CREATIVE MEASUREMENT SOLUTIONS LLC
  • Home
  • Bio & Vita
  • Contact
  • Blog

Bio & Vita

Daniel Lewis is Founder & Chief Scientist at Creative Measurement Solutions LLC, where he is actively engaged in confronting measurement and assessment challenges for partners in the industry. His current research—Embedded Standard Setting (Lewis & Cook, 2020)—characterizes his problem-solving strategy: Create simple, efficient, effective, and esthetic solutions that meet essential requirements.

Dan taught elementary school in NE Ohio and mathematics at Kent State University before resolving his dual interest in education and mathematics by completing his Ph.D. in Educational Measurement. He taught educational research methods as an Associate Faculty Member in the Kent State Graduate School of Education until joining CTB/McGraw-Hill in 1995. Dr. Lewis remained with CTB for 20 years, ultimately as Chief Research Advisor, supporting the technical foundations of CTB products and working with state departments of education on test design, reporting, and policy issues. In 1995, Dr. Lewis and Dr. Howard Mitzel (deceased) developed the Bookmark Standard Setting Procedure, an IRT-based method for setting performance standards that has been used by a majority of state education departments, the CIA, Google, and other nations.

Dr. Lewis' subsequent research was foundational to Vertically Moderated Standard Setting (VMSS); his contribution to a special VMSS volume of Applied Measurement in Education earned a 2006 AERA Division D Award for Significant Contributions to Educational Measurement. Following his tenure at CTB, Daniel served as Principal Research Scientist at Pacific Metrics and ACT.

Dan's latest work--Embedded Standard Setting (Lewis & Cook, 2020)--embeds standard setting within principled assessment design, resulting in cut scores that emerge organically from existing test development practices and changing the nature and significantly reducing the scope of, or eliminating, the standard setting workshop. This is expected to result in (a) additional support for the assessment validity argument, (b) improved item and test alignment, (c) defensible cut scores, and (d) significant cost savings for sponsoring agencies.

Daniel and his wife (and business associate), Laura, live in Carmel, CA with their mini-Aussie, Lily.
DANIEL LEWIS, PH.D.
Mobile: 831-601-8555     email: Dan.Lewis@CreativeMeasurement.com

                                                                                                                         EDUCATION
Ph.D.     Evaluation and Measurement                                        Kent State University,  Kent, OH             1995
                                                       
M.A.     Pure Mathematics                                                              Kent State University,  Kent, OH             1987                                                                                                              

B.S.     Elementary Education                                                        Kent State University,  Kent, OH             1980                                                                                                              

                                                                                                             PROFESSIONAL EXPERIENCE
 
Chief Scientist                                                                             Creative Measurement Solutions LLC          July 2019-Present                                                                                 

Principal Research Scientist                                                                  ACT & Pacific Metrics                           2015-2019                                                                                                               
        
Chief Research Advisor                                                                             CTB/McGraw-Hill                                1995-2015                                                                                                                 

  • Co-developed the Bookmark Standard Setting Procedure and Embedded Standard Setting
  • Facilitated standard settings for Smarter Balanced, ELPA21, and numerous state summative testing programs
  • Supported state departments of education in aligning assessment design with state policy
  • Supported the design and development of successful new shelf products
  • Conducted research on standard setting and score reporting
                                                                                             REFEREED PUBLICATIONS AND BOOK CHAPTERS
 
Lewis, D. & Cook, R. (2020). Embedded Standard Setting: Aligning standard setting methodology with contemporary assessment design principles.  Educational Measurement: Issues and Practices, 39(1), 8-21.
Lewis, D. & Lord-Bessen, J. (2018). Standard setting. Chapter in W. J. van der Linden (Ed.), Handbook of item response theory: Vol. 3. Applications. Boca Raton, FL: Chapman & Hall/CRC.
Lewis, D. (2018). Bookmark Method of Standard Setting. Entry in the SAGE Encyclopedia of Educational Research, Measurement, and Evaluation. Sage  Publications, Inc.
Lewis, D. M., Mitzel, H. C., Mercado, R. & Schulz, M. (2012). The Bookmark Standard Setting Procedure. Chapter in Setting Performance Standards: Concepts, Methods, and Perspectives, Second Edition. (ed: G. J. Cizek), Lawrence Erlbaum.
Ferrara, S. & Lewis, D. M. (2012). The Item Descriptor Matching Standard Setting Procedure. Chapter in Setting Performance Standards: Concepts, Methods, and Perspectives, Second Edition. (ed: G. J. Cizek), Lawrence Erlbaum.
Ho, A., Lewis, D. M., & MacGregor Farris, J. L. (2009). The dependence of growth model results on proficiency cut scores. Educational Measurement Issues and Practices 28:4.
 Lee, G. & Lewis, D. M. (2008). A generalizability theory approach to standard error estimates for Bookmark standard settings. Educational and Psychological Measurement, August 2008, vol. 68 no. 4 603-620.
Lewis, D. M. & Haug, C. (2005). Aligning policy and methodology to achieve consistent across-grade performance standards. Applied Measurement in Education, v18 n1 p11-34.
Green, D. R., Trimble, S., & Lewis, D. M. (2003). Interpreting the results of three different standards setting procedures. Educational Measurement: Issues and Practices, V 22, 1, 22-32.
Hartung, P. J., Lewis, D. M., May, K., & Niles, S. G. (2002). Family interaction patterns and college student career development. Journal of Career Assessment. 10(1) 78-90.
Mitzel, H. C., Lewis, D. M., Patz, R. J., & Green, D. R. (2000). The Bookmark Procedure: Cognitive perspectives on standard setting. Chapter in Setting Performance Standards: Concepts, Methods, and Perspectives, (ed: G. J. Cizek), Lawrence Erlbaum.
Niles, S. G., Lewis, D. M., & Hartung, P. J. (1997). Using the Adult Career Concerns Inventory to measure task involvement. The Career Development Quarterly, 46, 87-97.
Lewis, D. M., Savickas, M. L., & Jones, B. J. (1996). Career development predicts medical school success. The Journal of Vocational Behavior, v49, 86-98.
Lewis, D. M. & Cuevas, N. M. (1996). Validity and reliability issues in published public health and social policy research. Co-published simultaneously in Journal of Health & Social Policy, v8, 23-38, and as a chapter in Selected Practical Problems in Health and Social Research, 23-38, (ed: T. E. Dinero), The Hayworth Press, Inc.
Hartung, P. J., Speight, J. D., & Lewis, D. M. (1996). Individualism-collectivism and the career behavior of majority college students. The Career Development Quarterly, v45, 87-96.
Lewis, D. M. & Savickas, M. L. (1995). Validity of the Career Factors Inventory. The Journal of Career Assessment, v3, 44-56.
                                                                                                                          HONORS & AWARDS
  • American Education Research Association Division D Award for Significant Contribution to Educational Measurement                                                  2006
  • CTB/McGraw-Hill Employee of the Year                                                                                                                                                                                                    1996
  • Kent State University Graduate College of Education Annual Dissertation Award                                                                                                                         1995
Request a full vita: Dan.Lewis@CreativeMeasurement.com
Site powered by Weebly. Managed by Hostgator
  • Home
  • Bio & Vita
  • Contact
  • Blog