Measuring Educational Outcomes with Reliability and Validity - 12/2/2024

Includes a Live Web Event on 12/02/2024 at 3:00 PM (EST)

This workshop introduces participants to the principles of score reliability and validity, using a combination of didactics and review of medical education research projects. The workshop is divided into two parts with group exercises designed to reinforce understanding of the main principles.

After participating in this workshop, learners will be able to:

  1. Identify three types of reliability (inter-rater, test-retest, and internal consistency);
  2. Match types of reliability with appropriate statistical measures;
  3. Describe the relationship between reliability and validity;
  4. Describe multiple forms of evidence for validity;
  5. Select an approach to reliability and validity assessment for a particular study.

Recordings will be made available for viewing following the completion of each workshop. Viewing of recordings may not be substituted for participation in live workshops.

This workshop is a part of the MERC Virtual Workshop 2024 - Series 4.

Cayla Teal

Dr. Cayla R. Teal is the Associate Dean for Assessment and Evaluation and an Education Associate Professor in the Department of Population Health at the University of Kansas School of Medicine (KUSOM).  Dr. Teal received her B.A. degree in Chemistry from William Jewell College and her M.A. and Ph.D. in Community/Clinical Psychology from Wichita State University, with emphases in applied research methods and psychometrics. She completed a post-doctoral fellowship in Health Services Research at the Center of Innovation in Quality, Effectiveness and Safety at the Michael E. DeBakey Houston VA Medical Center.  She served as the Director of Educational Evaluation and Research at Baylor College of Medicine and an Assistant Dean for Academic Affairs and Associate Dean for Evaluation and Assessment at Texas A&M College of Medicine prior to coming to KUSOM.  Dr. Teal is responsible for the assessment of student performance in and program evaluation of the KUSOM’s curriculum and a member of its continuous quality improvement team.  She is a mixed-methods medical education researcher, an Associate Editor for Medical Education Online, a Deputy Editor for Teaching and Learning in Medicine, teaching faculty for AAMC Medical Education Research Certificate (MERC) program, and a 2022 AMA Scholar in Health Systems Science.  Dr. Teal recently completed her two-year term as the national chair for the Medical Education Scholarship, Research and Evaluation (MESRE) section at the AAMC’s Group on Educational Affairs (GEA) and serves as the Treasurer for the Society of Directors of Research in Medical Education (SDRME). 


Measuring Educational Outcomes with Reliability and Validity - Workshop - 12/2/2024
12/02/2024 at 3:00 PM (EST)  |  180 minutes
12/02/2024 at 3:00 PM (EST)  |  180 minutes
MERC Workshop Evaluation: Measuring Educational Outcomes - 12/2/2024
12 Questions