Measuring Educational Outcomes with Reliability and Validity - 3/3/2025
Includes a Live Web Event on 03/03/2025 at 12:00 PM (EST)
-
Register
- User - $125
This workshop introduces participants to the principles of score reliability and validity, using a combination of didactics and review of medical education research projects. The workshop is divided into two parts with group exercises designed to reinforce understanding of the main principles.
After participating in this workshop, learners will be able to:
- Identify three types of reliability (inter-rater, test-retest, and internal consistency);
- Match types of reliability with appropriate statistical measures;
- Describe the relationship between reliability and validity;
- Describe multiple forms of evidence for validity;
- Select an approach to reliability and validity assessment for a particular study.
Recordings will be made available for viewing following the completion of each workshop. Viewing of recordings may not be substituted for participation in live workshops.
This workshop is a part of the MERC Virtual Workshop 2025 - Series 1.
Jorie Colbert Getz
Jorie Colbert-Getz, PhD, MS, is Associate Professor in Internal Medicine and the Assistant Dean of Education Quality Improvement for the Spencer Fox Eccles School of Medicine at the University of Utah School of Medicine. She is also an adjunct faculty member for Johns Hopkins Masters of Education in the Health Professions. At the national level, Dr. Colbert-Getz serves on the Research in Medical Education (RIME) program planning committee. She has also served on the executive committee for the Society of Directors of Research in Medical Education, was the Medical Education Scholarship, Research, and Evaluation chair for the Western Region Group on Education Affairs and was the founding director of the Learning Community Institute Research Network. She has over 50 publications in medical education, mostly focused on assessment. Her overarching mission is to ensure assessments measure developmentally appropriate learning objectives / milestones. To that end, her research focuses on validity frameworks and other elements of assessment utility, survey design, and program evaluation. Dr. Colbert-Getz received her MS degree in Psychology from Illinois State University and her PhD degree in Educational Psychology from the University of Utah.