Digital Module 21: Results Reporting for Large-scale Assessments

Product not yet rated

Recorded On: 01/21/2021

In this digital ITEMS module, Dr. Francis O’Donnell and Dr. April Zenisky provide a firm grounding in the conceptual and operational considerations around results reporting for summative large-scale assessment. They anchor the module in the position that results reporting must be approached as a data-driven story that is purposefully designed to communicate specific information to accomplish specific goals. They further connect their overview to various aspects of validity and present different conceptual frameworks and practical models for report development. Throughout the module, they highlight research-grounded good practices, concluding with some principles and ideas around conducting reporting research. The module contains audio-narrated slides, an interview, interactive activities, and additional resources such as a glossary and reference documents.

Keywords: data, large-scale assessment, results, score reporting, validity, visualization

Key:

Complete
Failed
Available
Locked
DM21 (Results Reporting, Version 1.1)
Recorded 01/21/2021
Recorded 01/21/2021 Full version of the digital module with all interactive components and resources. Minor bug fixes and some audio enhancements relative to previous version.
DM21 VIDEO (Introduction, Version 1.0)
Open to view video.
Open to view video. Video version of the introduction section of the module. [4 Minutes]
DM21 VIDEO (Section 1, Version 1.0)
Open to view video.
Open to view video. Video version of the first content section of the module. [42 Minutes]
DM21 VIDEO (Section 2, Version 1.0)
Open to view video.
Open to view video. Video version of the second content section of the module. [27 Minutes]
DM21 VIDEO (Section 3, Version 1.0)
Open to view video.
Open to view video. Video version of the third content section of the module. [53 Minutes]
DM21 VIDEO (Section 4, Version 1.0)
Open to view video.
Open to view video. Video version of the fourth content section of the module. [34 Minutes]
DM21 VIDEO (Section 5, Version 1.0)
Open to view video.
Open to view video. Video version of the fifth content section of the module. [12 Minutes]

Francis O'Donnell

National Board of Medical Examiners

Francis O’Donnell is a psychometrician at the National Board of Medical Examiners. She earned her Ph.D. from the University of Massachusetts Amherst in Research, Educational Measurement, and Psychometrics in 2019. During her doctoral studies, she contributed to several projects on results reporting for K-12 and licensure assessments, which culminated in a dissertation about how teachers, parents, and students interpret achievement level labels. Francis’s research has been presented at multiple conferences and a book chapter she wrote with Dr. Stephen Sireci about reporting in credentialing and admissions contexts appears in Score Reporting: Research and Applications (Zapata-Rivera, 2018). In her current role, she oversees psychometric activities for medical education and certification examinations and researches topics such as validity, fairness, and innovative approaches to reporting results.

Contact Francis via fodonnell@nbme.org

April Zenisky

University of Massachusetts Amherst

April L. Zenisky is Research Associate Professor in the Department of Educational Policy, Research, and Administration in the College of Education at the University of Massachusetts (UMass) Amherst, and Director of Computer-Based Testing Initiatives in UMass’ Center for Educational Assessment (CEA). At UMass she leads and contributes to several externally-funded projects, and teaches courses and workshops on various topics, including test construction.  April’s main research interests include results reporting, technology-based item types, and computerized test designs. Her collaborative work on results reporting with Ronald K. Hambleton has advanced best practices for report development relative to both individual and group reporting and has explored emerging strategies for online reporting efforts. She has presented her research at various national and international conferences and has authored and co-authored a number of book chapters.

Contact April via azenisky@umass.edu