Digital Module 14: Planning and Conducting Standard Setting
Recorded On: 05/30/2020
In this digital ITEMS module, Dr. Michael B. Bunch provides an in-depth, step-by-step look at how standard setting is done. It does not focus on any specific procedure or methodology (e.g., modified Angoff, bookmark, body of work) but on the practical tasks that must be completed for any standard setting activity. Dr. Bunch carries the participant through every stage of the standard setting process, from developing a plan, through preparations for standard setting, conducting standard setting, and all the follow-up activities that must occur after standard setting in order to obtain approval of cut scores and translate those cut scores into score reports. The digital module includes a 120-page manual, various ancillary files (e.g., PowerPoint slides, Excel workbooks, sample documents and forms), links to datasets from the book Standard Setting (Cizek & Bunch, 2007), links to final reports from four recent large-scale standard setting events, quiz questions with formative feedback, and a glossary.
Keywords: achievement level descriptor, certification and licensure, cut score, feedback, interquartile range, performance level descriptor, score reporting, standard setting, panelist, vertical articulation
Michael B. Bunch
Senior Vice President, Measurement Incorporated
Mike joined Measurement Incorporated (MI) as director of test development in 1982. Prior to that time, he was a research psychologist at ACT (1976-78) and senior professional at NTS Research (1978-82). At MI he was soon promoted to vice president for research and development and later to senior vice president. He currently serves on MI’s board of directors and continues to direct MI’s psychometric team. While still employed by MI, Mike taught graduate courses in statistics and research methods at North Carolina Central University for six years and a mini-course on standard setting through the University of Maryland. He has presented several half-day and full-day training sessions on standard setting at NCME and other national and international organizations. In addition, he co-authored of Standard Setting: A Guide to Establishing and Evaluating Performance Standards on Tests with Gregory J. Cizek (2007) as well as various other articles and book chapters on standard setting. He has planned and carried out some of the largest and most complex standard setting events ever conceived.
Contact Mike via MBunch@measinc.com