Digital Module 14: Planning and Conducting Standard Setting

5 (2 votes)

Recorded On: 05/30/2020

In this digital ITEMS module, Dr. Michael B. Bunch provides an in-depth, step-by-step look at how standard setting is done. It does not focus on any specific procedure or methodology (e.g., modified Angoff, bookmark, body of work) but on the practical tasks that must be completed for any standard setting activity. Dr. Bunch carries the participant through every stage of the standard setting process, from developing a plan, through preparations for standard setting, conducting standard setting, and all the follow-up activities that must occur after standard setting in order to obtain approval of cut scores and translate those cut scores into score reports. The digital module includes a 120-page manual, various ancillary files (e.g., PowerPoint slides, Excel workbooks, sample documents and forms), links to datasets from the book Standard Setting (Cizek & Bunch, 2007), links to final reports from four recent large-scale standard setting events, quiz questions with formative feedback, and a glossary.

Keywords: achievement level descriptor, certification and licensure, cut score, feedback, interquartile range, performance level descriptor, score reporting, standard setting, panelist, vertical articulation 

Key:

Complete
Failed
Available
Locked
DM14 (Version 1.0)
Select the "View On-Demand Recording" button to begin.
Select the "View On-Demand Recording" button to begin. Full interactive module with all videos, quizzes, and resources.
VIDEO DM14 (Introduction, Version 1.0)
Open to view video.
Open to view video. Video version of the introductory part without video-based instructor and designer profiles. [4 Minutes]
VIDEO DM14 (Section 1, Version 1.0)
Open to view video.
Open to view video. Video version of the first content section. [8 Minutes]
VIDEO DM14 (Section 2, Version 1.0)
Open to view video.
Open to view video. Video version of the second content section. [50 Minutes]
VIDEO DM14 (Section 3, Version 1.0)
Open to view video.
Open to view video. Video version of the third content section. [60 Minutes]
VIDEO DM14 (Section 4, Version 1.0)
Open to view video.
Open to view video. Video version of the fourth content section. [35 Minutes]
DM14 (All Materials)
Open to download resource.
Open to download resource. Single ZIP folder with three subfolders containing (1) all main documents, (2) all worksheets, and (3) all supplementary PowerPoint presentations.

Michael B. Bunch

Senior Vice President, Measurement Incorporated

Mike joined Measurement Incorporated (MI) as director of test development in 1982. Prior to that time, he was a research psychologist at ACT (1976-78) and senior professional at NTS Research (1978-82). At MI he was soon promoted to vice president for research and development and later to senior vice president. He currently serves on MI’s board of directors and continues to direct MI’s psychometric team. While still employed by MI, Mike taught graduate courses in statistics and research methods at North Carolina Central University for six years and a mini-course on standard setting through the University of Maryland. He has presented several half-day and full-day training sessions on standard setting at NCME and other national and international organizations. In addition, he co-authored of Standard Setting: A Guide to Establishing and Evaluating Performance Standards on Tests with Gregory J. Cizek (2007) as well as various other articles and book chapters on standard setting. He has planned and carried out some of the largest and most complex standard setting events ever conceived.

Contact Mike via MBunch@measinc.com