Attention: You need to quickly create a (free!) user account within the Elevate learning management system (this website) to access any modules - you do NOT have to be an NCME member to do this. 

Assessment Development

All-access Pass
This provides immediate access to ALL print and digital modules in the portal by "registering" you for each and displaying all modules as a single collection as part of this pass.
Digital Module 08: Foundations of Operational Item Analysis
In this digital ITEMS module, Dr. Hanwook Yoo and Dr. Ronald K. Hambleton provide an accessible overview of operational item analysis approaches for dichotomously scored items within the frameworks of classical test theory and item response theory. Keywords: Classical test theory, CTT, corrections, difficulty, discrimination, distractors, item analysis, item response theory, operations, R Shiny, TAP, test development
Digital Module 09: Sociocognitive Assessment for Diverse Populations
In this digital ITEMS module, Dr. Robert [Bob] Mislevy and Dr. Maria Elena Oliveri introduce and illustrate a sociocognitive perspective on educational measurement, which focuses on a variety of design and implementation considerations for creating fair and valid assessments for learners from diverse populations with diverse sociocultural experiences. Keywords: assessment design, Bayesian statistics, cross-cultural assessment, diverse populations, educational measurement, evidence-centered design, fairness, international assessments, prototype, reliability, sociocognitive assessment, validity
Module 17: Item Bank Development
In this print module, Dr. Annie W. Ward and Dr. Mildred Murray-Ward help those who develop assessments of any kind to understand the process of item banking, to analyze their needs, and to find or develop programs and materials that meet those needs. Keywords: assessment development, item bank, item retrieval, item quality, parameter, standardized testing, ​test development
Module 18: Setting Passing Scores
In this print module, Dr. Gregory J. Cizek describes standard setting for achievement measures used in education, licensure, and certification. Keywords: cut score, Bookmark method, compromise method, Ebel method, examinee-based method, proficiency classification, standard setting, validity
Module 22: Standard Setting: Contemporary Methods
​In this print module, Dr. Gregory J. Cizek, Dr. Michael B. Bunch, and Dr. Heather Koons describe some common standard-setting procedures used to derive performance levels for achievement tests in education, licensure, and certification. Keywords: achievement classification, certification, cut scores, licensure, performance standards, proficiency classification, standard setting
Module 23: Practice Analysis Questionnaires: Design and Administration
In this print module, Dr. Mark R. Raymond describes procedures for developing practice analysis surveys with emphasis on task inventory questionnaires for credentialing examinations. Keywords: certification, credentialing, job analysis. licensure, practice analysis, questionnaire, rating scales
Module 24: Quality Control for Scoring, Equating, and Reporting
In this print module, Dr. Avi Allalouf describes quality control (QC) as a formal systematic process designed to ensure that expected quality standards are achieved during scoring, equating, and reporting of test scores. Keywords: scoring, equating, errors, mistakes, score reporting, operational practice, quality control, reporting, standards
Module 25: Multistage Testing
In this print module, Dr. Amy Hendrickson describes multistage tests (MSTs), including two-stage and testlet-based tests, and discusses the relative advantages and disadvantages of multistage testing as well as considerations and steps in creating such tests. Keywords: adaptive testing, multistage testing, principled assessment design, scoring, testlet, two-stage tests
Module 30: Booklet Designs in Large-Scale Assessments
In this print module, Dr. Andreas Frey, Dr. Johannes Hartig, and Dr. Andre A. Rupp describe the construction of complex booklet designs as the task of allocating items to booklets under context-specific constraints for large-scale standardized assessments and educational surveys. Keywords: booklet design, educational survey, experimental design, item response theory, IRT, large-scale assessments, measurement
Module 34: Automated Item Generation
In this print module, Dr. Mark J. Gierl and Dr. Hollis Lai describe and illustrate a template-based method for automatically generating test items for large-scale production enterprises. Keywords: automatic item generation, AIG, item model, item development, test development, technology and testing
Module 44: Quality-control for Continuous Mode Tests
In this print module, Dr. Avi Allalouf, Dr. Tony Gutentag, and Dr. Michal Baumer discuss errors that might occur at the different stages of the continuous mode tests (CMT) process as well as the recommended quality-control (QC) procedure to reduce the incidence of each error. Keywords: automated review, computer-based testing, CBT, continuous mode tests, CMT, human review, quality control, QC, scoring, test administration, test analysis, test scoring