Module 34: Automated Item Generation

5 (1 vote)

Changes to the design and development of our educational assessments are resulting in the unprecedented demand for a large and continuous supply of content-specific test items. One way to address this growing demand is with automatic item generation (AIG). AIG is the process of using item models to generate test items with the aid of computer technology. The purpose of this module is to describe and illustrate a template-based method for generating test items. We outline a three-step approach where test development specialists first create an item model. An item model is like a mould or rendering that highlights the features in an assessment task that must be manipulated to produce new items. Next, the content used for item generation is identified and structured. Finally, features in the item model are systematically manipulated with computer-based algorithms to generate new items. Using this template-based approach, hundreds or even thousands of new items can be generated with a single item model.

Keywords: automatic item generation, AIG, item model, item development, test development, technology and testing

Mark J.Gierl

Professor, Centre for Research in Applied Measurement and Evaluation, Faculty of Education, University of Alberta, Edmonton, AB, Canada

Dr. Gierl's research interests include Educational and psychological measurement, focusing on assessment engineering, including cognitive modeling, automatic item generation, automated test assembly, and automatic essay scoring; cognitive diagnostic assessment; differential item and bundle functioning; unidimensional and multidimensional item response theory; psychometric methods for evaluating test translation and adaptation.

Hollis Lai

Centre for Research in Applied Measurement and Evaluation, Faculty of Education, University of Alberta, Edmonton, AB, Canada

Dr. Lai's research interests include Technology in Assessment, Automatic Item Generation, Computer Adaptive Testing, Assessment in Medical Education, Cognitive Diagnostic Assessment, Learning Science, Applications of Artificial Intelligence in Education

Key:

Complete
Failed
Available
Locked
Module 34: Instructional Topics in Educational Measurement (ITEMS) Module: Using Automated Processes to Generate Test Items
Open to download resource.
Open to download resource.