Digital Module 09: Sociocognitive Assessment for Diverse Populations

5 (5 votes)

In this digital ITEMS module, Dr. Robert [Bob] Mislevy and Dr. Maria Elena Oliveri introduce and illustrate a sociocognitive perspective on educational measurement, which focuses on a variety of design and implementation considerations for creating fair and valid assessments for learners from diverse populations with diverse sociocultural experiences. The first part of the module, narrated by Dr. Mislevy, contains a general overview section, a description of the sociocognitive framing of assessment issues, and a section on implications for assessment around key concepts such as reliability, validity, and fairness. The second part of the module, narrated by Dr. Oliveri, contains a section on frameworks for fairness investigations and principled assessment design as well as brief vignette-based illustrations of the principles using a prototype activity to support collaboration and communication skills in the workplace. The module is designed to provide a relatively high-level, conceptual, and non-statistical overview and is intended for interdisciplinary team members who need to create fair and equitable learning and assessment systems for diverse populations.

Keywords: assessment design, Bayesian statistics, cross-cultural assessment, diverse populations, educational measurement, evidence-centered design, fairness, international assessments, prototype, reliability, sociocognitive assessment, validity

Module Overview

Core Slides

Key:

Complete

Failed

Available

Locked

Digital Module

Recorded 08/28/2019

Recorded 08/28/2019 Full interactive module with all content sections and resources. This version replaces the "sneak peek" version that contained only Dr. Mislevy's part.

You must register to access.

DM09 VIDEO (Sociocognitive Assessment, Version 2.0)

Open to view video.

Open to view video. A video version of all five content sections of the module [about 2 hours].

You must register to access.

Bob Mislevy

Lord Chair in Measurement and Statistics

Dr. Robert [Bob] Mislevy is the Frederic M. Lord Chair in Measurement and Statistics at Educational Testing Service as well as Professor Emeritus of Measurement, Statistics, and Evaluation at the University of Maryland, with affiliations with Second Language Acquisition and Survey Methods. Dr. Mislevy’s research applies developments in statistics, technology, and cognitive science to practical problems in educational assessment. His work includes a multiple-imputation approach to integrate sampling and psychometric models in the National Assessment of Educational Progress (NAEP), an evidence-centered framework for assessment design, and simulation- and game-based assessment with the Cisco Networking Academy. Among his many awards are AERA’s Raymond B. Cattell Early Career Award for Programmatic Research, NCME’s Triennial Award for Technical Contributions to Educational Measurement (3 times), NCME’s Award for Career Contributions, AERA’s E.F. Lindquist Award for contributions to educational assessment, the International Language Testing Association's Messick Lecture Award, and AERA Division D’s inaugural Robert L. Linn Distinguished Address Award. He is a member of the National Academy of Education and a past president of the Psychometric Society. He has served on projects for the National Research Council, the Spencer Foundation, and the MacArthur Foundation concerning assessment, learning, and cognitive psychology, and on the Gordon Commission on the Future of Educational Assessment. His most recent book is "Sociocognitive Foundations of Educational Assessment" for which he received the 2019 NCME Annual Award and on which this ITEMS module is based.

Contact Bob via rmislevy@ets.org

Maria Elena Oliveri

Research Scientist

Dr. María Elena Oliveri is a Research Scientist in the Academic to Career research center at the Educational Testing Service (ETS). Her research focuses on fairness, validity, diversity, equity, and innovative assessment design and development of competency-based digital formative assessments of 21^st century skills. She has actively disseminated her research in numerous published articles in journals such as Applied Measurement in Education and the International Journal of Testing; she has led various professional development workshops at national and international conferences such as AERA, NCME, and ITC; and she has presented at numerous national and international conferences. In earlier stages of her career, she was a literacy mentor to second-language teachers in the Vancouver School District as well as a teacher of second language learners and students with disabilities and she has hosted workshops for educators on innovative approaches to assessing culturally and linguistically diverse learners. She also was a lecturer at the University of British Columbia, Vancouver, Canada where she taught courses on assessment and developmental psychology to students pursuing Bachelor of Education degrees in French Immersion programs.

Contact Malena via moliveri@ets.org