Files in this item



application/pdfGUO-DISSERTATION-2016.pdf (694kB)
(no description provided)PDF


Title:Item parameter drift and online calibration
Author(s):Guo, Rui
Director of Research:Chang, Hua-Hua
Doctoral Committee Chair(s):Chang, Hua-Hua
Doctoral Committee Member(s):Culpepper, Steven Andrew; Douglas, Jeffrey A.; Hubert, Lawrence J.; Koehn, Hans-Friedrich
Department / Program:Psychology
Degree Granting Institution:University of Illinois at Urbana-Champaign
Subject(s):Item parameter drift
Online calibration
Multidimensional item response theory
Computerized adaptive testing
Abstract:An important assumption of item response theory based computerized adaptive assessment is item parameter invariance. Sometimes, however, item parameters are not invariant across different test administrations due to factors other than sampling error; and this phenomenon is termed item parameter drift. Several methods have been developed to detect drifted items, and most of the them were designed to detect drifts in the unidimensional item response model under the paper and pencil testing framework, which may not be adequate for computerized adaptive testing. This paper introduces an online (re)calibration design to detect item parameter drift for computerized adaptive testings in both unidimensional and multidimensional environment. Specifically, for online calibra- tion optimal design in unidimensional computerized adaptive testing model, a modified two-stage design is proposed by implementing a proportional density index algorithm. For a multidimensional computerized adaptive testing model, a four-quadrant online calibration pretest item selection design with proportional density index algorithm is proposed. Comparisons were made between different online calibration item selection strategies. Results showed that under unidimensional computerized adaptive testing, the pro- posed modified two-stage item selection criterion with proportional density algorithm outperformed the other existing methods in terms of item parameter calibration and item parameter drift detection, and un- der multidimensional computerized adaptive testing, the online (re)calibration technique with the proposed four-quadrant item selection design with proportional density index outperformed other methods.
Issue Date:2016-04-22
Rights Information:Copyright 2016 Rui Guo
Date Available in IDEALS:2016-07-07
Date Deposited:2016-05

This item appears in the following Collection(s)

Item Statistics