Explore the moving sample size used in a procedure for detecting compromised items based on item response theory
Jie, Yongjing
Loading…
Permalink
https://hdl.handle.net/2142/99519
Description
Title
Explore the moving sample size used in a procedure for detecting compromised items based on item response theory
Author(s)
Jie, Yongjing
Issue Date
2017-12-11
Director of Research (if dissertation) or Advisor (if thesis)
Zhang, Jinming
Committee Member(s)
Chang, Hua-Hua
Anderson, Carolyn J.
Department of Study
Educational Psychology
Discipline
Educational Psychology
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Keyword(s)
Item Response Theory (IRT)-based detection procedure
Moving sample size
Power
Lag
Abstract
A computerized adaptive testing (CAT) system can provide tests for examinees continuously, so items in the item bank face the risk of being leaked. The IRT-based detection procedure developed by Zhang and Li (2016) is further studied in this thesis, which is designed to identify compromised items via a series of hypothesis tests. The moving sample size m in the Zhang and Li procedure is very important because it can affect the lag and the power of the procedure in identifying compromised items. In this thesis, the author will explore the relationship between the moving sample size and the lag, and the relationship between the moving sample size and the power. The simulation results indicate that at the significance level of 0.05, moving sample size m has an exponential relationship with the lag, and has a quadratic relationship with the power. At the significance level of 0.01, moving sample size m has a logarithmic relationship with the lag, and has a cubic relationship with the power. The author attempts to find an appropriate value of moving sample size m to achieve a large value of the power and a small value of the lag. The simulation results show that at both significance levels 0.05 and 0.01, setting the moving sample size m to 200 can accomplish the mission, while setting moving sample size m to 10 will decrease the performance of the procedure in the case that the significance level is 0.05.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
