University of Illinois Urbana-Champaign

The application of a cognitive diagnostic model on the test of practical Chinese

Tang, Xiuxiu

Permalink

https://hdl.handle.net/2142/105274

Description

Title
The application of a cognitive diagnostic model on the test of practical Chinese
Author(s)
Tang, Xiuxiu
Issue Date
2019-04-26
Director of Research (if dissertation) or Advisor (if thesis)
Zhang, Jinming
Committee Member(s)
  • Anderson, Carolyn
  • Kern, Justin
Department of Study
Educational Psychology
Discipline
Educational Psychology
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Keyword(s)
  • CDM
  • Q-matrix
Abstract
Cognitive Diagnostic Models (CDMs) are frequently used in the second language proficiency exams to analyze test takers’ strengths and weaknesses. This study retrofits a CDM known as the Fusion model onto a non-diagnostic test data from the reading comprehension test of the Test of Practical Chinese (C.TEST). It focuses on the construction and modification of the Q-matrix which specifies the relationship between test items and attributes needed to answer each item correctly. There are three stages in this study: (1) identifying reading attributes, (2) constructing the initial Q-matrix, and (3) modifying the initial Q-matrix. In the first stage, six reading attributes were identified based on literature review and 3 experts’ judgment. In the second stage, test items were carefully reviewed by three experts, and then the initial Q-matrix was created by them. In the third stage, item parameters and model fit statistics were evaluated to refine the Q-matrix. Four item parameters, r11.3, c2, c6, c27, were dropped from the Fusion model. Results suggest that the refined Q-matrix is well-defined, and it can be applied to the C.TEST reading test since it has a good model fit and is able to effectively distinguish item masters from item non-masters.
Graduation Semester
2019-05
Type of Resource
text
Permalink
http://hdl.handle.net/2142/105274
Copyright and License Information
Copyright 2019 Xiuxiu Tang

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois
Dissertations and Theses - Education
Dissertations and Theses from the College of Education