International Journal of Language Testing

International Journal of Language Testing

Cognitive Diagnostic Modeling Analysis of the Reading Comprehension Section of an Iranian High-stakes Language Proficiency Test

Document Type : Original Research Article

Authors
Ali Akbar Boori 1
Mohammad Ghazanfari 2
Behzad Ghonsooly 3
Purya Baghaei 4
1 English Departmrnt, Ferdowsi University of Mashhad
2 English Department, Ferdowsi University of Mashhad
3 Professor of Applied Linguistics; Department of English Language and Literature, Ferdowsi University of Mashhad, Mashhad.
4 English Department, Islamic Azad University of Mashhad, Mashhad, Iran.
10.22034/ijlt.2023.399561.1256
Abstract
The purpose of this study was to compare the functioning of five restrictive CDMs, including DINA, DINO, A-CDM, LLM, and RRUM, against the G-DINA model to identify the best-fitting CDM which can better explain the interaction underlying the attributes of the reading comprehension section of an Iranian high-stakes language proficiency test. To achieve this aim, item responses of 1152 examinees to the items of the test were examined. The six CDMs were initially compared in terms of relative and absolute fit statistics at test-level to choose the best model. It was found that the G-DINA model outperformed compared to the restrictive models; thus, it was selected for the second phase of the study. Concerning the second purpose of the study, the G-DINA was used to identify strengths and weaknesses of the examinees. The results revealed that making an inference and vocabulary are the hardest attributes for examinees of the test, and understanding the specific information is the easiest attribute. Finally, the models were also compared at item-level. The presence of a combination of L2 reading attributes was found.
Keywords
Reading comprehension attributes
CDMs
G-DINA
compensatory
non-compensatory
International Journal of Language Testing
Volume 14, Issue 1
March 2024
Pages 17-33