A Comparison of Polytomous Rasch Models for the Analysis of C-Tests

Kadhim, Qasim Khlaif; Abdulridah, Safa Mohammed; Mutlak, Dhameer A.; Neamah, Nour Raheem; Kareem, Zaidoon Hussein; Hamad, Doaa A.; Tuama, Jassim Hassan; Qasim, Mohammed Saad

doi:10.22034/ijlt.2022.157128

A Comparison of Polytomous Rasch Models for the Analysis of C-Tests

Document Type : Original Research Article

Authors

Qasim Khlaif Kadhim ¹

Safa Mohammed Abdulridah ²

Dhameer A. Mutlak ³

Nour Raheem Neamah ⁴

Zaidoon Hussein Kareem ⁵

Doaa A. Hamad ⁶

Jassim Hassan Tuama ⁷

Mohammed Saad Qasim ⁸

¹ English Language Department, Al-Mustaqbal University College, Babylon, Iraq

² University of Warith Al-Anbiyaa, Karbala, Iraq

³ Al-Nisour University College/Baghdad/Iraq

⁴ Al-Manara College for Medical Sciences (Maysan)/Iraq

⁵ Department of Medical Laboratory Technics, Al-Zahrawi University College, Karbala, Iraq

⁶ Nursing Department, Hilla University College, Babylon, Iraq.

⁷ Altoosi University College, Najaf, Iraq

⁸ Al-Esraa University College, Baghdad, Iraq

10.22034/ijlt.2022.157128

Abstract

A C-Test is a gap-filling test for measuring language competence in the first and second language. C-Tests are usually analyzed with polytomous Rasch models by considering each passage as a super-item or testlet. This strategy helps overcome the local dependence inherent in C-Test gaps. However, there is little research on the best polytomous Rasch model for C-Tests. In this study, the Rating Scale Model (RSM) and the Partial Credit Model (PCM) for analyzing C-Tests were compared. To this end, a C-Test composed of six passages with both RSM and PCM was analyzed. The models were compared in terms of overall fit, individual item fit, dimensionality, test targeting, and reliability. Findings showed that, although the PCM has a better overall fit compared to the RSM, both models produce similar test statistics. In light of the findings of the study, the choice of the best Rasch model for C-Tests will be discussed.

Keywords

C-test

local item dependence

rating scale model

partial credit model

unidimensionality