Psychometric Evaluation of Cloze Tests with the Rasch Model

Abdulridah Dhyaaldian, Safa Mohammed; Hasan Al-Zubaidi, Sura; A. Mutlak, Dhameer; Raheem Neamah, Nour; ALI ALBEER, ALI A. MOHAMMED; A. Hamad, Doaa; Fadhil Al Hasani, Saad; Musa Jaber, Mustafa; Ghaleb Maabreh, Hatem

doi:10.22034/ijlt.2022.157127

Psychometric Evaluation of Cloze Tests with the Rasch Model

Document Type : Original Research Article

Authors

Safa mohammed abdulridah dhyaaldian ¹

Sura Hasan Al-Zubaidi ²

Dhameer A. Mutlak ³

Nour Raheem Neamah ⁴

ALI A. MOHAMMED ALI ALBEER ⁵

Doaa A. Hamad ⁶

Saad Fadhil Al Hasani ⁷

Mustafa Musa Jaber ⁸

Hatem Ghaleb Maabreh ⁹

¹ University of Warith Al-Anbiyaa, Karbala, Iraq

² Anesthesia Techniques Department, Al-Mustaqbal University College, Babylon, Iraq

³ Al-Nisour University College/Baghdad/Iraq

⁴ Al-Manara College For Medical Sciences (maysan)/Iraq

⁵ Department of Pharmacy, Al-Zahrawi University College, Karbala, Iraq

⁶ Nursing Department, Hilla University College, Babylon, Iraq.

⁷ Al-Esraa University College, Baghdad, Iraq

⁸ 8a Department of Medical instruments engineering techniques, Dijlah University College, Baghdad,10021, Iraq 8b Department of Medical instruments engineering techniques, Al-Farahidi University, Baghdad,10021, Iraq

⁹ People’s friendship university of Russia,Moscow,Russia.

10.22034/ijlt.2022.157127

Abstract

Cloze tests are gap-filling tests designed to measure overall language ability and reading comprehension in a second language. Due to their ease of construction and scoring, cloze tests are widely used in the context of second and foreign language testing. Previous research over the past decades has shown the reliability and validity of cloze tests in different contexts. However, due to the interdependent structure of cloze test items, item response theory models have not been applied to analyze cloze tests. In this research, we apply a method to circumvent the problem of local dependence for analyzing cloze tests with the Rasch model. Using this method, we applied the Rasch model to a cloze test composed of eight passages each containing 8-15 gaps. Findings showed that the Rasch model fits the data and thus it is possible to scale persons and cloze passages on an interval unidimensional scale. The test had a high reliability and was well-targeted to the examinees. Implications of the study are discussed.

Keywords

Cloze test

Local item dependence

Rasch model

Unidimensionality

Validity