Psychometric Evaluation of Dictations with the Rasch Model

Document Type : Original Research Article

Authors

1 Al-Manara College for Medical Sciences (Maysan)/Iraq

2 Scientific Research Center, Al-Ayen University, Thi-Qar, Iraq

3 Medical Laboratory Techniques Department /Medical (Technology) College, Al-Farahidi University/Iraq

4 English Language Department, Al-Mustaqbal University College, Babylon, Iraq

5 Medical Laboratory Techniques Department, Dijlah University College, Iraq, Baghdad

6 Al-Nisour University College/ Iraq

7 College of technical Engineering, The Islamic University, Najaf, Iraq. Medical Laboratory Techniques Department, Al-Turath University College, Iraq

8 Department of Dentistry, Al-Zahrawi University College, Karbala, Iraq

9 Altoosi University College, Najaf , Iraq

10 Al-Esraa University College, Baghdad, Iraq

Abstract

Dictation is a traditional technique for both teaching and testing overall language ability and listening comprehension. In a dictation, a passage is read aloud by the teacher and examinees write down what they hear. Due to the peculiar form of dictations, psychometric analysis of dictations is challenging. In a dictation, there is no clear boundary between the items and every word in the text is potentially an item. This makes the analysis of dictations with classical and modern test theories rather difficult. In this study, we suggest a procedure to make dictations analyzable with psychometric models. Our strategy entailed using several independent short passages instead of a single long passage. The number of mistakes in each passage was counted and entered into the analysis. Rasch model analysis was then applied to the passage scores (mistakes). Our findings showed that dictations fit the Rasch model very well and it is possible to measure examinees’ ability on an interval scale using dictations.

Keywords