International Journal of Language Testing

International Journal of Language Testing

Investigating Gender DIF in the Reading Comprehension Section of the B2 First Exam

Document Type : Original Research Article

Authors
Chairil Anwar Korompot 1
Iskandarsyah Siregar 2
Nurislom Iskandarovich Khursanov 3
Diyorjon Abdullaev 4
Khaled M Mohamed 5
1 English Language Education, Universitas Negeri Makassar, Makassar, Indonesia
2 Faculty of Language and Literature, Universitas Nasional, Indonesia
3 Doctor of Philosophy (PhD) in Philological Sciences, Renaissance University of Education, Tashkent, Uzbekistan
4 Innovations and Training of Scientific Pedagogical Personnel, Urganch State Pedagogical Institute, Urganch, Uzbekistan.
5 College of Mass Communications, Ajman University Ajman, 346, UAE
10.22034/ijlt.2023.421011.1301
Abstract
Construct-irrelevant variance is considered as a major threat to validity which indicates the existence of additional unrelated variables that distort the meaning of test scores and cause the test to be biased. Differential item functioning (DIF) analysis is an important technique in examining the validity and fairness of educational tests. Concerning the importance of test fairness in large-scale exams, this study aimed to (1) detect gender DIF in the reading comprehension section of the B2 First exam using the Rasch model and Mantel-Haenszel method, and (2) investigate the comparability of results from the two DIF detection techniques. To this end, the reading section of the B2 First exam was administered to 207 undergraduate students of English as a foreign language (EFL). After checking the fit of the data to the Rasch model, the results of the Rasch model-based DIF analysis showed the presence of two items indicating DIF, whereas the results of Mantel-Haenszel showed that there were three gender-DIF items.
Keywords
Fairness
Gender
Mantel-Haenszel
Rasch model
Reading comprehension
International Journal of Language Testing
Volume 14, Issue 2
October 2024
Pages 57-66