Arriza, Lovieanta and Garcia, Mark Lester B. and Rizarni, Aulia Noor (2025) Unpacking the Reading Subtest of ProTEFL: A 4PL IRT Model Study. Journal of Technological Pedagogy and Educational Development, 2 (2). pp. 42-56.

Text 27-116-3-PB.pdf Download (983kB)

Abstract

Reading comprehension is one of the key skills assessed in English language proficiency tests. However, many test items used in schools often fail to meet the expected psychometric standards, which can affect the accuracy of ability measurement. This study addresses the issue by evaluating the psychometric characteristics of the reading skill items in the ProTEFL instrument using an Item Response Theory (IRT) approach. This study contributes to the development of a high-quality standardized item bank for reading comprehension assessment and highlights the usefulness of the 4PL model for identifying problematic items. A quantitative descriptive method was employed through the analysis of 50 multiple-choice reading items from the ProTEFL. Responses from 8,038 test-takers were analyzed by checking sample adequacy, testing IRT assumptions, selecting model fits, and estimating item parameters. The results showed that the 4PL model provided the best fit (AIC = 468506.9; BIC = 469905.3; logLik = 234053.4), with 43 items meeting unidimensionality, local independence, and parameter invariance. About 70% of the items had good discrimination power, item difficulty was well distributed between 0 and 2 logits, pseudo-guessing values were mostly low, and 33% of items exhibited high upper asymptotes, indicating a risk of incorrect responses even by high-ability test-takers. These findings underscore the usefulness of the 4PL model in detecting flawed items and improving item quality. The study contributes to the refinement of the ProTEFL reading item bank and provides implications for developing valid and reliable language assessment instruments. Further research is recommended to apply multidimensional IRT models to cover other English language domains beyond reading.

Item Type:	Artikel Umum
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering
Divisi / Prodi:	Faculty of Industrial Technology (Fakultas Teknologi Industri) > S1-Electrical Engineering (S1-Teknik Elektro)
Depositing User:	M.Eng. Alfian Ma'arif
Date Deposited:	03 Oct 2025 01:17
Last Modified:	03 Oct 2025 01:17
URI:	http://eprints.uad.ac.id/id/eprint/88295
Dosen Pembimbing:	UNSPECIFIED | [error in script]

Actions (login required)

View Item