Universal Journal of Educational Research Vol. 3(7), pp. 451 - 459
DOI: 10.13189/ujer.2015.030704
Reprint (PDF) (390Kb)

Factors Affecting Item Difficulty in English Listening Comprehension Tests

Pei-Ju Sung , Su-Wei Lin ^*, Pi-Hsia Hung
Department of Education, National University of Tainan, Taiwan

ABSTRACT

Task difficulty is a critical issue affecting test developers. Controlling or balancing the item difficulty of an assessment improves its validity and discrimination. Test developers construct tests from the cognitive perspective, by making the test constructing process more scientific and efficient; thus, the scores obtained more precisely represent the proficiency level. In this paper, a framework of cognitive factors related to English listening comprehension (LC) tests is proposed. Data used were derived from the After School Alternative Program (ASAP) English test item pool. A total of 150 items were analyzed, and item difficulty was concurrently calibrated according to three-parameter-logistic item response theory from the responses of 1,459 fifth- to seventh-grade participants. Components affecting item difficulty were proposed and discussed with regard to the cognitive perspective. The 53.5% of variance in item difficulty of LC can be explained by the cognitive predicting model. This result is expected to make the task constructing procedure more organized and to ensure the task is of the desired difficulty, thus enabling the intended ability to be effectively measured. In addition, the ASAP English test aims to assist low-achieving students in remedial instruction; the cognitive factors and study results provide a reference for developing teaching materials of English LC remedial instruction and for constructing LC test items.

KEYWORDS
Listening Comprehension Test, Cognitive Factors, Item Difficulty

Cite This Paper in IEEE or APA Citation Styles
(a). IEEE Format:
[1] Pei-Ju Sung , Su-Wei Lin , Pi-Hsia Hung , "Factors Affecting Item Difficulty in English Listening Comprehension Tests," Universal Journal of Educational Research, Vol. 3, No. 7, pp. 451 - 459, 2015. DOI: 10.13189/ujer.2015.030704.

(b). APA Format:
Pei-Ju Sung , Su-Wei Lin , Pi-Hsia Hung (2015). Factors Affecting Item Difficulty in English Listening Comprehension Tests. Universal Journal of Educational Research, 3(7), 451 - 459. DOI: 10.13189/ujer.2015.030704.