VALIDITY EVIDENCE USING EXPERT JUDGMENT: A STUDY OF USING ITEM CONGRUENCE INVOLVING EXPERT JUDGEMENTS FOR EVIDENCE FOR VALIDITY OF A READING TEST

  • Zailani Jusoh UniSZA, Terengganu
  • Ainol Madziah Zubairi International Islamic University Malaysia
  • Kamal J I Badrasawi International Islamic University Malaysia
Keywords: Expert Judgement, Validity, Just, Test Construction

Abstract

This study demonstrates the use of the Item Objective Congruence Method (IOC) for a content validation procedure to evaluate the congruence between reading test items constructed and the reading sub-skills they were intended to measure. The IOC allows for quantification of the content validity evidence of a test or an instrument. In this study, experts were asked to rate 96 reading comprehension test items against the sub-skills that the items were intended to measure. In line with the concept of justice in Islam, it is important that the evidence of justice is demonstrated. Using ten English language experts who were also experienced test writers, the study found different degrees of agreement between the experts in terms of what some of the items were supposed to measure. Items that showed considerable incongruence are those that test multiple subskills. Whereas, items that had high degree of congruence are those that clearly test a single subskill.

Downloads

Download data is not yet available.
Published
2018-12-31
How to Cite
Jusoh, Zailani, Ainol Madziah Zubairi, and Kamal J I Badrasawi. 2018. “VALIDITY EVIDENCE USING EXPERT JUDGMENT: A STUDY OF USING ITEM CONGRUENCE INVOLVING EXPERT JUDGEMENTS FOR EVIDENCE FOR VALIDITY OF A READING TEST”. Al-Shajarah: Journal of the International Institute of Islamic Thought and Civilization (ISTAC), December, 307-20. https://journals.iium.edu.my/shajarah/index.php/shaj/article/view/766.
Section
ARTICLES