extended · article · 2024

Construct validity of primary trait writing rubrics based on assessment use argument (AUA) validation framework

Nurul Fariena Asli; Mohd Effendi Ewan Mohd Matore; Melor Md Yunus; George Engelhard Jr.

In assessing performance-based language assessment, the use of a valid and reliable scoring rubric is crucial to minimize measurement errors that become threats in the rating process. The validation process of rubrics which previously was based on qualitative data is not satisfying since empirical evidence is not present. Thus, drawing on the Assessment Use Argument (AUA) Validation Framework, this study aims to search for evidence to prove a claim which is Primary Trait Writing (PTW) rubrics for students self assessment activities are relevant to the construct being measured. Based on that, two warrants and one rebuttal were derived to prove the claim. The participants consisted of 149 secondary school students in a state in Malaysia and three facets identified in the study were the examinee (149 students), the rater (149 students and 3 teachers), and the trait (Content, Format, Cohesiv...