extended · article · 2022

Establishing the Validity and Reliability of a Program Evaluation Questionnaire using Rasch Measurement Model

Su Ling Loh; Nur Aisah Jamil; Khar Thoe Ng

This study was conducted to establish the validity and reliability of the evaluation questionnaire for the 12th Regional Congress of the Search For SEAMEO Young Scientist (SSYS) 2022 using the Rasch Measurement Model that was aided by the Winsteps software. The questionnaire contains 24 items that evaluate the Congress's objectives, inputs, as well as event management and administration. Each item is rated on a 4-point rating scale. The instrument was administered at the end of the 3-days SSYS Congress held virtually in which 1891 participants submitted their responses. The establishment of validity and reliability of this questionnaire is crucial before further analysis is carried out. The Rasch Model analysis showed that the reliability index of the respondents was 0.87 and person separation is 2.60, while the item reliability index is 0.96 with an item separation index of 5.08. Item p...