Evaluating the validity of the online multiliteracy assessment tool

Publication Type:
Journal Article
Citation:
Australian Journal of Education, 2017, 61 (3), pp. 305 - 327
Issue Date:
2017-11-01
Filename Description Size
0004944117729056.pdfPublished Version796.01 kB
Adobe PDF
Full metadata record
© 2017, © Australian Council for Educational Research 2017. This study aims to assess the validity of the Online Multiliteracy Assessment for students in Years 5 and 6. The Online Multiliteracy Assessment measures students’ abilities in making and creating meaning, using a variety of different modes of communication, such as text, audio and video. The study involved selecting two groups of students: the first group (n=19) was used in two pilot studies of the items and the second (n=299) was used in a field trial validating the functioning of the items and assessing the quality of the scale. The results indicated that the Online Multiliteracy Assessment has acceptable test–retest reliability; however, the fit to the Rasch model was less than ideal. Further investigation identified two important areas for improvement. First, the items assessing the higher order skills of synthesising, communicating and creating need to be more cognitively demanding. Second, some items need to be modified in order to improve their functionality.
Please use this identifier to cite or link to this item: