Building a Validity Argument for a Listening Test of Academic Proficiency

The official IELTS website states: Access to IELTS test materials or score data is
often not possible for a variety of reasons, ... purposes, and IELTS Official
Practice Materials, IELTS Scores Explained DVD and other published practice
tests can often be used as research tools. ... 1.12.2. IELTS Listening Test
Materials The IELTS listening test study could not use an operational version of
the test, because ...

Author: Vahid Aryadoust

Publisher: Cambridge Scholars Publishing

ISBN: 1443850934

Category: Foreign Language Study

Page: 325

View: 853

Over the years, various approaches to validation have emerged in psychological and educational assessment research, which can be classified into traditional approaches and modern approaches. Traditional approaches view validity as a multicomponential concept including, for example, content, construct, and predictive validity, while modern approaches conceptualize it as a unitary concept evaluated through argumentation. Drawing on the modern approach, this book builds a validity argument for an International English Language Testing System (IELTS) listening test sample. The book provides some insights into the listening sub-skills that the test engages, the psychometric dimensionality of the test, variables that predict item difficulty parameters, bias across age, nationality, test experience, and gender, as well as predictive-referenced evidence of validity. A variety of techniques including the Rasch model and structural equation modelling are used to answer the research questions and to build a validity argument framework; this argument organizes the thematically related findings into a coherent treatment of the validity of the listening test. The book presents the first treatment of validity argument and related analytical tools in one volume and maps the psychometric/statistical analysis tools onto the validity argument framework. It also provides an extensive literature review of listening comprehension, validation, and psychometric modeling and proposes both methods for developing and validating self-assessment instruments and novel approaches to improving the quality of language assessments.