skip to main content
Language:
Search Limited to: Search Limited to: Resource type Show Results with: Show Results with: Search type Index

Rater attitude towards emerging varieties of English: a new rater effect?

Language Testing in Asia, 2019-03, Vol.9 (1), p.1-21, Article 5 [Peer Reviewed Journal]

The Author(s). 2019 ;Language Testing in Asia is a copyright of Springer, (2019). All Rights Reserved. © 2019. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. ;ISSN: 2229-0443 ;EISSN: 2229-0443 ;DOI: 10.1186/s40468-019-0080-0

Full text available

Citations Cited by
  • Title:
    Rater attitude towards emerging varieties of English: a new rater effect?
  • Author: Hsu, Tammy Huei-Lien
  • Subjects: Assessment ; Attitude Measures ; Attitudes ; Bias ; Constructs of English language speaking ; Correlation ; Decision Making ; Education ; English (Second Language) ; English as an international language ; Evaluators ; Foreign Countries ; Indian English ; Indians ; Language assessment ; Language Attitudes ; Language Education ; Language Tests ; Language Variation ; Language varieties ; Rater attitude ; Scores ; Scoring ; Second Language Learning ; Sociolinguistics ; Speech ; Speech Communication ; Speech disorders ; Statistical analysis ; Teachers ; Testing and Evaluation ; World Englishes
  • Is Part Of: Language Testing in Asia, 2019-03, Vol.9 (1), p.1-21, Article 5
  • Description: Background A strong interest in researching World Englishes (WE) in relation to language assessment has become an emerging theme in language assessment studies over the past two decades. While research on WE has highlighted the status, function, and legitimacy of varieties of English language, it remains unclear how raters respond to the results of the global spread of English. Also unclear is whether their attitudes towards the varieties of English constitute a biasing factor in the scores they award in English speaking tests. As such, this study investigates the relationship between rater attitudes towards Indian English as an example of WE, as measured by the “rater attitude instrument” (RAI), and scores that raters awarded to IELTS speech samples produced by Indian examinees. Methods A total of 96 teacher raters rated six IELTS speech samples and then completed the RAI online. Correlation analysis, MANOVA, and Tukey contrasts were performed to test the extent to which rater attitudes towards Indian English as an example of WE affect rater scoring decisions on IELTS speech samples. Results Moderate to strong correlations were observed between the RAI and IELTS speech sample scores. The MANOVA results suggest significantly different ratings, with the positive attitude group consistently awarding higher scores to IELTS speech samples in comparison to the negative attitude group on all of the four analytic rating criteria. Furthermore, the RAI appears to be a significant predictor of IELTS speech sample scores. Conclusion A link between rater attitude towards Indian English, as an example of WE, and scoring tendency for Indian examinees may exist in a language assessment context. Thus, as raters reoriented their views, broadened their grasp of WE, and as awareness of WE increased in the language testing community in recent decades, the findings here show that testing agencies must add an understanding of potential rater bias towards WE to the current relevant literature.
  • Publisher: Cham: Springer International Publishing
  • Language: English
  • Identifier: ISSN: 2229-0443
    EISSN: 2229-0443
    DOI: 10.1186/s40468-019-0080-0
  • Source: Education Resources Information Center (ERIC)
    AUTh Library subscriptions: ProQuest Central
    Springer Open Access Journals
    DOAJ Directory of Open Access Journals

Searching Remote Databases, Please Wait