AN INVESTIGATION INTO THE RELATIONSHIP BETWEEN TEACHERS’ PERCEPTIONS OF TEST BIAS AND THEIR WORKING AND TRAINING BACKGROUND
Corresponding Author(s) : Nguyen Ngoc Nhat Minh
UED Journal of Social Sciences, Humanities and Education,
Vol. 11 No. 1 (2021): UED Journal of Social Sciences, Humanities and Education (UED-JSHE)
This paper aims to explore the relationship between how language teachers perceive test bias and where they are working, how long they have been working, and where they were professionally trained. The data were collected from 19 in-service English teachers from Eastern and Western settings. They completed a questionnaire in which they were asked to respond to test bias stimuli and answer questions related to their teaching background and training. The stimuli contained either of two forms of bias, unfair penalization and offensiveness. Qualitative and quantitative analysis showed teachers were not fully informed of possible forms of test bias and possible ways potential biases unfairly penalize or offend students. They were better able to recognize biases of unfair penalization than offensiveness. Statistical analyses revealed teachers with over 10 years of experience were better able to recognize potential test bias than those with less experience (at 90% confidence level). The findings contribute to the current limited literature on bias in classroom language testing and assessment, leading to implications for bias review in teacher-developed assessments and teacher training.
Download CitationEndnote/Zotero/Mendeley (RIS)
- Blankenship, J., Hubbard, B., & Johnson, D. (2009, April 27). Bias in classroom assessment. Retrieved from https://goo.gl/gldL0T
- Davison, C. (2004). The contradictory culture of teacher-based assessment: ESL teacher assessment practices in Australian and Hong Kong secondary schools. Language Testing, 21(3), 305-334. https://doi.org/10.1191/0265532204lt286oa
- Educational Testing Service. (2009). ETS guidelines for ets review of assessments. Retrieved from https://www.ets.org/Media/About_ETS/pdf/overview.pdf
- Educational Testing Service. (2012). Smarter balanced assessment consortium: Bias and sensitivity guidelines. Retrieved from https://portal.smarterbalanced.org/library/en/bias-and-sensitivity-guidelines.pdf
- Elder, C. (2012). Bias in language assessment. In C. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 406–412). Oxford: Wiley-Blackwell. https://doi.org/10.1002/9781405198431.wbeal1198
- Jannati, S. (2015). ELT teachers’ language assessment literacy: Perceptions and practices. The International Journal of Research in Teacher Education, 6(2), 26-37.
- Mellenbergh, G. J. (1989). Item bias and item response theory. International Journal of Educational Research, 13(2), 127-143. https://doi.org/10.1016/0883-0355(89)90002-5
- Mendoza, A. A. L., & Arandia, R. B. (2009). Language testing in Colombia: A call for more teacher education and teacher training in language assessment. Profile, 11(2), 55-70. Retrieved from http://revistas.unal.edu.co/index.php/profile/article/view/11442/36795
- Popham, W. J. (2014). Classroom assessment: What teachers need to know (7th ed.). Boston, MA: Pearson.
- Reynolds, C. R., & Suzuki, L. A. (2003). Bias in psychological assessment: An empirical review and recommendations. In I. B. Weiner, J. R. Graham, & J. A. Naglieri (Eds.), Handbook of Psychology (Vol. 10, pp. 82-113). Wiley Online Library. https://doi.org/10.1002/0471264385.wei1004
- Shepard, L., Camilli, G., & Averil, M. (1981). Comparison of procedures for detecting test-item
- bias with both internal and external ability criteria. Journal of Educational and Behavioral Statistics, 6(4), 317–75. https://doi.org/10.3102/10769986006004317
- Shim, K. N. (2009). An investigation into teachers’ perceptions of classroom-based assessment of English as a foreign language in Korean primary education. (Doctoral dissertation). Retrieved from the database of University of Exeter.
- Sikka, A., Nath, J., & Cohen, M. (2007). Practicing teachers’ beliefs and uses of assessment. International Journal of Case Method Research & Application, 10(3), 239-253.
- Wright, W. E. (2015). Foundations for teaching English language learners: Research, theory, policy, and practice (2nd ed.). Philadelphia, PA: Caslon.