Assessing Advanced Persian Language Learners’ Written Production:Developing a Detailed Rubric

Document Type : Research Paper

Author

---

Abstract

Designing and preparing of items for writing tests is not too difficult, but after the test session, assessing the learners’ written productions could be a burdensome task which would make it difficult to judge their performance. Sometimes this difficulty is mainly due to the lack of or inappropriateness of detailed assessment rubrics which would provide raters with clear criteria and assessment guidelines. The present research aimed to design a detailed assessment rubric for evaluating student writings which included three categories of grammar, vocabulary size, and spelling. More than 100 texts written by advanced Persian language learners in the Persian Language Center of Imam Khomeini International University were collected. Although this rubric is not a final and clear-cut rubric, it can be used as a basis for future empirical studies and development of more detailed and comprehensive rubrics in this area. Since, in rubrics, the weight of errors, the attitudes of raters, and the raters’ methods of dealing with written productions are shown, they could be used to acquaint language learners with the criteria applied for assessing written productions, and consequently to improve their test taking strategies.   

Keywords

References

اسفندیاری، ر. (1393). تصحیح نوشته‌های غیرفارسی‌زبانان: سوگیری مصححان فارسی‌زبان با استفاده از انگاره‌ی چندوجهی راش. پژوهش‌نامه‌ی آموزش زبان فارسی به غیرفارسی‌زبانان، سال سوم، شماره 3 (پیاپی 8)، پاییز و زمستان 1393، صص: 54-25.
Baharloo, A. (2013).Test Fairness in Traditional and Dynamic Assessment. Theory and Practice in Language Studies, 3(10), 1930-1938. October 2013 © 2013 ACADEMY PUBLISHER Manufactured in Finland.
Birjandi, P. & Mosallanejad, P. (2010). An Overview of Testing and Assessment. Esfahan: Sepahan Publication.
Brookhart, S. M. (2013). How to Create and Use Rubrics for Formative Assessment and Grading. USA: Association for Supervision & Curriculum Development. Retrieved from: http://www.ascd.org/publications/books/112001/chapters/What-Are-Rubrics-and-Why-Are-They-Important%C2%A2.aspx.
Brown, H. D. (2010). Language Assessment Principles and Classroom Practices (2nd  edition). USA: Pearson Education, Inc.
Coombe, C., Folse, K. & Hubley, N. (2007). A Practical Guide to Assessing English Language Learners. US: The University of Michigan Press.
Davies, A. (2010). Test Fairness: A Response. Language Testing, 27(2),pp. 171–176.
Eckes, T. (2005). Examining Rater Effects in TestDaF Writing and Speaking Performance Assessments: A Many-Facet Rasch Analysis. Language Assessment Quarterly, 2(3),pp. 197-221.
Fulcher, G. & Davidson, F. (2007). Language Testing and Assessment. UK: Routledge.
Harmer, J. (2009). The Practice of English Language Teaching (4th edition). Longman, Pearson.
Karami, H. (2013). The Quest for Fairness in Language Testing. Journal of  Educational Research and Evaluation, 19(2-3),pp. 158-169.
Kunnan, A. J. (2010). Test Fairness and Toulmin's Argument Structure. Language Testing, 27(2), pp. 183–189.  
McNamara, T. & Roever, C. (2006). Language Testing: The Social Dimension. USA: Blackwell Publishing.
McNamara, T. & Ryan, K. (2011).  Fairness versus Justice in Language Testing: The Place of English Literacy in the Australian Citizenship Test. Journal Language Assessment Quarterly, 8(2), Current Issues and Trends in Language Assessment in Australia and New Zealand, pp.161-178.  
Meier, V. (2012). Evaluating Rater and Rubric Performance on A Writing Placement Exam. Second Language Studies, 31(1), 47-101.    
O’Neill, G. & Gately, L. (2014). Developing Assessment Criteria and Rubrics. Retrieved from: http.//www.ucd.ie/t4cms/Asssessment%20Criteria%20&%20Rubrics.pdf. 
Peirce, W. (2006). Designing Rubrics for Assessing Higher Order Thinking. The text version of a workshop presented at AFACCT Howard Community College, Columbia, MD, on January 13, 2006. Retrieved from:
http://academic.pg.cc.md.us/~wpeirce/MCCCTR/Designingrubricsassessingthinking.html.
Popham, W. J. (2006). The Role of Rubrics in Testing and Teaching. New York: Routledge.
Popham, W. J. (2009). Assessment Literacy for Teachers: Faddish or Fundamental? Theory into Practice, 48: 4–11. The College of Education and Human Ecology, the Ohio State University.
Prieto, G. & Nieto, E. (2014).Analysis of Rater Severity on Written Expression Exam Using Many Faceted Rasch Measurement. Psicológica, 35, pp. 385-397.
Schaefer, E. (2008). Rater Bias Patterns in An EFL Writing Assessment. Language Testing, 25(4), pp.465-493.
Sokolik, M. (2003). Writing. In D. Nunan (Ed.), Practical English Language Teaching (pp.108-87).  US: McGraw-Hill.
Taylor, L. B. (2004). Testing Times: Research Directions and Issues for Cambridge ESOL Examinations. TESOL QUARTERLY, 38(1), Spring 2004. Retrieved from:
http://onlinelibrary.wiley.com/doi/10.2307/3588265/epdf?
University of Hawai’i. (2013).
http://www.manoa.hawaii.edu/assessment/howto/rubrics.htm. 
Weigle, S. C. (2002). Assessing Writing. Cambridge University Press.
Weir. C. J. (1990). Communicative Language Testing. UK: Prentice Hall International Ltd.
Xi, X. (2010). How Do We Go About Investigating Test Fairness? Language Testing, 27(2), pp.147–170.
Yaghoobi, M. (2016). Fairness and Bias in Language Testing. International Journal of Research in Linguistics, Language Teaching and Testing 1(3),136-143. Available online at http://ijrlltt.com.

Files

History

  • Receive Date: 03 December 2016
  • Revise Date: 22 June 2017
  • Accept Date: 11 July 2017

Share

How to cite

Statistics