ENHANCING WRITING SKILLS OF EFL LEARNERS THROUGH AUTOMATED FEEDBACK: AN EMPIRICAL INVESTIGATION
DOI:
https://doi.org/10.47255/gymtcf78Keywords:
automated writing evaluation, writing skills, feedback, writing class program, technology-based writing toolsAbstract
This study examines the effectiveness of an automated writing evaluation (AWE) tool in improving the writing skills of lower-proficiency EFL learners. The study involved 34 non-English major university students who received AWE feedback from the WhiteSmoke Writing Assistant during their writing practice sessions. The quality of their writing was evaluated using pre-and post-tests, and their perceptions of the feedback were gathered through a questionnaire. The results showed a significant improvement in the quality of students' writing after using AWE feedback. Additionally, the students perceived the AWE feedback as positively impacting the quality of their writing. These findings suggest that AWE feedback is a promising tool that can be incorporated into the writing class program to enhance the quality of students' writing. Writing teachers can use the tool to evaluate students' compositions and provide targeted feedback to help them improve their writing skills. Overall, the study highlights the potential of technology-based writing tools to facilitate language learning and improve EFL learners' writing proficiency.
References
Bai, L., & Hu, G. (2017). In the face of fallible AWE feedback: How do students respond?. Educational Psychology, 37(1), 67-81. https://doi.org/10.1080/01443410.2016.1223275.
Berg-Schlosser, D. (2012). Mixed methods in comparative politics: Principles and applications. Springer.
Chen, C. F. E., & Cheng, W. Y. E. C. (2008). Beyond the design of automated writing evaluation: Pedagogical practices and perceived learning effectiveness in EFL writing classes. Language Learning & Technology, 12(2), 94–112. http://dx.doi.org/10125/44145.
Chen, M., & Cui, Y. (2022). The effects of AWE and peer feedback on cohesion and coherence in continuation writing. Journal of Second Language Writing, 57, 100915. https://doi.org/10.1016/j.jslw.2022.100915.
Chou, H. N. C., Moslehpour, M., & Yang, C. Y. (2016). My access and writing error corrections of EFL college pre-intermediate students. International Journal of Education, 8(1), 144-161.
Creswell, J. W. (2014). Research designs. Qualitative, quantitative, and mixed methods approaches. London: Sage.
Ducasse, A. M. (2022). The Use of Technology for Redesigning L2 Language Assessments: Tasks, Rubrics, and Feedback in Emergency Remote Teaching Contexts. In Technology-Assisted Language Assessment in Diverse Contexts (pp. 212-227). Routledge. https://doi.org/10.4324/9781003221463-17.
Elliot, N., Gere, A. R., Gibson, G., Toth, C., Whithaus, C., & Presswood, A. (2013). Uses and Limitations of Automated Writing Evaluation Software. WPA-CompPile Research Bibliographies. http://comppile.org/wpa/bibliographies/Bib23/AutoWritingEvaluation.pdf
Ellis, N. C. (2005). At the interface: Dynamic interactions of explicit and implicit language knowledge. Studies in second language acquisition, 27(2), 305-352. https://doi.org/10.10170S027226310505014X.
Ersanlı, C. Y., & Yeşilel, D. B. A. (2023). The Use of Automated Writing Evaluation Tools to Foster ESL Writing Instruction. In New Directions in Technology for Writing Instruction (pp. 193-209). Cham: Springer International Publishing. https://doi.org/https://doi.org/10.1007/978-3-031-13540-8_10.
Fang, Y. (2010). Perceptions of the computer-assisted writing program among EFL college learners. Journal of Educational Technology & Society, 13(3), 246-256.
Grimes, D., & Warschauer, M. (2010). Utility in a fallible tool: A multi-site case study of automated writing evaluation. The Journal of Technology, Learning and Assessment, 8(6).
Hegelheimer, V., Dursun, A., & Li, Z. (2016). Automated writing evaluation in language teaching: Theory, development, and application. Calico Journal, 33(1), i-v.
Hockly, N. (2019). Automated writing evaluation. ELT Journal, 73(1): 82-88. https://doi.org/10.1093/elt/ccy044.
Huang, S., & Renandya, W. A. (2020). Exploring the integration of automated feedback among lower-proficiency EFL learners. Innovation in language learning and teaching, 14(1), 15-26. https://doi.org/10.1080/17501229.2018.1471083.
Jacobs, H. L. (1981). Testing ESL Composition: A Practical Approach. English Composition Program. Newbury House Publishers, Inc., Rowley, MA 01969.
Kirszner, L. G., & Mandell, S. R. (2011). Writing first with readings: Practice in context. Macmillan.
Koltovskaia, S. (2020). Student engagement with automated written corrective feedback (AWCF) wprovided by Grammarly: A multiple case study. Assessing Writing, 44, 100450. https://doi.org/10.1016/j.asw.2020.100450.
Khezrlou, S. (2022). Repeated academic writing with synchronous and asynchronous teacher electronic feedback: How are macro and micro aspects affected?. In Technology in Second Language Writing (pp. 63-79). Routledge. https://doi.org/10.4324/9781003279358-5.
Lee, I. (2020). Utility of focused/comprehensive written corrective feedback research for authentic L2 writing classrooms. Journal of Second Language Writing, 49, 100734.
Liao, H. C. (2016). Using automated writing evaluation to reduce grammar errors in writing. Elt Journal, 70(3), 308-319. https://doi.org/10.1093/elt/ccv058.
Li, J., Link, S., & Hegelheimer, V. (2015). Rethinking the role of automated writing evaluation (AWE) feedback in ESL writing instruction. Journal of second language writing, 27, 1-18. https://doi.org/10.1016/j.jslw.2014.10.004.
Ma, K. (2013). Improving EFL Graduate Students' Proficiency in Writing through an Online Automated Essay Assessing System. English Language Teaching, 6(7), 158-167. http://dx.doi.org/10.5539/elt.v6n7p158.
Muijs, D. (2010). Doing quantitative research in education with SPSS. London: Sage.
Parra G, L., & Calero S, X. (2019). Automated writing evaluation tools in the improvement of the writing skill. International Journal of Instruction, 12(2), 209-226. https://doi.org/10.29333/iji.2019.12214a.
Phakiti, A. (2014). Experimental Research Methods in Language Learning. London: Bloomsbury.
Ranalli, J., Link, S., & Chukharev-Hudilainen, E. (2017). Automated writing evaluation for formative assessment of second language writing: Investigating the accuracy and usefulness of feedback as part of argument-based validation. Educational Psychology, 37(1), 8-25.
Renandya, W. A. (2020). Instructed SLA: A Practical Guide For Teachers. TEFLIN Publication Division: Soul.
Stevenson, M. (2013). Shermis, MD, & Burstein, J. (2013). Handbook of Automated Essay Evaluation: Current applications and new directions (Eds). Routledge: New York.
Sreejesh, S., & Mohapatra, S. (2014). Mixed method research design: an application in consumer-brand relationships (CBR). New York: Springer.
Stevenson, M., & Phakiti, A. (2019). Automated feedback and second language writing. Feedback in second language writing: Contexts and issues. Cambridge University Press: Cambridge. https://doi.org/10.1017/9781108635547.009.
Stevenson, M. (2016). A critical interpretative synthesis: The integration of automated writing evaluation into classroom writing instruction. Computers and Composition, 42, 1-16. https://doi.org/10.1016/j.compcom.2016.05.001.
Tian, L., & Zhou, Y. (2020). Learner engagement with automated feedback, peer feedback and teacher feedback in an online EFL writing context. System, 91(4), 1-14. https://doi.org/10.1016/j.system.2020.102247.
Tsuda, N. (2014). Implementing Criterion (automated writing evaluation) in Japanese college EFL classes. Language and Culture: The Journal of the Institute for Language and Culture, 18, 25-45. https://konan-u.repo.nii.ac.jp/record/566/files/K00490.pdf.
Wang, Y. J., Shang, H. F., & Briody, P. (2013). Exploring the impact of using automated writing evaluation in English as a foreign language university students' writing. Computer Assisted Language Learning, 26(3), 234-257. https://doi.org/10.1080/09588221.2012.655300.
Wilson, J., Roscoe, R., & Ahmed, Y. (2017). Automated formative writing assessment using a levels of language framework. Assessing Writing, 34(4), 16-36. https://doi.org/10.1016/j.asw.2017.08.002.
Zhang, Z. V. (2020). Engaging with automated writing evaluation (AWE) feedback on L2 writing: Student perceptions and revisions. Assessing Writing, 43(1), 1 - 14. https://doi.org/10.1016/j.asw.2019.100439.
