Does technical assessment matter? Functionality and usability testing of websites for ESL/EFL autonomous learners
Keywords:
technology-enhanced learning, informal English learning, self-directed learning, website technical quality, website evaluation
Abstract
Given the social impact and the transformation of the teaching–learning process enhanced by new technologies, online language learning has been established as a field of study that has been approached primarily from the perspective of pedagogical themes. In the context of the LinguApp research project developed at the University of Córdoba (Spain),1 we aim to evaluate the technical quality of a group of English teaching websites for self-directed learning. The analysis is based on functionality and usability aspects through the use of a specifically designed checklist, created and preliminarily implemented in the early development phase of this study. To complete the design of the checklist before external validation, we offer a comparative study of four renowned websites from the LinguApp corpus: ESOLCourses, BBC, British Council and Cambridge English.2 These preliminary results allow to identify the strengths and weaknesses of these language learning websites by subjecting the data to qualitative and quantitative analysis, while they shed light on the need to strengthen web performance and so reinforce autonomous language students’ experience.
Downloads
Download data is not yet available.
References
Aguayo, N. & Ramírez, C. M. (2019) ‘Evaluación técnica de sitios web para el aprendizaje autónomo de inglés como segunda lengua’, EDMETIC, Journal of Media Literacy and ICT, vol. 8, no. 1, pp. 1–22. doi: 10.21071/edmetic.v8i1.11161
Al-Fraihat, D., Joy, M. & Sinclair, J. (2018) ‘A comprehensive model for evaluating e-learning systems success’, in Distance Learning for Educators, Trainers and Leaders, vol. 15, issue 3, ed M. Simonson, United States Distance Learning Association, Boston, MA, pp. 57–74.
Aly, M. A. (2008) ‘An evaluative study of some online websites for learning and teaching English as a foreign language’, Benha University, Egypt, Available at: http://files.eric.ed.gov/fulltext/ED499586.pdf
Boklaschuk, K. & Caisse, K. (2001) ‘Evaluation of educational websites’, Educational Communications and Technology, University of Saskatchewan, Saskatoon, Saskatchewan, Canada.
British Council. (2018) The Future Demand for English in Europe: 2025 and Beyond. British Council, London. Available at: https://www.britishcouncil.org/sites/default/files/future_demand_for_english_in_europe_2025_and_beyond_british_council_2018.pdf
Brockmann, R. J., Horton, W. & Brock, K. (1989) ‘From database to hypertext via electronic publishing: an information odyssey’, in The Society of Text: Hypertext, Hypermedia, and the Social Construction of Information, ed E. Barrett, MIT, Cambridge, pp. 162–205.
Cassidy, L. J. (2015) Website Benchmarking: A Tropical Tourism Analysis, PhD Thesis, James Cook University.
Devi, K. & Sharma, A. K. (2016) ‘Implementation of a framework for website quality evaluation: Himachal Pradesh university website’, Indian Journal of Science and Technology, vol. 9, no. 40, pp. 1–5. doi: 10.17485/ijst/2016/v9i40/100229
Dugalic, B. & Mishev, A. (2012) ‘ISO software quality standards and certification’, Local Proceedings of the Fifth Balkan Conference in Informatics, Novi Sad, Serbia, pp. 113–116.
European Commission (2008) ‘Multilingualism: an asset for Europe and a shared commitment’, Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions, COM(2008) 566 final, Brussels. Available at: https://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=COM:2008:0566:FIN:EN:PDF
Fogg, B. J., et al., (2002) ‘How do people evaluate a web site’s credibility? Results from a large study’, Report of Research [online] Available at: https://dejanseo.com.au/media/pdf/credibility-online.pdf
Gledec, G. (2005) ‘Quality model for the World Wide Web’, Proceedings of the 8th International Conference on Telecommunications, 2005. ConTEL 2005, pp. 281–287. Available at: https://www.researchgate.net/publication/4151791_Quality_model_for_the_world_wide_web
Gómez-Parra, M. E., Huertas-Abril, C. A. & Espejo-Mohedano, R. (2019) ‘Estudio para la validación de dos instrumentos para la evaluación de sitios web de aprendizaje de lenguas extranjeras’, Revista de Lenguas para Fines Específicos, vol. 25, no. 1, pp. 62–80. Available at: https://ojsspdc.ulpgc.es/ojs/index.php/LFE/article/view/1048
Gütl, C., et al., (2013) ‘Flexible and affordable foreign language learning environment based on Web 2.0 technologies’, International Journal of Emerging Technologies in Learning, vol. 8, no. 2, pp. 16–28. doi: 10.3991/ijet.v8i2.2488
Hadjerrouit, S. (2007) ‘Using an understanding of the learning cycle to build effective e-learning’, in Advanced Principles of Effective E-Learning, Informing Science Press, Santa Rosa, CA, pp. 27–58.
Hadjerrouit, S. (2010a) ‘Developing web-based learning resources in school education: a user-centered approach’, Interdisciplinary Journal of E-Learning and Learning Objects, vol. 6, no. 1, pp. 115–135. Available at: https://www.learntechlib.org/p/44777/
Hadjerrouit, S. (2010b) ‘A conceptual framework for using and evaluating web-based learning resources in school education’, Journal of Information Technology Education, vol. 9, pp. 54–79. Available at: https://www.learntechlib.org/p/111356/
Hasan, L. & Abuelrub, E. (2011) ‘Assessing the quality of web sites’, Applied Computing and Informatics, vol. 9, no. 1, pp. 11–29. doi: 10.1016/j.aci.2009.03.001
Healey, D. (2016) ‘Language learning and technology: past, present and future’, in Routledge Handbook of Language Learning and Technology, eds L. Murray & F. Farr, Routledge, New York, NY, pp. 9–23.
Ho, W. Y. (2018) Translanguaging in Online Language Learning: Case Studies of Self-Directed Chinese Learning of Multilingual Adults, Doctoral Thesis (Ph.D), UCL Institute of Education, University College London, United Kingdom. Available at: http://discovery.ucl.ac.uk/id/eprint/10044705
Ingham, H., Ingham, M. & Afonso, J. (2014) ‘Participation in lifelong learning in Portugal & the UK’, Education Economics, pp. 1–39. Available at: https://eprints.lancs.ac.uk/id/eprint/80008/1/Education_Economics_Revision_2.pdf
ISO (2001) ISO 9126-1:2001, Information Technology–Software Product Quality–Part 1: Quality Model, Geneva: International Standards Organization.
ISO (2011) ISO 25010:2011, Software Quality Model. Systems and Software Engineering–Systems and Software Quality Requirements and Evaluation (SQuaRE), System and Software Quality Models, Geneva: International Standards Organization.
Kessler, G. (2011) ‘Language learning in an era of ubiquitous computing: pedagogy, students and teachers’, ‘New Horizon: Striding into the Future’ Selected Proceedings of the 2011 Michigan Teachers of English to Speakers of Other Languages Conference, Kalamazoo, MI, pp. 6–17.
Kir, E. & Kayak, S. (2013) ‘The evaluation of websites teaching English as a foreign language (EFL)’, Procedia–Social and Behavioral Sciences, vol. 106, pp. 2788–2795. doi: 10.1016/j.sbspro.2013.12.320
Korucu-Kis, S. (2020) ‘An investigation into EFL pre-service teachers’ out-of-class self-regulated learning experiences with ICT’, in Enhancements and Limitations to ICT-Based Informal Language Learning: Emerging Research and Opportunities, eds R. Ahmed, A. Al-kadi & T. Hagar, IGI Global, Hershey, PA, pp. 112–137.
Kukulska-Hulme, A. & Shield, L. (2004) ‘Usability and pedagogical design: are language learning websites special?’, in Proceedings of ED-MEDIA 2004–World Conference on Educational Multimedia, Hypermedia & Telecommunications, eds L. Cantoni & C. McLoughlin, Association for the Advancement of Computing in Education (AACE), Lugano, Switzerland, pp. 4235–4242.
Kyppö, A. (2017) ‘Climbing a mountain. Learning Slovak in new language learning environments’, Department of Language and Communication Studies, University of Jyväskylä, Available at: https://jyx.jyu.fi/handle/123456789/55172
Lai, C., Hu, X. & Lyu, B. (2017) ‘Understanding the nature of learners’ out-of-class language learning experience with technology’, Computer Assisted Language Learning, vol. 31, no. 1–2, pp. 114–143. doi: 10.1080/09588221.2017.1391293
Membrate, T. W. (2010) A Framework for Evaluating Academic Web Site’s Quality from Students’ Perspective, Master’s Thesis, Delft University of Technology, The Netherlands.
Moreno, E. & Risueño, J. J. (2018) ‘Design of a checklist for evaluating language learning websites’, Porta Linguarum, vol. 30, pp. 23–41. Available at: https://www.ugr.es/~portalin/articulos/PL_numero30/3_%20Design%20of%20a%20Checklist%20for%20Evaluating%20Language.pdf
Moustakis, V. S., et al., (2004) ‘Website quality assessment criteria’, Proceedings of the Ninth International Conference on Information Quality (ICIQ-04), pp. 59–73. Available at: http://mitiq.mit.edu/iciq/documents/iq%20conference%202004/papers/websitequalityassessmentcriteria.pdf
Nielsen, J. (1999) Designing Web Usability: The Practice of Simplicity, New Riders Publishing, Thousand Oaks, CA.
Nielsen, J. (2012) ‘Usability 101: Introduction to usability’, Nielsen Norman Group [online] Available at: https://www.nngroup.com/articles/usability-101-introduction-to-usability/
Padayachee, I., Kotzé, P. & Van der Merwe, A. (2010) ‘ISO 9126 external systems quality characteristics, sub-characteristics and domain specific criteria for evaluating e-Learning systems’, The Southern African Computer Lecturers’ Association, University of Pretoria, South Africa. Available at: https://www.researchgate.net/profile/Paula_Kotze/publication/228987388_ISO_9126_external_systems_quality_characteristics_sub-characteristics_and_domain_specific_criteria_for_evaluating_e-Learning_systems/links/0c96051821b7c5e798000000.pdf
Rocha, A. & Brandão, P. L. (2011) ‘Quality of health web sites: Dimensions for a broad evaluation methodology’, in Handbook of Research on ICTs and Management Systems for Improving Efficiency in Healthcare and Social Care, eds M. Cruz-Cunha, I. M. Miranda & P. Gonçalves, IGI Global, pp. 922–936.
Shepherd, M. & Watters, C. (1999) ‘The functionality attribute of Cybergenres’, Proceedings of the 32nd Hawaii International Conference on System Sciences HICSS32, Abstracts and CD-ROM of Full Papers, Maui, HI, USA, 1999, pp. 9–[unspecified end page number]. doi: 10.1109/HICSS.1999.772650
Son, J.B. (2005) ‘Exploring and evaluating language learning web sites’, in Enhancing Learning and Teaching: Pedagogy, Technology and Language, eds J.-B. Son & S. O’Neill, Post Pressed, Flaxton, Australia, pp. 215–227. Available at: https://eprints.usq.edu.au/820/1/Son_ch13_2005.pdf
Son, J. B. & Park, J. Y. (2012) ‘Intercultural usability of language learning websites’, International Journal of Pedagogies and Learning, vol. 7, no. 2, pp. 135–141. doi: 10.5172/ijpl.2012.7.2.135
Stevenson, M. P. & Liu, M. (2010) ‘Learning a language with web 2.0: exploring the use of social networking features of foreign language learning websites’, CALICO Journal, vol. 27, no. 2, pp. 233–259. doi: 10.11139/cj.27.2.233-259
Published
2020-07-14
How to Cite
Aguayo N., & Ramírez C. M. (2020). Does technical assessment matter? Functionality and usability testing of websites for ESL/EFL autonomous learners. Research in Learning Technology, 28. https://doi.org/10.25304/rlt.v28.2353
Issue
Section
Original Research Articles
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors contributing to Research in Learning Technology retain the copyright of their article and at the same time agree to publish their articles under the terms of the Creative Commons CC-BY 4.0 License (http://creativecommons.org/licenses/by/4.0/) allowing third parties to copy and redistribute the material in any medium or format, and to remix, transform, and build upon the material, for any purpose, even commercially, under the condition that appropriate credit is given, that a link to the license is provided, and that you indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
_0%20(002).jpg)
.png){kind=spacer}
