Open educational resources for research training: quality assurance through a collaborative evaluation
Abstract
Although it is considered that open educational resources offer vast pedagogical opportunities for any educational context, there have been only few studies so far that have linked their use or application in the field of research training, and even less works that have addressed their quality assurance for that context. As part of an inter-institutional project, the main aim of this article is the collaborative selection and evaluation of appropriate educational resources for research training. The mixed method approach of the article includes needs’ analysis of researchers in training through questionnaires and interviews. This was the starting point for the collaborative evaluation of educational resources using the agreed common criteria derived from the Learning Object Review Instrument (LORI) evaluation instrument. This article suggests recommendations regarding the collaborative evaluation of educational resources and the use of LORI, and suggestions for creators of educational resources for research training to facilitate the quality assurance of their materials. A website is being developed to bind together the resources that have met the quality criteria established in collaborative evaluation.
Downloads
References
Adham, K. A., et al., (2018) ‘Learning to complete the PhD thesis’, Issues in Educational Research, vol. 28, no. 4, pp. 811–829, [online] Available at:http://www.iier.org.au/iier28/adham.pdf
Association of Universities and Colleges of Canada (AUCC) (2011) Trends in Higher Education: Volume 1 – Enrolment, Association of Universities and Colleges of Canada, Ottawa, ON.
Atenas, J. & Havemann, L. (2013) ‘Quality assurance in the open: an evaluation of OER repositories’, The International Journal for Innovation and Quality in Learning, vol. 2, pp. 22–34, [online] Available at: http://eprints.soas.ac.uk/17347/1/30-288-1-PB.pdf
Atenas, J. & Havemann, L. (2014) ‘Questions of quality in repositories of open educational resources: a literature review’, Research in Learning Technology, vol. 22, p. 20889. doi: 10.3402/rlt.v22.20889
Atenas, J., Havemann, L. & Priego, E. (2014) ‘Opening teaching landscapes: the importance of quality assurance in the delivery of open educational resources’, Open Praxis, vol. 6, no. 1, pp. 29–43. doi: 10.5944/openpraxis.6.1.81
Atkins, D. E., Brown, J. S. & Hammond, A. L. (2007) ‘A review of the open educational resources (OER) movement: achievements, challenges, and new opportunities’, Report to the William and Flora Hewlett Foundation, [online] Available at: http://www.hewlett.org/uploads/files/ReviewoftheOERMovement.pdf
Camilleri, A. F., Ehlers, U. D. & Pawlowski, J. (2014) State of the Art Review of Quality Issues Related to Open Educational Resources (OER) (No. JRC88304), Joint Research Centre (Seville site), [online] Available at: http://is.jrc.ec.europa.eu/pages/EAP/documents/201405JRC88304.pdf
Canto, P. J., Guillermo, M. C. & Tejada, M. A. (2012) ‘Recursos educativos abiertos para la formación de investigadores educativos: opinión de usuarios’, in Recursos educativos abiertos y móviles para la formación de investigadores: Investigaciones y experiencias prácticas, coord. M. S. Ramírez & J. V. Burgos, Lulú editorial digital, México, pp. 38–48.
Caplan, D. & Graham, R. (2008) ‘The development of online courses’, in The theory and practice of online learning, ed T. Anderson, Athabasca University Press, Edmonton, pp. 247–265.
Caswell, T., et al., (2008) ‘Open content and open educational resources: enabling universal education’, The International Review of Research in Open and Distributed Learning, vol. 9, no. 1, pp. 1–11, doi: 10.19173/irrodl.v9i1.469
Del Moral, M. E. & Cernea, D. A. (2005) ‘Diseñando Objetos de Aprendizaje como facilitadores de la construcción del conocimiento’, II Simposio Pluridisciplinar sobre Diseño, Evaluación y Descripción de Contenidos Educativos Reutilizables (SPDECE05), Barcelona, España.
Fernández-Pampillón, A. M., Dominguez, E. & de Armas, I. (2013) ‘Análisis de la evolución de los Repositorios Institucionales de material educativo digital de las universidades españolas’, RELATEC: Revista Latinoamericana de Tecnología Educativa, vol. 12, no. 2, pp. 11–25, [online] Available at: http://relatec.unex.es/article/view/1165
Fernández-Pampillón Cesteros, A. M., et al., (2017) ‘Herramienta de evaluación de la calidad de los Materiales Educativos Digitales: perfiles de aplicación del profesor y del alumno’, in UNE 71362 Calidad de los materiales educativos digitales. 35.240.90/Aplicaciones de las tecnologías de la información en educación, AENOR, Madrid, pp. 114–131, [online] Available at: https://eprints.ucm.es/45338/
Ford, K. C., Veletsianos, G. & Resta, P. (2014) ‘The structure and characteristics of #PhDChat, an emergent online social network’, Journal of Interactive Media in Education, vol. 2014, no. 1. doi: 10.5334/2014-08
Gordillo, A. (2017) Contribution to the Authoring, Distribution, Evaluation and Integration of Learning Objects, Dissertation E.T.S.I. Telecommunications, Universidad Politécnica de Madrid, [online] Available at: https://core.ac.uk/display/148690656?recSetID=
Gordillo, A., Barra, E. & Quemada, J. (2015) ‘A flexible open source web platform to facilitate learning object evaluation’, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings, Madrid, Spain. doi: 10.1109/FIE.2014.7044498
Hylén, J. (2006) Open Educational Resources: Opportunities and Challenges, OECD, Paris, [online] Available at: http://www.oecd.org/education/ceri/37351085.pdf
Kawachi, P. (2014) The TIPS Framework Version-2.0: Quality Assurance Guidelines for Teachers as Creators of Open Educational Resources, CEMCA, New Delhi, [online] Available at: http://cemca.org.in/ckfinder/userfiles/files/TIPS Framework_Version 2_0_Low.pdf
McGill, L. (2011) ‘Quality considerations’, [online] Available at: https://www.jisc.ac.uk/full-guide/open-educational-resources
Ministerio de Educación Nacional (MEN) (2013) ‘Ministerio de Educación Nacional, Sistema Nacional de Información de Educación Superior SNIES. Resumen de indicadores de educación superior’, [online] Available at: http://www.mineducacion.gov.co/sistemasdeinformacion
Moreno, J. & Salinas, J. (2011) ‘Resultados del proceso de diseño, desarrollo e implementación de un prototipo de entorno virtual para una comunidad de Investigadores en Formación’, Congreso Internacional EDUTEC 2011, Pachuca, México, [online] Available at: https://www.academia.edu/3010238/Resultados_del_proceso_de_dise%C3%B1o_desarrollo_e_implementaci%C3%B3n_de_un_prototipo_de_entorno_virtual_para_una_comunidad_de_Investigadores_en_Formaci%C3%B3n
Nesbit, J., Belfer, K. & Leacock, T. (2007) ‘Learning Object Review Instrument (LORI)’, [online] Available at: http://transplantedgoose.net/gradstudies/educ892/LORI1.5.pdf
Orellana, M. L. (2014) Supervisión en línea de proyectos de investigación en maestrías y doctorados. Estrategia de apoyo para la interacción, diseño y desarrollo de la investigación, haciendo uso de mapas conceptuales. Tesis Doctoral. Universidad de las Islas Baleares, Departamento de Pedagogía Aplicada y Psicología de la Educación.
Orellana, M. L., et al., (2016) Programa para el Fortalecimiento de la Calidad de la Investigación en Posgrados. Tutoría de la investigación y formación de investigadores en posgrados: modelos, recursos y entorno virtual, [online] Available at: https://www.researchgate.net/publication/330726923_Programa_para_el_Fortalecimiento_de_la_Calidad_de_la_Investigacion_en_Posgrados_Tutoria_de_la_investigacion_y_formacion_de_investigadores_en_posgrados_modelos_recursos_y_entorno_virtual
Orr, D., Rimini, M. & Van Damme, D. (2015) Open Educational Resources: A Catalyst for Innovation, Educational Research and Innovation, OECD Publishing, Paris. doi: 10.1787/9789264247543-en
Ramírez, M. S. & Burgos, J. V. (coords) (2012) Recursos educativos abiertos y móviles para la formación de investigadores: Investigaciones y experiencias prácticas, Lulú editorial digital, Monterrey, México.
Snyder, T. & Dillow, S. (2013) Digest of Education Statistics 2012 (NCES 2014-015), National Center for Education Statistics, Institute of Education Sciences, U.S., Department of Education. Washington, DC.
Sussex, R. (2008) ‘Technological options in supervising remote research students’, Higher Education, vol. 55, no. 1, pp. 121–137. doi: 10.1007/s10734-006-9038-0
Taylor, S., Kiley, M. & Humphrey, R. (2017) A Handbook for Doctoral Supervisors, Routledge, London.
UNESCO (2002) ‘Forum on the impact of open courseware for higher education in developing countries’, [online] Available at: http://unesdoc.unesco.org/images/0012/001285/128515e.pdf
UNESCO & Commonwealth of Learning (COL) (2011) ‘Guidelines for open educational resources (OER) in higher education’, Paris, [online] Available at: http://unesdoc.unesco.org/images/0021/002136/213605E.pdf
Wang, T. & Li, L. Y. (2011) ‘“Tell me what to do” vs. “guide me through it”: Feedback experiences of international doctoral students’, Active Learning in Higher Education, vol. 12, no. 2, pp. 101–112. doi: 10.1177/1469787411402438
Wiley, D. A. (2013) ‘On quality and OER’, in Iterating toward Openness, [online] Available at: https://opencontent.org/blog/archives/2947
Wisker, G. (2012) The Good Supervisor: Supervising Postgraduate and Undergraduate Research for Doctoral Theses and Dissertations, Macmillan International Higher Education, Basingstoke, Hampshire, United Kingdom.
Yuan, M. & Recker, M. (2015) ‘Not all rubrics are equal: a review of rubrics for evaluating the quality of open educational resources’, International Review of Research in Open and Distance Learning, vol. 16, no. 5, pp. 16–38. doi: 10.19173/irrodl.v16i5.2389
Zawacki-Richter, O. & Mayrberger, K. (2017) ‘Qualität von OER: International Bestandsaufnahme von InstrumentenzurQualitätssicherung von Open Educational Resources (OER) – Schrittezueinemdeutschen Modell am Beispiel der Hamburg Open Online University’, Synergie (Sonderband), vol. January, [online] Available at: https://www.synergie.uni-hamburg.de/media/sonderbaende/qualitaet-von-oer-2017.pdf
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors contributing to Research in Learning Technology retain the copyright of their article and at the same time agree to publish their articles under the terms of the Creative Commons CC-BY 4.0 License (http://creativecommons.org/licenses/by/4.0/) allowing third parties to copy and redistribute the material in any medium or format, and to remix, transform, and build upon the material, for any purpose, even commercially, under the condition that appropriate credit is given, that a link to the license is provided, and that you indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.