Open educational resources for research training: quality assurance through a collaborative evaluation

  • Victoria I. Marín Center for Open Education Research (COER), Faculty of Education and Social Sciences, Carl von Ossietzky Universität Oldenburg, Oldenburg, Germany http://orcid.org/0000-0002-4673-6190
  • Martha Lucía Orellana UNAB Creative, Universidad Autónoma de Bucaramanga (UNAB), Bucaramanga, Colombia
  • Nancy Peré Academic Unit, Universidad de la República, Montevideo, Uruguay
Keywords: evaluation criteria, higher education, distance education

Abstract

Although it is considered that open educational resources offer vast pedagogical opportunities for any educational context, there have been only few studies so far that have linked their use or application in the field of research training, and even less works that have addressed their quality assurance for that context. As part of an inter-institutional project, the main aim of this article is the collaborative selection and evaluation of appropriate educational resources for research training. The mixed method approach of the article includes needs’ analysis of researchers in training through questionnaires and interviews. This was the starting point for the collaborative evaluation of educational resources using the agreed common criteria derived from the Learning Object Review Instrument (LORI) evaluation instrument. This article suggests recommendations regarding the collaborative evaluation of educational resources and the use of LORI, and suggestions for creators of educational resources for research training to facilitate the quality assurance of their materials. A website is being developed to bind together the resources that have met the quality criteria established in collaborative evaluation.

Downloads

Download data is not yet available.

References


Adham, K. A., et al., (2018) ‘Learning to complete the PhD thesis’, Issues in Educational Research, vol. 28, no. 4, pp. 811–829, [online] Available at:http://www.iier.org.au/iier28/adham.pdf


Association of Universities and Colleges of Canada (AUCC) (2011) Trends in Higher Education: Volume 1 – Enrolment, Association of Universities and Colleges of Canada, Ottawa, ON.


Atenas, J. & Havemann, L. (2013) ‘Quality assurance in the open: an evaluation of OER repositories’, The International Journal for Innovation and Quality in Learning, vol. 2, pp. 22–34, [online] Available at: http://eprints.soas.ac.uk/17347/1/30-288-1-PB.pdf


Atenas, J. & Havemann, L. (2014) ‘Questions of quality in repositories of open educational resources: a literature review’, Research in Learning Technology, vol. 22, p. 20889. doi: 10.3402/rlt.v22.20889


Atenas, J., Havemann, L. & Priego, E. (2014) ‘Opening teaching landscapes: the importance of quality assurance in the delivery of open educational resources’, Open Praxis, vol. 6, no. 1, pp. 29–43. doi: 10.5944/openpraxis.6.1.81


Atkins, D. E., Brown, J. S. & Hammond, A. L. (2007) ‘A review of the open educational resources (OER) movement: achievements, challenges, and new opportunities’, Report to the William and Flora Hewlett Foundation, [online] Available at: http://www.hewlett.org/uploads/files/ReviewoftheOERMovement.pdf


Camilleri, A. F., Ehlers, U. D. & Pawlowski, J. (2014) State of the Art Review of Quality Issues Related to Open Educational Resources (OER) (No. JRC88304), Joint Research Centre (Seville site), [online] Available at: http://is.jrc.ec.europa.eu/pages/EAP/documents/201405JRC88304.pdf


Canto, P. J., Guillermo, M. C. & Tejada, M. A. (2012) ‘Recursos educativos abiertos para la formación de investigadores educativos: opinión de usuarios’, in Recursos educativos abiertos y móviles para la formación de investigadores: Investigaciones y experiencias prácticas, coord. M. S. Ramírez & J. V. Burgos, Lulú editorial digital, México, pp. 38–48.


Caplan, D. & Graham, R. (2008) ‘The development of online courses’, in The theory and practice of online learning, ed T. Anderson, Athabasca University Press, Edmonton, pp. 247–265.


Caswell, T., et al., (2008) ‘Open content and open educational resources: enabling universal education’, The International Review of Research in Open and Distributed Learning, vol. 9, no. 1, pp. 1–11, doi: 10.19173/irrodl.v9i1.469


Del Moral, M. E. & Cernea, D. A. (2005) ‘Diseñando Objetos de Aprendizaje como facilitadores de la construcción del conocimiento’, II Simposio Pluridisciplinar sobre Diseño, Evaluación y Descripción de Contenidos Educativos Reutilizables (SPDECE05), Barcelona, España.


Fernández-Pampillón, A. M., Dominguez, E. & de Armas, I. (2013) ‘Análisis de la evolución de los Repositorios Institucionales de material educativo digital de las universidades españolas’, RELATEC: Revista Latinoamericana de Tecnología Educativa, vol. 12, no. 2, pp. 11–25, [online] Available at: http://relatec.unex.es/article/view/1165


Fernández-Pampillón Cesteros, A. M., et al., (2017) ‘Herramienta de evaluación de la calidad de los Materiales Educativos Digitales: perfiles de aplicación del profesor y del alumno’, in UNE 71362 Calidad de los materiales educativos digitales. 35.240.90/Aplicaciones de las tecnologías de la información en educación, AENOR, Madrid, pp. 114–131, [online] Available at: https://eprints.ucm.es/45338/


Ford, K. C., Veletsianos, G. & Resta, P. (2014) ‘The structure and characteristics of #PhDChat, an emergent online social network’, Journal of Interactive Media in Education, vol. 2014, no. 1. doi: 10.5334/2014-08


Gordillo, A. (2017) Contribution to the Authoring, Distribution, Evaluation and Integration of Learning Objects, Dissertation E.T.S.I. Telecommunications, Universidad Politécnica de Madrid, [online] Available at: https://core.ac.uk/display/148690656?recSetID=


Gordillo, A., Barra, E. & Quemada, J. (2015) ‘A flexible open source web platform to facilitate learning object evaluation’, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings, Madrid, Spain. doi: 10.1109/FIE.2014.7044498


Hylén, J. (2006) Open Educational Resources: Opportunities and Challenges, OECD, Paris, [online] Available at: http://www.oecd.org/education/ceri/37351085.pdf


Kawachi, P. (2014) The TIPS Framework Version-2.0: Quality Assurance Guidelines for Teachers as Creators of Open Educational Resources, CEMCA, New Delhi, [online] Available at: http://cemca.org.in/ckfinder/userfiles/files/TIPS Framework_Version 2_0_Low.pdf


McGill, L. (2011) ‘Quality considerations’, [online] Available at: https://www.jisc.ac.uk/full-guide/open-educational-resources


Ministerio de Educación Nacional (MEN) (2013) ‘Ministerio de Educación Nacional, Sistema Nacional de Información de Educación Superior SNIES. Resumen de indicadores de educación superior’, [online] Available at: http://www.mineducacion.gov.co/sistemasdeinformacion


Moreno, J. & Salinas, J. (2011) ‘Resultados del proceso de diseño, desarrollo e implementación de un prototipo de entorno virtual para una comunidad de Investigadores en Formación’, Congreso Internacional EDUTEC 2011, Pachuca, México, [online] Available at: https://www.academia.edu/3010238/Resultados_del_proceso_de_dise%C3%B1o_desarrollo_e_implementaci%C3%B3n_de_un_prototipo_de_entorno_virtual_para_una_comunidad_de_Investigadores_en_Formaci%C3%B3n


Nesbit, J., Belfer, K. & Leacock, T. (2007) ‘Learning Object Review Instrument (LORI)’, [online] Available at: http://transplantedgoose.net/gradstudies/educ892/LORI1.5.pdf


Orellana, M. L. (2014) Supervisión en línea de proyectos de investigación en maestrías y doctorados. Estrategia de apoyo para la interacción, diseño y desarrollo de la investigación, haciendo uso de mapas conceptuales. Tesis Doctoral. Universidad de las Islas Baleares, Departamento de Pedagogía Aplicada y Psicología de la Educación.


Orellana, M. L., et al., (2016) Programa para el Fortalecimiento de la Calidad de la Investigación en Posgrados. Tutoría de la investigación y formación de investigadores en posgrados: modelos, recursos y entorno virtual, [online] Available at: https://www.researchgate.net/publication/330726923_Programa_para_el_Fortalecimiento_de_la_Calidad_de_la_Investigacion_en_Posgrados_Tutoria_de_la_investigacion_y_formacion_de_investigadores_en_posgrados_modelos_recursos_y_entorno_virtual


Orr, D., Rimini, M. & Van Damme, D. (2015) Open Educational Resources: A Catalyst for Innovation, Educational Research and Innovation, OECD Publishing, Paris. doi: 10.1787/9789264247543-en


Ramírez, M. S. & Burgos, J. V. (coords) (2012) Recursos educativos abiertos y móviles para la formación de investigadores: Investigaciones y experiencias prácticas, Lulú editorial digital, Monterrey, México.


Snyder, T. & Dillow, S. (2013) Digest of Education Statistics 2012 (NCES 2014-015), National Center for Education Statistics, Institute of Education Sciences, U.S., Department of Education. Washington, DC.


Sussex, R. (2008) ‘Technological options in supervising remote research students’, Higher Education, vol. 55, no. 1, pp. 121–137. doi: 10.1007/s10734-006-9038-0


Taylor, S., Kiley, M. & Humphrey, R. (2017) A Handbook for Doctoral Supervisors, Routledge, London.


UNESCO (2002) ‘Forum on the impact of open courseware for higher education in developing countries’, [online] Available at: http://unesdoc.unesco.org/images/0012/001285/128515e.pdf


UNESCO & Commonwealth of Learning (COL) (2011) ‘Guidelines for open educational resources (OER) in higher education’, Paris, [online] Available at: http://unesdoc.unesco.org/images/0021/002136/213605E.pdf


Wang, T. & Li, L. Y. (2011) ‘“Tell me what to do” vs. “guide me through it”: Feedback experiences of international doctoral students’, Active Learning in Higher Education, vol. 12, no. 2, pp. 101–112. doi: 10.1177/1469787411402438


Wiley, D. A. (2013) ‘On quality and OER’, in Iterating toward Openness, [online] Available at: https://opencontent.org/blog/archives/2947


Wisker, G. (2012) The Good Supervisor: Supervising Postgraduate and Undergraduate Research for Doctoral Theses and Dissertations, Macmillan International Higher Education, Basingstoke, Hampshire, United Kingdom.


Yuan, M. & Recker, M. (2015) ‘Not all rubrics are equal: a review of rubrics for evaluating the quality of open educational resources’, International Review of Research in Open and Distance Learning, vol. 16, no. 5, pp. 16–38. doi: 10.19173/irrodl.v16i5.2389


Zawacki-Richter, O. & Mayrberger, K. (2017) ‘Qualität von OER: International Bestandsaufnahme von InstrumentenzurQualitätssicherung von Open Educational Resources (OER) – Schrittezueinemdeutschen Modell am Beispiel der Hamburg Open Online University’, Synergie (Sonderband), vol. January, [online] Available at: https://www.synergie.uni-hamburg.de/media/sonderbaende/qualitaet-von-oer-2017.pdf
Published
2019-11-18
How to Cite
Marín, V., Orellana, M. L., & Peré, N. (2019). Open educational resources for research training: quality assurance through a collaborative evaluation. Research in Learning Technology, 27. https://doi.org/10.25304/rlt.v27.2271
Section
Original Research Articles