Long-term effectiveness of immersive VR simulations in undergraduate science learning: lessons from a media-comparison study
Our main goal was to investigate if and how using multiple immersive virtual reality (iVR) simulations and their video playback, in a science course, affects student learning over time. We conducted a longitudinal study, in ecological settings, at an undergraduate field-course on three topics in environmental biology. Twenty-eight undergraduates were randomly assigned to either an iVR-interaction group or a video-viewing group. During the field-course, the iVR group interacted with a head-mounted device-based iVR simulation related to each topic (i.e. total three interventions), while the video group watched a pre-recorded video of the respective simulation on a laptop. Cognitive and affective data were collected through the following checkpoints: a pre-test before the first intervention, one topic-specific post-test immediately after each intervention, a final post-test towards the end of the course, and a longitudinal post-test deployed approximately 2 months after the course. Through a descriptive analysis, it was found that student performance on the knowledge tests increased considerably over time for the iVR group but remained unchanged for the video group. While no within- or between-group differences were noted for intrinsic motivation and self-efficacy measures, students in the iVR group enjoyed all the simulations, and perceived themselves to benefit from those simulations.
Andreasen, N. K., et al., (2019) ‘Virtual reality instruction followed by enactment can increase procedural knowledge in a science lesson’, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), IEEE, Osaka, Japan, pp. 840–841. doi: 10.1109/VR.2019.8797755
Ba, R., et al., (2019) ‘Virtual reality enzymes: an interdisciplinary and international project towards an inquiry-based pedagogy’, in VR, Simulations and Serious Games for Education, eds Y. Cai, W. V. Joolinger & Z. Walker, Springer, Singapore, pp. 45–54. doi: 10.1007/978-981-13-2844-2_5
Bailenson, J., et al., (2008) ‘The effect of interactivity on learning physical actions in virtual reality’, Media Psychology, vol. 11, no. 3, pp. 354–376. doi: 10.1080/15213260802285214
Bandura, A. (1997) Self-Efficacy: The Exercise of Control, Freeman, New York, NY. doi: 10.5860/choice.35-1826
Checa, D. & Bustillo, A. (2020) ‘A review of immersive virtual reality serious games to enhance learning and training’, Multimedia Tools and Applications, vol. 79, no. 9, pp. 5501–5527. doi: 10.1007/s11042-019-08348-9
Chen, J. A., et al., (2016) ‘A multi-user virtual environment to support students’ self-efficacy and interest in science: a latent growth model analysis’, Learning and Instruction, vol. 41, no. C, pp. 11–22. doi: 10.1016/j.learninstruc.2015.09.007
Chittaro, L. & Buttussi, F. (2015) ‘Assessing knowledge retention of an immersive serious game vs. a traditional education method in aviation safety’, IEEE Transactions on Visualization and Computer Graphics, vol. 21, no. 4, pp. 529–538. doi: 10.1109/TVCG.2015.2391853
Cochrane, T. (2016) ‘Mobile VR in education: from the fringe to the mainstream’, International Journal of Mobile and Blended Learning (IJMBL), vol. 8, no. 4, pp. 44–60. doi: 10.4018/IJMBL.2016100104
Concannon, B. J., Esmail, S. & Roberts, M. R. (2019) ‘Head-mounted display virtual reality in post-secondary education and skill training: a systematic review’, Frontiers in Education, vol. 4, p. 80. doi: 10.3389/feduc.2019.00080
Fiorella, L. & Mayer, R. E. (2016) ‘Eight ways to promote generative learning’, Educational Psychology Review, vol. 28, no. 4, pp. 717–741. doi: 10.1007/s10648-015-9348-9
Garcia-Bonete, M. J., Jensen, M. & Katona, G. (2019) ‘A practical guide to developing virtual and augmented reality exercises for teaching structural biology’, Biochemistry and Molecular Biology Education, vol. 47, no. 1, pp. 16–24. doi: 10.1002/bmb.21188
Gaupp, R., Drazic, I. & Körner, M. (2019) ‘Long-term effects of an e-learning course on patient safety: a controlled longitudinal study with medical students’, PLoS One, vol. 14, no. 1, p. e0210947. doi: 10.1371/journal.pone.0210947
Gutierrez-Maldonado, J., Andres-Pueyo, A. & Talarn-Caparros, A. (2015) ‘Virtual reality to train teachers in ADHD detection’, Society for Information Technology & Teacher Education International Conference, Association for the Advancement of Computing in Education (AACE), Las Vegas, USA, pp. 769–772.
Hanus, M. D. & Fox, J. (2015) ‘Assessing the effects of gamification in the classroom: a longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance’, Computers & Education, vol. 80, pp. 152–161. doi: 10.1016/j.compedu.2014.08.019
Hew, K. F. & Cheung, W. S. (2010) ‘Use of three-dimensional (3-D) immersive virtual worlds in K-12 and higher education settings: a review of the research’, British Journal of Educational Technology, vol. 41, no. 1, pp. 33–55. doi: 10.1111/j.1467-8535.2008.00900
Hidi, S. & Renninger, K. A. (2006) ‘The four-phase model of interest development’, Educational Psychologist, vol. 41, no. 2, pp. 111–127. doi: 10.1207/s15326985ep4102_4
Jensen, L. & Konradsen, F. (2018) ‘A review of the use of virtual reality head-mounted displays in education and training’, Education and Information Technologies, vol. 23, no. 4, pp. 1515–1529. doi: 10.1007/s10639-017-9676-0
Kafai, Y. B. & Dede, C. (2014) ‘Learning in virtual worlds’, in The Cambridge Handbook of the Learning Sciences, ed R. K. Sawyer, Cambridge University Press, Chapel Hill, USA, pp. 522–544.
Kavanagh, S., et al., (2017) ‘A systematic review of Virtual Reality in education’, Themes in Science and Technology Education, vol. 10, no. 2, pp. 85–119.
Khor, W. S., et al., (2016) ‘Augmented and virtual reality in surgery – the digital surgical environment: applications, limitations and legal pitfalls’, Annals of Translational Medicine, vol. 4, no. 23, p. 423. doi: 10.21037/atm.2016.12.23
Kolb, D. A. (1984) Experiential Learning: Experience as the Source of Learning and Development, FT Press.
Labster. (2019a) Pigment Extraction: Use Photosynthesis to Produce Biofuel and Reduce Pollution, [online] Available at: https://www.labster.com/simulations/pigment-extraction/
Labster. (2019b) Food Webs: Learn about Interactions between Trophic Levels, [online] Available at: https://www.labster.com/simulations/food-webs/
Labster. (2019c) Biodiversity: Assess and Compare Biodiversity on an Exoplanet Virtual Lab Simulation, [online] Available at: https://www.labster.com/simulations/biodiversity/
Lamb, R., et al., (2018) ‘Comparison of virtual reality and hands on activities in science education via functional near infrared spectroscopy’, Computers & Education, vol. 124, pp. 14–26. doi: 10.1016/j.compedu.2018.05.014
Lana, R. E. (2009) ‘Pretest Sensitization’, in Artifacts in Behavioral Research: Robert Rosenthal and Ralph L. Rosnow’s Classic Books, eds R. Rosenthal & R. L. Rosnow, Oxford University Press, New York, USA, p. 93.
Lee, E. A. L., Wong, K. W. & Fung, C. C. (2010) ‘How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach’, Computers & Education, vol. 55, no. 4, pp. 1424–1442. doi: 10.1016/j.compedu.2010.06.006
Liagkou, V., Salmas, D. & Stylios, C. (2019) ‘Realizing virtual reality learning environment for industry 4.0’, Procedia CIRP, vol. 79, pp. 712–717. doi: 10.1016/j.procir.2019.02.025
Madani, A., et al., (2014) ‘Impact of a hands-on component on learning in the Fundamental Use of Surgical EnergyTM (FUSE) curriculum: a randomized-controlled trial in surgical trainees’, Surgical Endoscopy, vol. 28, no. 10, pp. 2772–2782. doi: 10.1007/s00464-014-3544-4
Madani, A., et al., (2016) ‘Long-term knowledge retention following simulation-based training for electrosurgical safety: 1-year follow-up of a randomized controlled trial’, Surgical Endoscopy, vol. 30, no. 3, pp. 1156–1163. doi: 10.1007/s00464-015-4320-9
Madden, J., et al., (2020) ‘Ready student one: exploring the predictors of student learning in virtual reality’, PLoS One, vol. 15, no. 3, p. e0229788.
Makransky, G., et al., (2020) ‘Immersive Virtual reality increases liking but not learning with a science simulation and generative learning strategies promote learning in immersive Virtual reality’, Journal of Educational Psychology. doi: 10.1037/edu0000473
Makransky, G., Borre-Gude, S. & Mayer, R. E. (2019) ‘Motivational and cognitive benefits of training in immersive virtual reality based on multiple assessments’, Journal of Computer Assisted Learning, vol. 35, no. 6, pp. 691–707. https://doi.org/10.1111/jcal.12375
Makransky, G. & Lilleholt, L. (2018) ‘A structural equation modeling investigation of the emotional value of immersive virtual reality in education’, Educational Technology Research and Development, vol. 66, no. 5, pp. 1141–1164. doi: 10.1007/s11423-018-9581-2
Makransky, G., Terkildsen, T. & Mayer, R. (2019) ‘Adding immersive virtual reality to a science lab simulation causes more presence but less learning’, Learning and Instruction, vol. 60, pp. 225–236. doi: 10.1016/j.learninstruc.2017.12.007
Makransky, G., Thisgaard, M. & Gadegaard, H. (2016) ‘Virtual simulations as preparation for lab exercises: assessing learning of key laboratory skills in microbiology and improvement of essential non-cognitive skills’, PLoS One, vol. 11, no. 6, p. e0155895. doi: 10.1371/journal.pone.0155895
Merchant, Z., et al., (2014) ‘Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: a meta-analysis’, Computers & Education, vol. 70, no. C, pp. 29–40. doi: 10.1016/j.compedu.2013.07.033
Meyer, O. A., Omdahl, M. K. & Makransky, G. (2019) ‘Investigating the effect of pre-training when learning through immersive virtual reality and video: a media and methods experiment’, Computers & Education, vol. 140, p. 103603. doi: 10.1016/j.compedu.2019.103603
Mikropoulos, T. & Natsis, A. (2011) ‘Educational virtual environments: a ten-year review of empirical research (1999–2009)’, Computers & Education, vol. 56, no. 3, pp. 769–780. doi: 10.1016/j.compedu.2010.10.020
Monteiro, V., Mata, L. & Peixoto, F. (2015) ‘Intrinsic motivation inventory: psychometric properties in the context of first language and mathematics learning’, Psicologia: Reflexão e Crítica, vol. 28, no. 3, pp. 434–443. doi: 10.1590/1678-7153.201528302
Moos, D. & Marroquin, E. (2010) ‘Multimedia, hypermedia, and hypertext: motivation considered and reconsidered’, Computers in Human Behavior, vol. 26, no. 3, pp. 265–276. doi: 10.1016/j.chb.2009.11.004
Moro, C., Štromberga, Z. & Stirling, A. (2017) ‘Virtualisation devices for student learning: comparison between desktop-based (Oculus Rift) and mobile-based (Gear VR) virtual reality in medical and health science education’, Australasian Journal of Educational Technology, vol. 33, no. 6. doi: 10.14742/ajet.3840
OECD. (2018) Ruth Benander, EDU/EDPC(2018)45/ANN3, ‘Future of education and skills 2030: conceptual learning framework’, in A Literature Summary for Research on the Transfer of Learning 8th Informal Working Group (IWG) Meeting, [online] Available at: https://www.oecd.org/education/2030/A-Literature-Summary-for-Research-on-the-Transfer-of-Learning.pdf
Pande, P. & Chandrasekharan, S. (2017) ‘Representational competence: towards a distributed and embodied cognition account’, Studies in Science Education, vol. 53, no. 1, pp. 1–43. doi: 10.1080/03057267.2017.1248627
Pande, P. (2020) ‘Learning and expertise with scientific external representations: an embodied and extended cognition model’, Phenomenology and the Cognitive Sciences, pp. 1–20. doi: 10.1007/s11097-020-09686-y
Parong, J. & Mayer, R. E. (2018) ‘Learning science in immersive virtual reality’, Journal of Educational Psychology, vol. 110, no. 6, p. 785. doi: 10.1037/edu0000241
Pekrun, R. (2006) ‘The control-value theory of achievement emotions: assumptions, corollaries, and implications for educational research and practice’, Educational Psychology Review, vol. 18, no. 4, pp. 315–341. doi: 10.1007/s10648-006-9029-9
Pekrun, R. & Stephens, E. J. (2010) ‘Achievement emotions: a control-value approach’, Social and Personality Psychology Compass, vol. 4, no. 4, pp. 238–255. doi: 10.1111/j.1751-9004.2010.00259.x
Plass, J. L. & Kaplan, U. (2016) ‘Emotional design in digital media for learning’, in Emotions, Technology, Design, and Learning, eds S. Y. Tettegah & M. Gartmeier, Elsevier, Amsterdam, pp. 131–161. doi: 10.1016/B978-0-12-801856-9.00007-4
Radianti, J., et al., (2020) ‘A systematic review of immersive virtual reality applications for higher education: design elements, lessons learned, and research agenda’, Computers & Education, vol. 147, Article 103778. doi: 10.1016/j.compedu.2019.103778
Rambøll Management Consulting. (2014). SurveyXact. https://www.surveyxact.com/
Renninger, K. A. & Hidi, S. (2015) The Power of Interest for Motivation and Engagement, Routledge, New York, USA. doi: 10.4324/9781315771045
Ryan, R. M. & Deci, E. L. (2000) ‘Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being’, American Psychologist, vol. 55, no. 1, p. 68. doi: 10.1037/0003-066X.55.1.68
Sánchez, J., Lumbreras, M. & Silva, J. (1997) ‘Virtual reality and learning: trends and issues’, Proceedings of the 14th International Conference on Technology and Education, Oslo, Norway, pp. 10–13.
Schiefele, U. (1991) ‘Interest, learning, and motivation’, Educational Psychologist, vol. 26, no. 3–4, pp. 299–323. doi: 10.1080/00461520.1991.9653136
Schott, C. & Marshall, S. (2018) ‘Virtual reality and situated experiential education: a conceptualization and exploratory trial’, Journal of Computer Assisted Learning, vol. 34, no. 6, pp. 843–852. doi: 10.1111/jcal.12293
Southgate, E. (2020) Virtual Reality in Curriculum and Pedagogy: Evidence from Secondary Classrooms, Routledge, New York, USA. doi: 10.4324/9780429291982
Tan, S. & Waugh, R. (2013) ‘Use of virtual-reality in teaching and learning molecular biology’, in 3D Immersive and Interactive Learning, ed Y. Cai, Springer, Singapore, pp. 17–43. doi: 10.1007/978-981-4021-90-6_2
Tokunaga, R. S. (2013) ‘Engagement with novel virtual environments: the role of perceived novelty and flow in the development of the deficient self-regulation of Internet use and media habits’, Human Communication Research, vol. 39, pp. 365–393. doi: 10.1111/hcre.12008
Torff, B. & Tirotta, R. (2010) ‘Interactive whiteboards produce small gains in elementary students’ self-reported motivation in mathematics’, Computers & Education, vol. 54, no. 2, pp. 379–383. doi: 10.1016/j.compedu.2009.08.019
Vergara, D., et al., (2019) ‘On the importance of the design of virtual reality learning environments’, International Conference in Methodologies and Intelligent Systems for Technology Enhanced Learning, Springer, Cham, pp. 146–152. doi: 10.1007/978-3-030-23990-9_18
Wigfield, A. & Eccles, J. S. (2002) ‘The development of competence beliefs, expectancies for success, and achievement values from childhood through adolescence’, in Development of Achievement Motivation, eds A. Wigfield & J. S. Eccles, Academic Press, New York, USA, pp. 91–120. doi: 10.1016/B978-012750053-9/50006-1
Willson, V. L. & Putnam, R. R. (1982) ‘A meta-analysis of pretest sensitization effects in experimental design’, American Educational Research Journal, vol. 19, no. 2, pp. 249–258.
Wu, B., Yu, X. & Gu, X. (2020) ‘Effectiveness of immersive virtual reality using head-mounted displays on learning performance: a meta-analysis’, British Journal of Educational Technology, vol. 21, no. 6, pp. 1991–2005. doi: 10.1111/bjet.13023
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors contributing to Research in Learning Technology retain the copyright of their article and at the same time agree to publish their articles under the terms of the Creative Commons CC-BY 4.0 License (http://creativecommons.org/licenses/by/4.0/) allowing third parties to copy and redistribute the material in any medium or format, and to remix, transform, and build upon the material, for any purpose, even commercially, under the condition that appropriate credit is given, that a link to the license is provided, and that you indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.