Long-term effectiveness of immersive VR simulations in undergraduate science learning: lessons from a media-comparison study

  • Prajakt Pande Department of People and Technology, Roskilde University, Roskilde, Denmark; and Centre for Virtual Learning Technologies, Roskilde University, Roskilde, Denmark
  • Amalie Thit Department of Science and Environment, Roskilde University, Roskilde, Denmark
  • Anja Elaine Sørensen Department of Science and Environment, Roskilde University, Roskilde, Denmark
  • Biljana Mojsoska Centre for Virtual Learning Technologies, Roskilde University, Roskilde, Denmark; and Department of Science and Environment, Roskilde University, Roskilde, Denmark
  • Morten E. Moeller Centre for Virtual Learning Technologies, Roskilde University, Roskilde, Denmark; and Department of Science and Environment, Roskilde University, Roskilde, Denmark
  • Per Meyer Jepsen Centre for Virtual Learning Technologies, Roskilde University, Roskilde, Denmark; and Department of Science and Environment, Roskilde University, Roskilde, Denmark
Keywords: virtual reality, longitudinal, science education, higher education, educational technology


Our main goal was to investigate if and how using multiple immersive virtual reality (iVR) simulations and their video playback, in a science course, affects student learning over time. We conducted a longitudinal study, in ecological settings, at an undergraduate field-course on three topics in environmental biology. Twenty-eight undergraduates were randomly assigned to either an iVR-interaction group or a video-viewing group. During the field-course, the iVR group interacted with a head-mounted device-based iVR simulation related to each topic (i.e. total three interventions), while the video group watched a pre-recorded video of the respective simulation on a laptop. Cognitive and affective data were collected through the following checkpoints: a pre-test before the first intervention, one topic-specific post-test immediately after each intervention, a final post-test towards the end of the course, and a longitudinal post-test deployed approximately 2 months after the course. Through a descriptive analysis, it was found that student performance on the knowledge tests increased considerably over time for the iVR group but remained unchanged for the video group. While no within- or between-group differences were noted for intrinsic motivation and self-efficacy measures, students in the iVR group enjoyed all the simulations, and perceived themselves to benefit from those simulations.


Download data is not yet available.


Andreasen, N. K., et al., (2019) ‘Virtual reality instruction followed by enactment can increase procedural knowledge in a science lesson’, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), IEEE, Osaka, Japan, pp. 840–841. doi: 10.1109/VR.2019.8797755

Ba, R., et al., (2019) ‘Virtual reality enzymes: an interdisciplinary and international project towards an inquiry-based pedagogy’, in VR, Simulations and Serious Games for Education, eds Y. Cai, W. V. Joolinger & Z. Walker, Springer, Singapore, pp. 45–54. doi: 10.1007/978-981-13-2844-2_5

Bailenson, J., et al., (2008) ‘The effect of interactivity on learning physical actions in virtual reality’, Media Psychology, vol. 11, no. 3, pp. 354–376. doi: 10.1080/15213260802285214

Bandura, A. (1997) Self-Efficacy: The Exercise of Control, Freeman, New York, NY. doi: 10.5860/choice.35-1826

Checa, D. & Bustillo, A. (2020) ‘A review of immersive virtual reality serious games to enhance learning and training’, Multimedia Tools and Applications, vol. 79, no. 9, pp. 5501–5527. doi: 10.1007/s11042-019-08348-9

Chen, J. A., et al., (2016) ‘A multi-user virtual environment to support students’ self-efficacy and interest in science: a latent growth model analysis’, Learning and Instruction, vol. 41, no. C, pp. 11–22. doi: 10.1016/j.learninstruc.2015.09.007

Chittaro, L. & Buttussi, F. (2015) ‘Assessing knowledge retention of an immersive serious game vs. a traditional education method in aviation safety’, IEEE Transactions on Visualization and Computer Graphics, vol. 21, no. 4, pp. 529–538. doi: 10.1109/TVCG.2015.2391853

Cochrane, T. (2016) ‘Mobile VR in education: from the fringe to the mainstream’, International Journal of Mobile and Blended Learning (IJMBL), vol. 8, no. 4, pp. 44–60. doi: 10.4018/IJMBL.2016100104

Concannon, B. J., Esmail, S. & Roberts, M. R. (2019) ‘Head-mounted display virtual reality in post-secondary education and skill training: a systematic review’, Frontiers in Education, vol. 4, p. 80. doi: 10.3389/feduc.2019.00080

Fiorella, L. & Mayer, R. E. (2016) ‘Eight ways to promote generative learning’, Educational Psychology Review, vol. 28, no. 4, pp. 717–741. doi: 10.1007/s10648-015-9348-9

Garcia-Bonete, M. J., Jensen, M. & Katona, G. (2019) ‘A practical guide to developing virtual and augmented reality exercises for teaching structural biology’, Biochemistry and Molecular Biology Education, vol. 47, no. 1, pp. 16–24. doi: 10.1002/bmb.21188

Gaupp, R., Drazic, I. & Körner, M. (2019) ‘Long-term effects of an e-learning course on patient safety: a controlled longitudinal study with medical students’, PLoS One, vol. 14, no. 1, p. e0210947. doi: 10.1371/journal.pone.0210947

Gutierrez-Maldonado, J., Andres-Pueyo, A. & Talarn-Caparros, A. (2015) ‘Virtual reality to train teachers in ADHD detection’, Society for Information Technology & Teacher Education International Conference, Association for the Advancement of Computing in Education (AACE), Las Vegas, USA, pp. 769–772.

Hanus, M. D. & Fox, J. (2015) ‘Assessing the effects of gamification in the classroom: a longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance’, Computers & Education, vol. 80, pp. 152–161. doi: 10.1016/j.compedu.2014.08.019

Hew, K. F. & Cheung, W. S. (2010) ‘Use of three-dimensional (3-D) immersive virtual worlds in K-12 and higher education settings: a review of the research’, British Journal of Educational Technology, vol. 41, no. 1, pp. 33–55. doi: 10.1111/j.1467-8535.2008.00900

Hidi, S. & Renninger, K. A. (2006) ‘The four-phase model of interest development’, Educational Psychologist, vol. 41, no. 2, pp. 111–127. doi: 10.1207/s15326985ep4102_4

Jensen, L. & Konradsen, F. (2018) ‘A review of the use of virtual reality head-mounted displays in education and training’, Education and Information Technologies, vol. 23, no. 4, pp. 1515–1529. doi: 10.1007/s10639-017-9676-0

Kafai, Y. B. & Dede, C. (2014) ‘Learning in virtual worlds’, in The Cambridge Handbook of the Learning Sciences, ed R. K. Sawyer, Cambridge University Press, Chapel Hill, USA, pp. 522–544.

Kavanagh, S., et al., (2017) ‘A systematic review of Virtual Reality in education’, Themes in Science and Technology Education, vol. 10, no. 2, pp. 85–119.

Khor, W. S., et al., (2016) ‘Augmented and virtual reality in surgery – the digital surgical environment: applications, limitations and legal pitfalls’, Annals of Translational Medicine, vol. 4, no. 23, p. 423. doi: 10.21037/atm.2016.12.23

Kolb, D. A. (1984) Experiential Learning: Experience as the Source of Learning and Development, FT Press.

Labster. (2019a) Pigment Extraction: Use Photosynthesis to Produce Biofuel and Reduce Pollution, [online] Available at: https://www.labster.com/simulations/pigment-extraction/

Labster. (2019b) Food Webs: Learn about Interactions between Trophic Levels, [online] Available at: https://www.labster.com/simulations/food-webs/

Labster. (2019c) Biodiversity: Assess and Compare Biodiversity on an Exoplanet Virtual Lab Simulation, [online] Available at: https://www.labster.com/simulations/biodiversity/

Lamb, R., et al., (2018) ‘Comparison of virtual reality and hands on activities in science education via functional near infrared spectroscopy’, Computers & Education, vol. 124, pp. 14–26. doi: 10.1016/j.compedu.2018.05.014

Lana, R. E. (2009) ‘Pretest Sensitization’, in Artifacts in Behavioral Research: Robert Rosenthal and Ralph L. Rosnow’s Classic Books, eds R. Rosenthal & R. L. Rosnow, Oxford University Press, New York, USA, p. 93.

Lee, E. A. L., Wong, K. W. & Fung, C. C. (2010) ‘How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach’, Computers & Education, vol. 55, no. 4, pp. 1424–1442. doi: 10.1016/j.compedu.2010.06.006

Liagkou, V., Salmas, D. & Stylios, C. (2019) ‘Realizing virtual reality learning environment for industry 4.0’, Procedia CIRP, vol. 79, pp. 712–717. doi: 10.1016/j.procir.2019.02.025

Madani, A., et al., (2014) ‘Impact of a hands-on component on learning in the Fundamental Use of Surgical EnergyTM (FUSE) curriculum: a randomized-controlled trial in surgical trainees’, Surgical Endoscopy, vol. 28, no. 10, pp. 2772–2782. doi: 10.1007/s00464-014-3544-4

Madani, A., et al., (2016) ‘Long-term knowledge retention following simulation-based training for electrosurgical safety: 1-year follow-up of a randomized controlled trial’, Surgical Endoscopy, vol. 30, no. 3, pp. 1156–1163. doi: 10.1007/s00464-015-4320-9

Madden, J., et al., (2020) ‘Ready student one: exploring the predictors of student learning in virtual reality’, PLoS One, vol. 15, no. 3, p. e0229788.

Makransky, G., et al., (2020) ‘Immersive Virtual reality increases liking but not learning with a science simulation and generative learning strategies promote learning in immersive Virtual reality’, Journal of Educational Psychology. doi: 10.1037/edu0000473

Makransky, G., Borre-Gude, S. & Mayer, R. E. (2019) ‘Motivational and cognitive benefits of training in immersive virtual reality based on multiple assessments’, Journal of Computer Assisted Learning, vol. 35, no. 6, pp. 691–707. https://doi.org/10.1111/jcal.12375

Makransky, G. & Lilleholt, L. (2018) ‘A structural equation modeling investigation of the emotional value of immersive virtual reality in education’, Educational Technology Research and Development, vol. 66, no. 5, pp. 1141–1164. doi: 10.1007/s11423-018-9581-2

Makransky, G., Terkildsen, T. & Mayer, R. (2019) ‘Adding immersive virtual reality to a science lab simulation causes more presence but less learning’, Learning and Instruction, vol. 60, pp. 225–236. doi: 10.1016/j.learninstruc.2017.12.007

Makransky, G., Thisgaard, M. & Gadegaard, H. (2016) ‘Virtual simulations as preparation for lab exercises: assessing learning of key laboratory skills in microbiology and improvement of essential non-cognitive skills’, PLoS One, vol. 11, no. 6, p. e0155895. doi: 10.1371/journal.pone.0155895

Merchant, Z., et al., (2014) ‘Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: a meta-analysis’, Computers & Education, vol. 70, no. C, pp. 29–40. doi: 10.1016/j.compedu.2013.07.033

Meyer, O. A., Omdahl, M. K. & Makransky, G. (2019) ‘Investigating the effect of pre-training when learning through immersive virtual reality and video: a media and methods experiment’, Computers & Education, vol. 140, p. 103603. doi: 10.1016/j.compedu.2019.103603

Mikropoulos, T. & Natsis, A. (2011) ‘Educational virtual environments: a ten-year review of empirical research (1999–2009)’, Computers & Education, vol. 56, no. 3, pp. 769–780. doi: 10.1016/j.compedu.2010.10.020

Monteiro, V., Mata, L. & Peixoto, F. (2015) ‘Intrinsic motivation inventory: psychometric properties in the context of first language and mathematics learning’, Psicologia: Reflexão e Crítica, vol. 28, no. 3, pp. 434–443. doi: 10.1590/1678-7153.201528302

Moos, D. & Marroquin, E. (2010) ‘Multimedia, hypermedia, and hypertext: motivation considered and reconsidered’, Computers in Human Behavior, vol. 26, no. 3, pp. 265–276. doi: 10.1016/j.chb.2009.11.004

Moro, C., Štromberga, Z. & Stirling, A. (2017) ‘Virtualisation devices for student learning: comparison between desktop-based (Oculus Rift) and mobile-based (Gear VR) virtual reality in medical and health science education’, Australasian Journal of Educational Technology, vol. 33, no. 6. doi: 10.14742/ajet.3840

OECD. (2018) Ruth Benander, EDU/EDPC(2018)45/ANN3, ‘Future of education and skills 2030: conceptual learning framework’, in A Literature Summary for Research on the Transfer of Learning 8th Informal Working Group (IWG) Meeting, [online] Available at: https://www.oecd.org/education/2030/A-Literature-Summary-for-Research-on-the-Transfer-of-Learning.pdf

Pande, P. & Chandrasekharan, S. (2017) ‘Representational competence: towards a distributed and embodied cognition account’, Studies in Science Education, vol. 53, no. 1, pp. 1–43. doi: 10.1080/03057267.2017.1248627

Pande, P. (2020) ‘Learning and expertise with scientific external representations: an embodied and extended cognition model’, Phenomenology and the Cognitive Sciences, pp. 1–20. doi: 10.1007/s11097-020-09686-y

Parong, J. & Mayer, R. E. (2018) ‘Learning science in immersive virtual reality’, Journal of Educational Psychology, vol. 110, no. 6, p. 785. doi: 10.1037/edu0000241

Pekrun, R. (2006) ‘The control-value theory of achievement emotions: assumptions, corollaries, and implications for educational research and practice’, Educational Psychology Review, vol. 18, no. 4, pp. 315–341. doi: 10.1007/s10648-006-9029-9

Pekrun, R. & Stephens, E. J. (2010) ‘Achievement emotions: a control-value approach’, Social and Personality Psychology Compass, vol. 4, no. 4, pp. 238–255. doi: 10.1111/j.1751-9004.2010.00259.x

Plass, J. L. & Kaplan, U. (2016) ‘Emotional design in digital media for learning’, in Emotions, Technology, Design, and Learning, eds S. Y. Tettegah & M. Gartmeier, Elsevier, Amsterdam, pp. 131–161. doi: 10.1016/B978-0-12-801856-9.00007-4

Radianti, J., et al., (2020) ‘A systematic review of immersive virtual reality applications for higher education: design elements, lessons learned, and research agenda’, Computers & Education, vol. 147, Article 103778. doi: 10.1016/j.compedu.2019.103778

Rambøll Management Consulting. (2014). SurveyXact. https://www.surveyxact.com/

Renninger, K. A. & Hidi, S. (2015) The Power of Interest for Motivation and Engagement, Routledge, New York, USA. doi: 10.4324/9781315771045

Ryan, R. M. & Deci, E. L. (2000) ‘Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being’, American Psychologist, vol. 55, no. 1, p. 68. doi: 10.1037/0003-066X.55.1.68

Sánchez, J., Lumbreras, M. & Silva, J. (1997) ‘Virtual reality and learning: trends and issues’, Proceedings of the 14th International Conference on Technology and Education, Oslo, Norway, pp. 10–13.

Schiefele, U. (1991) ‘Interest, learning, and motivation’, Educational Psychologist, vol. 26, no. 3–4, pp. 299–323. doi: 10.1080/00461520.1991.9653136

Schott, C. & Marshall, S. (2018) ‘Virtual reality and situated experiential education: a conceptualization and exploratory trial’, Journal of Computer Assisted Learning, vol. 34, no. 6, pp. 843–852. doi: 10.1111/jcal.12293

Southgate, E. (2020) Virtual Reality in Curriculum and Pedagogy: Evidence from Secondary Classrooms, Routledge, New York, USA. doi: 10.4324/9780429291982

Tan, S. & Waugh, R. (2013) ‘Use of virtual-reality in teaching and learning molecular biology’, in 3D Immersive and Interactive Learning, ed Y. Cai, Springer, Singapore, pp. 17–43. doi: 10.1007/978-981-4021-90-6_2

Tokunaga, R. S. (2013) ‘Engagement with novel virtual environments: the role of perceived novelty and flow in the development of the deficient self-regulation of Internet use and media habits’, Human Communication Research, vol. 39, pp. 365–393. doi: 10.1111/hcre.12008

Torff, B. & Tirotta, R. (2010) ‘Interactive whiteboards produce small gains in elementary students’ self-reported motivation in mathematics’, Computers & Education, vol. 54, no. 2, pp. 379–383. doi: 10.1016/j.compedu.2009.08.019

Vergara, D., et al., (2019) ‘On the importance of the design of virtual reality learning environments’, International Conference in Methodologies and Intelligent Systems for Technology Enhanced Learning, Springer, Cham, pp. 146–152. doi: 10.1007/978-3-030-23990-9_18

Wigfield, A. & Eccles, J. S. (2002) ‘The development of competence beliefs, expectancies for success, and achievement values from childhood through adolescence’, in Development of Achievement Motivation, eds A. Wigfield & J. S. Eccles, Academic Press, New York, USA, pp. 91–120. doi: 10.1016/B978-012750053-9/50006-1

Willson, V. L. & Putnam, R. R. (1982) ‘A meta-analysis of pretest sensitization effects in experimental design’, American Educational Research Journal, vol. 19, no. 2, pp. 249–258.

Wu, B., Yu, X. & Gu, X. (2020) ‘Effectiveness of immersive virtual reality using head-mounted displays on learning performance: a meta-analysis’, British Journal of Educational Technology, vol. 21, no. 6, pp. 1991–2005. doi: 10.1111/bjet.13023
How to Cite
Pande, P., Thit, A., Sørensen, A. E., Mojsoska, B., Moeller, M. E., & Jepsen, P. M. (2021). Long-term effectiveness of immersive VR simulations in undergraduate science learning: lessons from a media-comparison study. Research in Learning Technology, 29. https://doi.org/10.25304/rlt.v29.2482
Original Research Articles