Long-term effectiveness of immersive VR simulations in undergraduate science learning: lessons from a media-comparison study

  • Prajakt Pande Department of People and Technology, Roskilde University, Roskilde, Denmark; and Centre for Virtual Learning Technologies, Roskilde University, Roskilde, Denmark
  • Amalie Thit Department of Science and Environment, Roskilde University, Roskilde, Denmark
  • Anja Elaine Sørensen Department of Science and Environment, Roskilde University, Roskilde, Denmark
  • Biljana Mojsoska Centre for Virtual Learning Technologies, Roskilde University, Roskilde, Denmark; and Department of Science and Environment, Roskilde University, Roskilde, Denmark
  • Morten E. Moeller Centre for Virtual Learning Technologies, Roskilde University, Roskilde, Denmark; and Department of Science and Environment, Roskilde University, Roskilde, Denmark
  • Per Meyer Jepsen Centre for Virtual Learning Technologies, Roskilde University, Roskilde, Denmark; and Department of Science and Environment, Roskilde University, Roskilde, Denmark
Keywords: virtual reality, longitudinal, science education, higher education, educational technology

Abstract

Our main goal was to investigate if and how using multiple immersive virtual reality (iVR) simulations and their video playback, in a science course, affects student learning over time. We conducted a longitudinal study, in ecological settings, at an undergraduate field-course on three topics in environmental biology. Twenty-eight undergraduates were randomly assigned to either an iVR-interaction group or a video-viewing group. During the field-course, the iVR group interacted with a head-mounted device-based iVR simulation related to each topic (i.e. total three interventions), while the video group watched a pre-recorded video of the respective simulation on a laptop. Cognitive and affective data were collected through the following checkpoints: a pre-test before the first intervention, one topic-specific post-test immediately after each intervention, a final post-test towards the end of the course, and a longitudinal post-test deployed approximately 2 months after the course. Through a descriptive analysis, it was found that student performance on the knowledge tests increased considerably over time for the iVR group but remained unchanged for the video group. While no within- or between-group differences were noted for intrinsic motivation and self-efficacy measures, students in the iVR group enjoyed all the simulations, and perceived themselves to benefit from those simulations.

Downloads

Download data is not yet available.

References


Andreasen, N. K., et al., (2019) ‘Virtual reality instruction followed by enactment can increase procedural knowledge in a science lesson’, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), IEEE, Osaka, Japan, pp. 840–841. doi: 10.1109/VR.2019.8797755


Ba, R., et al., (2019) ‘Virtual reality enzymes: an interdisciplinary and international project towards an inquiry-based pedagogy’, in VR, Simulations and Serious Games for Education, eds Y. Cai, W. V. Joolinger & Z. Walker, Springer, Singapore, pp. 45–54. doi: 10.1007/978-981-13-2844-2_5


Bailenson, J., et al., (2008) ‘The effect of interactivity on learning physical actions in virtual reality’, Media Psychology, vol. 11, no. 3, pp. 354–376. doi: 10.1080/15213260802285214


Bandura, A. (1997) Self-Efficacy: The Exercise of Control, Freeman, New York, NY. doi: 10.5860/choice.35-1826


Checa, D. & Bustillo, A. (2020) ‘A review of immersive virtual reality serious games to enhance learning and training’, Multimedia Tools and Applications, vol. 79, no. 9, pp. 5501–5527. doi: 10.1007/s11042-019-08348-9


Chen, J. A., et al., (2016) ‘A multi-user virtual environment to support students’ self-efficacy and interest in science: a latent growth model analysis’, Learning and Instruction, vol. 41, no. C, pp. 11–22. doi: 10.1016/j.learninstruc.2015.09.007


Chittaro, L. & Buttussi, F. (2015) ‘Assessing knowledge retention of an immersive serious game vs. a traditional education method in aviation safety’, IEEE Transactions on Visualization and Computer Graphics, vol. 21, no. 4, pp. 529–538. doi: 10.1109/TVCG.2015.2391853


Cochrane, T. (2016) ‘Mobile VR in education: from the fringe to the mainstream’, International Journal of Mobile and Blended Learning (IJMBL), vol. 8, no. 4, pp. 44–60. doi: 10.4018/IJMBL.2016100104


Concannon, B. J., Esmail, S. & Roberts, M. R. (2019) ‘Head-mounted display virtual reality in post-secondary education and skill training: a systematic review’, Frontiers in Education, vol. 4, p. 80. doi: 10.3389/feduc.2019.00080


Fiorella, L. & Mayer, R. E. (2016) ‘Eight ways to promote generative learning’, Educational Psychology Review, vol. 28, no. 4, pp. 717–741. doi: 10.1007/s10648-015-9348-9


Garcia-Bonete, M. J., Jensen, M. & Katona, G. (2019) ‘A practical guide to developing virtual and augmented reality exercises for teaching structural biology’, Biochemistry and Molecular Biology Education, vol. 47, no. 1, pp. 16–24. doi: 10.1002/bmb.21188


Gaupp, R., Drazic, I. & Körner, M. (2019) ‘Long-term effects of an e-learning course on patient safety: a controlled longitudinal study with medical students’, PLoS One, vol. 14, no. 1, p. e0210947. doi: 10.1371/journal.pone.0210947


Gutierrez-Maldonado, J., Andres-Pueyo, A. & Talarn-Caparros, A. (2015) ‘Virtual reality to train teachers in ADHD detection’, Society for Information Technology & Teacher Education International Conference, Association for the Advancement of Computing in Education (AACE), Las Vegas, USA, pp. 769–772.


Hanus, M. D. & Fox, J. (2015) ‘Assessing the effects of gamification in the classroom: a longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance’, Computers & Education, vol. 80, pp. 152–161. doi: 10.1016/j.compedu.2014.08.019


Hew, K. F. & Cheung, W. S. (2010) ‘Use of three-dimensional (3-D) immersive virtual worlds in K-12 and higher education settings: a review of the research’, British Journal of Educational Technology, vol. 41, no. 1, pp. 33–55. doi: 10.1111/j.1467-8535.2008.00900


Hidi, S. & Renninger, K. A. (2006) ‘The four-phase model of interest development’, Educational Psychologist, vol. 41, no. 2, pp. 111–127. doi: 10.1207/s15326985ep4102_4


Jensen, L. & Konradsen, F. (2018) ‘A review of the use of virtual reality head-mounted displays in education and training’, Education and Information Technologies, vol. 23, no. 4, pp. 1515–1529. doi: 10.1007/s10639-017-9676-0


Kafai, Y. B. & Dede, C. (2014) ‘Learning in virtual worlds’, in The Cambridge Handbook of the Learning Sciences, ed R. K. Sawyer, Cambridge University Press, Chapel Hill, USA, pp. 522–544.


Kavanagh, S., et al., (2017) ‘A systematic review of Virtual Reality in education’, Themes in Science and Technology Education, vol. 10, no. 2, pp. 85–119.


Khor, W. S., et al., (2016) ‘Augmented and virtual reality in surgery – the digital surgical environment: applications, limitations and legal pitfalls’, Annals of Translational Medicine, vol. 4, no. 23, p. 423. doi: 10.21037/atm.2016.12.23


Kolb, D. A. (1984) Experiential Learning: Experience as the Source of Learning and Development, FT Press.


Labster. (2019a) Pigment Extraction: Use Photosynthesis to Produce Biofuel and Reduce Pollution, [online] Available at: https://www.labster.com/simulations/pigment-extraction/


Labster. (2019b) Food Webs: Learn about Interactions between Trophic Levels, [online] Available at: https://www.labster.com/simulations/food-webs/


Labster. (2019c) Biodiversity: Assess and Compare Biodiversity on an Exoplanet Virtual Lab Simulation, [online] Available at: https://www.labster.com/simulations/biodiversity/


Lamb, R., et al., (2018) ‘Comparison of virtual reality and hands on activities in science education via functional near infrared spectroscopy’, Computers & Education, vol. 124, pp. 14–26. doi: 10.1016/j.compedu.2018.05.014


Lana, R. E. (2009) ‘Pretest Sensitization’, in Artifacts in Behavioral Research: Robert Rosenthal and Ralph L. Rosnow’s Classic Books, eds R. Rosenthal & R. L. Rosnow, Oxford University Press, New York, USA, p. 93.


Lee, E. A. L., Wong, K. W. & Fung, C. C. (2010) ‘How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach’, Computers & Education, vol. 55, no. 4, pp. 1424–1442. doi: 10.1016/j.compedu.2010.06.006


Liagkou, V., Salmas, D. & Stylios, C. (2019) ‘Realizing virtual reality learning environment for industry 4.0’, Procedia CIRP, vol. 79, pp. 712–717. doi: 10.1016/j.procir.2019.02.025


Madani, A., et al., (2014) ‘Impact of a hands-on component on learning in the Fundamental Use of Surgical EnergyTM (FUSE) curriculum: a randomized-controlled trial in surgical trainees’, Surgical Endoscopy, vol. 28, no. 10, pp. 2772–2782. doi: 10.1007/s00464-014-3544-4


Madani, A., et al., (2016) ‘Long-term knowledge retention following simulation-based training for electrosurgical safety: 1-year follow-up of a randomized controlled trial’, Surgical Endoscopy, vol. 30, no. 3, pp. 1156–1163. doi: 10.1007/s00464-015-4320-9


Madden, J., et al., (2020) ‘Ready student one: exploring the predictors of student learning in virtual reality’, PLoS One, vol. 15, no. 3, p. e0229788.


Makransky, G., et al., (2020) ‘Immersive Virtual reality increases liking but not learning with a science simulation and generative learning strategies promote learning in immersive Virtual reality’, Journal of Educational Psychology. doi: 10.1037/edu0000473


Makransky, G., Borre-Gude, S. & Mayer, R. E. (2019) ‘Motivational and cognitive benefits of training in immersive virtual reality based on multiple assessments’, Journal of Computer Assisted Learning, vol. 35, no. 6, pp. 691–707. https://doi.org/10.1111/jcal.12375


Makransky, G. & Lilleholt, L. (2018) ‘A structural equation modeling investigation of the emotional value of immersive virtual reality in education’, Educational Technology Research and Development, vol. 66, no. 5, pp. 1141–1164. doi: 10.1007/s11423-018-9581-2


Makransky, G., Terkildsen, T. & Mayer, R. (2019) ‘Adding immersive virtual reality to a science lab simulation causes more presence but less learning’, Learning and Instruction, vol. 60, pp. 225–236. doi: 10.1016/j.learninstruc.2017.12.007


Makransky, G., Thisgaard, M. & Gadegaard, H. (2016) ‘Virtual simulations as preparation for lab exercises: assessing learning of key laboratory skills in microbiology and improvement of essential non-cognitive skills’, PLoS One, vol. 11, no. 6, p. e0155895. doi: 10.1371/journal.pone.0155895


Merchant, Z., et al., (2014) ‘Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: a meta-analysis’, Computers & Education, vol. 70, no. C, pp. 29–40. doi: 10.1016/j.compedu.2013.07.033


Meyer, O. A., Omdahl, M. K. & Makransky, G. (2019) ‘Investigating the effect of pre-training when learning through immersive virtual reality and video: a media and methods experiment’, Computers & Education, vol. 140, p. 103603. doi: 10.1016/j.compedu.2019.103603


Mikropoulos, T. & Natsis, A. (2011) ‘Educational virtual environments: a ten-year review of empirical research (1999–2009)’, Computers & Education, vol. 56, no. 3, pp. 769–780. doi: 10.1016/j.compedu.2010.10.020


Monteiro, V., Mata, L. & Peixoto, F. (2015) ‘Intrinsic motivation inventory: psychometric properties in the context of first language and mathematics learning’, Psicologia: Reflexão e Crítica, vol. 28, no. 3, pp. 434–443. doi: 10.1590/1678-7153.201528302


Moos, D. & Marroquin, E. (2010) ‘Multimedia, hypermedia, and hypertext: motivation considered and reconsidered’, Computers in Human Behavior, vol. 26, no. 3, pp. 265–276. doi: 10.1016/j.chb.2009.11.004


Moro, C., Štromberga, Z. & Stirling, A. (2017) ‘Virtualisation devices for student learning: comparison between desktop-based (Oculus Rift) and mobile-based (Gear VR) virtual reality in medical and health science education’, Australasian Journal of Educational Technology, vol. 33, no. 6. doi: 10.14742/ajet.3840


OECD. (2018) Ruth Benander, EDU/EDPC(2018)45/ANN3, ‘Future of education and skills 2030: conceptual learning framework’, in A Literature Summary for Research on the Transfer of Learning 8th Informal Working Group (IWG) Meeting, [online] Available at: https://www.oecd.org/education/2030/A-Literature-Summary-for-Research-on-the-Transfer-of-Learning.pdf


Pande, P. & Chandrasekharan, S. (2017) ‘Representational competence: towards a distributed and embodied cognition account’, Studies in Science Education, vol. 53, no. 1, pp. 1–43. doi: 10.1080/03057267.2017.1248627


Pande, P. (2020) ‘Learning and expertise with scientific external representations: an embodied and extended cognition model’, Phenomenology and the Cognitive Sciences, pp. 1–20. doi: 10.1007/s11097-020-09686-y


Parong, J. & Mayer, R. E. (2018) ‘Learning science in immersive virtual reality’, Journal of Educational Psychology, vol. 110, no. 6, p. 785. doi: 10.1037/edu0000241


Pekrun, R. (2006) ‘The control-value theory of achievement emotions: assumptions, corollaries, and implications for educational research and practice’, Educational Psychology Review, vol. 18, no. 4, pp. 315–341. doi: 10.1007/s10648-006-9029-9


Pekrun, R. & Stephens, E. J. (2010) ‘Achievement emotions: a control-value approach’, Social and Personality Psychology Compass, vol. 4, no. 4, pp. 238–255. doi: 10.1111/j.1751-9004.2010.00259.x


Plass, J. L. & Kaplan, U. (2016) ‘Emotional design in digital media for learning’, in Emotions, Technology, Design, and Learning, eds S. Y. Tettegah & M. Gartmeier, Elsevier, Amsterdam, pp. 131–161. doi: 10.1016/B978-0-12-801856-9.00007-4


Radianti, J., et al., (2020) ‘A systematic review of immersive virtual reality applications for higher education: design elements, lessons learned, and research agenda’, Computers & Education, vol. 147, Article 103778. doi: 10.1016/j.compedu.2019.103778


Rambøll Management Consulting. (2014). SurveyXact. https://www.surveyxact.com/


Renninger, K. A. & Hidi, S. (2015) The Power of Interest for Motivation and Engagement, Routledge, New York, USA. doi: 10.4324/9781315771045


Ryan, R. M. & Deci, E. L. (2000) ‘Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being’, American Psychologist, vol. 55, no. 1, p. 68. doi: 10.1037/0003-066X.55.1.68


Sánchez, J., Lumbreras, M. & Silva, J. (1997) ‘Virtual reality and learning: trends and issues’, Proceedings of the 14th International Conference on Technology and Education, Oslo, Norway, pp. 10–13.


Schiefele, U. (1991) ‘Interest, learning, and motivation’, Educational Psychologist, vol. 26, no. 3–4, pp. 299–323. doi: 10.1080/00461520.1991.9653136


Schott, C. & Marshall, S. (2018) ‘Virtual reality and situated experiential education: a conceptualization and exploratory trial’, Journal of Computer Assisted Learning, vol. 34, no. 6, pp. 843–852. doi: 10.1111/jcal.12293


Southgate, E. (2020) Virtual Reality in Curriculum and Pedagogy: Evidence from Secondary Classrooms, Routledge, New York, USA. doi: 10.4324/9780429291982


Tan, S. & Waugh, R. (2013) ‘Use of virtual-reality in teaching and learning molecular biology’, in 3D Immersive and Interactive Learning, ed Y. Cai, Springer, Singapore, pp. 17–43. doi: 10.1007/978-981-4021-90-6_2


Tokunaga, R. S. (2013) ‘Engagement with novel virtual environments: the role of perceived novelty and flow in the development of the deficient self-regulation of Internet use and media habits’, Human Communication Research, vol. 39, pp. 365–393. doi: 10.1111/hcre.12008


Torff, B. & Tirotta, R. (2010) ‘Interactive whiteboards produce small gains in elementary students’ self-reported motivation in mathematics’, Computers & Education, vol. 54, no. 2, pp. 379–383. doi: 10.1016/j.compedu.2009.08.019


Vergara, D., et al., (2019) ‘On the importance of the design of virtual reality learning environments’, International Conference in Methodologies and Intelligent Systems for Technology Enhanced Learning, Springer, Cham, pp. 146–152. doi: 10.1007/978-3-030-23990-9_18


Wigfield, A. & Eccles, J. S. (2002) ‘The development of competence beliefs, expectancies for success, and achievement values from childhood through adolescence’, in Development of Achievement Motivation, eds A. Wigfield & J. S. Eccles, Academic Press, New York, USA, pp. 91–120. doi: 10.1016/B978-012750053-9/50006-1


Willson, V. L. & Putnam, R. R. (1982) ‘A meta-analysis of pretest sensitization effects in experimental design’, American Educational Research Journal, vol. 19, no. 2, pp. 249–258.


Wu, B., Yu, X. & Gu, X. (2020) ‘Effectiveness of immersive virtual reality using head-mounted displays on learning performance: a meta-analysis’, British Journal of Educational Technology, vol. 21, no. 6, pp. 1991–2005. doi: 10.1111/bjet.13023
Published
2021-01-18
How to Cite
Pande, P., Thit, A., Sørensen, A. E., Mojsoska, B., Moeller, M. E., & Jepsen, P. M. (2021). Long-term effectiveness of immersive VR simulations in undergraduate science learning: lessons from a media-comparison study. Research in Learning Technology, 29. https://doi.org/10.25304/rlt.v29.2482
Section
Original Research Articles