Learning experience design of verbal prompts in virtual reality-based training for autistic children

  • Jewoong Moon Department of Educational Leadership, Policy, and Technology Studies, The University of Alabama, Tuscaloosa, Alabama, United States
Keywords: autism spectrum disorder, virtual world, social skills, verbal prompts, learning experience design


This study aimed to explore the design and development of verbal prompts in virtual reality (VR)-based social skills training for autistic children. Autism indicates a category with neurodiversity that influences individuals’ capability to engage in social and cognitive tasks. This complex neurodevelopmental condition manifests in a wide array of patterns, featuring unique experiences of each individual. This study explored both advantages and challenges encountered when autistic children interact with verbal prompts in multi-user, desktop VR-based social skills training. Our explanatory case study involved VR-based learning experiences of four autistic children. We used a qualitative thematic analysis to analyse the study participants’ interaction patterns with verbal prompts in the VR-based training. Our research can contribute to both theoretical knowledge and practical design guidelines for the creation of verbal prompts in desktop VR-based training programmes tailored for autistic children.


Download data is not yet available.


Adiani, D. et al. (2022). Career interview readiness in virtual reality (CIRVR): a platform for simulated interview training for autistic individuals and their employers. ACM Transactions on Accessible Computing (TACCESS), 15(1), 1–28. https://doi.org/10.1145/3505560

Aljehany, M. S., & Bennett, K. D. (2020). A comparison of video prompting to least-to-most prompting among children with autism and intellectual disability. Journal of Autism and Developmental Disorders, 50, 1714–1724. https://doi.org/10.1007/s10803-019-03929-x

Allen, G., & Courchesne, E. (2001). Attention function and dysfunction in autism. Frontiers in Bioscience-Landmark, 6(3), 105–119. https://doi.org/10.2741/allen

American Psychological Association. (2002). Ethical principles of psychologists and code of conduct. American Psychologist, 57, 1060–1073. https://doi.org/10.1037/0003-066X.57.12.1060

Bai, D. et al. (2019). Association of genetic and environmental factors with autism in a 5-country cohort. JAMA Psychiatry, 76(10), 1035–1043. https://doi.org/10.1001/jamapsychiatry.2019.1411

Barletta, V. S. et al. (2023). Serious games for autism based on immersive virtual reality: a lens on methodological and technological challenges. In Temperini, M. et al. Methodologies and Intelligent Systems for Technology Enhanced Learning, 12th International Conference. MIS4TEL 2022. Lecture Notes in Networks and Systems (pp. 181–195). Springer, Cham. https://doi.org/10.1007/978-3-031-20617-7_23

Bell, B. (2022). Using video modeling to teach abduction-prevention skills to children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 52(9), 3909–3918. https://doi.org/10.1007/s10803-021-05241-z

Bradley, R., & Newbutt, N. (2018). Autism and virtual reality head-mounted displays: a state of the art systematic review. Journal of Enabling Technologies, 12(3), 101–113. https://doi.org/10.1108/JET-01-2018-0004

Briot, K. et al. (2020). Social anxiety in children and adolescents with autism spectrum disorders contribute to impairments in social communication and social motivation. Frontiers in Psychiatry, 11, 710. https://doi.org/10.3389/fpsyt.2020.00710

Chang, Y. K., & Kuwata, J. (2020). Learning experience design: challenges for novice designers. In Schmidt, M., Tawfik, A. A., Jahnke, I. & Earnshaw, Y. (Eds.). Learner and User Experience Research: An Introduction for the Field of Learning Design & Technology. EdTech Books. Retrieved from https://edtechbooks.org/ux/LXD_challenges

Chen, J. et al. (2022). Virtual reality enhances the social skills of children with autism spectrum disorder: a review. Interactive Learning Environments, 1–22. https://doi.org/10.1080/10494820.2022.2146139

Chi, M. T. et al. (2001). Learning from human tutoring. Cognitive Science, 25(4), 471–533. https://doi.org/10.1207/s15516709cog2504_1

Chi, M. T., & Wylie, R. (2014). The ICAP framework: linking cognitive engagement to active learning outcomes. Educational Psychologist, 49(4), 219–243. https://doi.org/10.1080/00461520.2014.965823

Cresswell, L., Hinch, R., & Cage, E. (2019). The experiences of peer relationships amongst autistic adolescents: a systematic review of the qualitative evidence. Research in Autism Spectrum Disorders, 61, 45–60. https://doi.org/10.1016/j.rasd.2019.01.003

Didehbani, N. et al. (2016). Virtual reality social cognition training for children with high functioning autism. Computers in Human Behavior, 62, 703–711. https://doi.org/10.1016/j.chb.2016.04.033

Dixon, D. R. et al. (2020). Evaluation of an immersive virtual reality safety training used to teach pedestrian skills to children with autism spectrum disorder. Behavior Analysis in Practice, 13, 631–640. https://doi.org/10.1007/s40617-019-00401-1

Drasgow, E., Halle, J. W., & Ostrosky, M. M. (1998). Effects of differential reinforcement on the generalization of a replacement mand in three children with severe language delays. Journal of Applied Behavior Analysis, 31(3), 357–374. https://doi.org/10.1901/jaba.1998.31-357

Etikan, I., Musa, S. A., & Alkassim, R. S. (2016). Comparison of convenience sampling and purposive sampling. American Journal of Theoretical and Applied Statistics, 5(1), 1–4. https://doi.org/10.11648/j.ajtas.20160501.11

Glaser, N. et al. (2022). Formative design and development of a three-dimensional collaborative virtual learning environment through learning experience design methods. Journal of Formative Design in Learning, 6, 63–76. https://doi.org/10.1007/s41686-022-00072-2

Goldsmith, T. R., & LeBlanc, L. A. (2004). Use of technology in interventions for children with autism. Journal of Early and Intensive Behavior Intervention, 1(2), 166–178. https://doi.org/10.1037/h0100287

Green, G. (2001). Behavior analytic instruction for learners with autism: advances in stimulus control technology. Focus on Autism and Other Developmental Disabilities, 16(2), 72–85. https://doi.org/10.1177/108835760101600203

Heerey, E. A., Keltner, D., & Capps, L. M. (2003). Making sense of self-conscious emotion: linking theory of mind and emotion in children with autism. Emotion, 3(4), 394–400. https://doi.org/10.1037/1528-3542.3.4.394

Herrero, J. F., & Lorenzo, G. (2020). An immersive virtual reality educational intervention on people with autism spectrum disorders (ASD) for the development of communication skills and problem solving. Education and Information Technologies, 25, 1689–1722. https://doi.org/10.1007/s10639-019-10050-0

Jones, A. S., & Zarcone, J. R. (2014). Comparison of prompting strategies on two types of tasks with children diagnosed with autism spectrum disorders. Behavior Analysis in Practice, 7, 51–60. https://doi.org/10.1007/s40617-014-0010-7

Jones, E. K., Hanley, M., & Riby, D. M. (2020). Distraction, distress and diversity: exploring the impact of sensory processing differences on learning and school life for pupils with autism spectrum disorders. Research in Autism Spectrum Disorders, 72, 101515. https://doi.org/10.1016/j.rasd.2020.101515

Jung, S., & Sainato, D. M. (2015). Teaching games to young children with autism spectrum disorder using special interests and video modelling. Journal of Intellectual and Developmental Disability, 40(2), 198–212. https://doi.org/10.3109/13668250.2015.1027674

Katz, S. (2021). Utilizing GoogleMeets™ to implement prompting strategies during instruction for students with autism spectrum disorder. Journal of Special Education Technology, 36(2), 113–117. https://doi.org/10.1177/0162643421992702

Ke, F., & Im, T. (2013). Virtual-reality-based social interaction training for children with high-functioning autism. The Journal of Educational Research, 106(6), 441–461. https://doi.org/10.1080/00220671.2013.832999

Ke, F., Moon, J., & Sokolikj, Z. (2022). Virtual reality–based social skills training for children with autism spectrum disorder. Journal of Special Education Technology, 37(1), 49–62. https://doi.org/10.1177/0162643420945603

Koegel, R. L., Koegel, L. K., & Surratt, A. (1992). Language intervention and disruptive behavior in preschool children with autism. Journal of Autism and Developmental Disorders, 22(2), 141–153. https://doi.org/10.1007/BF01058147

Lahiri, U. et al. (2015). A physiologically informed virtual reality based social communication system for individuals with autism. Journal of Autism and Developmental Disorders, 45, 919–931. https://doi.org/10.1007/s10803-014-2240-5

Laugeson, E. A. et al. (2012). Evidence-based social skills training for adolescents with autism spectrum disorders: the UCLA PEERS program. Journal of Autism and Developmental Disorders, 42, 1025–1036. https://doi.org/10.1007/s10803-011-1339-1

Law, E. L. C., & Sun, X. (2012). Evaluating user experience of adaptive digital educational games with Activity Theory. International Journal of Human-Computer Studies, 70(7), 478–497. https://doi.org/10.1016/j.ijhcs.2012.01.007

Leslie, A. M., Friedman, O., & German, T. P. (2004). Core mechanisms in ‘theory of mind’. Trends in Cognitive Sciences, 8(12), 528–533.

Lorah, E. R. et al. (2015). A systematic review of tablet computers and portable media players as speech generating devices for individuals with autism spectrum disorder. Journal of Autism and Developmental Disorders, 45, 3792–3804. https://doi.org/10.1007/s10803-014-2314-4

Lorenzo, G. G., Newbutt, N. N., & Lorenzo-Lledó, A. A. (2023). Designing virtual reality tools for students with Autism Spectrum Disorder: a systematic review. Education and Information Technologies, 28, 1–49. https://doi.org/10.1007/s10639-022-11545-z

MacDuff, G. S., Krantz, P. J., & McClannahan, L. E. (2001). Prompts and prompt-fading strategies for people with autism. In Maurice, C., Green, G. & Foxx, R. M. (Eds.), Making a Difference: Behavioral Intervention for Autism (pp. 37–50). PRO-ED.

Maples-Keller, J. L. et al. (2017). The use of virtual reality technology in the treatment of anxiety and other psychiatric disorders. Harvard Review of Psychiatry, 25(3), 103. https://doi.org/10.1097/HRP.0000000000000138

McCleery, J. P. (2023). The Oxford Handbook of Autism and Co-occurring Psychiatric Conditions (Oxford Library of Psychology) (p. 443). New York, NY: Oxford University Press.

McCoy, K., & Hermansen, E. (2007). Video modeling for individuals with autism: a review of model types and effects. Education and Treatment of Children, 30(4), 183–213. https://doi.org/10.1353/etc.2007.0029

Meadan, H. et al. (2013). How can I help? Prompting procedures to support children’s learning. Young Exceptional Children, 16(4), 31–39. https://doi.org/10.1177/1096250613505099

Methley, A. M. et al. (2014). PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC Health Services Research, 14(1), 1–10. https://doi.org/10.1186/s12913-014-0579-0

Milley, A., & Machalicek, W. (2012). Decreasing students’ reliance on adults: a strategic guide for teachers of students with autism spectrum disorders. Intervention in School and Clinic, 48(2), 67–75. https://doi.org/10.1177/1053451212449739

Moon, J., & Ke, F. (2023). Effects of adaptive prompts in virtual reality-based social skills training for children with autism. Journal of Autism and Developmental Disorders, 1–21. https://doi.org/10.1007/s10803-023-06021-7

Moon, J., Choi, G. W., & Seo, J. Y. (2023). Revisiting multimedia learning design principles in virtual reality-based learning environments for autistic individuals. Virtual Reality, 27(4), 3101–3113.

Newman, B., Reinecke, D. R., & Meinberg, D. L. (2000). Self–management of varied responding in three students with autism. Behavioral Interventions, 15(2), 145–151. https://doi.org/10.1002/(SICI)1099-078X(200004/06)15:2%3C145::AID-BIN50%3E3.0.CO;2-3

Ogawa, R. T., & Malen, B. (1991). Towards rigor in reviews of multivocal literatures: applying the exploratory case study method. Review of Educational Research, 61(3), 265–286. https://doi.org/10.3102/00346543061003265

Olson, A. J., Roberts, C. A., & Leko, M. M. (2015). Teacher-, student-, and peer-directed strategies to access the general education curriculum for students with autism. Intervention in School and Clinic, 51(1), 37–44. https://doi.org/10.1177/1053451214546406

Parsons, S. (2015). Learning to work together: designing a multi-user virtual reality game for social collaboration and perspective-taking for children with autism. International Journal of Child-Computer Interaction, 6, 28–38. https://doi.org/10.1016/j.ijcci.2015.12.002

Parsons, S. (2016). Authenticity in Virtual Reality for assessment and intervention in autism: a conceptual review. Educational Research Review, 19, 138–157. https://doi.org/10.1016/j.edurev.2016.08.001

Schmidt, M., & Glaser, N. (2021). Investigating the usability and learner experience of a virtual reality adaptive skills intervention for adults with autism spectrum disorder. Educational Technology Research and Development, 69(3), 1665–1699. https://doi.org/10.1007/s11423-021-10005-8

Schmidt, M., & Huang, R. (2022). Defining learning experience design: voices from the field of learning design & technology. TechTrends, 66(2), 141–158. https://doi.org/10.1007/s11528-021-00656-y

Sundberg, M. L., Endicott, K., & Eigenheer, P. (2000). Using intraverbal prompts to establish tacts for children with autism. The Analysis of Verbal Behavior, 17, 89–104. https://doi.org/10.1007/BF03392958

Szumski, G. et al. (2019). Examining the effectiveness of naturalistic social skills training in developing social skills and theory of mind in preschoolers with ASD. Journal of Autism and Developmental Disorders, 49, 2822–2837. https://doi.org/10.1007/s10803-017-3377-9

Van Laarhoven, T. et al. (2018). Comparing mobile technologies for teaching vocational skills to individuals with autism spectrum disorders and/or intellectual disabilities using universally-designed prompting systems. Journal of Autism and Developmental Disorders, 48, 2516–2529. https://doi.org/10.1007/s10803-018-3512-2

Vann, S. W., & Tawfik, A. A. (2020). Flow theory and learning experience design in gamified learning environments. In Schmidt, M., Tawfik, A. A., Jahnke, I. & Earnshaw, Y. (Eds.), Learner and User Experience Research: An Introduction for the Field of Learning Design & Technology. EdTech Books. Retrieved from https://edtechbooks.org/ux/flow_theory_and_lxd

Vedora, J., & Conant, E. (2015). A comparison of prompting tactics for teaching intraverbals to young adults with autism. The Analysis of Verbal Behavior, 31(2), 267–276. https://doi.org/10.1007/s40616-015-0030-6

Yoder, P. J. et al. (2013). Social communication intervention effects vary by dependent variable type in preschoolers with autism spectrum disorders. Evidence-based Communication Assessment and Intervention, 7(4), 150–174. https://doi.org/10.1080/17489539.2014.917780
How to Cite
Moon J. (2024). Learning experience design of verbal prompts in virtual reality-based training for autistic children. Research in Learning Technology, 32. https://doi.org/10.25304/rlt.v32.3129
Original Research Articles