A Technical Account Behind the Development of a Reproducible Low-Cost Immersive Space to Conduct Applied User Testing

Document Type : Original Article

Authors

1 Cardiff School of Art & Design, Cardiff Metropolitan University, Llandaff Campus, Western Avenue, Cardiff, CF5 2YB - Wales - UK

2 School of Sport and Health Sciences, Cardiff Metropolitan University, Wales, UK

3 School of Design, Royal College of Art, London, UK.

4 Llandaff Campus, Cardiff Metropolitan University, Wales, UK

Abstract

Both laboratory and field experiments are flawed in their appropriateness for Human-centered design (HCD) user testing. Simulated Task Environments (STEs) offer a viable alternative, enabling researchers to recreate realistic conditions and immersive environments whilst controlling variables under laboratory conditions. This paper details the design process and technicalities used by a multi-disciplinary HCD research team to develop a reproducible low-cost immersive STE called the Perceptual Experience Laboratory (PEL). The research and development of the PEL in its three distinct stages is outlined to share the lessons learnt for the benefit of researchers and practitioners. In its current form, cylindrical media is surface-mapped on a bespoke 2m-high, 200° video wall to deliver seamless 12K enhanced field-of-view content around the user to visually recreate environments not normally accessible to researchers. The staging area can be configured with props and multisensory cues, simulating an in-context approach for HCD product testing. Additionally, immersive and realistic soundscapes are created via a 20.4 audio system equipped with spatial panners which provide directional sound. A growing number of commercial and academic research projects have been delivered using the PEL with research validating the user testing environment and its ongoing success attracting research and enterprise capital investments to advance immersive capabilities.

Keywords


Baldwin, J., & Evans, E. (2020). Exploring novel technologies to enhance food safety training and research opportunities. International Association for Food Protection. 40(6), p. 456–463. https://doi.org/10.4315/1541-9576-40.6.456
Baldwin, J., Haven-Tang, C., Gill, S., Morgan, N., & Pritchard, A. (2021). Using the perceptual experience laboratory (PEL) to simulate tourism environments for hedonic wellbeing. Information Technology Tourism. 23(1), p. 45–67. https://doi.org/10.1007/s40558-020-00179-x
Berg, L., & Vance, J. (2017). Industry use of virtual reality in product design and manufacturing: a survey. Virtual Reality. 21(1), p. 1–17. https://doi.org/10.1007/s10055-016-0293-9
Brade, J., Lorenz, M., Busch, M., Hammer, N., Tscheligi, M., & Klimant, P. (2017). Being there again – Presence in real and virtual environments and its relation to usability and user experience using a mobile navigation task. International Journal of Human Computer Studies. 101, p. 76–87. https://doi.org/10.1016/j.ijhcs.2017.01.004
Chang, E., Kim, H. T., & Yoo, B. (2020). Virtual reality sickness: A review of causes and measurements. International Journal of Human-Computer Interaction. p. 1658–1682. https://doi.org/10.1080/10447318.2020.1778351
Chu, S., & Downes, J. (2002). Proust nose best: Odors are better cues of autobiographical memory. Memory and Cognition. 30(4), p. 511–518. https://doi.org/10.3758/BF03194952
Dahl, Y., Alsos, O. A., & Svanæs, D. (2010). Fidelity considerations for simulation-based usability assessments of mobile ICT for hospitals. International Journal of Human-Computer Interaction. 26(5), p. 445–476. https://doi.org/10.1080/10447311003719938
de Back, T. T., Tinga, A. M., Nguyen, P., & Louwerse, M. M. (2020). Benefits of immersive collaborative learning in CAVE-based virtual reality. International Journal of Educational Technology in Higher Education. 17(1). https://doi.org/10.1186/s41239-020-00228-9
Deniaud, C., Honnet, V., Jeanne, B., & Mestre, D. (2015). The concept of “Presence” as a measure of ecological validity in driving simulators. Journal of International Science. 3(1), p. 1–13. https://doi.org/10.1186/s40166-015-0005-z
Dillon, C., Keogh, E., Freeman, J., & Davidoff, J. (2000). Aroused and Immersed: The Psychophysiology of Presence. Goldsmiths College Independent Television Commission.
Dinh, H., Walker, N., Hodges, L., Song, C., & Kobayshi, A. (1999). Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments. IEEE Annual International Symposium Virtual Reality.
Duffy, E. (1962). Activation and behaviour. Wiley & Son, New York.
Eoh, H., Chung, M., & Kim, S. (2005). Electroencephalographic study of drowsiness in simulated driving with sleep deprivation. International Journal of Industrial Ergonomics. 35(4), p. 307–330. https://doi.org/10.1016/j.ergon.2004.09.006
Freeman, D., Haselton, P., Freeman, J., Spanlang, B., Kishore, S., Albery, E., Denne, M., Brown, P., Slater, M., & Nickless, A. (2018). Automated psychological therapy using immersive virtual reality for treatment of fear of heights: a single-blind, parallel-group, randomised controlled trial. The Lancet Psychiatry. 5(8), p. 625–632. https://doi.org/10.1016/S2215-0366(18)30226-8
Freeman, D., Reeve, S., Robinson, A., Ehlers, A., Clark, D., Spanlang, B., & Slater, M. (2017). Virtual reality in the assessment, understanding, and treatment of mental health disorders. In Psychological Medicine. 47(14), p. 2393–2400. Cambridge University Press. https://doi.org/10.1017/S003329171700040X
Gadiraju, U., Möller, S., Nöllenburg, M., Saupe, D., Egger-Lampl, S., Archambault, D., & Fisher, B. (2015). Crowdsourcing versus laboratory: Towards human-centered experiments using the crowd. Lecture Notes in Computer Science. https://dx.doi.org/10.1007/978-3-319-66435-4_2
Gallagher, A. G., Ritter, E. M., Champion, H., Higgins, G., Fried, M. P., Moses, G., Smith, C. D., & Satava, R. M. (2005). Virtual reality simulation for the operating room: Proficiency-based training as a paradigm shift in surgical skills training. Annals of Surgery. 241(2), p. 364–372. https://doi.org/10.1097/01.sla.0000151982.85062.80
Genova, C., Biffi, E., Arlati, S., Redaelli, D. F., Prini, A., Malosio, M., Corbetta, C., Davalli, A., Sacco, M., & Reni, G. (2022). A simulator for both manual and powered wheelchairs in immersive virtual reality CAVE. Virtual Reality. 26(1), p. 187–203. https://doi.org/10.1007/s10055-021-00547-w
Giacomin, J. (2014). What is human Centered Design? The Design Journal. 14(4), p. 606–623. https://doi.org/10.2752/175630614X14056185480186
Gordon, B. (2007). Emulation of real-life environment via augmented virtual environment. [MSc thesis, Swansea Institute of Higher Education].
Gordon, B. (2021). Keeping it real: The potential for accessible mixed-reality usability testing environments. [Doctoral thesis, Cardiff Metropolitan University].
Greenguard, S. (2019). Virtual Reality (The MIT Press Essential Knowledge series). MIT Press. https://doi.org/10.7551/mitpress/11836.001.0001
Gromer, D., Madeira, O., Gast, P., Nehfischer, M., Jost, M., Müller, M., Mühlberger, A., & Pauli, P. (2018). Height simulation in a virtual reality cave system: Validity of fear responses and effects of an immersion manipulation. Frontiers in Human Neuroscience. 12(372), p. 372. https://doi.org/10.3389/fnhum.2018.00372
Guger, C., Edlinger, G., Leeb, R., Pfurtscheller, G., Antley, A., Garau, M., Brogni, A., Friedman, D., & Slater, M. (2004). Heart-rate variability and event-related ECG in virtual environments. In Proceedings of the 7th Annual International Workshop Presence 2004. p. 240–245.
Hays, R., & Singer, M. (2012). Simulation fidelity in training system design: Bridging the gap between reality and training. Springer, Berlin Heidelberg.
HCD Research Group. (2023). Retrieved July 12, from www.ucdresearch.com.
Herz, R. S. (1998). Are odors the best cues to memory? A cross-modal comparison of associative memory stimuli. Annals of the New York Academy of Sciences. p. 670–674. https://doi.org/10.1111/j.1749-6632.1998.tb10643.x
Hillman, N., & Pauletto, S. (2014). The Craftsman: The use of sound design to elicit emotions. The Soundtrack. 7(1), p. 5–23. https://doi.org/10.1386/st.7.1.5_1
Kassab, E., Tun, J., Arora, S., King, D., Ahmed, K., Miskovic, D., Cope, A., Vadwana, B., Bello, F., Sevdalis, N., & Kneebone, R. (2011). Blowing up the Barriers in surgical Training: Exploring and Validating the concept of Distributed Simulation. Annals of Surgery. 254(6), p. 1059–1065. https://doi.org/10.1097/SLA.0b013e318228944a
Kjeldskov, J., & Skov, M. (2007). Studying usability in Sitro: Simulating real world phenomena in controlled environments. International Journal of Human-Computer Interaction. 22(1–2), p. 7–36. https://doi.org/10.1207/s15327590ijhc2201-02_2
Krohn, S., Tromp, J., Quinque, E. M., Belger, J., Klotzsche, F., Rekers, S., Chojecki, P., De Mooij, J., Akbal, M., McCall, C., Villringer, A., Gaebler, M., Finke, C., & Thöne-Otto, A. (2020). Multidimensional evaluation of virtual reality paradigms in clinical neuropsychology: Application of the VR-check framework. Journal of Medical Internet Research. 22(4). https://doi.org/10.2196/16724
Lachenmayr, B., & Vivell, P. (1992). Perimetrie. Stuttgart.
Lawrence, A. (2020). Thought for food: An evidence-led approach to improving welsh food industry competitiveness. [Doctoral thesis, Cardiff Metropolitan University].
Lawrence, A., Loudon, G., Gill, S., & Baldwin, J. (2019). Simulated environments for food packaging design assessment. International Conference of Culinary Arts and Sciences.
Lawrence, A., Loudon, G., Gill, S., Pepperell, R., & Baldwin, J. (2019). Geometry vs Realism: An exploration of visual immersion in a synthetic reality space. International Associations of Societies in Design Research Conference, Manchester, 2–5 September. Available at: https://iasdr2019.org/uploads/files/Proceedings/te-f-1248-Law-A.pdf
Lessiter, J., Freeman, J., Keogh, E., & Davidoff, J. (2001). A cross-media presence questionnaire: The ITC-sense of presence inventory. Presence. 10(3), p. 282–297. https://doi.org/10.1162/105474601300343612
Liu, D., Macchiarella, N. D., & Vincenzi, D. A. (2008). Simulation fidelity. In Human Factors in Simulation and Training. Issue December 2008, p. 61–74. https://doi.org/10.1201/9781420072846.ch4
Maillot, P., Dommes, A., Dang, N., & Vienne, F. (2017). Training the elderly in pedestrian safety: Transfer effect between two virtual reality simulation devices. Accident Analysis and Prevention. 99, p. 161–170. https://doi.org/10.1016/j.aap.2016.11.017
Manjrekar, S., Sandilya, S., Bhosale, D., Kanchi, S., Pitkar, A., & Gondhalekar, M. (2014). CAVE: An emerging immersive technology -a review. Proceedings - UKSim-AMSS 16th International Conference on Computer Modelling and Simulation. UKSim 2014, p. 131–136. https://doi.org/10.1109/UKSim.2014.20
Martins, J., Gonçalves, R., Branco, F., Barbosa, L., Melo, M., & Bessa, M. (2017). A multisensory virtual experience model for thematic tourism: A Port wine tourism application proposal. Journal of Destination Marketing & Management. 6(2), p. 103–109.
Meehan, M., Insko, B., Whitton, M., & Brooks, F. (2002). Physiological measures of presence in stressful virtual environments. ACM Transactions on Graphics. 21(3), p. 645-652. https://doi.org/10.1145/566654.566630
Munyann, I., Neer, S., Beidel, D., & Jentsch, F. (2016). Olfactory stimuli increase presence in virtual environments. PLoS ONE. 11(6), p. 1–19. https://doi.org/10.1371/journal.pone.0157568
Murray, N., Ademoya, O., Chinea, G., & Muntean, G. (2017). A tutorial for olfaction-based multisensorial media application design and Evaluation. ACM Computing Surveys. 50(5). https://doi.org/10.1145/3108243
Pan, X., & Hamilton, A. (2018). Why and how to use virtual reality to study human social interaction: The challenges of exploring a new research landscape. British Journal of Psychology. 109(3), p. 395–417. https://doi.org/10.1111/bjop.12290
Patton, D. (2014). How real is good enough? Assessing realism of presence in simulations and its effects on decision making. In D. Schmorrow & C. Fidopiastis (Eds.), Foundations of augmented cognition. Advancing human performance and decision-making through adaptive systems. Springer, Greece.
Riihiaho, S. (2017). Usability Testing. In Norman, K., & Kirakwski J. The Wiley Handbook of Human Computer Interaction. https://doi.org/10.1002/9781118976005.ch14
Ronchi, E., Mayorga, D., Lovreglio, R., Wahlqvist, J., & Nilsson, D. (2019). Mobile-powered head-mounted displays versus cave automatic virtual environment experiments for evacuation research. Computer Animation and Virtual Worlds. 30(6). https://doi.org/10.1002/cav.1873
Rosen, K. (2018). The history of medical simulation. Journal of Critical Care. 23(2), p. 157–166. https://doi.org/10.1016/j.jcrc.2007.12.004
Rubin, J., & Chisnell, D. (2008). Handbook of usability testing. How to Plan, Design and Conduct Effective Tests. Second Edition. Wiley Publishing, Indianapolis.
Rudd, J., Stern, K., & Isensee, S. (1996). Low vs. high-fidelity prototyping debate. Interactions. 3(1), p. 76–85.
Slater, M., Lotto, B., Arnold, M. M., & Sanchez-Vives, M. V. (2009). How we experience immersive virtual environments: The concept of presence and its measurement. Anuario de Psicologia. 40(2), p. 193–210.
Slater, M., & Sanchez-Vives, M. V. (2016). Enhancing our lives with immersive virtual reality. In Frontiers Robotics AI. 3(DEC). Frontiers Media S.A. https://doi.org/10.3389/frobt.2016.00074
Strasburger, H., Rentschler, I., & Jüttner, M. (2011). Peripheral vision and pattern recognition: A review. Journal of Vision. 11(3). https://doi.org/10.1167/11.5.13
Tussyadiah, I., Wang, D., Jung, T., & tom Dieck, M. (2018). Virtual reality, presence, and attitude change: Empirical evidence from tourism. Tourism Management. 66, p. 140–154. https://doi.org/10.1016/j.tourman.2017.12.003
Viglia, G., & Dolnicar, S. (2020). A review of experiments in tourism and hospitality. Annals of Tourism Research. 80, p. 1–15. https://doi.org/10.1016/j.annals.2020.102858
Virtual Reality Society. (2020). Head-mounted Displays. Retrieved December 5, from https://www.vrs.org.uk/virtual-reality-gear/head-mounted-displays/
Wang, Q. J., Escobar, F. B., Da Mota, P. A., & Velasco, C. (2021). Getting started with virtual reality for sensory and consumer science: Current practices and future perspectives. Food Research International. 145(110410). https://doi.org/10.1016/j.foodres.2021.110410
Watson, D., Clark, L., & Tellegan, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scale. Journal of Personality and Social Psychology. 54(6), p. 1063–1070.
Witmer, B., & Singer, M. (1998). Measuring presence in virtual environments: A presence questionnaire, presence. Teleoperators and Virtual Environments. 7(3), p. 225–240. https://doi.org/10.1162/105474698565686
Woolley, A. (2008). Contextual testing of interactive prototypes at the early stages within the discipline of design. (Issue December 2008). University of Wales.