Skip to main content
Springer Nature Link
Log in

Sensorial Sensory Gaps in XR: A Relational Process Model for Immersive Experience

  • Conference paper
  • First Online:
Culture and Computing (HCII 2025)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 15800))

Included in the following conference series:

  • 247 Accesses

Abstract

Extended Reality (XR) technologies have continuously evolved, integrating virtual and physical experiences while converging with artificial intelligence (AI) to provide immersive services across various domains. However, despite these technological advancements and theoretical developments, the user experience (UX) of XR remains significantly constrained, failing to fully meet user expectations.

These limitations primarily stem from discrepancies in the relational balance among sensory inputs. In the physical world, sensory modalities operate in a harmonious and balanced manner. However, interactions with virtual objects often disrupt this equilibrium, leading to inconsistencies in sensory input integration.

This study identifies such sensory discrepancies as a critical challenge in human-centered XR technology development and experience design. It investigates the unmet aspects of immersive experiences and emphasizes a strategic approach to interaction design that ensures a balanced multisensory experience.

The methodology was based on a literature review, along with experimental research such as expert interviews. Using Python, the relationships between sensory elements were defined and simulated, leading to the development of a strategic research model for human-centered integrated design, referred to as the “Relational Process Model for Immersive Experience.” The results provide a foundational framework for developing standardized usability metrics and design methodologies. Additionally, it offers insights into overcoming the dual system development process that hinders the advancement of XR systems, contributing to the creation of smoother and more immersive user interactions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
€34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 60.98
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 79.17
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

') var buybox = document.querySelector("[data-id=id_"+ timestamp +"]").parentNode var buyingOptions = buybox.querySelectorAll(".buying-option") ;[].slice.call(buyingOptions).forEach(initCollapsibles) var buyboxMaxSingleColumnWidth = 480 function initCollapsibles(subscription, index) { var toggle = subscription.querySelector(".buying-option-price") subscription.classList.remove("expanded") var form = subscription.querySelector(".buying-option-form") var priceInfo = subscription.querySelector(".price-info") var buyingOption = toggle.parentElement if (toggle && form && priceInfo) { toggle.setAttribute("role", "button") toggle.setAttribute("tabindex", "0") toggle.addEventListener("click", function (event) { var expandedBuyingOptions = buybox.querySelectorAll(".buying-option.expanded") var buyboxWidth = buybox.offsetWidth ;[].slice.call(expandedBuyingOptions).forEach(function(option) { if (buyboxWidth buyboxMaxSingleColumnWidth) { toggle.click() } else { if (index === 0) { toggle.click() } else { toggle.setAttribute("aria-expanded", "false") form.hidden = "hidden" priceInfo.hidden = "hidden" } } }) } initialStateOpen() if (window.buyboxInitialised) return window.buyboxInitialised = true initKeyControls() })()

Institutional subscriptions

Similar content being viewed by others

References

  1. Alloway, T.P., Carpenter, C.: Exploring the use of pokémon go to enhance cognition and affect. Psychol. Popular Media 10(2), 178–186 (2021). https://doi.org/10.1037/ppm0000283

    Article  Google Scholar 

  2. Bollnow, O.: Human space. Mimesis International, Sesto San Giovanni, Italy. (2020)

    Google Scholar 

  3. Cornelio, P., Velasco, C., Obrist, M.: Multisensory integration as per technological advances: a review. Front. Neurosci. (2021). https://doi.org/10.3389/lastaccessed2025/01/25

    Article  Google Scholar 

  4. Fetsch, C.R., Pouget, A., DeAngelis, G.C., Angelaki, D.E.: Neural correlates of reliability-based cue weighting during multisensory integration. Nat. Neurosci. 15(1), 146–154 (2012). https://doi.org/10.1038/nn.2983

    Article  Google Scholar 

  5. Fontaine, G.: The experience of a sense of presence in intercultural and international encounters. Presence: Teleoperators Virtual Environ. 1(4), 482–490 (1992). https://doi.org/10.1162/pres.1992.1.4.482

    Article  Google Scholar 

  6. Heim, M.: Virtual Realism. Oxford University Press, UK (1998)

    Book  Google Scholar 

  7. Koo, J., Yoo, S., Nguyen, M. H., and Sung, M.: Salad: part-level latent diffusion for 3D shape generation and manipulation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 14441–14451 (2023)

    Google Scholar 

  8. Mori, M., Ikeda, S., Saito, H.: A survey of diminished reality: techniques for visually concealing, eliminating, and seeing through real objects. IPSJ Transact. Comput. Vis. Appl. (2017). https://doi.org/10.1186/s41074-017-0028-1

    Article  Google Scholar 

  9. Pretto, P., et al.: Foggy perception slows us down. Elfie 1, e00031 (2012). https://doi.org/10.7554/eLife.00031.lastaccessed2024/10/25

    Article  Google Scholar 

  10. Slater, M., Wilbur, S.: A framework for immersive virtual environments (FIVE): speculations on the role of presence in virtual environments. Presence Teleoperators Virtual Environ. 6(6), 603–616 (1997). https://doi.org/10.1162/pres.1997.6.6.603

    Article  Google Scholar 

  11. Spangenberg, E.R., Crowley, A.E.: Improving the store environment: do olfactory cues affect evaluations and behaviors? J. Market. 60(2), 67–80 (1996). https://doi.org/10.2307/1251931

    Article  Google Scholar 

  12. Wang, Y., Amores, J., Maes, P.: On-face olfactory interfaces. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, New York (2020). https://doi.org/10.1145/3313831.3376737

  13. Yang, L. et al.: Oakink: a large-scale knowledge repository for understanding hand-object inter-action. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 20953–20962 (2022)

    Google Scholar 

  14. Qin, T., Pan, J., Cao, S., Shen, S.: A general optimization-based framework for local odometry estimation with multiple sensors, arXiv preprint arXiv:1901.03638. 2019

Download references

Author information

Authors and Affiliations

  1. Hongik University, Sejong Special City, 30016, South Korea

    Sunghee Ahn

Authors
  1. Sunghee Ahn
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Sunghee Ahn .

Editor information

Editors and Affiliations

  1. Eindhoven University of Technology, Eindhoven, The Netherlands

    Matthias Rauterberg

Rights and permissions

Reprints and permissions

Copyright information

© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ahn, S. (2025). Sensorial Sensory Gaps in XR: A Relational Process Model for Immersive Experience. In: Rauterberg, M. (eds) Culture and Computing. HCII 2025. Lecture Notes in Computer Science, vol 15800. Springer, Cham. https://doi.org/10.1007/978-3-031-93160-4_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-93160-4_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-93159-8

  • Online ISBN: 978-3-031-93160-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics