Optimized virtual reality design through user immersion level detection with novel feature fusion and explainable artificial intelligence

PeerJ Comput Sci. 2024 Jul 19:10:e2150. doi: 10.7717/peerj-cs.2150. eCollection 2024.

Abstract

Virtual reality (VR) and immersive technology have emerged as powerful tools with numerous applications. VR technology creates a computer-generated simulation that immerses users in a virtual environment, providing a highly realistic and interactive experience. This technology finds applications in various fields, including gaming, healthcare, education, architecture, and training simulations. Understanding user immersion levels in VR is crucial and challenging for optimizing the design of VR applications. Immersion refers to the extent to which users feel absorbed and engrossed in the virtual environment. This research primarily aims to detect user immersion levels in VR using an efficient machine-learning model. We utilized a benchmark dataset based on user experiences in VR environments to conduct our experiments. Advanced deep and machine learning approaches are applied in comparison. We proposed a novel technique called Polynomial Random Forest (PRF) for feature generation mechanisms. The proposed PRF approach extracts polynomial and class prediction probability features to generate a new feature set. Extensive research experiments show that random forest outperformed state-of-the-art approaches, achieving a high immersion level detection rate of 98%, using the proposed PRF technique. We applied hyperparameter optimization and cross-validation approaches to validate the performance scores. Additionally, we utilized explainable artificial intelligence (XAI) to interpret the reasoning behind the decisions made by the proposed model for user immersion level detection in VR. Our research has the potential to revolutionize user immersion level detection in VR, enhancing the design process.

Keywords: Deep learning; Explainable Artificial Intelligence; Machine learning; Virtual reality.

Grants and funding

This research is funded by Princess Nourah bint Abdulrahman University and Researchers Supporting Project number (PNURSP2024R346), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia. Prince Sultan University Riyadh Saudi Arabia supported Article Processing Charges (APC) of this publication. The funder provided full support regarding datasets, software, technology, infrastructure for study design, data collection and analysis, decision to publish, and preparation of the manuscript.