Description: The proposed innovation is to demonstrate the feasibility of creating a shared VR and AR world with photorealistic rendering of large-scale environment. The need for advanced extended immersive reality is critical in order to support future Lunar and Martian space missions training. NASA JSC has been using Virtual Reality for many years to train the astronauts in limited world space, for instance the interior of an ISS module, the robotics arm of both Shuttle and Station. The Artemis missions will challenge the current set of VR training capabilities and will require the move to a greater virtual world realism, to a more collaborative work environment, to a mix of multiple modalities and to the use of the continuously improving VR and AR headsets. Tietronix is proposing to develop a framework and associated artifacts development tools and workflow that provide a photorealistic multi-user multi-modality shared environment. We foresee the capability of our framework to enable AR and VR users’ collaboration, and to provide a wider set of interactions and use cases as compared to immersive VR alone.

Benefits: Complex assembly and maintenance tasks in space operational environments NASA Gateway missions NASA Artemis program Lunar Rover Training Active Response Gravity Offload System (ARGOS) project Scientific Hybrid Reality Environment (SHyRE) project Joint Augmented Reality Visual Informatics System (JARVIS)

Automotive assembly training Airline pilot training Power plant systems Solar electrical generating plants operator and field technicians training Department of Defense (DoD) large complex systems training