To Case Studies
06/30/2024
Shared Naked-Eye 3D Interface for Operating Space Rovers
Japan Aerospace Exploration Agency (JAXA)
The R&D theme “Applicability Evaluation of Naked-Eye 3D Monitor Technology to Manipulation Work” was selected in the ninth call of JAXA’s Space Exploration Innovation Hub. Together with Tokyo University of the Arts, xbs Inc., and Portalgraph Inc., JAXA prototyped a naked-eye 3D system that enables real-time tele-operation of on-orbit manipulators and planetary rovers.
Challenges
Conventional VR head-mounted displays are designed for a single user, making it impossible for a team to watch the same rover-camera feed together. Projecting that feed on a large flat display lets multiple observers view it simultaneously, yet the loss of stereoscopic depth severely reduces situational awareness.
Solution
To address this challenge, we mounted a VR180 camera on the rover, used Portalgraph to project its feed onto large displays, and delivered stereoscopic images to multiple viewers simultaneously. By dynamically adjusting the 3D projection to match each observer’s head movement, the system provides a much more immersive viewing experience.
Results
Conventional flat displays used for tele-operation fail to convey depth, so operators must rely on experience to gauge the rover’s surroundings. By deploying our new display technology, we provide a wide 3D field of view that follows head movements, significantly enhancing situational awareness and control precision.