
2024
Spider Man Simulator
HCI, Energy harvesting, Nanogenerator
Bo Hui, Bryan, Jaron Xing
We would like to introduce the innovative wearable interface, on-skin interface, applied in a Cave Automatic Virtual Environment system, as known as CAVE-like system, providing a more immersive and inclusive interaction within virtual environments. The essential feature of the interface is that it can be self-powered and positioned anywhere on the user's body according to individual needs and preferences. This flexibility ensures that the controller can accommodate a wide range of physical abilities and ergonomic design. For example, in our demonstration, users can replicate the distinctive hand gestures of the character Spiderman, sending commands to the system to simulate web launching in a gaming environment.
Publication:
Exploration of On-skin Interfaces to Enhance Immersive Experiences and Promote Inclusive Applications
The Cave Automatic Virtual Environment system (CAVE-like system) system [1] provides a physically immersive environment for both normal users and users with disabilities. However, the commonly used handheld controllers, while effective, limit user immersion and exclude some individuals with physical disabilities. We would like to propose an innovative interface device aimed at improving user immersion and accessibility in a CAVE-like system. The interface utilizes a nanogenerator-based pulse for signal generation and incorporates a nexus for real-time signal analysis and instruction generation with assistance of tracking system in CAVE-like system. The device provides users and designers with considerable flexibility to develop interactions tailored to specific gestures, physical capabilities, and ergonomic considerations, effectively overcoming the constraints associated with traditional handheld controllers.





