Live Demonstration: NeuroTouch - A Neuromorphic Vision-based Tactile Sensor for Real-Time Gesture Recognition

Victor Hoffmann, Valentina Cavinato, Kirk Scheper; Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR) Workshops, 2025, pp. 5023-5024

We propose to demonstrate NeuroTouch, a vision-based tactile sensor that combines a highly deformable dome-shaped soft material with an integrated neuromorphic camera, leveraging frame-based and event-based vision for multi-finger gesture detection. Our approach transforms an elastic body into a rich and nuanced interactive controller by tracking markers printed on its surface with event-based methods and classifying the displacement field into one of five gesture types with a corresponding intensity. We will demonstrate this novel control interface with a simple video game, highlighting the potential of soft controllers for entertainment applications.