Rolling Spheres: Privacy-Protected Hand Pose Reconstruction and Air Writing

Journal: IEEE TMC 2026

Rolling Spheres is a privacy-preserving hand interaction system for real-time 3D hand pose reconstruction and air writing. Instead of relying on cameras that capture facial or environmental details, it leverages rolling-shutter light pattern sensing with lightweight wearable markers to reconstruct hand motion at high temporal resolution while preserving user privacy.

Highlights

• Privacy-protected hand pose reconstruction without full-scene visual capture
• Real-time 3D hand tracking using rolling-shutter temporal-spatial sensing
• Supports air writing, gesture interaction, and virtual input scenarios
• High-frequency tracking with low latency for dynamic hand motion
• Potential applications in AR/VR/MR, gaming, smart home, and telesurgery