JURUSBANGOH
27 days agoHonored Guest
Proposta: Rastreamento Corporal Total via Wi-Fi
Subject: Proposal: WiFi-based Full Body Tracking using CSI (Channel State Information)
Message:
Hi Meta Dev Team,
I would like to propose a feature that could revolutionize body tracking on Meta Quest headsets without requiring external trackers or extra cameras: WiFi-based Motion Sensing using CSI (Channel State Information).
The Concept:
Every time a person moves between a WiFi transmitter (router) and a receiver (Quest), the signal undergoes phase and amplitude distortions. By accessing the CSI data from the Quest’s WiFi chipset, we can analyze these signal patterns to identify body posture and movement in real-time.
Technical Implementation:
- Signal Analysis: Utilize the 5GHz/6GHz signal fluctuations to map the user's silhouette and limb positions.
- Machine Learning Integration: Use a lightweight neural network to translate CSI "shadows" into skeletal data, similar to how researchers have successfully used WiFi for "through-wall" sensing.
- Hybrid Tracking: Combine this WiFi data with the existing Inside-Out tracking and IMU data to fill in the gaps when the controllers or legs are out of the cameras' field of view.
Why this is a game-changer:
- Zero Cost for the User: No need for Vive trackers or Tundra trackers.
- Privacy: It doesn't rely on optical images of the room, just radio frequency patterns.
- Lower Latency: Direct processing of signal data can be extremely fast on modern SOCs.
I believe this would make Full Body Tracking accessible to everyone and put the Quest even further ahead in the VR market.
Best regards,
- Vinícius