We’ve researched various possibilities to recognize and use non-verbal communication, such as head movements, to drive events in Virtual Reality. We’ve used Unreal and the Oculus Rift (DK2) to build these experiments. The demo video shows a few possibilities of using head movements in the context of window shopping: You can browse products by nodding, turn a product by rotating the head, and view products from up close.
We’re curious for your thoughts about our demo, and about using gestures / movements in Virtual Reality.
