Forum Discussion
Stereo camera
I wanted to render stereo vision into oculus rift. I've been researching a lot on this topic, and found openCV with openGL or direct3D will do the job. But can unity alone be suffice to do this job?
Unity apparently supports a WebCamTexture that lets you feed data from a camera into the scene. However, in order to do this effectively you need precise knowledge of the latency of the camera.
A naive approach would be to just take the webcam texture and place it in the scene at a fixed position relative to the Unity camera. However this doesn't produce very good results because in the delay between when the image was captured by the webcam and the time when it's rendered in the scene, your head may have moved.
But, if you track the head pose for when images are captured, then you can compensate for the change in head pose by the time they're displayed. Like this:
A naive approach would be to just take the webcam texture and place it in the scene at a fixed position relative to the Unity camera. However this doesn't produce very good results because in the delay between when the image was captured by the webcam and the time when it's rendered in the scene, your head may have moved.
But, if you track the head pose for when images are captured, then you can compensate for the change in head pose by the time they're displayed. Like this: