How to implement correct aspect ratio camera passthrough in Oculus
Hi, I am trying to implement camera passthrough, I need passthrough to be as close to our natural eye as possible. I know I need webcams that have about same FOV as Oculus, ~100 degree. And the webcams should be as close to human eye as possible. What confuses me is at how far in the VR world should the captured webcam be rendered? If I render too far, passthrough is just a small rectangle, if too close, entire FOV cannot be seen. So how to determine the right distance to render to match FOV of webcam and Oculus, so that passthrough shows as naturally as possible to a natural eye? Is doing a calibration the only solution? Can anyone point to how might a calibration be? Thank you.Non asymetric frustrum and custom FOV - how to encode this properly ?
I want to implement in our code a custom FOV setting. The question is whatever this is possible. From the camera setup parameters reported by the drivers (sum or min/max arcus tangent), it is clear CV1 required aprox. 79.5 FOV, DK2 95 FOV. The SDK documentation shows how to visualize lower FOV by using only a part of the HMD FOV (see Oculus Home example for demo ...) . It means to show e.g. 50 FOV tunel in the 79.5 FOV. CV1 require in addition strongly asymmetric camera placement (the lenses are not in the displays centre). The question is can I implement bigger FOV scene view than the drivers offered one ? It was working O.K. with DK2. If I now modify the asymmetric frustum matrix to both hold infinity to where should be and bigger FOV the scene looks aftet the modification during horizontal head movement warped and strange. I am not sure I do something wrong (I multiply the directional tangents by a constant to get bigger FOV) or whatever what I want is impossible due to the HW design. Any idea ?
