Feature Request: Custom passthrough styling with kernels, textures, and blending functions
Hi, it would be really nice if there was an API where you can supply a convolution kernel and/or texture with some blending function to apply to passthrough as a custom filter. Since there is no access to camera feed, the ability to apply custom kernels to passthrough image could be really useful. I am guessing this is what the SDK already does with "passthrough styles" (Passthrough Styles Sample | Oculus Developers). However, there's only edge detection currently. With custom kernels you can achieve a variety of other effects like gaussian blurs, image sharpening, etc. Kernel (image processing - Wikipedia With textures, you can apply these kernels at some strength sampled by values in some supplied stereo textures. This will allow for cool effects like applying blur or some custom lighting effect in a particular area, not necessarily the whole passthrough view. With blending functions, blend mode along with the supplied texture, you can achieve a wider variety of image color effects. Blend modes - Wikipedia This can all be done without access to the camera feed, only using scene information and I think this is somewhat of an essential feature if there isn't a plan to allow access to the camera. It would be really cool and maybe simpler if you could instead just upload some shader to the headset to be applied to passthrough, but I am guessing this would be difficult or it would have been done already. If anybody agrees or have other suggestions or alternatives for implementing cool passthrough effects, post a comment.1.8KViews3likes3Comments
