Stereo Pano Video Playback in Unity 5.1

I'm wondering if anyone has had any luck with playing back stereo pano videos in Unity 5.1.. Here's where I'm at:

I'm guessing you can't use the native VR support as there's no access to each eye texture, so I'd have to disable that and use the old OVR integration. So I would create a sphere for each eye, cull each sphere to each eye camera, then use texture offsets to display each eye's video (using one video with both eyes on it, over/under). Since you can't use MovieTexture on Android for GearVR I'm thinking a .jpg sequence would work best, but then I'll run out of texture memory fast so will have to do something tricky to load/unload frames as it plays.

Seems like a mission! Anyone have an easier or more efficient way of getting stereo panos to play back within Unity? I need to integrate them with other realtime pieces so can't use any pre-packaged players..

thanks!