Forum Discussion
Retrieve and send Controller Inputs from/to an Application
Is there a possibility to control an App (via. Oculus Link, Steam-apps) by reading and sending controller position values.
I only need access to the controllers (no other sensor information from the VR-Headset itself).
This is for a Computer Vision project. My intention is to train a model that is capable to play Beat Saber.
However, I want to avoid developing an own game on Unity or UE.
I only need access to the controllers (no other sensor information from the VR-Headset itself).
This is for a Computer Vision project. My intention is to train a model that is capable to play Beat Saber.
However, I want to avoid developing an own game on Unity or UE.
3 Replies
- Reading is easy. You can make a very minimal app that initialises the sdk as an invisible app, that makes it not render anything and it doesn't conflict with other games running. Then just poll the controller state.Have a look at my code here: https://github.com/rajetic/auto_oculus_touch/blob/master/auto_oculus_touch/dllmain.cppIn particular the initOculus and poll functions.Sending fake control data to the game is much harder. There's no easy way in the SDK to do that. You'll need to do something like injecting a DLL payload into the running game and hooking onto the SDK input functions so you can intercept calls to them and replace the data.
- Thank you for sharing your Repo. It helped me understanding the some basics of the sdk.
Yeah, the problem with manipulation of controller inputs remains.
I hope someone has a solution already or soon. Otherwise I'll have to dig into it myself and post an update altough dll injections are not my specialty - Do you think there is no way to emulate the oculus touch controller?
Basically the emulator will be recognized as a physical device, thus I believe manipulating an emulator seems to be an easier solution. But the question is whether or not this already exists?
