Skip to main content
Azrion
New Participant
May 18, 2020

Retrieve and send Controller Inputs from/to an Application

Is there a possibility to control an App (via. Oculus Link, Steam-apps) by reading and sending controller position values.
I only need access to the controllers (no other sensor information from the VR-Headset itself).

This is for a Computer Vision project. My intention is to train a model that is capable to play Beat Saber.
However, I want to avoid developing an own game on Unity or UE.

3 replies

kojack
kojack
Honored Contributor
May 19, 2020
Reading is easy. You can make a very minimal app that initialises the sdk as an invisible app, that makes it not render anything and it doesn't conflict with other games running. Then just poll the controller state.
In particular the initOculus and poll functions.

Sending fake control data to the game is much harder. There's no easy way in the SDK to do that. You'll need to do something like injecting a DLL payload into the running game and hooking onto the SDK input functions so you can intercept calls to them and replace the data.
Author: Oculus Monitor , Auto Oculus Touch , Forum Dark Mode , Phantom Touch Remover , X-Plane Fixer Hardware: Threadripper 1950x, MSI Gaming Trio 2080TI, Asrock X399 Taich Headsets: Wrap 1200VR, DK1, DK2, CV1, Rift-S, GearVR, Go, Quest, Quest 2, Reverb G2, Quest 3
AzrionAuthor
New Participant
June 2, 2020
Thank you for sharing your Repo. It helped me understanding the some basics of the sdk.

Yeah, the problem with manipulation of controller inputs remains.

I hope someone has a solution already or soon. Otherwise I'll have to dig into it myself and post an update altough dll injections are not my specialty
AzrionAuthor
New Participant
June 2, 2020
Do you think there is no way to emulate the oculus touch controller?

Basically the emulator will be recognized as a physical device, thus I believe manipulating an emulator seems to be an easier solution. But the question is whether or not this already exists?
Terms & ConditionsAccessibility statement