Skip to main content
Inspiring
October 11, 2023
Solved

[UNRESOLVED as of May 30, 2024] - Quest 3 Controller Tracking Issues

update May 30, 2024: There have been no updates/improvements to controller tracking since Meta Support marked this as solved! Community consensus seems to be that this issue stems from hardware/software limitations with the controllers, specifically the method of tracking (as a software developer working specifically in the machine learning and computer vision space, I agree that this technology is not particularly robust enough to handle some types of movement). If you play games that require fast hand movements and/or dynamic hand positioning, I would recommend not buying a Quest 3, unfortunately. I've heard some anecdotes regarding improved tracking with the Quest Pro controllers, but the improvements are marginal at best - not worth the additional ~$300 for minimal performance gains IMO. My personal recommendation is to stick to Quest 2. Not to detract from the various improvements that the Quest 3 has brought (e.g., color passthrough w/higher resolution, better hand tracking, higher overall hardware specs compared to Quest 2, etc.), but Quest 2 controller tracking is significantly better than the Quest 3's. Ideally, my hope is that Meta will push an update that allows for pairing Quest 2 controllers with the Quest 3, but as of right now, that's just a pipe dream as Meta has given no indication of making these headsets/controllers backwards compatible. While I'm (naively) hopeful that things will change, realistically speaking, I have 0 expectations and a lot of disappointment.

 

tl;dr: I've had a Quest 2 for almost 3 years. I received my Quest 3 today and was very excited to use it. Controller tracking performance is much worse than the Quest 2, at least in the context of games where you swing your arms as fast as you can. This was not a problem for the Quest 2 (unless controllers were physically damaged, e.g., hitting a wall, dropping them, etc.). Don't buy if you play games like Gorilla Tag, Beat Saber, Synth Riders, or any of the other games mentioned throughout this thread!!!

 

Question:
Are there ways to modify the Quest 3's controller tracking such that fast hand movements won't be affected by the prediction-like behavior where the in-game hand moves farther than you swing? When I perform a baseball throwing movement with my hand/arm, the tracking will not keep up and it ends up losing my hand's position for a fraction of a second, causing my in-game hand to be positioned farther away than my hand actually is (this is not an issue with Quest 2 controller tracking).

 

Details/Context:
I primarily use VR for exercise, and I mostly play Gorilla Tag. Gorilla Tag is a game where you play as the upper half of a gorilla, using your arms as your means of locomotion. Basically, you use your arms as if they were your legs, and you can run, climb trees, wall-run, etc. It's an infection-based tagging game where you join a lobby of up to 9 other people, and the game will randomly select a player to be the first tagger. The tagger(s) will continue tagging until everyone in the lobby has been tagged (infection-style), and then a random player will be selected as first tagger; this pattern just continuously repeats.

While the learning curve is pretty steep to play at a high level, there is a growing community of players who are very competitive (approx. 10-20k players based on the communities I participate in - Competitive Gorilla Tag on Discord and Gorilla Tag Competitive on Discord). As a prominent member of this community, people have been seeking my feedback on whether or not the Quest 3 is worth it. While I feel that a majority of the new features are amazing, I have had issues with the controller tracking.

Gorilla Tag is an active game where you're constantly swinging your arms as fast as you can to travel around the map(s) to avoid being tagged. The primary player base for the game is Quest 2 users. Aside from physical damage, most players have not had any problems with controller tracking on the Quest 2, aside from when the controller goes out of the tracking range of the headset (as expected). 

However, the Quest 3 controllers lose tracking during medium-fast to fast hand movement (medium-fast: like playing catch with a friend; fast: throwing a baseball as hard as you can). The consequence of this in the context of Gorilla Tag is that your in-game arm extends to the game's max arm length frequently, causing your hand to collide with the wall/tree/ground and launch you away from the surface. This is a big issue for games/activities involving fast-paced hand movement as it's not nearly as reliable as the Quest 2 controller tracking performance. 

TheAntiSocializer
Honored Contributor
October 24, 2023

Hey everyone, I've connected with the team and they are actively investigating tracking issues like you've mentioned. We'll be working to improve performance, especially for competitive players in games like Gorilla Tag, Supernatural, IB Cricket, and Eleven Table Tennis. We expect to roll some of these improvements in the upcoming releases.

Sometimes it's okay to be a little Bing Chilling

531 replies

New Participant
November 11, 2023

Tracking on my Q3 is fine for me in standalone, but I'm having serious tracking issues on PCVR.

I am playing "In Death", the PC version of "In Death: Unchained". Quite often the controller drifts, and also freezes so I can't use my crossbow. But the enemies can still swarm in and attack me. This is making the game near unplayable. I'm sure I never had this issue with the Q2, but I've given that to my brother now. We need a fix for PCVR games too. Oh, and please fix the microphone popping issue also. It's awful.

Participant
November 11, 2023

Are you on a 6ghz band (6E) ? There are known issues for some if so, try 5ghz (reg AX AC). Otherwise trouble shooting PCVR can be quite a challenge - rely on Virtual Desktop and forget Air Link at it's basically abandoned by Meta. Check the VIrtual Desktop Discord for support

Participant
November 11, 2023

I replaced the batteries and turned off hand tracking fully. That helped somewhat as i noticed in Beat Saber that the device sometimes seems to be fights itself to switch to hand tracking vs. controller use, but still not a solid evidence, that this is a solution.

I fear that the missing cameras on the top of the device will be the downfall for Oculus Quest 3 as the tracking needs to fully rely on AI, which is a load of sh..(for now). This was a mistake to release it like this. I wonder if the dev team was ever considering Beat Saber type games at all or it was fully developed for MR and now they bite the bullet and hope everyone who dont like the product because of the problems like "fast hand movement", just leave silently.

Either way, this is unnacceptable, as users who buy this product should not be beta testers, trying to find out how can they manage to have better experience.

 

TheAntiSocializer 
Any dev update about this? Anything new they learned or any progress has been made?

 

 

 

Participant
November 11, 2023

I originally was under the same assumption but following a factory reset, issues with general tracking (hand tracking being too agressive like you describe) went away but I am still left with controller tracking issues under very specific circumstances. The fact that it can perform flawlessly under the most stringent conditions for a short period of time tells me that the overall design itself isn't flawed otherwise, it would always fail.

Participant
November 11, 2023

well I livid... now my right controller's haptic completely stopped working while in the middle of a workout. Tried everything, nothing seems to be bringing it. So left controller randomly losing tracking albeit in specific conditions and now right without haptic... lovely.

Participant
November 13, 2023

Disabling hand tracking helped alot in Beat Saber. I can manage to do 91-94% Expert+ runs now. Not perfect, still missing some blocks, but it's much better.

What also must be done to achieve this is how you need to hold the controllers. The controller must be a bit sideways, buttons facing almost directly to the side cameras and my pointing finger wraps around at the top(between the trigger and the top of the controller). This way i won't throw away the controller and not block the sensors.

But even after this, tracking issues are still present.

-Controllers tends to start floating away at the front of my face(even if just briefly, it could break the combos),

-Controllers not tracking properly around my knees,

-Controllers are performing extremely poorly higher then the headset.

If i play after the sun is down and the light source is directly above me, the controller tracking is extremely poor, no matter how i try to hold the controller.

I'm in the same room with the same light, furnitures, flooring and the Quest 2 didn't have these issues.

 

New Participant
November 19, 2023

I am so glad I found this thread! I was having weird issues yesterday with really basic swings in Beat Saber and some stuttering during songs. Doing a swing upwards vertically from my hip to above my head and sometimes the saber wouldn't even move in game. Just a T-shirt, ceiling light is on etc.

I didn't fully disable hand tracking, I just went to settings and toggled "Auto switch from Controllers to hands" to off and turn Auto-Switch sensitivity to low just for good measure and it seems to have sorted out both my issues. The songs no longer have little pauses like the quest is trying to calculate something and pretty much all of my swings are tracked and registered by the device!

Just speculating but I'm mostly convinced it's to do with the auto switching and there must be some swings that make the quest 3 think that I've put the controller down for a second. Not the most perfect tracking but also good enough for me to play casually.

Up and Coming
November 21, 2023

One of the most ridiculous threads to read through. Beat saber players using a grip that covers all the LEDs and then complaining about tracking???

People using wrongly designed quest adaptors where the LED face is obscured and then complaining about tracking, only to try a different (correctly designed) adaptor and not have issues.

Quest 3 tracking is good and anyone saying otherwise for their use case should have known what they were buying.

Participant
November 21, 2023

Alright, I'll bite and feed the troll just because...

The vast majority of users reporting issues are not using any kind of grip or adaptors, myself included.  The games where people are experiencing not some Applab demo but popular (hell even subscription based bundle with Q3 Meta first party) app. 

Obviously not a problem for everyone or every controller (only left one acting up in my case) for that matter which makes me hopeful that a FW or minute hardware tweak might take care of it. Until then, people are trying to figure out patterns and reasons why.

Up and Coming
November 21, 2023

We can ignore the troll. Plenty of people here have lots of experience. In addition to the most important people, VR enthusiasts who've bought a Quest 3, we've also had game developers chime in. Meta has replied here, acknowledging the issue!

Since the troll insinuated we're just some random know-nothings: I've been a Software Engineer for 30 years, I've worked with virtual worlds since the 1990s, covered early hardware 15 years ago back in the Vuzix days, and brought attention of the issue to my friends at NWN and The Verge. My friend Cory Ondrejka was the VP at Facebook who convinced Zuck to buy the Oculus (Google FlipperPA some time, or see this article). Over the past few years alone, I've owned an HTC Vive, Valve Index, Quest 2, and immediately noticed the issues on the Quest 3 upon purchase, while only using the as-designed grip on Beat Saber. As I previously mentioned, Meta has also acknowledged it. This is a real problem and I hope there is a solution, but I fear it is a bad hardware design and a bad bet that "A.I." could do more than it can. You can't fake reality, and BS generating machine learning models are going to be especially noticeable when it's attached to your body!

Up and Coming
November 21, 2023

Taichi said quest 3 tracking was good. He is one of the best beat saber players in the world. Are you going to argue with him? What does he do to get good tracking? He uses an alternate grip that does not obscure any of the LEDs.

Quest 3 when playing eleven table tennis tracks more realistically than it did on the quest 2. Look at the best players in the world hitting high speed shots exactly like real table tennis that were not possible on the quest 2.

The tracking volume of the quest 3 is larger than it is on the quest 2. I think that quest 3 tracking is miraculous given there is no tracking ring.

you can look on the eleven table tennis discord. One of the first adaptor to come out was the solidslime v1. It had tracking issues which were rectified with a v2 version of the adaptor. All of the other adaptors which are correctly designed also don't have much in the way of tracking issues. Or not much that is not attributed to the missing tracking ring.

Also one issue not brought up is the low stereo overlap of the quest 3 reduces depth perception and therefore user error at missing things that would not be missed on the quest 2.

I actually remember when I used a quest 1 (after using a quest 2 for 2 years) my beat saber scores improved on the quest 1. The controller shape was more natural in my hand and maybe the lighter weight also had a difference. Despite the quest 1 being worse in almost every way for beat saber (72hz, lower resolution, smaller tracking volume, etc.) my scores were better.

 

Up and Coming
November 21, 2023

As I posted above - turning off hand-tracking has mostly fixed the tracking on my MQ3. Not perfect, but playable.

 

Now, telling users that they're imagining it, or whatever you think is going on, is insulting. I'm glad I found a way to make it better, but turning off hand tracking is not an ideal solution.

Up and Coming
November 22, 2023

I never use any strap or controller protector that can cover any tracking LED. I usually play Beat Saber 9 to 10 star custom maps, it is clear that Quest 3 controller tracking wrongly (slow/moving to wrong direction) when moving fast among border of sight area. It’s more like a software issue. 

Participant
November 24, 2023

Same here my drumsticks keep disappearing on smash drums. Super disappointed since I think it’s too late to return my quest 3.

New Participant
November 27, 2023

Any updates here ? This is honestly a huge issue and it's disappointing that it's taking so long to resolve. 

New Participant
November 27, 2023

It is very disappointing 😞