Forum Discussion

BreakMaker's avatar
BreakMaker
Explorer
2 years ago
Solved

Cannot access scene model entities at runtime on UE5.2 / Quest 3

Hi there,

I cannot access the scene model which I previously captured using Scene Capture. For my test, I have added the table of my PC workstation.

Following the documentation I have added an OculusXRScene actor and configured it.

This has definitely worked, as I can see the box shape representing the table when I hit "play in VR". Also, I can see the SceneMesh which I recorded with the depth scanner on the Quest3.

When I call GetActorsBySemanticLabel and specify "TABLE" as per the semantic label list on the documentation page, I get zero actors.

I am wondering if this is because I use link (for fast testing) but it would surprise me since I can access the scene mesh. 

Thanks for any hint!!

depth
Quest
scene
Unreal
  • BreakMaker's avatar
    BreakMaker
    2 years ago

    I am not sure where in the documentation they say that, but if so, it is outdated. You can get the scene mesh using Link and even see it in the PIE output. What you cannot see in the PIE output is the passthrough layer.

13 Replies

  • Jeebius's avatar
    Jeebius
    Honored Guest
    2 years ago

    Hi,

    How do you see the scene mesh? I've been trying to preview in when play in VR but I do not see anything.

    • BreakMaker's avatar
      BreakMaker
      Explorer
      2 years ago

      Hi,

      If you scan the room previously, the scene mesh will be stored locally on your device. You can then get the scene mesh from the OculusXRActor.

  • apricity.shen's avatar
    apricity.shen
    Honored Guest
    2 years ago

    Hi, I'm using scene api in quest3. But scene api doesnt work in built apk, while does work in quest link.
    Do you know the reason? Appreciate it!

    • BreakMaker's avatar
      BreakMaker
      Explorer
      2 years ago

      Hi, are you sure you set up the Project Settings correctly? There is a variable you must set in order for the scene mesh to be supported. Also do not forget to ask for the android permission when you start.

  • Aeromixx's avatar
    Aeromixx
    Expert Protege
    2 years ago

    I have not messed with Scene API yet, but common Android/Quest build issue is permissions. Check the Sample project if there is special permissions in the Android settings to copy and maybe even a node to request permissions. Just a shot in the dark guess.

  • kampfz's avatar
    kampfz
    Honored Guest
    2 years ago

    Not sure why you are even able to see something when you use preview in VR. It is stated directly in the documentation that the Scene API only works in a packaged APK. I've had no issues using it in a packaged APK

    • BreakMaker's avatar
      BreakMaker
      Explorer
      2 years ago

      I am not sure where in the documentation they say that, but if so, it is outdated. You can get the scene mesh using Link and even see it in the PIE output. What you cannot see in the PIE output is the passthrough layer.

  • BreakMaker's avatar
    BreakMaker
    Explorer
    2 years ago

    By the way I have solved the issue: This is not covered in the documentation so I if you run into the same problem, try this: You have to initialize the various components inside the OculusXRSceneActor placed in the level. Otherwise they never get spawned.

     

    By the way, I have created this spatial UI using what I have learned, check it out 🙂
    https://youtu.be/3nkdo9VH89w 

  • shreyaskr.2023's avatar
    shreyaskr.2023
    Honored Guest
    2 years ago

    Hey, were you able to solve the "GetActorsBySemanticLabel returning zero actors"?
    I can't get it to work on a packaged build.

    • kampfz's avatar
      kampfz
      Honored Guest
      2 years ago

      Make sure your scene is populated before calling Get Actors by Semantic Label. You can check if the scene is populated with the "Is Scene Populated" node and then populate with the "Populate Scene" node. Hope that helps!

      • shreyaskr.2023's avatar
        shreyaskr.2023
        Honored Guest
        2 years ago

        I keep getting IsScenePopulated as false even though I click on 'PopulateScene' in the UI after I do scene capture (setting up TABLE and OTHER.)

        I also have this error in the app's logs pulled from the headset-
        ```LogMR: Error: ovrp_InitializeMixedReality() failed```

        I have MetaXR plugin ticked and also have the passthrough enabled, anchor support, scene support all ticked to true.