Do you have any feedback and/or issues in regards to the Meta Avatars SDK? Use this place to discuss, as we'll have members of the engineering team reviewing this thread! Read the blog on the Meta Avatars SDK here: https://developer.oculus.com/blog/meta-avatars-sdk-now-available/ Refer to the Meta Avatars SDK documentation here: https://developer.oculus.com/documentation/unity/meta-avatars-overview/

Hello mouse_bear Someone over on Oculus Start linked me here and I am glad as I do have some feedback but first, let me share that Meta is onto something big with the new Meta Avatars. My user testing with them was very positive. Users were absolutely delighted to see their own Meta Avatar and it made their immersion deeper. Way to go team Meta!!! Sadly it was not smooth sailing to implement and turns out that I cannot use them right now unfortunately. More on both below. End to End Tutorials and Videos:There is a big win for Meta and Developers in terms of Meta Avatars and the more apps that can adopt, the more it will make the entire platform feel more cohesive (like the Miis did on the Wii). I know you know this, but what you may not know is how much time developers are wasting right now due to a lack of a more direct explanation on how to implement Meta Avatars. Yes there is documentation but I and others I have spoken with, have spent many hours trying to figure it all out as not all was obvious. Thank goodness for the developer forums and the Oculus Start Discord. Thankfully I got it all sorted now, but that comes at a cost of wasted time and that impacts both of us. I spent many hours trying to figure out little things that are just not obvious in the documentation or even just absent. When I look back on what I have learned, I recognize one good tutorial would have cut it down from days to maybe 30 mins. Meta Avatars is that simple. This said, the trend these days is to not only provide the technical documentation like you have, but also videos with the developer(s) just casually walking you through setup, store deployment, avatar setup and testing (not just local avatar as that is far from custom Avatar in an app), common issues, limitations (like the lighting one below), troubleshooting tips, and best practices etc. These sorts of videos often get you up and running very quickly and allows you to get back to creating not trying to figure out why your avatar is blue. I am sorry to be negative here, but it really needs to be said that Meta should really consider stepping it up here as it is a win win for both Meta and devs who are working hard to bring content to the platform. Delays due to documentation gaps affect both of us. I highly recommend asking someone around the office who knows little to nothing about the Meta Avatars and have them try and implement it in Unity and elsewhere as it will provide many insights as to the gaps in the documentation and as well as input for your videos. If the Meta team would like to reach out to me for more feedback, I welcome it. Realtime Spot and Point of Light Support:I managed to get the Meta Avatars working end to end with a users custom avatar, but due to the additive/async scene load nature of my title, I cannot use light probes and thus I cannot light the Meta Avatar with anything other than a real time Directional light which just looks so flat and out of sync with the rest of the realtime lights. With this said, I am requesting real time shaders, preferably URP Lit or Simple Lit, be added to the Meta Avatar shaders for those of us who prefer real time lights and/or cannot use light probes. I know Meta does not recommend many realtime lights due to the hardware of the Quest, but with clever optimization, you really can have them...and a lot of them. There are over 100 realtime lights in my ride so far and as you can see if you try it yourself, they make things look very real as compared to light probes. Just look at the seat you are in and how the light and shadows interact especially in that loading area going under all the spotlights. It really adds to the immersion of my title and I am sure others. Thanks for reading my feedback and I look forward to improvements over the coming months. Ideally, realtime spot and point lights will be working with the Meta Avatars before I have completed my ride over the next year. LOVE to hear back from you on the priority of this request. My title https://www.oculus.com/experiences/quest/4212005182188732/ Edited to remove some of my frustration that was coming through. 🙂

6000 yes. Ran on PC. Running on Play->PC - yes. Building for Android now.Load up the SampleAvatarSDK in the editor and set the breakpoints where I have in the attached picture.If you only hit the last one, then USING_XR_SDK was not seen. Make sure you have it in the Windows AND Android 'other' settings.If you are hitting the 1st breakpoint, then hit continue and when you get to the 2nd breakpoint check the contents of the _UserID variable, it should be zero. If not, it thinks you want local avatars. Then go step by step, and see if the load if failing. If it is, Unity+meta thinks your API key settings are not correct.Looking forward to hearing and helping more.

Android build just finished. It is also working on Oculus.If not for you, you are not abandoned. I would love to see if I can help.

I wrote a free asset on the Unity asset store (it is a lot of code) to try to help others with.(I think this is the url) https://assetstore.unity.com/packages/templates/packs/simple-movement-kit-and-animation-helper-291684--I still have problems with it.-- In windows standalone some controlls backwards, except when you use the x-box controller, then go link with the Oculus and maybe it corrects the reverse controls. I am still tying to figure out why +x is not +x on all input devices.It might help you. Feel free to ask me if you have questions. (I get $0.00 for it, I do it for the fun of it).

However the avatar is 180° backward like it used to be.

Meta Avatars SDK (Feedback/Issues)

161 Replies

ImmersiveMatthew
Adventurer
4 years ago

Hello mouse_bear Someone over on Oculus Start linked me here and I am glad as I do have some feedback but first, let me share that Meta is onto something big with the new Meta Avatars. My user testing with them was very positive. Users were absolutely delighted to see their own Meta Avatar and it made their immersion deeper. Way to go team Meta!!! Sadly it was not smooth sailing to implement and turns out that I cannot use them right now unfortunately. More on both below.

End to End Tutorials and Videos:
There is a big win for Meta and Developers in terms of Meta Avatars and the more apps that can adopt, the more it will make the entire platform feel more cohesive (like the Miis did on the Wii). I know you know this, but what you may not know is how much time developers are wasting right now due to a lack of a more direct explanation on how to implement Meta Avatars. Yes there is documentation but I and others I have spoken with, have spent many hours trying to figure it all out as not all was obvious. Thank goodness for the developer forums and the Oculus Start Discord. Thankfully I got it all sorted now, but that comes at a cost of wasted time and that impacts both of us. I spent many hours trying to figure out little things that are just not obvious in the documentation or even just absent. When I look back on what I have learned, I recognize one good tutorial would have cut it down from days to maybe 30 mins. Meta Avatars is that simple. This said, the trend these days is to not only provide the technical documentation like you have, but also videos with the developer(s) just casually walking you through setup, store deployment, avatar setup and testing (not just local avatar as that is far from custom Avatar in an app), common issues, limitations (like the lighting one below), troubleshooting tips, and best practices etc. These sorts of videos often get you up and running very quickly and allows you to get back to creating not trying to figure out why your avatar is blue. I am sorry to be negative here, but it really needs to be said that Meta should really consider stepping it up here as it is a win win for both Meta and devs who are working hard to bring content to the platform. Delays due to documentation gaps affect both of us. I highly recommend asking someone around the office who knows little to nothing about the Meta Avatars and have them try and implement it in Unity and elsewhere as it will provide many insights as to the gaps in the documentation and as well as input for your videos. If the Meta team would like to reach out to me for more feedback, I welcome it.

Realtime Spot and Point of Light Support:
I managed to get the Meta Avatars working end to end with a users custom avatar, but due to the additive/async scene load nature of my title, I cannot use light probes and thus I cannot light the Meta Avatar with anything other than a real time Directional light which just looks so flat and out of sync with the rest of the realtime lights. With this said, I am requesting real time shaders, preferably URP Lit or Simple Lit, be added to the Meta Avatar shaders for those of us who prefer real time lights and/or cannot use light probes. I know Meta does not recommend many realtime lights due to the hardware of the Quest, but with clever optimization, you really can have them...and a lot of them. There are over 100 realtime lights in my ride so far and as you can see if you try it yourself, they make things look very real as compared to light probes. Just look at the seat you are in and how the light and shadows interact especially in that loading area going under all the spotlights. It really adds to the immersion of my title and I am sure others.

Thanks for reading my feedback and I look forward to improvements over the coming months. Ideally, realtime spot and point lights will be working with the Meta Avatars before I have completed my ride over the next year. LOVE to hear back from you on the priority of this request.

My title https://www.oculus.com/experiences/quest/4212005182188732/

Edited to remove some of my frustration that was coming through. 🙂
- ImmersiveMatthew
  Adventurer
  4 years ago
  I got it working end to end after a week of trying to figure all the little things not clear in the documentation and am happy to help you out. Where are you stuck? What did you get working so far if anything?
  - olaysia
    Expert Protege
    4 years ago
    Hello Metaverse-Adventures, thank you for offering help as it is much needed in my case!
    My first problem is that I can't get my own Oculus Account's avatar to show up in the example scenes. On my console I can see an error saying "Failed Entitlement Check - Missing entitlement for {my app id}". Falling back to Local Avatar.
- anthony.hunt.75
  Explorer
  4 years ago
  Hi
  
  I wanted to know if it was possible to edit the avatar models in the preset zip file, as I would need to have personalised avatars in an offline app, but connected on a LAN.
  
  Thanks !
Heaney-555
Heroic Explorer
4 years ago
The documentation states that cross-platform support (eg. same avatar showing on Quest and Rift) requires App Grouping in the Developer Dashboard.

However, App Grouping does not work for App Lab apps. App Lab apps cannot be grouped with Rift apps, thereby making cross-platform impossible.

Is there a workaround for this?
- olaysia
  Expert Protege
  3 years ago
  I've managed to get cross-platform to work without app grouping.
EdDaWord
Honored Guest
4 years ago
Per this other thread, it seems like the sample scenes are not running for some people: https://forums.oculusvr.com/t5/Unity-VR-Development/Meta-Avatars-SDK-mostly-broken/td-p/936708

I am also having trouble getting the Sample Scenes to run on the Quest 2. Is there a possibility of adding progressively complex scenes so that one can test why the built APKs might not be running on the device properly? Personally, I am stuck pretty early on. I've been able to other apps to run on the Quest however configuring the sample scenes has been troublesome.

Thanks for providing good documentation regardless.
kukuhbr
Honored Guest
4 years ago
Hi, I am having problem using Meta Avatar with Geckoview web view plugin.
Sample avatar with webview is OK.
CDNAvatar without webview is OK.
CDNAvatar toghether with webview crashed my app. (whichever one gets loaded first, once both are active in the scene, the app crash)

I am using the only available Oculus Quest-compatible webview on Unity asset store from Vuplex (https://assetstore.unity.com/packages/tools/gui/3d-webview-for-android-with-gecko-engine-web-browser-158778)
Apparently it's related to locked up threads as the crash report give SIGSEGV error on random places.

I've contacted Vuplex developer, set up a bug repro scene, and they have given me great support. They are checking whether the problem is related with Geckoview. We haven't been able to pinpoint the problem though.

I think there are also possibility that the crash is related to Meta Avatar sdk. During development, my team has found out that either disabling lipsync or downgrading shader from Horizon -> UnityStandard/MobileDiffuse can temporarily fix the crash. But the next day the crash unexplainably occurs again.

Is it possible if I get someone from the engineering team kindly take a peek in my bug repro scene and ask for their insight?
- olaysia
  Expert Protege
  4 years ago
  Oh **bleep**, I also work with Vuplex so I may get the same problem down the line. Let me know if you find a solution for this.
  - binary_nate
    Protege
    4 years ago
    Hi, Olaysia 👋. This is Nate, the founder of Vuplex. I did a deep dive into this issue, but unfortunately I haven't been able to figure out how to avoid the issue that the Meta Avatars SDK causes with Gecko. I'm tracking this issue, so if you do encounter it, please let me know. For now, I believe the best workaround if you encounter this issue is to switch to the non-Gecko 3D WebView for Android package, which is something I can help you with. I recently thought of a way that may help me remedy its limitations relating to mouse input on Oculus Quest, so I plan to pursue that in the near future to help make it as capable as the Gecko package.
Morgana
Explorer
4 years ago
Can we have a version of the SDK for those of us that choose not to use Unity please! And by that I mean not only Unreal, but please don't forget us devs who choose to use the Native path.... For any of your SDKs... Thanks!

VincentRezzoug

Member

4 years ago

Hi ! I'm trying to update my project by adding meta avatars to a custom PlayerController with OVRCameraRig
I encountered some problem with the avatar hands using controllers tracking. (head and hand tracking working fine)
I found this post and it seems to work : https://forums.oculusvr.com/t5/Unity-VR-Development/Meta-Avatars-Controller-tracking-with-OVRCameraRig-not-working/td-p/930865

Aweeed
Honored Guest
4 years ago
HI! I'm working on AVATAR2 SDK in unity (quest 2) , after input the developer number in Oculus Platform' -> 'Edit Settings' and Avatar edit setting , load the sample mirror scene , run in Oculus Link , the avatar is broken as you can see in photo below, I though it's two controler issue , so I change the setting to controller only, but It's the same result , please help , working on this for ten hours , still can not work ;(

and pop out some error message here
[ovrAvatar2 examplePlatformInit] Update your app id by selecting 'Oculus Platform' -> 'Edit Settings'
at Oculus.Platform.Core.getAppID (System.String appId) [0x00046] in C:\Users\User\OculusPassTest\Assets\Oculus\Platform\Scripts\Platform.cs:50
at Oculus.Platform.Core.AsyncInitialize (System.String appId) [0x00000] in C:\Users\User\OculusPassTest\Assets\Oculus\Platform\Scripts\Platform.cs:64
at OvrPlatformInit.InitializeOvrPlatform () [0x00020] in C:\Users\User\OculusPassTest\Assets\Oculus\Avatar2\Example\Common\Scripts\OvrPlatformInit.cs:34
UnityEngine.Debug:LogError (object,UnityEngine.Object)

[ovrAvatar2 sampleAvatar] Error initializing OvrPlatform. Falling back to local avatar
UnityEngine.Debug:LogError (object,UnityEngine.Object)

[ovrAvatar2] System.NullReferenceException: Object reference not set to an instance of an object
at Oculus.Avatar2.CAPI+ovrAvatar2Transform.op_Implicit (UnityEngine.Transform t) [0x00008] in C:\Users\User\OculusPassTest\Assets\Oculus\Avatar2\Scripts\CAPI\OvrAvatarAPI_Types.cs:364
at SampleInputTrackingDelegate.GetRawInputTrackingState (Oculus.Avatar2.OvrAvatarInputTrackingState& inputTrackingState) [0x00052] in C:\Users\User\OculusPassTest\Assets\Oculus\Avatar2\Example\Common\Scripts\SampleInputTrackingDelegate.cs:35
at Oculus.Avatar2.OvrAvatarInputTrackingDelegate.GetInputTrackingState (Oculus.Avatar2.OvrAvatarInputTrackingState& inputTrackingState) [0x00000] in C:\Users\User\OculusPassTest\Assets\Oculus\Avatar2\Scripts\OvrAvatarInputTrackingDelegate.cs:25
at Oculus.Avatar2.OvrAvatarBodyTrackingContext.InputTrackingCallback (Oculus.Avatar2.CAPI+ovrAvatar2InputTrackingState& trackingState, System.IntPtr userContext) [0x00007] in C:\Users\User\OculusPassTest\Assets\Oculus\Avatar2\Scripts\OvrAvatarBodyTrackingContext.cs:205
UnityEngine.Debug:LogError (object,UnityEngine.Object)
Oculus.Avatar2.OvrAvatarLog:Log (Oculus.Avatar2.OvrAvatarLog/ELogLevel,string,string,UnityEngine.Object) (at Assets/Oculus/Avatar2/Scripts/OvrAvatarLog.cs:101)
Oculus.Avatar2.OvrAvatarLog:LogError (string,string,UnityEngine.Object) (at Assets/Oculus/Avatar2/Scripts/OvrAvatarLog.cs:159)
Oculus.Avatar2.OvrAvatarBodyTrackingContext:InputTrackingCallback (Oculus.Avatar2.CAPI/ovrAvatar2InputTrackingState&,intptr) (at Assets/Oculus/Avatar2/Scripts/OvrAvatarBodyTrackingContext.cs:214)
Oculus.Avatar2.CAPI:OvrAvatar_Update (single) (at Assets/Oculus/Avatar2/Scripts/CAPI/OvrAvatarAPI_Avatar.cs:230)
Oculus.Avatar2.OvrAvatarManager:Update () (at Assets/Oculus/Avatar2/Scripts/OvrAvatarManager.cs:499)
- ImmersiveMatthew
  Adventurer
  4 years ago
  I believe the issue is that you need a Rift ID when using link on the Quest. You can just make a shell game on your developer dashboard and target the Rift to get that App ID. May be wrong there as I did not use link myself.
  - Aweeed
    Honored Guest
    4 years ago
    I'm using quest2 , so I put the ID in second colume, and I just apply a rift ID , doesn't work , thanks for reply 😉 HELP! ;(
IlyaVoitsekh
Explorer
4 years ago
Hi!
We're trying to test/use Meta Avatars SDK (v10, MirrorScene, Quest 2, Germany), by following this guide and encountered several issues:

- first we have seen an error "com.oculus.horizon.service.ExternalPlatformLocal$PackageNotInLibraryException: Package com.test.test not in users library" and we "fixed" it by adding the apk to alpha track so the build is not in "Unknown sources" category, but it main list of apps

- current issue is that Mirror Scene loads, but we see only Skybox and we can move, but there are NO AVATARS, in logs there were several errors, but the ones we though may lead to solving the issue are:

Thanks in advance for your time and help 🙂
- IlyaVoitsekh
  Explorer
  4 years ago
  We've setup a new empty project with Oculus Integration Package (v37) and Meta Avatars SDK (v10) and in empty project it works (we still see the errors which you can find above), but when we add it to existing project it fails.
  
  Seems like one of the biggest difference in logs is Error which says: SignatureHelper
  Not a trusted user. Do you pass the IsTrustedUser gk?
  
  Any ideas on why that is happening?
  
  Also you can see below two error logs from working empty project and non-working integration of avatars in our project:
  
  non working errors:
  
  errors from working version:
  - beastus
    Explorer
    4 years ago
    Same. Did you ever figure this out?
zdavis0099
Explorer
4 years ago
When playing the sample scenes my avatar moves perfectly but pressing any buttons causes a loading screen to appear and I get this error:

[ovrAvatar2 sampleAvatar] Error initializing OvrPlatform. Falling back to local avatar

UnityEngine.Debug:LogError (object,UnityEngine.Object)
Oculus.Avatar2.OvrAvatarLog:Log (Oculus.Avatar2.OvrAvatarLog/ELogLevel,string,string,UnityEngine.Object) (at Assets/Oculus/Avatar2/Scripts/OvrAvatarLog.cs:101)
Oculus.Avatar2.OvrAvatarLog:LogError (string,string,UnityEngine.Object) (at Assets/Oculus/Avatar2/Scripts/OvrAvatarLog.cs:159)
SampleAvatarEntity/<LoadCdnAvatar>d__21:MoveNext () (at Assets/Oculus/Avatar2/Example/Common/Scripts/SampleAvatarEntity.cs:134)
UnityEngine.SetupCoroutine:InvokeMoveNext (System.Collections.IEnumerator,intptr)
- CyberLizard
  Explorer
  4 years ago
  Hello, Did you ever fix this error: "Error initializing OvrPlatform. Falling back to local avatar"
  I am at the same point.
  
  In Oculus>Platform>Edit Settings
  
  It says "The Unity Editor will use the credentials from the Oculus Application." Does this mean I need the Oculus PC app installed? Also "Use Standalone Platform checkbox is greyed out".
  - mikedurand
    Oculus Staff
    4 years ago
    You do need the Oculus Platform installed on your Windows machine if you are attempting to run any samples that pull a custom avatar from the CDN. But you also need to make sure you have configured your Oculus app to enable Avatars. Please see these docs:
    https://developer.oculus.com/documentation/unity/meta-avatars-app-config/
LucasCL
Explorer
4 years ago
It seems that now we cannot load more than one avatar with the same ID? It used to be possibe not so long ago. This makes networking development more tedious. It would be good if you enable again loading more than one avatar from the same Oculus ID.
Thanks.