Voice SDK (Feedback/Issues)

Hi !

I've been playing around with the Voice SDK. I'd like to set up some simple words like "Ready" or "Let's go".

I've set up everything on Unity following the tutorial and the build-in words are working fine. So I've created some custom words on Wit.ai and imported them on my project. I've created Utterance like "Ready" and "Let's go" and set them under the same Intent "Start" (I selected the "English" language).

It's seems to work, but partially. Everytime I say "Ready" or "Let's go", I'm getting this :

> start matched, but confidence (0,00) was below threshold (0,60)

If I'm saying something else I don't get this line, so it seems to be detecting something.

The confidence never seems to go beyond 0. Am I missing something ?

Here's my settings for the Intent "Start", created directly from the "Understanding viewer" window

Also, I can confirm that that Wit can properly hear me saying "Ready" or "Let's go" as I'm doing a Debug.log on Transcriptions Events.

Well, as a "quick and dirty" fix I could just use the Transcriptions.Events and do a manual switch case on the results, but I'd like to understand why the proper way is not working.

Thanks !

Voice SDK does not seem to work with Unity 2021.2.2f1. Stack trace below:

Object reference not set to an instance of an object
Request Stack Trace:
at System.Environment.get_StackTrace () [0x00000] in <c183552e59b24622ab6b4273bc2ea328>:0
at Facebook.WitAi.WitRequest.Request () [0x00038] in C:\RalphVR\Easely\Easely\Assets\Oculus\Voice\Lib\Wit.ai\Scripts\Runtime\WitRequest.cs:212
at Facebook.WitAi.Wit.ActivateImmediately (Facebook.WitAi.Configuration.WitRequestOptions requestOptions) [0x000dd] in C:\RalphVR\Easely\Easely\Assets\Oculus\Voice\Lib\Wit.ai\Scripts\Runtime\Wit.cs:374
at Facebook.WitAi.Wit.OnSampleReady (System.Int32 sampleCount, System.Single[] sample, System.Single levelMax) [0x00260] in C:\RalphVR\Easely\Easely\Assets\Oculus\Voice\Lib\Wit.ai\Scripts\Runtime\Wit.cs:225
at Facebook.WitAi.Lib.Mic+<ReadRawAudio>d__55.MoveNext () [0x001cd] in C:\RalphVR\Easely\Easely\Assets\Oculus\Voice\Lib\Wit.ai\Scripts\Runtime\Lib\Mic.cs:301
at UnityEngine.SetupCoroutine.InvokeMoveNext (System.Collections.IEnumerator enumerator, System.IntPtr returnValueAddress) [0x00000] in <809a92a718b54e21a55192c70e75634b>:0
Response Stack Trace:
at Facebook.WitAi.WitRequest.HandleResponse (System.IAsyncResult ar) [0x000cd] in C:\RalphVR\Easely\Easely\Assets\Oculus\Voice\Lib\Wit.ai\Scripts\Runtime\WitRequest.cs:335
UnityEngine.Debug:LogError (object)
Facebook.WitAi.WitRequest:HandleResponse (System.IAsyncResult) (at Assets/Oculus/Voice/Lib/Wit.ai/Scripts/Runtime/WitRequest.cs:363)
System.Threading._ThreadPoolWaitCallback:PerformWaitCallback ()

Same project in 2019 worked fine with voice sdk. Is there a recommended version to use?

EDIT: Rolled back to 2020.3.22f1 and the sdk works. 

Where can I find the documentation or instruction to display and activate the microphone button?

I want to try the Hand pinch click on UI button in this page.

hand pinch 

I'm finding that utterances are parsed in Unity with a trailing full-stop (punctuation). This makes new utterances appear in Wit.ai, even though the exact same text has already been added and trained. Seems redundant. Is there a reason for the punctuation?

Is there a way to activate voice command without click button and the using the Understanding Viewer?

I understand that there is no wake word currently in voice SDK. Is there a workaround for that?

Hi, it seems simple thing but I cannot call method from AppVoiceExperience class to another class. I get an error says

Assets\Apartment_Door\Scripts\DoorController.cs(19,12): error CS0246: The type or namespace name 'AppVoiceExperience' could not be found (are you missing a using directive or an assembly reference?)

-----------------------------------------

private Animation doorAnim;
private BoxCollider doorCollider;
public AppVoiceExperience AppVoiceExperience; //this line is getting the error

if (AppVoiceExperience.Activate() && playerInZone)

What I am trying to do is to call an activate method from the AppVoiceExperience class.

Thank you!

Posting this as feedback, and for comments...

So I found that going through the lengthy process of manual training and relying on the responses from Wit.ai was making things in my app very unpredictable.

For example, asking the user "What's your name?" and wanting to get the reply back as a custom 'name_response' Intent with an Entity ' name_of_person' was impossible without training Wit.ai with a whole lot of first names (which of course is impossible). These single word responses just came back as 'out of scope' until I actually taught the ai that 'John' is a name, 'Jill' is a name, 'Rajesh' is a name, etc. etc.

So I had to cheat and created a wildcard option is WitResponseMatcher.cs:

        private bool IntentMatches(WitResponseNode response)
        {
            var intentNode = response.GetFirstIntent();
            if (string.IsNullOrEmpty(intent))
            {
                return true;
            }

//JDP add '*' wildcard to ignore intent
            if (intent == intentNode["name"].Value || intent == "*")
            {
                var actualConfidence = intentNode["confidence"].AsFloat;
                if (actualConfidence >= confidenceThreshold || intent == "*")
                {
                    return true;
                }

                Debug.Log($"{intent} matched, but confidence ({actualConfidence.ToString("F")}) was below threshold ({confidenceThreshold.ToString("F")})");
            }

            return false;
        }
    }

Then using the path "text" I was able to get back whatever the user says

Seems very hacky! (I especially hate to change SDK scripts...) So fine for a Hackathon, but not sure how else I could have done it?

Thanks yolan   I didn't realise that's what wit/contact was for 🙂
The name thing was more of an example. I think I tried leaving the field blank but it wasn't working. I think because wit.ai would sometimes mistakenly return an erroneous intent name, which then would match and I think make the code fail on the confidenceThreshold. That's why I had to be more explicit. (that's what I meant by "responses from Wit.ai was making things in my app very unpredictable")
I also found the ability to code for essentially any return value (and pick up the text) valuable in that I could do my own wit-like comparisons in Unity - freed from wit.ai doing the choosing for me.
Essentially in that mode I'm just using the VoiceSDK to do speech-to-text

Hi I am a quadriplegic and unable to move my fingers I was wondering when voice control will be available in Australia because when I bought the quest i missed the note about voice control only available in the US.

Is it possible to use a US vpn ? your help would be appreciated