Entitlement Check completes, but VRC Validator & submitted builds fail

I've built our game for Rift, and I have code to check if the user is entitled to the app. When I play a build locally, I can see that the check passes, which I assume means the player is entitled to run the game.

However, when I run the VRC validator, or submit the app through the Oculus dashboard, I'm told we're failing the entitlement check.

The code is as follows:

IEnumerator DoOculusSetup() {
    #if OCULUS
    try {
        Core.AsyncInitialize("XXXXXXXXXXXX");
        Entitlements.IsUserEntitledToApplication().OnComplete(CallbackOculusGetEntitlement);

    } catch(UnityException e) {
        Debug.LogError("Oculus platform failed to initialize due to exception:");
        Debug.LogException(e);

        // Immediately quit the application.
        UnityEngine.Application.Quit();
    }
    #endif

    yield break;
}


void CallbackOculusGetEntitlement(Message msg) {
    if (msg.IsError) {
        Debug.LogError("[Oculus] You are NOT entitled to use this app.");
        UnityEngine.Application.Quit();
    } else {
        Debug.Log("[Oculus] You are entitled to use this app.");
    }
    return;
}

Running the game locally, I do see the "You are entitled to use this app" message in the log, which I understood to mean the entitlement check is successful. Not sure why it's still being flagged as a VRC error.