Handling connection errors in Speech SDK

Jasmin Hadzajlic 0

Hi, we are using Speech SDK (version 1.35.0, C++) for "speech to text". We use SpeechRecognizer->StartKeywordRecognitionAsync. While running the application, we lose connection sometimes and sometimes internet connection is okay, but we get error response from server. Through Canceled event we get connection errors, sometimes ConnectionFailure (5), sometimes ServiceTimeout (6). How should we recover from these to have initial state again (StartKeywordRecognitionAsync running)? When we get Canceled event, sometimes it recovers automatically, sometimes doesn't. We tried to StopKeywordRecognitionAsync and start it again and that works, but sometimes we get weird results. We also tried to use Connection class manually, but that also didn't help. What is the best way of tracking state of connection to server and the best way of recovering from lost connection, server timeout, etc?

Thanks in advance.

romungi-MSFT 43,656 Microsoft Employee

@Jasmin Hadzajlic i could not find any guidance in this case from the official documentation but as per the keyword sample for C++ from SDK repo, I think you are already following the recommendation to call the StartKeywordRecognitionAsync() in case of timeout or connection error or no keyword recognized. See this sample from SDK repo.

    if (useKeyword)
    {
        // Creates an instance of a keyword recognition model.
        auto keywordModel = KeywordRecognitionModel::FromFile(GetKeywordModelFileName());
        // Starts the following routine:
        // 1. Listen for a keyword in input audio. There is no timeout.
        //    Speech that does not start with the keyword is ignored.
        // 2. If the keyword is spotted, start normal speech recognition.
        // 3. After a recognition result (that always includes at least
        //    the keyword), go back to step 1.
        // Steps 1-3 repeat until StopKeywordRecognitionAsync() is called.
        recognizer->StartKeywordRecognitionAsync(keywordModel).get();
        cout << "Say something starting with \"" << GetKeywordPhrase() << "\" (press Enter to stop)...\n";
        cin.get();
        // Stops recognition.
        recognizer->StopKeywordRecognitionAsync().get();
    }

Share via

Handling connection errors in Speech SDK