Random Words Detected by Azure Speech Recognizer in Silence

Abdul Subhan 5 Reputation points
2024-06-24T07:44:54.3933333+00:00

Hello Azure Support Team,

I am currently using the Azure Speech Service to recognize speech inputs in my application. The setup of my speech recognizer is as follows:

export const createSpeechRecognizer = () => {
  const speechRecognitionConfig = SpeechSDK.SpeechConfig.fromSubscription(avatarAppConfig.cogSvcSubKey, avatarAppConfig.cogSvcRegion);
  speechRecognitionConfig.setProperty(SpeechSDK.PropertyId.SpeechServiceConnection_LanguageIdMode, "Continuous");

  const autoDetectSourceLanguageConfig = SpeechSDK.AutoDetectSourceLanguageConfig.fromLanguages(avatarAppConfig.sttLocales.split(','));
  const recognizer = SpeechSDK.SpeechRecognizer.FromConfig(speechRecognitionConfig, autoDetectSourceLanguageConfig, SpeechSDK.AudioConfig.fromDefaultMicrophoneInput());

  return recognizer;
}

speechRecognizer.recognized = async (s, e) => {
        if (e.result.reason === SpeechSDK.ResultReason.RecognizedSpeech) {
          const userQuery = e.result.text.trim();
          if (userQuery) {
            console.log("User query in mic:", userQuery);
              handleUserQuery(userQuery);
          }
        }
      };

While using this setup, I am experiencing an issue where the speech recognizer sometimes detects random words as input even when there is complete silence. Some examples of the random words detected include "Play", "BJP", etc.

This behavior is unexpected and impacts the functionality of my application. Could you please assist me in resolving this issue? Any guidance or suggestions on how to mitigate this problem would be greatly appreciated.

Thank you for your support.

Best regards,
Abdul Subhan
abdul@inextlabs.com

Azure AI Bot Service
Azure AI Bot Service
An Azure service that provides an integrated environment for bot development.
776 questions
Azure AI Speech
Azure AI Speech
An Azure service that integrates speech processing into apps and services.
1,506 questions
Azure Startups
Azure Startups
Azure: A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.Startups: Companies that are in their initial stages of business and typically developing a business model and seeking financing.
236 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. dupammi 7,955 Reputation points Microsoft Vendor
    2024-06-24T12:40:13.2833333+00:00

    Hi @Abdul Subhan

    Thank you for reaching out to the Microsoft Q&A forum.

    I understand that you are experiencing an issue where the speech recognizer sometimes detects random words as input even when there is complete silence. This issue could be caused by the microphone sensitivity being too high, causing the recognizer to pick up background noise and interpret it as speech.

    To mitigate this problem, you can try adjusting the microphone sensitivity to a lower value. You can also try using noise suppression techniques to improve the speech recognizer's performance in noisy environments. However, please note that the Azure Speech SDK does not provide an option for noise cancellation as it uses the audio from the selected source (file or microphone) as is and passes it to the service.

    A workaround could be to use an external microphone instead of the device microphone which can pick up other sounds or use the speech devices SDK which is actually a hardware device with the speech devices SDK and has the capability of noise suppression and echo cancellation.

    If you have already tried adjusting the settings and using noise suppression, and the issue still persists, you can try some of the other solutions mentioned in the Azure documentation on how to mitigate or resolve echo issues.

    I hope this information helps.

    0 comments