SpeechSynthesizer sometimes plays speech depending on SpeechSynthesisOutputFormat

One More Henry 20

In a C# WPF application, I call this function to convert text to speech:

SpeechSynthesisResult speechSynthesisResult = await speechSynthesizer.SpeakSsmlAsync(strSsml);

The audio data is returned ok. BUT the function also sometimes plays the speech as well through my sound device, depending on which output format is selected.

Raw24Khz16BitMonoPcm <- Automatically plays the speech audio.

Audio24Khz160KBitRateMonoMp3 <- Does not play the speech audio.

I need the automatic speech out to stop, but I also need the audio data in WAV file format.

My configuration looks like this:

`SpeechConfig speechConfig = SpeechConfig.FromSubscription(SubscriptionKey, SubscriptionRegion);`

speechConfig.OutputFormat = OutputFormat.Detailed;

speechConfig.SetSpeechSynthesisOutputFormat(Raw24Khz16BitMonoPcm);

speechConfig.SpeechSynthesisVoiceName = "en-GB-LibbyNeural";

speechConfig.SetProperty(PropertyId.Speech_LogFilename, "[FILE ON MY HARD DISK]");

Thanks for reading.

VasaviLankipalle-MSFT 15,836 Reputation points

2024-07-04T04:45:34.8633333+00:00
Hello @One More Henry, Thanks for using Microsoft Q&A Platform.

You can refer to the list of audio formats that are available to retrieve the audio in wav format.

As please note that,

Raw formats like Raw24Khz16BitMonoPcm don't include audio headers. Use raw formats only in one of these situations:

You know that your downstream implementation can decode a raw bitstream.

You plan to manually build headers based on factors like bit depth, sample rate, and number of channels.
One More Henry 20 Reputation points

2024-07-04T08:41:08.3966667+00:00

Hello Vasavi, the problem is that my call to SpeakSsmlAsync using the audio format Raw24Khz16BitMonoPcm plays the speech. I can hear it coming out of my speakers, and the call to the function does not finish until the speech has finished being played. What I want is for the call to SpeakSsmlAsync to return immediatly without playing the speech out loud, but returning the audio data, like it does using the Audio24Khz160KBitRateMonoMp3 format.

How do generate the PCM speech audio data silently?

Share via

SpeechSynthesizer sometimes plays speech depending on SpeechSynthesisOutputFormat