Azure Kinect DK Microphone Data

Keenan Fitzharris 21 Reputation points
2020-07-13T15:47:01.3+00:00

Hello my name is Keenan. I am currently working on a university research project which utilizes the Azure Kinect DK sensor for autonomous robot motion.

I plan to use the microphone array (7 mics) found in the sensor for motion planning (beamforming techniques). These algorithms require that I have access the raw microphone data. In other words I need the decibel/frequency received by each microphone in real time. The Kinect Viewer application is able to visualize this data very easily as shown below.

12014-kinect-viewer.jpg

Is there a way to access this microphone data? Currently all resources I have found use the microphones for speech purposes. Either speech recognition or translation -- but this is not needed for my project. I just need the data from each microphone.

Currently I have used the code from:

https://github.com/microsoft/Azure-Kinect-Sensor-SDK/tree/develop/tools/k4aviewer

To access the sensors. Is there an easy implementation to also receive the microphone data?

Any help would be appreciated.

Thanks,

Keenan

Azure Kinect DK
Azure Kinect DK
A Microsoft developer kit and peripheral device with advanced artificial intelligence sensors for sophisticated computer vision and speech models.
292 questions
Accepted answer
  1. AshokPeddakotla-MSFT 32,946 Reputation points
    2020-07-15T05:01:15.697+00:00

    @Keenan Fitzharris I have checked with the Azure Kinect team on this question and below is the response.

    There is no sample outside of the k4aviewer tool that uses audio for applications other than speech.
    The k4aviewer is open sourced (as part of Sensor SDK). We suggest you use that as sample code.

    I hope this response helps you, please confirm!

    0 comments

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.