Is there any kinect version that helps in speech therapy?

Layla Obeid 6 Reputation points
2020-11-23T09:06:57.867+00:00

Hi,
I am an educator/researcher who is working on a project or a thesis for my degree.
I am thinking of using Kinect to recognize the lips/ mouth movements to train speech delay kids. My idea is to show students audio-visual 3d mouth, tongue, and throat movements on the Kinect to train them to speak a letter or word by interacting with the camera and evaluating their sounds and movements by the Kinect. At the same time, the Kinect camera will configure if the student's sound and mouth movement are correct.

I am perplexed about which tag I should use for my question to be best answered.

I really appreciated it if there are studies or experiments on this issue to let me know.

Regards

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,852 questions
Azure Kinect DK
Azure Kinect DK
A Microsoft developer kit and peripheral device with advanced artificial intelligence sensors for sophisticated computer vision and speech models.
292 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Ramr-msft 17,736 Reputation points
    2020-11-24T14:29:09.493+00:00

    @Layla Obeid Thanks, Please have a look at https://video2.skills-academy.com/en-us/azure/cognitive-services/speech-service/how-to-select-audio-input-devices for more info on selecting audio devices.
    We also have a Robot Operating System(ROS) package for the Azure Kinect. The Kinect camera is a widely adopted sensor in the field of robotics.
    https://github.com/microsoft/azure_kinect_ros_driver

    Also Have a look at https://github.com/microsoft/Azure-Kinect-Samples

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.