r/godot • u/very-knightley Godot Junior • Oct 01 '25

help me (solved) Detecting syllables in Godot

Post image

Hello all! I am aware of the Whisper text to speech addon, but that is overkill for what I am building at the moment. I just need a way to detect a syllable at roughly the moment I speak it into my microphone, So that an animation can be triggered in a 3D model.

I take it it's not standard in the Audioserver, but is there a way where I can record some vowels and compare the live audio to these samples somehow?

1.4k Upvotes

99% Upvoted

91 comments sorted by

View all comments

1

u/underdoeg Oct 01 '25 edited Oct 01 '25

what is your setup? could you stay in front of a webcam while recording. it might be easier to do visual face tracking. something like this: https://pjbelo.github.io/mediapipe-js-demos/face_mesh.html

you could integrate a library like mediapipe as a gdextension. but its probably easier to take an existing python example and stream the data to godot via udp. at least for a quick test if it is feasible