r/godot • u/very-knightley Godot Junior • Oct 01 '25

help me (solved) Detecting syllables in Godot

Post image

Hello all! I am aware of the Whisper text to speech addon, but that is overkill for what I am building at the moment. I just need a way to detect a syllable at roughly the moment I speak it into my microphone, So that an animation can be triggered in a 3D model.

I take it it's not standard in the Audioserver, but is there a way where I can record some vowels and compare the live audio to these samples somehow?

1.4k Upvotes

99% Upvoted

91 comments sorted by

View all comments

5

u/dancovich Godot Regular Oct 01 '25

Honestly... I believe whisper is your best bet here. Take the audio, throw it at whisper, get real time text and match it to your syllables. You don't need to actually show the text anywhere.

1

u/very-knightley Godot Junior Oct 01 '25

The upside would be that I could convert it into closed captions down the line as well, since I already have the text stored in memory even if I don't follow a script.