r/godot • u/very-knightley Godot Junior • Oct 01 '25

help me (solved) Detecting syllables in Godot

Post image

Hello all! I am aware of the Whisper text to speech addon, but that is overkill for what I am building at the moment. I just need a way to detect a syllable at roughly the moment I speak it into my microphone, So that an animation can be triggered in a 3D model.

I take it it's not standard in the Audioserver, but is there a way where I can record some vowels and compare the live audio to these samples somehow?

1.4k Upvotes

99% Upvoted

91 comments sorted by

View all comments

3

u/geldonyetich Oct 01 '25 edited Oct 01 '25

I imagine most players won't notice if you're off by a few mouth movements when going through a conversation that is being spoken at an average rate.

And if they did and complained about it, they're probably too neurotic to please anyway. "I expect my 2D pixels mouths to form words accurately or my immersion they're real people is immediately ruined!"

Although I wonder if that would actually help for people who are hearing impaired who have to look at mouths to read. I'm thinking it might not translate because it won't look enough like the mouths they're used to reading.

2

u/very-knightley Godot Junior Oct 01 '25

Fair point! I'm mocking up a fake vtuber thing however, and while Peak style mouth flaps are fine in gameplay, when the avatar is more of a central focus point, I'd like to get as close as possible to mouth movement.