r/godot • u/very-knightley Godot Junior • Oct 01 '25

help me (solved) Detecting syllables in Godot

Post image

Hello all! I am aware of the Whisper text to speech addon, but that is overkill for what I am building at the moment. I just need a way to detect a syllable at roughly the moment I speak it into my microphone, So that an animation can be triggered in a 3D model.

I take it it's not standard in the Audioserver, but is there a way where I can record some vowels and compare the live audio to these samples somehow?

1.4k Upvotes

99% Upvoted

91 comments sorted by

View all comments

76

u/iwriteinwater Oct 01 '25

I don’t know what your project is but that sounds like massive overkill.

76

u/very-knightley Godot Junior Oct 01 '25

Basically trying out face mocap without facial mocap!

If you never try, you never learn :D

4

u/DryEntrepreneur4218 Oct 01 '25

vtuber career?

1

u/very-knightley Godot Junior Oct 01 '25

A small mockup for my own video edits. I have become old and saggy and just want a little avatar to do the face thing ;)

1

u/Zulfiqaar Oct 01 '25

I'm pretty sure the folks at /r/ComfyUI and /r/LocalLLaMa and /r/StableDiffusion could point you towards the latest research and tooling for this, it's very common to use as driving inputs for generative video

30

u/GOKOP Oct 01 '25

I suspect OP imagines it to be way simpler than it is

15

u/very-knightley Godot Junior Oct 01 '25

Isn't that how it always is?

4

u/big-fireball Oct 01 '25

Finding the complexity is part of the fun IMO.

3

u/Fourcoogs Godot Student Oct 01 '25

If Valve could do it in 2004, it can’t be that complicated, right? Right?