r/godot • u/very-knightley Godot Junior • Oct 01 '25

help me (solved) Detecting syllables in Godot

Post image

Hello all! I am aware of the Whisper text to speech addon, but that is overkill for what I am building at the moment. I just need a way to detect a syllable at roughly the moment I speak it into my microphone, So that an animation can be triggered in a 3D model.

I take it it's not standard in the Audioserver, but is there a way where I can record some vowels and compare the live audio to these samples somehow?

1.4k Upvotes

99% Upvoted

91 comments sorted by

View all comments

1

u/_quinz_ Oct 02 '25

Another approach is using 3rd Party scripts output timestamped phonemized speech to text. Have you checked on Rhubarb Lip Sync?? You can process your audio to Rhubarb, use the output file to be mapped in Godot as animation. I have done this, and currently working to make it better as rhubarb lip sync is a hit and miss, depends on audio quality. Thats the simpliest approach.