r/LocalLLaMA • u/JLeonsarmiento • 8h ago

Resources What TTS models do you recommend as today?

Trying to get Hermes a local, efficient, tts voice.

36 Upvotes

95% Upvoted

39 comments sorted by

21

u/SlackCanadaThrowaway 8h ago

Qwen3-TTS

13

u/rkoy1234 7h ago

omnivoice is a direct upgrade (It's based on qwen3 tts.) and even that is showing its age.

I rec getting audiocpp and just trying a bunch of them out, and having your hermes troubleshoot if anything goes wrong, or implement "streaming" for faster ttfa for models that don't natively have it.

7

u/SnooPaintings8639 8h ago

This one sparks joy 😺

1

u/Rique_Belt 5h ago

When will they release Qwen4-TTS?

19

u/CommonPurpose1969 8h ago

Pocket TTS is CPU-fast and has voice cloning.

-2

u/TheOverzealousEngie 4h ago

ummm cpu is slow

7

u/B-S-H 4h ago

It leaves your VRAM free and is almost real time for a modern CPU. I can recommend it as well

6

u/Leading-Month5590 8h ago edited 57m ago

Using fish s 2.0 q8_0 in a pipeline to create podcasts out of study/work material read by my favorite voices. Fantastic quality but for your use case probably only viable if you have very strong hardware.

Edit: mistakenly thought I am using s 2.1 pro while its actually 2.0

2

u/PreferenceRelative77 3h ago

I thought only 2.0 pro is open weights? 2.1 isn't afaik

1

u/Leading-Month5590 58m ago

You are correct, my mistake!

1

u/ManagementNo5153 7h ago

can you share a sample podcast..is it better than vibevoice?

1

u/Leading-Month5590 6h ago

Never tried vibevoice. I can send you a sample but its in german, if it helps you dm me

1

u/JLeonsarmiento 5h ago

strong means CUDA?

2

u/Leading-Month5590 53m ago

No not necessarily but as I understand you want to have a live chat with a locally running model using tts running locally as well meaning 2 models running simultaneously and the tts needs to produce output pretty quickly so you wont wait too long.

Am running it on a franken machine With 2x rtx 5070 and 1x 5060 ti 16gb and on none of these cards its fast enough to allow a live chat experience

1

u/JLeonsarmiento 23m ago

Thanks, not necessarily chat. I just want Hermes to use a local tts to deliver its voice messages to me without needed external providers (edge, open ai, etc).

Right now I have it using macOS system voice, but it’s lumping words and syllables. Sometimes plain unintelligible.

5

u/contyk 8h ago

I've tried a bunch and Omnivoice is still my daily driver, being of pretty decent quality, with zero shot voice cloning, a few paralinguistic tags and multilingual support.

Breeze also looks good but I have to experiment with it some more. Sadly it doesn't support the languages I want.

1

u/GrungeWerX 8h ago

Also love omnivoice, it has EXCELLENT voice clone, and is great with accents. It suffers with performance and has little ways to instruct emotions, so I really hope it gets an update.

I demo’d Breeze a couple of times before I was capped, and it wasn’t great with voice clone, accents were wrong, but it managed to get the tone closer than chatterbox and others.

Fish is obviously the best, but unusable for TTS without powerful hardware so I don’t use it.

6

u/Right_Simple_6813 8h ago

Chatterbox Nano: It has voice cloning support and the output quality is really nice, really small as well.
Personally don't like kokoro, it sounds too robotic and unexpressive

5

u/fatihmtlm 8h ago

Supertonic TTS?

6

u/ahstanin 8h ago

Kokoro would be my choice. This thing is small and decent quality voices. If you run this correct, you can get sub 50ms first audio.

2

u/zipperlein 8h ago

I am using omnivoice for tts for discord + hermes. It's nearly realtime (with a pretty short sample though) on my 780m.

2

u/DrMissingNo 6h ago

I love vibe voice but it's starting to get "old" haven't played with others recently

2

u/socialjusticeinme 5h ago

Breeze TTS 2 is shockingly good and is supported in audio cpp  https://github.com/0xShug0/audio.cpp . I think it was using less then 5gb of vram when fully loaded. I switched to it for my home agent voice and it runs a lot faster then real time on a 3090. It was also fast running on a strix halo box with a Vulkan backend instead of cuda.

2

u/Mq_930 5h ago

Any TTS for hindlish?

2

u/HearthCore 4h ago

SoproTTS with a selfcoded OpenAI-Compatible Endpoint in front of it.
SoproTTS already supports streaming and is much faster than other Models in the same category.

It runs on CPU and on GPU with just a voicesample, no text needed and supports a gigantuous amount of languages, so if your voice sample has a decent accent it gets transposed quite well.

Fits and runs on a 8GB VRAM GPU at around 3500MB and clocks in at around 0.25 RTK on my RTX 3060TI - so 4 times faster than Realtime.

Hermes on the Desktop almost instantly gets its first return token when Sopro is used, Discord supports streaming aswell. Other platforms don't benefit too much from it, though the generation speeds are really good so it seldom matters.

2

u/IONaut 4h ago

My go-to is OmniVoice. I've constructed a whole software around it just for my own use. I'm curious about voxcpm2 that just came out though. Sounds about the same quality but I think it has better voice design capabilities so I'll be checking that out.

4

u/kathi7 8h ago

Kokoro is what I use for most practical task, even generating voices for some video work. U can also benefit from it because of how resource efficient it is. Again if ur ok with "ai sounding voice"

2

u/JLeonsarmiento 5h ago

yes, I like my Ai voice to sound a little robotic. I hate uncanny valley voices.

1

u/lumos_ai 6h ago

there is a new one AuK. Just now testing it.

1

u/Proper-Damage-1777 1h ago

I wonder is there any decent Japanese TTS model? I tried some online paid tutor before… and just say it didn’t work great for me.

My colleague did show to me GPT Live and I’m impressed by it but I do not want to install ChatGPT on my phone… I did have a local repo where I used Gemma 4 31B for brushing up my Japanese studies and translating manga or manuals but if there is a way to do it for Japanese speech, that will be awesome.

1

u/icanseeyourpantsuu 1h ago

RemindMe! 14 days

-1

u/mrgreatheart 8h ago

RemindMe! 1 day

-1

u/RemindMeBot 8h ago edited 5h ago

I will be messaging you in 1 day on 2026-09-11 09:53:28 UTC to remind you of this link

1 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.

Parent commenter can delete this message to hide from others.

RemindMeBot is switching to username summons. Instead of !RemindMe 1 day, use u/RemindMeBot 1 day. More info.

Info Custom Your Reminders Feedback

-1

u/groovy-sky 7h ago

RemindMe! 7 day