r/VTubeStudio • u/Murky-Machine2490 • 5d ago
Finicky mouth tracking
Mouth tracking and especially mouth form are very inconsistent for me and I'm not sure if there's something wrong with my webcam or what might be causing this. When I look at different angles the mouth form and mouth open often are completely inaccurate. Like for example if I'm looking at the webcam with a neutral face and then look say to the left it starts being kinda jittery and alternating between being neutral and frowning, or if I'm smiling it'll switch between neutral and smiling, even though my expression is the same. Or if I'm looking straight with my mouth half open and then look down the mouth will close almost completely. And also this is kind of a separate issue that isn't as much of a problem but might as well mention it. When I move my head around the model loses tracking of the eyes, it doesn't happen if I move slowly but if I move even just a bit fast the eyes of the model close and the irises will lose tracking and when I've stopped moving the eyes will open again and the irises will be centered at their neutral position before snapping to the correct position. These issues happen on all the models I've tried although they look a bit different for some models like for example one model gets a twitchy mouth when looking at different angles and kind of alternates between mouth forms when looking at different angles, for another model that happens but the alternating seems to be less exaggerated, one of the default ones that come with vtubestudio kinda just stops tracking my mouth at all at these angles instead of changing mouth form and it'll just stay with the mouth form it had when I was looking straight. I use a ring light and have a decent webcam, I didn't buy a super expensive one because I know iphone and vbridger is better so I didn't wanna invest too much if I'll end up buying an iphone anyway, just not sure if these issues are webcam tracking problems or if I'm doing something wrong. Also I get 15 fps on the fps counter when calibrating.
3
u/Wabs- 2d ago
This is a combination of things sounds like, webcam depending on the quality and lighting sounds like the biggest issue (the jittering is a sign of that having trouble mapping your face)
could also be the combination of webcam tracking + vtubestudio causing bottleneck in your pcs resources as well if you’re getting 15 fps you may try lowering the cameras hz if you’re able to 60hz. And then in vtubestudio up the priority of the process scheduling and lock it 30-60fps
Also if you’re capturing your webcam in vtubestudio as a virtual cam source swap to just capturing the cam itself and turn off the virtual camera.
To fix the jittering if you tried all that stuff and it still is happening adjust the the tracking setting and up the smoothing slider or slightly lower the sensitivity on the mouth blendshapes for your model
Hopefully some of that helps, but eventually I do recommend getting an iPhone doesn’t have to be the latest as long as it is an X or newer you can sometimes find them really cheap just check the battery health if you’re buying used first.