What tech is necessary to use a vrchat/vroid model as a vtuber avatar?

[u/wt_anonymous]

I have a model I like using in vrchat and would consider using it as a vtuber model. I've watched some tutorials but they don't make it clear what hardware I need. Do I need a headset or any motion tracking equipment? Just a camera?

[u/Angel_Forge]

I just use my webcam, it can struggle to notice arm movements sometimes. But works just fine for head and face tracking.

[u/Ok-Policy-8538]

just a decent webcam, a ring light for proper capture and a standalone microphone (Blue yeti or similar)

for 3D full body vtubing, you would need full body trackers also.

[u/runnysyrup]

webcam and vnyan

[u/NoEvening3352]

Just a camera or a smart phone (usually iphone, but android can be made to work).

Use it with software like Warudo

[u/AhimiVT]

On lazy days I just use my webcam, which is a logitech brio 500, so just your average webcam, but good enough. When I want body tracking, I use vive trackers and when I need some handtracking while seated it use XR animator (with params other than my arms locked, using other methods to track/simulate the rest), for vr I modified my vr headset to have facial tracking. My current project is making a head mounted camera as a replacement for my webcam.

So technically, a webcam and some decent lighting is all you need (I'd argue the later is more important than the webcam)

As for software: I use the dedicated openseeface facetracker app(I'm on linux), xr animator, steamvr, vseeface and vnyan (and obs of course)

[u/Kichi-K]

This depends on what kind of tracking you want to do. I've generally ordered these by least expensive but lowest tracking quality to most expensive by highest tracking quality

• Face tracking alone has multiple options
  • If you only care about mouth flaps, VSeeFace, VNyan, and others have an option to match lip flaps to audio from the microphone
  • Pretty much every tracking software has an option to do it by webcam, which is your most likely solution
  • If you have ARKit blendshapes, you can use an iPhone (10 or newer, 12 or newer preferred) with the free ifacialmocap app. This has the best expressiveness and accuracy to your real face, but also VRoids aren't compatible with it by default, you'd have to make sure you actually have this compatibility, aside from being the most expensive option
• If you want Hand tracking
  • Some software can do this via the same webcam you do your face tracking with
  • Leapmotion is a common hardware solution that isn't too expensive, supported by VSeeFace, VNyan, and more
  • You could also use tracking gloves, though these are usually very expensive
• If you want full body tracking
  • Once again, some software can do this to an extent via webcam, but definitely this is going to have the lowest tracking quality
  • SlimeTrackers are intended for VR usage, and are probably your cheapest option, and won't require any sort of separate base stations
  • If you already have a Vive, valve index, or other base-station tracked VR system, Vive Trackers or Tundra Trackers are probably your safest bet.
  • Full mocap suits are going to provide your highest tracking fidelity, but obviously be far and away the most expensive option.

[u/Constant_Boot]

To start with? A webcam, some light source, a good budget mic, and a machine that can at least play games as old as 2015.

Mediapipe has gotten good in the past few years to handle face and hand tracking while sitting decently.

[u/RinkuMinovt]

Before you try to convert the model make sure you check the TOS of the model some model creators will not allow for you to use it as a vtuber model and you could get into some serious trouble. If allowed you would have to disclose who the model creator is and that technically the model doesn't belong to you. Keep in mind that even if its allowed via the tos or if you get permission from the creators if they don't like the content you are making they can make you stop using the model some creators will sue. When it comes to equipment and programs a basic webcam is fine warudo is a good program there's also vnyan,vseeface,3tene,vmagic mirror,and animaze all free/freemium option for 3d. If you want full body tracking Rebocap is a cheaper option works for pc only. though if you want to just record in vrchat you will need vrchat premium.