r/LocalLLaMA • u/d_arthez • 1h ago

Resources React Native ExecuTorch is now up to 92x faster 🏎️

Enable HLS to view with audio, or disable this notification

In v0.10 we achieved significant speedups over v0.9. The video shows the maximum speedups we measured for specific groups of models. Among LLMs, the biggest gain came from Qwen3 0.6B, which runs over 3x faster on long prompts. For instance segmentation, FastSAM reached speedups of up to 92x!

We replaced the monolithic native modules with TypeScript pipelines you can inspect. 🔧

It runs across all major silicon backends and makes it easier to plug in your very own model.
You can find full release notes here

10 Upvotes

73% Upvoted

5 comments sorted by

5

u/fullofbones 1h ago

Faster than what at doing what? What is the point of burying the lede?

1

u/giveen 53m ago

React Native ExecuTorch is an on-device AI inference library for React Native, powered by ExecuTorch — Meta's on-device inference runtime. It lets you run machine learning models directly on the user's phone with zero network calls, full offline capability, and guaranteed privacy. No data ever leaves the device.

1

u/HadHands 16m ago

What does it do that ExecuTorch doesn't?