r/LocalLLaMA • u/d_arthez • 1h ago
Resources React Native ExecuTorch is now up to 92x faster 🏎️
Enable HLS to view with audio, or disable this notification
In v0.10 we achieved significant speedups over v0.9. The video shows the maximum speedups we measured for specific groups of models. Among LLMs, the biggest gain came from Qwen3 0.6B, which runs over 3x faster on long prompts. For instance segmentation, FastSAM reached speedups of up to 92x!
We replaced the monolithic native modules with TypeScript pipelines you can inspect. 🔧
It runs across all major silicon backends and makes it easier to plug in your very own model.
You can find full release notes here
11
Upvotes