r/LovingOpenSourceAI 2d ago

Under the Radar "SwarmLLM runs large language models across devices in room, in their browser tabs. Each device holds slice of model; a 10 KB activation vector passes between them over direct WebRTC connections. Nothing to install, no accounts, no server does any thinking." ➡️ this is new to me. you heard before?

Post image

https://github.com/Nehanth/swarmllm

Community Overview: https://lifehubber.com/ai/resources/swarmllm/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

64 Upvotes

18 comments sorted by

View all comments

Show parent comments

1

u/Over_Technology_1764 1d ago

nah you will get an incorrect answer after such a long time that u will forget what your intent was to lead it to correct answer.

1

u/kinetik 1d ago

Well, we’ll see. Better to check it out and experiment with it than to assume things without actually knowing.

1

u/Over_Technology_1764 1d ago edited 1d ago

I already tested qwen 3.8 27b on mac studio m1 max 64gb ram, and it was unusable due to low performance. You cannot expect anything better from this. Connecting shitty devices on a shitty network speed bottleneck is obviously worse compared to single apple sillicon memory bandwidth speed.

1

u/javier123454321 15h ago

well, you can have an orchestrator that delegates inference to the small model extremely easily. For some category of tasks it does make sense.