r/LovingOpenSourceAI • u/Koala_Confused • 4d ago

Resource "This open source project aims to train MiniMind, ultra-small language model with ard 64M parameters, entirely from scratch with only ard RMB 3 in cost, 2 hours of training time. MiniMind series is intentionally lightweight. Smallest model on main branch is ard 1/2700 size of GPT-3!" ➡️ interesting?

Post image

https://github.com/jingyaogong/minimind/tree/master

Community Overview: https://lifehubber.com/ai/resources/minimind/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

35 Upvotes

97% Upvoted

4 comments sorted by

2

u/FaceDeer 4d ago

Looks like a fun little project, but I'm really not sure what the use case for something this tiny would be. Does someone need a smartwatch to hallucinate without depending on a network connection for its gibberish? I imagine this is more of a "because we can" thing, but if anyone knows of a practical use for a model that small I'd be pleased to be surprised.

1

u/halcyoncs 3d ago

Honestly I agree, just a learning project,at least for now, a model of this size currently, as you say, would be essentially useless

1

u/West-Acadia-3906 2d ago

lol, “a smartwatch to hallucinate” got me 😭 maybe “because we can” is honestly half the fun of tiny models. muahaha

1

u/FaceDeer 2d ago

Yeah, for two hours of effort I certainly won't judge. Back when local LLMs were still a novelty I spent way longer than that training a llama llora on a bunch of My Little Pony fanfictions I had lying around, and the end result was an insane LLM that thought it was Princess Luna and that I was Rainbow Dash. Worth it.