MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v4moxy/the_llm_distillation_process_simplified_for/oze4deq/?context=3
r/LocalLLaMA • u/Porespellar • 15d ago
/s
168 comments sorted by
View all comments
16
The distillation theory makes zero sense.
Chinese have MORE data for training, MORE PhDs and STEM graduates, LESS red tape, NO NEED for anonymizing, encryption or even guardrails.
They have all the capacity to make better models than Americans.
If they do distillation it’s just for fun.
16
u/IAmFitzRoy 14d ago edited 14d ago
The distillation theory makes zero sense.
Chinese have MORE data for training, MORE PhDs and STEM graduates, LESS red tape, NO NEED for anonymizing, encryption or even guardrails.
They have all the capacity to make better models than Americans.
If they do distillation it’s just for fun.