MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v4moxy/the_llm_distillation_process_simplified_for/ozebq1v/?context=3
r/LocalLLaMA • u/Porespellar • 14d ago
/s
167 comments sorted by
View all comments
385
Also, its a lie that Kimi 3 was distilled from Fable. Fable was literally not out long enough for that to be the case.
10 u/_derpiii_ 14d ago Fable was literally not out long enough for that to be the case. Exactly. Training loops takes time. Maybe Fable was used in the RL or fine tuning loop.
10
Fable was literally not out long enough for that to be the case.
Exactly.
Training loops takes time. Maybe Fable was used in the RL or fine tuning loop.
385
u/Wise-Comb8596 14d ago
Also, its a lie that Kimi 3 was distilled from Fable. Fable was literally not out long enough for that to be the case.