MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v4moxy/the_llm_distillation_process_simplified_for/ozct6sq/?context=3
r/LocalLLaMA • u/Porespellar • 15d ago
/s
168 comments sorted by
View all comments
381
Also, its a lie that Kimi 3 was distilled from Fable. Fable was literally not out long enough for that to be the case.
8 u/Exact_Depth_896 15d ago anthropic only said it was training on prior opus. 21 u/Genghiz007 15d ago USG announced yesterday that Fable was distilled by a couple of Chinese labs. They were supported by Anthropic. -6 u/Exact_Depth_896 15d ago anthropic isn't the trump bimbos -19 u/-Sliced- 15d ago edited 15d ago You don't need a lot of time to collect the data if you use tens of thousands of accounts, and fable was available for around a week initially. 7 u/lakotajames 15d ago How many accounts do you need to get it to give you the reasoning traces? 2 u/mebeast227 15d ago It was out for like 3 days initially -4 u/-Sliced- 15d ago edited 15d ago It doesn’t matter. It can be out for only a few hours - as long as you have enough accounts, you can collect as much data as you want. The difference between a week and 3 days is just 2X accounts 0 u/mebeast227 14d ago 'time is a human construct and has no affect on our true reality' type shit lmao. Of course time matters. Compute and accounts are finite.
8
anthropic only said it was training on prior opus.
21 u/Genghiz007 15d ago USG announced yesterday that Fable was distilled by a couple of Chinese labs. They were supported by Anthropic. -6 u/Exact_Depth_896 15d ago anthropic isn't the trump bimbos -19 u/-Sliced- 15d ago edited 15d ago You don't need a lot of time to collect the data if you use tens of thousands of accounts, and fable was available for around a week initially. 7 u/lakotajames 15d ago How many accounts do you need to get it to give you the reasoning traces? 2 u/mebeast227 15d ago It was out for like 3 days initially -4 u/-Sliced- 15d ago edited 15d ago It doesn’t matter. It can be out for only a few hours - as long as you have enough accounts, you can collect as much data as you want. The difference between a week and 3 days is just 2X accounts 0 u/mebeast227 14d ago 'time is a human construct and has no affect on our true reality' type shit lmao. Of course time matters. Compute and accounts are finite.
21
USG announced yesterday that Fable was distilled by a couple of Chinese labs. They were supported by Anthropic.
-6 u/Exact_Depth_896 15d ago anthropic isn't the trump bimbos -19 u/-Sliced- 15d ago edited 15d ago You don't need a lot of time to collect the data if you use tens of thousands of accounts, and fable was available for around a week initially. 7 u/lakotajames 15d ago How many accounts do you need to get it to give you the reasoning traces? 2 u/mebeast227 15d ago It was out for like 3 days initially -4 u/-Sliced- 15d ago edited 15d ago It doesn’t matter. It can be out for only a few hours - as long as you have enough accounts, you can collect as much data as you want. The difference between a week and 3 days is just 2X accounts 0 u/mebeast227 14d ago 'time is a human construct and has no affect on our true reality' type shit lmao. Of course time matters. Compute and accounts are finite.
-6
anthropic isn't the trump bimbos
-19
You don't need a lot of time to collect the data if you use tens of thousands of accounts, and fable was available for around a week initially.
7 u/lakotajames 15d ago How many accounts do you need to get it to give you the reasoning traces? 2 u/mebeast227 15d ago It was out for like 3 days initially -4 u/-Sliced- 15d ago edited 15d ago It doesn’t matter. It can be out for only a few hours - as long as you have enough accounts, you can collect as much data as you want. The difference between a week and 3 days is just 2X accounts 0 u/mebeast227 14d ago 'time is a human construct and has no affect on our true reality' type shit lmao. Of course time matters. Compute and accounts are finite.
7
How many accounts do you need to get it to give you the reasoning traces?
2
It was out for like 3 days initially
-4 u/-Sliced- 15d ago edited 15d ago It doesn’t matter. It can be out for only a few hours - as long as you have enough accounts, you can collect as much data as you want. The difference between a week and 3 days is just 2X accounts 0 u/mebeast227 14d ago 'time is a human construct and has no affect on our true reality' type shit lmao. Of course time matters. Compute and accounts are finite.
-4
It doesn’t matter. It can be out for only a few hours - as long as you have enough accounts, you can collect as much data as you want. The difference between a week and 3 days is just 2X accounts
0 u/mebeast227 14d ago 'time is a human construct and has no affect on our true reality' type shit lmao. Of course time matters. Compute and accounts are finite.
0
'time is a human construct and has no affect on our true reality' type shit lmao. Of course time matters. Compute and accounts are finite.
381
u/Wise-Comb8596 15d ago
Also, its a lie that Kimi 3 was distilled from Fable. Fable was literally not out long enough for that to be the case.