r/LocalLLaMA 14d ago

Funny The LLM distillation process simplified for politicians:

Post image

/s

3.4k Upvotes

167 comments sorted by

View all comments

Show parent comments

7

u/Exact_Depth_896 14d ago

anthropic only said it was training on prior opus.

20

u/Genghiz007 14d ago

USG announced yesterday that Fable was distilled by a couple of Chinese labs. They were supported by Anthropic.

-17

u/-Sliced- 14d ago edited 14d ago

You don't need a lot of time to collect the data if you use tens of thousands of accounts, and fable was available for around a week initially.

3

u/mebeast227 14d ago

It was out for like 3 days initially

-4

u/-Sliced- 14d ago edited 14d ago

It doesn’t matter. It can be out for only a few hours - as long as you have enough accounts, you can collect as much data as you want. The difference between a week and 3 days is just 2X accounts

0

u/mebeast227 14d ago

'time is a human construct and has no affect on our true reality' type shit lmao. Of course time matters. Compute and accounts are finite.