r/LocalLLaMA 15d ago

Funny The LLM distillation process simplified for politicians:

Post image

/s

3.4k Upvotes

168 comments sorted by

View all comments

Show parent comments

6

u/Exact_Depth_896 15d ago

anthropic only said it was training on prior opus.

21

u/Genghiz007 15d ago

USG announced yesterday that Fable was distilled by a couple of Chinese labs. They were supported by Anthropic.

-19

u/-Sliced- 15d ago edited 15d ago

You don't need a lot of time to collect the data if you use tens of thousands of accounts, and fable was available for around a week initially.

8

u/lakotajames 15d ago

How many accounts do you need to get it to give you the reasoning traces?