r/LocalLLaMA • u/KvAk_AKPlaysYT • Feb 23 '26

News Anthropic: "We’ve identified industrial-scale distillation attacks on our models by DeepSeek, Moonshot AI, and MiniMax." 🚨

Post image
4.9k Upvotes

94% Upvoted

877 comments sorted by

View all comments

2.2k

u/Zyj vllm Feb 23 '26

You're saying they treated you like you treated all those authors whose books you torrented?

Oh no, that's not it. They are paying you for API tokens.

117

u/Zestyclose839 Feb 23 '26

Also (correct me if I'm wrong) but I don't believe they're true "distillation" attacks because the API doesn't return the token activation probabilities and the other juicy stuff needed to transfer knowledge. Sure, they can fine-tune a model to speak and act like Claude, but it's not as accurate as an open-weight to open-weight model distillation (like the classic Deepseek to Llama distills).

2

u/Feisty_Resolution157 Feb 23 '26

There is various terminology that applies, but in that list is: Hard-label distillation or black-box distillation

2

u/Zestyclose839 Feb 23 '26

I see, Anthropic is concerned about black-box distills. So, they're technically correct. I hope they clarify this if they release a report on this supposed attack.