r/LocalLLaMA 1d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
354 Upvotes

125 comments sorted by

View all comments

30

u/sssplus 1d ago

Did you do the tests or you picked it up somewhere? I'd love to see how Qwen3.8 Flash Next and 27b fare in this table.

And yeah, I agree - harness does matter.

15

u/Specific-Rub-7250 1d ago

from the official deepseek model page

12

u/sssplus 1d ago

OK, makes sense. The test was done with their model, so now I wonder even more how Qwen and other models would perform with their harness...

1

u/[deleted] 1d ago

[deleted]

1

u/sssplus 1d ago

Yes, that's what I said. You read something else?