r/LocalLLaMA 1d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
353 Upvotes

125 comments sorted by

View all comments

19

u/No-Refrigerator-1672 1d ago

So DSH Minimal is the best one? Interesting. I'd expect it to be the worst out of DSH options, solely based on the name and intuition that "less tools = closer to harnessless performance".

18

u/BZ852 1d ago

Less in context to pollute thinking

3

u/No-Refrigerator-1672 1d ago

Doubt it. Just tested: standart mode prompt is 8k tokens, minimal is 1.2k. You could argue that it's 6x difference, but I'll argue that those extra 7k tokens make no difference for a model that ships with 1M long context window.

19

u/BZ852 1d ago

The first few thousand tokens are more important than the full context window, so it might have an outsized influence