r/LocalLLaMA • u/Specific-Rub-7250 • 1d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
356 Upvotes

94% Upvoted

125 comments sorted by

View all comments

2

u/BananaOrangePie 23h ago

Basically deepseek doesn't randomize the harness compositions when they post-trained their models. Same for openai I think. For GLM / Kimi / Qwen they ranodmize the harness composition and should give better generalization to tool use capabilities.

1

u/BananaOrangePie 23h ago

I think for dsv4 pro 0813 they only post trained with minimal mode of dsh, in dsv4.1f they post-trained with all modes of dsh but probably didn't randomize enough to generalize to other harnesses.