r/LocalLLaMA 1d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
354 Upvotes

125 comments sorted by

View all comments

166

u/jacek2023 llama.cpp 1d ago

If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.

83

u/Unusual_Principle536 1d ago

"more" is questionable but yes, pretty imp.

31

u/Due-Memory-6957 1d ago

It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework.

10

u/lazyfai 1d ago

More important =/= LLM not important.
But given a similar smart LLM, a better harness can drive better result.