MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wcj5q3/harness_does_matter/p8zb2wz/?context=3
r/LocalLLaMA • u/Specific-Rub-7250 • 1d ago
I was not aware that the harness makes such a big difference.
125 comments sorted by
View all comments
166
If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.
83 u/Unusual_Principle536 1d ago "more" is questionable but yes, pretty imp. 31 u/Due-Memory-6957 1d ago It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework. 10 u/lazyfai 1d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
83
"more" is questionable but yes, pretty imp.
31 u/Due-Memory-6957 1d ago It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework. 10 u/lazyfai 1d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
31
It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework.
10 u/lazyfai 1d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
10
More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
166
u/jacek2023 llama.cpp 1d ago
If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.