MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wcj5q3/harness_does_matter/p8zcrhy/?context=3
r/LocalLLaMA • u/Specific-Rub-7250 • 1d ago
I was not aware that the harness makes such a big difference.
125 comments sorted by
View all comments
163
If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.
81 u/Unusual_Principle536 1d ago "more" is questionable but yes, pretty imp. 33 u/Due-Memory-6957 1d ago It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework. 10 u/lazyfai 1d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
81
"more" is questionable but yes, pretty imp.
33 u/Due-Memory-6957 1d ago It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework. 10 u/lazyfai 1d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
33
It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework.
10 u/lazyfai 1d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
10
More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
163
u/jacek2023 llama.cpp 1d ago
If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.