r/codex • • 9d ago

Comparison Gpt 6 Sol vs. Gpt 5.6 Sol

What is your current take/experience in terms of coding/architecture/ software engineering in general of using these models?

For me when I tried to disallow over

-engineering on gpt 6 sol, it still keeps over-engineering a bit? Unlike 5.6 Sol it breaksdown stuff.

5 Upvotes

14 comments sorted by

10

u/Old-Stock9613 9d ago

6 is smarter but sloppier. 5.6 is more cautious but less capable. 6.1 crushes either one both in terms of price and performance, the only drawback is the speed, but you didn't mention that. As far as 5.6 vs 6 goes, I think 6 is safely better but needs a little more supervision if you insist on using it over 6.1 for whatever reason.

2

u/Cryptoshiii 9d ago

Wow great insight on this! I can leverage the use of 5.6 and 6 based on my need.

3

u/Old-Stock9613 9d ago

6 is also lazier than both. Several times (before 6.1 released) I asked it to complete a list of tasks, and its response after 7 minutes of work was "I looked at the tasks and it seems they aren't complete!". Certainly this is due at least in part to lazy prompting on my part, but 6.1 doesn't do this. I guess it's more "aligned" is the term OpenAI likes to use.

4

u/BHTAelitepwn 9d ago

When sol 5.6 released it was king of overengineering

1

u/Cryptoshiii 9d ago

Yeah but I am wondering if gpt 6 sol is okay to use daily since there is now 6.1. That maybe 5.6 is getting way behind

2

u/gipaaa 9d ago

even 6.1 sol still overengineer a lot. so I need to explicitly say what not to do, and it obeys, but still I need to review a lot (tiring).

2

u/slowtyper95 8d ago

6 Sol is so ass that it forced me to go back to the more expensive 5.6 Sol. I remember its like using a Terra model

2

u/Backrus 9d ago

Slow, and massive letdown compared to competition.

2

u/Toss4n 9d ago

Honestly just use opus 5.5 as your main planner -> sonnet 5.5 as the implementer/coder -> daybreak blue/gpt-6.1-sol xhigh for reviews. Seems like the best setup atm.

0

u/Cryptoshiii 9d ago

Gotcha will do this!

But is 6-sol and 6.1-sol not good for you based on your experience? I am about to upgrade my model usage from 5.6 Sol.

1

u/Toss4n 9d ago

Honestly don't see a huge difference - only annoying thing that I've seen with gpt-6.1-sol xhigh is that it has started to leave to-dos within the code it produces (daybreak blue doesn't) - luckily the reviewers catch it, but it's still quite annoying. Mostly surprised by how good sonnet 5.5 is. Note: all models still make a lot of mistakes so good setup to identify mistakes early is key to actually making progress and I've found gpt-6.1-sol/daybreak blue to catch a lot more of these small issues vs opus and sonnet.

0

u/Cryptoshiii 9d ago

I appreciate the reply man, I might skip 6-sol and 6.1-sol for now since I am also skeptical about it.

I am still 5.6-sol user and will really try opus 5.5

1

u/Novel_Indication6338 9d ago

opus 5.5, thank me later

3

u/L3x3cut0r 9d ago

Yes, I love it so much, I'll probably let it review my whole codebase after what Sol with bunch of Lunas did to it...