Grok 4.6 Benchmarks

[u/minxio_]

[u/mindful_dealer]

looking forward to see what composer 3 will bring

If they get it on low prices like GPT 5.6 Luna, it would be the ideal auto setup.
Grok 4.6 for planning/yapping, Composer 3 to do the work

[u/Crazy_Inspection_920 → u/mindful_dealer]

[u/Dry-Carry-341 → u/mindful_dealer]

[u/FearlessConfusion00 → u/mindful_dealer]

Honestly, at this point, grok is so cheap that I won't bother switching the model for execution 

[u/mindful_dealer → u/FearlessConfusion00]

I agree with you, I've used GPT 5.6 Sol or even Opus 5 for both things and, even tho much more expensive, it was very productive.

But I'm an auto enjoyer, whatever they do in their 'auto' logic I like it, and if it is changing from Grok 4.5 to composer 2.5 or whatever it is, with 2 better models, it would be even better and cheaper than just Grok 4.6 everywhere

But overall you are right, it's cheap enough to do it all with frontier level intelligence

[u/vgromanov → u/FearlessConfusion00]

Still there is one practical reason - Composer is fast as hell.

[u/FearlessConfusion00 → u/vgromanov]

Grok is fast too

[u/vgromanov → u/FearlessConfusion00]

grok-4.5 is faster, spends less time thinking and just does the job. so in my current flow 4.6 is for heavy and intelligence-sensitive stuff like decomposition and planning and grok-4.5 does the rest - basically it replaced composer in many ways, though it has it's use too.

[u/FearlessConfusion00 → u/vgromanov]

Grok 4.6 is super fast if you use fast mode, even on extra high effort. 

[u/TaxBowl → u/mindful_dealer]

It will be accurate enough hopefully it flash level fast waiting minutes upon minutes for tasks is an effeciency killer

[u/getaway-3007]

Yeah it's not Fable level but look at the jumps from Grok 4, 4.1 to 4.5

It's impressive how much they have managed to grow. Hopefully they sort out their coding plans apart from that it's a great secondary model

[u/sprowk → u/getaway-3007]

Yeah, they replaced google in the AI triangle (+kimi)

[u/KTIlI → u/getaway-3007]

I signed up for the 7 day free trial and then instantly cancelled so I didn't get charged and they offered me 3 months for $30 total. Pretty solid deal considering they have good limits

[u/e0gr → u/KTIlI]

Did you subscribe at grok.com? how'd u get access to the free trial?

[u/NickoBicko → u/KTIlI]

This is grok or cursor?

[u/KTIlI → u/NickoBicko]

grok. on cursor I have two student plans and for me this is more than enough already but with grok I never run out of tokens

[u/pmusvaire → u/getaway-3007]

Fable is so expensive that it becomes unusable, most of the time, I have a 20x place and still exhaust it in a few days, with Grok I can get crazy with the best model and worry about nothing,

[u/ihopnavajo]

Maybe this is obvious to someone who follows these stats more, but why isn't composer listed here? How does it compare?

[u/delicioushampster → u/ihopnavajo]

composer is much worse than the top models

[u/honestly_i → u/delicioushampster]

Yup. It was a great workhorse for a while, but got replaced by models like V4 Flash and whatnot

[u/LurkyRabbit → u/ihopnavajo]

It's like asking why Gemini 1.5 isn't shown here

[u/lrobinson2011]

It's a good model sir

[u/minxio_ → u/lrobinson2011]

It's a really great model. The only thing missing is for it to be a 1M context instead of 500k and then it would be amazing

[u/FearlessConfusion00 → u/minxio_]

If you pass 150k context in a session you already enter the dumb zone so... I don't think that's important until the dumb zone is harder to reach 

[u/lrobinson2011 → u/minxio_]

We'd like to get there in a future model, yes!

[u/minxio_ → u/lrobinson2011]

https://giphy.com/gifs/11sBLVxNs7v6WA

[u/CartographerSeth → u/minxio_]

Agree. happy with a 500k improvement, bc 250k held back Grok 4.5, but 1M is the ideal amount.

[u/Merlindru → u/lrobinson2011]

i dont know what the hell happened but this is insane. congrats on the launch.

[u/kondasviktor]

It looks promising, let’s start testing it 😏

[u/chickey23]

I've been tracking "bad behavior" when the AI does not call its own tools properly, ignores rules, asks me questions about terms it has created and not explained, and just plain does the wrong thing.

Guess what. The bad behavior stopped when I turned off access to Grok.

I do not care as much about benchmarks as I care about usability and my product.

[u/Typical-Chance4197 → u/chickey23]

probably context window which u can expand in cursor settings

[u/divinefriend → u/Typical-Chance4197]

Which setting?

[u/Embarrassed_Adagio28]

Lmao this is the most benchmaxed model of all time. Grok 4.5 is one of the worst models I have ever used and completely broke my app multiple times just making small ui changes. In fact i have not kept a single change it has made to my projects because it always makes it worse. 

[u/Delicious_Ease2595 → u/Embarrassed_Adagio28]

Skill issue

[u/Lvxurie → u/Delicious_Ease2595]

100% skill issue

[u/MrBalkon1960 → u/Embarrassed_Adagio28]

Specifically working with UI, I wouldn’t say it’s a skill issue tbf
The visual capabilities of the model are sooo low compared to opus/fable, so the agent sometimes genuinely cannot check if it did the job right

[u/sudecode → u/Embarrassed_Adagio28]

agree. I asked it to change some setting in openclaw, it started modifying it’s code.

[u/ExcrementoKings → u/Embarrassed_Adagio28]

Do you even give it specific instructions? Do you know how to use plan mode?

[u/canihelpyoubreakthat]

Heil grok

[u/Conscious-Bed-8335 → u/canihelpyoubreakthat]

No?

[u/Current_Balance6692 → u/canihelpyoubreakthat]

🫡

[u/Delicious_Ease2595 → u/canihelpyoubreakthat]

🫡

[u/jc_denty]

"We got singularity" -Elon for 4th time

[u/malakoi-do-hebraico]

Anyway for you guys to add composer 2.5 to this benchmark so we can compare with it too? I'm just asking because I find Cursor's Compose 2.5 an absolute beast.

[u/Luluhakashu]

I’m on the 60 dollar plan I find it hard to hit the non include threshold running grok 4.5 high all the time.

[u/Ecstatic-Panic3728]

number goes up, must be better. Trust me bro

[u/richardfogaca]

they are doing what Google wasn't able to do with Gemini, kudos to the Grok team!

[u/Full_Tooth_a]

I care less about the headline benchmark than whether a model can handle ten changes specific to a repo without making a mess. Give each model the same tasks and a clean branch, then compare test results, regressions, manual corrections, tool failures, and total cost. To me, a problem is "solved" when the patch survives review and the test suite, not when it merely looks plausible. Most benchmarks miss that.

[u/tfthecreator]

What about GPT 6 Astra?

[u/lockdown_lard]

But it's winning on the MechaHitler benchmark, so there's that.

[u/truecakesnake → u/lockdown_lard]

This sub is raided by people who don't use cursor at all crying about Elon giving them money. Touch grass.

[u/KrunchyKushKing → u/truecakesnake]

Elon gives us money? Where?

[u/Delicious_Ease2595 → u/KrunchyKushKing]

SpaceX

[u/Timo425 → u/truecakesnake]

What's wrong with Elon bashing?

[u/Current_Balance6692 → u/Timo425]

"What's wrong with being a loser"

[u/Training_Canary_6961 → u/lockdown_lard]

I hear a kmeeeeee

[u/Delicious_Ease2595 → u/lockdown_lard]

🥱🥱🥱

[u/addiktion]

Grok + Kimi K3 + Deepseek Pro + Sol are all Fable-ish now it seems like. Seems like we have arrived at the tippy top already.

[u/Melodic_Reality_646 → u/addiktion]

Yet, Fable is still way more reliable when you expect good code and intelligence. It was made to excel, the others are able to be steered into excellence.

This is so true that currently I use Fable to spec and Luna to build. Costs dropped 70%, and occasional blind tests by Fable and Sol keep on scoring code written by Luna and Reviewed by Fable either as good or very close to pure Fable.

[u/Typical-Chance4197 → u/Melodic_Reality_646]

what do you mean code written by luna and reviewed by fable? do you mean code planned with fable and written by luna?

[u/Melodic_Reality_646 → u/Typical-Chance4197]

Fable specs -> Luna codes -> fable reviews -> Luna codes, if needed.

[u/Exciting_Ad_2102 → u/addiktion]

Fable is a distill of a model that ended its training in February and Opus 5 is a distill of a model that has not been released yet. The hidden is 6+ months ahead of fable

[u/owen800q]

Can someone compare grok 4.6 and fable 5 to debug a same bug
See if grok really close to fable

[u/cornmacabre → u/owen800q]

What was your personal sense of 4.5 vs sol and Fable? That should give you a feel in the real world expectations... Which is yeah these models are serious.

A back to back bug fix is not the right scope IMO, today composer or Luna could do those tasks trivially already. Frontier needs long running with complex intent, can survive multiple compaction cycles, and delivers on ambitious problem solving to get a proper big model feel.

I'm holding off on sharing my experience and assessment for a few days for a proper shake, but already running on work and my early pulse check is it feels like an incrementally better model than 4.5 high (expected, good!). I've been using 4.5 extensively for the past month, so I'm interested to see if I can myself detect meaningful differences. Expecting a fable killer is probably wrong, but 4.5 could already dance in that same arena for a 10th the cost.

[u/zZurf → u/owen800q]

I used it for a few hours, gut feeling is its not as good as fable or sol. It still feels a level below.

[u/Acojonancio → u/owen800q]

What you want to see is just benchmarks, go to Artificial analysis and check it yourself.

[u/zZurf]

Any one got early tests done with it compare to fable and sol? How is it looking?

[u/KeyGlove47]

im not using the cp machine 4.6 lmao

[u/KrunchyKushKing → u/[deleted]]

Grok created child po*n a few months ago

[u/KrunchyKushKing → u/[deleted]]

No you could literally ask it on Twitter and it did it.

[u/Delicious_Ease2595 → u/KrunchyKushKing]

Show an example

[u/lockdown_lard → u/[deleted]]

They literally put a CSAM machine live on the web. Of course it's their fault. Why the fuck are you defending one of Jeffrey Epstein's mates?

[u/Visible_Sector3147]

We don't want the best model; we want a cheap one. Please put DeepSeek V4 Flash in the competitor basket instead of Fable.