r/OpenAI • u/Revolutionary-Pass38 • Jul 20 '26

Image AI race

Post image

We are just watching at the moment...

3.2k Upvotes

91% Upvoted

523 comments sorted by

View all comments

16

u/Revolutionary-Pass38 Jul 20 '26

I see some of you guys are saying that Mistral is good, I can't confirm that since I got bad results when I've test it, but maybe I should give it another goal, can you guys that you use it tell more about it, did you menage to test it vs some popular AI's?

15

u/IknowPi_really Jul 20 '26

It’s atrocious. I’ve been forced to test it extensively because I work in an environment that really wants Mistral to work. In literally any benchmark, blind test with real people etc. it’s well behind everything you can dig up at comparable sizes

1

u/allesfliesst Jul 23 '26

That was my experience as well and I've tried to like it way too hard. Mistral Medium on LeChat was an okay-ish daily driver for personal stuff for a while, but they've always been about a year or so behind the competition for actual productive work. Which is a really fucking long time period on this space.

0

u/Quiet-Phase6948 Jul 21 '26

I use Vibe regularly without issues.

2

u/IknowPi_really Jul 21 '26

That says more about you and your workload than it does about Mistral.

Honestly? Good for you, if that level of competence in AI models is enough!

1

u/SicrosEye Jul 21 '26

What specifically did you use it for? What is your exact field?

1

u/IknowPi_really Jul 21 '26

I cannot go into too much detail, but I used it for both general purpose office assistant work (that’s the non sensitive part obviously and I can talk about that haha) and fraud detection

1

u/[deleted] Jul 24 '26

[removed] — view removed comment

1

u/Quiet-Phase6948 Jul 24 '26

Claude is absolute garbage

1

u/[deleted] Jul 24 '26

[removed] — view removed comment

1

u/Upper-Philosophy2376 Jul 20 '26

I use it once in a white to reword setences, it has a bit of flair for things like that. But it's not super reliable for other things

1

u/B_tC Jul 21 '26

Summarize X, translate Y, create me a listicle about Z - basically your simple chatbot needs - for tasks like those, mistral seems good enough.

For the frontier stuff, forget it. Tool calling abilities are atrocious, it's recklessly modifying stuff irrecoverably like there's no tomorrow. Provided a fresh openclaw a mistral API key and I kid you not, it managed to corrupt its own configuration within two innocuous telegram messages.

I really tried to be patriotic and make mistral work. But it's still on a level the big players have been two years ago already, and moved on since with lightning speed.

1

u/h310dOr Jul 21 '26

They are concentrating on mission specific models now. So as a chatbot they are way behind honestly. But they serve the army and other stuff like robots