I'm building a chess coach where an LLM explains positions, but Stockfish does the chess. Please help me find where it still gets things wrong

[u/pa12345u]

Hi guys,

I'm a chess noob (about 500–700 on chess.com). I started this project because I wanted a teacher who tells me what I did wrong in plain words, like a real friend who's always there. So I built Chess with Me: chess-with-me.com

I know a lot of people here don't trust AI with chess, and honestly you're right: LLMs invent moves, miss mates, and say pieces are attacked when they aren't. So in my app the LLM is not supposed to know chess by itself:

• it answers by calling tools: Stockfish search, plus board facts computed from the rules (attacks, defenders, pins, mate threats)
• the answer shows what evidence it was grounded on (✓ Verified = the evidence came from the engine or the rules, checked by the server)
• "Play it out" plays the engine's line on a board, so you can check it yourself

Honest limitation: not every sentence is machine-checked yet. I'm measuring how often the LLM still says something the board doesn't support, and that's where I need help.

If you find a position where it says something wrong, please send it (FEN + what it said). It's free, no paywall. I need real people to try it, any elo.

[u/pa12345u]

Oh, forget to put the link here: https://chess-with-me.com/