26 August 2026
AI models stumble on puzzles humans solve easily
First reported
MIT Technology Review ran this on .
- Language models, the AI systems behind chatbots like ChatGPT, excel at memorizing facts but fail at spatial reasoning tasks like mental rotation puzzles where you identify 3D objects from different angles.
- Models often get tricked by slight variations of classic logic puzzles because they rely on what they memorized during training rather than reasoning through the problem, as shown in studies of Knights and Knaves riddles.
Reported by MIT Technology Review