dark-pen/frosty-jan
Updated
J C
dark-pen
AI & ML interests
None yet
Recent Activity
reacted
to
mike-ravkine's
post
with 👀
2 days ago
Spatial reasoning is a domain where LLMs struggle surprisingly hard.
A new paper, "Stuck in the Matrix: Probing Spatial Reasoning in Large Language Models" compares performance on a handful of spacial reasoning tasks and finds all SOTA LLMs breaking down and hallucinating their faces off when the grids get large.
https://arxiv.org/html/2510.20198v1
The word search task is especially revealing: notice the bias towards detecting "horizontal" while struggling with "vertical" - LLMs only understand simple, linear relationships.. add a stride for 2D and it's basically over.
upvoted
a
collection
2 days ago
Dream-Coder 7B
Organizations
