MentalThink: Shaping Thoughts in Mental SVG World
Abstract
MentalThink enables multimodal large language models to perform visual-symbolic reasoning by generating and interpreting SVG code as an executable intermediate representation for spatial problem-solving.
We introduce MentalThink, a visual-symbolic reasoning paradigm that equips Multimodal LLMs (MLLMs) with an executable mechanism for "mental" visualization. The core of MentalThink is a think-with-SVG pipeline, where the model learns to generate, render, and interpret scalable vector graphics (SVG) code as an intermediate visual representation for multi-turn reasoning. By creating structured vector sketches, the model can externalize spatial hypotheses, inspect them through deterministic rendering, and reason within a constrained geometric space, effectively mimicking the human process of mental imagery. We instantiate this paradigm through a two-stage training framework, combining Supervised Fine-Tuning (SFT) for SVG syntactic alignment with multi-turn Reinforcement Learning (RL) to encourage iterative inspection, revision, and refinement of intermediate visual hypotheses. Extensive evaluations demonstrate that MentalThink achieves superior performance on spatial understanding and reasoning benchmarks (e.g., 55.1% on VSIBench, 76.0% on MindCube), showing that executable vector graphics provide a verifiable visual workspace for dynamic perspective taking, visual reflection, and compositional scene construction.
Community
MentalThink presents a "think-with-SVG" pipeline for Multimodal LLMs. By generating, rendering, and interpreting scalable vector graphics (SVG), we equip models with an executable mechanism for visual-symbolic reasoning and spatial problem-solving.
We hope this work inspires new ways to enhance the verifiable visual reasoning capabilities of MLLMs. Feedback and discussions are very welcome!
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning (2026)
- InterSketch: An Interleaved Reasoning Model with Self-correcting Visual Sketch and Stepwise Reward (2026)
- Scene Graph Thinking: Reinforcing Structured Visual Reasoning for Multimodal Large Language Models (2026)
- IVR-R1: Refining Trajectories through Iterative Visual-Grounded Reasoning in Reinforcement Learning (2026)
- H-GRPO: Permutation-Invariant Reinforcement Learning for Grounded Visual Reasoning (2026)
- DeepLatent: Think with Images via Parallel Latent Visual Reasoning (2026)
- Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2607.03530 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper