This repository manually collects works in latent space, which will be continuously updated.

[2025/11/30] We release the initial version!

Here, we classify all the latent space based methods two categories, and sort by date in ascending order:

• 📖 News
• 🌟 Overview
• 🤝 Contributing
• 🔥 Methods
  • LLM-based
  • VLM-based
  • MAS-based

We warmly welcome contributions of excellent resources you find via pull request. Please follow the instruction in CONTRIBUTING.md if you want to make one. Additionally, if you want to have any other issue, please add this wechat group.

Date	Paper Title	Introduction	Code
2024/11	Language Models are Hidden Reasoners: Unlocking Latent Reasoning Capabilities via Self-Rewarding		Github
2024/12	Training Large Language Models to Reason in a Continuous Latent Space		Github
2024/12	Deliberation in Latent Space via Differentiable Cache Augmentation		-
2025/02	Token Assorted: Mixing Latent and Text Tokens for Improved Language Model Reasoning		-
2025/02	SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs		Github
2025/02	Reasoning with Latent Thoughts: On the Power of Looped Transformers		-
2025/02	CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation		Github
2025/03	Reasoning to Learn from Latent Thoughts		Github
2025/04	Efficient Pretraining Length Scaling		-
2025/05	SoftCoT++: Test-Time Scaling with Soft Chain-of-Thought Reasoning		Github
2025/05	Reasoning by Superposition: A Theoretical Perspective on Chain of Continuous Thought		Github
2025/05	Enhancing Latent Computation in Transformers with Latent Tokens		-
2025/05	Seek in the Dark: Reasoning via Test-Time Instance-Level Policy Gradient in Latent Space		Github
2025/05	Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chains		Github
2025/05	LARES: Latent Reasoning for Sequential Recommendation		-
2025/05	Hybrid Latent Reasoning via Reinforcement Learning		Github
2025/05	System-1.5 Reasoning: Traversal in Language and Latent Spaces with Dynamic Shortcuts		-
2025/05	Soft Reasoning: Navigating Solution Spaces in Large Language Models through Controlled Embedding Exploration		Github
2025/06	Efficient Post-Training Refinement of Latent Reasoning in Large Language Models		Github
2025/07	Latent Inter-User Difference Modeling for LLM Personalization		Github
2025/08	Bridging Search and Recommendation through Latent Cross Reasoning		-
2025/09	Decoding in Latent Spaces for Efficient Inference in LLM-based Recommendation		-
2025/09	LTA-thinker: Latent Thought-Augmented Training Framework for Large Language Models on Complex Reasoning		Github
2025/09	SIM-CoT: Supervised Implicit Chain-of-Thought		Github
2025/09	Pretraining LLM with Latent Thoughts in Continuous Space		Github
2025/09	MemGen: Weaving Generative Latent Memory for Self-Evolving Agents		Github
2025/09	LatentEvolve: Self-Evolving Test-Time Scaling in Latent Space		Github
2025/09	MARCOS: Deep Thinking by Markov Chain of Continuous Thoughts		-
2025/09	Latent Thinking Optimization: Your Latent Reasoning Language Model Secretly Encodes Reward Signals in Its Latent Thoughts		-
2025/10	KaVa: Latent Reasoning via Compressed KV-Cache Distillation		-
2025/10	Thinking on the Fly: Test-Time Reasoning Enhancement via Latent Thought Policy Optimization		Github
2025/10	LaDiR: Latent Diffusion Enhances LLMs for Text Reasoning		Github
2025/10	Unlocking Out-of-Distribution Generalization in Transformers via Recursive Latent Space Reasoning		Github
2025/10	Latent Reasoning in LLMs as a Vocabulary-Space Superposition		Github
2025/10	SemCoT: Accelerating Chain-of-Thought Reasoning through Semantically-Aligned Implicit Tokens		Github
2025/10	Scaling Latent Reasoning via Looped Language Models		-
2025/11	SofT-GRPO: Surpassing Discrete-Token LLM Reinforcement Learning via Gumbel-Reparameterized Soft-Thinking Policy Optimization		Github
2025/11	Think-at-Hard: Selective Latent Iterations to Improve Reasoning Language Models		Github
2025/11	SpiralThinker: Latent Reasoning through an Iterative Process with Text-Latent Interleaving		-
2025/11	Improving Latent Reasoning in LLMs via Soft Concept Mixing		-
2025/11	CLaRa: Bridging Retrieval and Generation with Continuous Latent Reasoning		Github
2025/11	Learning When to Stop: Adaptive Latent Reasoning via Reinforcement Learning		Github

Date	Paper Title	Introduction	Code
2024/12	Perception Tokens Enhance Visual Reasoning in Multimodal Language Models		Github
2025/01	Efficient Reasoning with Hidden Thinking		Github
2025/06	Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens		Github
2025/08	Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Models		-
2025/09	Latent Visual reasoning		-
2025/10	Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space		Github
2025/10	Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views		Github
2025/10	Latent Chain-of-Thought for Visual Reasoning		Github
2025/10	Latent Sketchpad: Sketching Visual Thoughts to Elicit Multimodal Reasoning in MLLMs		Github
2025/11	CoCoVa: Chain of Continuous Vision-Language Thought for Latent Space Reasoning		-
2025/11	VisMem: Latent Vision Memory Unlocks Potential of Vision-Language Model		Github
2025/11	Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens		Github
2025/11	Monet: Reasoning in Latent Visual Space Beyond Image and Language		Github
2025/12	Interleaved Latent Visual Reasoning with Selective Perceptual Modeling		Github
2025/12	ReLaX: Reasoning with Latent Exploration for Large Reasoning Models		-
2025/12	Mull-Tokens: Modality-Agnostic Latent Thinking		-
2025/12	Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space		Github

Date	Paper Title	Introduction	Code
2025/10	Cache-to-Cache: Direct Semantic Communication Between Large Language Model		Github
2025/10	Thought Communication in Multiagent Collaboration		-
2025/11	Enabling Agents to Communicate Entirely in Latent Space		-
2025/11	Latent Collaboration in Multi-Agent Systems		Github