← 피드로
[Submitted on 17 Sep 2026]
Abstract:Autoregressive (AR) models suffer from local greediness, while diffusion language models (DLMs) often lack the strict causal structure required for reasoning. To combine the advantages and overcome the drawbacks of the dual, we propose Causal Latent Revision (CaLR), a framework that reformulates reasoning as constrained latent optimization. By adopting a causal topology matrix (CTM) from an expert model and implicit differentiation, CaLR performs gradient-guided “thought revision” to enforce logical consistency, enabling dynamic self-correction of intermediate steps during parallel generation. Empirically, CaLR achieves SOTA DLM performance on complex benchmarks, surpassing strong AR baselines and demonstrating superior robustness in constrained tasks like Sudoku.
Submission history
From: Wei Cai [view email]
[v1]
Thu, 17 Sep 2026 18:34:02 UTC (786 KB)
추출 본문 · 출처: arxiv.org · https://arxiv.org/abs/2609.20981