← 피드로
[Submitted on 3 Nov 2025 (v1), last revised 1 Sep 2026 (this version, v3)]
Abstract:Natural Language Explanations (NLEs) describe how Large Language Models (LLMs) make decisions by drawing on external Context Knowledge (CK) and Parametric Knowledge (PK). Understanding the interaction between these sources is key to assessing NLE grounding, yet these dynamics remain underexplored. Prior work has largely focused on i) single-step generation and ii) modeled PK–CK interaction as a binary choice within a rank-1 subspace. This approach overlooks richer interactions and how they unfold over longer generations, such as complementary or supportive knowledge. We propose a novel rank-2 projection subspace that disentangles PK and CK contributions more accurately and use it for the first multi-step analysis of knowledge interactions across longer NLE sequences. Experiments across four QA datasets and three open-weight LLMs demonstrate that rank-1 subspaces struggle to represent diverse interactions, whereas our rank-2 formulation captures them effectively, highlighting PK alignment for supportive interactions and CK alignment for conflicting ones. Our multi-step analysis reveals that hallucinated generations exhibit strong alignment with the PK direction, though context-faithful generations maintain a more balanced alignment between PK and CK.
Submission history
From: Sekh Mainul Islam [view email]
[v1]
Mon, 3 Nov 2025 16:15:06 UTC (1,445 KB)
[v2]
Fri, 30 Jan 2026 12:34:43 UTC (1,010 KB)
[v3]
Tue, 1 Sep 2026 14:49:45 UTC (983 KB)
추출 본문 · 출처: arxiv.org · https://arxiv.org/abs/2511.01706