SKILL-RAG: Self-Knowledge Induced Learning and Filtering for Retrieval-Augmented Generation

This paper has been withdrawn by Tomoaki Isoda

[Submitted on 20 Sep 2025 (v1), last revised 21 Aug 2026 (this version, v2)]

No PDF available, click to view other formats

Abstract:Retrieval-Augmented Generation (RAG) has significantly improved the performance of large language models (LLMs) on knowledge-intensive tasks in recent years. However, since retrieval systems may return irrelevant content, incorporating such information into the model often leads to hallucinations. Thus, identifying and filtering out unhelpful retrieved content is a key challenge for improving RAG this http URL better integrate the internal knowledge of the model with external knowledge from retrieval, it is essential to understand what the model “knows” and “does not know” (which is also called “self-knowledge”). Based on this insight, we propose SKILL-RAG (Self-Knowledge Induced Learning and Filtering for RAG), a novel method that leverages the model’s self-knowledge to determine which retrieved documents are beneficial for answering a given query. We design a reinforcement learning-based training framework to explicitly elicit self-knowledge from the model and employs sentence-level granularity to filter out irrelevant content while preserving useful this http URL evaluate SKILL-RAG using Llama2-7B and Qwen3-8B on several question answering benchmarks. Experimental results demonstrate that SKILL-RAG not only improves generation quality but also significantly reduces the number of input documents, validating the importance of self-knowledge in guiding the selection of high-quality retrievals.

Submission history

From: Tomoaki Isoda [view email]
[v1] Sat, 20 Sep 2025 11:02:06 UTC (1,382 KB)
[v2] Fri, 21 Aug 2026 02:21:43 UTC (1 KB) (withdrawn)