본문 바로가기
  • Home

Lightweight DS-RAG: A Training-Free RAG Framework for Multi-Document QA on Edge Devices

  • Journal of The Korea Society of Computer and Information
  • Abbr : JKSCI
  • 2025, 30(11), pp.19~27
  • Publisher : The Korean Society Of Computer And Information
  • Research Area : Engineering > Computer Science
  • Received : July 30, 2025
  • Accepted : October 3, 2025
  • Published : November 28, 2025

Ji-Min Bang 1 Woo-Sin Lee 1

1광운대학교

Accredited

ABSTRACT

Multi-document Question Answering (Multi-document QA) is an essential component of question answering systems in real-world environments. It requires extracting and integrating the necessary information from multiple documents to generate accurate responses. The DS-RAG framework is optimized for real-world multi-document QA tasks. It improves the system’s overall accuracy and efficiency by using a document selection module that selects only the core documents retrieved after question decomposition, which are necessary for response generation. However, this process requires additional computational resources and additional training, making it difficult to apply in resource-limited environments. To address this limitation, this study proposes a Lightweight DS-RAG framework that achieves selection effects through importance-weighted query generation, thereby eliminating the need for a separate selection module. The proposed approach identifies key information within a question and generates importance-weighted queries. This enables retrieval focused on the most relevant information while maintaining both efficiency and accuracy. This approach maintains high retrieval accuracy while significantly reducing computational overhead, and can be applied in resource-constrained environments without domain-specific training. Experimental results demonstrate that the Lightweight DS-RAG framework achieves 95% of the retrieval performance of the original DS-RAG, as measured by the F1-score. Additionally, it exhibited an average performance improvement of 67.5% over RAG without a selection module. These results demonstrate that a high level of accuracy can be maintained without a separate selection module or additional training, indicating that the Lightweight DS-RAG framework can serve as a practical alternative in resource-constrained environments.

Citation status

* References for papers published after 2024 are currently being built.