Date of Submission

6-10-2026

Date of Award

6-16-2026

Institute Name (Publisher)

Indian Statistical Institute

Document Type

Master's Dissertation

Degree Name

Master of Technology

Subject Name

Computer Science

Department

Computer Vision and Pattern Recognition Unit (CVPR-Kolkata)

Supervisor

Bhattacharya, Ujjwal

Abstract (Summary of the Work)

The increasing need to deploy language models on constrained devices has given rise to efficiency issues in retrieval-augmented generation (RAG) approaches. Although RAGs boost answers’ quality by retrieving knowledge from external sources, current methods utilize static retrieval mechanisms, resulting in unnecessary computation, higher latencies, and inefficiency in resource usage. In this work, an efficient RAG approach based on small language models (SLMs) is presented, which uses a efficient and adaptive retrieval scheme. This method dynamically changes the retrieval depth and context constrution based on the complexity of the query, using a trained MLP router whose routing decisions are learned from Adaptive-RAG-style oracle labels rather than hand-written rules, leading to a compromise between performance and efficiency. A full pipeline is provided, including dataset preprocessing, corpus generation, embedding construction, vector indexation, retrieval, and answer generation processes. Experiments were performed on HotpotQA bench mark and SQuAD 2.0 datasets, comparing the presented approach with the baseline RAG approach using static retrieval scheme. Experimental results show that the proposed approach lowers the computation cost while providing similar answers’ quality. By adaptively controlling retrieval and context size, the framework provides an effective solution for deploying RAG systems in constrained environments.

Control Number

CS2411

DOI

https://dspace.isical.ac.in/items/0628a78b-fd62-4ab5-9cc3-97fab6d6beb5

DSpace Identifier

http://hdl.handle.net/10263/7759

Download

Share

COinS