Google

In the final stage of the Retrieval-Augmented Generation (RAG) process, the augmented input, denoted as $$\mathbf{x}'$$, serves as the context. The Large Language Model then uses this combined information to predict the subsequent text, an operation that is mathematically represented by the conditional probability model $$\Pr(\mathbf{y}|\mathbf{x}')$$.

Generating Predictions with Augmented Input in RAG

In the Retrieval-Augmented Generation (RAG) framework, the final prediction is generated by prompting a Large Language Model (LLM). This process involves feeding the model an input that combines both the original user query and the relevant texts retrieved from an external information source.

Prompting LLMs with Retrieved Texts in RAG

Based on the case study below, identify the primary failure in the final generation stage of this information system. Explain why the system's answer is inadequate, even though it is factually based on the retrieved text.

Diagnosing a Generation Failure in an Information System

A developer is building a question-answering system. They have successfully implemented a retrieval component that finds relevant text passages for a user's query. The developer proposes two different approaches for the final generation step:

1.  **Approach A:** Ignore the original query and simply ask a language model to summarize the retrieved text passages.
2.  **Approach B:** Combine the original query with the retrieved text passages and ask the language model to answer the query based on the provided text.

Critique both approaches. Which approach is more likely to produce a helpful and accurate answer for the user, and why? Justify your reasoning by explaining the role of each input component (the original query and the retrieved text).

Evaluating Generation Strategies in a Q&A System

A system is designed to answer questions using a two-step process: first, it finds relevant documents from a database, and second, it uses a large language model to generate a final answer. A user asks, 'What is the battery life of the new "Innovate X" phone?' The system retrieves the following text: 'The Innovate X phone features a 5000mAh battery, providing up to 48 hours of talk time.' Which of the following inputs to the language model is structured to produce the most accurate and relevant 

Learn Before

Related