Google

A common strategy for improving text generation is to alter the search objective used during the decoding process. Rather than adhering to a single criterion, such as finding the most probable sequence, the goal can be modified to optimize for different qualities in the output.

Modifying the Search Objective to Improve Decoding

Minimum Bayes Risk (MBR) decoding is an alternative to Maximum a Posteriori (MAP) decoding that modifies the search objective. Instead of selecting the single most probable output, MBR decoding aims to choose an output that minimizes the expected risk when evaluated against a distribution of possible correct outputs.

MBR Decoding as an Alternative to MAP Decoding

A simple yet effective technique for enhancing control over text generation is to integrate penalty terms directly into the decoding process. This approach modifies the search objective to guide the model's output according to specific constraints or desired attributes, making the decoding process more controllable.

Incorporating Penalty Terms for Controllable Decoding

Based on this scenario, critique the current search objective. Explain why simply finding the most probable sequence leads to this undesirable outcome and propose a general modification to the search objective to encourage more diverse and interesting headlines.

Improving Generic Text Generation

A language model is designed to summarize long articles. While the generated summaries are factually correct, they often contain repetitive phrases, making them sound unnatural. Explain how the standard search objective (finding the most probable sequence of words) might contribute to this issue and briefly describe, in principle, how modifying this objective could lead to more varied and natural-sounding summaries.

Diagnosing Repetitive Text Generation

A language model is tasked with generating creative story endings. Its current decoding process consistently produces endings that are grammatically perfect and logically sound, but are often predictable and repetitive (e.g., '...and they all lived happily ever after.'). Which of the following statements best analyzes why modifying the search objective could address this issue?

Learn Before

Related