Google

A distinction can be made between two types of prompts for refining LLM outputs. Unguided prompts, such as the simple command "Please refine it!", depend entirely on the model's intrinsic instruction-following capabilities without specific direction. In contrast, guided prompts provide targeted feedback, like "Please correct all the grammatical errors," which directs the model to focus on particular aspects, leading to a more effective refinement process.

Guided vs. Unguided Refinement Prompts

A simple, unguided instruction for refining a model's output can be a generic command like "Please refine it!". This type of prompt relies on the LLM's general ability to follow instructions without providing specific criteria for improvement.

Example of an Unguided Refinement Prompt

To guide an LLM's refinement process toward a specific issue, a prompt can provide targeted feedback. For instance, the instruction "Please correct all the grammatical errors in the translation" directs the model to focus its improvements on grammatical accuracy.

Example of a Guided Refinement Prompt for Grammatical Correction

A user is trying to get a good French translation for the English idiom 'He's pulling your leg.' Analyze the following interaction and explain why the user's second prompt was ineffective. Then, propose a new prompt that would be more likely to produce the desired result.

Improving an Idiomatic Translation

A user asks a language model to explain a scientific concept. The model's response is accurate but uses very technical jargon. The user's first attempt to fix this is to simply ask, 'Make this simpler.' Rewrite this instruction to be a more effective, *guided* refinement prompt that specifies the desired changes for a middle school audience.

Transforming an Unguided Prompt

A user is working with a language model to improve a short story it generated. The user wants to make the main character more compelling. Consider two possible follow-up instructions they could give the model:

1. "Make it more interesting."
2. "Revise the story to give the main character a clearer motivation for their actions and add more descriptive details about their internal thoughts."

Which instruction is more likely to lead to a successful revision, and why?

Learn Before

Related