Google

For a large language model to successfully perform a task via few-shot learning, the prompt must contain a sufficient number of demonstrations. Although the required number of examples is generally small, it must be adequate for the model to recognize the underlying input-output pattern of the task.

Sufficiency of Demonstrations in Few-Shot Learning

A developer is using a language model to classify customer feedback. When they test the model with the new feedback, 'This is the best app I have ever used!', the model incorrectly classifies it as 'Negative'. Based on the provided case study, explain the most likely reason for this specific failure and what single change to the set of examples would be most effective at fixing it.

Diagnosing Few-Shot Learning Failures

A developer is creating a prompt to extract a 'Product Name' and 'Issue Type' from customer support tickets. The model is performing poorly on new tickets. Below is the prompt they are using.

---
**Prompt Start**

Extract the product name and issue type from the following support tickets.

Ticket: "My new QuantumLeap laptop won't turn on. I've tried plugging it in, but nothing happens."
Product Name: QuantumLeap laptop
Issue Type: Power Failure
###
Ticket: "The screen on my QuantumLeap laptop is flickering constantly. It's very distracting."
Product Name: QuantumLeap laptop
Issue Type: Display Malfunction
###
Ticket: "I can't connect my StellarSound headphones to my phone via Bluetooth."
Product Name:
Issue Type:

**Prompt End**
---

Evaluate the two demonstrations provided in the prompt. Explain why this set of examples is likely insufficient for the model to reliably handle a wide variety of support tickets.

Evaluating Demonstration Sufficiency in a Prompt

A developer is trying to get a language model to classify short movie reviews as 'Positive', 'Negative', or 'Neutral'. They test two different sets of instructions, shown below. 

**Instructions A:**
Classify the following movie review.
Review: The plot was predictable and the acting was wooden.
Classification: Negative
---
Review: This film was an absolute masterpiece from start to finish.
Classification:

**Instructions B:**
Classify the following movie reviews.
Review: The plot was predictabl

Learn Before

Instructions A: Classify the following movie review. Review: The plot was predictable and the acting was wooden. Classification: Negative

Related