Analysis of a Language Model's Arithmetic Error
Given the following scenario, identify the correct final answer and explain the specific calculation step the model likely failed to perform.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is tasked with solving the following problem: 'A person has 7 items, then loses 2, then gains 5, and finally gives away 3. How many items remain?' The model provides the answer '10'. The correct solution is '7'. Based on this information, what is the most likely logical error the model made?
A language model is presented with the following word problem: 'A person starts with 7 items, eats 2, receives 5 more, and then gives 3 away. How many items are left?' The model provides the answer '10'. Based on this scenario, the model's answer is correct for the intermediate step of the calculation, right before the final action of giving 3 items away.