Evaluation of the Model's Answer to the Arithmetic Word Problem
The model's output of 10 for the arithmetic reasoning word problem is evaluated as incorrect when compared to the correct answer, which is 7.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Related
A student is solving the following word problem: 'Jack starts with 7 apples. He eats 2, then his mom gives him 5 more. Finally, he gives 3 apples to his friend John. How many apples does Jack have left?' The student provides the following reasoning: 'Jack starts with 7, eats 2, so he has 5. Then he gets 5 more, so 5 + 5 = 10. The final answer is 10.' Which statement best analyzes the error in the student's reasoning?
To solve the word problem, 'Jack starts with 7 apples. He eats 2, then his mom gives him 5 more. Finally, he gives 3 apples to his friend John,' you must perform a series of calculations. Arrange the following calculations in the correct chronological order.
Auditing an Automated Calculation
Learn After
A language model is tasked with solving the following problem: 'A person has 7 items, then loses 2, then gains 5, and finally gives away 3. How many items remain?' The model provides the answer '10'. The correct solution is '7'. Based on this information, what is the most likely logical error the model made?
A language model is presented with the following word problem: 'A person starts with 7 items, eats 2, receives 5 more, and then gives 3 away. How many items are left?' The model provides the answer '10'. Based on this scenario, the model's answer is correct for the intermediate step of the calculation, right before the final action of giving 3 items away.
Analysis of a Language Model's Arithmetic Error