Google

A simple algebraic problem commonly used to illustrate Chain-of-Thought (CoT) prompting is the task of calculating the average of a given set of numbers, for instance, the numbers 2, 4, and 6.

Example of an Algebraic Problem for CoT Illustration

A language model is prompted to 'think step-by-step' to find the average of the numbers 2, 4, and 6. Arrange the following steps into the logical order the model should follow to arrive at the correct answer.

A computational model was asked to find the average of the numbers 2, 4, and 6. It produced the step-by-step reasoning shown below. Analyze this process, identify the specific step that contains a fundamental error in its logic, and explain why the reasoning is incorrect.

Evaluating a Computational Reasoning Process

A developer is testing a language model's ability to solve multi-step arithmetic problems by having it "think out loud." The model is given the task: "What is the average of the numbers 2, 4, and 6?" Which of the following responses from the model best demonstrates a clear, step-by-step reasoning process?

Learn Before

Related