Multiple Choice
In a speculative decoding process, the number of consecutively accepted tokens from the start of a draft sequence, denoted by , is determined by finding the index of the first rejected token. The formula is: .
Given a draft sequence of 5 tokens () with the following randomly generated numbers () and probability ratios (), what is the calculated value of ?
- t=1: =0.4,
0
1
Updated 2025-10-03
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science