Google

The output stage, labeled as step ③, is the final part of the K-best selection process. Based on a predefined 'beam width' (K), the top K candidates from the ranked list are selected as the final output. All other candidates with lower probabilities are discarded. For instance, with a beam width of K=3, the top three candidates ('cute', 'on', 'sick') are chosen, forming the final output beam.

Output Stage in K-Best Selection

A developer is analyzing a text generation system. At a specific step, the system produces a ranked list of potential next words. It then applies a selection process to determine the final output beam. Given the system's state below, determine the numerical value of the 'beam width' parameter used in this step and justify your answer.

Analyzing a Text Generation Output

A language model generates a ranked list of potential next words: `['run', 'walk', 'sprint', 'jog', 'move']`. The final output selected from this list is `['run', 'walk']`. The 'beam width' (K) used in this selection process must have been ____.

A text generation system has produced the following list of potential next words, ranked from most to least probable: ['happy', 'glad', 'joyful', 'cheerful', 'content', 'pleased']. If the system is configured to select the final output using a 'beam width' of 3, which set of words will be chosen?

Learn Before

Related