Google

The discriminator's task in replaced token detection is to classify each token in a sequence that has been altered by a generator. It receives an input sequence and produces a label of either $$\mathrm{original}$$ or $$\mathrm{replaced}$$ for each position. 

For example, if the sequence generated is "The boy spent decades working on toys .", the process can be visualized as follows:

$$
\begin{array}{r c c c c c c c c c}
\text{replaced:} & [\mathrm{CLS}] & \text{The} & \text{boy} & \text{spent} & \text{decades} & \text{working} & \text{on} & \text{toys} & . \\
& \downarrow & \downarrow & \downarrow & \downarrow & \downarrow & \downarrow & \downarrow & \downarrow & \downarrow \\
& \multicolumn{9}{c}{\text{Discriminator (the model we want)}} \\
& \downarrow & \downarrow & \downarrow & \downarrow & \downarrow & \downarrow & \downarrow & \downarrow & \downarrow \\
\text{label:} & \mathrm{original} & \mathrm{original} & \mathrm{original} & \mathrm{original} & \mathrm{replaced} & \mathrm{original} & \mathrm{original} & \mathrm{original} & \mathrm{original}
\end{array}
$$

As shown, the model accurately identifies "decades" as $$\mathrm{replaced}$$ and "toys" as $$\mathrm{original}$$, even though "toys" was masked and regenerated by the generator, because it matches the original text.

Visual Example of Discriminator Operation in Replaced Token Detection

A text-processing system uses a 'generator' to alter a sentence and a 'discriminator' to identify the changes. The discriminator labels each token as 'original' or 'replaced'. Consider this scenario: The original sentence is 'The cat sat on the mat.' The generator is tasked with replacing the word 'sat', but it happens to choose 'sat' as the replacement. The sentence given to the discriminator is therefore unchanged: 'The cat sat on the mat.' Explain how a correctly functioning discriminator should label the word 'sat' and provide the reasoning for this label.

Discriminator Labeling Logic

A text-processing system uses two components: a 'generator' that alters an original sentence, and a 'discriminator' that then labels each word in the altered sentence as either 'original' or 'replaced'. The discriminator's goal is to identify which words in the final sentence are different from the original words at the same position.

Review the following process and outcome. Based on the described goal of the discriminator, is its final label for the word 'jumps' correct? Justify your answer.

Evaluating a Token Classification System

A text-processing system is designed to identify altered words in a sentence. It uses a 'generator' to produce a new version of an original sentence, and then a 'discriminator' to label each word in the new sentence as either 'original' (if it's the same as the word in the original sentence) or 'replaced' (if the generator changed it).

Original Sentence: "The scientist discovered a new planet."
Generator's Output Sentence: "The scientist found a new planet."

Based on its task, how should the d

Learn Before

Related