Learn Before
Example of Indexed Hidden State Sequence Notation
A sequence of hidden states, indexed from an initial point to a final point , can be represented as a series of vectors: . This notation is commonly used in sequence models to denote a specific subsequence of hidden state vectors.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Example of Indexed Embedding Sequence Notation
A model processes a sequence of seven input vectors, represented as . Which of the following correctly uses indexed notation to represent the subsequence containing only the third, fourth, and fifth vectors?
Applying Indexed Sequence Notation
A sequence of vectors is represented by the notation . This notation represents a subsequence containing exactly 6 vectors.
Learn After
A sequence model processes the sentence 'The quick brown fox jumps over' and generates a hidden state vector for each word. The vectors are indexed starting from 1, so the vector for 'The' is represented as , for 'quick' as , and so on. Which of the following correctly represents the sequence of hidden state vectors for the specific phrase 'brown fox jumps'?
Representing a Subsequence of Hidden States
A sequence of hidden state vectors is represented as . This sequence contains a total of ____ vectors.