Definition of C(x, tθ) Notation for Rotated Tokens
In the context of Rotary Positional Embeddings (RoPE), the notation is used as a shorthand to represent a token's embedding after it has been rotated by an angle . This notation encapsulates the result of the complex multiplication , where is the complex number form of the vector .
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Formula for Applying RoPE Rotation 't' Times
Component-wise Vector Rotation in Complex Space
A 2D vector (x, y) can be represented by the complex number z = x + iy. To rotate this vector by an angle θ, it is multiplied by the complex number e^(iθ) = cos(θ) + i sin(θ). If the vector (3, 4) is rotated by 90 degrees (π/2 radians) using this method, what are the coordinates of the new, rotated vector?
A 2D vector can be rotated by representing it as a complex number and multiplying it by another complex number that represents the rotation. Arrange the following steps in the correct logical order to derive the coordinates of a vector
(x₁, x₂)after it has been rotated by an angleθ.Mapping Complex Multiplication to Rotated Vector Components
Learn After
Inner Product of RoPE-Encoded Token Representations
In the context of positional embeddings, the notation represents the result of rotating a 2-dimensional vector by an angle . If the initial vector is and the rotation angle is , what is the resulting vector?
The notation is a shorthand for rotating a 2-dimensional vector by an angle . This operation is equivalent to representing the vector as a complex number and multiplying it by . Based on this, which expression correctly represents the first component of the resulting rotated vector?
The transformation represented by the notation , which rotates a 2-dimensional vector by an angle , changes the magnitude (or length) of the original vector .