HyperAIHyperAI

Command Palette

Search for a command to run...

Rotary Positional Embeddings (RoPE)

Date

3 years ago

Size

12.68 MB

RoPE was proposed by Su Jianlin and others. It is an absolute position encoding. Its basic idea is to enable the model to pay attention to relative positions through absolute position encoding.

Notebook Preview

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing

HyperAI Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp