rotary-positional-embedding

Here are 3 public repositories matching this topic...

liaoyanqing666 / Decoder-only-transformer_Time_Series_Prediction

使用Decoder-only的Transformer进行时序预测，包含SwiGLU和RoPE(Rotary Positional Embedding)，Time series prediction using Decoder-only Transformer, Including SwiGLU and RoPE(Rotary Positional Embedding)

time-series pytorch transformer rope time-series-prediction decoder-only rotary-positional-embedding swiglu

Updated Jan 25, 2024
Python

prajeshshrestha / Llama-2.0-architecture-and-inference-from-scratch-with-PyTorch

Star

pytorch pytorch-implementation kv-cache llama2 grouped-query-attention rotary-positional-embedding

Updated Aug 5, 2024
Python

lucadellalib / llama3

Star

A single-file implementation of LLaMA 3, with support for jitting, KV caching and prompting

python transformers pytorch large-language-models llm grouped-query-attention rotary-positional-embedding llama3

Updated Nov 11, 2024
Python

Improve this page

Add a description, image, and links to the rotary-positional-embedding topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the rotary-positional-embedding topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly