8000 GitHub - SharathHebbar/Transformers: Transformers Intuition
[go: up one dir, main page]
Skip to content

SharathHebbar/Transformers

BranchesTags

Repository files navigation

Transformers (Attention is all you need)

Context

Articles

Repository Contents

Types

  1. Encoder Only Models
  2. Decoder Only Models
  3. Encoder-Decoder Models

Codes

  1. Tokenizer
  2. Word Embedding
  3. Semantic Search
  4. Tokenization Positional_Encoding Self Attention
  5. Extractive QnA with BERT
  6. Instruction following using GPT
  7. Product Review using T5
  8. Decoder Only Model
  9. Fill-Mask Encoder Only Model
  10. Sentiment Analysis Encoder Only Model
  11. Encoder-Decoder Model

Theory Stuffs

  1. Hand-written Notes
  2. Hyperparameters
  3. Basics
  4. Attention is all you need from scratch *WIP

About

Transformers Intuition

medium.com/@sharathhebbar24/transformers-an-intution-3ef6ef3b15f5

Topics

transformers embeddings semantic-similarity sequence-to-sequence tokenization attention-is-all-you-need encoder-decoder-model encoder-model decoder-model masked-language-models causal-language-modeling

Resources

Readme
Activity

Stars

6 stars

Watchers

2 watching

Forks

1 fork
Report repository

Releases

No releases published

Packages

No packages published

Languages
0