Implementation for MatMul-free LM.
-
Updated
Jun 27, 2024 - Python
Implementation for MatMul-free LM.
[NeurIPS 2021 Spotlight] & [IJCV 2024] SOFT: Softmax-free Transformer with Linear Complexity
Polynormer: Polynomial-Expressive Graph Transformer in Linear Time
This repo contains the source code of the first deep learning-base singing voice beat tracking system. It leverages WavLM and DistilHuBERT pre-trained speech models to create vocal embeddings and trains linear multi-head self-attention layers on top of them to extract vocal beat activations. Then, it uses HMM decoder to infer signing beats and t…
A place for code to relax in happiness without the pressure of maintenance. Mostly related to Machine Learning and Deep Learning
Add a description, image, and links to the linear-transformer topic page so that developers can more easily learn about it.
To associate your repository with the linear-transformer topic, visit your repo's landing page and select "manage topics."