10000 Infini-AI-Lab · GitHub
[go: up one dir, main page]

Skip to content
@Infini-AI-Lab

Infini-AI-Lab

Next Generation AI algorithms and systems

Popular repositories Loading

  1. Sequoia Sequoia Public

    scalable and robust tree-based speculative decoding algorithm

    Python 350 37

  2. TriForce TriForce Public

    [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

    Python 259 17

  3. MagicPIG MagicPIG Public

    [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

    Python 228 16

  4. MagicDec MagicDec Public

    [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding

    Python 122 9

  5. UMbreLLa UMbreLLa Public

    LLM Inference on consumer devices

    Python 121 15

  6. Multiverse Multiverse Public

    Python 76 9

Repositories

Showing 10 of 23 repositories

Top languages

Loading…

Most used topics

Loading…

0