Stars
fanshiqing / grouped_gemm
Forked from tgale96/grouped_gemmPyTorch bindings for CUTLASS grouped GEMM.
LAVIS - A One-stop Library for Language-Vision Intelligence
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga…
Robust Speech Recognition via Large-Scale Weak Supervision
An Open Source text-to-speech system built by inverting Whisper.
Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)
State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.
Open weights LLM from Google DeepMind.
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…
SGLang is a fast serving framework for large language models and vision language models.
Code and example data for the paper: Rule Based Rewards for Language Model Safety
A simple and well styled PPO implementation. Based on my Medium series: https://medium.com/@eyyu/coding-ppo-from-scratch-with-pytorch-part-1-4-613dfc1b14c8.
An educational resource to help anyone learn deep reinforcement learning.
Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
OpenAI Baselines: high-quality implementations of reinforcement learning algorithms
Example models using DeepSpeed
LLM Inference analyzer for different hardware platforms
An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.
Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表，主要面向基础大模型评测，旨在探求生成式AI的技术边界.