Build software better, together

Projects

ggml-org : tutorials
#6 updated May 14, 2025
ggml : roadmap
#7 updated Apr 16, 2025

Upcoming features and tasks for the ggml core library and related projects (e.g. llama.cpp / whisper.cpp, etc)
github : copilot workspace
#9 updated Mar 7, 2025

Automation via Copilot Workspace

Inactive
ggml : backends
#12 updated Nov 6, 2024

Resources related to the backend component of `ggml`
ggml : numerical optimization
#15 updated Sep 29, 2024

Numerical optimization via automatic differentiation
llama : Hugging Face integration
#11 updated Sep 23, 2024

Functionality related to better HF integration
ggml : RPC backend
#10 updated Sep 9, 2024

Distributed inference over the network
ggml : sub-4-bit integer quantization
#6 updated May 31, 2024

Explore strategies for utilizing 2-bit and 3-bit integer quantization
ggml : improve integer quantization
#2 updated Oct 10, 2023

Make the inference of quantized models faster and more accurate
llama : add LoRA support
#5 updated Apr 17, 2023

Add capabilities for low-rank adaptation of LLaMA models and derivatives

Provide feedback