8000 Add cuda graphs sizes and make it default. by Narsil · Pull Request #1703 · huggingface/text-generation-inference · GitHub
[go: up one dir, main page]
Skip to content

Add cuda graphs sizes and make it default.#1703

Merged
Narsil merged 3 commits intomainfrom
cuda_graph_default
Apr 4, 2024
Merged

Add cuda graphs sizes and make it default.#1703
Narsil merged 3 commits intomainfrom
cuda_graph_default

Commits

Commits on Apr 4, 2024
0