Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
machine-learning deployment inference pytorch artificial-intelligence llama whisper gemma mistral openai-api llm flan-t5 chatglm llamacpp vllm ggml wizardlm qwen llama3 glm4
-
Updated
Nov 24, 2025 - Python