8000 llm-proxy · GitHub Topics · GitHub

#

llm-proxy

Here are 17 public repositories matching this topic...

katanemo / archgw

The smart edge and AI gateway for agents. Arch is a high-performance proxy server that handles the low-level work in building agents: like applying guardrails, routing prompts to the right agent, and unifying access to LLMs, etc. Natively designed to handle and process prompts, Arch helps you build agents faster.

proxy routing gateway prompt proxy-server openai envoy envoyproxy llms generative-ai llmops llm-inference llm-proxy ai-gateway llm-gateway llm-routing ai-gateway-support

Updated Oct 8, 2025
Rust

thushan / olla

Lightweight & fast AI inference proxy for self-hosted LLMs backends like Ollama, LM Studio and others. Designed for speed, simplicity and local-first deployments.

golang ai proxy self-hosted llamacpp vllm llm-inference ollama llm-proxy lmstudio llm-router llm-routing self-hosted-ai

Updated Oct 9, 2025
Go

starbased-co / ccproxy

Customize and Extend Claude Code with ccproxy: Route to OpenAI, Gemini, Qwen, OpenRouter, and Ollama. Gain full control of your Claude Max/Pro Subscription with your own router.

Updated Oct 8, 2025
Python

PromptSail / prompt_sail

Open Source LLM proxy that transparently captures and logs all interactions with LLM API

llm prompt-tool prompt-engineering prompt-manager prompt-management llm-prompting llm-proxy

Updated Jun 15, 2025
HTML

bluewave-labs / LangRoute

This is a robust and configurable LLM proxy server built with Node.js, Express, and PostgreSQL. It acts as an intermediary between your applications and various Large Language Model (LLM) providers

proxy llm llm-proxy llm-gateway llmproxy

Updated Oct 8, 2025
TypeScript

fabiojbg / LLMApiGateway

A personal LLM gateway with fault-tolerant capabilities for calls to LLM models from any provider with OpenAI-compatible APIs. Advanced features like retry, model sequencing, and body parameter injection are also available. Especially useful to work with AI coders like Cline and RooCode and providers like OpenRouter.

fault-tolerance proxy gateway openai-api llm openrouter llm-proxy llm-gateway roocode cline-ai

Updated Aug 28, 2025
Python

Alorse / llm-proxy

Allows any BYOK AI editor or extension, such as Cursor or Continue, to connect to any openai-compatible LLM by aliasing it as a different model

ai vscode-extension llm llm-proxy cursor-extension

Updated Jul 4, 2025
TypeScript

LM4eu / goinfer

Local LLM proxy, DevOps friendly

inference inference-server inference-api openai-api llm openaiapi llamacpp llama-cpp local-llm localllm local-ai llm-proxy llama-api llama-server llm-router language-model-api local-lm local-llm-integration

Updated Oct 8, 2025
Go

evgensoft / ai-proxy

Proxy for many LLM-provider with OpenAI like request

llm-proxy ai-proxy

Updated Aug 13, 2025
Go

Motlify / gen-ai-proxy

A self-hosted, open-source (Apache 2.0) proxy for LLM's with prometheus metrics

proxy-server llmops llm-proxy

Updated Jul 30, 2025
Go

matdev83 / llm-interactive-proxy

Connect any LLM-powered client app, such as a coding agent, to any supported inference backend/model.

Updated Oct 8, 2025
Python

sven-ai / sven-for-developers

Store your knowledge (privately), lead LLMs with it and cure hallucinations.

tool tooling openai knowledge-base rag openai-api llm openaiapi anthropic chromadb llm-proxy ollama-api open-webui llmapi anthropic-api

Updated Jun 17, 2025
Shell

binbandit / claude-litellm-proxy

A proxy for claude code to use liteLLM

docker streaming typescript ai api-gateway proxy hono claude multi-provider openai-api ai-development llm anthropic genai function-calling llm-proxy litellm tool-calling claude-code

Updated Oct 6, 2025
TypeScript

guyinwonder168 / ai-proxy

AI Proxy Server - A high-performance, secure unified API gateway for multiple LLM providers (OpenAI, Gemini, Groq, OpenRouter, Cloudflare) with intelligent routing, rate limiting, and streaming support. Features modular architecture, enhanced security, and optimized performance.

unified-api llm-proxy ai-proxy openrouter-proxy

Updated Aug 26, 2025
Go

riipandi / sorai

[WIP] Sorai is a lightweight, high-performance, and open-source LLM proxy gateway.

gateway openai llm llmops openai-proxy llm-proxy ai-gateway llm-gateway antrophic mcp-gateway

Updated Jun 24, 2025
Rust

Mj23978 / evogen

A TypeScript wrapper to seamlessly route multiple Vercel AI providers by model name, offering unparalleled flexibility and extensibility for managing diverse AI services—inspired by the provider-routing architecture of litellm but optimized for TypeScript/Vercel workflows

ai openai ollama vercel-ai-sdk llm-proxy litellm

Updated Jul 12, 2025
TypeScript

nguyenvanduocit / aiproxy

llm-proxy ai-proxy

Updated Aug 2, 2024
Go

Improve this page

Add a description, image, and links to the llm-proxy topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-proxy topic, visit your repo's landing page and select "manage topics."

0