Route LLM requests to the best model for the task at hand.
-
Updated
Nov 17, 2025 - Jupyter Notebook
#
llm-router
Here are 16 public repositories matching this topic...
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
golang ai amd proxy intel self-hosted nvidia mlx llamacpp llama-cpp vllm llm-inference local-ai ollama llm-proxy lmstudio sglang llm-router llm-routing self-hosted-ai
-
Updated
Nov 15, 2025 - Go
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
self-hosted mlx openai-api llm llamacpp llama-cpp vllm llm-inference localllm localllama llama-server llm-router mlx-lm
-
Updated
Nov 17, 2025 - Go
RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.
arena routing multi-agent multi-agent-systems router-benchmark llm llm-router llm-routing router-evaluation router-leaderboard
-
Updated
Nov 20, 2025 - Python
Fully agentic LLM orchestrator with autonomous decision-making. This agentic system self-discovers models, learns from usage, and adapts routing strategies. Save 67% on API costs through intelligent agentic behavior. Production-ready with monitoring and self-healing.
python machine-learning artificial-intelligence multi-model self-learning cost-optimization openai-api ai-agent llm autonomous-ai gpt-5 claude-ai claude-api ollama gemini-ai llm-router agentic-ai ai-orchestration model-routing
-
Updated
Nov 10, 2025 - Python
Intelligent routing automatically selects the optimal model (GPT-4/Claude/Llama) for each prompt based on complexity. Production-ready with streaming, caching, and A/B testing.
python streaming monitoring api-gateway artificial-intelligence openai ab-testing claude cost-optimization fastapi groq llm langchain llmops gpt-5 anthropic llm-router ai-orchestration
-
Updated
Oct 9, 2025 - Python
Local LLM proxy, DevOps friendly
inference inference-server inference-api openai-api llm openaiapi llamacpp llama-cpp local-llm localllm local-ai llm-proxy llama-api llama-server llm-router language-model-api local-lm local-llm-integration
-
Updated
Nov 20, 2025 - Go
Open-source pipeline for generating and augmenting Arch-Router-style conversational routing datasets.
-
Updated
Oct 27, 2025 - Python
Securing markets of dLLMs (Decentralized LLMs) utilizing cryptographic technologies.
nlp machine-learning ethereum smart-contracts artificial-intelligence mpc cryptoeconomics fhe zkp tokenomics llm llm-router
-
Updated
May 29, 2024
Successfully developed an LLM application that provides AI-powered, structured insights based on user queries. The app features a dynamic response generator with progress indicators, interactive upvote/downvote options, and a clean, engaging user interface built using Streamlit. Ideal for personalized meal, fitness, and health-related advice.
streamlit-webapp openai-api prompt-engineering generative-ai langchain llm-chain llm-application chatopenai llm-router output-parsers llm-router-chain multi-prompt-chain
-
Updated
Mar 27, 2025 - Python
LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).
automation cloud rest-api model-management load-balancing on-prem genai llm-router llm-gateway llm-gateway-system llm-balancing
-
Updated
Nov 19, 2025 - Python
A lightweight AI model router for seamlessly switching between multiple AI providers (OpenAI, Anthropic, Google AI) with unified API interface.
-
Updated
Jun 13, 2025 - Python
Hybrid LLM router: local+cloud models with meta-routing,memory, FastAPI UI, and FAISS; integrates Ollama and OpenAI.
-
Updated
Sep 5, 2025 - Python
A dynamic input-based LLM routing AI-agent built with n8n. It selects the most suitable language model based on user queries, and uses the selected model to answer, solve, or address the input accordingly.
-
Updated
Jun 7, 2025
Improve this page
Add a description, image, and links to the llm-router topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llm-router topic, visit your repo's landing page and select "manage topics."