LLM API Gateway: OpenRouter, LiteLLM, and Cloudflare
An LLM API gateway puts OpenAI, Anthropic, and Gemini calls in one place. Compare OpenRouter, LiteLLM, and Cloudflare on latency, fallback, cache, and budgets.
litellm
3 posts
When AI Caching Pays Off
An AI API cache hit reuses input-prefix KV, not a stored answer. Which requests hit, the break-even rate after write cost, and agent versus chatbot logs.
Monitoring a LiteLLM Proxy - What the Admin UI Covers, and What Only Grafana and Langfuse Show
Prometheus, Grafana, and Langfuse on a LiteLLM proxy, same mock traffic for 14 minutes. What the Admin UI shows, and when to add the other two.