LLM Test Server

About this product

LLM Test Server is a local, deterministic stand-in for 13 LLM provider APIs. Your app keeps its official SDK and points it at namespaced routes like /openai/v1; answers, tool calls, streams and failures come from fixtures your test sets up. The dashboard shows where every token goes: system prompt, tool schemas, conversation turns, prompt-cache reads and writes. Built forNET and Aspire, and shipped as a Docker image so any stack can use it. Free and open source.

Keywords