From 984ca3d3834f738b527efdccfefc91ad6a39bc90 Mon Sep 17 00:00:00 2001 From: Vuong Hoang Date: Tue, 16 Jun 2026 01:40:30 -0700 Subject: [PATCH] feat(tools): single-file gateway chat playground MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Zero-dependency, zero-backend HTML chat UI for the LiteLLM gateway. The browser talks straight to :4000 (gateway CORS is open), so it's just one file you open — no container, no stack. System-prompt textarea, model datalist, streaming SSE, renders reasoning_content for the -thinking/ -reasoning models, settings persist in localStorage. Deliberately never sends a `tools` field, sidestepping the vLLM "tools must not be an empty array" bug that breaks the LiteLLM admin UI playground for vLLM-backed models (litellm #6228; the gateway's strip_empty_tools hook can't reach the UI's in-process completion call). Verified against the live gateway: streams + parses a real completion with no tools sent. --- tools/gateway-chat.html | 156 ++++++++++++++++++++++++++++++++++++++++ 1 file changed, 156 insertions(+) create mode 100644 tools/gateway-chat.html diff --git a/tools/gateway-chat.html b/tools/gateway-chat.html new file mode 100644 index 0000000..2ef4482 --- /dev/null +++ b/tools/gateway-chat.html @@ -0,0 +1,156 @@ + + + + + +Gateway Chat — light LiteLLM playground + + + + + +
+
+
+ + + +
+
+ + +