LLM Gateway

connecting…
Gateway URL:
Queue Status

Queue Depth by Status

Vendor Slots

Throughput (last 10 min)

Errors — Last 24h

AI Usage & Cost
Total Calls
--
Total Tokens
--
Est. Cost
--
Success Rate
--

By Vendor / Model / Service

Vendor Model Service Calls In ✦=cache Out Est. Cost
Loading…

Daily Cost & Tokens (14 days)

Diagnostics

Vendor Connectivity

Click a vendor to test:

Schema Validator Test

Recent Requests

LLM Queue — Last 50

Status Vendor Model Service Operation User Priority Retries Queued At Started At
Loading…
Log Viewer

Gateway Logs

Loading logs…