mirror of
https://github.com/kevinveenbirkenbach/computer-playbook.git
synced 2026-11-08 19:56:53 +00:00
kevinveenbirkenbachandClaude Opus 5
7802399001
The first deploy that measured generation rates gave mock/deterministic 4148 tok/s against 70.7 for the fastest real model. That number is the proxy's echo latency, not a rate: a mock returns its declared string without generating anything. Being local, free and 59 times faster, it then won every routing decision, so the alias answered pong to any prompt and the routing probe would have gone green while proving nothing. The exclude list is derived rather than maintained: it is the router's own alias plus every alias whose provider is the mock provider, so a mock declared in services.yml or in a variant is covered without a second place to update. LITELLM_EXCLUDE also becomes a set. It held a single alias and was compared with `not in`, which on a string is a substring test, so a comma-joined list would have silently unranked any model id contained in it. A mock stays routable. With nothing preloaded it is the only model the gateway serves and has to win; it simply no longer wins on a number that is not a model's. Against the rates this deploy measured, the alias moves from mock/deterministic back to qwen2.5:0.5b. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>