kevinveenbirkenbachandClaude Opus 5 e4bb6ec30d feat(ci): answer the AI consumers from a deterministic mock, load real models only where they are proven ...

Every AI consumer asks for LITELLM_CHAT_MODEL, so a CI round paid CPU inference for tests that only check wiring. This follows the shape svc-net-tor already uses: variant 0 runs the whole logic against chutney, variant 1 against the public network.

A mock is an ordinary remote_models entry with provider mock rather than a config key of its own, because that list already means 'an alias and a way to call it' and a mock needs no key. AI_AGENT_MODEL prefers it so the agent broker stays deterministic in every round, including the ones where the consumers get a real model.

The preload switch lives in svc-ai-ollama's variants, not in the gateway's. The gateway's services.ollama is a bare consumer flag carrying bond, enabled and shared; a preload_models key there would have been silently inert and the models would have downloaded anyway.

Variant 0 keeps every backend enabled and empties its preloads instead of disabling it, because variant 0 must stay the maximal closure - and because tor does not disable its service either, it changes the flavor.

Production is untouched: with no mock declared the chain resolves exactly as before, which is asserted rather than assumed.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

2026-09-23 15:58:39 +02:00

..

cli

feat(ci-trigger): state the selection and its axes, and refuse one that cannot deploy

2026-09-23 11:56:24 +02:00

group_vars

feat(ci): answer the AI consumers from a deterministic mock, load real models only where they are proven

2026-09-23 15:58:39 +02:00

library

…

plugins

refactor(svc-ai-litellm): build the model routes once instead of a loop per source

2026-09-23 15:57:14 +02:00

roles

refactor(svc-ai-litellm): build the model routes once instead of a loop per source

2026-09-23 15:57:14 +02:00

scripts

fix(diagnostics): let the in-zone probes read the drop-in that holds the zone

2026-09-03 12:50:58 +02:00

utils

feat(ci): deploy only the variants a change reaches

2026-09-21 22:51:03 +02:00

__init__.py

…