Repository navigation
Production release inputs: metrics guard image and uncensored model name - #1
Merged
Merged
Conversation
Build the serving image here: Tinfoil's Kimi image plus one file that requires the metrics key on every path under vLLM's /metrics. vLLM's own bearer check does not cover that path, and the shim's only gate for it is Tinfoil's online admin-key validator. - maple_metrics_auth.py: pure ASGI middleware, standard library only, loaded with --middleware. Refuses when no key is configured. - scripts/install_metrics_auth.py: build-time installer that fails if the base image's vLLM is not the build the guard was written against. - Release workflow builds the image, pins its digest on a release-only commit and tags it; the renderer checks the pinned configuration. - Serve the model as kimi-k3-1-pro-uncensored. - Close /v1/messages and /v1/messages/count_tokens again. - EXPERIMENTS.md becomes CHANGES.md and lists every difference from stock. Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
The first build copied the guard correctly but the check imported the source copy beside the installer. Import it in a separate isolated interpreter instead, the way the server will find it. Co-Authored-By: Claude <noreply@anthropic.com>
AnthonyRonning
marked this pull request as ready for review
November 19, 2026 02:16
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changes
First release meant to serve customers (v0.2.0). Engine settings stay as in v0.1.7: 120 vCPUs, three DSpark draft tokens.
maple_metrics_auth.py, loaded with--middleware. It requires theMETRICS_API_KEYbearer on every path under/metricsand passes every other request through untouched. vLLM's own bearer check does not cover/metrics, and the shim's only gate for it is Tinfoil's online admin-key validator.kimi-k3-1-pro-uncensoredin place ofkimi-k3-1-pro./v1/messagesand/v1/messages/count_tokensclosed again. They were opened in v0.1.8 for a benchmark run.inference-deepseek-uncensored.EXPERIMENTS.mdbecomesCHANGES.mdand lists every difference from stock.Why the guard is safe to add
scope,receiveandsendobjects, so streaming and client-disconnect handling are unchanged. A test asserts object identity./metricsrequest is refused.^/metrics(.*)$to Prometheus, so the guard folds repeated slashes and case and matches the prefix.--middlewarehook, its/metricsmount or its guarded-prefix list differ from what the guard was written against.Checks
python3 -m unittest discover -s tests(24 tests): the guard, and that the Dockerfile, configuration and guard agree.python3 render_config.py --check: the template differs from stock v0.0.3 only in the listed entries; a configuration pinned by Tinfoil'supdate_config.pypasses with--require-pinned-image, a tampered one fails.Not verified yet
METRICS_API_KEYreaches the vLLM process environment. It is declared as a container secret besideVLLM_API_KEY, which does. Qualification on the node will show it: no key and wrong key refused, metrics key accepted.🤖 Generated with Claude Code