telemetry: cut perf-devnet-3 edge logs over to Vector→OTLP, drop Loki#46
Open
samcm wants to merge 1 commit into
Open
telemetry: cut perf-devnet-3 edge logs over to Vector→OTLP, drop Loki#46samcm wants to merge 1 commit into
samcm wants to merge 1 commit into
Conversation
Replace the Loki log sink (and the hand-added otelcol-contrib experiment) with Vector's OTLP logs pipeline to the prod analytics gateway, matching the cutover already shipped on blob/bal/glamsterdam-devnets. Log level is parsed into OTel severity at ingest. Ingress identity (auth user + ingress_user tag) is derived from ethereum_network_name instead of secret_loki.username, so attribution stays correct regardless of the sops username. Bump Vector to 0.56.0 (keeping the docker.ethquokkaops.io/dh mirror prefix). otelcol_contrib_cleanup is left true so deploying this removes the currently-running otelcol container (these nodes have it live). Once a deploy confirms otelcol is gone, the otelcol_contrib role can be dropped from the playbook as a follow-up (as done for the other devnets).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Cuts perf-devnet-3 edge log shipping off Loki onto Vector's OTLP logs pipeline to the prod analytics gateway (clickhouse-raw
external.otel_logs), matching the cutover already live on blob/bal/glamsterdam-devnets.docker_logs→ OTLP/v1/logs, log level parsed into OTel severity at ingestingress_usertag) =ethereum_network_name(perf-devnet-3), not the sops usernamedocker.ethquokkaops.io/dh/mirror prefix)--tags otelcol,vector(Vector container restart only)otelcol_contrib_cleanup: trueis kept so the deploy removes the currently-running hand-added otelcol on these nodes. Follow-up once confirmed: drop theotelcol_contribrole from the playbook (as done for the other devnets).Heads-up for whoever runs perf-devnet-3: the committed
devnet-3inventory.ini currently lists only the bootnode — please make sure it reflects the live hosts (the cluster's other nodes appear under the staledevnet-2inventory) before rolling, and deploy one node at a time. Config-only PR; not deployed.