Skip to content

docs(benchmarks): add benchmarking guide, scenario diagrams, and stakeholder landing page - #71

Merged
JLCode-tech merged 2 commits into
stagingfrom
fix/forge-agent-token
Oct 6, 2026
Merged

JLCode-tech merged 2 commits into
stagingfrom
fix/forge-agent-token

Conversation

@JLCode-tech

Copy link
Copy Markdown
Owner

Summary

This PR overhauls the documentation to provide an executive and technical landing page for enterprise customers, F5 internal engineers, and field sales teams, with dedicated architecture diagrams for all 15 validation scenarios and 5 curated walkthrough demos (including the AgentCore AI tool governance demo). It also introduces a dedicated AI inference benchmarking guide and integrates the Forge agent-bound token runner.

Key Changes

  1. Root Landing Page (README.md):

    • Added Stakeholder Value Matrix for Enterprise Platform/Network Engineers, Cloud/AI Architects, Solutions Architects/SEs, and Sales Leadership.
    • Added GitHub-native Mermaid architecture diagrams for System & Network Topology, Multi-Proxy Benchmarking Shootout, and the AgentCore AI tool call governance demo.
    • Comprehensive overviews of the 15 validation scenarios, 5 walkthrough demos, and pinned ecosystem versions.
  2. AI Inference Benchmarking Guide (docs/BENCHMARKS.md):

    • Comprehensive guide for aiperf benchmarking within the isolated VPC data plane.
    • Architectural flowcharts covering Operator Workstation $\leftrightarrow$ Forge WebSocket $\leftrightarrow$ AWS EICE SSH $\leftrightarrow$ in-VPC Jumphost $\leftrightarrow$ TMM VIP $\leftrightarrow$ vLLM/SageMaker GPU backends.
    • Full documentation for all 4 smoke presets (latency, throughput, long-context, streaming), 8 synthetic Forge scenarios, and open-loop trace replay (mooncake).
    • Multi-proxy shootout walkthrough comparing F5 BNK against Envoy, HAProxy, and NGINX.
    • Prometheus scrape integration and regression testing with benchmark ingest --expect-ttft-drop.
  3. Scenario & Demo Architecture Diagrams (docs/SCENARIOS.md):

    • Added dedicated Mermaid diagrams for every single one of the 15 validation scenarios.
    • Added dedicated architecture diagrams for 5 curated demos: agentcore-demo (Bedrock AgentCore + MCP tool governance), diameter (RFC 6733 CER/CEA), http2 (h2c multiplexing), bigip-cis (coexistence with external BIG-IP VE), and ingress-migration (simultaneous 3-way ingress migration).
    • Documented external VIP allocation map (.100–.254).
  4. Forge Agent Token & Security Fixes:

    • Uses an agent-bound token for the benchmark agent and ensures clean failure upon auth rejection.
    • Annotates false-positive credentials and file path findings for gosec.

Verification

  • gofmt -l internal cmd: 0 diffs
  • make lint (go vet + staticcheck): Clean (0 errors)
  • npx cspell: 11/11 markdown files clean (0 issues)
  • AWSBNKCTL_SKIP_AUTH=1 go run ./cmd/awsbnkctl up -f examples/full-cluster/cluster.yaml --dry-run: Passed (exit 0)
  • AWSBNKCTL_SKIP_AUTH=1 go run ./cmd/awsbnkctl down -f examples/full-cluster/cluster.yaml --dry-run: Passed (exit 0)
  • go test -short ./...: 100% green

@JLCode-tech
JLCode-tech force-pushed the fix/forge-agent-token branch from 54179c1 to a96451b Compare October 6, 2026 03:39
@JLCode-tech
JLCode-tech merged commit a34c11b into staging Oct 6, 2026
13 checks passed
@JLCode-tech
JLCode-tech deleted the fix/forge-agent-token branch October 6, 2026 03:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant