Skip to content

Add a metadata-injection mutation to the CLI challenge #29

Description

@Victoria824

Why

The web playground demonstrates untrusted glossary text attempting to disable policy checks. The CLI mutation suite should produce the same release-blocking evidence.

Acceptance criteria

  • Add a deterministic metadata-injection mutation in src/queryassure/challenge.py
  • Treat retrieved descriptions and glossary text as data, never policy instructions
  • Emit a named failure gate and sanitized evidence
  • Add a focused regression test
  • Update the challenge documentation and expected mutation count

The test must not call a live model provider.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions