Skip to content

Improve Semaphore test report grouping and summaries - #3291

Merged
sosnovsky merged 7 commits into
masterfrom
issue_3290_improve_semaphore_ci_tests_summary
Sep 24, 2026
Merged

sosnovsky merged 7 commits into
masterfrom
issue_3290_improve_semaphore_ci_tests_summary

Conversation

@DenBond7

@DenBond7 DenBond7 commented Sep 22, 2026 •

Copy link
Copy Markdown
Collaborator

Problem

Semaphore published each test job under its full job name. This split instrumentation results across matrix shards and prevented tests from the same class from being grouped together.

The generated reports were also unavailable to Semaphore MCP, and the workflow Report tab remained empty.

Changes

  • Group all instrumentation results under a stable Instrumentation tests report name.
  • Keep unit tests in a separate JUnit tests group.
  • Generate MCP-optimized summaries for job and pipeline reports.
  • Generate a workflow Markdown report containing:
    • overall test status and counters;
    • statistics by test group;
    • failed and errored tests;
    • the 10 slowest tests;
    • branch and commit information.
  • Publish the Markdown report as .semaphore/REPORT.md.

Closes #3290


Tests (delete all except exactly one):

  • Does not need tests (refactor only, docs or internal changes)

To be filled by reviewers

I have reviewed that this PR... (tick whichever items you personally focused on during this review):

  • addresses the issue it closes (if any)
  • code is readable and understandable
  • is accompanied with tests, or tests are not needed
  • is free of vulnerabilities

@DenBond7 DenBond7 changed the title Fix Semaphore test report grouping for MCP Improve Semaphore test report grouping and summaries Sep 22, 2026
@DenBond7
DenBond7 marked this pull request as ready for review September 23, 2026 15:38
@DenBond7
DenBond7 requested a review from sosnovsky as a code owner September 23, 2026 15:38

@sosnovsky sosnovsky left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice improvement 👍

@sosnovsky
sosnovsky merged commit 1646c88 into master Sep 24, 2026
7 checks passed
@sosnovsky
sosnovsky deleted the issue_3290_improve_semaphore_ci_tests_summary branch September 24, 2026 11:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Improve Semaphore CI tests summary

2 participants