Skip to content

Run fewer CI jobs on pull requests - #1315

Merged
crmne merged 1 commit into
mainfrom
ci-pr-corners
Oct 26, 2026
Merged

crmne merged 1 commit into
mainfrom
ci-pr-corners

Conversation

@crmne

@crmne crmne commented Oct 26, 2026 •

Copy link
Copy Markdown
Owner

The account's 20 hosted runners were full from 11:00 to 16:30 UTC on 2026-10-26, with up to 380 jobs queued. ruby_llm's PR runs are among the heaviest: 17 test jobs, 16 of which run the whole suite a second time with Faraday v1.

  • Pull requests test Ruby 3.2 and 4.0 against Rails 7.1 and 8.1, plus JRuby on Rails 7.1 and the two sandbox jobs: 7 jobs instead of 19. Faraday v1 runs once, on Ruby 3.2 with Rails 7.1.
  • Pushes to main keep every pair, each with Faraday v1, through the new full input on _test-matrix.yml (default true).
  • CodeQL moves from the default setup, which always runs on every push to main, to codeql.yml: pull requests, weekly, and on demand, for the same languages (actions, JavaScript/TypeScript, Ruby). The default setup is already turned off in the repo settings, since GitHub rejects advanced results while it is on.

No status checks are required on main, so the smaller PR matrix can't block merges.

Summary by CodeRabbit

  • Chores
    • Updated automated test runs to cover selected Ruby and Rails combinations for pull requests, with an option to run the full version matrix.
    • Added automated code analysis for pull requests and weekly runs across GitHub Actions, JavaScript/TypeScript, and Ruby.

The account's 20 hosted runners were full for hours with hundreds of
jobs queued. Pull requests now test the oldest and newest Ruby and
Rails plus JRuby, with Faraday v1 on the oldest pair: 7 jobs instead
of 19. Pushes to main keep every pair, each with Faraday v1.

CodeQL moves from the default setup, which runs on every push to
main, to a workflow that runs on pull requests and weekly.
@coderabbitai

coderabbitai Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

No actionable comments were generated in the recent review.

Recent review info
Run configuration
Commits

Reviewing files that changed from the base of the PR and between 35eb0e8 and 4673d77.

Files selected for processing: 3
  • .github/workflows/_test-matrix.yml
  • .github/workflows/codeql.yml
  • .github/workflows/pr.yml

Included review availability: This review used your included allowance. Your plan provides up to 8 included reviews per hour; 7 remain after this review.

Walkthrough

The pull request adds an input to select test-matrix breadth and Faraday v1 coverage, configures pull-request testing to use the reduced matrix, and adds a CodeQL workflow for Actions, JavaScript/TypeScript, and Ruby.

Changes: Test matrix selection

Layer / File(s) Summary
Configure and apply test-matrix selection
.github/workflows/_test-matrix.yml, .github/workflows/pr.yml
The reusable workflow adds a full input that defaults to true. When false, it selects Ruby 3.2, 4.0, and JRuby with Rails 7.1 and 8.1, and runs Faraday v1 only for Ruby 3.2 with Rails 7.1. The pull-request workflow sets full to false.

CodeQL analysis

Layer / File(s) Summary
Configure and run CodeQL analysis
.github/workflows/codeql.yml
The workflow runs on pull requests targeting main, on a weekly schedule, and on manual dispatch. It defines read-only workflow-level contents permission and concurrency control. Its analysis job uses a language matrix for Actions, JavaScript/TypeScript, and Ruby, then checks out the repository, initializes CodeQL, and analyzes results.

Priority: Normal

Estimated code review effort: 2 (Simple) | ~12 minutes

Change: Other

Sequence Diagram(s)

sequenceDiagram
  participant Runner as GitHub Actions runner
  participant Checkout as actions/checkout
  participant CodeQL as CodeQL action
  Runner->>Checkout: Check out repository
  Runner->>CodeQL: Initialize analysis for matrix language
  Runner->>CodeQL: Analyze results with language category
Loading
Merge Risk: Minimal · up to 4673d

The CI changes are mergeable after normal checks; no actionable issue remains.

Pre-merge checks: Passed 6 · Failed 1

Failed Failed checks: 1 warning

Check name Status Explanation Resolution
Description check Warning The description clearly explains the matrix reduction, retained full runs on pushes, CodeQL changes, and the reason for the change. However, it omits the required template sections for type of change,… Update the description to include all template headings and complete the applicable checkboxes, including the change type, scope, testing and quality checks, ownership confirmation, and API changes. Mark non-applicable items explicitly.
Passed Passed checks: 6 passed
Check name Status Explanation
Title check Passed The title clearly and concisely describes the main change: reducing CI jobs on pull requests.
Docstring Coverage Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Review Evidence Stays Out Of The Repository Passed The pull request changes only three workflow YAML files: .github/workflows/_test-matrix.yml, .github/workflows/codeql.yml, and .github/workflows/pr.yml. It adds no screenshots, captures, compari…
Dependencies From Sources The Maintainer Controls Passed The pull request changes only GitHub Actions workflow files. It adds workflow action references, but it does not modify a manifest, lockfile, or package manager configuration. No git URL, fork depende…
Full details: Docstring Coverage

Explanation

No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0 files. (3 skipped: 3 unsupported.)

Full details: Review Evidence Stays Out Of The Repository

Explanation

The pull request changes only three workflow YAML files: .github/workflows/_test-matrix.yml, .github/workflows/codeql.yml, and .github/workflows/pr.yml. It adds no screenshots, captures, comparison pages, recordings, or other review-evidence files.

Full details: Dependencies From Sources The Maintainer Controls

Explanation

The pull request changes only GitHub Actions workflow files. It adds workflow action references, but it does not modify a manifest, lockfile, or package manager configuration. No git URL, fork dependency, patch, override, replace entry, or alternate package registry is introduced.

Full details: Description check

Explanation

The description clearly explains the matrix reduction, retained full runs on pushes, CodeQL changes, and the reason for the change. However, it omits the required template sections for type of change, scope checks, quality checks, ownership, and API changes.

Resolution

Update the description to include all template headings and complete the applicable checkboxes, including the change type, scope, testing and quality checks, ownership confirmation, and API changes. Mark non-applicable items explicitly.

Finishing Touches
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@crmne
crmne merged commit daf10f2 into main Oct 26, 2026
19 checks passed
@crmne
crmne deleted the ci-pr-corners branch October 26, 2026 21:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant