Skip to content

ci: coderabbit - review each PR once, not on every push - #3518

Merged
eleshar merged 1 commit into
developfrom
ci/coderabbit-incremental-3517
Sep 23, 2026
Merged

eleshar merged 1 commit into
developfrom
ci/coderabbit-incremental-3517

Conversation

@eleshar

@eleshar eleshar commented Sep 23, 2026 •

Copy link
Copy Markdown
Contributor

Build/CI Pull Request

Linked issues

Closes #3517

Build/CI change

  • What: sets reviews.auto_review.auto_incremental_review: false in .coderabbit.yml.
  • Why: the key was unset, so it took its schema default of true ("Re-run the review on each push"). The plan allows 1 review an hour, and every push to any open PR used it up. Queued PRs got "Review limit reached" on every attempt.

Baseline & Target

Rollback

  • Plan: revert this PR, or delete the one key.

Notes

  • Validated with check-jsonschema against https://coderabbit.ai/integrations/schema.v2.json: the new config and develop's both pass. The key is at reviews.auto_review.auto_incremental_review, type boolean, default true.
  • Secrets/permissions: none.
  • /code-review and /security-review: no findings.

Changelog

Changed

Summary by CodeRabbit

  • Chores
    • Automated pull request reviews now run once when a pull request is opened. Additional reviews after updates can be requested manually. No end-user-facing product changes are included.

auto_incremental_review defaulted to true, so every push to any open PR
used the plan's 1 review an hour and starved the review queue. New PRs
still get an automatic first review; re-reviews are requested explicitly.
Validated against schema.v2.json.
@eleshar
eleshar requested review from a team and ashleyshaw as code owners September 23, 2026 15:53
@eleshar

eleshar commented Sep 23, 2026

Copy link
Copy Markdown
Contributor Author

@coderabbitai review

@github-actions

Copy link
Copy Markdown
Contributor

PR Template Routing

Branch Type: ci
Scope: coderabbit-incremental-3517
Template: pr_ci.md
Labels Applied: type:ci,area:ci

This PR was automatically routed based on the branch naming strategy.

@coderabbitai

coderabbitai Bot commented Sep 23, 2026 •

Copy link
Copy Markdown
Contributor

Review in Change Stack →

Navigate logical layers of code changes, visualize relationships, and explore their blast radius.

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Repository: lightspeedwp/.github/.coderabbit.yml

Review profile: CHILL

Plan: Advanced

Run ID: ba48baaf-552a-430a-8ae6-34c304090a0a

📥 Commits

Reviewing files that changed from the base of the PR and between 4022476 and 8e5c2e1.

📒 Files selected for processing (2)
  • .coderabbit.yml
  • CHANGELOG.md

Included review availability: Your plan provides up to 1 included review per hour; 0 remain after this review.


📝 Walkthrough

Walkthrough

The configuration disables automatic reviews on each push. The changelog records that automated reviews are limited to one per pull request, with manual requests for re-reviews after fixes.

Changes

Automatic review cadence

Layer / File(s) Summary
Configure review cadence
.coderabbit.yml, CHANGELOG.md
The configuration disables automatic incremental reviews and documents the manual re-review workflow. The changelog records the change to one automated review per pull request.

Estimated code review effort: 2 (Simple) | ~5 minutes

Merge Risk: ⚪ Minimal · up to 8e5c2

Eligible new PRs still receive an automatic review, and later reviews can be requested manually. No actionable merge-blocking impact is established for this cadence change.

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Linked Issues check ✅ Passed Issue #3517 requires reviews.auto_review.auto_incremental_review: false. .coderabbit.yml contains this setting under reviews.auto_review. The existing enabled: true setting remains active, and…
Out of Scope Changes check ✅ Passed The reviewed changes are limited to the CodeRabbit review configuration and a related Unreleased changelog entry. Both changes directly support issue #3517. No unrelated source, workflow, or product b…
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly and concisely describes the main change: CodeRabbit will review each pull request once instead of reviewing it after every push.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@github-actions

Copy link
Copy Markdown
Contributor

📋 Changelog Quality Validation

Metric Count
✅ Passing 86
❌ Failing 10
🆕 New failures in this PR 0
📦 Pre-existing failures 10

Status

✅ Validation PASSED - No new failures introduced by this PR.
Note: 10 pre-existing failure(s) remain in the Unreleased section.

No action required.

@coderabbitai

coderabbitai Bot commented Sep 23, 2026 •

Copy link
Copy Markdown
Contributor
⚠️ Action not completed

Already reviewed the last commit. Use @coderabbitai full review to rerun a review of the entire changeset.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

@eleshar
eleshar merged commit ffc2dc3 into develop Sep 23, 2026
32 checks passed
@eleshar
eleshar deleted the ci/coderabbit-incremental-3517 branch September 23, 2026 16:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ci: CodeRabbit re-reviews every push and starves the review queue

1 participant