๐๐ฒ๐๐๐ผ๐ป๐ ๐๐ฒ๐ฎ๐ฟ๐ป๐ฒ๐ฑ ๐๐บ๐ฝ๐ฟ๐ผ๐๐ถ๐ป๐ด ๐๐ผ๐ฑ๐ฒ ๐ฅ๐ฒ๐๐ถ๐ฒ๐๐ ๐๐ถ๐๐ต ๐๐
AI is changing how we review code. We spent five months testing tools like Claude Code, GitHub Copilot, CodeRabbit, and Qodo.
We wanted to improve our process without adding noise. Here is what we learned.
๐ง๐ต๐ฒ ๐ง๐ผ๐ผ๐น๐ ๐ช๐ฒ ๐ง๐ฒ๐๐๐ฒ๐ฑ
- Claude Code: Great for custom workflows. We use custom slash commands and sub-agents to manage context. Running it locally helps reduce noise in GitHub comments.
- GitHub Copilot: It has improved immensely. It now follows our specific team instructions and links to our documentation. It also integrates well with CodeQL.
- CodeRabbit: It is excellent at understanding large codebases. It uses a validation agent to keep the signal-to-noise ratio high.
- Qodo: This tool stands out for regulatory compliance. It flags violations for GDPR and ISO standards automatically.
๐๐ฒ๐ ๐๐ฒ๐ฎ๐ฟ๐ป๐ถ๐ป๐ด๐
- Stop the praise: AI often adds fluff like "Great job!" or "Nice addition." We updated our instructions to remove all compliments. We only want actionable feedback on issues and improvements.
- Use sub-agents: Using agents to explore the codebase in parallel prevents the main context window from getting clogged.
- Continuous improvement: We use Claude to review our last five merged PRs. This helps us find new patterns and update our coding standards automatically.
- Avoid "AI slop": Automated tools can produce low-quality comments. We use specific instructions to ensure the AI acts as a professional reviewer, not a linter.
๐๐ ๐ช๐ถ๐น๐น ๐ก๐ผ๐ ๐ฅ๐ฒ๐ฝ๐น๐ฎ๐ฐ๐ฒ ๐๐๐บ๐ฎ๐ป๐
AI cannot make high-level design decisions. It cannot discuss complex trade-offs with a teammate.
Instead, AI handles the repetitive checks. This frees you to focus on architecture and logic.
๐ ๐ ๐๐ฑ๐๐ถ๐ฐ๐ฒ
Do not wait. Pick one tool and run a one-month pilot with your team. The worst case is you turn it off. The best case is your team becomes augmented and your code quality improves.
How are you handling AI noise in your PRs?
Source: https://dev.to/bolt04/lessons-learned-improving-code-reviews-with-ai-1c00
Optional learning community: https://t.me/GyaanSetuAi