Submitter Metrics quantify how submitters are responding to comments, engaging in discussion, and incorporating suggestions. Submitter metrics are:
Responsiveness is the average time it takes to respond to a comment with either another comment or a code revision;
Comments addressed is the percentage of Reviewer comments that were responded to with a comment or a code revision;
Receptiveness is the ratio of follow-on commits to comments. It’s important to remember that Receptiveness is a ‘goldilocks’ metric—you’d never expect this metric to go up to 100%, and if you did it’d be indicative of a fairly unhealthy dynamic where every single comment lead to a change;
Unreviewed PRs is the percentage of PRs submitted that had no comments.
Reviewer Metrics provide a gauge for whether reviewers are providing thoughtful, timely feedback. Reviewer metrics are:
Reaction time is the average time it took to respond to a comment;
Involvement is the percentage of PRs a reviewer participated in. It’s important to note that this metric is a highly context-based metric. At an individual or team level, “higher” is not necessarily better as it can point to a behavior where people are overly-involved in the review process, but there are certain situations where you’d expect to see Involvement very high, sometimes from a particular person on the team and other times from a group that’s working on a specific project;
Influence is the ratio of follow-on commits to comments made in PRs;
Review coverage represents the percentage of PRs reviewed.
Comment metrics are:
Robust comments are comments that have a length over 200 characters;
Regular comments are comments that span between 100-200 characters;
Trivial comments are comments that have under 100 characters.
Sharing Index metrics are:
PRs is the total number of PRs that were reviewed;
Sharing Index measures how broadly information is being shared amongst a team by looking at who is reviewing whose PRs;
Active Reviewers is the count of active users who actually reviewed a PR in the selected time period;
Submitters is the total number of users who submitted a PR in the selected time period.
There are six metrics that comprise the PR Resolution report:
Time to Resolve is the average time it takes to close a Pull Request;
Time to First Comment is the average time between when a Pull Request is opened and the time the first Reviewer comments;
Follow-on Commits is the average number of code revisions once a Pull Request is opened for review;
Reviewers is the average number of reviewers per Pull Request;
Reviewer Comments is the average number of reviewer comments per Pull Request;
Avg. Comments per Reviewer is the average number of comments per Reviewer.