Run agentscan if first-contribution left a comment - #32338
Open
iccir wants to merge 2 commits into
Open
Conversation
1 task
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
PR summary
This PR adds an additional step to the "PR Greetings" workflow: if first-contribution leaves a comment, we then run agentscan and potentially add a label.
automation: mixedautomation: automatedautomation: flaggedWhat is agentscan?
AgentScan is a website, GitHub action, and GitHub app that uses identity to figure out automation patterns. See https://agentscan.tools/adopters for a list of other projects using it (notably: node.js).
I found the website a few days ago and have been reviewing previously-closed PRs with it. It seems to do a very good job of detecting automated activity. The website provides graphs of authors' recent history.
Approach
My first idea was to make a new workflow that would run when the
first-contributorlabel was applied. Based on yesterday's meeting comments regarding the PR Template checker, I'm not sure if this will work.Instead, I check the
comment-urloutput of thefirst-contributionaction. This should be an empty string if no comment was left. This adds an additionalcontents: readpermission to the job thatfirst-contributiondoesn't need. I'm not sure if there is a better way to isolate permissions.Only labels are added to help triage. While agentscan has other features, I didn't want it to automatically close PRs or make comments.
This is my first time using GitHub workflows, I probably made mistakes. Please scrutinize.
Open questions for discussion:
Follow-up Work
If this is approved, we will need to add the corresponding GitHub labels prior to merging.
AI Disclosure
PR quality check