Feature/community tested command#1230
Feature/community tested command#1230sudorishabh wants to merge 13 commits intoRocketChat:developfrom
Conversation
Adds .github/workflows/pr-community-tested.yml with the issue_comment trigger (created only), PR-only job guard, and least-privilege permissions (issues: write, pull-requests: write). The script step is a placeholder for the counting and labeling logic added in subsequent commits.
…g Fetches the PR author and all conversation comments on each /tested trigger. Builds a deduplicated Set of non-author, non-bot logins whose comment body is exactly '/tested'. Applies the community-tested label once 2 unique testers are recorded; addLabels is idempotent so re-running never causes issues.
…ummary Reacts with +1 (👍) on a valid /tested comment and eyes (👀) when the comment is ignored (author self-test or not exact match). Writes a progress table to the Actions step summary so maintainers can see tester status without any new PR thread noise.
…ned Before applying the community-tested label, the workflow now checks whether it exists and creates it (color #0075ca, with description) if not. This removes any need for manual repo setup — the first qualifying PR triggers label creation automatically.
… Compare trimmed comment bodies case-insensitively when counting testers and when deciding +1 vs eyes reactions, so /Tested and /TESTED match the command once the workflow has started.
|
There's a minor change planned. Instead of any 2 people, we'll go something like this: Only a person with at least 1 merged PR in EmbeddedChat, and who is not the author of the current PR, can run this command. Then it will mark it as community-tested and ask to upload a demo video for the testing. After that, as many people write /tested, it will count them and show a confidence score of how many people have tested it. |
|
working on this. |
|
Please review it, @Spiral-Memory |
|
Improved pr-community-tested workflow Previously, any 2 people could mark a PR as tested. Now, only contributors who already have a merged PR in the repo can do it (and not the PR author themselves). If someone tries and doesn't qualify, the bot tells them why. The first person to run /tested triggers the label and gets asked to share a demo video. After that, each additional tester bumps up a confidence score -Low, Medium, or High - shown in a single comment that updates in place rather than spamming the thread. Also fixed a subtle bug where someone who had commented /tested before they were eligible could still get counted later. The bot now keeps its own verified list so only people who actually passed the check at the time they commented are counted. |
ci: add /tested command to apply community-tested label on PRs
Adds a GitHub Actions workflow that lets community members comment /tested on a PR to signal they have verified it locally. Once two unique non-author contributors do so, the community-tested label is automatically applied.
Acceptance Criteria fulfillment
Fixes #1226
What changed
One new file: .github/workflows/pr-community-tested.yml
Design decisions
How to test
Video/Screenshots
PR Test Details
Note: The PR will be ready for live testing at https://rocketchat.github.io/EmbeddedChat/pulls/pr-<pr_number> after approval. Contributors are requested to replace
<pr_number>with the actual PR number.