Survey link: https://malomalsky.github.io/commit-survey-site/
This survey evaluates AI-generated commit messages by comparing them with human-written references.
- 7 comparisons total
- Each item shows two commit messages (A and B) and code diff
- Response options: A / B / Equal / Skip
- Responses are recorded via Google Forms
- Estimated time: 5-7 minutes
- Visit https://malomalsky.github.io/commit-survey-site/
- For each example, compare Option A vs Option B
- Click your preferred option
- Your response will be recorded automatically
- Hosted on GitHub Pages
- Response collection via Google Apps Script
- Blind A/B testing with randomized order