Improve daily-experiment-report readability with progressive disclosure, quick stats, and visual status cues#34035
Merged
Conversation
Co-authored-by: pelikhan <[email protected]>
Co-authored-by: pelikhan <[email protected]>
Copilot
AI
changed the title
[WIP] Improve daily experiment report with progressive disclosure and visual enhancements
Improve daily-experiment-report readability with progressive disclosure, quick stats, and visual status cues
May 22, 2026
Contributor
There was a problem hiding this comment.
Pull request overview
This PR updates the daily-experiment-report workflow authoring guide to make the generated discussion easier to scan via progressive disclosure (collapsible details), a top-level quick-stats section, and consistent visual/status cues. The PR also includes regenerated workflow lock changes (notably smoke-temporary-id.lock.yml) and a small bot-skip list tweak in ai-moderator.lock.yml.
Changes:
- Add a
min_samplesprogress-bar helper and guidance for surfacing per-variant progress in the report. - Restructure the report template with a “⚡ Quick Stats” section and move verbose per-experiment content into
<details>blocks. - Regenerate/update workflow lock content (setup mechanism + image/version bumps) and adjust
GH_AW_SKIP_BOTSordering/casing.
Show a summary per file
| File | Description |
|---|---|
| .github/workflows/smoke-temporary-id.lock.yml | Regenerated lock workflow with updated setup mechanism (local action via checkout) and updated runtime image/binary versions. |
| .github/workflows/daily-experiment-report.md | Adds progressive-disclosure template updates, quick stats, and a min_samples progress-bar helper + formatting guidance. |
| .github/workflows/ai-moderator.lock.yml | Updates GH_AW_SKIP_BOTS list contents/order (adds case variant). |
Copilot's findings
Tip
Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
- Files reviewed: 3/3 changed files
- Comments generated: 3
| if target <= 0: | ||
| return "░" * width + f" {current}/{target} (N/A)" | ||
| ratio = max(0.0, min(1.0, current / target)) | ||
| filled = int(round(ratio * width)) |
Comment on lines
+472
to
+474
| > **Status**: 🟢 READY / 🟡 COLLECTING / 🔴 FAILED | ||
| > **Variants**: `<v1>` vs `<v2>` · **Window**: last 30 runs · **Analysed**: N runs with artifacts | ||
| > **min_samples**: <min_samples> per variant | ||
| > **min_samples**: <min_samples> per variant · **Significance**: p = <p-value> |
Comment on lines
+116
to
126
| - name: Checkout actions folder | ||
| uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6.0.2 | ||
| with: | ||
| repository: github/gh-aw | ||
| sparse-checkout: | | ||
| actions | ||
| persist-credentials: false | ||
| - name: Setup Scripts | ||
| id: setup | ||
| uses: github/gh-aw-actions/setup@v0.74.8 | ||
| uses: ./actions/setup | ||
| with: |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This updates
daily-experiment-reportto make output easier to scan: key decisions and health signals stay visible, while verbose statistics/charts move behind expandable sections. It also adds explicit guidance for progress visualization and recommendation framing.Report structure (progressive disclosure)
<details><summary>blocks.Top-level quick signal section
⚡ Quick Statsblock at the top of the report with:Min-sample progress visualization
min_samplesprogress per variant.Visual guidance for consistency
🟢 READY,🟡 COLLECTING,🔴 FAILED), and stronger formatting of recommendations/variant names.