Releases: microsoft/Power-CAT-Copilot-Studio-Kit
Releases · microsoft/Power-CAT-Copilot-Studio-Kit
Copilot Studio Kit December 2025
Changes
- Agent Review Tool has improved UI and engine.
- SharePoint File Sync now supports syncing over 500 files
- Conversation KPI: Corrected display where Conversation ID appeared as “deflection”
- Agent Review Tool: Improved load performance for review details
- Agent Inventory: AI Prompts recognized as Tools
- Agent Inventory: Web Search available in inventory
- Agent Value Summary: Corrected summary number inconsistencies
- Usage performance improvements within Agent Inventory
- Localization updates for Side Navigation.
- Setup Wizard: Dropdown control for Boolean values (replaces free-text field)
- Agent Inventory: Console error fix (#445)
- Sync Agent: Button state logic fixed (#459)
- Conversation KPI: Transcript merging updated to respect new inactivity thresholds
Github issues fixed (improvements and issues):
- Generative Answer Failure #433
- Inventory Data Question Handling #453
- Agent Review Tool slow loading #269
- Conversation KPI “deflection” ID issue #345
- Web Search in Inventory #439
- Web Search in Inventory #450
- Tools not detected in Inventory #441
- Agent Inventory Console Error #445
- Sync Agent button disabled #459
- Agent Value Summary number oddities #480
- Hard-coded AdminAlias in "Agent Compliance | Quarantine" flow #461
- Compliance Hub Threshold Configs – Support Additional Filter Operators #466
- Bing Usage Field / Bing Usage Compliance Threshold and Email #439
- Compliance Hub – Don't add users to Maker group #442
First Time Setup Instructions
Upgrade Instructions
Copilot Studio Kit October 2025
Changes
Compliance Hub - Customizable agent compliance review process leveraging information in the Agent Inventory- Separate landing pages for administrators and makers - simplified roles with increased data segregation for makers
- Historical agent usage information in agent details view
- Agent configuration cloning
- Conversation Analyzer prompt management improvements, improved conversation selection
- Validation for tracked variables for Conversation KPIs
- Secret masking in e.g. agent configuration view
- Complete agent response in test results show all messages received from the agent
- Adaptive card actions support for Microsoft Authentication
- Knowledge support in Plan Validation
Issues fixed:
First Time Setup Instructions
Upgrade Instructions
Copilot Studio Kit September 2025
Changes
- Added support for Microsoft Authentication in test automation
- Custom agent usage data now available in Agent Inventory (optional solution distributed separately)
- Added support for Adaptive Card actions in test automation
- Test run results now include cost information for generative answers testing and adaptive card AI validation (AI Builder credits)
Issues fixed:
#250 - The Flow "Global | Get Current Dataverse Url" fails to run
#278 - Environment Default-xxxxxxxxxx cannot be linked
#249 - Invalid Operation - Division by Zero Error
First Time Setup Instructions
Upgrade Instructions
Copilot Studio Kit July 2025
Changes
- Plan validation for custom agents with generative orchestration enabled - evaluate if expected tools were used in the dynamic plan
- Adaptive card testing using comparison operators - maker can define string comparison operator to be used in the test case
- Adaptive card testing using AI - maker can provide validation instructions that are used to validate adaptive card with custom prompt
- SharePoint synchronization configuration validation
- Test case cloning - simplifies and accelerates the process of creating variations of the same test case
- Key vault support for user authentication secret in agent configuration
- Agent Value Summary dashboard - agents in Agent Inventory are classified based on their type, behavior and value benefit
Issues fixed:
- Scheduled tests / Trigger events
- Make KPI Tiles Clickable for Drill-Through Filtering in Agent Inventory
- Error while using Setup Wizard in Copilot Studio Kit
First Time Setup Instructions
Upgrade Instructions
Copilot Studio Kit May 2025
Changes
- Setup Wizard - Guided post-deployment configuration steps
- Agent Inventory V2 - Added new fields
- Multi-topic match for test automation - For testing custom agents with generative orchestration
- Conversation Analyzer (Preview) - Leverages AI to analyze conversation transcripts using preconfigured or custom prompts
Issues fixed:
- Unable to sync files across environments #190
- Multi-Turn - Test Result Shows Success When a Critical Step Fails #165
- Conversation KPIs Dashboard issue - SessionID is not unique in "Session Details" table #118
- Transcript WebChat control empty in Conversation KPIs part of the app #120
- Pagination Missing in File Sync Flow #168
- Error Authentication with Entra instead of Manual #180
First Time Setup Instructions
Upgrade Instructions
Copilot Studio Accelerator April 2025
Changes
- Multi-turn support for test automation
- New string comparison operators for Response Match test type
- Floating widget sample in Webchat Playground
- Agent Inventory (Preview)
- Agent Review Tool
- Issue #92 fixed
First Time Setup Instructions
Upgrade Instructions
Copilot Studio Accelerator March 2025
Changes
- Finished the improvements on the token handling mechanism for testing authenticated custom agents.
- Re-enabled the testing of authenticated custom agents.
Issues fixed
- Test run results now show the test case information at the time of test run execution #56
- Removed the delay between batches - was causing issues with certain SKUs #90
- Configurable delay for test cases #91
Note
Testing of authenticated custom agents requires channel security to be enabled.
First Time Setup Instructions
Upgrade Instructions
Copilot Studio Kit February 2025
Changes
- Added Webchat Playground - easy-to-use UI to modify the styles of Copilot Studio Webchat
- Added Adaptive Cards Gallery - collection of reusable adaptive card templates demonstrating the extensibility of adaptive cards
- Conversation KPIs no longer in preview - performance optimized and preview limitations lifted
- Moved the feature details from landing page into their own pages
- Copilot Studio Kit is using components from Creator Kit, please check installation instructions for setup info
Note
We are working on improvements to the test logic of authenticated bots and have temporarily disabled the feature, until we finish with the improvements.
First Time Setup Instructions
Upgrade Instructions
Copilot Studio Accelerator February 2025
Changes
- Added Webchat Playground - easy-to-use UI to modify the styles of Copilot Studio Webchat
- Added Adaptive Cards Gallery - collection of reusable adaptive card templates demonstrating the extensibility of adaptive cards
- Conversation KPIs no longer in preview - performance optimized and preview limitations lifted
- Moved the feature details from landing page into their own pages
- Copilot Studio Kit is using components from Creator Kit, please check installation instructions for setup info
Note
We are working on improvements to the test logic of authenticated bots and have temporarily disabled the feature, until we finish with the improvements.
First Time Setup Instructions
Upgrade Instructions
Copilot Studio Accelerator December 2024
Changes
- Updated SharePoint synchronization to include pages and filters.
- Added Prompt Advisor (preview) Ref# #83: Allows makers to develop effective prompts while learning useful prompt engineering skills.
- Bug Fix Ref# #84: Copilot tests are getting error out.