-
Notifications
You must be signed in to change notification settings - Fork 1k
Open
Labels
observabilityIssues related to observability (metrics, dashboards, alerts, opentelemetry)Issues related to observability (metrics, dashboards, alerts, opentelemetry)project/tasksCoder tasksCoder tasks
Description
As per this ProductBoard entry: https://coder.productboard.com/detail/MTpQbUVudGl0eTowOTVkYWVmMC1lNjkwLTRjZmMtYTI2ZC02YWQ4MDMyMmEwNjA=
πββοΈ Problem / Opportunity
We do not know how many Tasks executed by Coder users are actually completed with a success. It's impossible to guess it with the high level of confidence just by observing the stats.
π Solution: User Story / Epic
- As Coder users, when I terminate / finish the Task I am asked by Coder for my assessment of the outcomes: whether it was a success, a neutral experience or a failure. I can also leave my short comments to help Coder and my admins fine tune the templates.
- As Coder product team we can learn from our real customers about the success rate of the tasks and also receive direct feedback what went wrong in case it did. This helps us fine tune the solution.
- As a Coder Admin I can see the tasks success rate and users' feedback as part of the template insights. This helps me make educated decisions how to configure the templates and/or educate my users in the future.
- As a Coder Admin I can disable the feedback popup per Template in its configuration.
π¨ Solution: Design / Architecture
- Upon the termination of the task, we display a popup message asking for votes about the task quality. See the mockup below.
- The data gets transmitted to Coder via Telemetry mechanisms and can be analyzed but it is also stored internally for the local admins to be able to analyze.
- The popups are displayed by default, but there is an option in template terraform file to disable them.
- Coder Admins can see the success rate as well as the list of comments sorted by the date per Template in the Template Insights report.


Metadata
Metadata
Assignees
Labels
observabilityIssues related to observability (metrics, dashboards, alerts, opentelemetry)Issues related to observability (metrics, dashboards, alerts, opentelemetry)project/tasksCoder tasksCoder tasks