Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Mechanism and UI for collecting Coder Tasks success rate and feedbackΒ #19757

@bartekgatzcoder

Description

@bartekgatzcoder

As per this ProductBoard entry: https://coder.productboard.com/detail/MTpQbUVudGl0eTowOTVkYWVmMC1lNjkwLTRjZmMtYTI2ZC02YWQ4MDMyMmEwNjA=

πŸ’β€β™‚οΈ Problem / Opportunity
We do not know how many Tasks executed by Coder users are actually completed with a success. It's impossible to guess it with the high level of confidence just by observing the stats.

πŸ“– Solution: User Story / Epic

  • As Coder users, when I terminate / finish the Task I am asked by Coder for my assessment of the outcomes: whether it was a success, a neutral experience or a failure. I can also leave my short comments to help Coder and my admins fine tune the templates.
  • As Coder product team we can learn from our real customers about the success rate of the tasks and also receive direct feedback what went wrong in case it did. This helps us fine tune the solution.
  • As a Coder Admin I can see the tasks success rate and users' feedback as part of the template insights. This helps me make educated decisions how to configure the templates and/or educate my users in the future.
  • As a Coder Admin I can disable the feedback popup per Template in its configuration.

🎨 Solution: Design / Architecture

  • Upon the termination of the task, we display a popup message asking for votes about the task quality. See the mockup below.
  • The data gets transmitted to Coder via Telemetry mechanisms and can be analyzed but it is also stored internally for the local admins to be able to analyze.
  • The popups are displayed by default, but there is an option in template terraform file to disable them.
  • Coder Admins can see the success rate as well as the list of comments sorted by the date per Template in the Template Insights report.
Image Image

Metadata

Metadata

Assignees

Labels

observabilityIssues related to observability (metrics, dashboards, alerts, opentelemetry)project/tasksCoder tasks

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions