Sisense dashboard: user adoption of truncating container registry image name
Context
In #364290 (closed) we added a new feature to truncate an image repository's name in the UI:
The hypothesis is showing the full image name was not necessary. We want to understand if that hypothesis is correct by analyzing the tracking implemented on the ellipsis button. This issue is to build a dashboard in Sisense to monitor this feature.
- This feature is under a feature flag.
- There is frontend implementation of tracking on the event of clicking the ellipsis button (dashboard)
- We want to use the click tracking to determine if we roll this feature out to everyone or roll back.
Example of successful feature | Example of failed feature |
---|---|
The ellipsis button is seldom used | The ellipsis button is used a lot, we're hiding important information from the customer |
To do: Representing in Sisense
After discussing, an approach could be a Sisense chart with how many viewed the page (with feature flag on): used the feature versus did not use the feature.
What we will do with this data
Ignore data for the first month that users are exposed to the feature (as they may click to discover what the feature is)
After 1 month, analyze data to see:
- If 20% or less click the ellipsis button, we can roll this feature to everyone
- If 21% - 40% click the ellipsis button, we need to do further research (qual)
- If 40% or more click the ellipsis button, we need to roll back and remove this feature