Production SM test of Service Ping, Operational Data and Subscription Data
Summary
In milestone %14.1 we shipped two significant changes around metrics collection: (1) Rename Usage Ping to Service Ping, (2) Operational Data collection for use in customer success services.
This issue will be used to document self-managed production tests of data collected to ensure there are no issues flowing into the Data warehouse and Gainsight.
Participants
DRI | Team | Scope of Testing |
---|---|---|
@amandarueda | Product | Customer simulation |
@snalamaru | Data | Data warehouse verification |
@emcinerney | Customer Success | Gainsignt verification |
Test plan
We will simulate three user scenarios:
- Free user sending Service Ping
- Paid user sending Service Ping + Operational Data + Subscription Data
- Paid users only sending Operational Data + Subscription Data
Once the instances are created and data is collected, we will track the received data for each use case in the data warehouse and Gainsight. We will update the Test steps section below with outcome.
Test steps
Use Case 1: Free user sending Service Ping
- UUID:
918cf155-bead-45af-aaa1-bd12357c6d4a
- hostname:
gitlab.example.com
- version:
14.1.1-ee
- license_md5: n/a - free instance
- license_id: n/a - free instance
- Subscription: n/a - free instance
Use Case 2: Paid user sending Service Ping + Operational Data + Subscription Data
- UUID:
- hostname:
- version:
- license_md5:
2e88dd724337477413d50ff39c04a159
- license_id:
1000154
- Subscription: A-S00047993
- SFDC Account: https://gitlab.my.salesforce.com/0014M00001yT2yLQAS
Use Case 3: Paid users only sending Operational Data + Subscription Data
- UUID:
be4a084a-52f1-4f5c-be87-aa2c2ef8a823
- hostname:
6de35749cff1
- version:
14.1.0-ee
- license_md5:
6987e521b697257e9560a5677cd63b39
- license_id:
1000433
- Subscription: A-S00048247
- SFDC Account: https://gitlab.my.salesforce.com/0014M00001yT2yBQAS
Project plan
-
@amandarueda to create test instances by 2021-07-30 -
@snalamaru to document test steps related to data warehouse verification in this issue description -
@emcinerney to document test steps related to Gainsight verification in this issue description -
@snalamaru to verify collected data in data warehouse and sign-off Pass/Fail
-
@emcinerney to verify collected data in data warehouse and sign-off Pass/Fail
Edited by Amanda Rueda