Migrate existing Test Governance data to ClickHouse
# First step
For the dashboards mentioned in https://docs.google.com/spreadsheets/d/1j7uGKozwbPgOny_etIv8XICN4k0rO2YpWP6xXsnYUE8/edit?gid=1983983669#gid=1983983669
<table>
<tr>
<td>
\#
</td>
<td>Dashboard Name</td>
<td>Backend Tech Stack</td>
<td>Frontend Tech Stack</td>
<td>Purpose</td>
<td>Target Audience</td>
<td>Note</td>
<td>Data already in ClickHouse/, or if not estimated data usage</td>
</tr>
<tr>
<td align="right">1</td>
<td>
[JetBrains extension individual test results dashboard](https://dashboards.quality.gitlab.net/d/de95aedcaxtz4c/f475db2)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>Identifies flaky/slow tests in their test suite</td>
<td>Editor Extensions team</td>
<td></td>
<td></td>
</tr>
<tr>
<td align="right">2</td>
<td>
[JetBrains extension test result summary dashboard (MRs and main)](https://dashboards.quality.gitlab.net/d/ce72483cuudxcb/jetbrains-extension-test-result-dashboard)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>Identifies flaky/slow tests in their test suite</td>
<td>Editor Extensions team</td>
<td>uses same datasource as above dashboard</td>
<td></td>
</tr>
<tr>
<td align="right">3</td>
<td>
[VSCode extension individual test results dashboard](https://dashboards.quality.gitlab.net/d/fe8uljyso69z4a/vscode-extension-individual-test-results-dashboard)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>Identifies flaky/slow tests in their test suite</td>
<td>Editor Extensions team</td>
<td></td>
<td></td>
</tr>
<tr>
<td align="right">4</td>
<td>
[VSCode extension test result summary dashboard (MRs and main)](https://dashboards.quality.gitlab.net/d/ae52qo5pcs9ogd/3da06fb)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>Identifies flaky/slow tests in their test suite</td>
<td>Editor Extensions team</td>
<td>uses same datasource as above dashboard</td>
<td></td>
</tr>
<tr>
<td align="right">5</td>
<td>
[Large import tests](https://dashboards.quality.gitlab.net/d/AioZ8Qd4z/large-import-tests)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>??? - doesn't seem to have any current data</td>
<td>Import team</td>
<td>No data - looks broken</td>
<td></td>
</tr>
<tr>
<td align="right">6</td>
<td>
[Failure distribution](https://dashboards.quality.gitlab.net/d/cdhiwocktlclca/failure-distribution)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>Charts different failure types</td>
<td>E2E test related dashboard</td>
<td>Seems to be broken over last 30 days</td>
<td></td>
</tr>
<tr>
<td align="right">7</td>
<td>
[Main Runs](https://dashboards.quality.gitlab.net/d/tR_SmBDVk/main-runs)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>e2e test stats for master pipelines</td>
<td>E2E test related dashboard</td>
<td></td>
<td></td>
</tr>
<tr>
<td align="right">8</td>
<td>
[MR Runs](https://dashboards.quality.gitlab.net/d/adzjhyeg6egaoa/mr-runs)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>e2e test stats for MR pipelines</td>
<td>E2E test related dashboard</td>
<td>No data - looks broken</td>
<td></td>
</tr>
<tr>
<td align="right">9</td>
<td>
[Single Spec Metrics](https://dashboards.quality.gitlab.net/d/cW0UMgv7k/single-spec-metrics)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>Individual stats for e2e specs</td>
<td>E2E test related dashboard</td>
<td></td>
<td></td>
</tr>
<tr>
<td align="right">10</td>
<td>
[Test stability by group](https://dashboards.quality.gitlab.net/d/edgcentzu45q8b/test-stability-by-group)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>Drill down into errors per stage</td>
<td>E2E test related dashboard</td>
<td></td>
<td></td>
</tr>
<tr>
<td align="right">11</td>
<td>
[Top failures](https://dashboards.quality.gitlab.net/d/Csi6nbvnk/top-failures)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>Top e2e test failures</td>
<td>E2E test related dashboard</td>
<td>Perhaps this has been superseeded with a Snowflake graph?</td>
<td></td>
</tr>
<tr>
<td align="right">12</td>
<td>
[Top Runtimes](https://dashboards.quality.gitlab.net/d/cILohlD7z/top-runtimes)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>top e2e test runtimes</td>
<td>E2E test related dashboard</td>
<td>No data - looks broken</td>
<td></td>
</tr>
<tr>
<td align="right">13</td>
<td>
[Executed method time graphs](https://dashboards.quality.gitlab.net/d/bdte84rkt62o0d/executed-method-time-graphs)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>Graphs related to time it takes to execute methods interacting with UI. Data is based on scheduled non merge request pipeline runs.</td>
<td>E2E test related dashboard</td>
<td>No data - looks broken</td>
<td></td>
</tr>
<tr>
<td align="right">14</td>
<td>
[Fabrication time graphs](https://dashboards.quality.gitlab.net/d/3g5WHzxnk/fabrication-time-graphs)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>as above</td>
<td>E2E test related dashboard</td>
<td>No data - looks broken</td>
<td></td>
</tr>
<tr>
<td align="right">15</td>
<td>
[Mean/Max fabrication time](https://dashboards.quality.gitlab.net/d/K4me1-xnz/mean-max-fabrication-time)
</td>
<td>InfluxDB</td>
<td>Grafana</td>
<td>as above</td>
<td>E2E test related dashboard</td>
<td>No data - looks broken</td>
<td></td>
</tr>
<tr>
<td align="right">16</td>
<td>
[Omnibus E2E Test Pipelines](https://10az.online.tableau.com/#/site/gitlab/views/DRAFTTestEconomyMetrics/OmnibusE2ETestPipelines)
</td>
<td>Snowflake</td>
<td>Tableau</td>
<td>Omnibus test pipeline metrics and costs</td>
<td>E2E test related dashboard</td>
<td></td>
<td></td>
</tr>
<tr>
<td align="right">17</td>
<td>
Product Analytics [E2E Test Economy Metrics](https://10az.online.tableau.com/#/site/gitlab/views/DRAFTTestEconomyMetrics/ProductAnalyticsE2ETestAutomationPipeline?:iid=1)
</td>
<td>Snowflake</td>
<td>Tableau</td>
<td>Product Analytics specifc e2e test metrics and costs</td>
<td>E2E test related dashboard</td>
<td>No data - looks broken</td>
<td></td>
</tr>
</table>
1. Establish which dashboards use data that will be covered by the new Text Execution data that is being provided by DA.
2. For those that aren't, establish how much data is likely to be produced on a monthly basis.
3. This will allow us to determine if our estimates for our ClickHouse instance costs are correct.
epic