Skip to content

Draft: Improve git issues network error signature diversity ratio

Pranshu Sharmarequested to merge
prsharma-git_issues_network_error into master

What does this MR do and why?

Improves log normalization by adding support for additional dynamic values that helps reduce the failure signature diversity score for git_issues_network_error.

Changes

  1. Better warnings handling - system now recognizes patterns for warning fragments, normalizes them consistently
  2. Enhanced testing Expected impact & dry-runs
  • Before (Master branch) - Diversity ratio: 32.5%

Download the CSV file from https://app.snowflake.com/ys68254/gitlab/w33qYqpFqfDA

fca --csv <path to csv>
./bin/analyze_signatures results.csv --category git_issues_network_error
Click to view logs 
 ./bin/analyze_signatures results.csv --category git_issues_network_error
====================================================================================================
CI FAILURE SIGNATURE ANALYSIS
====================================================================================================
Data source: results.csv
Category filter: git_issues_network_error
Total records: 249
DETAILED ANALYSIS FOR: git_issues_network_error
----------------------------------------------------------------------------------------------------
Total failures: 249
Unique signatures: 81
Diversity ratio: 32.5%

  • After (prsharma-git_issues_network_error branch) - Diversity score: 32.1%

    With the new normalization rules applied, the diversity score for git_issues_network_error is significantly reduced from 32.5% to 32.5%.

Click to view logs 
➜     triage-ops git:(prsharma-git_issues_network_error) ✗ ./bin/analyze_signatures results.csv --category git_issues_network_error
====================================================================================================
CI FAILURE SIGNATURE ANALYSIS
====================================================================================================
Data source: results.csv
Category filter: git_issues_network_error
Total records: 249
DETAILED ANALYSIS FOR: git_issues_network_error
----------------------------------------------------------------------------------------------------
Total failures: 249
Unique signatures: 80
Diversity ratio: 32.1%

Related Issue

gitlab-org/quality/analytics/team#297

Edited by Pranshu Sharma

Merge request reports