Improve ruby_http_500 signature diversity ratio
What does this MR do and why?
Improves log normalization by adding support for additional dynamic values that helps reduce the failure signature diversity score for ruby_http_500.
Changes
- Better warnings handling - system now recognizes patterns for warning fragments, normalizes them consistently
- Enhanced testing Expected impact & dry-runs
- Before (Master branch) - Diversity ratio: 43.7%
Download the CSV file from https://app.snowflake.com/ys68254/gitlab/w33qYqpFqfDA
fca --csv <path to csv>
./bin/analyze_signatures results.csv --category ruby_http_500
Click to view logs
./bin/analyze_signatures results.csv --category ruby_http_500
====================================================================================================
CI FAILURE SIGNATURE ANALYSIS
====================================================================================================
Data source: results.csv
Category filter: ruby_http_500
Total records: 252
DETAILED ANALYSIS FOR: ruby_http_500
----------------------------------------------------------------------------------------------------
Total failures: 252
Unique signatures: 110
Diversity ratio: 43.7%
-
After (
prsharma-http_500_failuresbranch) - Diversity score: 10.3%With the new normalization rules applied, the diversity score for
ruby_http_500.is significantly reduced from 43.7% to 10.3%.
Click to view logs
➜ triage-ops git:(prsharma-cng-failures) ./bin/analyze_signatures results.csv --category ruby_http_500
====================================================================================================
CI FAILURE SIGNATURE ANALYSIS
====================================================================================================
Data source: results.csv
Category filter: ruby_http_500
Total records: 252
DETAILED ANALYSIS FOR: ruby_http_500
----------------------------------------------------------------------------------------------------
Total failures: 252
Unique signatures: 26
Diversity ratio: 10.3%
Related Issue
Edited by Pranshu Sharma