Skip to content

Evaluate limits on Max file size indexed in Advanced Search

Problem we want to solve

When users are searching across projects in Advanced Search they will not see results from files larger than 1mb. These Larger files, while less common, are maybe some of the stronger use cases for Code Search.

Proposal

We should review the files sizes of the items indexed to look at percentages and base the size limitations off of the 95% range. Alternatively we should consider match the size limitations for Gitlab (default 10mb).

Other Information

https://www.elastic.co/guide/en/elasticsearch/reference/current/general-recommendations.

https://github.com/elastic/elasticsearch-py/issues/1079

Maybe there are better ways to process large files.

Edited by John McGuire