Skip to content

elasticsearch: Cannot index large snippets

Observed while working on https://gitlab.com/gitlab-org/gitlab-ee/issues/11419

To bulk-import snippets, we use rake gitlab:elastic:index_snippets and the es_import helper. This reliably times out on staging.gitlab.com

It looks like the problem occurs when a batch contains a large-enough snippet. At least one in the database is ~5MiB in size.

I'd suggest we exclude or truncate the content for larger snippets. More generally, do we have size limits on snippets? Should we?