Add migration to index all projects

Proposal

Note: it is imperative to calculate if we have enough space on the cluster to add the projects. That calculation needs to be part of the migration (using space_requirements migration option)

Add an Advanced Search migration that enqueues all projects for indexing.

The migration does not need to run if advanced search limiting is not enabled. This will be much more efficient for self managed customers who do not use the limiting feature

This can be a new little migration helper (if one was not already created), which can also be quite useful for indexing all documents of a specific type. We can add a configuration option so that we can specify whether it should respect elasticsearch limiting rules and SCHEMA_VERSION.

  • Allow SCHEMA_VERSION to be unset in the migration, if this is true the helper will do no clean up. Be sure to check for empty SCHEMA_VERSION and less than as a document that needs to be updated.
  • If SCHEMA_VERSION is set, it is used to clean up existing data when everything needs to be re-indexed.
  • For elasticsearch limiting rules, for projects it would be set to false to not respect the limiting and issues it will be set to true
Edited by Terri Chu