As a member of Crossref operations, I want to know that the pusher has resulted in a complete index on an ongoing basis
Background
The CS currently has a method for scanning. It can be done manually or via Cron. Currently it checks the SOLR index for missed DOIs. This will need to be updated, and the process reviewed, for the new Elastic Search version.
Questions to answer in our knowledge base:
- How often is it run?
- How is the failure reported?
- How is failure decided?
- How do we monitor if it worked?
Suggestion:
- Report the latest run date.
- Check via Pingdom.
Definition of done
-
Available via a staging URL -
Code reviewed -
Unit tests identified, implemented, and passing -
Knowledge base reviewed and updated -
Changes to infrastructure -
This should be done via a REST API call instead of talking to Solr (as it is done now) or elasticsearch directly
Notes
- This should be run ideally within Docker if possible.
- Make this configurable to take into account the public, polite, and plus pools.
- GitHub Issue: https://github.com/CrossRef/cayenne/issues/71
- May need to consider putting this out in a feature branch given the monolithic nature of CS releases.
Edited by Patrick Polischuk