Determine current service levels in logs for throughput
We want to add logging to the Global Search indexing with the time it takes to index and different labels (type/name
, scope
), so that we can determine the custom service levels for this.
As opposed to the search, we don't need level
, as ES indexing is always advanced
search.
We want to log indexing at 2 places, one is the ProcessBookkeepingService
, which will run every minute, and goes over all items that are set in redis. This will include all indexable items that are updated since the last run, except for wikis and code blobs.
This is done in bulk, but we would like to measure the time it takes to index one item, not the whole bulk. So we want to measure it per item individually.
Wikis and code blobs are indexed in ElasticCommitIndexerWorker
, so we also want to log the timing there.