Improve the logging of zoekt_scheduling_worker

Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.

• Close this issue

Background

Currently, we have logging for each scheduling task but it is hard to find the full lifecycle of any index from the logs.

Proposal

Add the separate log entry of each index in each scheduling task using the structure payload. The log might look like this:

      {
          'zoekt.scheduling_event.enabled_namespace_id' => 1,
          'zoekt.scheduling_event.replica_id' => 1,
          'zoekt.scheduling_event.index_id' => 1,
          'zoekt.scheduling_event.message' => 'Indices that should be marked as pending_eviction',
          'zoekt.scheduling_event.index_state' => 'ready',
          'zoekt.scheduling_event.index_watermark_level' => 'critical_watermark_exceeded'
          'zoekt.scheduling_event.reserved_storage_bytes' => '100000'
          'zoekt.scheduling_event.used_storage_bytes' => '95000'
      }.compact

Implement the new logs using a FF