Skip to content

Add additional generation information to the logging context

Luke Duncalfe requested to merge 357-log-inputs-and-outputs into main

What does this merge request do and why?

This MR adds additional parameters to the logging context (current file, prompt, and model output). This context automatically gets logged in the logging middleware.

The inference parameters (temperature, top_k, etc.) will be added in another MR as it needs bigger changes made to the instrumentation and these values are currently static. are logged with simple log.info() calls.

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.

Relates to #357

Edited by Andras Herczeg

Merge request reports