Add additional generation information to the logging context
What does this merge request do and why?
This MR adds additional parameters to the logging context (current file, prompt, and model output). This context automatically gets logged in the logging middleware.
The inference parameters (temperature, top_k, etc.) will be added in another MR as it needs bigger changes made to the instrumentation and these values are currently static. are logged with simple log.info()
calls.
How to set up and validate locally
Numbered steps to set up and validate the change are strongly suggested.
Merge request checklist
-
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.
Relates to #357
Edited by Andras Herczeg