Skip to content

Send stop sequences with code completion requests

Andras Herczeg requested to merge 307-add-stop-sequences into main

What does this merge request do and why?

This MR adds a the stopSequences parameter with the value ["\n\n"] when calling the code completion endpoint (not the code generation) (see docs) in order to reduce unwanted predictions.

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.

Closes #307 (closed)

Edited by Andras Herczeg

Merge request reports