Skip to content

Solving the abort problem

Stephan Rayner requested to merge fix-pipeline-abort into main

What does this merge request do and why?

When the pipeline was run by some of the team members but not all the pipeline aborted.

Screenshot_2023-10-30_at_23.32.59

I've moved the fix that was implemented in duo_chat.py to io.py so that all the pipelines can benefit from this improvement.

How to set up and validate locally

Pull this branch and run the following command

poetry run promptlib code-suggestions \
    --runner DirectRunner \
    --project unreview-poc-390200e5 \
    --region us-central1 \
    --temp-location "gs://unreview-dataflow/tmp/" \
    --save-main-session \
    eval \
    --input-bq-table unreview-poc-390200e5.gl_gitlab_codebase.input_testcases_v1  \
    --output-bq-table unreview-poc-390200e5.ci_prompt_library.code_suggestions_DEVELOPER_TESTING \
    --include-suffix \
    --throttle-sec 0.01 \
    --batch-size 24 \
    --min-length 25 \
    --language rust \
    --transformation function_signatures \
    --transformation imports \
    --transformation file_name_and_language \
    --model code-gecko@latest

If your result looks different than the picture (like it makes the data)

Merge request checklist

  • I've ran the affected pipeline(s) to validate that nothing is broken.
  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Stephan Rayner

Merge request reports