Verified Commit 395ca6b2 authored by Mario Varas's avatar Mario Varas
Browse files

integrates\feat(job): #4470.23 remove parallelism

- Execute sequentially
- Reduce max workers
parent d5206c13
......@@ -125,7 +125,6 @@ sorts.execute:
<<: *sorts_in_schedule_execute
stage: test-code
interruptible: false
parallel: 15
sorts.train:
<<: *makes
......
......@@ -50,7 +50,7 @@ def get_subscription_files_df(fusion_path: str) -> DataFrame:
def update_integrates_toes(group_name: str, csv_name: str) -> None:
with open(csv_name, 'r') as csv_file:
reader = csv.DictReader(csv_file)
with ThreadPoolExecutor(max_workers=16) as executor:
with ThreadPoolExecutor(max_workers=8) as executor:
for predicted_file in reader:
executor.submit(
update_toe_lines_sorts,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment