Autogenerated job_id are not same in system database and folder structure
What is the current bug behavior?
In the current meltano version: v1.39.1 the folder name is different from the job_id in system database.
What is the expected correct behavior?
The folder name should exactly match the job_id in system database
Steps to reproduce
Run meltano elt
command without the --job_id
meltano elt tap-zuora target-csv
Meltano in this case will auto-generate the job_id and create a folder under .meltano/run
. It will also create an entry in the system database with the job_id. In the current meltano version: v1.39.1 the folder name is different from the job_id in system database.
Relevant logs and/or screenshots
In the system database I found the generated job id is different from the folder name under .meltano/run/elt/
.
Correct Job Id per database: job_20200714-00:38:49.927082 Folder name: job-20200714-003849-927082
Possible fixes
Synchronize the job_id in the system database and the folder name under .meltano/run/elt/
to avoid confusion.
Further regression test
Ensure we automatically catch similar issues in the future
-
Write additional adequate test cases and submit test results -
Test results should be reviewed by a person from the team