having schema name at the beginning of table name while using loader repo(pipelinewise-target-snowflake) variant
Dear Meltano Team, I had an issue last previous week (issue #3135 (closed)) regarding the target snowflake issue and as have been suggested here I have used the latest as below
loaders:
- name: target-snowflake
# variant: meltano
# pip_url: git+https://gitlab.com/meltano/target-snowflake.git
variant: transferwise
pip_url: git+https://github.com/transferwise/pipelinewise-target-snowflake.git
now, I face with two issues:
- after running the related pipeline, it creates the table in target snowflake schema without the schema name which was in tap-postgres. while I was using "traget-snowflake" it was working as expected but after switching to "pipelinewise-target-snowflake" it is not working as expected. For example
extractors:
- name: tap-postgres
variant: transferwise
pip_url: xxxxx
- name: tap-postgres--AAAA
inherit_from: tap-postgres
config:
filter_schemas: postgres_schema_name
select:
- postgres_schema_name-accounts.*
- postgres_schema_name-results.*
loaders:
- name: target-snowflake
# variant: meltano
# pip_url: git+https://gitlab.com/meltano/target-snowflake.git
variant: transferwise
pip_url: git+https://github.com/transferwise/pipelinewise-target-snowflake.git
but in my target snowflake the data instead of inserting to {targetdb}.{targetschema} in table {postgres_schema_name-account}. a new table with name {account} in {targetdb}.{targetschema} has been created and data inserted inside it.
- In addition this new table doesn't have __loadedat timestamp column so I only have the latest data inside
would you please help and advise on this matter?