In adswerve/target-bigquery, state objects are merged
What is the current bug behavior?
What is happening now?
target-bigquery
, default variant adswerve
merges state objects, causing partition state created by the SDK to be transformed into a format it can not parse.
What is the expected correct behavior?
What should be happening?
The target should not manipulate state.
Steps to reproduce
How one can reproduce the issue?
Use a tap with partitioned state (e.g. MeltanoLabs/tap-github
with adswerve/target-bigquery
and notice the transformed state object.
Relevant logs and/or screenshots
Please use code blocks (```) to format console output
See: Tap fails to read its own state file with parti... (sdk#300 - closed)
Possible fixes
If you can, link to the line of code that might be responsible for the problem or suggest a fix
Default the target's merge_state_messages
setting to false.
Further regression test
Ensure we automatically catch similar issues in the future
-
Write additional adequate test cases and submit test results -
Test results should be reviewed by a person from the team