How should numeric transforms be handed from tap to target?
Following from https://meltano.slack.com/archives/C01PKLU5D1R/p1645780848809499
There's a question on the proper way for taps and target to communicate types for decimal/currency values:
As a first go, here's a set of principles to kick of the convesertation:
First-order principles:
- Numbers should be
numbertype, not string. - Target needs to have at least a large enough field for the data to land successfully.
- Target should always be free to create a field larger than is needed.
Bonus / second-order principles:
- Should we have standard hints for precision and size requirements?
- For example, some places we can put hints are:
format,min,max, andmultipleOf
- How does the tap communicate these?
- For targets which are listening to those type hints, how should they interpret those type hints?
- For example, some places we can put hints are:
Edited by AJ Steers