Skip to content

Add changes for Bulk API V2

BenjMaq requested to merge BenjMaq/tap-salesforce:add_bulk_api_v2 into master

Adding support for Salesforce Bulk V2 API.

  • Adding a new BULK_V2_API_TYPE, which can be used by setting BULK_V2 as api_type in the config
  • Bumping the API version to 51.0 for Bulk V2 API, while keeping 41.0 on the other two API types
  • In Bulk V2, preventing the use of ORDER BY clause in SOQL queries because this creates issues https://help.salesforce.com/articleView?id=000353741&language=en_US&mode=1&type=1. I'm ensuring the state keeps the latest fetched records using a new max_replication_key_value variable.
  • Adding a new connection type OAuthPasswordCredentials which uses a combination of username, password, client_id, and client_secret.
  • Adding an end_date config to be able to split loads in multiple chunks. If some objects are too big to be loaded at once, end_date can be used in combination with start_date/the state of the stream.
Edited by BenjMaq

Merge request reports

Loading