Add changes for Bulk API V2
Adding support for Salesforce Bulk V2 API.
- Adding a new
BULK_V2_API_TYPE
, which can be used by settingBULK_V2
asapi_type
in the config - Bumping the API version to
51.0
for Bulk V2 API, while keeping41.0
on the other two API types - In Bulk V2, preventing the use of
ORDER BY
clause in SOQL queries because this creates issues https://help.salesforce.com/articleView?id=000353741&language=en_US&mode=1&type=1. I'm ensuring the state keeps the latest fetched records using a newmax_replication_key_value
variable. - Adding a new connection type
OAuthPasswordCredentials
which uses a combination ofusername
,password
,client_id
, andclient_secret
. - Adding an
end_date
config to be able to split loads in multiple chunks. If some objects are too big to be loaded at once,end_date
can be used in combination withstart_date
/thestate
of the stream.
Edited by BenjMaq