description:This is the database used for authentication, not the database used for extraction. The data extracted is determined by following the selecting entities and attributes instructions.
-name:replica_set
label:Replica Set
description:The name of the replica set.
-name:ssl
kind:boolean
value:false
value_post_processor:stringify
label:SSL
description:Whether to use SSL connection or not.
-name:verify_mode
kind:boolean
value:true
value_post_processor:stringify
description:SSL Verify Mode
label:Verify Mode
-name:include_schemas_in_destination_stream_name
kind:boolean
value:false
description:Forces the stream names to take the form `<database_name>_<collection_name>`
description:Salesforce client ID. See https://developer.salesforce.com/docs/atlas.en-us.api_rest.meta/api_rest/intro_understanding_web_server_oauth_flow.html.
-name:client_secret
kind:password
label:Client Secret
description:Salesforce client secret. See https://developer.salesforce.com/docs/atlas.en-us.api_rest.meta/api_rest/intro_understanding_web_server_oauth_flow.html.
-name:refresh_token
kind:password
label:Refresh Token
description:Salesforce refresh token. See https://developer.salesforce.com/docs/atlas.en-us.api_rest.meta/api_rest/intro_understanding_web_server_oauth_flow.html.
-name:start_date
kind:date_iso8601
label:Start Date
description:Determines how much historical data will be extracted. Please be
aware that the larger the time period and amount of data, the longer the initial
extraction can be expected to take.
-name:is_sandbox
kind:boolean
value:false
label:Is Sandbox
description:Use Salesforce Sandbox
-name:api_type
value:REST
...
...
@@ -64,15 +74,19 @@ variants:
-label:BULK
value:BULK
label:API Type
description:Used to switch the behavior of the tap between using Salesforce’s “REST” and “BULK” APIs.
-name:select_fields_by_default
kind:boolean
value:true
description:Select by default any new fields discovered in Salesforce objects
label:Select Fields By Default
-name:state_message_threshold
kind:integer
value:1000
description:Generate a STATE message every N records
description:The name of the consumer group to join for dynamic partition assignment (if enabled), and to use for fetching and committing offsets.
-name:bootstrap_servers
label:Bootstrap Servers
description:host[:port] string (or list of comma separated host[:port] strings) that the consumer should contact to bootstrap initial cluster metadata.
-name:primary_keys
kind:object
label:Primary Keys
description:Optionally you can define primary key for the consumed messages. It requires a column name and /slashed/paths ala xpath selector to extract the value from the kafka messages. The extracted column will be added to every output singer message.
-name:use_message_key
kind:boolean
label:Use Message Key
description:(Default true) Defines whether to use Kafka message key as a primary key for the record. Note - custom primary key(s) takes precedence if such defined and use_message_key is set to true.
-name:initial_start_time
label:Initial Start Time
description:(Default latest) Start time reference of the message consumption if no bookmarked position in state.sjon. One of - latest, earliest or an ISO-8601 formatted timestamp string.
-name:max_runtime_ms
kind:integer
label:Max Runtime (ms)
description:(Default 300000) The maximum time for the tap to collect new messages from Kafka topic. If this time exceeds it will flush the batch and close kafka connection.
-name:commit_interval_ms
kind:integer
label:Commit Internal (ms)
description:(Default 5000) Number of milliseconds between two commits. This is different than the kafka auto commit feature. Tap-kafka sends commit messages automatically but only when the data consumed successfully and persisted to local store.
-name:consumer_timeout_ms
kind:integer
label:Consumer Timeout (ms)
description:(Default 10000) KafkaConsumer setting. Number of milliseconds to block during message iteration before raising StopIteration
-name:session_timeout_ms
kind:integer
label:Session Timeout (ms)
description:(Default 30000) KafkaConsumer setting. The timeout used to detect failures when using Kafka’s group management facilities.
-name:heartbeat_interval_ms
kind:integer
label:Heartbeat Interval (ms)
description:(Default 10000) KafkaConsumer setting. The expected time in milliseconds between heartbeats to the consumer coordinator when using Kafka’s group management facilities.
-name:max_poll_records
kind:integer
label:Max Poll Records
description:(Default 500) KafkaConsumer setting. Maximum number of records to poll.
-name:max_poll_interval_ms
kind:integer
label:Max Poll Interval (ms)
description:(Default 300000) KafkaConsumer setting. The maximum delay between invocations of poll() when using consumer group management.
-name:message_format
label:Message Format
description:(Default json) Supported message formats are json and protobuf.
-name:proto_schema
label:Protobuf Schema
description:Protobuf message format in .proto syntax. Required if the message_format is protobuf.
description:This is the database used for authentication, not the database used for extraction. The data extracted is determined by following the selecting entities and attributes instructions.
-name:replica_set
-kind:boolean
label:SSL
name:ssl
label:Replica Set
description:The name of the replica set.
-name:ssl
kind:boolean
value:false
-description:SSL Verify Mode
value_post_processor:stringify
label:SSL
description:Whether to use SSL connection or not.
-name:verify_mode
kind:boolean
name:verify_mode
value:true
-description:Forces the stream names to take the form `<database_name>_<collection_name>`
instead of `<collection_name>`
value_post_processor:stringify
description:SSL Verify Mode
label:Verify Mode
-name:include_schemas_in_destination_stream_name
kind:boolean
name:include_schemas_in_destination_stream_name
value:false
description:Forces the stream names to take the form `<database_name>_<collection_name>`
description:Your account Id. This can be found under Setup -> Company -> Company Information. Look for Account Id. Note "_SB" is for Sandbox account.
-name:ns_consumer_key
kind:password
label:NetSuite Consumer Key
description:Your consumer key for token based authentication consumer key for SOAP connection. Visit the https://support.cazoomi.com/hc/en-us/articles/360010093392-How-to-Setup-NetSuite-Token-Based-Authentication-as-Authentication-Type for details.
-name:ns_consumer_secret
kind:password
label:NetSuite Consumer Secret
description:Your consumer secret for token based authentication consumer key for SOAP connection. Visit the https://support.cazoomi.com/hc/en-us/articles/360010093392-How-to-Setup-NetSuite-Token-Based-Authentication-as-Authentication-Type for details.
-name:ns_token_key
kind:password
label:NetSuite Token Key
description:Your token key for token based authentication consumer key for SOAP connection. Visit the https://support.cazoomi.com/hc/en-us/articles/360010093392-How-to-Setup-NetSuite-Token-Based-Authentication-as-Authentication-Type for details.
-name:ns_token_secret
kind:password
label:NetSuite Token Secret
description:Your token secret for token based authentication consumer key for SOAP connection. Visit the https://support.cazoomi.com/hc/en-us/articles/360010093392-How-to-Setup-NetSuite-Token-Based-Authentication-as-Authentication-Type for details.
-name:select_fields_by_default
kind:boolean
label:Select Fields By Default
description:When new fields are discovered in NetSuite objects, the select_fields_by_default key describes whether or not the tap will select those fields by default.
-name:is_sandbox
kind:boolean
label:Is Sandbox
description:The is_sandbox should always be set to "true" if you are connecting Production account of NetSuite. Set it to false if you want to connect to SandBox acccount.
-name:start_date
kind:date_iso8601
label:Start Date
description:Determines how much historical data will be extracted. Please be
aware that the larger the time period and amount of data, the longer the initial
