Skip to content

Offest changes

Bogdan Tabor requested to merge patch/ADAPT-OFFSET into master
  • TEST RESULT FOR 'OffsetOutOfRange' CONDITION

Kafka server was reconfigured and help patch was loaded into adapter to trigger 'OffsetOutOfRange' errors.
Below log ilustrates how loading the patch prevents reading messages already removed by Kafka server.


**[BEFORE PATCH]**

automation-platform    | 2022-06-03T08:07:55.415Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.417Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.419Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.420Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.422Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.424Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.425Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.427Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.428Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.430Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.431Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.433Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.435Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.436Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.437Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.439Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.442Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.445Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.447Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.449Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.451Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.453Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.456Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.458Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.460Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.462Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.464Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.466Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.468Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.469Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.471Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.473Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.475Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.477Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.479Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.481Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.482Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1105, message=[
automation-platform    |   'Parent process disconnected. Terminating child processes, kafka-1, in 3 seconds...'
automation-platform    | ]
automation-platform    | 2022-06-03T08:07:55.484Z - debug: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:143, message=[ 'Begin cleanup strategy for kafka-1, status: STOPPED' ]
automation-platform    | kafka-1 is awaiting shut down. PID: 856 Status: STOPPED

**[KAFKA STOP TO LOAD THE PATCH]**


automation-platform    | 2022-06-03T08:07:55.489Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:350, message=[ 'OffsetOutOfRange: Error: OffsetOutOfRange' ]
automation-platform    | 2022-06-03T08:07:55.489Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Sheriff.bin:934, message=[ 'kafka-1 is OFFLINE!' ]
automation-platform    | 2022-06-03T08:07:55.491Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Alarm.bin:255, message=[
automation-platform    |   'Alarms module sending AdapterUnreachable adapter = kafka-1 host = null port = null'
automation-platform    | ]
automation-platform    | 2022-06-03T08:07:55.494Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Sheriff.bin:179, message=[ 'kafka-1 has closed.' ]
automation-platform    | 2022-06-03T08:07:55.495Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Alarm.bin:255, message=[
automation-platform    |   'Alarms module sending AdapterUnreachable adapter = kafka-1 host = null port = null'
automation-platform    | ]
automation-platform    | 2022-06-03T08:07:55.496Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Sheriff.bin:193, message=[ 'kafka-1 has closed and will not restart.' ]
automation-platform    | 2022-06-03T08:07:55.927Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/WebServer.bin:609, message=[
automation-platform    |   'Failed to load schema for NSOManager getQueueItemDetails queueItemId: Error: schema is invalid: data/properties/queueItemId/examples should be array'
automation-platform    | ]
automation-platform    | 2022-06-03T08:07:56.076Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Sheriff.bin:1718, message=[ 'kafka-1 has been stopped.' ]
automation-platform    | Launching kafka-1 @itentialopensource/adapter-kafka
automation-platform    | 2022-06-03T08:09:50.767Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1203, message=[
automation-platform    |   'Initializing service /opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js'
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:50.794Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1181, message=[ 'kafka-1 broadcasting handshake.' ]
automation-platform    | 2022-06-03T08:09:50.841Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Sheriff.bin:1783, message=[ 'creating corral: kafka-1' ]
automation-platform    | 2022-06-03T08:09:50.870Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Sheriff.bin:1607, message=[ 'Adding corral @itentialopensource/adapter-kafka Adapter' ]
automation-platform    | 2022-06-03T08:09:50.881Z - debug: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/node_modules/@itential/event-system/dist/EventSystem.js:1, message=[
automation-platform    |   'kafka-1 event system received topics {"@itential/app-operations_manager":{"missedJobs":{"type":"object","properties":{"count":{"type":"number","description":"number of jobs that were missed by the scheduler"},"triggerId":{"description":"the id of the trigger document that is associated with these jobs.","type":"string"},"jobsProcessed":{"type":"string","description":"which jobs were now ran by the scheduler. This is the value of processMissedJobs on the schedule document."}},"required":["count","triggerId","jobsProcessed"],"additionalProperties":false},"failedTrigger":{"type":"object","properties":{"triggerId":{"description":"the id of the trigger document that is associated with these jobs.","type":"string"},"type":{"type":"string","description":"the type of the trigger that failed. Either eventSystem or schedule"},"errorMessage":{"type":"string","description":"a string describing why the scheduled job failed"}},"required":["triggerId","errorMessage","type"],"additionalProperties":false}},"@itential/app-workflow_engine":{"jobStart":{"type":"object","required":["job"],"properties":{"job":{}}},"jobComplete":{"type":"object","required":["job"],"properties":{"job":{}}},"jobError":{"type":"object","required":["job"],"properties":{"job":{}}},"jobCancel":{"type":"object","required":["job"],"properties":{"job":{}}},"jobResume":{"type":"object","required":["job"],"properties":{"job":{}}},"jobFix":{"type":"object","required":["job"],"properties":{"job":{}}},"jobPause":{"type":"object","required":["job"],"properties":{"job":{}}}},"@itentialopensource/adapter-kafka":{"kafka":{}}}'
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:50.882Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:870, message=[ 'kafka-1 start received, initializing...' ]

**[KAFKA WITH THE PATCH LOADED]**

automation-platform    | 2022-06-03T08:09:50.883Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:668, message=[ 'kafka-1 initializing as adapter.' ]
automation-platform    | this.topicsEvents [
automation-platform    |   {
automation-platform    |     topic: 't1',
automation-platform    |     subscribers: 999999,
automation-platform    |     offset: 152,
automation-platform    |     partition: 0,
automation-platform    |     avro: 'NO',
automation-platform    |     processed: 152,
automation-platform    |     subInfo: [ [Object] ]
automation-platform    |   }
automation-platform    | ]
automation-platform    | subInfo [ { subname: 'default', filters: [], rabbit: 'kafka', throttle: {} } ]
automation-platform    | sub 0
automation-platform    | 2022-06-03T08:09:51.059Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:336, message=[ 'NEED TO RESTART ADAPTER - EXITING' ]
automation-platform    | 2022-06-03T08:09:51.059Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:343, message=[ 'kafka-1-adapter-constructor: undefined' ]
automation-platform    | 2022-06-03T08:09:51.068Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:676, message=[ 'kafka-1 schema validated.' ]
automation-platform    | 2022-06-03T08:09:51.069Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:390, message=[ 'kafka-1-adapter-connect' ]
automation-platform    | 2022-06-03T08:09:51.075Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:744, message=[ 'kafka-1 status message handlers applied.' ]
automation-platform    | kafka-1 ready to work.
automation-platform    | 2022-06-03T08:09:51.077Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Sheriff.bin:934, message=[ 'kafka-1 is OFFLINE!' ]
automation-platform    | 2022-06-03T08:09:51.078Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Alarm.bin:255, message=[
automation-platform    |   'Alarms module sending AdapterUnreachable adapter = kafka-1 host = null port = null'
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:51.094Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:405, message=[ 'EMITTED ONLINE' ]
automation-platform    | 2022-06-03T08:09:51.103Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:431, message=[ 'OffsetOutOfRange: t1', 'string' ]
automation-platform    | topic1 t1
automation-platform    | 2022-06-03T08:09:51.110Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:438, message=[ 'Trying to set earliest offset for topic t1' ]
automation-platform    | 2022-06-03T08:09:51.110Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:1272, message=[ 'kafka-1-adapter-setOffset' ]
automation-platform    | 2022-06-03T08:09:51.111Z - debug: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:1326, message=[ 'Changes made to consumer' ]
automation-platform    | 2022-06-03T08:09:51.112Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:431, message=[ 'OffsetOutOfRange: t1', 'string' ]
automation-platform    | topic1 t1
automation-platform    | topic2 t1
automation-platform    | 2022-06-03T08:09:51.115Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:456, message=[ 'Trying to set latest offset for topic t1' ]
automation-platform    | 2022-06-03T08:09:51.118Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:438, message=[ 'Trying to set earliest offset for topic t1' ]
automation-platform    | topic2 t1
automation-platform    | 2022-06-03T08:09:51.119Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:456, message=[ 'Trying to set latest offset for topic t1' ]
automation-platform    | 2022-06-03T08:09:51.322Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/WebServer.bin:609, message=[
automation-platform    |   'Failed to load schema for NSOManager getQueueItemDetails queueItemId: Error: schema is invalid: data/properties/queueItemId/examples should be array'
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:51.446Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Alarm.bin:289, message=[
automation-platform    |   'Alarms module sending AdapterConnected adapter = kafka-1 host = null port = null'
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:51.472Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | Uncaught exception handled by Service!
automation-platform    | Error: {"origin":"kafka-1-adapter-constructor","type":"Restarting to add new topics","vars":[]}
automation-platform    |     at Timeout._onTimeout (/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:345:17)
automation-platform    |     at listOnTimeout (internal/timers.js:557:17)
automation-platform    |     at processTimers (internal/timers.js:500:7)
automation-platform    | 2022-06-03T08:09:52.067Z - debug: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:143, message=[ 'Begin cleanup strategy for kafka-1, status: CRASHED' ]
automation-platform    | kafka-1 is awaiting shut down. PID: 871 Status: CRASHED
automation-platform    | 2022-06-03T08:09:52.079Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Sheriff.bin:251, message=[ 'kafka-1 has shutdown unexpectedly.' ]
automation-platform    | 2022-06-03T08:09:52.081Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Sheriff.bin:280, message=[ 'Restarting kafka-1. Retry attempt: 1.' ]
automation-platform    | Launching kafka-1 @itentialopensource/adapter-kafka
automation-platform    | 2022-06-03T08:09:54.046Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1203, message=[
automation-platform    |   'Initializing service /opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js'
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.078Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1181, message=[ 'kafka-1 broadcasting handshake.' ]
automation-platform    | 2022-06-03T08:09:54.127Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Endpoints.bin:22, message=[
automation-platform    |   "Cannot register method 'Kafka.createTopics'. It has already been declared."
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.128Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Endpoints.bin:22, message=[
automation-platform    |   "Cannot register method 'Kafka.sendMessage'. It has already been declared."
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.129Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Endpoints.bin:22, message=[
automation-platform    |   "Cannot register method 'Kafka.subscribe'. It has already been declared."
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.130Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Endpoints.bin:22, message=[
automation-platform    |   "Cannot register method 'Kafka.subscribeAvro'. It has already been declared."
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.131Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Endpoints.bin:22, message=[
automation-platform    |   "Cannot register method 'Kafka.unsubscribe'. It has already been declared."
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.132Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Endpoints.bin:22, message=[
automation-platform    |   "Cannot register method 'Kafka.commitOffset'. It has already been declared."
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.133Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Endpoints.bin:22, message=[
automation-platform    |   "Cannot register method 'Kafka.setOffset'. It has already been declared."
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.136Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Endpoints.bin:22, message=[
automation-platform    |   "Cannot register method 'Kafka.pauseConsumer'. It has already been declared."
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.136Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Endpoints.bin:22, message=[
automation-platform    |   "Cannot register method 'Kafka.resumeConsumer'. It has already been declared."
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.137Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Endpoints.bin:22, message=[
automation-platform    |   "Cannot register method 'Kafka.pauseTopics'. It has already been declared."
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.138Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Endpoints.bin:22, message=[
automation-platform    |   "Cannot register method 'Kafka.resumeTopics'. It has already been declared."
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.139Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Endpoints.bin:22, message=[
automation-platform    |   "Cannot register method 'Kafka.closeConsumer'. It has already been declared."
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.140Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Sheriff.bin:1783, message=[ 'creating corral: kafka-1' ]
automation-platform    | 2022-06-03T08:09:54.155Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Sheriff.bin:1607, message=[ 'Adding corral @itentialopensource/adapter-kafka Adapter' ]
automation-platform    | 2022-06-03T08:09:54.165Z - debug: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/node_modules/@itential/event-system/dist/EventSystem.js:1, message=[
automation-platform    |   'kafka-1 event system received topics {"@itential/app-operations_manager":{"missedJobs":{"type":"object","properties":{"count":{"type":"number","description":"number of jobs that were missed by the scheduler"},"triggerId":{"description":"the id of the trigger document that is associated with these jobs.","type":"string"},"jobsProcessed":{"type":"string","description":"which jobs were now ran by the scheduler. This is the value of processMissedJobs on the schedule document."}},"required":["count","triggerId","jobsProcessed"],"additionalProperties":false},"failedTrigger":{"type":"object","properties":{"triggerId":{"description":"the id of the trigger document that is associated with these jobs.","type":"string"},"type":{"type":"string","description":"the type of the trigger that failed. Either eventSystem or schedule"},"errorMessage":{"type":"string","description":"a string describing why the scheduled job failed"}},"required":["triggerId","errorMessage","type"],"additionalProperties":false}},"@itential/app-workflow_engine":{"jobStart":{"type":"object","required":["job"],"properties":{"job":{}}},"jobComplete":{"type":"object","required":["job"],"properties":{"job":{}}},"jobError":{"type":"object","required":["job"],"properties":{"job":{}}},"jobCancel":{"type":"object","required":["job"],"properties":{"job":{}}},"jobResume":{"type":"object","required":["job"],"properties":{"job":{}}},"jobFix":{"type":"object","required":["job"],"properties":{"job":{}}},"jobPause":{"type":"object","required":["job"],"properties":{"job":{}}}},"@itentialopensource/adapter-kafka":{"kafka":{},"t1":{}}}'
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.166Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:870, message=[ 'kafka-1 start received, initializing...' ]
automation-platform    | 2022-06-03T08:09:54.167Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:668, message=[ 'kafka-1 initializing as adapter.' ]
automation-platform    | this.topicsEvents [
automation-platform    |   {
automation-platform    |     topic: 't1',
automation-platform    |     subscribers: 999999,
automation-platform    |     offset: 152,
automation-platform    |     partition: 0,
automation-platform    |     avro: 'NO',
automation-platform    |     processed: 152,
automation-platform    |     subInfo: [ [Object] ]
automation-platform    |   }
automation-platform    | ]
automation-platform    | subInfo [ { subname: 'default', filters: [], rabbit: 'kafka', throttle: {} } ]
automation-platform    | sub 0
automation-platform    | 2022-06-03T08:09:54.412Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:676, message=[ 'kafka-1 schema validated.' ]
automation-platform    | 2022-06-03T08:09:54.414Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:390, message=[ 'kafka-1-adapter-connect' ]
automation-platform    | 2022-06-03T08:09:54.422Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:744, message=[ 'kafka-1 status message handlers applied.' ]
automation-platform    | kafka-1 ready to work.
automation-platform    | 2022-06-03T08:09:54.425Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Sheriff.bin:934, message=[ 'kafka-1 is OFFLINE!' ]
automation-platform    | 2022-06-03T08:09:54.426Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Alarm.bin:255, message=[
automation-platform    |   'Alarms module sending AdapterUnreachable adapter = kafka-1 host = null port = null'
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.437Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:405, message=[ 'EMITTED ONLINE' ]
automation-platform    | 2022-06-03T08:09:54.455Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:431, message=[ 'OffsetOutOfRange: t1', 'string' ]
automation-platform    | topic1 t1
automation-platform    | 2022-06-03T08:09:54.463Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:438, message=[ 'Trying to set earliest offset for topic t1' ]
automation-platform    | 2022-06-03T08:09:54.464Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:1272, message=[ 'kafka-1-adapter-setOffset' ]
automation-platform    | 2022-06-03T08:09:54.465Z - debug: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:1326, message=[ 'Changes made to consumer' ]
automation-platform    | 2022-06-03T08:09:54.466Z - error: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:431, message=[ 'OffsetOutOfRange: t1', 'string' ]
automation-platform    | topic1 t1
automation-platform    | topic2 t1
automation-platform    | 2022-06-03T08:09:54.470Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:456, message=[ 'Trying to set latest offset for topic t1' ]
automation-platform    | 2022-06-03T08:09:54.485Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:438, message=[ 'Trying to set earliest offset for topic t1' ]
automation-platform    | topic2 t1
automation-platform    | 2022-06-03T08:09:54.487Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:456, message=[ 'Trying to set latest offset for topic t1' ]
automation-platform    | 2022-06-03T08:09:54.726Z - warn: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/WebServer.bin:609, message=[
automation-platform    |   'Failed to load schema for NSOManager getQueueItemDetails queueItemId: Error: schema is invalid: data/properties/queueItemId/examples should be array'
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.910Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/pronghorn-core/core/Alarm.bin:289, message=[
automation-platform    |   'Alarms module sending AdapterConnected adapter = kafka-1 host = null port = null'
automation-platform    | ]
automation-platform    | 2022-06-03T08:09:54.930Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]

After loading the patch adapter does not try to read messages already removed at kafka server.

  • TEST RECEPTION OF BELOW STRING(COPY/PASTE TO SEND ALL MESSAGES QUICKLY ONE BY ONE)

Producer input:

>q
w
e
r
t
y
u
i
o
p
a
s
d
f
g
h
j
k
l
z
x
c
v
b
n
m
1
2
3
4
5
6
7
8
9
0>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

RESULT (ALL MESSAGES RECEIVED BY ADAPTER):

automation-platform    | 2022-06-03T08:25:19.608Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 176' ]
automation-platform    | 2022-06-03T08:25:19.868Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: q TO t1' ]
automation-platform    | 2022-06-03T08:25:19.872Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 177' ]
automation-platform    | 2022-06-03T08:25:20.009Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: w TO t1' ]
automation-platform    | 2022-06-03T08:25:20.011Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 178' ]
automation-platform    | 2022-06-03T08:25:20.148Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: e TO t1' ]
automation-platform    | 2022-06-03T08:25:20.153Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 179' ]
automation-platform    | 2022-06-03T08:25:20.300Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: r TO t1' ]
automation-platform    | 2022-06-03T08:25:20.305Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 180' ]
automation-platform    | 2022-06-03T08:25:20.450Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: t TO t1' ]
automation-platform    | 2022-06-03T08:25:20.452Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 181' ]
automation-platform    | 2022-06-03T08:25:20.592Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: y TO t1' ]
automation-platform    | 2022-06-03T08:25:20.600Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 182' ]
automation-platform    | 2022-06-03T08:25:20.740Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: u TO t1' ]
automation-platform    | 2022-06-03T08:25:20.745Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 183' ]
automation-platform    | 2022-06-03T08:25:20.881Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: i TO t1' ]
automation-platform    | 2022-06-03T08:25:20.884Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 184' ]
automation-platform    | 2022-06-03T08:25:21.026Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: o TO t1' ]
automation-platform    | 2022-06-03T08:25:21.029Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 185' ]
automation-platform    | 2022-06-03T08:25:21.174Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: p TO t1' ]
automation-platform    | 2022-06-03T08:25:21.175Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 186' ]
automation-platform    | 2022-06-03T08:25:21.314Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: a TO t1' ]
automation-platform    | 2022-06-03T08:25:21.322Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 187' ]
automation-platform    | 2022-06-03T08:25:21.456Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: s TO t1' ]
automation-platform    | 2022-06-03T08:25:21.461Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 188' ]
automation-platform    | 2022-06-03T08:25:21.599Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: d TO t1' ]
automation-platform    | 2022-06-03T08:25:21.606Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 189' ]
automation-platform    | 2022-06-03T08:25:21.745Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: f TO t1' ]
automation-platform    | 2022-06-03T08:25:21.748Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 190' ]
automation-platform    | 2022-06-03T08:25:21.887Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: g TO t1' ]
automation-platform    | 2022-06-03T08:25:21.889Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 191' ]
automation-platform    | 2022-06-03T08:25:22.106Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: h TO t1' ]
automation-platform    | 2022-06-03T08:25:22.112Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 192' ]
automation-platform    | 2022-06-03T08:25:22.245Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: j TO t1' ]
automation-platform    | 2022-06-03T08:25:22.251Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 193' ]
automation-platform    | 2022-06-03T08:25:22.403Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: k TO t1' ]
automation-platform    | 2022-06-03T08:25:22.407Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 194' ]
automation-platform    | 2022-06-03T08:25:22.546Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: l TO t1' ]
automation-platform    | 2022-06-03T08:25:22.548Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 195' ]
automation-platform    | 2022-06-03T08:25:22.687Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: z TO t1' ]
automation-platform    | 2022-06-03T08:25:22.688Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 196' ]
automation-platform    | 2022-06-03T08:25:22.817Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: x TO t1' ]
automation-platform    | 2022-06-03T08:25:22.825Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 197' ]
automation-platform    | 2022-06-03T08:25:22.960Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: c TO t1' ]
automation-platform    | 2022-06-03T08:25:22.965Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 198' ]
automation-platform    | 2022-06-03T08:25:23.105Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: v TO t1' ]
automation-platform    | 2022-06-03T08:25:23.110Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 199' ]
automation-platform    | 2022-06-03T08:25:23.242Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: b TO t1' ]
automation-platform    | 2022-06-03T08:25:23.245Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 200' ]
automation-platform    | 2022-06-03T08:25:23.381Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: n TO t1' ]
automation-platform    | 2022-06-03T08:25:23.383Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 201' ]
automation-platform    | 2022-06-03T08:25:23.525Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: m TO t1' ]
automation-platform    | 2022-06-03T08:25:23.530Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 202' ]
automation-platform    | 2022-06-03T08:25:23.683Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: 1 TO t1' ]
automation-platform    | 2022-06-03T08:25:23.688Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 203' ]
automation-platform    | 2022-06-03T08:25:23.831Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: 2 TO t1' ]
automation-platform    | 2022-06-03T08:25:23.835Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 204' ]
automation-platform    | 2022-06-03T08:25:23.972Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: 3 TO t1' ]
automation-platform    | 2022-06-03T08:25:23.974Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 205' ]
automation-platform    | 2022-06-03T08:25:24.122Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: 4 TO t1' ]
automation-platform    | 2022-06-03T08:25:24.123Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 206' ]
automation-platform    | 2022-06-03T08:25:24.354Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: 5 TO t1' ]
automation-platform    | 2022-06-03T08:25:24.366Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 207' ]
automation-platform    | 2022-06-03T08:25:24.512Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: 6 TO t1' ]
automation-platform    | 2022-06-03T08:25:24.516Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 208' ]
automation-platform    | 2022-06-03T08:25:24.652Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: 7 TO t1' ]
automation-platform    | 2022-06-03T08:25:24.658Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 209' ]
automation-platform    | 2022-06-03T08:25:24.801Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: 8 TO t1' ]
automation-platform    | 2022-06-03T08:25:24.805Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 210' ]
automation-platform    | 2022-06-03T08:25:24.945Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: 9 TO t1' ]
automation-platform    | 2022-06-03T08:25:24.975Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:471, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 211' ]
automation-platform    | 2022-06-03T08:25:25.159Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:544, message=[ 'Emitting: 0 TO t1' ]
automation-platform    | 2022-06-03T08:25:25.172Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.173Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.173Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.174Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.174Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.174Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.174Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.175Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.175Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.175Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.176Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.176Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.176Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.176Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.176Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.177Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.177Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.177Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.177Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.178Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.178Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.178Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.178Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.178Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.179Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.179Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.179Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.179Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.179Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.180Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.180Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.180Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.180Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.180Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.181Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T08:25:25.191Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
  • TEST OF FILTERING filter='Q'

Config:

{
  "name": "kafka-1",
  "model": "@itentialopensource/adapter-kafka",
  "type": "Adapter",
  "properties": {
    "id": "kafka-1",
    "type": "Kafka",
    "brokers": [],
    "groups": [],
    "properties": {
      "host": "kafka",
      "port": 9092,
      "registry_url": "",
      "writeTime": 30000,
      "stub": false,
      "topics": [
        {
          "name": "t1",
          "always": true,
          "subscriberInfo": [
            {
              "subname": "default",
              "filters": [
                "Q"
              ],
              "rabbit": "kafka",
              "throttle": {}
            }
          ]
        }
      ],
      "client": {
        "connectTimeout": 10000,
        "requestTimeout": 3000,
        "autoConnect": true,
        "connectRetryOptions": {},
        "idleConnection": 300000,
        "reconnectOnIdle": true,
        "maxAsyncRequests": 10
      },
      "producer": {
        "requireAcks": 1,
        "ackTimeoutMs": 100,
        "partitionerType": 0
      },
      "consumer": {
        "groupId": "kafka-node-group",
        "autoCommit": false,
        "autoCommitIntervalMs": 5000,
        "fetchMaxWaitMs": 100,
        "fetchMinBytes": 1,
        "fetchMaxBytes": 1048576,
        "fromOffset": true,
        "encoding": "utf8",
        "keyEncoding": "utf8"
      }
    }
  },
  "isEncrypted": true,
  "loggerProps": {
    "description": "Logging",
    "log_directory": "/opt/itential/logs",
    "log_filename": "kafka-1.log",
    "log_max_file_size": 10485760,
    "log_max_files": 10,
    "log_timezone_offset": 0,
    "syslog": {
      "level": "warning",
      "host": "127.0.0.1",
      "port": 514,
      "protocol": "udp4",
      "facility": "local0",
      "type": "BSD",
      "path": "",
      "pid": "process.pid",
      "localhost": "",
      "app_name": "",
      "eol": ""
    },
    "log_level": "info",
    "console_level": "trace"
  },
  "virtual": false
}

Producer input:

>Q
>ABC
>QWERYTY^H^H
>Q

RESULT OF FILTERING:

automation-platform    | 2022-06-03T10:11:05.945Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:467, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 226' ]
automation-platform    | 2022-06-03T10:11:05.946Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:542, message=[ 'Emitting: Q TO t1' ]
automation-platform    | 2022-06-03T10:11:05.967Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T10:11:13.144Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:467, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 227' ]
automation-platform    | 2022-06-03T10:11:13.145Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:529, message=[
automation-platform    |   'Message ABC being dropped as it does not meet the filter condition Q'
automation-platform    | ]
automation-platform    | 2022-06-03T10:11:35.550Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:467, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 228' ]
automation-platform    | 2022-06-03T10:11:35.550Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:529, message=[
automation-platform    |   'Message QWERYTY\b\b being dropped as it does not meet the filter condition Q'
automation-platform    | ]
automation-platform    | 2022-06-03T10:11:44.296Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:467, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 229' ]
automation-platform    | 2022-06-03T10:11:44.296Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:542, message=[ 'Emitting: Q TO t1' ]
automation-platform    | 2022-06-03T10:11:44.308Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
  • TEST WITH MULTIPLE FILTERS
    Config:
      "topics": [
        {
          "name": "t1",
          "always": true,
          "subscriberInfo": [
            {
              "subname": "default",
              "filters": [
                "BAMBO",
                "IXI",
                "PIXI"
              ],
              "rabbit": "kafka",
              "throttle": {}
            }
          ]
        }
      ],

Producer input:

>IXI
>BAB
>BAMBO
>PIXI
>PIXI123
>
>

Filtering result:

automation-platform    | 2022-06-03T12:14:22.756Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:467, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 250' ]
automation-platform    | 2022-06-03T12:14:22.756Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:529, message=[
automation-platform    |   'Message IXI being passed as it does meet the filter condition: IXI'
automation-platform    | ]
automation-platform    | 2022-06-03T12:14:22.757Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:542, message=[ 'Emitting: IXI TO t1' ]
automation-platform    | 2022-06-03T12:14:22.779Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T12:14:40.470Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:467, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 251' ]
automation-platform    | 2022-06-03T12:14:40.472Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:552, message=[ 'Message BAB being dropped as it does meet any filter condition' ]
automation-platform    | 2022-06-03T12:14:43.125Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:467, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 252' ]
automation-platform    | 2022-06-03T12:14:43.127Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:529, message=[
automation-platform    |   'Message BAMBO being passed as it does meet the filter condition: BAMBO'
automation-platform    | ]
automation-platform    | 2022-06-03T12:14:43.128Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:542, message=[ 'Emitting: BAMBO TO t1' ]
automation-platform    | 2022-06-03T12:14:43.146Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T12:14:45.785Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:467, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 253' ]
automation-platform    | 2022-06-03T12:14:45.786Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:529, message=[
automation-platform    |   'Message PIXI being passed as it does meet the filter condition: PIXI'
automation-platform    | ]
automation-platform    | 2022-06-03T12:14:45.786Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:542, message=[ 'Emitting: PIXI TO t1' ]
automation-platform    | 2022-06-03T12:14:45.796Z - trace: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itential/service/lib/Service.js:1095, message=[ 'kafka-1 : has received a emit message of type: 10' ]
automation-platform    | 2022-06-03T12:14:50.416Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:467, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 254' ]
automation-platform    | 2022-06-03T12:14:50.417Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:552, message=[
automation-platform    |   'Message PIXI123 being dropped as it does meet any filter condition'
automation-platform    | ]
automation-platform    | 2022-06-03T12:17:45.854Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:467, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 255' ]
automation-platform    | 2022-06-03T12:17:45.854Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:552, message=[ 'Message  being dropped as it does meet any filter condition' ]
automation-platform    | 2022-06-03T12:17:45.855Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:467, message=[ 'PROCESSING NEW MESSAGE ON TOPIC: t1 PARTITION: 0 WITH OFFSET: 256' ]
automation-platform    | 2022-06-03T12:17:45.855Z - info: audit_id=undefined, origin=/opt/itential/automation-platform/node_modules/@itentialopensource/adapter-kafka/adapter.js:552, message=[ 'Message  being dropped as it does meet any filter condition' ]

RESULT:
'BAMBO' 'IXI' 'PIXI' messages are passed. 'BAB' 'PIXI123' '' are dropped by the filters.

Edited by Bogdan Tabor

Merge request reports