Skip to content

Tags

Tags give the ability to mark specific points in history as being important
  • 1.2.20

    - Added 7Z support to decompress actions
  • 1.2.19

    - No changes for this release
  • 1.2.18

    - Compose - added additional health checks for Loki and Grafana
    
    - Increased HTTP body size for compose NGINX
  • 1.2.13

    - Limit to 31 days of Loki logs on compose stack
    - Compose install can disable clickhouse with values.yaml config
    - Airgap install uses an airgap specific values.yaml for additional configuration
    - Airgap includes yq and jq dockerized tool and execution scripts
    - Airgap includes lazydocker for on box docker diagnostics and monitoring without UI
    - Added mandatory static list of docker images to airgap docker manifest generator
    
    - Search Page Calendar Helper now base times off of current time not the time when the calendar dialog was opened.
    - Search Page Calendar now shows the time being used every time the dialog is reopened instead of whatever values it was previously closed with.
    - Values selected in the dropdowns in the JSON Renderers can now be cleared out
    - Improved clickhouse CPU/RAM performance on compose stack
    - Disable redis persistence on compose stack
    - Compose: Timeouts on startup fixed for slower VMs
    - Compose: Changed docker user execution to local user for most pods that mount local volumes to resolve permission issues on some Linux configurations
    - Fixed an issue with the monitor healthcheck in compose environments.
  • 2.0-rc5

    - compose script now has a 'build' target that will build all core docker images.  Useful for running compose with snapshots
    - Autodetect Linux and MacOS in compose script
    - Added destroy command to compose script
    - Healthcheck for plugins installed in compose, the installation is not considered complete until the container reaches a healthy state
    - Added rollback logic for failed plugin installs in compose
    - Added restart policies for compose services
    
    - Compose script now creates data directories with the correct permissions
    
    - Fixed bug that prevented plugins from being upgraded when running in compose
    
    - Use bitnami/redis:7.2.5 in compose stack and kubernetes
    - Upgrade loki to 2.9.9
    - Upgrade promtail to 2.9.9
    - Upgrade minio to RELEASE.2024-07-04T14-25-45Z
    - Upgrade clickhouse to 24.6.2-debian-12-r0
  • 1.2.11

    - Installer Builder for standalone DeltaFi systems targeting airgapped networks (compose/airgap/airgap-inator)
    
    - Fixed bug in Additional Properties Renderer where "[object Object]" appears when a new property is added
  • 1.2.10

    - Added clickhouse to compose
    
    - Update the monitor k8s resource check to only execute when it is running in a cluster
    
    - Updated to the following images in compose:
        - grafana: deltafi/grafana:11.0.0-0
        - graphite: graphiteapp/graphite-statsd:1.1.10-5
        - loki: grafana/loki:2.9.3
        - minio: quay.io/minio/minio:RELEASE.2024-06-11T03-13-30Z
        - nginx: docker.io/nginx:1.27.0-alpine
        - promtail: docker.io/grafana/promtail:2.9.3
        - mongodb: docker.io/bitnami/mongodb:5.0.17
        - redis: docker.io/bitnami/redis:7.2.4
        - clickhouse: bitnami/clickhouse:24.3.3-debian-12-r2
  • 1.2.9

    - Auto Resume remove confirmation should show Name instead of Id
    
    - Fixed errors displayed when installing a plugin on the Plugins page
    - Trim groupId, artifactId, and version on Plugins page
    - Sorted plugin list in "Select a Plugin" dropdown on Flows page
    - Fixed default boolean and integer values not being set in Actions in Flow Builder
    
    - Minio: RELEASE.2024-06-11T03-13-30Z
    - Upgrade to Grafana 11.0.0
    - Upgrade to Clickhouse 24.3.3
  • 1.2.8

    - Back-port 2.0 Python Test Kit fixes into 1.2:
      - Fix passthrough data checks
      - Bug fix for JsonCompareHelper and enable regex support
    - Resolved an issue causing a Internal Server Error (500) during authentication attempts by users lacking a password.
  • 1.2.7

    - Added a metadata trigger to ErrorByFiatTransformAction
    - `ClickhouseService` in core
    - `Error Analytics` dashboard added to Grafana
    - New Clickhouse table captures all occurrences of errors with flow, error cause and annotations
    
    - MongoDB runs in kubernetes as a stateful set
    - Grafana runs in kubernetes as a stateful set
    
    - Fixed Boolean values being removed on Flow Builder saves
    - Removed asterisks from two non-mandatory fields on the Auto Resume Rule form.
  • 1.2.6

    - Documenation for intial install to include enabling tls in kubernetes
    
    - Upgrade to deltafi/grafana:10.4.2-0
    - Upgrade Java base image to deltafi/deltafi-java-jre:21.0.3-alpine-0
    - Upgrade CI build image to use Java 21.0.3
    - Upgrade Ruby base image to deltafi/deltafi-ruby:3.3.1-alpine3.19-0
  • 1.2.5

    - Documentation for DeltaFile analytics and new survey
    - Additional logging on Egress action errors
    
    - Changed the requeueSeconds property to requeueDuration
    - Changed the deltaFileCache.syncSeconds property to deltaFileCache.syncDuration
    
    - Potential thread interrupt deadlock in HTTP egress actions
    - Potential thread interrupt deadlock in ActionRunner
    - error in `migrate-to-durations.js` migration
    
    - Deprecated survey API documentation
    
    - Deprecation of original `/survey` rest endpoint in favor of the more robust `/api/v1/survey` API.  The original rest endpoint will be removed in 2.0.
    - `/survey` REST endpoint has been deprecated and will be removed in DeltaFi 2.0.  The `/api/v1/survey` API should be used for annotation of survey related data.
    
    - Added DeltaFile schema version tests for v6 and v7
    - Improved UI test reliability and speed.
    
    - The migrate-to-durations.js script (automatically run during installation) updates the deltaFiProperties and
    systemSnapshot Mongo database collections with the following:
      - Replaces requeueSeconds with requeueDuration of "PT{requeueSeconds}S"
      - Replaces deltaFileCache.syncSeconds with deltaFileCache.syncDuration of "PT{deltaFileCache.syncSeconds}S"
      - Replaces REQUEUE_SECONDS with REQUEUE_DURATION in the setProperties array
      - Replaces DELTAFILE_CACHE_SYNC_SECONDS with DELTA_FILE_CACHE_SYNC_DURATION in the setProperties array
      - Replaces DELTA_FILE_CACHE_SYNC_SECONDS with DELTA_FILE_CACHE_SYNC_DURATION in the setProperties array
    - Redis 7.2.4
    - Minio RELEASE.2024-04-06T05-26-02Z
    - Clickhouse 24.3.2-debian-12-r2
  • 1.2.4

    - Added the ability to add Publish Rules to Ingress Actions on the Ingress Actions Page
    - Add Subscriptions to Transform Actions in the Flow Plan Builder Page
    - Presort "By Flow" and "By Message" tabs on Errors Page by flow name
    - Added a Resource.read method that takes a Charset for string decoding
    - Default values for action parameters are now set on the action edit page in the flow builder.
    - Grafana: Ability to create moving averages and linear/polynomial regression on dashboards
    - Grafana: Globally tagged annotations will appear on every dashboard chart
    - Grafana: System Overview chart now has `Global Events` panel to display annotation details
    - Added a new cron schedule UI for Timed Ingress Actions.
    
    - Moved `utils` directory to `bin`.  Left a symlink to utils for backward compatability.
    - Build a virtual environment for `deltafi-python` build to insure broad build compatability
    - Added CI retries on UI eslint and test jobs
    
    - cluster command halts if gradlew fails
    - Do not copy the old cron schedule or target flow when saving a TimedIngressFlow
    - Clustermonitor: Broken app level performance metrics (regression in upgrades)
    - Bad change for testing purposes resulted in malicious MongoDB delete queries
    
    - Update nginx and kubectl base images
    - Move clustermonitor base image to latest Ubuntu LTS
    - Grafana upgrade to 10.4.1
    - Upgrade to DGS 8.4.4
    - Upgrade to Spring Boot 3.2.4
    - Upgrade Palantir Docker plugin to 0.36.0
    - Upgrade Jackson to 2.16.2
    - Upgrade OpenFeign to 13.2.1
    - Upgrade dependencies:
      - commons-compress: 1.26.1
      - commons-io: 2.16.0
      - httpclient: 5.3.1
      - jsch: 0.2.17
      - json: 20240303
      - JSONSchemaGenerator: 4.35.0
      - json-path: 2.9.0
      - json-schema-validator: 1.1.0
      - kubernetes-client: 6.10.0
      - logback-classic: 1.5.3
      - lombok: 1.18.32
      - dropwizard metrics-core: 4.2.25
      - minio-client: 8.5.9
      - nifi-flowfile-packager: 1.25.0
      - tika-core: 2.9.1
    - Upgrade test dependencies:
      - assertj: 3.25.3
      - jupiter: 5.10.2
      - rest-assured: 5.4.0
      - testContainers: 1.19.7
      - wiremock-standalone: 3.5.2
    - Update CI build image to JDK 21.0.2
    - Update base image for Java applications to deltafi/deltafi-java-jre:21.0.2-alpine-0
    - KinD image upgrade to support KinD 0.22.0
    - Upgrade Python dependencies to match 3.12.1 base image
    - Upgrade to ruby 3.3.0 for all Ruby base images
    - Moved UI base image to Node 20 and Alpine 3.19
  • 1.2.3

    - Added the ability to add Publish Rules to Ingress Actions on the Ingress Actions Page
    - Add Subscriptions to Transform Actions in the Flow Plan Builder Page
    - Presort "By Flow" and "By Message" tabs on Errors Page by flow name
    - Added a Resource.read method that takes a Charset for string decoding
    - Default values for action parameters are now set on the action edit page in the flow builder.
    - Grafana: Ability to create moving averages and linear/polynomial regression on dashboards
    - Grafana: Globally tagged annotations will appear on every dashboard chart
    - Grafana: System Overview chart now has `Global Events` panel to display annotation details
    
    - Moved `utils` directory to `bin`.  Left a symlink to utils for backward compatability.
    - Build a virtual environment for `deltafi-python` build to insure broad build compatability
    - Added CI retries on UI eslint and test jobs
    
    - cluster command halts if gradlew fails
    - Do not copy the old cron schedule or target flow when saving a TimedIngressFlow
    
    - Added DeltaFile schema version tests for v6 and v7
    
    - Update nginx and kubectl base images
    - Move clustermonitor base image to latest Ubuntu LTS
    - Grafana upgrade to 10.4.1
    - Upgrade to DGS 8.4.4
    - Upgrade to Spring Boot 3.2.4
    - Upgrade Palantir Docker plugin to 0.36.0
    - Upgrade Jackson to 2.16.2
    - Upgrade OpenFeign to 13.2.1
    - Upgrade dependencies:
      - commons-compress: 1.26.1
      - commons-io: 2.16.0
      - httpclient: 5.3.1
      - jsch: 0.2.17
      - json: 20240303
      - JSONSchemaGenerator: 4.35.0
      - json-path: 2.9.0
      - json-schema-validator: 1.1.0
      - kubernetes-client: 6.10.0
      - logback-classic: 1.5.3
      - lombok: 1.18.32
      - dropwizard metrics-core: 4.2.25
      - minio-client: 8.5.9
      - nifi-flowfile-packager: 1.25.0
      - tika-core: 2.9.1
    - Upgrade test dependencies:
      - assertj: 3.25.3
      - jupiter: 5.10.2
      - rest-assured: 5.4.0
      - testContainers: 1.19.7
      - wiremock-standalone: 3.5.2
    - Update CI build image to JDK 21.0.2
    - Update base image for Java applications to deltafi/deltafi-java-jre:21.0.2-alpine-0
    - KinD image upgrade to support KinD 0.22.0
    - Upgrade Python dependencies to match 3.12.1 base image
    - Upgrade to ruby 3.3.0 for all Ruby base images
    - Moved UI base image to Node 20 and Alpine 3.19
  • 1.2.2

    - UI: Added overall and by-node charts to System Metrics page.
    - Added external link indicators to sidebar menu.
    
    - Fixed panel header height on Ingress Routing page.
    - Fixed a bug when viewing content containing multiple files of different file types.
    - Fixed the handling of carriage returns in the BoundedLineReader
  • 1.2.1

    - Added the ability to add and update Ingress Actions to UI.
    - Added scrollToTop on the actionConfigurationDialog when there are errors
    - UI: Clicking on an action in a `RETRIED` state on the DeltaFile Viewer now shows the error cause and context.
    - UI: Display local git branch in UI when running in development mode.
    
    - Consolidated metrics chart panels on the dashboard into a single Metrics panel and incorporated a timeframe dropdown.
    - Changed default chart refresh interval from 5 minutes to 1 minute.
    - Description is now an editable field for existing flows in the flow plan builder
    - UI: Content Viewer now detects JSON and XML content regardless of `mediaType`.
    - Replaced "Show Acknowledged" button on Errors page with a dropdown of Errors, Acknowledged, and All.
    
    - Fixed bugs with Flow Plan Builder collect fields
    - Fixed headers on all dialogs and in the Flow Plan Builder
    - Fixed issue when you have a property that uses the boolean json schema renderer the initial value put into the renderer is held on even if you try to change it.
    - Fixed issue where our Integer Json Renderer wasnt able to support string forms of numbers.
    - Fixed a bug on the search page that was causing the back button to not behave as expected.
    
    - Moved Calendar into a component.
    
    - Upgrade clustermonitor to kubectl 1.29.1
    - Update nodemonitor to alpine:3.19.1 base image
  • 1.2.0

    - Added automatic Java 21 toolchain selection using `jenv`
    - Added `resolveDeps` tasks to gradle subprojects
    
    - Java toolchain is now 21.x
    
    - Added parallel JUnit test execution to improve build performance when running unit tests
    - ByteBuddy dependency is running in "experimental" mode for Java 21 compatability
    
    - Upgrade Gradle to 8.5
    - Migrate core projects to use Java 21
        NOTE: Plugins running against the new Java action kit must be recompiled with Java 21 toolchain
    - Update CI build image to JDK 21.0.1
    - Update base image for Java applications to deltafi/deltafi-java-jre:21.0.1-alpine-0
  • 1.1.20

    667cf097 · Fix gradle plugin ·
  • 1.1.18

    - UI: Rearranged sidebar menu by moving DeltaFiles above Metrics for improved navigation.
    - `cluster destroy` command will optionally destroy all docker registry contaners and volumes associated with the cluster
    
    - Addressed the following missing features in the python test kit:
      - added DOMAIN, ENRICH, EGRESS, and VALIATE actions
      - added support to check metrics
      - allow DID to be specified by test case
      - Updated Error and Filter result processing to optionally check `context` and `annotations`
      - Fixed bug when checking for a Filter result
    
    - UI: Action Metrics page
    - UI: Action Metrics from Flows page