Skip to content

Improve examples and operators, add provider, restructure

Simon Sawertrequested to merge
airflow-updates into main

This MR takes a general pass and brings multiple improvements!

Improve examples and operators

  • Use params instead of DagParam
  • Add support for templating
  • Remove util no longer needed
  • Make ValidioIncidentsSensor use poll poke interval

Implement provider

  • Implement Validio as a provider
  • Update the ValidioHook connection to support custom provider type
  • Don't use JSON in the extra field, store secrets in password field (making them encrypted)

Update package layout

  • Mirror common practices for Airflow providers
  • Create one directory (module) per resource type
  • Split classes to one per file (Operators)

Miscellaneous

  • Remove non existing script
  • Add plugin which will work same as entrypoint (required for Airflow to register plugin)
  • General updates to documentation (README and code)
  • Add dev dependencies to have a fully working environment with poetry
  • Add notes about issues with multithreading on macOS
  • Update no_proxy workaround to work for all endpoints (*)

Merge request reports