Skip to content

Add pipeline details (extractor,loader and transform) into tags

Pankaj Saini requested to merge pankajsaini-ldt/files-airflow:5-add-tags-to-allow-filter-dags-by-tag into master

Closes #5 (closed)

This MR only addresses adding pipeline details into tags. Extracting transform(dbt) tags from transform models does not seem a very nice idea because of two reasons.

  1. As dbt models allow adding any number of tags, rendering all these tags in airflow might make the UI a bit messy.
  2. There are usually a number of dbt models associated with a tap transform, it will again make the number of tags very high in airflow.

Merge request reports