update tables using delta

K. Reddickrequested to merge
dev into main

utilize databricks delta tables instead of writing files with parquet.

Merge request reports