D

dbt

The project use traffic data from automatic measurement and corresponding weather data in order to support analyses aimed at answering the question: Do weather conditions impact traffic?

The aim of the project is to design and implement entire data data flow using ETL/ELT tools and methods. The steps include: csv data extract and initial processing (Python), load to AWS S3 Data Lake (Python boto3, AWS CLI), staging (Snowflake) and transformation (dbt core), data warehousing (Snowflake), data prep and EDA (Python, pandas) and visualisation (Streamlit).

A web app and API for analyzing dbt projects for performance, complexity, and compliance https://whetstone.nicholasyager.com

https://public.tableau.com/app/profile/shayne.lussier/viz/ClothingStore-Dashboard/Dashboard

A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.

See the documentation at: https://airflow-dbt-python.readthedocs.io/

dbt demo project.

Example repository using dbt and Snowflake

This prototype project is used for demonstrating unit testing in DBT using static test dataset.

model covid 19 tap

covid 19 dbt tranform