A

airflow

Data engineering pipeline for professional tennis match data (ATP & WTA), built with Airflow, dbt, Python and PostgreSQL.

Utilized Airflow and Selenium to scrape weather forecast and send email alerts regarding extreme weather. Thresholds for extreme weather are defined in an external settings (yml) file. Quarto was used for documentation: https://avivfaraj.gitlab.io/weather-alerts/ .

Simulation of a real hospital scenario with a ML model in production

DluOne Data Composer for Data Engineering and Data Science

This is a repo with scripts for Data Science and Engineering quick start with docker

I'm using personally for my daily work and side projects

Airflow pipeline, mainly for exploration and self-learning, but particularly for scraping LINE Webtoon data and store it in external MySQL database. The ingested data are used to create dashboard on https://ammarchalifah.com/webtoon-insights

Some basic Apache Airflow DAGs running ML-Workflows. This project is part of the lecture Business Computing at the HTWSaar in south-west Germany.

Airflow data processing with Ansible and LXD