airflow

Simulation of a real hospital scenario with a ML model in production

DluOne Data Composer for Data Engineering and Data Science

This is a repo with scripts for Data Science and Engineering quick start with docker

I'm using personally for my daily work and side projects

Airflow pipeline, mainly for exploration and self-learning, but particularly for scraping LINE Webtoon data and store it in external MySQL database. The ingested data are used to create dashboard on https://ammarchalifah.com/webtoon-insights

Some basic Apache Airflow DAGs running ML-Workflows. This project is part of the lecture Business Computing at the HTWSaar in south-west Germany.

Airflow data processing with Ansible and LXD