D

data-ingestion

Elasticsearch ingest pipeline validation. https://estceque.touhey.pro/

Transpiler for data processing pipelines. https://mustash.touhey.pro/

A Streamlit+Snowflake app for automatically loading uploaded CSV files to brand new tables in a staging area.

Ingest SFTP path into S3 container, configured by args and environment variables. Concurrently download sftp files in a path and copy inside a S3 prefix.