Create a GitHub Action for Meltano ELT

Summary

GitHub Actions are a CI/CD offering with capabilities similar to those of GitLab CI, except that they can be published to the a marketplace where they get more visibility and users can add them to their projects with one click.

This action would be useful for developers that are first trying out Meltano, or don't need a full Kubernetes/cloud deployment with an orchestrator, metrics UIs, etc.

Proposed benefits

Give users that want to try out Meltano for ELT a way that is quick and easy.

Proposal details

  • A composite action is probably easier but we can consider a docker action too. Either way, the action would install the latest or some configurable Meltano version for the user and any other dependencies, and also run meltano install.

  • Inputs to the job could be: tap, target, job_id, transform and log_level to compose a command like

    meltano --log-level={log_level} elt {tap} {target} --job_id={job_id} --transform={transform}

Best reasons not to build

This only solves ELT and very basic orchestration needs. No fancy UI for jobs and retries are manual.