Add utilities to execute, convert and distribute Jupyter notebooks as reports.
Problem to solve
As a Meltano user, we use Jupyter notebooks for management reports;
- I’d like to be able to execute and convert Jupyter notebooks in my Meltano project.
- I’d like to be able to distribute pdf reports by email in my Meltano project. (Sendgrid)
- I’d like to be able to distribute markdown reports to Slack in my Meltano project. (Apprise)
- I’d like to be able to distribute markdown reports to Matatika in my Meltano project. (matatika publish)
Target audience
Users who want to create reports and send from their Meltano project.
For example:
- In a Jupyter notebook you could make yourself a daily report on details of Job runs within your Meltano project.
- You could make a weekly summary of some metrics you are tracking through your Meltano project.
Proposal
We want to add our notebook utility plugin to Meltano, which through meltano can handle the executing and converting of a Jupyter notebook.
What does success look like, and how can we measure that?
A notebook plugin that executes Jupyter notebooks and has the ability to convert them, included in the Meltano discovery.yml.
Regression test
(Ensure the feature doesn't cause any regressions)
-
Write adequate test cases and submit test results -
Test results should be reviewed by a person from the team
Links / references
Please note that this was taken from GitLab, to be changed accordingly