Skip to content

Update MeltanoAnalysisFileParser to namespace different topics

Yannis Roussos requested to merge 970-update-m5o-compiler-to-namespace-different-topics into master

Merge Request Checklist

  • Link to an issue
  • Include the proposed fix or feature
  • Include and update tests for the modified code
  • Include a documentation change
  • Add a CHANGELOG.md entry in the Unreleased section

This MR updates MeltanoAnalysisFileParser to namespace different topics. It also updates the controllers affected by this change and adds the namespace of a topic as a required parameter.

Summary of Updates:

  • Packages and custom topics in different directories are properly isolated and namespaced
  • Output directory for compiled m5oc files has been updated to .meltano/run/models/
  • Support for multi sub-folders with custom models under project/model/
  • Topics.index is now indexed using the topic['namespace']/topic['name']
  • Entries in Topics.index also include the Topic's name and namespace
  • Update the API controllers to support namespaced topics and the new location m5oc files are located.
  • Update Meltano UI Dashboards and Reports, so that they are also located under .meltano/run/models/
  • Update all tests that were affected by the aforementioned updates.

Closes #970 (closed)

Merge request reports