Skip to content

WIP: Resolve "Fix Marketo Extractor"

Thomas La Piana requested to merge 104-fix-marketo-extractor into master

Closes #104 (closed)

  • write a utility that generates a config file containing credentials and start_date (each resource can be run independently)
  • write a client.py that can deal with authentication/sending requests (MarketoClient)
  • add a method for getting activity types
  • add a method for getting leads
  • add a method for getting activities
  • write a utility that generates the marketo keyfile
  • write a utility that generates the initial state file (based on the job's start time)
  • implement mypy in the makefile
  • get all code passing mypy checks
  • add a method that dumps out the schema and data using singer core (marketo utils, not client)
  • write a README
  • write some tests
  • create a dockerfile
  • write a makefile with useful commands

Future improvements? (for another MR/umbrella issue)

  • also supports an end_date where it will check responses and stop loading data at a certain time
  • concurrency
  • utilize more generators so the whole response doesn't need to be stored in memory (scalable)
  • ability to choose which fields to load per endpoint
Edited by Thomas La Piana

Merge request reports