Skip to content
  • Martin Eve's avatar
    🚀 chore(CHANGELOG.md): update version to 0.0.9 and add push_json_to_s3 method · 8626eeb2
    Martin Eve authored
     feat(README.md): add streaming upload to S3 to handle large JSON files
    🔧 chore(pyproject.toml): add smart-open to dependencies
    🔧 chore(requirements.txt): add smart-open to dependencies
    🔧 chore(setup.cfg): update version to 0.0.9 and add smart-open to dependencies
     feat(aws_utils.py): add push_json_to_s3 method
    The version has been updated to 0.0.9 and a new method push_json_to_s3 has been added to the AWSConnector class. This method writes JSON data to S3 using a streaming approach, which allows for handling of large JSON files. The smart-open package has been added as a dependency to support this new method.
    8626eeb2