-
Martin Eve authored
✨ feat(README.md): add streaming upload to S3 to handle large JSON files🔧 chore(pyproject.toml): add smart-open to dependencies🔧 chore(requirements.txt): add smart-open to dependencies🔧 chore(setup.cfg): update version to 0.0.9 and add smart-open to dependencies✨ feat(aws_utils.py): add push_json_to_s3 method The version has been updated to 0.0.9 and a new method push_json_to_s3 has been added to the AWSConnector class. This method writes JSON data to S3 using a streaming approach, which allows for handling of large JSON files. The smart-open package has been added as a dependency to support this new method.8626eeb2