Commit c95330d4 authored by Neil Spink's avatar Neil Spink

adding APACHE license and updating documentation

parent 02d9ed11
Pipeline #39523152 failed with stages
in 4 minutes and 49 seconds
# Change Log
## 0.0.3 - 2018-12-09
- Introduced a new function called grab-invoke that reads the sites and pages that should be crawled from a file named website-monitor-list.yml
- Improved HTML query for example site
## 0.0.2 - 2018-12-03
- Extended GitLab deployment pipeline
- Automated deployment to AWS using CloudFormation
## 0.0.1 - 2018-11-26
- Tool is able to grab prices from a website
- Wrote unit tests
- Created GitLab deployment pipeline
\ No newline at end of file
This diff is collapsed.
......@@ -24,19 +24,20 @@ Blog | Tag
https://www.clouded.ch/lambda-web-scraper-project-week-1/ | https://gitlab.com/neilspink/aws-lambda-price-grabber/tags/week1
https://www.clouded.ch/lambda-web-scraper-project-week-2/ | https://gitlab.com/neilspink/aws-lambda-price-grabber/tags/week2
https://www.clouded.ch/lambda-web-scraper-project-week-3/ | https://gitlab.com/neilspink/aws-lambda-price-grabber/tags/week3
https://www.clouded.ch/lambda-web-scraper-project-week-4/ | https://gitlab.com/neilspink/aws-lambda-price-grabber/tags/week4
## The programs
## Notes
You must download the libraries before zipping and uploading to AWS lambda.
You must download the libraries before zipping and uploading to AWS lambda. In the build folder run lib-download.sh to get them and clean up lib-remove-sh
In the build folder run lib-download.sh to get them and clean up lib-remove-sh
Unit tests can be run using nose2 which you might need to install
Unit tests can be run using nose2 which you might need to install:
pip install nose2
nose2
The lambda function can be run using the command
The lambda function can be run using the command:
python lambda_function.py
python grab_price.py
python grab_invoke.py
...
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment