• Slack's avatar
    Try to fix Google Play scraper for actual deployment setting · 3bae1cf1
    Slack authored
    It would appear that Google explicitely blocks requests with a Browser
    user agent if they originate from a server IP address (Google knows
    about). To circumvent this we would either need to use a proxy or a
    different user agent. The curl user agent seems to be working for now so
    let's try and use that.
    
    Additionally it seems that Google returns slightly altered content
    depending on the originating IP address of the request. This might make
    reliably unit tests impractical. If it turns out that Google takes other
    measures to prevent scraping I will remove the scraper because I'm not
    going to play chicken with Google.
    3bae1cf1
Name
Last commit
Last update
celery_conf Loading commit data...
contact Loading commit data...
db Loading commit data...
descgen Loading commit data...
docker Loading commit data...
public_static Loading commit data...
settings Loading commit data...
static Loading commit data...
templates Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
.gitlab-ci.yml Loading commit data...
Dockerfile Loading commit data...
LICENSE Loading commit data...
README.md Loading commit data...
__init__.py Loading commit data...
gunicorn.py.ini Loading commit data...
manage.py Loading commit data...
requirements.deploy.txt Loading commit data...
requirements.txt Loading commit data...
urls.py Loading commit data...
wsgi.py Loading commit data...