Unable to audit some pages: Error while loading + SSLError
Summary
Some pages can't be audited while they can viewed in a browser
Steps to reproduce
- Take one of the following pages :
- Run a page audit on it (Asqatasun v5.0.0-rc.1)
What is the current bug behavior?
User is presented the error: A problem occured while loading the content of the page.
Here are the logs:
INFO org.asqatasun.webapp.orchestrator.AsqatasunOrchestrator - Launching audit Page on https://www.francecompetences.fr/
WARN org.asqatasun.util.http.HttpRequestHandler - IOException on https://www.francecompetences.fr/
WARN org.asqatasun.util.http.HttpRequestHandler - IOException on https://www.francecompetences.fr/
INFO org.asqatasun.service.command.AbstractScenarioAuditCommandImpl - Loading content for null
WARN org.asqatasun.service.command.AbstractScenarioAuditCommandImpl - Audit Status is ERROR while SCENARIO_LOADING was required
WARN org.asqatasun.service.command.AuditCommandImpl - Audit status isERROR whileCONTENT_ADAPTING was required
WARN org.asqatasun.service.command.AuditCommandImpl - Audit status isERROR whilePROCESSING was required
WARN org.asqatasun.service.command.AuditCommandImpl - Audit status isERROR whileCONSOLIDATION was required
WARN org.asqatasun.service.command.AuditCommandImpl - Audit status isERROR whileANALYSIS was required
INFO org.asqatasun.webapp.orchestrator.AsqatasunOrchestrator - AUDIT COMPLETED:127,https://www.francecompetences.fr/,1615285047127
INFO org.asqatasun.webapp.orchestrator.AsqatasunOrchestrator - Current audit is 127
INFO org.asqatasun.webapp.orchestrator.AsqatasunOrchestrator - Audit page terminated on https://www.francecompetences.fr/
What is the expected correct behavior?
Page should be audited by Asqatasun
Relevant logs and/or screenshots
Trying to load the page with HTTPie leads to an SSL error:
$ http https://www.francecompetences.fr/
http: error: SSLError: HTTPSConnectionPool(host='www.francecompetences.fr', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:852)'),)) while doing GET request to URL: https://www.francecompetences.fr/
$ http https://anzyleduc.fr/
http: error: SSLError: HTTPSConnectionPool(host='anzyleduc.fr', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:852)'),)) while doing GET request to URL: https://anzyleduc.fr/
$ http https://cussy-en-morvan.fr/
http: error: SSLError: HTTPSConnectionPool(host='cussy-en-morvan.fr', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:852)'),)) while doing GET request to URL: https://cussy-en-morvan.fr/
Certificate configuration seem correct on the webserver:
... except all 3 pages have:
- an incomplete chain
- and no CAA
From the user point of view, this is confusing to be able to browse a page and that Asqatasun cannot audit it. Asqatasun looks like the culprit.
Do we have an option when loading the page that we could change? Is it something else?
Possible fixes
(If you can, link to the line of code that might be responsible for the problem)
Edited by Fabrice Gangler