Missing funder locations in production REST API
Background
In production funder 501100008028 has location null:
"location": null
In staging the location is not null:
"location": "Spain"
These discrepancies might have something to do with sws.geonames.org's requests limit.
We call sws.geonames.org to obtain the country name. We cache the results, so in theory we should be making <300 requests. sws.geonames.org's limit is 1000/hour.
However, our cache seems to be currently using only 32 "slots". Locally on my laptop, the ingesting code requested data from sws.geonames.org ~1800 times, which exceeds the limit.
We should try to increase the number of slots and check how it affects the number of null country names for funders.
Definition of ready
-
Product owner: @ppolischuk1 -
Tech lead: @dtkaczyk -
Service:: label applied -
Definition of done updated -
Weight applied
Definition of done
-
Code reviewed -
Available via a staging URL -
Knowledge base reviewed and updated -
Acceptance criteria met -
funder ingestion does not exceed sws.geonames.org's requests limit
-
Notes
Edited by Dominika Tkaczyk