Having issue downloading a large dataset

[ryan-routethis]

I am trying to pull the building feature layer for all of South Africa (roughly 20GB), and I keep on encountering this error:

OSError: AWS Error NETWORK_CONNECTION during GetObject operation: curlCode: 28, Timeout was reached
Error downloading full dataset: Command '['overturemaps', 'download', '--bbox', '16.2816999,-47.1313489,38.2216904,-22.1254239', '-f', 'geojson', '-t', 'building', '-o', 'buildings_South_Africa_full.geojson']' returned non-zero exit status 1.

I've downloaded large maps before like the whole of Ontario, Canada which is over 30GB and the download was successful . This problem has been occurring for the last three days, and is usually timing out once it has been running for 4500-5000+ seconds. I am running it using the python interface through a script I created to download the map and upload to our ArcGIS account. Like I said, I've been running into no issues until three days ago. Some support would be greatly appreciated. Thank you very much.

[ryan-routethis]

Hello,

I would like to follow up on this issue. It is still occurring and is happening to me at around the 500 second mark of runtime. I am trying to download the building layer for Guernsey, UK. This is the message I am getting:

OSError: AWS Error NETWORK_CONNECTION during GetObject operation: curlCode: 28, Timeout was reached
Error downloading data: Command '['overturemaps', 'download', '--bbox', '-8.8988999,34.5614,33.9165549,60.91569999999999', '-f', 'geojson', '-t', 'building', '-o', 'Guernsey,_UK_buildings.geojson']' returned non-zero exit status 1.

Support would be greatly appreciated. Thank you.

[mtravis]

@ryan-routethis I've also encountered this exact same error over the last few days.

My steps can be replicated here: https://docs.overturemaps.org/examples/lonboard/#geopandas

[brad-richardson]

@ryan-routethis @mtravis Could you share more info about your setup? These would be a good start:

1. python version
2. pip list | grep -E 'overturemaps|numpy|pyarrow|shapely|geopandas'
3. OS + version

I'll try reproducing it myself later today

[brad-richardson]

@ryan-routethis Actually, it looks like this might be a memory issue - your bbox covers a fairly large area