Hi, I'm doing a full planet ingest using osm2pgsql on an Amazon AWS instance. I've given it a 25 gb cache using slim mode, and it's been very speedy. I started the process yesterday morning and now we're at the "Going over pending ways" portion. I'm concerned however that the process has stalled out. My log file has not updated for 2 hours and I am stuck at
And that's the end of my log file. When it was processing the nodes/ways/rels, at least I got an update of how far it was, but now it seems to have possibly stalled since nothing has updated in 2 hours. How can I tell how far along this portion of the process is? Or, how can I tell if it has stalled out? asked 11 Jun '15, 16:23 pixelk8e |
There are current versions of osm2pgsql that don't provide any output during that stage. For estimated times for import see http://wiki.openstreetmap.org/wiki/Osm2pgsql/benchmarks Note that due to OSM data growth these are always out of date (but can give you a rough indication). answered 12 Jun '15, 18:58 SimonPoole ♦ |
Did you already check CPU usage and I/O load of your osm2pgsql process?
Yes, it is using ~10-20% of the cpu at any given time (averaging at about 14%), but i/o seems to be nonexistent (I'm running osm2pgsql to a database on another instance, so that makes sense to me). But I'm still concerned it's chugging away at nothing.
What does "wa" (I/O wait) say in
top
?