This is a static archive of our old OpenStreetMap Help Site. Please post any new questions and answers at community.osm.org.

Import crashed at “going over pending ways”

I ran an import of the full planet file in slim mode. It seems to have successfully imported the data, but then it crashed when going over pending ways. The log before the crash looks like this:

Node stats: total(3545099707), max(4418326239) in 4387s
Way stats: total(369751285), max(444345685) in 192701s
Relation stats: total(4509999), max(6610383) in 264005s
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads

Going over pending ways...
Maximum node in persistent node cache: 4418699263

Is it possible to resume the import for the remaining steps?

planet import ways

asked 24 Oct '16, 09:48

johnNM
11●1●1●2
accept rate: 0%

edited 24 Oct '16, 09:49

What platform and version?

https://www.google.co.uk/search?q="Maximum+node+in+persistent+node+cache"

suggests that you might be using an old non-64-bit-aware version, and you may need to upgrade.

(24 Oct '16, 09:57) SomeoneElse ♦

Thank you @SomeoneElse. Apologies for not including additional info. My specs are as follows:

Ubuntu 14.04 LTS 700GB disk 30GB RAM

I used the following command:

sudo -u offlineuser osm2pgsql --create-d gis --slim --flat-nodes ~/osm/flat_nodes.bin -C 14000 --number-processes 4 --style ~/osm/openstreetmap-carto/openstreetmap-carto.style --multi-geometry /home/offlineserver/planet-latest.osm.pbf

(24 Oct '16, 10:24) johnNM

What does "osm2pgsql -h -v | grep -i version" say?

(24 Oct '16, 10:44) SomeoneElse ♦

osm2pgsql SVN version 0.85.0 (64bit id space)

(24 Oct '16, 11:36) johnNM