This is a static archive of our old OSM Help Site. Please post any new questions and answers at community.openstreetmap.org.

Problem importing europan map

0

Hi guys and thanks in advance. I have installed nominatim on my local (virtual) centOS 6.6 machine following the wiki guide there http://wiki.openstreetmap.org/wiki/Nominatim/Installation. I follow the instructions line to line and I manage to import a little map (monaco-latest.osm.pbf) and everything goes fine. Now I tried to import the european map (15.8 gb), i follow the same procedure, I launch the command:

nohup ./utils/setup.php --osm-file european.latest.osm.pbf --all --osm2pgsql-cache 18000 2>>err.log 1>>setup.log &

On a (virtual) machine with 500 gb disk space and 16 gb RAM. Now after 20 hours if I open the setup.log I can see some create table (9 exactly) and many insert; the file end with IMPORT command. If I open the err.log I can see something like this:

NOTICE:  table "place" does not exist, skipping
NOTICE:  type "keyvalue" does not exist, skipping
NOTICE:  type "wordscore" does not exist, skipping
NOTICE:  type "stringlanguagetype" does not exist, skipping
NOTICE:  type "keyvaluetype" does not exist, skipping
NOTICE:  function get_connected_ways(pg_catalog.int4[]) does not exist, skipping
Allocating memory for dense node cache
Allocating dense node cache in one big chunk
Allocating memory for sparse node cache
Sharing dense sparse Node-cache: cache=2048MB, maxblocks=262144*8192, allocation method=11 Mid: pgsql, scale=10000000 cache=2048
Setting up table: planet_osm_nodes
NOTICE:  table "planet_osm_nodes" does not exist, skipping
Setting up table: planet_osm_ways
NOTICE:  table "planet_osm_ways" does not exist, skipping
Setting up table: planet_osm_rels
NOTICE:  table "planet_osm_rels" does not exist, skipping
Reading in file: /srv/mappe/europe-latest.osm.pbf
Processing: Node(10k 10.0k/s) Way(0k 0.00k/s) Relation(0 0.00/s)
Processing: Node(20k 20.0k/s) Way(0k 0.00k/s) Relation(0 0.00/s)
.....
.....

This file ended exactly with this line and no error:

Processing: Node(1561860k 141.1k/s) Way(6002k 0.04k/s) Relation(0 0.00/s)

When I see this scenario the first time I kill the process, delete the database and reimport the map again. But is the THIRD TIME that the error.log ended exactly with that line, exactly at Node 1561860. The process is still present in ps -aux list and the postgresql data folder is still growing and if I launch the following command:

psql -d postgres -c "select * from pg_stat_activity where datname = 'nominatim'"

I can see some log (but outdated). What damned is happening? Why the log stops exactly at that line? Why stops if there is no error? Maybe the map file is corrupted? Please help me I don't know what I have to do. Thanks Giacomo

Sorry for my stupidity... The process is not stucked, is working on node 1561860 and way growing very slowly... when I launch tail -f I didn't see that Way(x,y) parameter is growing.. I believed it was fixed to a specific value.

Sorry, I have to delete the entire post?? Just last question: the --osm2pgsql-cache value should be half of RAM memory?? How can I determine that??

Thanks Giacomo

asked 22 Oct '15, 11:37

giacomo-keybiz's gravatar image

giacomo-keybiz
33101013
accept rate: 0%

edited 22 Oct '15, 12:06