Nominatim 2.4 install. /usr/bin/php -Cq ./utils/setup.php --osm-file /vol/north-america-latest.osm.pbf --all --osm2pgsql-cache 7000 It runs: /home/nominatim/Nominatim-2.4.0/nominatim/nominatim -i -d nominatim -P 5432 -t 3 -r 5 -R 25 Slow - been running 12 + hours and the log is not changing. Load is 3 cores on a 4 core box. Last log entry is Functions. Node stats: total(783686820), max(3646699746) in 2396s Way stats: total(51666293), max(360069395) in 4044s Relation stats: total(460477), max(5360296) in 456s Setting up table: planet_osm_nodes Setting up table: planet_osm_ways Setting up table: planet_osm_rels Going over pending ways... 0 ways are pending Using 1 helper-processes ^MFinished processing 0 ways in 0 sec Going over pending relations... 0 relations are pending Using 1 helper-processes ^MFinished processing 0 relations in 0 sec Stopping table: planet_osm_nodes Stopping table: planet_osm_rels Building index on table: planet_osm_rels Stopping table: planet_osm_ways Stopped table: planet_osm_nodes in 0s Stopped table: planet_osm_ways in 0s Stopped table: planet_osm_rels in 12s node cache: stored: 645470369(82.36%), storage efficiency: 70.35% (dense blocks: 557656, sparse nodes: 173232129), hit rate: 84.20% Osm2pgsql took 6910s overall Functions Postgres activity: nominatim | 20565 | idle | select place_id from placex where rank_search = $1 and geometry_sector = $2 and indexed_status > 0 nominatim | 20374 | idle | insert into placex (osm_type, osm_id, class, type, name, admin_level, housenumber, street, addr_place, isin, postcode, country_code, extratags, geometry) select * from place where osm_id % 3 = 0 nominatim | 20375 | idle | insert into placex (osm_type, osm_id, class, type, name, admin_level, housenumber, street, addr_place, isin, postcode, country_code, extratags, geometry) select * from place where osm_id % 3 = 1 nominatim | 20376 | idle | INSERT INTO import_status VALUES('2015-07-11 18:13') nominatim | 20566 | active | update placex set indexed_status = 0 where place_id = $1 nominatim | 20567 | active | update placex set indexed_status = 0 where place_id = $1 nominatim | 20568 | active | update placex set indexed_status = 0 where place_id = $1 postgres | 26833 | active | SELECT datname,pid,state,query FROM pg_stat_activity; Why would there be 3 of these? And what is it trying to do? update placex set indexed_status = 0 where place_id = $1 asked 13 Jul '15, 15:11 Bill Bell |
Here is relevant area of TOP. Going VERY slow.
top - 14:16:31 up 1 day, 7:29, 1 user, load average: 3.00, 3.01, 3.00 Tasks: 145 total, 6 running, 139 sleeping, 0 stopped, 0 zombie %Cpu(s): 75.3 us, 0.1 sy, 0.0 ni, 24.6 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st KiB Mem: 31416208 total, 31201488 used, 214720 free, 172412 buffers KiB Swap: 0 total, 0 used, 0 free. 29675768 cached Mem
20566 postgres 20 0 4498792 3.329g 3.286g R 99.8 11.1 585:09.61 postgres
20567 postgres 20 0 4504124 3.328g 3.284g R 99.8 11.1 585:06.06 postgres
20568 postgres 20 0 4503440 3.292g 3.249g R 99.8 11.0 585:08.31 postgres
A second apart - /vol is where postgres is. 16 bytes?
/dev/xvdb 769018760 145604728 584327092 20% /vol
/dev/xvdb 769018760 145604744 584327076 20% /vol
I was using nohup and it seems that PHP stops writing to the log file. I switches to screen and it appears to log now.
I am playing with the postgres config, to se right memory, and right now it is running.
To others: use screen! If it gets stuck restart with:
./utils/setup.php -v --create-functions --index --create-search-indices --osm2pgsql-cache 10000
This also helps: http://pgtune.leopard.in.ua/