NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum

Nominatim 2.4 install.

/usr/bin/php -Cq ./utils/setup.php --osm-file /vol/north-america-latest.osm.pbf --all --osm2pgsql-cache 7000

It runs: /home/nominatim/Nominatim-2.4.0/nominatim/nominatim -i -d nominatim -P 5432 -t 3 -r 5 -R 25

Slow - been running 12 + hours and the log is not changing. Load is 3 cores on a 4 core box. Last log entry is Functions.

Node stats: total(783686820), max(3646699746) in 2396s

Way stats: total(51666293), max(360069395) in 4044s

Relation stats: total(460477), max(5360296) in 456s

Setting up table: planet_osm_nodes

Setting up table: planet_osm_ways

Setting up table: planet_osm_rels

Going over pending ways... 0 ways are pending

Using 1 helper-processes ^MFinished processing 0 ways in 0 sec

Going over pending relations... 0 relations are pending

Using 1 helper-processes

^MFinished processing 0 relations in 0 sec

Stopping table: planet_osm_nodes

Stopping table: planet_osm_rels

Building index on table: planet_osm_rels

Stopping table: planet_osm_ways

Stopped table: planet_osm_nodes in 0s

Stopped table: planet_osm_ways in 0s

Stopped table: planet_osm_rels in 12s

node cache: stored: 645470369(82.36%), storage efficiency: 70.35% (dense blocks: 557656, sparse nodes: 173232129), hit rate: 84.20%

Osm2pgsql took 6910s overall

Functions

Postgres activity:

nominatim | 20565 | idle | select place_id from placex where rank_search = $1 and geometry_sector = $2 and indexed_status > 0

nominatim | 20374 | idle | insert into placex (osm_type, osm_id, class, type, name, admin_level, housenumber, street, addr_place, isin, postcode, country_code, extratags, geometry) select * from place where osm_id % 3 = 0

nominatim | 20375 | idle | insert into placex (osm_type, osm_id, class, type, name, admin_level, housenumber, street, addr_place, isin, postcode, country_code, extratags, geometry) select * from place where osm_id % 3 = 1

nominatim | 20376 | idle | INSERT INTO import_status VALUES('2015-07-11 18:13')

nominatim | 20566 | active | update placex set indexed_status = 0 where place_id = $1

nominatim | 20567 | active | update placex set indexed_status = 0 where place_id = $1

nominatim | 20568 | active | update placex set indexed_status = 0 where place_id = $1

postgres | 26833 | active | SELECT datname,pid,state,query FROM pg_stat_activity;

Why would there be 3 of these? And what is it trying to do?

update placex set indexed_status = 0 where place_id = $1

asked 13 Jul '15, 15:11

Bill%20Bell's gravatar image

Bill Bell
11113
accept rate: 0%

edited 13 Jul '15, 18:54

Here is relevant area of TOP. Going VERY slow.

top - 14:16:31 up 1 day, 7:29, 1 user, load average: 3.00, 3.01, 3.00 Tasks: 145 total, 6 running, 139 sleeping, 0 stopped, 0 zombie %Cpu(s): 75.3 us, 0.1 sy, 0.0 ni, 24.6 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st KiB Mem: 31416208 total, 31201488 used, 214720 free, 172412 buffers KiB Swap: 0 total, 0 used, 0 free. 29675768 cached Mem

20566 postgres 20 0 4498792 3.329g 3.286g R 99.8 11.1 585:09.61 postgres
20567 postgres 20 0 4504124 3.328g 3.284g R 99.8 11.1 585:06.06 postgres
20568 postgres 20 0 4503440 3.292g 3.249g R 99.8 11.0 585:08.31 postgres

A second apart - /vol is where postgres is. 16 bytes?

/dev/xvdb 769018760 145604728 584327092 20% /vol

/dev/xvdb 769018760 145604744 584327076 20% /vol

(13 Jul '15, 15:20) Bill Bell

I was using nohup and it seems that PHP stops writing to the log file. I switches to screen and it appears to log now.

I am playing with the postgres config, to se right memory, and right now it is running.

To others: use screen! If it gets stuck restart with:

./utils/setup.php -v --create-functions --index --create-search-indices --osm2pgsql-cache 10000

(14 Jul '15, 04:37) Bill Bell
(14 Jul '15, 04:38) Bill Bell

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×689

question asked: 13 Jul '15, 15:11

question was seen: 3,003 times

last updated: 14 Jul '15, 04:38

NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum