|
I am running a Nominatim install on an EC2 instance with 1TB SSD, 6 processors and 64GB memory for the planet. The process has been running for about a week now. After rank creation, which finished about two days back, the install is stuck at index creation. When I queried pg_stat_activity, I see below as the currently active query: This has started two days ago and still active. On the list of indexes that are created here: https://github.com/openstreetmap/Nominatim/blob/3b4ffea690fdbc84623916f968bee2ba15ee681b/sql/indices.src.sql, this particular index is creation appears before some other spatial indexes. Does that suggest the install will go on for another week or so? Strangely, I don't see the cpu or the ram being utilised by Postgres. CPU is at about 1% usage and memory below 1GB in usage. Do you think the installation is stuk for some reason? When I queried place and placex tables I see some indexes there but not all in indices.src.sql; if for some reason, the process is stuck, can I stop the process and build the remaining indexes manually according to indices.src.sql? Update When I checked pg_stat_activity after 8 hours, I saw now the active query is to create a different index from here. Both the linked sql files have a comment mentioning, These indices are created only after the indexing process is done. Does this mean if I don't care for forward geocoding or search (I am only interested in reverse geo look ups), if I stop the process now I should be fine? Update Finally the entire process finished in 8 days opposed to the 2 days that is given in the official installation instructions |
|
Sounds much like https://github.com/openstreetmap/Nominatim/issues/1476 If that's the case you need to watch the progress and possibly kill the autovacuum several time. After the installation run https://github.com/openstreetmap/Nominatim/blob/master/utils/check_import_finished.php to make sure all required indices got created. Thanks, could you take a look at the update I added to the question?
(01 Jan '20, 03:09)
picmate
The setup.php supports a --reverse-only parameter (http://nominatim.org/release-docs/latest/admin/Import-and-Update/). If you look into https://github.com/openstreetmap/Nominatim/blob/master/lib/setup/SetupClass.php you'll see a couple of indices (those in /sql/indices_search.src.sql) are skipped. The one you mentioned in the original question, idx_placex_rank_address, is needed for reverse.
(01 Jan '20, 12:35)
mtmail
It finished after 8 days. Thanks for the info
(01 Jan '20, 16:58)
picmate
|
How much OSM data are you using? Is it a small extract, a country, or the whole planet? The answer may not help with whether the process is stuck or not, but it could explain how long the process is expected to take.
It is the planet. Thanks