I have already imported the OSM Planet to the database. And I want to update the database regularly. The update command I use is osm2pgsql --append -slim with 6GB cache. However, the update process is still too slow. Hardware: 32G memory, 1.7TB SSD. Database config:
On average it took 1 hour to process 6 hours worth of new OSM updates. (Screenshot is the log printed by the script openstreetmap-tiles-update-expire. Inside the script, it calls osm2pgsql --append -slim) I remember when bulk loading OSM Planet to the database, a lot of articles suggest modifying postgresql.conf Such as: fsync = off (import only!) autovacuum = off (import only!) Since the database is keep updating, should I change the postgresql config settings back to these import settings to increase performance? asked 02 Dec '20, 20:38 Yingcai |
I am not sure what screen shot is about, this doesn't look like osm2pgsql output!? There is some advice on how to tune your database for osm2pgsql in the osm2pgsql manual at https://osm2pgsql.org/doc/manual.html#tuning-the-postgresql-server . answered 03 Dec '20, 09:27 Jochen Topf The screenshot is the log printed by the script openstreetmap-tiles-update-expire (mod_tile https://github.com/SomeoneElseOSM/mod_tile/tree/switch2osm ). Inside the script, it calls osm2pgsql --append -slim
(04 Dec '20, 19:53)
Yingcai
|
Could you indicate what hardware this is running on and your original import parameters?
(for completeness - that screenshot looks like output from openstreetmap-tiles-update-expire)
Thanks @simonPoole and @SomeoneElse. The post has been updated.