This is a static archive of our old OpenStreetMap Help Site. Please post any new questions and answers at community.osm.org.

osm2pgsql on Dedicated Server ???

how to optimization the osm2pgsql on Dedicated Server (centos 7)?

I have 2 of this testing server with:

1) 8 core, 32G RAM， NVME 512GB

2) 8 core, 64G RAM， NVME 512GB

software: Linux (centos 7.6.1810)

/etc/sysctl.conf

vm.swappiness = 0

/etc/security/limits.conf

* soft nofile 1024000
* hard nofile 1024000
* soft nproc unlimited
* hard nproc unlimited
* soft core unlimited
* hard core unlimited
* soft memlock unlimited
* hard memlock unlimited

/etc/fstab

/dev/mapper/centos-root / xfs defaults,noatime,nodiratime 0 0

sh run:

export FLATNODESFILE=/var/osm/nodes.cache

export PBFFILE=/mnt/resource/planet-190805.osm.pbf

export CACHESIZE=30000 # how to optimization this para on differencce HW

export PGPASSWORD=< pg_password >

# /usr/local/share/osm2pgsql/default.style

osm2pgsql --create --hstore --hstore-add-index --cache $CACHESIZE --multi-geometry --unlogged \

--flat-nodes $FLATNODESFILE --number-processes 8 -v \

--host < PG_Server_IP > --port 5432 --database gis --username osm $PBFFILE

any other optimization are need?

osm2pgsql

asked 02 Sep '19, 03:53

Nationals
11●4●4●6
accept rate: 0%

edited 02 Sep '19, 04:20

DateFile Node Way Relation

190722 5330978k 591991k 6917050

(02 Sep '19, 04:15) Nationals

One Answer:

I suggest to set --number-processes to about half your cores, not the full number. Also, 512 GB of disk space will not be sufficient for a full planet import (1 TB is needed and even that will soon run out). This help site also has some recommendations about optimizing your postgresql.conf (e.g. here).

answered 02 Sep '19, 08:29

Frederik Ramm ♦
82.5k●92●720●1273
accept rate: 23%

PG SQL is on another Dedicated Server with 1TB NVME.

(02 Sep '19, 10:53) Nationals