NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum

I'm currently trying to import an osm planet file into my GIS render DB using osm2pgsql and the import keeps failing at the same point.

I ran pgtune prior to running the ingest. I have autovac set to off

I'm running a linux server with 16 cores and 64 GB ram.
postgresql 9.2 osm2pgsql 0.86

I have run the following with 16GB, 24GB and 40GB Cache using 4 processors.

nohup time osm2pgsql --create --proj 3857 --style /usr/local/share/osm2pgsql/default.style -j --slim -C 40000 --number-processes 4 --database gis /home/centos/APIdbplanet.osm

Each time I get the following error:

node cache: stored: 3180786074(100.00%), storage efficiency: 83.61% (dense blocks: 434757, sparse nodes: 121306150), hit rate: -nan% Osm2pgsql failed due to ERROR: CREATE INDEX planet_osm_ways_nodes ON planet_osm_ways USING gin (nodes) WITH (FASTUPDATE=OFF) ; failed: ERROR: invalid memory alloc request size 2013265920

I have a hard time thinking that this is a memory issue. Any help would be great. Thanks.

asked 04 May '16, 15:26

Cellington's gravatar image

Cellington
21691015
accept rate: 0%

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×710
×263
×196
×56

question asked: 04 May '16, 15:26

question was seen: 3,066 times

last updated: 04 May '16, 15:26

NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum