NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum

Hi, I am working on optimizing the process of converting pbf files to Postgres ingestion files with osmosis --write-pgsql-dump. In my case, Osmosis cannot complete the writing of dump files for Europe even in 5 days so I was looking for different options to speed it up and I found the nodeLocationStoreType=InMemory parameter which will read the nodes in memory and thus speed up the process significantly. However, it seems that this is not possible even with a small pbf for Albania for example (43MB) with a machine with 64GB of ram. I get an OutofmemoryError: Java heap space and I have allocated 55GB RAM to JVM with JAVACMD_OPTIONS="-Xmx55G". I don't understand how is this possible and if I am missing something. The command that i use is: osmosis -v --read-pbf-fast file="albania-latest.osm.pbf" --log-progress interval=60 --used-node --write-pgsql-dump enableBboxBuilder=yes enableLinestringBuilder=yes directory=/home keepInvalidWays=no nodeLocationStoreType=InMemory

asked 11 Feb '22, 10:18

LiliaAngelova's gravatar image

LiliaAngelova
11112
accept rate: 0%

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×252
×28
×15

question asked: 11 Feb '22, 10:18

question was seen: 515 times

last updated: 11 Feb '22, 10:18

NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum