Hi, I am working on optimizing the process of converting pbf files to Postgres ingestion files with osmosis --write-pgsql-dump. In my case, Osmosis cannot complete the writing of dump files for Europe even in 5 days so I was looking for different options to speed it up and I found the nodeLocationStoreType=InMemory parameter which will read the nodes in memory and thus speed up the process significantly. However, it seems that this is not possible even with a small pbf for Albania for example (43MB) with a machine with 64GB of ram. I get an OutofmemoryError: Java heap space and I have allocated 55GB RAM to JVM with JAVACMD_OPTIONS="-Xmx55G". I don't understand how is this possible and if I am missing something. The command that i use is: osmosis -v --read-pbf-fast file="albania-latest.osm.pbf" --log-progress interval=60 --used-node --write-pgsql-dump enableBboxBuilder=yes enableLinestringBuilder=yes directory=/home keepInvalidWays=no nodeLocationStoreType=InMemory

asked 11 Feb, 10:18

LiliaAngelova's gravatar image

LiliaAngelova
112
accept rate: 0%

Be the first one to answer this question!
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×245
×27
×15

question asked: 11 Feb, 10:18

question was seen: 152 times

last updated: 11 Feb, 10:18

powered by OSQA