I've been trying to import this beast into PostgreSQL. I've been using EC2 since I don't have enough HDD space myself.

My last attempt on a large EC2 instance, with 850GB, failed because it ran out of disk space. I have a graph to show it hitting the 850GB:

Graph showing disk space running out

I'd like to know approximately how much space I need, or maybe 850GB is way bigger than required and Osmosis is going into an infinite loop?

I couldn't find out how to enable logging on osmosis, so I can see how far it's gone into the import.

The command I'm using is:

time bzcat planet-latest.osm.bz2 | osmosis --read-xml file="/dev/stdin" enableDateParsing=no --write-pgsql user="osm" database="osm" password="osm"

For my next attempt I'll give it 1TB.. I'll update this question appropriately with my results.

asked 14 Feb '11, 00:59

Gerald%20Kaszuba's gravatar image

Gerald Kaszuba
36116
accept rate: 0%

edited 14 Feb '11, 03:13

Update: I had a strange parsing error with Osmosis, so this test is on hold for now. I'm testing my development with australia.osm for now (which was ~3.4GB). I'll update this if I ever get planet.osm going.

(15 Feb '11, 04:55) Gerald Kaszuba

I think there is something wrong.

yevaud, the mapnik-rendering-Server, has this configuration:

/database - sdb - 4x 300GB 10kRPM (RAID10)

the usage is at 60%

permanent link

answered 16 Feb '11, 14:32

josias's gravatar image

josias
59871523
accept rate: 33%

Thanks, I'll look into the problem.

(16 Feb '11, 21:22) Gerald Kaszuba
Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×208
×141

question asked: 14 Feb '11, 00:59

question was seen: 5,443 times

last updated: 16 Feb '11, 21:22

powered by OSQA