NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum

I installed Openstreetmap on EC2 machine, i read that the whole world need something like 300GB, the hole word compressed is 32GB and Europe is 16GB, so i set 350GB to avoid problems, unfortunately in the the last steps on importing data to db, the process fail with out of space error. I use this command to extract:

sudo -u postgres osm2pgsql --append --database gis --slim -C 12000 /usr/local/share/maps/planet/europe-latest.osm.pbf

Did anyone set openstreetmaps maps and can tail how mach disk space i need for Europe ?

asked 13 Jun '16, 08:07

H_N's gravatar image

H_N
56115
accept rate: 0%

edited 13 Jun '16, 19:45

aseerel4c26's gravatar image

aseerel4c26 ♦
32.6k18248554

Nominatim? Tile server? Overpass server...?

(13 Jun '16, 08:13) Frederik Ramm ♦
1

@Frederik Ramm Mod_tile, renderd, mapnik, osm2pgsql and a postgresql/postgis database

(13 Jun '16, 08:18) H_N
1

I suspect that, compared to what you've read, all bets are off once you specify "--append". I'd be very surprised if many people have tried appending Europe to whatever database they currently have.

It's also worth mentioning that people do keep mapping things, which means that the database keeps getting bigger. What might have fitted on a certain size of machine once won't any more.

(19 Jun '16, 17:19) SomeoneElse ♦

I tried in(16.6.2016) on difirrant disks:

  • The first try 300 GB stop on no more space error.
  • The second try 350 GB also stop on no more space error.
  • Finally in the third try i succeed i put the disk on 400 GB, but in this try i also add the drop flag.
permanent link

answered 20 Jun '16, 04:02

H_N's gravatar image

H_N
56115
accept rate: 0%

edited 20 Jun '16, 12:15

1

How much free space is left? Bear SomeoneElse's comment in mind. The required disk space will increase with further updates, better leave some room or you will run into the same problem again.

(20 Jun '16, 07:54) scai ♦
2

In the middle of the loading(sm2pgsql --append...) it reached 362GB(maximum).

After finish loading all Europe, disk usage is 110GB(include OS and 16GB compressed Europe).

(20 Jun '16, 12:34) H_N

Needing 3 times as much disk space during load compared to afterwards is due to "append" I think. I don't see that when I load without --append (I'd run out of space if I did).

(20 Jun '16, 12:42) SomeoneElse ♦
Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×440
×204
×10

question asked: 13 Jun '16, 08:07

question was seen: 6,116 times

last updated: 20 Jun '16, 12:42

NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum