NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum

We are trying to generate map tiles of the entire world, and at a certain stage we get the error "invalid memory alloc request size 1677721600" and we cannot proceed.

When we generate a small country it is done fine, but when working on the entire world, the tile generation stops after 25/30% and 85/90%.

How to proceed?

asked 09 Jul '13, 20:25

Agnoletti's gravatar image

Agnoletti
26114
accept rate: 0%

edited 18 Apr '15, 02:38

aseerel4c26's gravatar image

aseerel4c26 ♦
32.6k18248554

Would it be possible to provide a few more details about the setup you're using, including the hardware spec of the box that the rendering is running on? Also - there's more than one way to generate map tiles, so details what you're actually running that's running out of memory would help.

(10 Jul '13, 01:55) SomeoneElse ♦

Hi SomeoneElse, A bit more info:

The error occured during transfer *.osm.bz2 to PostgreSQL database when using osm2pgsql.

Hardware:

  • Intel(R) Xeon(R) CPU E31240 @ 3.30GHz (4x2)

  • Available RAM ~20 GB

  • HDD - 2.7 TB

  • Ubuntu 11.04

Software:

  • PostgreSQL 9.2

  • PostGIS 2.0

  • osm2pgsql 0.69

For view and editing map style (CartoCSS) was used TileMill.

Pls let me know if more info is needed.

(10 Jul '13, 09:13) Agnoletti

What is your work_mem and maintenance_work_mem in postgresql set to?

permanent link

answered 13 Jul '13, 10:18

pnorman's gravatar image

pnorman
2.4k52140
accept rate: 18%

In postgresql.conf:

work_mem = 1024MB

maintenance_work_mem = 2048MB

shared_buffers = 1024MB

temp_buffers = 64MB

Last running command:

sudo -u postgres osm2pgsql -m -c -d gis --slim -C 10000 planet-latest.osm.bz2

Additionally:

Approx free RAM on the server ~20GB. Was using default configure file (styles) /usr/share/osm2pgsql/default.style

(15 Jul '13, 20:17) Agnoletti

Is there anything in the PostgreSQL server logs? It might be that you need to run a re-index on the tables as there could be some weird corruption.

permanent link

answered 22 Jul '13, 09:34

Scott07's gravatar image

Scott07
36336
accept rate: 0%

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×165

question asked: 09 Jul '13, 20:25

question was seen: 2,718 times

last updated: 18 Apr '15, 02:38

NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum