How long does it take for you in a moderate server with 8GB RAM? We have experience that update takes significantly longer than actual time period, so which creates ever-growing time lag.

asked 20 Sep '10, 10:27

JaakL's gravatar image

JaakL
27224
accept rate: 0%

edited 20 Sep '10, 13:54

Gnonthgol's gravatar image

Gnonthgol ♦
13.6k15101198


The wiki page for my SotM performance talk has an SVG image for a 8 GB RAM machine showing that you should be able to process a daily diff in under 10 hours. This is an osm2pgsql import however; in case you are talking about an APIDB import using Osmosis, that is likely to take longer. For osm2pgsql, we have seen that using PostgreSQL 8.4 was much slower than 8.3, so make sure you're not running 8.4. Of course, the usual database tuning tips apply (are your imports perhaps interrupted by an auto-vacuum process? can you afford the risk of having fsync=off? have you increased your shared_buffers from the default?). Sometimes, running an "analyze" command on the database also helps.

permanent link

answered 20 Sep '10, 10:59

Frederik%20Ramm's gravatar image

Frederik Ramm ♦
69.0k806261079
accept rate: 24%

Thank you! I have actually seen the slides and your presentation, my question was specifically about minutely and hourly diffs. We had hourly diff import test run of 25 hours or so. We use SAS drives in RAID-0, which should give good raw IO speed, and have applied the basic DB optimizations (no vacuum, increased shared_buffers).

(20 Sep '10, 12:50) JaakL
Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×208
×196
×97
×29

question asked: 20 Sep '10, 10:27

question was seen: 6,365 times

last updated: 20 Sep '10, 13:54

powered by OSQA