|
Hi! I am using generate_tiles.py script to generate tiles but it is taking awfully long time for whole Europe. It was generating tiles really fast for just one town, but whole Europe seems to be taking forever. Basicaly I followed this tutorial: http://openstreetmapserverwindows.blogspot.ie/2015/11/osmopenstreetmap-tile-server.html to set up everything on Windows Server 2012 64-bit and we made it. Importing whole Europe from http://download.geofabrik.de/ took 15 days (wow!) probably because we have HDD instead of SSD disk on our server. Our processor is Xenon 3.5 GHz and 32 GB RAM. I started generate_tiles.py 10 minutes ago for zoom level (3-16) 10 minutes ago and I got only 135 tiles so far ;-( (it is processing zoom level 6 now...). This is terribly slooow. How can we speed up this process so that we get all tiles for zoom level (3-16) in at least 1 month? :-) This is serious question. Looking in Windows "Resource Monitor" I see 4 postgres.exe processes reading data with average speed between ~ 500 and ~ 2500 B/s - isn't this terribly slow ? Maybe we should tweak Postgres to speed it up ? I can provide further technical details and settings I used in files if needed. Thank you. |
|
The style your using should provide recommendations for partial indexes. Beyond that, general PostgreSQL tuning is applicable, mainly work_mem. https://www.geofabrik.de/media/2012-09-08-osm2pgsql-performance.pdf has some recommendations, but mainly as they apply to importing, and for an older PostgreSQL version. Most styles are slowest per tile at low zooms, particularly zoom 6-9. If you are using https://svn.openstreetmap.org/applications/rendering/mapnik/generate_tiles.py you need to adjust the default NUM_THREADS to reflect your CPU. Unfortunately, generate_tiles.py generates tiles one by one instead of rendering a larger area and cutting the image to size like mod_tile. This probably makes it 4 to 16 times slower than mod_tile. Pre-rendering to zoom 16 isn't practical with most styles. The OSMF rendering servers pre-render to zoom 12, and this takes about a day. Each zoom has 4x the number of tiles, so you're looking at about 300x as many tiles as zoom 12. |
|
OK, nevermind. I noticed there is generate_tiles_multiprocess.py script , I changed NUM_THREADS to 8 and used and it generated half million tiles over the night already :-) It is processing zoom level 12 now, so I think it should be done over next few days. |