After a week of importing, I hit an error due to an unrelated db issue. Is it in any way possible to pick up and continue the last ~3 hours of the relations import?

Reading in file: /osm/data/planet-220516.osm.pbf
Using PBF parser.
Processing: Node(7685383k 248.6k/s) Way(858972k 2.10k/s) Relation(9501590 59.22/s)WARNING:  terminating connection because of crash of another server process
DETAIL:  The postmaster has commanded this server process to roll back the current transaction and exit, because another server process exited abnormally and possibly corrupted shared memory.
HINT:  In a moment you should be able to reconnect to the database and repeat your command.
WARNING:  terminating connection because of crash of another server process
DETAIL:  The postmaster has commanded this server process to roll back the current transaction and exit, because another server process exited abnormally and possibly corrupted shared memory.
HINT:  In a moment you should be able to reconnect to the database and repeat your command.
terminate called after throwing an instance of 'std::runtime_error'
  what():  result COPY_END for planet_osm_polygon failed: SSL SYSCALL error: EOF detected

asked 31 May, 09:33

JamesPep's gravatar image

JamesPep
16123
accept rate: 0%


No, unfortunately it is not possible to pick up where the import crashed.

Note that one week for the import seems to be on the long side. Have you read the chapters on tuning the database in the manual? https://osm2pgsql.org/doc/manual.html#tuning-the-postgresql-server

permanent link

answered 01 Jun, 08:15

Jochen%20Topf's gravatar image

Jochen Topf
5.0k54872
accept rate: 31%

It's painfully slow, but it's on one of those new AWS RDS Aurora-Postgreql "serverless" instance, so I'm not sure how to tune it.

(02 Jun, 10:30) JamesPep
Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×258
×2

question asked: 31 May, 09:33

question was seen: 351 times

last updated: 02 Jun, 10:30

powered by OSQA