I need to parse a .pbf file in Python, but using apply_file() on PyOsmium handlers is not working well for me and so I want to use apply_buffer(). I don't quite know what format is expected from it and documentation on it is lacklustre, but I assume it's to be a binary string encompassing a fileblock.

The problem is that if I open() a file in Python I don't know of a way to find fileblocks to feed them to PyOsmium.

It might have something to do with using a protocol buffer library, but Google's own tutorial only shows how to read a whole file at once. I can't do that, because the files I'm handling are too large for memory (think planet.osm.pbf), so I need to do it piece by piece.

How should I approach this? Am I asking in the right place?

asked 01 Oct, 11:53

fsaler's gravatar image

fsaler
1625
accept rate: 0%

Be the first one to answer this question!
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×71
×58
×55
×18
×9

question asked: 01 Oct, 11:53

question was seen: 106 times

last updated: 01 Oct, 11:53

powered by OSQA