NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum

Is there a vector map layer planned for openstreetmap.org? Since such layer would move map rendering from server to client I think there may be a lot of potential to lower both rendering and traffic load of OSM servers. Are there any plans for this? Maybe something like Mapbox GL JS could be used as technical solution.

asked 14 May '16, 22:00

Kozuch's gravatar image

Kozuch
1.7k587285
accept rate: 8%

edited 14 May '16, 22:04


I think there are a couple of reasons why a vector map of, what I assume you refer too, is the Standard or OpenStreetMap-Carto styled layer is not planned or realistic anywhere in the near future:

  • As someone already pointed out, developer resources is one aspect. Knowing what I know from developing an OSM renderer from scratch for ArcGIS, it is an absolute huge undertaking to develop and maintain a style as complex as Carto / Standard, and the infrastructure to support it all. Converting the existing raster based style and infrastructure to a vector based one, would be a pretty massive task.

  • There is a second, much underappreciated aspect though. Despite all the flashy promotion of vector based maps as being "light-weight" and "fast" compared to raster tile services, this is only so for very basic simple maps with just a few vector layers (maybe 5-10 max). As soon as you start converting a style as complex as Carto, which would probably require a couple of hundreds of vector layers, things start to look entirely different...

  • Also, Carto currently displays buildings from a scale of about 1:50k. That would mean literally (tens of) thousands of vector building objects needing to be transferred and rendered on mobile devices with big screens if a 1:1 vector style conversion would need to be implemented with the same level of detail as Carto at each Z zoomlevel...

Honestly, have you ever seen a style even nearly as complex as Carto being served as pure vector tiles?

I haven't, I think that says enough. I think current mobile hardware simply is not yet up to the task to deal with such complex vector services. Maybe in another 10 years...

Just testing of some vector services on my Samsung Tab S (first version), which is pretty high end as regards mobile with an octo-core processor, shows map rendering in the mobile browser to be very sluggish compared to opening the same vector service in a browser on my Core i5 desktop. And that is with a very basic style. Opening the Google Maps App, which does offer acceptable performance, and zooming all the way in, I only get to see any buildings when there are no more than maybe 50-500 buildings max in the viewport...

Also, in this respect, I recently read an article where the author concluded that with the apparent switch to vector based services, a style like Google's was considerably simplified compared to the styling before the switch. Less objects were shown at each zoom level. So you can have vector on your mobile device now, but at the huge cost of great simplification of the styling and the number of features shown at each zoom level.

Is that the price you want to pay for having vector?

permanent link

answered 22 May '16, 10:58

mboeringa's gravatar image

mboeringa
1.5k21527
accept rate: 9%

edited 22 May '16, 11:10

3

Re "have you ever seen a style even nearly as complex as Carto being served as pure vector tiles", OsmAnd's style isn't a million miles away, either in the data used to display it and the complexity of the style itself. You can't compare "lines of code" since the styling language is so different, but it's not that dissimilar.

See for example:

https://github.com/osmandapp/OsmAnd-resources/blob/master/obf_creation/rendering_types.xml

(22 May '16, 11:34) SomeoneElse ♦
2

A 1:1 conversion is definitely unrealistic but maybe we don't need this. When zooming out OsmAnd stops pretty soon to display things like buildings due to the high complexity already mentioned by you. Yet instead of this black and white approach it is possible to do something in-between, like drawing only important buildings (hospitals, schools, churches, train stations, ...). An efficient, performant vector style will definitely need some additional brain power but it's not impossible as shown by various applications already using vector maps.

(22 May '16, 17:17) scai ♦

I am not saying you can't have vector maps. Yes, MapOut looks impressive with its "3D" hillshading. But almost all vector maps I have seen do away with two things much valued by OSM users: 1) Layered rendering of highways and railways based on the OSM layer=x tag. Most only render connected lines, or show layering only at the very highest zoom levels (e.g. Google Maps App for Android). 2) High detail at lower zoom levels, e.g. buildings and (small) natural and landuse features. Despite what all of you are saying, many of the requests I have seen on the Carto Github in the past few years, actually are from people asking for more to be shown, even in zoom levels that seem hardly feasible. So I am pretty sure there are other opinions out there as well.

(22 May '16, 23:56) mboeringa

" If getting that quality of cartography onto osm.org is a "price" I can "pay", show me where to enter my credit card details."

You may find this interesting: http://forum.openstreetmap.org/viewtopic.php?pid=578345#p578345

And considerably outdated in terms of the cartography, but still some impression: http://forum.openstreetmap.org/viewtopic.php?id=26451

(23 May '16, 00:04) mboeringa

FIY these guys have a working solution for global vector tiles: https://openmaptiles.org/. So it is doable and is working quite nicely. Works well on mobile too.

(27 Apr '17, 22:05) Kozuch
2

@Kozuch none of the styles suggested by openmaptiles.org is a general purpose (with POIs etc) map style a la the OSM "standard" style. Actually if you look at all the major vector tile providers MB, MZ and WMF, you will notice that they all provide basic, typically very bland, map styles that at best are usable as a background for a small bit of custom data. The only exception would seem to be maps produced by Andy Allan, but even those tend to be "topical".

(28 Apr '17, 10:47) SimonPoole ♦

My ArcGIS Renderer in development, needs a staggering 350+(!) layers to create a rendering as rich, and in some areas clearly surpassing Carto, like the ability to show area:highway and man_made=bridge respecting OSM layer=x tag. I would love to see vector tile services able to handle a complexity like that, but at the current state of affairs, I think we are a long way off.

(28 Apr '17, 11:34) mboeringa

There is a new website that features freely accessible OSM-based worldwide vector map - https://www.mapcat.com. You can search for POIs (example: "restaurant") in the top left corner and they show the result directly on the map which is very nice.

(21 Jul '17, 13:52) Kozuch
showing 5 of 8 show 3 more comments

Just to chime in here. I've been working on porting the openstreetmap-carto style to vector tiles. But to render it server side with mapnik, producing images at the end, not to use client side rendering. It took a bit of work, but it can be done. I am not sure if it's sensible to have that rendered client side.

permanent link

answered 23 May '16, 08:53

rorym's gravatar image

rorym
5.4k1449100
accept rate: 11%

could you insert a link to some repo or documentation?

(23 May '16, 11:27) aseerel4c26 ♦

Not yet, but hopefully soon.

(23 May '16, 12:37) rorym
(06 Nov '17, 13:41) kocio

Well, oh my oh my, what was I wrong!!

I am taking back my words about not being able to publish a 350+ layer Vector Tiles service...

I knew ESRI was working on Vector Tiles, but hadn't yet found the time to explore the new addition in Pro 1.4. I am not used to ESRI getting it right the first time, it usually takes a second round.

But I just published an Amsterdam OpenStreetMap extract to a Vector Tile service created with ArcGIS Pro, with all freaking 350+ thematic layers!

There are some caveats though: - (Open cross) hatch polygon symbols are not yet supported in Vector Tiles, they end up being solid fills, which covers up stuff below it, which it really shouldn't. - Also hatched line symbols fail, and draw as a simple line feature - Random stipple pattern symbols seem replaced with equally spaced ones, meaning lesser cartography. - Symbols that use a reference scale for their size (e.g. 1:10k), and should be scaled in size / made bigger or smaller at other scales, don't. This doesn't work with Vector Tiles and the current client rendering. - Labelling is not as good as ESRI's Maplex label engine, there is quite a lot of labels missing.!But all in all, I am surprised to see this output so easily! I even published in a custom UTM zone 31N projection, instead of default Web Mercator.

The attached image shows both the Vector Tile (Right) and a PDF of the same data as comparison (Left). Notice the solid fill instead of cross hatch near Amsterdam Central Station, and a lot of missing labels.

Lastly, my first generation Tab S was able to handle opening this smaller extract as well. alt text

permanent link

answered 28 Apr '17, 13:40

mboeringa's gravatar image

mboeringa
1.5k21527
accept rate: 9%

edited 28 Apr '17, 13:48

1

I'm sure we good get this done with proprietary software and/or a horde of paid developers :-) (not to mention an essentially 100% stranglehold on the commercial GIS market).

The question is just what does it have to do with OpenStreetMap?

(28 Apr '17, 14:22) SimonPoole ♦

"The question is just what does it have to do with OpenStreetMap?"

That client side rendering and server side publishing of a Vector Tile service as complex as Carto's is at least theoretically possible.

Whether this all holds up at the scale of current global OSM data, and whether the OpenStreetMap site should serve VT for styles like Carto, or has the developers sources to explore it, are other questions indeed.

By the way, the "horde" in this case just has a single member, I developed my own renderer and style...

(28 Apr '17, 14:41) mboeringa

The "hordes" referred to ESRIs developer staff. There is a, at least short term, difference between OSM and companies that can spend a billion or two, three ... on something they consider strategic (ESRI, google, etc) and what we can do in a short time (given time lots of things are possible without funds).

(28 Apr '17, 19:02) SimonPoole ♦

No, there is no such planning.

permanent link

answered 21 May '16, 22:04

stephan75's gravatar image

stephan75
12.6k556210
accept rate: 6%

1

Is the reason for a "no" just a lack of (developer) resources or is there something else behind?

(21 May '16, 23:12) Kozuch
2

@stephan75 no plans even for the long run? I doubt that.

(22 May '16, 07:54) scai ♦
1

FWIW: on the dev mailing list I only found this partly relevant entry (searching for vector) https://lists.openstreetmap.org/pipermail/dev/2015-December/028970.html which has no follow ups.

(22 May '16, 09:39) aseerel4c26 ♦
1
(22 May '16, 09:40) aseerel4c26 ♦

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×440
×89
×45

question asked: 14 May '16, 22:00

question was seen: 7,873 times

last updated: 06 Nov '17, 13:41

NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum