|
Right so i was initially tasked with validating and cleaning data over a large suburb of Harare in Zimbabwe. The data had recently been collected by members of the Red Cross in the ground in Harare and had been uploaded straight away without much cleaning having taken place. The main cleaning that needed to be done was on the address attributes of all of the houses (~5000) that had been mapped (Just to be clear here - i'm not editing anything more than attribute data). This involved making sure that the 'addr:street' attribute data was formatted correctly - ie 18robertmugsabe way -> 18 Robert Mugabe Way etc. The 'addr:housenumber' attribute also needed to be cleaned to ensure consistency in the syntax - ie 699a-b, 699 ab, 699A. B ---> 699A/B. I also plan to sense-check the data to ensure the houses are on the right roads, street names are correct e.t.c. I approached this initially by doing an overpass query of all of the edits done by the username of the person who had made all of the uploads in the area. I then downloaded the results as a geoJSON (Points, Lines and Polygons). I then converted these seperate geoJSON files to shapefiles. From here i extracted the 'addr:housenumber' and 'addr:street' fields from the attribute tables and brought them in to excel to perform formatting formulas on the syntax of the data. I then replaced the original attribute columns with the newly edited ones in the shapefile (all the while retaining the integrity of the id field and making sure the edits were appended to the correct polygons). At this stage i could bring in the shapefile to JOSM and re-save it as an .osm file. I was hopeful that the conflation plugin would be able to manage merging in the new attribute data but seems to throw up a conflict for everything i'm trying to change. I still have a small hope that this plugin might be able to manage it in some way but need some advice. Next (using a small 2 building sample) i tried simply uploading the .osm file but expectedly it simply placed all of its data on top of the already existing data. What i am now thinking is that this upload could still work but only through downloading all of the relevant osm data in JOSM, deleting it and then uploading the new .osm files (Line, Point, Polygon) in its place. Is this a viable method? Would it throw up red flags galore? I am hoping that as this process is primarily concerned with improving the formatting and syntax of data that is currently there it might be viewed more favorably as opposed to a mass editing, deleting or upload of geometry data. Any help would be greatly appreciated, Cheers |
|
You have really created too many layers of indirection through changing the format of the data to have much hope of successfully merging it back. A large scale delete and replace is probably not appropriate as it is reasonable to alter the data in situ. It is important to ensure that you have the skills and knowledge to so this suitably. I would suggest the following alternative in JOSM:
|
