bringing validation to users - pretalx.com...clarisse abalos @map2save matthew gibb @giblet22. the...
TRANSCRIPT
![Page 1: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/1.jpg)
Bringing Validation to Users
Integrating Quality Assurance Checks
into Map Editors
Clarisse Abalos@map2save
Matthew Gibb@giblet22
![Page 2: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/2.jpg)
The Problem• Abundance of data issues waiting to be
cleaned up
• There are more mappers than validators
• Mappers need more guidance while mapping
![Page 3: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/3.jpg)
This Photo by Unknown author is licensed under CC BY-NC-ND.
To-Fix
Improve OSM
OSM Lint
Atlas
OSM Inspector
Keep Right
Osmose
![Page 4: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/4.jpg)
Quality Assurance ApproachStop bad or incomplete data from being created
![Page 5: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/5.jpg)
Solutions
Validation rules in JOSM and iD
Custom Presets and Validation Rules
Validation-centric Overpass Queries
![Page 6: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/6.jpg)
Validation in JOSM
Validation on dataset while editing features Warnings before upload
![Page 7: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/7.jpg)
JOSM Data Validator Types
Tag Checker Rules (MapCSS)• Great for basic topology
and tag checks
Tests (Java)
• Able to handle more complex geometry checks
![Page 8: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/8.jpg)
What is MapCSS?
• CSS-like language for map stylesheets
• Used in JOSM for map styling and data validation
Each color represents a building with a different name
![Page 9: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/9.jpg)
Basic MapCSS Validation Checks
Features that meet the rule criteria appear in the JOSM Validation Results window
![Page 10: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/10.jpg)
Create your own MapCSS checks locally 1. Write the rule -
save as .mapcss or .validator.mapcss file
2. Add as an Active Rule in JOSM
3. Click “Validation”
![Page 11: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/11.jpg)
Converting other QA tools to MapCSS
![Page 12: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/12.jpg)
Available JOSM
Tag CheckerRules
❏ Osmose (QA Tool Inspired Validations)
❏ KeepRight❏ OSM Lint
![Page 13: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/13.jpg)
JOSM Wiki Ruleshttps://josm.openstreetmap.de/wiki/Rules
![Page 14: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/14.jpg)
![Page 15: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/15.jpg)
JOSM Validator – Water StructuresInspired by Osmose analyser: #1221 “Far from water”
(Developed by: Milla Zagorski)
![Page 16: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/16.jpg)
JOSM Validator - WaterwaysInspired by Osmose analyser: #1220 “Waterway”
(Developed by: Milla Zagorski)
![Page 17: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/17.jpg)
JOSM Validator – Public TransportInspired by Osmose analyser: #1260 “Public Transport”
(Developed by: Milla Zagorski)
![Page 18: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/18.jpg)
What's new in JOSM?
58 new validators!
• Osmose – 41
• KeepRight – 7
• OSM Lint – 9
• Atlas – 1
(Developed by: David Manzer & Milla Zagorski)
![Page 19: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/19.jpg)
Mainly addressing...
highway issues tagging issues tree-trimming issues
![Page 20: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/20.jpg)
A really sweet bar chart
![Page 21: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/21.jpg)
Tasking Manager Campaign
MapRules(configId)
Presets
JOSM
ID
Validation Rules
JOSM
ID
Custom Presets and Validation Rules
Requirements for mapping features become• Simplified• Standardized• Streamlined
Simple UI to create guidelines that can be tied to campaigns and generate presets and validation rules that can tailor the editors to your campaign/organization focus specific needs
iframe
xml
json
MapCSS
json
![Page 22: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/22.jpg)
Creating Attribution Guidelines
Assisted with taginfo popular combinations
![Page 23: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/23.jpg)
Campaign Focused Presets
![Page 24: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/24.jpg)
Realtime Validation
• Only show fields and values relevant to campaign
• Throw validation errors or suggestions for further information while editing
![Page 25: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/25.jpg)
In Progress
USER PRESETS SHARING AND REUSING PRESETS
INTEGRATING INTO TASKING MANAGER 4
https://github.com/radiant-maxar/maprules
![Page 26: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/26.jpg)
Validation Based Overpass Queries
Why?
• Stale errors in QA databases
• Pulling in validation targeted data over larger areas
• Bulk operations
![Page 27: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/27.jpg)
MapRoulette Challenges
GeoJSON ● Local File● Remote Url
Overpass Query
![Page 28: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/28.jpg)
![Page 29: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/29.jpg)
![Page 30: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/30.jpg)
Automatically Fix Validation
Errors
![Page 31: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/31.jpg)
Why does this matter?
• Custom validations give users and groups the directed focus they need.
• If you're only interested in mapping railways, why not share your `railway=switch` validation MapCSS checker?
• Thematic validations can assist with directed editing and cleanup
![Page 32: Bringing Validation to Users - pretalx.com...Clarisse Abalos @map2save Matthew Gibb @giblet22. The Problem • Abundance of data issues waiting to be cleaned up • There are more](https://reader035.vdocuments.us/reader035/viewer/2022081403/607eb92d4665342e334c3b25/html5/thumbnails/32.jpg)
Create and Share Validation Rules
ADD TO MAPCSS VALIDATION RULES
ADD TO JOSM VALIDATORS
CREATE MAPRULES