arcgis data reviewer: ensuring accurate and complete data ......query attributes finds features...

27
Rama Atluri Sherry Fagin ArcGIS Data Reviewer: Ensuring Accurate and Complete Data to Meet Your Mission

Upload: others

Post on 25-Jan-2021

8 views

Category:

Documents


0 download

TRANSCRIPT

  • Rama Atluri

    Sherry Fagin

    ArcGIS Data Reviewer:

    Ensuring Accurate and Complete Data to

    Meet Your Mission

  • Agenda

    • Defining data quality

    • What is ArcGIS Data Reviewer?

    • Automated review

    • Error management and reporting

    • Semi-automated review

    • Summary/resources

  • Defining data qualityDefining data quality

  • Defining qualityA technical perspective

    Spatial Accuracy

    Thematic Accuracy

    Completeness

    Logical Consistency

    Temporal Quality

    Usability

    ISO-19157:2013 Geographic information – Data quality

    Lake feature has been shifted

    Swimming pool captured as wetland

    Neighborhood with missing building footprint

    Highway with road surface type gravel

  • Defining qualityA technical perspective

    Spatial Accuracy

    Thematic Accuracy

    Completeness

    Logical Consistency

    Temporal Quality

    Usability

    ISO-19157:2013 Geographic information – Data quality

    Updated chart should show closed runway

    Outdated chart showing open runway

    Used to map National Parks

    Used to route emergency vehicles

  • Defining qualitySources of data quality requirements

    Subject matter

    experts

    Industry

    standards /

    specifications

    Quality

    assurance plan

    Training and

    experience

  • Data quality managementCapabilities of the ArcGIS

    Geodatabase integrity

    • Schema constraints

    • Attribute rules

    • Versioning

    Advanced data types

    • Topologies

    • Parcel fabric

    • Utility network

    • Automated review

    • Semi-automated review

    • Error management

    • Quality reporting

    ArcGIS Data Reviewer

  • What is ArcGIS Data Reviewer?Data quality management in the ArcGIS

    • Data Reviewer for Desktop

    - ArcGIS Pro

    • ArcGIS Server

    - Validation Server

    Apps

    DesktopAPIs

    Enterprise

  • Managing quality controlQuality control processes

    Automated

    review

    Quality

    reporting

    Semi-automated

    review

  • Types of quality control

    Fast

    Consistent

    Repeatable

    Objective

    100% Coverage

    Automated review

    Guided workflows

    Streamlined processes

    Subjective

    Sampling

    Semi-automated review

  • Automated reviewSection Subhead

    Defining data qualityAutomated review

  • Attribute Rules Overview

    User defined rules for simple features using Arcade scripting

    Ensure data quality during data collection and maintenance

    Enforce data integrity

    Defined in feature classes or tables

    Supported across the ArcGIS system*

  • Attribute Rule Types

    Constraints

    Validation

    Calculation

  • Ready To Use Rules

    Pre-defined data validation methods

    Easily configurable (no scripting required)

    Support in Constraint and Validation workflows

    Assess feature’s integrity, properties and spatial relationships

    Data Reviewer integration

  • Automated reviewSection Subhead

    Defining data quality

    Implementing

    automated review

  • Implementing data quality rulesRule implementation workflow

    Authoring workflow

    - Identify and document requirements

    - Identify relevant validation methods in ArcGIS

    - Implement data quality rules

    Industry

    standards /

    specifications

    Subject matter

    experts

    Training and

    experience

    Quality

    assurance

    plans

    Cutbacks Duplicate Vertex

    Evaluate Vertex Count

    Evaluate Polygon Perimeter/Area

  • Implementing data quality rulesReviewer Rule implementation workflow

    Authoring Reviewer Rules

    - Identify data quality requirements

    - What ArcGIS capability supports the requirement?

    - What workflow will the capability support?

    Industry

    standards /

    specifications

    Subject matter

    experts

    Training and

    experience

    Quality

    assurance

    plans

    Validation

    Constraint

    Cutbacks Duplicate Vertex

    Evaluate Vertex Count

    Evaluate Polygon Perimeter/Area

  • Implementing data quality rulesReviewer Rules in constraint workflows

    • Attribute (constraint) rules

    - Created using ArcGIS Pro

    - Validates data sources

    - Geodatabase features/tables

    - 9 check types

    - Rules stored in Geodatabase

    - Supported in

    - File Geodatabase

    - Enterprise Geodatabase

    - Feature Services (branch

    versioned)

  • Implementing data quality rulesReviewer Rules in validation workflows

    • Attribute (validation) rules

    - Created using ArcGIS Pro

    - Validates data sources

    - Geodatabase features/tables

    - 10 check types

    - Rules stored in Geodatabase

    - Supported in

    - Feature Services (branch

    versioned)

    Demo

  • Automated reviewKey enhancements in ArcGIS Pro

    • Attribute Rule integration

    - Attribute (constraint) Rules enforce

    data integrity during editing

    - Reviewer checks assess a feature’s

    - Integrity

    - Spatial relationships

    DomainFinds attribute values that do not comply with coded value or

    range domains that are associated with an attribute field.

    Query AttributesFinds features based on a query WHERE clause run against

    row attributes.

    CutbacksFinds segments where the angle between segments in a polygon or

    polyline is below a specified minimum value.

    Duplicate VertexFinds vertices from the same feature that are collocated or within a

    specified tolerance of one another.

    Feature on FeatureFinds features that have a specific relationship, either from two

    different feature layers or within the same feature layer.

    MonotonicitySearches Z or M-enabled polylines for vertices that are not strictly

    increasing or decreasing in value or are trending based on specified

    conditions.

    Polyline or Path Closes on SelfFinds paths or lines in polyline features that close themselves.

  • Evaluate Polyline LengthFinds polyline segments, parts or features that have a line length

    within a specified tolerance.

    Evaluate Part CountFinds features with a part count that is within a specified value.

    Evaluate Polygon Perimeter and AreaFinds polyline segments, parts, or features that have a line length

    within a specified tolerance.

    Evaluate Vertex CountFinds polyline or polygon features that have a vertex count within a

    specified tolerance.

    Automated reviewKey enhancements in ArcGIS Pro

    • Attribute Rule integration

    - Attribute (constraint) Rules enforce

    data integrity during editing

    - Reviewer checks assess a feature’s

    - Integrity

    - Spatial relationships

    - Geometric properties

  • Validation Reviewer Rules at ArcGIS Pro 2.5/ArcMap 10.8

    • Rule authoring

    • Optimize existing checks to support validation workflows

    *Subject to change without notice

    Cutbacks Duplicate VertexEvaluate Vertex Count

    Evaluate Polygon Perimeter/Area

    Evaluate Polyline Length

    Evaluate Part Count

    Feature on Feature

    Monotonicity Polyline/Path closes Self

    Query Attributes

  • Validation Server workflow

    Review

    Correct

    Verify

    Editors

    Data

    maintenance

    Validation

    ServerEvaluate

    Desktop

    Web

    Dirty

    features

    Data workflow

    Cyclic

    Mobile

    Review

    Correct

    Verify

    Analyst

    ArcGIS Enterprise

    Demo

  • Managing quality controlQC lifecycle management

    Review

    Find and

    record errors

    Correct

    Perform editsor

    Note exceptions

    Verify

    Acceptableor

    Unacceptable

  • Reporting data quality

    Methods of consuming data quality results

    - ArcGIS Dashboards

    - ArcGIS Pro pop-ups

    - Symbolize by validation status – reporting by feature class

    - Build reports and charts in Pro

  • Summary

    • Defining data quality

    • ArcGIS Data Reviewer

    - Automated validation checks

    - Error management

  • Want to learn more?

    • Documentation

    - Desktop Help

    - https://pro.arcgis.com/en/pro-app/help/data/validating-data/get-started-with-data-reviewer.htm

    • Tutorial

    - https://pro.arcgis.com/en/pro-app/help/data/validating-data/tutorial-enhance-quality-assurance-

    editing.htm

    • GeoNet (community.esri.com)

    - Data Reviewer place

    https://pro.arcgis.com/en/pro-app/help/data/validating-data/get-started-with-data-reviewer.htmhttps://pro.arcgis.com/en/pro-app/help/data/validating-data/tutorial-enhance-quality-assurance-editing.htm