arcgis pro - inforum library · qgis (free, open source, runs on all os) 9. other software 10....

189
An introduction to GIS using ArcGIS Pro https://uoft.me/arcgispro 1 Marcel Fortin, University of Toronto Map and Data Library, [email protected] Last updated: November 12, 2018

Upload: others

Post on 27-May-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

An introduction to GIS using ArcGIS Pro

https://uoft.me/arcgispro

1

Marcel Fortin, University of Toronto Map and Data Library, [email protected]

Last updated: November 12, 2018

Page 2: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Download Datahttp://maps.library.utoronto.ca/workshops/ArcGISProWorkshop/ArcGISProWorkshop.zip

2

1 - click on the “Windows File Explorer”

2 - move the “ArcGISProWorkshop.zip” file from the “Downloads” folder to the “Documents” folder

Page 3: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

OR … Copy Data from the MDL Network Drivehttp://maps.library.utoronto.ca/workshops/ArcGISProWorkshop/ArcGISProWorkshop.zip

3

1 - click on the “Windows File Explorer”

2 - select the “GIS and Data Temp” drive

Page 4: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Copy Data1 - copy the ArcGISProWorkshop.zip file to the “Documents”

NOTE: If you downloaded the file from the maps.library.utoronto.ca server, you already moved your zip archive to the “Documents” area. See page 33.

4

Page 5: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Extract Data

1 - right-click on the “ArcGISProWorkshop.zip” file → select “7-zip” → select “Extract to “ArcGISProWorkshop\”

2 - you should now have a folder called “ArcGISProWorkshop”

5

Page 6: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Agenda- Map and Data Library

- Services- Software access- Other Workshops

- What is GIS?- Hands-on ArcGIS Pro Modules

- A tour of ArcGIS Pro- Making a Map- Loading and Manipulating Data- Analysis Tools

6

Page 7: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

- Data and Maps Collections (MDL web pages and SP GeoPortal)- Reference Services (in person (5th floor of Robarts)

- Data Visualization- Numeric Data- Research Data Management- GIS- Maps

- [email protected], 416-978-5589- Hours 11-5 Monday through Friday

7

Page 8: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Esri software

8

Page 9: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

QGIS (free, open source, runs on all OS)

9

Page 10: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Other Software

10

Page 11: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Other MDL Workshops

Data

- Working with Messy Data in OpenRefine

Data Visualization

- Data Visualization

- Infographics

GIS

- ArcGIS Online

- ArcGIS Pro

- Story Maps

Qualitative Data Analysis

- Nvivo

Quantitative Data Analysis / Statistics

- R

- SPSS

- Stata

To view a list of workshops and to register, see: https://mdl.library.utoronto.ca/technology/workshops-training/workshop-schedule 11

Page 12: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

What is GIS?

12

Page 13: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

13

Page 14: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

What is GIS?

14

Page 15: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

What is GIS?

15

Page 16: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

What is GIS?

16

Page 17: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

What is GIS?

17

Page 18: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

What is GIS?

18

Page 19: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

What is GIS?

19

Page 20: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

How are geospatial data built?What is GIS?

20

Page 21: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

How are geospatial data built?What is GIS?

21

Page 22: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

What is GIS?

22

Page 23: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Vector DataPoints

23

Page 24: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Vector DataLines

24

Page 25: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Vector DataLines

25

Page 26: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Vector DataPolygons or Areas

26

Page 27: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Vector DataPolygons or Areas

27

Page 28: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Attribute DataTable variables/columns

28

Page 29: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Attribute DataTable variables/columns

29

Page 30: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Attribute DataSymbology based on variables/columns

Population / Land Area

30

Page 31: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Raster DataOr matrix / grid data

31

Page 32: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Why Raster?

32

Page 33: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Raster DataOr matrix / grid data

33

Page 34: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Raster DataOr matrix / grid data

34

Page 35: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Raster DataOr matrix / grid data

35

Page 36: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Raster DataOr matrix / grid data

36

Page 37: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Raster Data and vector dataOr matrix / grid data

37

Page 38: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Raster vs. Vector

38

Page 39: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Raster vs. Vector

39

Page 40: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Raster vs. Vector

40

Page 41: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

ArcGIS Pro - Module 1 - Getting Started1 - Turn on the first layer, “FIRE_FACILITY_WGS84”

2 - right-click on the layer name and select “Zoom to Layer”

41

Page 42: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in Windows, navigate to the location where you exported your map

2 - double-click on the file to view the image of the map

42

ArcGIS Pro - Module 2 - Making a Map

Page 43: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in both maps, zoom out to be able to see Greenland and Canada

43

ArcGIS Pro - Module 3 - Manipulating data

Universal Transverse Mercator (UTM) Projection WGS84 Geographic Projection

Page 44: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

ArcGIS Pro - Module 4 - AnalysisIn your estimation, which better represents the population density of the City of Toronto? Graduated Colours, Graduated Symbols, Proportional Symbols or Dot Density?

44

Graduated Colours

Graduated Symbols

Proportional Symbols

Dot Density

Page 45: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

ArcGIS ProModule 1 - a tour of ArcGIS Pro

45

Page 46: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Goals- Learn the basics of ArcGIS Pro’s main tools- View and manipulate datasets and basemaps- Export a basic map view

46

Page 47: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

(Repeated steps) - Download Datahttp://maps.library.utoronto.ca/workshops/ArcGISProWorkshop/ArcGISProWorkshop.zip

47

1 - click on the “Windows File Explorer”

2 - move the “ArcGISProWorkshop.zip” file from the “Downloads” folder to the “Documents” folder

Page 48: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

(Repeated Steps) OR … Copy Data from the MDL Network Drivehttp://maps.library.utoronto.ca/workshops/ArcGISProWorkshop/ArcGISProWorkshop.zip

48

1 - click on the “Windows File Explorer”

2 - select the “GIS and Data Temp” drive

Page 49: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

(Repeated Steps) - Copy Data1 - copy the ArcGISProWorkshop.zip file to the “Documents”

NOTE: If you downloaded the file from the maps.library.utoronto.ca server, you already moved your zip archive to the “Documents” area. See page 33.

49

Page 50: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

(Repeated Steps) - Extract Data

1 - right-click on the “ArcGISProWorkshop.zip” file → select “7-zip” → select “Extract to “ArcGISProWorkshop\”

2 - you should now have a folder called “ArcGISProWorkshop”

50

Page 51: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

ArcGIS Pro - Module 11 - from the Windows Start menu, type ArcGIS → Select ArcGIS Pro

51Windows 7 Windows 10

Page 52: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on “Open another project”

2 - click on “Browse”

3 - go to “c:\users\MDW###-PAF\Documents\ArcGISProWorkshop\modules\”

4 - select “Module 01 - A tour of ArcGIS Pro.aprx”

5 - click on “OK”52

Page 53: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Panes, views and tabsArcGIS Pro makes use of many “panes”, “views” and “tabs”

1 - this area is called the “Contents” Pane

2 - this “tab” holds the area called the “Map” view

53

Page 54: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Panes, views and tabs1 - under the “View” menu, click on the “Catalog Pane”

This particular pane is used to manage datasets

2 - close the “Catalog” pane

54

Page 55: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Panes, views and tabs1 - under the “View” menu, click on the “Catalog View”

You will notice that “Catalog” is now open in a “tab”

55

Page 56: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Panes, views and tabs1 - you can un-anchor the tab (as with all tabs for that matter) by clicking the tab and dragging it out of the anchor

56

Page 57: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Layers1 - Turn on the first layer, “FIRE_FACILITY_WGS84”

2 - right-click on the layer name and select “Zoom to Layer”

57

Page 58: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Layers

1 - Turn off the “FIRE_FACILITY_WGS84”

2 - Turn on the “Centreline_WGS84” layer

3 - right-click on the “Centreline_WGS84” layer and select “Zoom to Layer”

58

Page 59: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Layers1 - Turn off the first two layers

2 - Turn on the third layer “Neighborhoods_WGS84”

59

Page 60: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Layers and Basemaps1 - Turn off all layers, including the basemaps “World Topographic Map” and “World Hillshade”

60

Page 61: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Layers and Basemaps1 - Under the Map meny, select “Basemap” and choose the basemap called “Image Hybrid”

2 - Repeat with other basemaps and return to the original “Topographic” Basemap

61

Page 62: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Layers and Basemaps1 - Turn off all Basemap Layers

2 - Turn on the Fire facility and neighbourhoods layers

62

Page 63: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Scale1 - at the bottom left of the map area, select various scales (one at a time)

2 - create a customized scale using the “Customize” option

63

Page 64: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1- Using the mouse buttons and wheel, navigate around your map

2 - If you lose your Toronto area data, select one of the layers, right-click and select “Zoom to Layer” or click on the “Full Extent” icon

64

Navigating

Page 65: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Bookmarks1 - under the “Map” tab select “Bookmarks”

2 - click on the “Canada” bookmark

65

Page 66: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Your map should look like this one

66

Page 67: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - repeat the last step but select the Toronto bookmark this time

2 - zoom in anywhere closer in the Toronto area and create a new bookmark using the “New Bookmark…” option

3 - select the “Toronto” bookmark again and then your new bookmark

67

Page 68: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Symbolizing Data1 - right-click the Neighbourhoods layer

2 - select “Zoom to Layer”

3 - right-click on the Neighbourhoods layer again but now select the “Symbology” option

4 - select the “Single Symbol” option in the Symbology pop-up box

68

Page 69: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Attribute data1 - right-click on the neighbourhoods layer and select “Attribute Table”

You will notice descriptive (attribute) information about individual polygons or areas

2 - click on any entries in the table

You will notice that the highlighted row in the table is highlighted in the same colour on the map

69

Page 70: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - right-click on the selected row and select “Zoom To”

70

Page 71: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on the “Clear” option under the “View” menu to clear your selection

71

Page 72: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

There should not be any selected features on your map

72

Page 73: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on any of the polygons

73

Page 74: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on different streets

2 - click on fire stations

You should see popups with the attribute information for each feature clicked on

74

Page 75: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click the “Share” ribbon

2 - click on “Map”

3 - type in a name and select a location for your exported map and select “PDF” as the type

4 - locate your exported map and double-click on it

75

Page 76: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

End of Module 1

76

Page 77: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

ArcGIS ProModule 2 - Authoring and Publishing a Map

1

Marcel Fortin, University of Toronto Map and Data Library, [email protected]

Page 78: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Goals- Learn to create a map project

that includes a legend, scale bar, an inset map, a title and a north arrow

2

Page 79: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - using the Windows menu search programs option, type in “ArcGIS Pro”

2 - select ArcGIS Pro from the list of Programs

3 - click on “Open another project”

4 - click on “Browse”

5 - find in the location “C:\users\MDW###-PAF\Documents\ArcGISProWorkshop\modules\Module 02 - Making a Map.aprx”

6 - click on “OK”3

Making a Map

Page 80: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Making a MapA map of population density in the City of Toronto by neighbourhoods will appear. We want to show the City’s most densely populated neighbourhood and also include an overview map of the city along with traditional map elements such as a scale bar, north arrow and a legend.

4

Page 81: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

5

1 - in the “Contents” pane, turn off the “Topographic” base map

2 - under the “Map” menu, select “Bookmarks” and click on the “Downtown Toronto” bookmark

Page 82: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - using the “Insert” menu, select “New Layout” and select the “Tabloid 11 X 17” option

2 - again under the “Insert” menu, select “Map Frame” and click on “Downtown Toronto” bookmark

Your map of Toronto should appear in your layout

New Layout

6

Page 83: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Adding an overview map

7

Now that we have a layout for our map with a main map inserted, we also want to add an overview map

1 - using the “Insert” menu, select “New Map”

2 - in the new map “Map1”, select the “View” menu and click on the “Catalog Pane”

3 - in the “Catalog”, navigate to the “data” → “Neighbourhood_boundaries” → “UTM6” folder

4 - click and drag into the map, the “NEIGHBOURHOODS_UTM6.shp”

Page 84: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - turn off the “Topographic” base map

8

Page 85: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on the “Layout” tab

2 - using the “Insert” menu, select “Map Frame” and select “Map1” that we just created

“Map1” will appear in a similar state and location in your layout as in this image

9

Page 86: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - making sure your “Map1” frame is selected, resize and move the frame to the top left corner of the “Map” area

2 - click on the “Layout” menu and click on the “Fixed Zoom Out” until you can see the entire outline of the city of Toronto in your “Map1” frame

10

Page 87: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on the “Map1” frame

2 - under the “Insert” menu, select “Extent Indicator” and choose “Map Frame”

You should now have an extent indicator of your main map laid out on your overview map

11

Extent Indicator

Page 88: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on the initial “Map” frame by clicking on it in the layout (not the tab)

2 - using the “Insert” menu, select the “North Arrow” option and select an arrow

3 - move the arrow to the bottom left of the map

12

Adding a North Arrow

Page 89: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on the “Scale Bar” option and select the “Scale Line 1 Metric” scale bar

2 - move the scale bar to the bottom right of the map

13

Adding a Scale Bar

Page 90: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Modifying the Scale Bar1 - right-click on the scale bar and select “Properties”

2 - in the “Format Scale Bar” popup, change the “Label Text” to KM and change the Divisions to “2” and Subdivisions to “5”

3 - adjust the size of the scale bar on the map to show only “2 KM”

4 - move the scale bar just between Leslie Spit and the Toronto Islands

14

Page 91: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on the “Legend” option in the “Insert” menu area

2 - draw a rectangle in the frame

3 - adjust the size of the legend and move it to the bottom right of the layout

15

Adding a Legend

Page 92: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Modifying the legend1 - click on the “Map” tab

2 - in the “Contents” pane, rename the neighbourhoods layer to “Toronto Neighbourhoods” and “Population_2016 / NEIGHBOURHOODS_UTM6.area” to “2016 Population Density”

3 - click on the “Layout” tab and examine the “Legend”. Your legend should now reflect the changes made in the “Map” tab.

16

Page 93: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in the “Insert” menu, click on “Aa Symbol”

2 - Select “Title (Sans Serif)”

3 - Draw a box on your map where you want to insert the text of the title and type in the title of the map

17

Adding a map title

Page 94: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Saving your map1 - click on the “Project” menu

2 - click on “Save”

3 - click on the back arrow to return to your project

18

Page 95: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - under the “Share” menu option, select “Layout”

2 - select a resolution and a format for your exported map

3 - select a location where you wish to export your map

4 - click “Export”

5 - Exit out of ArcGIS Pro

19

Exporting/Sharing a Map

Page 96: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in Windows, navigate to the location where you exported your map

2 - double-click on the file to view the image of the map

20

View your exported map

Page 97: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

21

END

Page 98: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

ArcGIS ProModule 3 - Loading and Manipulating Data

1

Marcel Fortin, University of Toronto Map and Data Library, [email protected]

Page 99: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Goals● Create an ArcGIS Pro “Project”● Add vector data “layers”● Learn the basics about Map

Projections● Use Attribute tables (descriptive

data)● Symbolize attribute data

2

● Subset data● Label data● Formatted Layer Files● Add Raster Data● Group data layers● Load Mapping Services● Geocoding

Page 100: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - using the Windows menu search programs option, type in “ArcGIS Pro”

2 - Select ArcGIS Pro from the list of Programs

3 - Click on “Blank” under “Create a new Project”

4 - Provide a name for your project and take note of the location of the project.

5 - Make sure you select “Create a new folder for this project.

3

Creating a new project

Page 101: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - your project will open with no map or data loaded

4

Creating a new project

Page 102: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in the catalog “view”, double-click on “Databases”. You should see a “Geodatabase” with the same name as your project.

2 - Double-click on the geodatabase (there should be no data present)

2 - click on the word “Project” in the location part of the Catalog view to navigate back

3 - Double-Click “Folders” and double-click on the folder inside (there should be only the geodatabase and a file with the extension .tbx)

5

Creating a new project

Page 103: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on the word “Project” in the Catalog view location area

2 - right-click on the “Folders”

3 - select “Add Folder Connection”

4 - locate the “ArcGISProWorkshop” folder and click on the “data” folder

5 - click “OK”

6

Creating a new project

Page 104: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - double-click on the data folder

2 - double-click on the “Bike_Rack_Locations” folder

7

Creating a new project

Page 105: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click once on the “Bike_Rack_Locations_WGS84.shp” shapefile* dataset.

2 - you will now see both a description of this dataset and a preview of it

* Note: A shapefile is a common GIS dataset format.

8

Creating a new project

Page 106: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - close the “Catalog” view by clicking on the x

9

Creating a new project

Page 107: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on the “Insert” menu

2 - click on “New Map” option

3 - select “New Map” in the dropdown options

A new blank map with only a basemap should appear

* Map projections are methods for representing the three-dimensional sphere of the earth into a two-dimensional surface

Map Projections*

10

Page 108: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

11

Map Projections1 - under the Map menu, click on the “full extent” button

Note the size of Greenland vs. the size of Africa. Africa is actually 14 times bigger than greenland. Don’t believe me? See https://mapfight.appspot.com/africa-vs-gl/africa-greenland-size-comparison

Page 109: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in Windows locate the folder called “ArcGISWorkshop\data\Neighbourhood_boundaries” and double-click on it

2 - with the folder open, click and drag the “NEIGHBORHOODS_WGS84.shp” file into the map or contents area of ArcGIS pro.

12

Map Projections

Page 110: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

This map of Toronto Neighbourhoods should display, possibly in another random colour. Pay close attention to the shape of our map.

13

Map Projections

Page 111: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - under the “Insert” menu again, select the “New Map” option and select “New Map”

A new tab will be created called “Map1”

14

Map Projections

Page 112: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - under the “View” menu click on “Catalog Pane”

2 - in the “Catalog” click on the “Folders” area, navigate to the following location “data” → “Neighbourhood_boundaries” → “UTM6”

3- click and drag the “NEIGHBOURHOODS_UTM6.shp” file into your map

15

Map Projections

Page 113: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

You will notice that your two maps look very different. This is because of two different projections being used.

16

Map Projections

Universal Transverse Mercator (UTM) Projection WGS84 Geographic Projection

Page 114: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in both maps, zoom out to be able to see Greenland and Canada

17

Map Projections

Universal Transverse Mercator (UTM) Projection WGS84 Geographic Projection

Page 115: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - Now zoom out to view the entire world

18

Map Projections

Universal Transverse Mercator (UTM) Projection WGS84 Geographic Projection

Page 116: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

19

Projections - WGS 84

1 - in your first map, right-click on the neighbourhoods layer and select “Properties”

2 - select the “Source” option in the popup

3 - examine the “Spatial Reference” information. Take note of the “WKID” and the “Datum”

Page 117: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in your second map, right-click on the neighbourhoods layer and select “Properties”

2 - select the “Source” option in the popup

3 - examine the “Spatial Reference” information. Take note of the “WKID” and the “Datum”. You will notice there is also “Projection” information

Projections - NAD 1927 UTM Zone 17 (EPSG 26717)

20

Page 118: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

You can compare and get information about thousands of projections at spatialreference.org

21

Map Projectionshttp://spatialreference.org

Page 119: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - open the “Catalog” pane

2 - locate the Centreline folder and right-click on the “CENTRELINE_WGS84.shp” shapefile

3 - look under the “Spatial Reference” area

4 - judging by the WKID and Geographic Coordinate System, should you load this dataset in the first or second map?

22

Map Projections

Page 120: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - go back to your first map by clicking on its tab

2 - drag the “CENTRELINE_WGS84.shp” shapefile into this map

23

Attribute Data

Page 121: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - right-click the “CENTRELINE_WGS84” layer in the “Contents” area and select “Attribute Table”

24

Attribute data

Page 122: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - Unanchor the attribute table tab outside of the map by hold-clicking on the tab and moving it anywhere on the screen

Attribute data

25

Page 123: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - locate the column/field “FCOD_DESC”

2 - right-click on the column header and select “Sort Ascending”

3 - examine the records by scrolling to the bottom of the table and examine the entries

Notice that the entries are in categories. We can symbolize our entries based on those categories.

26

Attribute data

Page 124: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - right-click again on the centreline layer and select “Symbology”

2 - in the symbology pop up window click on the “Primary symbology” option and select “Unique Values”

27

Symbolizing data

Page 125: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - select the “FCODE_DESC” variable for “Field1” in the Symbology popup window

2 - click on “Color scheme”

3 - click the “Show names” and “Show all” option

4 - select the “Basic Random” colour scheme

28

Symbolizing data

Page 126: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - once your centreline layer has drawn, click once in the contents area on the line left of the variable “Expressway Ramp”

2 - in the “Symbology” popup window, click on the “Highway” option

29

Symbolizing data

Page 127: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - repeat the same operation as on the previous page for the “Expressway” variable

30

Symbolizing data

Page 128: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - repeat the operation for the “Major Railway” and “Minor Railway” layers but select the “Railroad” option in the “Symbology” popup

31

Symbolizing data

Page 129: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on the “River” variable

2 - in the “Symbology” popup type in the word “river” in the search box

3 - select the “Water (line)” option

Symbolizing data

32

Page 130: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

You can also changed just the colour of the current symbol

1 - right-click on the “Local” variable

2 - select the colour, “Gray 70%”

33

Symbolizing data

Page 131: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click once on the word “CENTRELINE_WGS84” above “FCODE_DESC” in the “Contents” area

2 - rename the layer “Toronto Roads”

3 - click once on the word “FCODE_DESC” under “Toronto Roads” and rename the variable “Streets”

34

Symbolizing data

Page 132: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - right-click on the “Toronto Roads” layer and select “Symbology”

2 - right-click on the “Access Road” option and select “Remove”

Symbolizing data

35

Page 133: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - remove the following variables in the same fashion as in the the last operation on page 35:

“Ferry Route”, “Geostatistical line”, “Hydro Line”, “Minor Shoreline”, “Other”, “Other Ramp” and “Pending”

NOTE: you can select several variables by control-click selecting several at one time, then right-clicking and selecting “Remove”

Symbolizing data

36

Page 134: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in the “Symbology” pop up, select the “More” option tool and click “Show all other values” to unselect the option to display all unformatted options (the ones we deleted)

37

Symbolizing data

Page 135: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - using the “Catalog” pane, click on the “BikeWays” folder and drag the “CENTRELINE_BIKEWAY_OD_WGS84.shp” layer into your map

2 - in the contents area, right-click the “CENTRELINE_BIKEWAY_OD_WGS84.shp” layer and select “Attribute Table”

38

Creating data subsets

Page 136: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in the attribute table, locate the “CP_TYPE” column/variable

2 - right-click on the “CP_TYPE” column and select “Sort Descending”

3 - scroll down and examine the different possible entries for this field

4 - notice the many empty entries?

Creating data subsets

39

Page 137: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - turn the “Toronto Roads” layer off in the contents pane

2 - In the attribute table, notice the “Bike Lanes” entries in “CP_TYPE” column

Creating data subsets

40

Page 138: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - under the “Map” menu option, click on “Select By Attributes”

2 - a “Geoprocessing” popup will open

3 - make sure you are selecting attributes from the “CENTRELINE_BIKEWAY_OD_WGS84” layer

2 - “Selection Type” should be set to “New selection”

3 - click on “Add Clause”

41

Creating data subsets

Page 139: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - select the field “CP_TYPE” to be queried, the option “is Equal to”, and the entry “Bike Lanes” using the drop-down menu options

2 - Click on “Add” once the expression is complete

3 - click on “Run”

Creating data subsets

42

Page 140: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - notice there are 1279 entries selected

2 - under “Selection type”, select “Add to the current selection”

3 - Click on “Add Clause”

Creating data subsets

43

Page 141: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - using the boolean operator “Or”, select the field “CP_TYPE” that “is Equal to” → “Suggested On-Street Routes”

2 - click on “Add”

44

Creating data subsets

Page 142: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on “Run” in the Geoprocessing popup

2 - there should now be 2313 selected road segments from the attribute table

3 - your map should show the selected entries in pale blue like in your attribute table

Creating data subsets

45

Page 143: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - right-click on the bikeways layer in the contents pane and select “Data → Export Features”

2 - in the “Geoprocessing” popup, type in the name “bikeways” for the new dataset within the projects “geodatabase”

3 - click on “Run”

Creating data subsets

46

Page 144: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Your map should now include your data subset

1 - if your “Catalog” pane is closed, open it again by going to the “View” menu and clicking on “Catalog Pane”

2 - navigate to the geodatabase by going to the “Folders” area of the “Catalog”

3 - navigate to “Loading and Manipulating Data.gdb” or whatever name you called your project

3 - expand the geodatabase, and you should see your “bikeways” layer listed 47

Creating data subsets

Page 145: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - turn off the original “CENTRELINE_BIKEWAY_OD_WGS84” layer, but keep the new “bikeways” layer on

48

Creating data subsets

Page 146: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

49

Creating data subsets1 - click on the coloured line underneath the “bikeways” layer in the “Contents” pane.

2 - in the “Symbology” popup window, click on “Properties” and change the “Line width” to 2.5pt.

3 - click on “Apply”

Page 147: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - remove the original bikeways layer by right-clicking on it and selecting “Remove”

2 - turn the “Toronto Roads” layer on

3 - right-click on the “Toronto Roads” layer and select “Label”

4 - notice the speed (slow) of the labeling?

50

Labeling

Page 148: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

“Labeling” using default settings can be messy. In this case we are lucky at least that the software chose the right field since it uses the first “text” field it found in the table.

51

Labeling

Page 149: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - right click again on the “Toronto Roads” layer and select “Labeling Properties”

2 - click on the “Visibility Range” option of the “Label Class” popup

3 - select “1:50,000” under the “Out beyond” drop down option. This will prevent the software from labelling our text when it is not useful at “small” scale

52

Labeling

Page 150: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - start zooming in to a larger scale than 1:50,000 to see the labels

53

Labeling

Page 151: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on the “Label expression” option in the “Label Class” popup

2 - build the following expression in the “Expression” box:

$feature.LF_NAME + “ (“ + $feature.FCODE-DESC + “)”

which will create a label from the two fields containing the name of the road and the type of road.

3 - click on “Apply”

54

Labeling

Page 152: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - click on the “Symbol” option of the “Label Class” popup box

2 - expand the “Appearance” area and change the size of the font used for your label to 8pt

3 - click on “Apply”

55

Labeling

Page 153: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - under the “Position” area of the popup window again, expand the “Placement” option

2 - click on “Allow stacked labels to straddle lines”

3 - select “Offset curved”

56

Labeling

Page 154: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Now that we have formatted our layer the way we want it, we want to be able to reuse or share this formatting.

1 - right-click on the “Toronto Roads” layer and select “Sharing” → “Save As Layer File”

2 - navigate to your “data” folder and into the “Centreline” folder

3 - name your layer “Toronto Roads.lyrx”

4 - click “Save”

Layer Files

57

Page 155: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - once your formatting has been saved for your “Toronto roads” layer right-click on the “Toronto Roads” layer and select “Remove”

2 - right-click on the “bikeways” layer and select “Zoom to Layer”

58

Layer Files

Page 156: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Let’s verify that the formatting we created was saved in the layer file.

1 - under the “Map” menu, select “Add Data” → “Data”

2 - in the “data” → “Centreline” folders, select the “Toronto Roads.lyrx” file

3 - click on “OK”

59

Layer Files

Page 157: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - to restore the order of our layers from before, select the “bikeways” layer and move it above the “Toronto Roads” layer in the Contents pane

Layer Files

60

Page 158: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

remember to save your project often

61

Saving Projects

Page 159: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in the “Catalog” pane, locate the “AP1947” folder

2 - select and load the two files within that folder into the map

3 - shift-click and select both air photos in the “Contents” pane

4 - while still holding the shift key, right-click on one of the two file and select “Group”

5 - rename the grouped datasets “1947 air photos”

62

Grouping datasets

Page 160: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - right-click on the “1947 air photos” layer and select “Zoom to Layer”

2 - you could save the grouping of the two datasets in a “layer” file as we did previously with the “Toronto Roads” layer.

63

Grouping Datasets

Page 161: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - right-click and remove the “1947 air photos” layer group

2 - in your web browser, go to the following url: https://www.toronto.ca/city-government/data-research-maps/open-data/open-data-catalogue/#b2d79926-bce9-989c-390b-7ff5247b6515 alternatively, go to toronto.ca/open, click on the “Open Data Catalogue” link and in the search box type “Web Map Services”, click on the link

3 - select and copy the first link

64

Mapping Services

Page 162: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in ArcGIS Pro, click on the “Insert” menu and select “New WMS Server”

2 - in the “server URL” box, paste the link obtained from the open data site: “http://gis.toronto.ca/arcgis/services/primary/cot_ortho_mtm/M

apServer/WMSServer?”

3 - click on “OK”

65

Mapping Services

Page 163: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in the “Catalog” pane, navigate to the “Servers” area

2 - expand the “primary_cot_ortho_mtm” connection, expand the “Layers”

3 - select and drag the “City of Toronto Imagery” layer into your map

4 - zoom in and out of your map

66

Mapping Services

Page 164: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

67

Mapping ServicesOther WMS sites

Page 165: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding1 - in the folder “ArcGISProWorkshop/data/Coffee_Shops” double-click on the file, “Coffee_TIME_SA.csv”

Notice there is no geography attached to this file other than address locations.

2 - close the spreadsheet

68

Page 166: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding1 - drag the “Coffee_TIME_SA.csv” file into the “Contents” pane

You will notice that the table appears in the “Contents” pane, but nothing is mapped out. In order for our data to be mapped out, coordinates need to be assigned to each location. A “Geocoder” must be used to accomplish this task. There are many that exist, but ArcGIS Pro uses its own proprietary one that requires you sign into ArcGIS Online.

69

Page 167: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in the top right corner of the ArcGIS Pro screen, click on “Not signed in”

2 - click on “Sign in”

3 - click on “ARCGIS ONLINE (UNIVERSITY OF TORONTO)

4 - sign in using your UTORid

Geocoding

70

Page 168: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding1 - in the “Contents” pane, right-click on the “Coffee_Time_SA.csv” file and select “Geocode Table”

2 - in the “Geocode Table” wizard popup, click on “Start → “

71

Page 169: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding1 - in “Step 1 of 6”, your “Input Table” should be “Coffee_Time_SA.csv” and your selection for your data to be geocoded should be selected as “More than one field”

2 - click on “Next →”

3 - select either of the two geocoders listed

4 - click on “Next →”

72

Page 170: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding1 - if using the “ArcGIS World Geocoding Service”, match the fields as in this screen capture

2 - if using the “Canadian Geocoder”, map the fields as per the second screen capture

3 - click on “Next →”

73

Page 171: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

GeocodingNOTE: if using the “ArcGIS World Geocoding Service” go to the next page

1 - if using the “Canadian Geocoder”, click on “Run”

2 - once completed, click on “No” to the “Geocoding Completed” popup

3 - close the “Geocode Table” popup window

74

Page 172: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

GeocodingNOTE: This screen is for those who are using the “ArcGIS World Geocoding Service”

1 - select “Address Location” as the “Preferred Location Type” in “Step 4”

2 - click on “Next →”

3 - in “Step 5”, click on “Next →”

75

Page 173: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding1 - click on “Finish → “ in “Step 6”

2 - click on “Run” once the “Guided Workflow Complete” popup appears

76

Page 174: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding1 - in the “Geocoding Completed” popup, click “No” to run through the “rematch” process

2 - close the “Geocode Table” popup window

77

Page 175: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding1 - click on any of the resulting points

2 - right-click on the generated layer “Coffee_Time_SA_Geocoded” and select “Attribute Table”

3 - when sliding through the table to the right to view all the fields, you will notice that the longitude (X) and latitude (Y) fields for each entry will be listed

78

Page 176: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding with Google EarthOne alternative to Esri’s geocoders is to use Google to geocode your addresses.

1 - In Windows Explorer, open “Google Earth Pro”

2 - drag the “Coffee_Time_SA.csv” file into “Google Earth”

79

Page 177: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding with Google Earth1 - in the “Data Import Wizard”, select “Delimited” for “Field Type” and “Comma” under the “Delimited” area

2 - click on “Next >”

80

Page 178: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding with Google Earth1 - make sure the option “This dataset does not contain latitude/longitude information, but street addresses” is turned on

2 - click on “Next >”

81

Page 179: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding with Google Earth1 - map out the “Address Fields” according to the spreadsheet column names “Street Field” → “Address”; “City Field” → “City”, etc.

2 - click on “Finish”

82

Page 180: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding with Google Earth1 - click on “No” when asked to apply a template to the file

83

Page 181: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding with Google Earth1 - turn on the “Coffee_Time_SA.csv” layer in the “Places” pane in Google Earth

2 - click on any of the points

84

Page 182: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding with Google Earth1 - right-click on the “Coffee_Time_SA.csv” layer and select “Save Place As…”

2 - save your file as “Coffee_Time_SA.kmz” in the “ArcGISProWorkshop\data\CoffeeShops” folder

85

Page 183: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Geocoding with Google Earth1 - from the “ArcGISProWorkshop\data\CoffeeShops\” folder, drag and drop the “Coffee_Time_SA.kmz” file into your map

2 - click on any of the points

86

Page 184: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Other GeocodersAnother free geocoder is “Geocoder.ca”

To use “geocoder.ca”, simply copy and paste addresses in the first screen and select an output format

Click on “Geoparse locations from text”

87

Page 185: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Other GeocodersThe University of Toronto also purchases access to DMTI’s “Location Hub” geocoder

A username and password are required for access to this service.

88

Page 186: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

1 - in Windows, navigate to the the “ArcGISProWorkshop/data/lost_breweries” folder

2 - double click on the “LostBreweriesToronto.csv” file

Notice there are two columns indicating a geographic location using latitude, “POINT_X” and a longitude, “POINT_Y”

3 - close the file and do not save it

89

Displaying XY (Coordinate or GPS) Data

Page 187: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Displaying XY Data1 - drag the “LostBreweriesToronto.csv” file into your map

2 - right-click on “LostBreweriesToronto.csv” in the “Contents” pane and select “Display XY Data”

3 - make sure the “X Field” is set to “POINT_X” and the “Y Field” is set to “POINT_Y” and note the name of the “Output Feature Class”

4 - click on “Run”

90

Page 188: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

Displaying XY data1 - a new feature layer will be loaded into your map and saved into your geodatabase

91

Page 189: ArcGIS Pro - Inforum Library · QGIS (free, open source, runs on all OS) 9. Other Software 10. Other MDL Workshops Data - Working with Messy Data in OpenRefine Data Visualization

End of Module 3Workshop evaluation if you do not move onto module 4:

http://maps.library.utoronto.ca/feedback.html

92