linkedgov extension for google refine
DESCRIPTION
Presentation slides for UK Gov Camp 2012TRANSCRIPT
![Page 1: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/1.jpg)
The
LinkedGov extension
for Google Refine
@danpaulsmith
![Page 2: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/2.jpg)
What is LinkedGov?
A community project aiming to
make public data more usable
@danpaulsmith
CleaningImproving access
EnrichingLinking
![Page 3: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/3.jpg)
@danpaulsmith
Import existing
data(CSV, Excel,
XML)
Cleaning tasks
Question site
data.linkedgov
.org
LinkedGov database
& core components
Data flow
(Data is stored as machine-readable data)
✔✖
![Page 4: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/4.jpg)
What is Google Refine?
“A power tool for working with messy data”
“cleaning it up”,
“ transforming it”,
“extending it”,
“and linking it”
@danpaulsmith
![Page 5: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/5.jpg)
@danpaulsmith
![Page 6: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/6.jpg)
Spreadsheet software
Spreadsheet software Google Refine
Single-cell editing Bulk-editing
Create & input data Use & transform existing data
Document-based Data-based
Allows extensions to be installed
@danpaulsmith
![Page 7: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/7.jpg)
Transposition, multi-valued cells, clustering, faceting, filtering
@danpaulsmith
![Page 8: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/8.jpg)
What does the LinkedGov extension do?
@danpaulsmithImage curtosey of http://download.chip.eu
![Page 9: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/9.jpg)
Typing wizards
@danpaulsmith
Date & time Measurements Geolocations Addresses
![Page 10: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/10.jpg)
Other wizards
@danpaulsmith
Columns to rows Rows to columns Blank values Codes and symbols
![Page 11: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/11.jpg)
@danpaulsmith
![Page 12: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/12.jpg)
@danpaulsmith
![Page 13: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/13.jpg)
Cleaning
@danpaulsmith
![Page 14: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/14.jpg)
Enriching
@danpaulsmith
![Page 15: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/15.jpg)
What a machine understands before
(CSV, TSV, Excel)
@danpaulsmith
number word number word date number number
number word number word date number number
number word number word date number number
number word number word date number number
number word number word date number number
Column
Row
Column Column Column Column Column Column
RowRowRowRow
![Page 16: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/16.jpg)
What a machine understands after
(machine-readable format)
@danpaulsmith
Celsius string kWh Postcode date m3 metres
Celsius String kWh Postcode date m3 metres
Celsius string kWh Postcode date m3 metres
Celsius string kWh Postcode date m3 metres
Celsius string kWh Postcode date m3 metres
PostcodeName Gas/hourTempWater/hourDate Height
BuildingBuilding
BuildingBuildingBuilding
![Page 17: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/17.jpg)
The power of linking
@danpaulsmith
PostcodesLatitude & longitude Dates Measurements
GP Surgery address dataNHS geo data
GP Surgery energy use data
NHS events data
![Page 18: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/18.jpg)
@danpaulsmith
Import existing
data(CSV, Excel,
XML)
Cleaning tasks
Question site
data.linkedgov
.org
LinkedGov database
& core components
Data flow
(Data exists as linked data)
✔✖
![Page 19: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/19.jpg)
Cleaning tasks
@danpaulsmith
![Page 20: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/20.jpg)
@danpaulsmith
Import existing
data(CSV, Excel,
XML)
Cleaning tasks
Question site
data.linkedgov
.org
LinkedGov database
& core components
Data flow
(Data exists as linked data)
✔✖
![Page 21: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/21.jpg)
Question site
@danpaulsmith
![Page 22: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/22.jpg)
@danpaulsmith
Import existing
data(CSV, Excel,
XML)
Cleaning tasks
Question site
data.linkedgov
.org
LinkedGov database
& core components
Data flow
(Data exists as linked data)
✔✖
![Page 23: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/23.jpg)
data.linkedgov.org
@danpaulsmith
![Page 24: LinkedGov extension for Google Refine](https://reader033.vdocuments.us/reader033/viewer/2022061218/54827e38b4af9f9b538b4ac2/html5/thumbnails/24.jpg)
Feedback & questions
@danpaulsmith
http://linkedgov.org - Website
http://wiki.linkedgov.org - Wiki
@LinkedGov - Twitter
#linkedgov – IRC (Freenode.net)