linked data tutorial 20111102
TRANSCRIPT
Linked Data TutorialOpen Government Knowledge: AI Opportunities and Challenges (OGK2011)
AAAI Fall Symposium
David Wood3 Round Stones Inc.
November 2011
What isLinkedData?
1970s 1980s 1990s
$ cat foo.txt | grep blah | sort
A neat little package Client-Server The Early Web
Silos
Email Databases Proprietarycontainers
Silos
Web
Universal Client
Universal Connection
Universal File System
Ubiquitous,reusable applications
URL Curation
The Web of Documents• A global network of linked documents
• A place where anyone can say anything about anything
• A vast collection of human-readable knowledge (and opinion)
• Documents are linked, but links are not qualified
Data Inflation
Megabyte (MB) = 220
Gigabyte (GB) = 230
Terabyte (TB) = 240 1,000GB
Petabyte (PB) = 250 1,000TB
Exabyte (EB) = 260 or 1,000PB
Zettabyte (ZB) = 270 or 1,000EB
Yottabyte (YB) = 280 or1,000ZB
Web
Universal Client
Universal Connection
Universal Database
Logic and interlinking
Ubiquitous,reusable applications
URL Curation
of Data
The Web of Data• A global network of linked statements
• A place where anyone can say anything about anything
• A vast collection of machine-readable knowledge (and opinion)
• Statements are linked, and links are qualified
We’ve Seen This Before
RDF:A data format for
the Web
RDF is ...• Resource Description Framework
http://www.w3.org/RDF/
• A simple, powerful, data model
• Used to define relationships between things
• Designed to work with the architecture of the web
• The data model for the Web of Data
Allow anyoneto say anythingabout anything
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
NASA - NSSDC - Spacecraft - Detailstitle
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
NASA - NSSDC - Spacecraft - Detailstitle
23 November 2009published
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
NASA - NSSDC - Spacecraft - Detailstitle
23 November 2009published
15702size
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
NASA - NSSDC - Spacecraft - Detailstitle
23 November 2009published
Apollo 11 Command and Service Module
15702size
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
NASA - NSSDC - Spacecraft - Detailstitle
23 November 2009published
Apollo 11 Command and Service Module
about
15702size
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
NASA - NSSDC - Spacecraft - Detailstitle
23 November 2009published
Apollo 11 Command and Service Module
about
Web Pagea
15702size
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
NASA - NSSDC - Spacecraft - Detailstitle
23 November 2009published
Apollo 11 Command and Service Module
about
Web Pagea Spacecrafta
15702size
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
NASA - NSSDC - Spacecraft - Detailstitle
23 November 2009published
Apollo 11 Command and Service Module
about
Web Pagea Spacecrafta
Apollo 11 Command and Service Modulename
15702size
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
NASA - NSSDC - Spacecraft - Detailstitle
23 November 2009published
Apollo 11 Command and Service Module
about
Web Pagea Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
15702size
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
NASA - NSSDC - Spacecraft - Detailstitle
23 November 2009published
Apollo 11 Command and Service Module
about
Web Pagea Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
15702size
28801.0mass
Spacecraft Name Mass Launched Launch Site
1969-018A Apollo 9 26801.0 1969-03-03 1
1969-030A Mariner 7 411.8 1969-03-27 1
1969-043A Apollo 10 28834.0 1969-05-18 1
1969-059A Apollo 11 Command and Service Module (CSM) 28801.0 1969-07-16 1
1969-059C Apollo 11 Lunar Module / EASEP 15065.0 1969-07-16 1
1969-099A Apollo 12 Command and Service Module (CSM) 28790.0 1969-11-14 1
1970-029C Apollo 13 Lunar Module/ALSEP 15196.0 1970-04-11 1
1970-029A Apollo 13 Command and Service Module (CSM) 28945.0 1970-04-11 1
Spacecraft Name Mass Launched Launch Site
1969-018A Apollo 9 26801.0 1969-03-03 1
1969-030A Mariner 7 411.8 1969-03-27 1
1969-043A Apollo 10 28834.0 1969-05-18 1
1969-059A Apollo 11 Command and Service Module (CSM) 28801.0 1969-07-16 1
1969-059C Apollo 11 Lunar Module / EASEP 15065.0 1969-07-16 1
1969-099A Apollo 12 Command and Service Module (CSM) 28790.0 1969-11-14 1
1970-029C Apollo 13 Lunar Module/ALSEP 15196.0 1970-04-11 1
1970-029A Apollo 13 Command and Service Module (CSM) 28945.0 1970-04-11 1
Spacecraft Name Mass Launched Launch Site
1969-018A Apollo 9 26801.0 1969-03-03 1
1969-030A Mariner 7 411.8 1969-03-27 1
1969-043A Apollo 10 28834.0 1969-05-18 1
1969-059A Apollo 11 Command and Service Module (CSM) 28801.0 1969-07-16 1
1969-059C Apollo 11 Lunar Module / EASEP 15065.0 1969-07-16 1
1969-099A Apollo 12 Command and Service Module (CSM) 28790.0 1969-11-14 1
1970-029C Apollo 13 Lunar Module/ALSEP 15196.0 1970-04-11 1
1970-029A Apollo 13 Command and Service Module (CSM) 28945.0 1970-04-11 1
Spacecraft Name Mass Launched Launch Site
1969-018A Apollo 9 26801.0 1969-03-03 1
1969-030A Mariner 7 411.8 1969-03-27 1
1969-043A Apollo 10 28834.0 1969-05-18 1
1969-059A Apollo 11 Command and Service Module (CSM) 28801.0 1969-07-16 1
1969-059C Apollo 11 Lunar Module / EASEP 15065.0 1969-07-16 1
1969-099A Apollo 12 Command and Service Module (CSM) 28790.0 1969-11-14 1
1970-029C Apollo 13 Lunar Module/ALSEP 15196.0 1970-04-11 1
1970-029A Apollo 13 Command and Service Module (CSM) 28945.0 1970-04-11 1
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
NASA - NSSDC - Spacecraft - Detailstitle
23 November 2009published
Apollo 11 Command and Service Module
about
Web Pagea Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
15702size
28801.0mass
Spacecraft Name Mass Launched Launch Site
1969-018A Apollo 9 26801.0 1969-03-03 1
1969-030A Mariner 7 411.8 1969-03-27 1
1969-043A Apollo 10 28834.0 1969-05-18 1
1969-059A Apollo 11 Command and Service Module (CSM) 28801.0 1969-07-16 1
1969-059C Apollo 11 Lunar Module / EASEP 15065.0 1969-07-16 1
1969-099A Apollo 12 Command and Service Module (CSM) 28790.0 1969-11-14 1
1970-029C Apollo 13 Lunar Module/ALSEP 15196.0 1970-04-11 1
1970-029A Apollo 13 Command and Service Module (CSM) 28945.0 1970-04-11 1
Spacecraft Name Mass Launched Launch Site
1969-018A Apollo 9 26801.0 1969-03-03 1
1969-030A Mariner 7 411.8 1969-03-27 1
1969-043A Apollo 10 28834.0 1969-05-18 1
1969-059A Apollo 11 Command and Service Module (CSM) 28801.0 1969-07-16 1
1969-059C Apollo 11 Lunar Module / EASEP 15065.0 1969-07-16 1
1969-099A Apollo 12 Command and Service Module (CSM) 28790.0 1969-11-14 1
1970-029C Apollo 13 Lunar Module/ALSEP 15196.0 1970-04-11 1
1970-029A Apollo 13 Command and Service Module (CSM) 28945.0 1970-04-11 1
ID Name
1 Cape Canaveral, United States
2 Tyuratam (Baikonur Cosmodrome), U.S.S.R
3 Xichang Space Launch Center
Spacecraft Name Mass Launched Launch Site
1969-018A Apollo 9 26801.0 1969-03-03 1
1969-030A Mariner 7 411.8 1969-03-27 1
1969-043A Apollo 10 28834.0 1969-05-18 1
1969-059A Apollo 11 Command and Service Module (CSM) 28801.0 1969-07-16 1
1969-059C Apollo 11 Lunar Module / EASEP 15065.0 1969-07-16 1
1969-099A Apollo 12 Command and Service Module (CSM) 28790.0 1969-11-14 1
1970-029C Apollo 13 Lunar Module/ALSEP 15196.0 1970-04-11 1
1970-029A Apollo 13 Command and Service Module (CSM) 28945.0 1970-04-11 1
ID Name
1 Cape Canaveral, United States
2 Tyuratam (Baikonur Cosmodrome), U.S.S.R
3 Xichang Space Launch Center
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?
id=1969-059A
NASA - NSSDC - Spacecraft - Detailstitle
23 November 2009published
Apollo 11 Command and Service Module
about
Web Pagea Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
15702size
28801.0mass
Apollo 11 Command and Service Module
Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
28801.0mass
Apollo 11 Command and Service Module
Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
28801.0mass
Cape Canaveral
Cape Canaveral, United States name
launchsite
Apollo 11 Command and Service Module
Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
28801.0mass
Cape Canaveral
Cape Canaveral, United States name
launchsite
Resource
Apollo 11 Command and Service Module
Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
28801.0mass
Cape Canaveral
Cape Canaveral, United States name
launchsite
Resource
Literal
Apollo 11 Command and Service Module
Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
28801.0mass
Cape Canaveral
Cape Canaveral, United States name
launchsite
Resource
LiteralPredicate
Resources...• Represent things on the web, like web
pages — Information Resources
• Represent things not on the web, like people and places — Non-Information Resources
• Can represent anything at all
• Named using URIs (usually)
• May not have a name — Blank Nodes
Literal Values...• Are values to work with and show
users
• Can be just a string of text — Plain Literals
• Can have a language assigned to the them using ISO codes
• Can have a specific datatype assigned to them — Typed Literals
Predicates are...• Relationships between Resources
• Named using URIs
• Described in Schema(or vocabularies, or ontologies)
Apollo 11 Command and Service Module Cape Canaveral Cape Canaveral,
United States namelaunchsite
Statement or Triple
Apollo 11 Command and Service Module Cape Canaveral Cape Canaveral,
United States namelaunchsite
Statement or Triple
Apollo 11 Command and Service Module Cape Canaveral Cape Canaveral,
United States namelaunchsite
Subject Predicate Object
Statement or Triple
Apollo 11 Command and Service Module Cape Canaveral Cape Canaveral,
United States namelaunchsite
Subject Predicate Object
Statement or Triple
Statement or Triple
Apollo 11 Command and Service Module Cape Canaveral Cape Canaveral,
United States namelaunchsite
Subject Predicate Object
Statement or Triple
Statement or Triple
Subject Predicate Object
Apollo 11 Command and Service Module
Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
28801.0mass
Cape Canaveral
Cape Canaveral, United States name
launchsite
Apollo 11 Command and Service Module
Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
28801.0mass
Cape Canaveral
Cape Canaveral, United States name
launchsite
LiteralPredicate
Resource
Apollo 11 Command and Service Module
Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
28801.0mass
Cape Canaveral
Cape Canaveral, United States name
launchsite
Apollo 11 Command and Service Module
Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
28801.0mass
Cape Canaveral
Cape Canaveral, United States name
launchsitehttp://.../1969-059A
http://.../Spacecraft
http://.../cape+cana...
Apollo 11 Command and Service Module
Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
28801.0mass
Cape Canaveral
Cape Canaveral, United States name
launchsitehttp://.../1969-059A
http://.../Spacecraft
http://.../cape+cana...
N 28° 27' 31''latitude
W 80° 31' 59''longitude
http://.../cape+cana...
Apollo 11 Command and Service Module
Spacecrafta
Apollo 11 Command and Service Modulename
16 July 1969launched
28801.0mass
Cape Canaveral
Cape Canaveral, United States name
launchsitehttp://.../1969-059A
http://.../Spacecraft
http://.../cape+cana...
N 28° 27' 31''latitude
W 80° 31' 59''longitude
Simple Rules for Merging• URIs name the resources we are
describing
• Two people using the same URI are describing the same thing
• The same URI in two datasets becomes one URI with all of the properties from both datasets
• RDF data can use URIs from many different websites
Simple Rules for Merging• Graphs from several different sources
can be merged
• Resources with the same URI are considered identical
• No limitations on which graphs can be merged
Linked Data can be merged with
other Linked Data
No silos
RDF...• is a Graph data model
XML is a tree data modelRDBMS is a table data model
• can be easily distributed
• is easily mergeable
• can say anything about anything
• is not newthe spec is from 1999the idea, EAV, stems back to the late 1960s
The Future ofLinked Data
YouTube HDTV
watch videos watch Better videos
Publish videos
Share videos
Rate videos
Discuss videos
Linked Data RDBMS
Use data Use data
Publish data
Share data
Rate data
Discuss data
Linked Data warehouses Linked Data supply chains Linked Data analytics
Coming Soon
http://linkeddatabook.com/editions/1.0/http://3roundstones.com/linking-enterprise-data/
Further Reading
http://www.linkeddatadeveloper.com/http://3roundstones.com/linking-government-data/
Callimachuscallimachusproject.org
CreditsBatman Treaty Signing
(public domain)http://upload.wikimedia.org/wikipedia/commons/d/dc/Batman_signs_treaty_artist_impression.jpg)
Centro Universitario de Ciencias Exactas e Ingenierías, Universidad de Guadalajara
(public domain)
http://proton.ucting.udg.mx/galeria/3D/WEB.jpg
Spreadsheet PhotoCasey Serin
(CC-BY licensed)http://www.flickr.com/photos/sercasey/351617208/sizes/l/in/photostream/
LOD Cloud DiagramsRichard Cyganiak, Anja Jentzsch, (CC-BY-SA)
http://lod-cloud.net/
Earth weather analysis imageNASA Goddard SFC
CC-BYhttp://www.flickr.com/photos/gsfc/4662884851/
Darkon Movie Poster, BBC screenshots, CAMC credit card image and book covers © their respective ownersand used under Fair Use for educational purposes
Darkon Movie Poster, BBC screenshots, CAMC credit card image and book covers © their respective ownersand used under Fair Use for educational purposes
All other photos and drawings © 2010-11 David Wood, released under a CC-BY-SA licenseAll other photos and drawings © 2010-11 David Wood, released under a CC-BY-SA license
CreditsHead with 3D Glasses
Mark Chapman(CC-BY licensed)
http://www.flickr.com/photos/markchapmanphoto/5139429152/
Chasm PhotoTravis S.
(CC-BY-NC licensed)http://www.flickr.com/photos/baggis/3860802929/
Supply Chain ImageKevin Krejci
(CC-BY licensed)http://www.flickr.com/photos/kevinkrejci/6141829763/
Sharing Squirrels Imageleezie5
CC-BY-NC-ND licensed)http://www.flickr.com/photos/leeziet/5912219625/
Thanks to
• Rob Styles, Talis Group Ltd for his CC-BY licensed “Two Day Introduction to the Web of Data” slides and spacecraft example data.
This work is Copyright © 2011 3 Round Stones Inc.It is licensed under the Creative Commons Attribution 3.0 Unported LicenseFull details at: http://creativecommons.org/licenses/by/3.0/
You are free:
to Share — to copy, distribute and transmit the work
to Remix — to adapt the work
Under the following conditions:Attribution. You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work).
Share Alike. If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one.