Copyright 2009 Digital Enterprise Research Institute. All rights reserved.

Digital Enterprise Research Institute www.deri.ie

Employing Google Refine to Publish Linked Data

Fadi Maali and Richard Cyganiak

Digital Enterprise Research Institute www.deri.ie

Road map

Self-Service Linked Government Data

Google Refine

RDF Export Extension

RDF Reconciliation Extension

Digital Enterprise Research Institute www.deri.ie

We need government data as Linked Data not just Raw Data

….aha, and of a good quality!

Digital Enterprise Research Institute www.deri.ie

Raw data catalogue, data.gov

Digital Enterprise Research Institute www.deri.ie

We want governments to provide Linked Data not just Raw Data… and of good quality

TIM

EM

ONE

Y SKIL

LS

Digital Enterprise Research Institute www.deri.ie

From raw data to Linked Data

DIY

Digital Enterprise Research Institute www.deri.ie

DIY Recipe

Publishers provide RDF representation of their catalogues

User shares the RDF data

Tool support to select datasets of interest and put them into RDF

Digital Enterprise Research Institute www.deri.ie

DIY Recipe

Publishers provide RDF representation of their catalogues

User shares the RDF data

Tool support to select datasets of interest and put them into RDF

dcat

Digital Enterprise Research Institute www.deri.ie

DIY Recipe

Tool support to select datasets of interest and put them into RDF User shares the

RDF data

Publishers provide RDF representation of their catalogues

dcat

Google Refine

+ RDF export extension+ RDF reconciliation extension

Digital Enterprise Research Institute www.deri.ie

DIY Recipe

User shares the RDF dataTool support to select datasets of interest and put them into RDF

Publishers provide RDF representation of their catalogues

dcat Google Refine

+ RDF export extension

+ RDF reconciliation extension

Share RDF data along with the conversion process descriptionProvenance & Reproducibility

Digital Enterprise Research Institute www.deri.ie

Road map

Self-Service Linked Government Data

Google Refine

RDF Export Extension

RDF Reconciliation Extension

Digital Enterprise Research Institute www.deri.ie

Google Refine

Google Refine is a power tool for working with messy data, cleaning it up, transforming it from one format into another, extending it with web services, and linking it to databases like Freebase*

Desktop application that a user interacts with using a web browser

Open Source (New BSD License) Extensible

*http://code.google.com/p/google-refine/

Digital Enterprise Research Institute www.deri.ie

Demo

Digital Enterprise Research Institute www.deri.ie

Demo

Top 100 IT university in UK (Guardian data blog http://www.guardian.co.uk/news/datablog/2009/jun/02/universityguide-choosingadegree)

Digital Enterprise Research Institute www.deri.ie

Demo

Digital Enterprise Research Institute www.deri.ie

Demo

Digital Enterprise Research Institute www.deri.ie

Demo

Digital Enterprise Research Institute www.deri.ie

Demo

Digital Enterprise Research Institute www.deri.ie

Demo

Top 100 Electronic Engineering university in UK (Guardian data blog http://www.guardian.co.uk/news/datablog/2009/jun/02/universityguide-choosingadegree)

Digital Enterprise Research Institute www.deri.ie

Demo

Digital Enterprise Research Institute www.deri.ie

RDF Reconcile Extension

RDF Reconcile Extension

Silk Server

SPARQL endpoint

Sindice se

arch A

PI

Crafted RDF

SPARQL

SPARQL endpoint with fulltext extension

Hybrid SPARQL

Silk LSL

Google Refine

Digital Enterprise Research Institute www.deri.ie

Benchmarking…

Reconciling DailyMed against Dbpedia (SPARQL endpoint)

Digital Enterprise Research Institute www.deri.ie

Benchmarking…

Reconciling DailyMed against Sider RDF dump

Digital Enterprise Research Institute www.deri.ie

Conclusion

Publishers provide RDF representation of their catalogues

User shares the RDF data

Tool support to select datasets of interest and put them into RDF

dcat Google Refine+ RDF export extension

+ RDF reconciliation extension

??

Digital Enterprise Research Institute www.deri.ie

Links

Google Refine http://code.google.com/p/google-refine/

RDF Export Extension http://lab.linkeddata.deri.ie/2010/grefine-rdf-extension/

RDF Reconciliation Extensionwill be released soon…