homer task 3.2: “overview on technical aspect for...

HOMER TASK 3.2: “OVERVIEW ON TECHNICAL ASPECT FOR THE FEDERATION”

Ljubljana, 11 December 2013

CSI Piemonte

Alessandro FranceschettiNives AlciatoSaverino Reale

In this presentation we talk about:

Memorandum of UnderstandingCollection of the signatures and introduction to the MoU light

The requirements to realize the Homer Federation: the situation

The Federated Semantic multi language Search Engine: what has been done in November 2013

The ongoing activities and looking forward

Roadmap for next months

Memorandum of UnderstandingThe 9th version has been accepted by all Partners

At 09/12/2013 collection of the signatures from:01 Piedmont Region – ITALY04 Emilia-Romagna Region – ITALY05 Veneto Region - ITALY06 Sewerage Board of Limassol – Amathus SBLA – CYPRUS08 Decentralized Administration of Crete - CRETE14 Local Council Ass. of Malta Gozo – MALTA

For ‘13 Région Provence-Alpes-Côte d'Azur - PACA – France’ the signature will come in the first trimester 2014

Memorandum of Understanding “Light” for new Stakeholders

With the aim to extend the Federation and have a huge number of datasets, it has been thought – as first step to start the activities - the MoU “light”:

is addressed to the Stakeholders who wish to expose their catalogues of open data joining in the Federation

has been created starting from the MoU_V09 accepted and signed and contains only those articles that are strictly necessary to describe what is the federation, how is composed and which are the fulfilments

it will be delivered before the end of December 2013 and it will be possible to propose it to all new stakeholders that are interested in the thematic and in the Homer Federation


Memorandum of Understanding Collection of the signatures and the MoU light

The requirements to realize the Homer Federation: the situation The Federated Semantic multi language Search Engine: what has been done in November 2013




To be inside the federation each open data portals have to meet:

data side requirements

technical side requirements

The requirements to realize the Homer Federation: summarizing the Requirements

A. Data requirements

Documentation provided

A.1 have open data or data to be opened related to the 5 Homer categories

A.2 have an open data portal or an url that exposes these data

A.3 have a metadata structure that meets the “metadata common fields”

A.4 use the labels of EuroVoc to insert the tags as keywords in datasets

A.1 Preparatory table for Open Portals SoA_v03.xls

A.2 ODP State 2013 10_sent.xls

A.3 Metadata Common Fields_v06.xls

A.4 EuroVoc labels and Homer Tags.xls, Homer_EuroVoc_CSI Piemonte.ppt


A.1 5 Homer

categories

A.2OPD

or URL

A.3Metadata common fields

A.4EuroVoc

Yes all Partners Yes all Partners

Yes for: Piedmont, Sarga, E-R, Veneto, SBLA, AGAPA, PACA, DAC, Malta, Slovenia, Corse, Montenegro

Yes for:Piedmont, E-R, Veneto, SBLA, PACA, DAC, Malta, Slovenia, Corse, Montenegro

Work In Progress for Sardinia Work In Progress for SARGA, Sardinia, AGAPA

13/13 13/13 12/13 10/13


B. Technical requirements

Documentation provided

B.1.1 datasets are exposed with API set interface CKAN compliant (or)B.1.2 datasets are exposed with Catalogue Services for the Web protocol (or)B.1.3 datasets are exposed with Web Services like ‘www.dati.piemonte.it’

B.2 interoperability with the Federated Index

B.3 a page to access at the federated search and to expose the result of the federated search

B.1,2,3 Federation_technical specific_CSI_V03.doc

B.1,2,3 Glossary_V01.doc


B.1.1CKAN

B.1.2.CSW

B.1.3Dati.piemonte.it

B.2Fed Index

B.3Page for search

Veneto, SBLA, DAC, Montenegro

none Piedmont, Emilia-Romagna,Slovenia

Piedmont, Veneto, SBLA, DAC, Montenegro, E-R, Slovenia

none

Work In Progress for Sarga, Sardinia, AGAPA, PACA, LCA Malta, Corse

Work In Progress for Sarga, Sardinia, AGAPA, PACA, LCA Malta, Corse

Work In Progress for all Partners

7/13 7/13 0/13


Memorandum of UnderstandingCollection of the signatures






To check that all the metadata cards are in the Federated-Index

Look at this symbol: it represents the metadata catalogue

The Federated Semantic multi language Search Engine: test the search engine at 3 levels involved

To test the search engine have been identified testcases to cover all possibilities at the levels:

• EuroVoc level• Multi language level• EuroVoc level and multi language level combined

This because it has been necessary to verify that a semantic multi language search provides the right result

1. Testcases At EuroVoc level:

a)a) InsertionInsertion in metadata cards of labels from EuroVoc that refers at different levels of the tier hierarchical structure (domain, microthesauris, top concepts, narrower terms, related terms inside or outside)

b)b) CheckCheck that the result of the different kinds of searches contains / or not contains, the tree or the sub-tree of the domain involved (for this look also at the example of search in the slide-show about EuroVoc)

2. Testcases At multi language level:

Id_card Field_01 tag lang Field_n

000123 xxx FreshWater en zzz

000124 yyy Agua dulce es xxx

000125 kkk Eau douce fr yyy

000126 zzz Acqua dolce it kkk

000127 xxx γλυκόνερό

el zzz

000128 yyy слаткавода

sr xxx

000129 kkk Sladka voda sl yyy

text Lang input Lang output # cards

Water En blank 7 (all)

Eau Fr En 000123

Acqua It It 000126

Agua blank blank 000124

Translation of a concept in all languages Translation from lang input different to lang output

Identification in the same language Identification of a term without specification of the language

a)a) InsertionInsertion in the metadata cards of labels from EuroVoc that refers at the same concept in all different languages involved in Homer

b)b) CheckCheck that the result of the different kinds of searches contains / or not contains the metadata cards expected

3. Testcases At EuroVoc level and at multi language level combined:

Field_a)a) InsertionInsertion in metadata cards of labels from EuroVoc that refers at different levels of the

tier hierarchical structure and in all languages involved in Homer

b)b) CheckCheck that the result of the different kinds of searches contains / or not contains, the tree or the sub-tree of the domain involved in the languages used

The Federated Semantic multi language Search Engine: what has been done in November 2013 – Technical Side

Urls received from:

Field_0

Emilia-Romagna Region http://www.dati.emilia-romagna.it/index.php?option=com_rd&view=pceli_list&format=xml&layout=xml

Veneto Region http://opendata.collaudo.regione.veneto.it/dataset

SBLA Cyprus http://opendata-cy.datacenter.uoc.gr/dataset/tto1ot1ka-xapaktnp1ot1ka-tou-avakukjwuevou-vepou

DAC Crete http://84.205.229.31/api/2/rest/package

Geodetic Institue of Slovenia http://www.open-homer.si/data/package_list.xml

Mediterranean University of Montenegro

http://www.open-data.me/api/rest/package

The Federated Semantic multi language Search Engine: what has been done in November 2013 – Technical Side

Field_0

API

API dati.piemonte.it compliant

API CKAN compliant

The Federated Semantic multi language Search Engine: what has been done in November 2013 http://www.dati.piemonte.it/homer/test/#

The Search:

The Federated Semantic multi language Search Engine: what has been done in November 2013 http://www.dati.piemonte.it/homer/test/#The Result:


Memorandum of UnderstandingCollection of the signatures and the MoU light



The ongoing activities and looking forwardRoadmap for next months


The federation is born

The federation is in progress

Achievement for all Partners of the requirements Data Side & Technical Side


New stakeholders in the Federation

A huge number of datasets available for theHackathon on 17th May 2014


Memorandum of UnderstandingCollection of the signatures and the MoU light





Roadmap for next monthsWhen What StateOctober 2013 Implementation and Test phase of the Federated

Semantic Multi Language Engine

November 2013 Configuration of the Federated Index to call Open Data portal API’s that has been ready to be federated

December 2013 The Engine is built and 7 Partners are federated

From now to 2014 The Federation is in progress: it is possible to add new Open Data and to configure new Open Data Portals and to add new Stakeholders

THANKS Ευχαριστίες

HVALA Хвала GRACIASMERCI GRAZIE

CSI PiemonteAlessandro FranceschettiNives AlciatoSaverino Reale

homer task 3.2: “overview on technical aspect for...

Documents