all-wp meeting 4 athens, workpackage 2, kai eckert

28
co-funded by the European Union Work Package 2 All WP Meeting 28th November 2013, Athens Kai Eckert

Upload: digitised-manuscripts-to-europeana

Post on 30-Nov-2014

686 views

Category:

Education


0 download

DESCRIPTION

 

TRANSCRIPT

Page 1: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

co-funded by the European Union

Work Package 2

All WP Meeting28th November 2013, Athens

Kai Eckert

Page 2: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Timetable

16.04.2013 DM2E Review: Work Package 2 2

Q1

• 2.1, 2.3: Test of external components (MINT, Silk, jMet2Ont, D2R), Data Survey• 2.2: Basic entity structure of the model

Q2

• 2.1, 2.4, 2.5: Prototype of Infrastructure, Workflows, UI• 2.2: Mapping workshops, further work on the DM2E data model

Q3

• Softwaredesign of Intermediate Architecture, Foundational work• Combination of the DM2E model with Linked Data principles, Integration with Architecture

Q4

• Provenance Model for DM2E Infrastructure, Web service development• DM2E Data Model 1.0, first stable and operational version.

Q5

• Implementation of the DM2E Data Model in Mint.• Development of the Intermediate Version of the Infrastructure: due on July 15th.

Q6

• Implementation of OmNom as final version.• Further refinements of the DM2E model.

Q7

• Setup of the Silk instance, finalization of OmNom (final version due January 2014).• Data ingestions (Wittgenstein, ÖNB Codices), data evaluation for contextualisation.

Page 3: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Data Model (Evelyn, Julia, Steffen)

DM2E All WP Meeting: Work Package 2 311.06.2013

Page 4: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

DM2E Model Refinements

• Currently working on Version 1.1:– dm2e:     <http://onto.dm2e.eu/schemas/dm2e/1.1/> .– dm2edata: <http://data.dm2e.eu/data/> .

• Model specification– Revision 0.8– Updated EDM definitions

• New property– dm2e:hasAnnotatableVersionAt

• Hierarchies now analogue to EDM– dcterms:hasPart and dcterms:isPartOf

Page 5: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

DM2E Model Documentation

Current stable Version: DM2E Model v1.0

• Version 1.0 documentation on dm2e.eu: http://dm2e.eu/document#DM2EModelSpecification

• Version 1.1 revision history and latest releases on Redmine– Revision history– Model specification– OWL file

Page 6: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Modelling Issue: Uncertainty

• Thoughts on modelling uncertainty:– https://dm2e.hu-berlin.de/redmine/projects/wp2/ wiki

/DM2E#Uncertainty-in-ontology-modelling

• Example of thesimple solution:

Provider data Representation in DM2E

1909-[19--?] edm:TimeSpan begin: 1909 end: uncertainBegin: uncertainEnd: 1999

[18--?] edm:TimeSpan begin: end: uncertainBegin: 1800 uncertainEnd: 1899

17XX edm:TimeSpan begin: end: uncertainBegin: 1700 uncertainEnd: 1799

Page 7: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Mappings

Mappings of the Polytechnische Journal

Page 8: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Consistency Check of the Ontology

• First test using Protege (4.3.0)– Reasoner (HermiT 1.3.8, FaCT ++)– discovered some inconsistent inferred axioms– changed the illogical relations

• Second test using Protege (4.3.0)– Reasoner (HermiT 1.3.8, FaCT ++)– included individuals from the UBER mappings– work in progress

Page 9: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

First Test - First Example

Explanation:

Inconsistent Inferred Axiom

Page 10: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

First Test - Second Example

Explanation:

Inconsistent Inferred Axiom

Page 11: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Second Test with Individuals

Page 12: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Next Steps of UBER in WP2

DM2E model• Analyse your mappings– Which resources are not used?– Are any resources missing?

• Revise the model– A last time after the mapping analysis

DM2E to EDM• XSLT from the specialised to the generalised model

Page 13: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

OmNom (Konstantin, Kai)

DM2E All WP Meeting: Work Package 2 1311.06.2013

Page 14: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

The DM2E Data Bridge

DM2E Review: Work Package 2 1416.04.2013

This is YOUR data.

This is the void:Datasetin DM2E.

Page 15: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Some more links are actually available...

DM2E All WP Meeting: Work Package 2 1511.06.2013

Page 16: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Implementation

• Implementation (mostly) completed.• Currently mainly testing, bug fixes and performance

tuning.• Final version due: January 2014!• Optimized visualization as eye candy (compare to

previous slide):

DM2E All WP Meeting: Work Package 2 1611.06.2013

Page 17: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

RESTful Linked Data API

• Mostly unchanged since intermediate version.• Feedback needed from WP3, but also from other

potential users of the data.• Feature added on request: Data can be marked as

temporary (the default for now). So ingest and play with it, it won‘t be carved in stone (yet).

DM2E All WP Meeting: Work Package 2 1711.06.2013

Page 18: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Alternative ingestion tool

• Fallback solution: Direct XSLT transformation and ingestion.

• Command line based, no GUI, only basic provenance information (but complete).

• Why?– Avoid bottleneck due to ongoing development of OmNom– performance evaluations.

Available on request. Or provide links to your data files and an XSLT mapping and we (Dominique, Kai) are happy to ingest for you.

DM2E All WP Meeting: Work Package 2 1811.06.2013

Page 19: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Single Sign On, Security (Jorge)

DM2E All WP Meeting: Work Package 2 1911.06.2013

Page 20: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Authentication Service

● Centralized Authentication and Authorization Service● Centralized Storage of User Accounts● User Account Schema based on MINT Model. ● Single Sign-On● Standard Based: JAAS, Web Services/SOAP● "Remember Me" support● Password reset support

Page 21: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Status

• Implementation of WS for Single Sign-on (WS-SSO) (http://dm2e-security.rz-berlin.mpg.de/josso/).

• Implementation of a User Manager Application integrated with WS-SSO (http://dm2e-security.rz-berlin.mpg.de/userManager/).

• OmNom integration.

DM2E All WP Meeting: Work Package 2 2111.06.2013

Page 22: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Contextualisation (Dominique, Klaus)

DM2E All WP Meeting: Work Package 2 2211.06.2013

Page 23: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Status

• Evaluation of provided datasets regarding the contextualisation.

• Setup of a Silk instance with preloaded contextualisation targets (GND, LCSH).

• Planned: Geonames, VIAF, Yago, Freebase, DDC, InPho, JudaicaLink, …

• Directly usable: Dbpedia

DM2E Review: Work Package 2 2316.04.2013

Page 24: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

JudaicaLink (Dov, Kai)

• Permission to create and publish Linked Data from:– Russian Jewish Encyclopedia (rujen.ru)– YIVO Encyclopedia

• UMA hired a student assistant to work with both encyclopedias and create Linked Data representations.

• More encyclopediae would be great (Contact Dov)• Further information: JudaicaLink.org

DM2E All WP Meeting: Work Package 2 2411.06.2013

Page 25: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Deployment (Julia)

DM2E All WP Meeting: Work Package 2 2511.06.2013

Page 26: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Berlin Server

• What do we have?– 2 Processors (Multicore)– 64 GB RAM– 4 TB Hard Drive (Usable space might be less, depends on

RAID configuration)– That‘s all, we won‘t get more!

• UBER and UMA will reinstall the server from scratch.• Virtual Machines:– Ontologies, OWLIM, OmNom, Silk, Pundit, Redmine, …

• Downtimes in December, will be announced.

DM2E Review: Work Package 2 2616.04.2013

Page 27: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Next steps

• Final Version (January 2014)– Complete transformation and ingestion infrastructure– Integrated contextualization– Connection with scholarly environment (WP3)– Documentation Drafts

• Data ingestions(!)• Maintenance phase– Bug fixing and performance tuning in OmNom– Documentation and introductory materials with WP4– Data provision for Europeana– Search and browse interface

DM2E Review: Work Package 2 2716.04.2013

Page 28: All-WP Meeting 4 Athens, Workpackage 2, Kai Eckert

Thank you.

DM2E Review: Work Package 2 2816.04.2013