in and out: work flows between library data and linked- data at the...

In and out: Work flows between library data and linked-data at the National Library of Spain

Semantic Web in Libraries November, 25-27th, 2019, Hamburg

Ricardo Santos National Library of Spain

BIBLIOTECA NACIONAL DE ESPAÑA

@3186Ricardo #datosbne

WHAT IS DATOS.BNE?

A fully functioning linked-data based gateway into the library resources. - Library resources (as any other catalogue)

- Data about authors - Data about vocabularies - Data about items - Connected to usual library services (digital library items, loan

services, document reproduction services)

MAIN FEATURES

FRBR-Based

Entity based Entity driven search Entity-based search results ranking

Linked and enriched

Interlinks between FRBR entities Linked to prominent equivalent concepts Enriched with outside data

BASIC DATA MODEL

5 From MARC to FRBR entities

From a 2-D structure to….

6 From MARC to FRBR entities

Behind the scenes

MARiMbA

Data (Marc)

Data analysis Mapping & sorting Linked Data generation Linking and enrichment

Data generation

Publication pipeline

Indexing (1)

Double storing Front-end (2)

Triple store (3)

Ranking based in FRBR relationships

(1) Elasticsearch (2) MongoDB (3) Virtuoso

Peeking inside Marimba

Ingestion and analysis of MARC21 records

Mapping 1: sorting

Mapping 2: model entity linking

Mapping 3: data properties

RDF generation Sorting is based on records: Ex: An authority record with a given tag and a given subfield

combination is an entity XX 100 $a $d C1005

Object properties are based on internal keys or inferred

Data properties are based on subfields:

260 $a P3003 (place of publication)

Dataflows

Other sources

Digital Library

MARC21 (95%)

DATOS.BNE.ES

Dataflows

Other sources

Identifiers from VIAF

Links: sameAs

Dataflows

Other sources

Identifiers from VIAF

Dbpedia

THEY REMAIN ONLY IN DATOS.BNE

Enrichments and data imports

Main enrichment: EVERYDAY JOB

Other enrichments and imports:

Source Library system Datos.bne

Sources: Libraries and beyond Data imported: identifiers, equivalencies and attributes

2019: Wikidata

Achievement: more than 80.000 persons authority records enriched with data from Wikidata

Mapping BNE Ids with Wikidata IDs, using VIAF identifier datadump

Extracting selected properties (in Spanish where available), using the Wikidata API: - Retrieved selected properties from every ID in JSON - Sorting and grouping - Convert to MARC21 fields according to mapping Performed by datosbne technological partner, Memorandum Multimedia

2019: Wikidata

Quality check-ups:

General overview disregard property P737 (influenced by)

Work on property Occupation (P106) : - Sorting, grouping and arranging for revision by vocabulary experts. - Decision on every value:

o Keep it o Align it with BNE Subject Vocabulary o Disregard it.

2019: Wikidata

Occupation quality check-up:

From Wikidata to datosbne

A funny thing happened on my way to datos.bne

From Wikidata to datosbne A funny thing happened on my way to datos.bne

datos.bne Persons’ advanced search

From Wikidata to datosbne A funny thing happened on my way to datos.bne

Wikidata : concerns

PROVENANCE

Provenance is explicit in the library side of the data

No mapping or device has been implement in the RDF side

Wikidata : concerns

QUALITY

Wikidata is exposed to data vandalism

Keep calm and Don’t be afraid of errors

Ricardo Santos Head of Technical Services Department

ricardo.santos@bne.es @3186ricardo

Pº de Recoletos 20-22 28071 Madrid

España T +34 915 807 800

www.bne.es

NATIONAL LIBRARY OF SPAIN

in and out: work flows between library data and linked- data at the...

Documents

designing immutability data flows in ember

entitifying europeana: building an ecosystem of...

visualizing government data flows

tli 2012: data flows in integrated breeding

principles for improved nss data flows

trans-border data flowsschool of information trans-border...

decentralisation, distribution, disintegration - towards...

modelling fiber suspensions flows using rheological data

delta flows: data and calibrations

measuring cross‐border data flows: data, literature, and...

national regulation of transborder data flows

visual concept detection and linked open data at...

real-time data flows with apache nifi

trade agreements and data flows

large-scale etl data flows with data pipeline and dataduct

regulation of transborder data flows

estimating migration flows using online search data

measuring cross‐border data flows: data, literature, and...

mapping financial data flows

linked data for production: a multi -institution...