the ecosystem of genealogical data exchange

The Ecosystem of Genealogical Data Exchange

Ryan Heaton

© 2015 by Intellectual Reserve, Inc. All rights reserved.

Author: Soren Schaperhttps://creativecommons.org/licenses/by-nc-sa/2.0/

● The Evolution of our Genealogical Ecosystem● The Elements of our Genealogical Ecosystem● The Actors of our Genealogical Ecosystem● The Flows of our Genealogical Ecosystem● The Inhibitors of our Genealogical Ecosystem● The Developments of our Genealogical Ecosystem

Author: Soren Schaperhttps://creativecommons.org/licenses/by-nc-sa/2.0/

Author: Richard Linghttp://creativecommons.org/licenses/by-sa/3.0/deed.en

Ecosystem (noun)

A community of living organisms in conjunction with the nonliving components of their environment, interacting as a system.

Author: Richard Linghttp://creativecommons.org/licenses/by-sa/3.0/deed.en

The beginnings of a genealogical ecosystem...

Author: Owen Gilberthttps://creativecommons.org/licenses/by-nc-sa/2.0/

Author: Charles Stanfordhttps://creativecommons.org/licenses/by/2.0/

Author: Swirehttps://creativecommons.org/licenses/by-nc/2.0/

Author: Doug Kerrhttps://creativecommons.org/licenses/by-sa/2.0/

Author: Ben Crowderhttps://creativecommons.org/licenses/by-nc-sa/2.0/

Author: Doug Coldwellhttps://creativecommons.org/licenses/by/2.0/

Author: Matt Chanhttps://creativecommons.org/licenses/by-nd/4.0/

Author: Enoksonhttps://creativecommons.org/licenses/by-nc/2.0/

Author: Dennis Skleyhttps://creativecommons.org/licenses/by-nd/4.0/

Author: Vicious Bitshttps://creativecommons.org/licenses/by-nc-sa/2.0/

Author: Daniel Kulinskihttps://creativecommons.org/licenses/by-nc-sa/2.0/

Author: FutUndBeidlhttps://creativecommons.org/licenses/by/2.0/

Author: Phil's 1stPixhttps://creativecommons.org/licenses/by-nc-sa/2.0/

The Elements of a Genealogical Ecosystem● Records● Persons● Relationships● Sources● Citations● Analysis● Research

Author: Phil's 1stPixhttps://creativecommons.org/licenses/by-nc-sa/2.0/

Author: Phil's 1stPixhttps://creativecommons.org/licenses/by-nc-sa/2.0/

The Actors of a Genealogical Ecosystem● Systems● Users

Author: Phil's 1stPixhttps://creativecommons.org/licenses/by-nc-sa/2.0/

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

The Flows of a Genealogical Ecosystem

● User-to-User● System-to-User● System-to-System

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

The Flows of a Genealogical Ecosystem

● User-to-User● GEDCOM● Proprietary Formats

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

The Flows of a Genealogical Ecosystem

Case Study

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

● GEDCOM● Proprietary Import (not Export)● Data Loss feature mismatch, encoding issues, etc.

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

● Inhibitors● Lack of specification support

● e.g. citation metadata● Lack of incentive

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

Author: Jen Goellnitzhttps://creativecommons.org/licenses/by-nc-nd/2.0/

The Flows of a Genealogical Ecosystem

● System-to-User● Web Interface● APIs

Author: Jen Goellnitzhttps://creativecommons.org/licenses/by-nc-nd/2.0/

The Flows of a Genealogical Ecosystem

Case Study

Author: Jen Goellnitzhttps://creativecommons.org/licenses/by-nc-nd/2.0/

Author: Jen Goellnitzhttps://creativecommons.org/licenses/by-nc-nd/2.0/

● Family Graph API● JSON over HTTP ● Entities Person, Relationship, User, Event, Source, Note

Author: Jen Goellnitzhttps://creativecommons.org/licenses/by-nc-nd/2.0/

● Family Graph API● Smart Matches

The Flows of a Genealogical Ecosystem

Case Study

Author: Jen Goellnitzhttps://creativecommons.org/licenses/by-nc-nd/2.0/

Author: Jen Goellnitzhttps://creativecommons.org/licenses/by-nc-nd/2.0/

● FamilySearch API● XML, JSON over HTTP ● Entities Person, Relationship, User, Source, Note, Discussion Photo/Story, Search, Match, Change History, etc.

Author: Jen Goellnitzhttps://creativecommons.org/licenses/by-nc-nd/2.0/

Author: Jen Goellnitzhttps://creativecommons.org/licenses/by-nc-nd/2.0/

● FamilySearch API● Conforms to GEDCOM X ● Significant number of partners

Author: Jen Goellnitzhttps://creativecommons.org/licenses/by-nc-nd/2.0/

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

The Flows of a Genealogical Ecosystem

● System-to-System● APIs● Business Deals

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

The Flows of a Genealogical Ecosystem

Case Study

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

● Open Archives (openarch.nl)● Tooling and APIs for data from hundreds of providers.

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

● Open Archives (openarch.nl)● OAI-PMH● A2A (Archives to All)

The Flows of a Genealogical Ecosystem

Case Study

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

● Bulk Record Data● Bulk Tree Data● Atom + GEDCOM X (Notify/Feed)● GEDCOM X Data Sets

Author: Henrik Johanssonhttps://creativecommons.org/licenses/by-nc/2.0/

Author: William Beemhttps://creativecommons.org/licenses/by-nc/2.0/

The Inhibitors of a Genealogical Ecosystem● Security● Budget Constraints● Data Loss/Impedance● Feature Mismatch

Author: William Beemhttps://creativecommons.org/licenses/by-nc/2.0/

The Inhibitors of a Genealogical Ecosystem● Lack of Well-Established Processes● Lack of Well-Established Specifications

Author: William Beemhttps://creativecommons.org/licenses/by-nc/2.0/

The Inhibitors of a Genealogical Ecosystem● User Immaturity● Developer Immaturity● Product Management Immaturity

Author: William Beemhttps://creativecommons.org/licenses/by-nc/2.0/

The Inhibitors of a Genealogical Ecosystem● User Immaturity

● “My Tree-itis”● Outdated Mindsets

Author: William Beemhttps://creativecommons.org/licenses/by-nc/2.0/

The Inhibitors of a Genealogical Ecosystem● Developer Immaturity

● Re-inventing the Wheel● Internationalization Ignorance● Backwards-Incompatible Changes● Specification Ignorance

Author: William Beemhttps://creativecommons.org/licenses/by-nc/2.0/

The Inhibitors of a Genealogical Ecosystem● Product Management Immaturity

● “My Product-itis”● Misunderstood User Demands● Compatibility De-prioritization

Author: William Beemhttps://creativecommons.org/licenses/by-nc/2.0/

Author: Jason Scragzhttps://creativecommons.org/licenses/by/2.0/

The Developments of a Genealogical Ecosystem● User Demand● Business Demand● Increasing Interest

Author: Jason Scragzhttps://creativecommons.org/licenses/by/2.0/

The Developments of a Genealogical Ecosystem● GEDCOM X● FHISO● OAI-PMH and A2A

Author: Jason Scragzhttps://creativecommons.org/licenses/by/2.0/

Author: Randy OHChttps://creativecommons.org/licenses/by/2.0/

GEDCOM X● Conceptual Model● Data Formats● API Specifications

Author: Randy OHChttps://creativecommons.org/licenses/by/2.0/

GEDCOM X● Conceptual Model

● Defines the Concepts and Vocabulary● Person● Relationship● Event● Source Description● Evidence● Place Description

Author: Randy OHChttps://creativecommons.org/licenses/by/2.0/

GEDCOM X● Data Formats

● XML● JSON● File Format

Author: Randy OHChttps://creativecommons.org/licenses/by/2.0/

GEDCOM X● API Specifications

● REST Architecture● Tree API● Records API

Author: Randy OHChttps://creativecommons.org/licenses/by/2.0/

GEDCOM X● API Specifications

● Resources, Operations, and Links● Read Person● Update Source Description● Search for Persons● Delete Relationship

Author: Randy OHChttps://creativecommons.org/licenses/by/2.0/

GEDCOM X● API Specifications

● Potential for new providers● Ancestry, FindMyPast, MyHeritage● PHPGedView, WikiTree

Author: Randy OHChttps://creativecommons.org/licenses/by/2.0/

GEDCOM X● API Specifications

● Potential for new providers

Author: Randy OHChttps://creativecommons.org/licenses/by/2.0/

GEDCOM X● API Specifications

● Potential for new providers

Author: Randy OHChttps://creativecommons.org/licenses/by/2.0/

GEDCOM X● API Specifications

● Potential for new providers

Author: Randy OHChttps://creativecommons.org/licenses/by/2.0/

How to Improve our Genealogical Ecosystem● Make Noise● Use the paved roads

Credit: NASA

Credit: NASA