enhancement ecosystem: enriching content with user tags and annotations

41
www.designforcontext.co m Duane Degler @ddegler Thomas Vander Wal @infocloud Enhancement Ecosystems: Enriching Structured Content with User Tagging and Annotation SEMTECH BIZ 2013 2 nd October 2013, New York

Upload: design-for-context

Post on 27-Jan-2015

105 views

Category:

Design


0 download

DESCRIPTION

How do we increase the findability and value of content? How do we maintain metadata and thesauri? Automated tools help apply structure to content, yet these capabilities deliver greatest value when combined with human-curated enhancement. When designing content/data applications, we pay particular attention to the "Enhancement Ecosystem." Applying context and meaning is an ongoing activity - not something you do once during creation. This is particularly important for long-lived content: historically important texts/media, scientific literature, archives, museum/library object descriptions, data sets with multiple uses, and content where contributions span over years. We explore: Tagging and folksonomy so authors/editors understand how users apply language and meaning to content; Curation and rule-setting in concept extraction; Mining user annotations and the content locations where they are applied; How auto-tagging suggestions can be refined to maximize the meaning that is applied to unstructured content over time.

TRANSCRIPT

Page 1: Enhancement Ecosystem: Enriching content with user tags and annotations

www.designforcontext.comDuane Degler @ddeglerThomas Vander Wal @infocloud

Enhancement Ecosystems: Enriching Structured Contentwith User Tagging and Annotation

SEMTECH BIZ 20132nd October 2013, New York

Page 2: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal2

Add structure

Goal: Content Enhancement

Nulla nunc velit, suscipit iaculis dictumFringilla egestas ante. Integer sit amet rhoncus orci. Phasellus egestas at dolor pretium rutrum. Morbi at ultrices tortor. Donec vehicula convallis enim a interdum. Nunc sed aliquet risus.

Integer tempus orci sed dui euismod tristique. Etiam sit amet lectus non neque porttitor consectetur sit amet ut mauris. Proin sit amet est at justo auctor dapibus. Phasellus non neque blandit, volutpat nunc at, tempus lorem. Pellentesque ac consequat nibh.

Phasellus egestas semper massa, eu placerat nisl ultrices eu. Nulla et posuere mauris, at viverra nunc. Nam porttitor laoreet arcu, id tempor libero egestas euismod. Nulla in diam nisl. Phasellus elementum turpis ac ipsum dignissim, at porttitor leo semper. Duis sollicitudin velit eu dolor placerat rhoncus. Ut ut turpis nec nibh ultricies aliquet eget ac arcu. Praesent dapibus rhoncus accumsan. Integer laoreet tellus sed turpis interdum congue. Praesent nulla ipsum, iaculis nec dictum quis, posuere in nulla. Cras nec dui ornare orci blandit pretium nec consequat tellus. Etiam eu neque odio.

Nunc posuere sem sed orci faucibus aliquet. In sagittis tellus non dui laoreet, id mattis libero pharetra. Praesent sollicitudin odio a lobortis pellentesque. Integer ullamcorper dapibus auctor. Pellentesque urna magna, posuere placerat nibh vitae, feugiat adipiscing mi. Maecenas euismod, eros eget luctus tempor, eros risus placerat enim, quis gravida odio nisl id turpis. Lorem ipsum dolor sit amet, consectetur adipiscing elit. Nullam a accumsan velit, ac facilisis erat. ctus eu. Pellentesque habitant morbi tristique senectus et netus et malesuada fames ac turpis egestas. Duis non nulla lectus. Morbi mollis convallis.

Nulla nunc velit, suscipit iaculis dictumFringilla egestas ante. Integer sit amet rhoncus orci. Phasellus egestas at dolor pretium rutrum. Morbi at ultrices tortor. Donec vehicula convallis enim a interdum. Nunc sed aliquet risus.

Integer tempus orci sed dui euismod tristique. Etiam sit amet lectus non neque porttitor consectetur sit amet ut mauris. Proin sit amet est at justo auctor dapibus. Phasellus non neque blandit, volutpat nunc at, tempus lorem. Pellentesque ac consequat.

Phasellus egestas semper massa, eu placerat nisl ultrices eu. Nulla et posuere mauris, at viverra nunc. Nam porttitor laoreet arcu, id tempor libero egestas euismod. Nulla in diam nisl. Phasellus elementum turpis ac ipsum dignissim, at porttitor leo semper. Duis sollicitudin velit eu dolor placerat rhoncus. Ut ut turpis nec nibh ultricies aliquet eget ac arcu. Praesent dapibus rhoncus accumsan. Integer laoreet tellus sed turpis interdum congue. Praesent nulla ipsum, iaculis nec dictum quis, posuere in nulla. Cras nec dui ornare orci blandit pretium nec consequat tellus. Etiam eu neque odio. Nunc posuere sem sed orci faucibus aliquet. In sagittis tellus non dui laoreet, id mattis.

MetadataIssue: 7 (10)Author: A. MaecenasAuthor: G. EuismodDate: 10.2.2013Word Ct: 3,187Keywords: faucibus, aliquet, sagittis, tellus

Related Content• Integer ullamcorper

dapibus auctor• Pellentesque urna

magna• Posuere placerat• Vitae, feugiat

adipiscing• Euismod, eros eget

luctus te

Tags• ullamcorper • dapibus auctor• urna magna• placerat

LDLinked Data

TAText Analytics

IAInformation Architecture

UXUser Experience

KMKnowledge Management

ESEnterprise Social

Page 3: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal3 Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal3

Is time our enemy?Or our friend?

Creating an Enhancement Ecosystem

Page 4: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal4

Manage

New content

Legacy content

Taxonomy• ------

• ------• ------

• ------• ------

Extract & Index

Review & Assess

Use

Crawl Track

Annotate

LinkTag

Collaborate

Enhance & Validate

Page 5: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal5 Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal5

Enhancement Ecosystem

Source MaterialExtract & Index

Page 6: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal6

Manage

New content

Legacy content

Taxonomy• ------

• ------• ------

• ------• ------

Extract & Index

Considerations for automated processing

Automated tools have “editorial perspective”

What something is about What is explicit, rather than

implied

But more challenging . . . What is inherent, even if not

made explicit? What is the external focus?

Context of use?

Page 7: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal7

New content

Legacy content

Taxonomy• ------

• ------• ------

• ------• ------

Taxonomy enhancement Must update and evolve

to remain relevant

• Should be a continual process, not “big bang” every few years

Embracing evolution lowers costs

• Improvement cost

• Misalignment cost Formalize the evolution, don’t just

react to drift

Considerations for taxonomies

Page 8: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal8 Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal8

Enhancement Ecosystem

Enhance & Validate

Page 9: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal9

Manage

New content

Legacy content

Taxonomy• ------

• ------• ------

• ------• ------

Extract & Index

Enhance & Validate

Successful adoption… Keep it simple. It is easier for users to recognize

a term and validate its relevance than it is to recall a term that aligns with user expectations.

In the ecosystem, this step is iterative for continuous improvement.

Author / Editor / SME

Page 10: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal10

Enhancement support during writing and reviewingStructured and

unstructured sources proactively provided

as resources for authors and editors.

Page 11: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal11

Enhancement support for elaborating contextsA range of sources.

Recognition is easier and more consistent

than recall.

Page 12: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal12

Enhancement support for elaborating contexts

Information available when applying terms

helps users understand what

terms mean.

Page 13: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal13 Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal13

Enhancement Ecosystem

Review & Assess

Page 14: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal14

The iteration step! Not “one and done.” Pattern-finding based on what

matters to users. Assess value:

• Relevance• Quantity• Significance• Quirkiness

Manage

New content

Legacy content

Taxonomy• ------

• ------• ------

• ------• ------

Extract & Index

Enhance & Validate

Owner’s iterative review & assessment

Review & Assess

Page 15: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal15

Manage

New content

Legacy content

Taxonomy• ------

• ------• ------

• ------• ------

Extract & Index

Enhance & Validate

Review & Assess

Use

Crawl Track

Annotate

Link

Collaborate

Tag

Enlisting our users

Page 16: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal16 Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal16

Enhancement Ecosystem

Crawl & Track

Page 17: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal17

Manage

New content

Legacy content

Taxonomy• ------

• ------• ------

• ------• ------

Extract & Index

Enhance & Validate

Review & Assess

Use

Crawl Track

Surfacing how and where used

Formal & informal references to content

Identifying where something is cited provides:

• Context

• Perceived value from user

• Surrounding terms

Page 18: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal18

Page 19: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal19

Page 20: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal20

Page 21: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal21

Tasks produce path patterns, uncovered by analytics

1 2 3 4 5 Yellow brick road (set path)

A

G

D

SN

8Family Circus(wandering)

1b

1c

1d

Spelunking(deep dive)

Window shopping (look-leave-look)

!Serendipitous (‘aha’ discovery)

Page 22: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal22 Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal22

Enhancement Ecosystem

Annotate, Tag & Link

Page 23: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal23

Manage

New content

Legacy content

Taxonomy• ------

• ------• ------

• ------• ------

Extract & Index

Enhance & Validate

Review & Assess

Use

Annotate

LinkTag

Tags & Folksonomy Discover vocabulary Valid personal perception Emergent terms Gap identification

Page 24: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal24

Folksonomy tagging triad

Definition

Interest Identity

Metadata

Object

Vocabulary

Page 25: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal25

Dual folksonomy triad

TerminologyCommunity

Culture

Definition

Interest Identity

Metadata

Object

Vocabulary

Page 26: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal26

Taxonomy < > Folksonomy ?

Taxonomy Folksonomy

Structure

Efficiency

Solid foundation

Messy

Difficult findability

Slow to emerge

Resource intensive

Not emergent

Difficult to validate

Relatively inexpensive

Emergent by nature

Continual validation

Page 27: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal27

Page 28: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal28

Page 29: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal29

Page 30: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal30

Page 31: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal31

Manage

New content

Legacy content

Taxonomy• ------

• ------• ------

• ------• ------

Extract & Index

Enhance & Validate

Review & Assess

Use

Annotate

LinkTag

Interpreting linked content Context and conceptual patterns See things in the aggregate Surface conceptual distance, not

semantic distance

Page 32: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal32

One NY Times article gets different URLs in Twitter.

The application aggregates them and captures surrounding text for analysis.

Page 33: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal33

Manage

New content

Legacy content

Taxonomy• ------

• ------• ------

• ------• ------

Extract & Index

Enhance & Validate

Review & Assess

Use

Annotate

LinkTag

Users’ context-setting With Location With tool / service Direct link to concept within an

object

Can apply structure to enhance:

• Hypothesis

• Noting Structure

• Interpretation (strong)

Page 34: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal34

The increase in OA-related musculoskeletal pain especially in the growing elderly population has created heightened interest in effective treatments with better safety profiles. The Glucosamine/chondroitin Arthritis Intervention Trial (GAIT) was designed to examine the effects of the dietary supplements glucosamine and chondroitin sulfate given alone or in combination as compared to celeecox or placebo on pain associated with osteoarthritis of the knee. The primary symptomatic outcome assessment of the GAIT study was after 24 weeks of randomized, double-blinded, placebo-controlled therapy.[6] An ancillary structural study describing the effects of the agents on radiographic joint space width loss for up to two years has also recently been reported.[7] To date, very few data have been reported for the long-term treatment of OA with any agent including the supplements and celecoxib studied here. Patients in the structural study continued to have safety and clinical efficacy assessments at all scheduled visits. This paper details the clinical efficacy and safety experience with these agents alone and in combination along with celecoxib as compared to placebo in patients from this subset of GAIT over 24 months of follow-up.

chondroitin sulfatecelecoxib

radiographic joint space

Add note, action

Search on this now

Tag forTag for search

Add case note

“Smart” notes for knowledge workers

Capture knowledge of important terms

Tag for Search

“Radiographic joint space” Just capture the keyword Mark as a target term Mark as a general concept

Associate with existing concept:Measurement

Search notes:

Add term cancel

Capture hypothesesand elaborations

Add case note

Paragraph 45“…radiographic joint space…”

Case note Private note

Associate with: Hypothesis ☐ Evidence☐ Concept in case documents

Other cases (cross-reference):

Save note cancel

Page 35: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal35 Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal35

Enhancement Ecosystem

Collaborate

Page 36: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal36

Manage

New content

Legacy content

Taxonomy• ------

• ------• ------

• ------• ------

Extract & Index

Enhance & Validate

Review & Assess

Use

Collaborate

Data from collaborations Richer resource, as used more

often with more complete thoughts captured

Easy to use Larger narrative But:

• Hard to algorithmically harvest

• Not as precise

Page 37: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal37

Page 38: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal38

Page 39: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal39 Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal39

Enhancement Ecosystem

Page 40: Enhancement Ecosystem: Enriching content with user tags and annotations

Enhancement Ecosystems: Enriching Structured Content | SemTechBiz East | October 2, 2013 | © Degler, Vander Wal40

Manage

New content

Legacy content

Taxonomy• ------

• ------• ------

• ------• ------

Extract & Index

Enhance & Validate

Review & Assess

Use

Crawl Track

Annotate

Link

Collaborate

Tag

Enhancement Ecosystem:Iterative, Relevant, User-Centered

Page 41: Enhancement Ecosystem: Enriching content with user tags and annotations

www.designforcontext.comDuane Degler @ddeglerThomas Vander Wal @infocloud

Enhancement Ecosystems: Enriching Structured Contentwith User Tagging and Annotation

SEMTECH BIZ 20132nd October 2013, New York