uncertainty handling in mobile community information systems

Oberseminar

Informatik 5 RWTH Aachen Yiwei Cao Informatik 5, RWTH Aachen

Uncertainty Handling in Mobile Uncertainty Handling in Mobile Community Information Systems

Yiwei Cao

March 22, 2012

Lehrstuhl Informatik 5(Information Systems)

Prof. Dr. M. JarkeI5-Cao-0312-1

Oberseminar

AgendaYiwei Cao AgendaIntroduction- Background and problem- Scenario- Uncertainty 2.0

Concept of the uncertainty handling modelsConcept of the uncertainty handling modelsTechnical realization of Virtual CampfireM d l lid ti th h Vi t l C fiModel validation through Virtual CampfireConclusions and outlook



OberseminarBackground: Uncertainty in

Database ResearchYiwei Cao Database ResearchRepresentation of data uncertainty- Uncertainty is a term used in many research fields: philosophy, economics, finance,

statistics, psychology, sociology, physics, engineering, artificial intelligence, information science, and computer science Web and mobile lead to uncertaintyp y

- Uncertainty is defined as a measure of the incompleteness of one’s knowledge or information about an unknown quantity whose true value could be established if a perfect measuring device were available [CuFr99]Introduction perfect measuring device were available [CuFr99]

- 4I representation of data uncertainty: incorrect, incomplete, imprecise, and inconsistent information [KKMK09]

Introduction

Concepts

Realization

Advanced uncertainty databases- Based on probabilistic theory, statistics, and fuzzy logic [AAB*03, KKMK09]

Validation

Conclusions

- Examples: Orion [SMM*08], Trio [BSHW06] - Text and number-based objects multimedia has higher requirements - Data centered the user factor and context are not considered



- Data centered the user factor and context are not considered

Oberseminar

Background of ConceptsYiwei Cao Background of ConceptsWeb 2.0- Social network sites for information sharing - User-generated content and tagging [Smit07, MNBD06, SLWa11]- Folksonomy instead of taxonomy [Orei05]

Introduction

Community of PracticeGroups of people who share a concern or a passion for something

Introduction

Concepts

Realization- Groups of people who share a concern or a passion for something

they do and who interact regularly to learn how to do it better [Weng98]

Validation

Conclusions

[ g ]- Mutual engagement- Joint enterprise



p- Shared repertoire

OberseminarUncertainty Scenario:

Formula 1 Motor Race in MonacoYiwei Cao Formula 1 Motor Race in Monacoreporter Photo experts?

Lack of clarity, not lack of data [DaLe86]

chicanemonacomonte carlo

ferrariFan community? ?

y, [ ]

fairmont@twitter

curve-7 port

ferrari

technician

bmw

Introduction

start43°40′15″N 7°17′52″E

? ?Introduction

Concepts

Realization

like@facebook43°44′23″N 7°25′38″E

swimming-poolstart

deleteValidation

Conclusions

Source: http://en.wikipedia.org/wiki/File:Monte_Carlo_Formula_1_track_map.svg

Semantics-related Context-related Community-relatedbig-curve Lehrstuhl Informatik 5(Information Systems)


ybig-curve

Search for all photos shared by Ferrari fan community taken at my current location of Grand Prix 2004?

Oberseminar

Aspects of Uncertainty 2 0 Yiwei Cao Aspects of Uncertainty 2.0 Context uncertainty

Uncertainty refers to poor quality of contextual data acquired directly from the environment- Uncertainty refers to poor quality of contextual data acquired directly from the environment- Geospatial, temporal, social/community, and technical

e.g. measure or perception errors of mobile devices [HeIn04] 43°40′15″N 7°17′52″E

43°44′23″N 7°25′38″E

Semantics uncertainty- Uncertainty refers to a large number of different meanings embedded in the same

multimedia content

7 17 52 E

Introduction

7 25 38 E

- Domain, richness, precision, and machine-readability e.g. variety of metadata standards: general vs. domain specific metadata standards [Kosc03]e g GPS information (context) is mapped to another way of location name (semantics) fairmont

Introduction

Concepts

Realizatione.g. GPS information (context) is mapped to another way of location name (semantics)

Community uncertainty- Uncertainty refers to various influences of user communities

fairmontValidation

Conclusions

- Creation, management, search & retrieval, sharing, and recommendatione.g. users, esp. some amateurs annotate multimedia with false information (intentionally) e.g. different communities have different interest and semantic ferrari reporter

curve-7



misunderstandingse.g. users use false operations on multimedia like@facebook

ferrari reporter

Oberseminar

Research QuestionsYiwei Cao Research QuestionsHow to define, identify, and handle uncertainty 2.0 in mobile community , y, y yinformation systems?Which information processes may operate on multimedia semantics and context for uncertainty handling?Can we optimize usage of tags to reduce uncertainty in mobile

Introduction community information systems? Which user roles are present in communities of practice and with which “ ti ” d th l ?

Introduction

Concepts

Realization

“practices” do they play?How do experts and amateurs interact on uncertainty handling in mobile community information systems?

Validation

Conclusions

community information systems?



Oberseminar

Concept: Mind MapYiwei Cao Concept: Mind MapIntroduction

ConceptsVC Storytelling

VC Tagging

Workflow model

Data management

model

maps

Concepts

Realization

ValidationService

con

Web 2 0

results

VC Tagging

ACIS

consists ofem

ploysConclusions

nsistsof

2.0

Mobile

sin Uncertainty handling models

realizesUncertainty2.0 aspects

modelsCCPLE

YouTell G.A.based on

demosApplication

supports Afghan culturalheritage researchers

Web 2.0 DS CoP ATLAS

n

needs

Community

Classic Chinese Poem

G.Averof Battleshipmuseum managers



learners

Oberseminar

Starting Point: ATLAS Media Theory Yiwei Cao Starting Point: ATLAS Media Theory

M di i Media processing operations [Jaeg02, SKJa02, Span07, Klam10]

Introduction- Transcription (semantics)- Localization (context)- Addressing (community)

Introduction

Concepts

RealizationAddressing (community)

Conceptual information flow between media and

iti

Validation

Conclusions

communitiesMobile and Web 2.0 aspects are not considered

Source: [Span07]



p

OberseminarUncertainty 2.0 Handling Model:Workflow for System EngineeringYiwei Cao Workflow for System Engineering

1. A common data set for user communities to manage multimedia with context and semantic information

Database

WWW1. Data storage

Meta‐data Semantization Meta‐

dataTagsTagsTags

pr

2. Semantics is enhanced via user generated tags in communities of practicesIntroduction

gmetadata management 2. Collaborative tagging

Conteroduction

of practices3. Multimedia artifacts with

reduced uncertainty are further

Introduction

Concepts

Realization

extualizationaddressed to communities for storytelling

4 Mobile devices enrich media

Validation

Conclusions

Contextualization

4. Mobile adaptation 3. Community–based storytelling

Stories 4. Mobile devices enrich media capture ways and share adaptive multimedia

Stories

A l f bil lti di Lehrstuhl Informatik 5(Information Systems)


A loop for mobile multimedia management

OberseminarUncertainty 2.0 Handling Model:

Data Management ModelYiwei Cao Data Management Model

Community

CoP

Introduction

Amount o

Uncertain

Community based

StorytellingContextualization

Context Management

SemanticsManagement

Introduction

Concepts

Realization

of multim

edi

nty decrease

Collaborative TaggingSemantization

Metadata Management

gValidation

Conclusions

a decreases

es

Mobile AdaptationContextualization

Semantization

Mobile Multimedia Data ManagementContextualization



OberseminarUncertainty 2.0 Handling:

Mobile AdaptationYiwei Cao Mobile Adaptation

CoPCoP

Introduction

Context Management

SemanticsManagement

Context Management

SemanticsManagement

Introduction

Concepts

Realization

Metadata Management

g

Metadata Management

gMobile

AdaptationContextualizationValidation

Conclusions

Mobile Multimedia Data Management



OberseminarThe Mobile Multimedia

Adaptation ProcessYiwei Cao Adaptation Process1. Interoperability is enhanced by multimedia metadata standards2 Metadata is converted into RDF via ontology based context modeling according to use context2. Metadata is converted into RDF via ontology-based context modeling according to use context3. Context queries in SPARQL are executed based on context reasoning4. Queried multimedia results are adapted onto mobile devices

Introduction

SPARQLMultimedia metadata standards

Introduction

Concepts

Realization

MPEG‐7

D bli COntology A Ontology B

Validation

Conclusions

Dublin Core

TV‐Anytime

gy

RDFS

OWLgy

Domain Information

Mobile multimedia

lt

Contexty

EXIF

RDF Information query results



...

OberseminarAn Example of the Mapping between MPEG 7 and RDFYiwei Cao between MPEG-7 and RDF

<rdf:RDF xmlns:rdf="... " xmlns:mpeg7="..."><rdf:Description>

D i ti i t " S ti D i ti T "p

<mpeg7:Description> <mpeg7:SemanticDescriptionType> <mpeg7:Semantics rdf:parseType="Resource">

<mpeg7:SemanticBase><mpeg7:SemanticPlaceType

<urn:Description xsi:type="urn:SemanticDescriptionType"xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><urn:Semantics>

<urn:Label />S ti B i t " S ti Pl T "

p g ypxml/curve7.xml#SemanticPlaceType_user20091115">

<mpeg7:Place rdf:parseType="Resource"><mpeg7:GeographicPosition

rdf:parseType="Resource">

<urn:SemanticBase xsi:type="urn:SemanticPlaceType"id="SemanticPlaceType_user20091115">

<urn:Label><urn:Name>curve 7</urn:Name>

D fi iti d i t / D fi itiIntroduction p yp<mpeg7:Point rdf:parseType="Resource"><mpeg7:longitude>7.269449</mpeg7:longitude><mpeg7:latitude>43.83931</mpeg7:latitude><mpeg7:altitude>29.0</mpeg7:altitude>

<urn:Definition> monaco grand prix route</urn:Definition></urn:Label><urn:Place><urn:GeographicPosition>

P i t ltit d "29 0" l tit d "43 83931" l it d

Automatic mapping

Introduction

Concepts

Realizationp g p g

</mpeg7:Point></mpeg7:GeographicPosition>

</mpeg7:Place><mpeg7:Label rdf:parseType="Resource">

<urn:Point altitude="29.0" latitude="43.83931" longitude= "7.269449" /></urn:GeographicPosition>

</urn:Place>/ S ti B

Validation

Conclusions

p g p yp<mpeg7:Definition>monaco grand prix route </mpeg7:Definition>

<mpeg7:Name>curve 7</mpeg7:Name></mpeg7:Label>

</urn:SemanticBase></urn:Semantics>

</urn:Description>



...</mpeg7:Semantics> ...

</rdf:RDF>

Oberseminar

Context aware QueriesYiwei Cao Context-aware QueriesQuerying multimedia context in SPARQL

- Example: search for all photos taken at a certain curveMultimedia results are more precise

- Semantics of multimedia artifacts is enriched via mapping of context and semanticsSemantics of multimedia artifacts is enriched via mapping of context and semantics- Ontology is applied for basic context reasoning

IntroductionPREFIX mpeg7: <http://manet.informatik.rwth-aachen.de/~khodaei/mpeg7-v2.owl#> PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> PREFIX xsd: <http://www.w3.org/2001/XMLSchema#> PREFIX fn: <http://www w3 org/2005/xpath functions#>

Introduction

Concepts

RealizationPREFIX fn: <http://www.w3.org/2005/xpath-functions#>

SELECT ?l ?alt ?fileWHERE { ?l mpeg7:Place ?r . ?r mpeg7:GeographicPosition ?r2 . ?r2 mpeg7:Point ?r3 .

?r3 mpeg7:altitude ?alt. ?l mpeg7:Label ?label . ?label mpeg7:Name "curve 7". ?l ?spt

Validation

Conclusions

g g gmpeg7:SemanticPlaceType . ?mc mpeg7:SemanticBaseRef ?ll. ?des mpeg7:Semantic ?mc . ?des mpeg7:MediaInformation ?mi . ?mi mpeg7:MediaIdentification ?mid . ?mid mpeg7:EntityIdentifier ?file. FILTER (xsd:float(?alt) > 28.0). FILTER (STR(?l) = ?ll)}



OberseminarUncertainty Handling: Collaborative TaggingYiwei Cao Collaborative Tagging

Introduction

CoPCoP

Introduction

Concepts

RealizationContext Management

SemanticsManagement

Context Management

SemanticsManagement Collaborative

TaggingSemantization

Validation

ConclusionsMetadata Management

g

Metadata Management

g




Oberseminar

CommsonomyYiwei Cao CommsonomyCommunity as a new dimension for the tag spaceCommsonomy is a community-based folksonomy defined and used within and across communities of practice

Introduction

Media processing operations- Semantization: users tag resources

C t t li ti h Introduction

Concepts

Realization

- Contextualization: users share resources in communities S

eman

Contex

Validation

Conclusions

ntization

xtulization



Oberseminar

Extended Commsonomy ModelYiwei Cao Extended Commsonomy ModelTagging as an effective “practice” conducted in communities of practice [CKKR10]

Various Web 2 0 operations are different types of tagging activities− Various Web 2.0 operations are different types of tagging activitiesA role model to support amateurs and expertsFocus on community requirements

IntroductionIntroduction

Concepts

Realization

Validation

Conclusions



Oberseminar

Web 2 0 Operations as TaggingYiwei Cao Web 2.0 Operations as TaggingGoal: providing appropriate and “certain” media operations to user communities R t d i t l f ( ti di t it )Represented in a tuple of (user, operation, media, tag, community)Operations are compound if the tags have restrictions, otherwise are simpleUser-generated tags enrich multimedia semantics to handle uncertainty 2.0User generated tags enrich multimedia semantics to handle uncertainty 2.0

IntroductionIntroduction

Concepts

Realization

Validation

Conclusions



OberseminarUncertainty Handling:

Community based StorytellingYiwei Cao Community-based Storytelling

Community

Introduction

CoPCoP

Community based

StorytellingContextualization

Introduction

Concepts

RealizationContext ManagementContext Management

SemanticsManagement

SemanticsManagement

Validation

ConclusionsMetadata Management

g

Metadata Management

g




OberseminarCommunity-Based Storytelling with a

Role Model and Story TemplatesYiwei Cao Role Model and Story TemplatesStorytelling is a compound media operation with multiple tag values- Digital storytelling combines narratives with digital content and produces digital

stories in the form of a collection of multimedia [Robi07]Storytelling for error and inconsistency detection [BaMu08 Have07]- Storytelling for error and inconsistency detection [BaMu08, Have07]

Community based storytelling [CKMa08, CKJa10] - An effective practice in CoPIntroduction An effective practice in CoP- Template-based nonlinear storytelling

Movement Oriented Design (MOD)

Introduction

Concepts

Realization

Hero’s journey- A role model for storytelling

Domain experts

Validation

Conclusions

Domain expertsMultimedia experts

- New algorithmsLehrstuhl Informatik 5(Information Systems)


User profile-based story search Expert finding

OberseminarNew Algorithm Based on Concepts:

Profile Based Story SearchYiwei Cao Profile-Based Story Search

Introduction

Tags

Introduction

Concepts

Realization

Validation

Conclusions

Uncertainty is reduced additionallyLehrstuhl Informatik 5(Information Systems)


Uncertainty is reduced additionally- Users’ story rating- Users’ media tagging and story tagging

OberseminarValidation: Virtual Campfire Mobile Community Information SystemsYiwei Cao Community Information Systems

SeViAnno

D t b

Semantization

Database

WWW1. Data storagemetadata management 2. Collaborative tagging

Meta‐data

TagsTagsTags

Meta‐data

Introduction

Data repository: cultural heritage, Web 2.0 user generated media etc.

Semantization

Collaborative tagging

produ

Contextu

Introduction

Concepts

Realization

produ

Contextu

Collaborative tagging

uction

alization

Validation

ConclusionsYouTell

uction

alizationMobile Campfire

Contextualization

4. Mobile adaptation 3. Community –based storytelling

StoriesContextualization



Community-based storytellingMobile adaptation and production

OberseminarValidating Virtual Campfire with Various Cultural CommunitiesYiwei Cao Various Cultural Communities

Afghan cultural heritage management community- Context and semantics mapping to engineer GIS community information

systems - Employment of multimedia, cultural, and GIS metadata standards p oy e o u ed a, cu u a , a d G S e ada a s a da ds- Community multimedia access based on a role model

Th G k B ttl hi G i A f t it Introduction The Greek Battleship Georgios Averof management community - Commsonomy for user communities to use semantics-rich tags- User profile-based story search for media selection

Introduction

Concepts

Realization p y- Community-based role model, experts emerging from amateurs

Classical Chinese Poem learner community

Validation

Conclusions

Classical Chinese Poem learner community- Geo-tagging support- Various tagging approaches for learning content: multi-granular,



standard-based- Community role model, game-based learning based on stories

OberseminarTagging Practice for Afghan Cultural

Heritage Management: SeViAnnoYiwei Cao Heritage Management: SeViAnnoContext: tight time schedule for cultural heritage researchersS ti diff t i t t ti f lti di f diff t d i t Semantics: different interpretations of multimedia from different domain experts Community:collaboration Macro

Introduction

among worldwideusersTaggingIntroduction

Concepts

Realization

Tagging- Multi-granular- Metadata

Conte t a areValidation

Conclusions

- Context-aware

Micro

Meso

Micro



Oberseminar

SeViAnno Service UsageYiwei Cao SeViAnno Service UsageContext uncertainty- Map-based tagging (geo-tagging)

Semantics uncertainty - MPEG-7 metadata standard-based tagging with multi-granularity

Community uncertainty: users’ usage of different tagging approachesD i t t d t t d d b d t iIntroduction - Domain experts use metadata standard-based tagging

- Amateurs use simple tagging

Introduction

Concepts

Realization

Validation

Conclusions



OberseminarStorytelling Practice for Battleship

Georgios Averof: YouTellYiwei Cao Georgios Averof: YouTellContext: the events with some temporal and spatial variants spatial variants Semantics: a large amount of multimedia of the same event, even with description in ancient GreekCommunity: cooperation of interdisciplinary domain experts Introduction domain experts A story example using the Movement Oriented Design story template

M bil C fi

Introduction

Concepts

RealizationMobile CampfireValidation

Conclusions

Community management Tagging StorytellingProduction



Oberseminar

YouTell Tag UsageYiwei Cao YouTell Tag UsageSemantics uncertainty

Si l lti di tif t t d t t d i t h- Single multimedia artifact tags and story tags used in story searchContext uncertainty

Geo tagging and mapping to multimedia metadata - Geo-tagging and mapping to multimedia metadata Community uncertainty - Domain experts have access to edit stories created by amateursIntroduction Domain experts have access to edit stories created by amateurs- Story templates help amateurs tell good stories- Communities of practice cultivate experts and expert knowledge

Introduction

Concepts

Realization

Validation

Conclusions


Prof. Dr. M. JarkeI5-Cao-0312-28 Tags

Oberseminar

Conclusions Yiwei Cao Conclusions How to define, identify, and handle uncertainty in mobile community , y, y yinformation systems?- Definition and identification of uncertainty 2.0 for mobile community information

t i th t f lti di ti t t d itsystems in the aspects of multimedia semantics, context, and community- Uncertainty 2.0 handling through a layer data management model- Engineering mobile community information systems with a workflow based on the Introduction Engineering mobile community information systems with a workflow based on the

concept of community of practice- Validation in Virtual Campfire with algorithms, services, and applications

Introduction

Concepts

Realization

Which information processes may operate on multimedia semantics and context for uncertainty handling?

S ti ti di t i ti ll b ti t i

Validation

Conclusions

- Semantization: media transcription, collaborative tagging- Contextualization: mobile adaptation, media localization, community addressing,

community-based storytellingLehrstuhl Informatik 5(Information Systems)


y y g

Oberseminar

ConclusionsYiwei Cao ConclusionsCan we optimize usage of tags to reduce uncertainty in mobile

it i f ti t ? community information systems? - Yes, commsonomy combines Web 2.0 and mobile community information systems

Experts’ tag usage reduces uncertainty- Experts tag usage reduces uncertainty- Tagging optimizes Web 2.0 operations and is applied for system engineering

Which user roles are present in communities of practice and with which Introduction Which user roles are present in communities of practice and with which “practices” do they play?- A comprehensive role model integrates amateurs and domain experts

Introduction

Concepts

Realization

- Users practice tagging and storytelling for mobile multimedia managementHow do experts and amateurs interact on uncertainty handling in mobile

it i f ti t ?

Validation

Conclusions

community information systems? - Amateurs collaborate with and learn from experts in CoP through various practices

Expert knowledge is collected in mobile data management with a common data Lehrstuhl Informatik 5(Information Systems)


- Expert knowledge is collected in mobile data management with a common data repository for certain domains

Oberseminar

OutlookYiwei Cao OutlookStorytelling for knowledge management in enterprises and organizationsAugmented reality taggingSocial network analysis for uncertainty 2.0 handlingValidation of VC media operations and practices on mobile and Web 2.0 social network sites

IntroductionEnhancement of community support in interdisciplinary user communities: entrepreneurship, journalists, etc.

Introduction

Concepts

Realization

Validation

Conclusions



Oberseminar

Thank YouYiwei Cao Thank You

QuestionsQuestions



uncertainty handling in mobile community information systems

Technology