augmented participation to live events through social network content enrichment with ecstasys

Dipartimento di

Elettronica, Informazione e

Bioingegneria

Augmented Participation to Live Events

through Social Network Content

Enrichment with ECSTASYS

Marco Brambilla, Daniele Dell’Aglio, Emanuele Della Valle,

Andrea Mauri and Riccardo Volonterio

Dipartimento di Elettronica, Informazione e Bioingegneria

Problem

Conferences (but also exhibitions, sports or

fashion happenings) are complex events – They are composed by parallel and dislocated sub-

events (talks, workshops, tutorials)

27 May 2014 - AI Mashup Challenge @ESWC2014

Problem

Participants, organisers and interested people

are interested in having an holistic view on the

Problem

Participants, organisers and interested people

are interested in having an holistic view on the

It is hard to have a clear vision of what is

happening – Attendees have a partial view of the event (they know

what happens in the place where they are)

The solution

Attendees share opinions, recommendations,

materials, and reports of the happening through

social media

Let’s capture them!

The solution

Attendees share opinions, recommendations,

materials, and reports of the happening through

social media

Let’s capture them!

Event-Centered STream Analysis SYStem

(ECSTASYS) – It caputes the the social media contents related to a

live event

– It enriches them in a way that makes it valuable for (local or remote) attendees.

ECSTASYS as a whole

Retrieve the tweets

ECSTASYS as a whole

Retrieve the tweets

Filter the non-relevant ones

ECSTASYS as a whole

Retrieve the tweets

Identify the conference-related entities

ECSTASYS as a whole

Retrieve the tweets

Associate each tweet to the event it discusses

ECSTASYS as a whole

Retrieve the tweets

Associate each tweet to the event it discusses

Visualise them by event

ECSTASYS KB

Deriving the knowledge base

ECSTASYS KB

SW dog food

Conference

schedule

ECSTASYS KB

SW dog food

Conference

schedule

• Authors

• Paper at the

conference

• Recent papers

• Schedule

ECSTASYS KB

SW dog food

Conference

schedule

SeWeb Conference

Ontology

ECSTASYS

vocabulary

• Authors

• Paper at the

conference

• Recent papers

• Schedule

ECSTASYS KB

SW dog food

Conference

schedule

SeWeb Conference

Ontology

ECSTASYS

vocabulary

Lite-RL

• Authors

• Paper at the

conference

• Recent papers

• Schedule

Retrieve the data

Twitter Streaming API

“Ingenious way to learn

languages: duolingo

#www2013”

Retrieve the data

By keyword

#vonahn

#www2013

languages: duolingo

#www2013”

Retrieve the data

By keyword

#vonahn

#www2013

By geo

languages: duolingo

#www2013”

By user

Retrieve the data

By keyword

#vonahn

#www2013

By geo

languages: duolingo

#www2013”

Filter the non-relevant data

Relevance Filter

Previous conf.

tweets

CRF Model

Relevance Filter

Previous conf.

tweets

CRF Model

CRF filter over a

model derived by

Relevance Filter

Previous conf.

tweets

CRF Model

CRF filter over a

model derived by

Tweets with

non-English text

Relevance Filter

Previous conf.

tweets

CRF Model

CRF filter over a

model derived by

Tweets with

non-English text

Tweets not related

to the conference

Identify the relevant entities

Entity annotator

AIDA DB

Entity annotator

AIDA DB

AIDA AIDA identifies only

the conference-

related entities

Entity annotator

ECSTASYS KB AIDA DB

AIDA A custom dataset

for AIDA is derived

by the EKB

AIDA identifies only

the conference-

related entities

Entity annotator

ECSTASYS KB AIDA DB

for AIDA is derived

by the EKB

the conference-

related entities

languages: duolingo

#www2013”

Entity annotator

ECSTASYS KB AIDA DB

for AIDA is derived

by the EKB

the conference-

related entities

Identify the associated event

Domain content linker

ECSTASYS KB

Keynote

ECSTASYS KB

Keynote

ECSTASYS KB

Validation and disambiguation

Validator and disambiguator

Expert crowd

Resolve the

linkage

when more

options are

available

Expert crowd

Resolve the

linkage

when more

options are

available

Expert crowd

Validate links

Expert crowd

Validate links

Expert crowd

Visualisation

Wall view

Visualisation

Wall view

Conclusions

Is it a mashup? Yes! It puts together data from

Twitter (current and past tweets)

Semantic Web Dog Food

Conference schedule

Is it intelligent? Yes! It uses:

AI to filter the non-relevant tweets

NLP for identifying the entities in the text

Semantic Web technologies to integrate data and query it

Crowdsource to validate the results and solve the ambiguous results

Thank you! Questions?

Augmented Participation to Live Events

through Social Network Content Enrichment

with ECSTASYS

http://demo.search-computing.com/aimc-2014/home

Marco Brambilla, Daniele Dell’Aglio, Emanuele Della Valle,

Andrea Mauri, Riccardo Volonterio

(DEIB, Politecnico di Milano)

daniele.dellaglio@polimi.it

augmented participation to live events through social network content enrichment with ecstasys

ai mashup challenge

tweets dipartimento

ecstasys marco brambilla

relevant ones dipartimento

complex events

live events

dislocated subevents

solution attendees

Technology

illinois holstein championship...

augmented reality gaming | augmented reality games

webinar component 3: enrichment and extracurricular...

augmented shelf: digital enrichment of library shelves

enrichment activities information. - elliott hudson … ·...

augmented and virtual reality - massachusetts institute of...

towards pervasive augmented realitytowards pervasive...

applying feuerstein’s instrumental enrichment …...

effects of organic and inorganic fertilizer on the growth...

enrichment...

job enrichment

augmented scale patterns #1 (bass clef)...augmented scale...

augmented experience: augmented reality

enrichment project

geometry teacher’s edition - enrichment · geometry te -...

augmented reality and augmented telepresence visualization...

4 enrichment

the emergence of augmented reality in orthopaedic surgery...

fall 2019 program enrichment · 2019-09-06 · enrichment...

ibetelgeuse: an augmented reality browser for iphone · 1.1...