1/10/2011 CUbRIK Presentation 0

Combining human and machinecomputation for the digital humanities

Demo session at MMSP‘13

CUbRIK in a nutshell

1/10/2011 CUbRIK Presentation 1

Open Entities Repository

Space/Location Awareness

Time Awareness

Increase multimedia content processing

automatic computation ability

Games Q&ACrowdtasks

Open to hybrid workflows

Humans in the loop

Machine tasks Human tasks Social tasks

Solve uncertainty from automatic

computation using collective

intelligence

Open to plug-in

Off-the-Shelf open source

From R&D projects

3rd Party

Open to algorithms

Open to components

White box MM search Processing

Indexing

CUbRIK

1/10/2011 CUbRIK Presentation 2

Humans in the loop

1/10/2011 CUbRIK Presentation 3

Raw content

High level features

(automatic annotations)

Conflict

(e.g., “Image contains

‘Romano Prodi’ ”

Confidence = low)?

Conflict store Conflict

manager

Conflict resolution

task store

Conflict resolution

task: conflict,

required skill, priority, ..

CUbRIK app

for Conflict

resolution

Game Q&ACrowdtask

1/10/2011 CUbRIK Presentation 4

Context

Goals

New tool for research and exploration of multimedia collections

Based on two focus groups, two dedicated round of user interviews and an online questionnaire

Showcases integration of CUbRIK components

Status Y2 of 3

1/10/2011 CUbRIK Presentation 5

User Story: Who is this person? Tell me more!

1/10/2011 CUbRIK Presentation 6

Demo time!

1/10/2011 CUbRIK Presentation 7

Conclusion & Outlook

Very specific challenges

What is truth? Humanities vs. Computer Science

Gathering requirements for tools that haven‘t beendeveloped yet

Engaging crowds

Image copyrights

Refinement of the application

Additional datasources

Improvement of the interface

Integration of the different components

1/10/2011 CUbRIK Presentation 8

WWW.CUBRIKPROJECT.EU

Visit us on

1/10/2011 CUbRIK Presentation 9

@CUBRIKPROJECT

Or follow us on Twitter