adapting the hypermedia structure in a generic multimedia ...€¦ · setup box low cpu mobile...

Adapting the Hypermedia Structure in a GenericMultimedia Adaptation Framework

Sebastien Laborie and Jerome Euzenat

SMAP’06

1 Sebastien Laborie and Jerome Euzenat Adapting the hypermedia structure in an adaptation framework

Introduction Motivations

A multimedia document example

A movie trailer presentation

Temporal-hypermedia dimension

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3


Introduction Motivations

Multimedia document adaptation

Laptop

Initialmultimediadocument

Mobile phonesmall screen

PDAlow bandwidth

Setup boxlow CPU

Mobile phone

PDA

Setup box

Adapteddocument

Adapteddocument’

Adapteddocument”

Adaptation

Adaptation

Adaptation


Introduction Our adaptation approach

Our adaptation approach

Adaptation of the multimedia document structure.

A multimedia document specification is composed of :

A set of multimedia objects.A set of relations between multimedia objects.

The adapted document should be close to the initial one.

Initial document

Poster Abstract

Characters Dates

Trailer

meets

afterafter

meets

before

meets

before before

overlaps overlaps

adaptation

proximity

Adapted document

Poster Abstract

Characters Dates

Trailer

meets

afterafter

before

before

meets

before before

meets met by






A set of multimedia objects.

A set of relations between multimedia objects.


Initial specification

Poster Abstract

Characters Dates

Trailer

meets

afterafter

meets

before

meets

before before

overlaps overlaps

adaptation

proximity

Adapted specification

Poster Abstract

Characters Dates

Trailer

meets

afterafter

before

before

meets

before before

meets met by








Initial specification

Poster Abstract

Characters Dates

Trailer

meets

afterafter

meets

before

meets

before before

overlaps overlaps

adaptation

proximity

Adapted specification

Poster Abstract

Characters Dates

Trailer

meets

afterafter

before

before

meets

before before

meets met by








Initial relation graph

Poster Abstract

Characters Dates

Trailer

meets

afterafter

meets

before

meets

before before

overlaps overlaps

adaptation

proximity

Adapted relation graph

Poster Abstract

Characters Dates

Trailer

meets

afterafter

before

before

meets

before before

meets met by


Introduction Our contribution

What is new in this paper ?

Adapt the hypermedia dimension.

Temporal-Hypermedia adaptation.

Propose an incremental adaptation which takes into accountthe user interactions.


Introduction Our contribution

Outline

1 Adaptation of the Hypermedia DimensionHypermedia specificationHypermedia adaptation

2 Adaptation based on the Hypermedia Structure

3 Adapting the Hypermedia Structure according to userinteractions

4 Conclusion


Adaptation of the Hypermedia Dimension

Outline




4 Conclusion


Adaptation of the Hypermedia Dimension Hypermedia specification

Hypermedia specification


Poster

Abstract

Trailerl1

l2


Poster Abstract

Trailer

l1 l2

{o}{b} {m}

{s}{e}

{fi}

{fi}

{oi}

{b} {b}





Poster

Abstract

Trailerl1

l2

Allen interval algebra

x r y x / y y r−1 xbefore (b) (bi) aftermeets (m) (mi) met-byduring (d) (di) contains

overlaps (o) (oi) overlapped-bystarts (s) (si) started-by

finishes (f ) (fi) finished-byequals (e) (e)


Poster Abstract

Trailer

l1 l2

{o}{b} {m}

{s}{e}

{fi}

{fi}

{oi}

{b} {b}





Poster

Abstract

Trailerl1

l2






Poster Abstract

Trailer

l1 l2

{o}{b} {m}

{s}

{e}

{fi}

{fi}

{oi}

{b} {b}





Poster

Abstract

Trailerl1

l2






Poster Abstract

Trailer

l1 l2

{o}{b} {m}

{s}{e}

{fi}

{fi}

{oi}

{b} {b}


Adaptation of the Hypermedia Dimension Hypermedia adaptation

Hypermedia adaptation

Identify the target device profile (e.g., only one button).

Identify the possible relations according to the profile :

Overlapping links are impossible at a time.A link belongs to a multimedia object.

Compute adapted solutions close to the initial document.

Preserve a maximum of relations.


Poster Abstract

l1 l2

Trailer

{o}

{s}{e}

{fi}

{fi}

{oi}

{b} {m}{b} {b}

Possible relation graph

Poster Abstract

l1 l2

Trailer

all

{s, f , d, e}{s, f , d, e}

{m, mi, b, bi}

all

all

all allall all






Overlapping links are impossible at a time.

A link belongs to a multimedia object.




Poster Abstract

l1 l2

Trailer

{o}

{s}{e}

{fi}

{fi}

{oi}

{b} {m}{b} {b}


Poster Abstract

l1 l2

Trailer

all

{s, f , d, e}{s, f , d, e}

{m, mi, b, bi}

all

all

all allall all






Overlapping links are impossible at a time.A link belongs to a multimedia object.




Poster Abstract

l1 l2

Trailer

{o}

{s}{e}

{fi}

{fi}

{oi}

{b} {m}{b} {b}


Poster Abstract

l1 l2

Trailer

all

{s, f , d, e}{s, f , d, e}

{m, mi, b, bi}

all

all

all allall all



Temporal proximities

before meets overlaps

finished-by

starts

contains

equals

during

started-by

finishes

lappeoverlapped-by met-by after



Temporal proximities

before meets overlaps

finished-by

starts

contains

equals

during

started-by

finishes

lappeoverlapped-by met-by after

δ(before, overlaps) = 2





Generate consistent possible relation graphs.distance =

∑ni=1 δ(ri , pi ).


Poster Abstract

l1 l2

Trailer

{o}

{s}{e}

{fi}

{fi}

{oi}

{b} {m}{b} {b}


Poster Abstract

l1 l2

Trailer

all

{s, f , d, e}{s, f , d, e}

{m, mi, b, bi}

all

all

all allall all

distance = 2 + 1 + 1 = 4 (minimal)





Generate consistent possible relation graphs.

distance =∑n

i=1 δ(ri , pi ).


Poster Abstract

l1 l2

Trailer

{o}

{s}{e}

{fi}

{fi}

{oi}

{b} {m}{b} {b}

Consistent possible relation graph

Poster Abstract

l1 l2

Trailer

{o}

{s}{s}

{m}

{fi}

{mi}

{b} {m}{b} {b}







∑ni=1 δ(ri , pi ).


Poster Abstract

l1 l2

Trailer

{o}

{s}{e}

{fi}

{fi}

{oi}

{b} {m}{b} {b} distance


Poster Abstract

l1 l2

Trailer

{o}

{s}{s}

{m}

{fi}

{mi}

{b} {m}{b} {b}







∑ni=1 δ(ri , pi ).


Poster Abstract

l1 l2

Trailer

{o}

{s}{e}

{fi}

{fi}

{oi}



Poster Abstract

l1 l2

Trailer

{o}

{s}{s}

{m}

{fi}

{mi}

{b} {m}{b} {b}

distance = 2

+ 1 + 1 = 4 (minimal)






∑ni=1 δ(ri , pi ).


Poster Abstract

l1 l2

Trailer

{o}

{s}{e}

{fi}

{fi}

{oi}



Poster Abstract

l1 l2

Trailer

{o}

{s}{s}

{m}

{fi}

{mi}

{b} {m}{b} {b}

distance = 2 + 1

+ 1 = 4 (minimal)






∑ni=1 δ(ri , pi ).


Poster Abstract

l1 l2

Trailer

{o}

{s}{e}

{fi}

{fi}

{oi}



Poster Abstract

l1 l2

Trailer

{o}

{s}{s}

{m}

{fi}

{mi}

{b} {m}{b} {b}

distance = 2 + 1 + 1

= 4 (minimal)






∑ni=1 δ(ri , pi ).


Poster Abstract

l1 l2

Trailer

{o}

{s}{e}

{fi}

{fi}

{oi}



Poster Abstract

l1 l2

Trailer

{o}

{s}{s}

{m}

{fi}

{mi}

{b} {m}{b} {b}

distance = 2 + 1 + 1 = 4

(minimal)




Compute adapted solutions close to the initial document.Generate consistent possible relation graphs.distance =

∑ni=1 δ(ri , pi ).


Poster Abstract

l1 l2

Trailer

{o}

{s}{e}

{fi}

{fi}

{oi}



An adapted solution

Poster Abstract

l1 l2

Trailer

{o}

{s}{e}

{fi}

{fi}

{oi}

{b} {m}{b} {b}




A possible adapted execution

Initial document

Poster

Abstract

Trailerl1

l2

Adapted document

Poster

Abstract

Trailerl1

l2


Adaptation based on the Hypermedia Structure

Outline




4 Conclusion



The Hypermedia Structure

Initial Specification

Poster

Abstract Characters

Trailer

Dates

l1l2

l3

Characters

Trailer

Datesl3

Abstract Characters

Trailer

Datesl2

l3




Difficult to adapt with our adaptation approach.

Different timelines with different relations and objects number.

Initial Specification

Poster

Abstract Characters

Trailer

Dates

l1l2

l3

Characters

Trailer

Datesl3

Abstract Characters

Trailer

Datesl2

l3




Identify all sub-specifications to preserve our approach.

Sub-specification 1

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3

l1, l2 l3l3

Sub-specification 2

Characters

Trailer

Dates

l3

l3

l2

Sub-specification 3

Abstract Characters

Trailer

Dates

l2l3



Adapting all sub-specifications at once

Identify the target device profile.

Sub-specification 1

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3

l1, l2 l3l3

Sub-specification 2

Characters

Trailer

Dates

l3

l3

l2

Sub-specification 3

Abstract Characters

Trailer

Dates

l2l3




Profile = Impossible to select a link during a video.

Sub-specification 1

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3

l1, l2 l3l3

Sub-specification 2

Characters

Trailer

Dates

l3

l3

l2

Sub-specification 3

Abstract Characters

Trailer

Dates

l2l3




Adapt each sub-specification.

Sub-specification 1

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3

l1, l2 l3l3

Sub-specification 2

Characters

Trailer

Dates

l3

l3

l2

Sub-specification 3

Abstract Characters

Trailer

Dates

l2l3



Drawbacks

Some sub-specifications are adapted even if there are notexecuted.

If the profile changes during the user interactions, allsub-specifications have to be adapted again.

Parts of several sub-specifications are adapted several times.


Adapting the Hypermedia Structure according to user interactions

Outline




4 Conclusion



Incremental adaptation

Start from an initial sub-specification.

Sub-specification 1

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3

l3

l2

Sub-specification 3

Abstract Characters

Trailer

Dates

l2




Impossible to select a link during a video.

Sub-specification 1

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3

l3

l2

Sub-specification 3

Abstract Characters

Trailer

Dates

l2




Adapt the sub-specification.

Sub-specification 1

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3

l3

l2

Sub-specification 3

Abstract Characters

Trailer

Dates

l2




The user selects the link l3.

Sub-specification 1

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3

l3

l2

Sub-specification 3

Abstract Characters

Trailer

Dates

l2




Generate the sub-specification according to the previous one.

Sub-specification 1

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3

l3

l2

Sub-specification 3

Abstract Characters

Trailer

Dates

l2l3




Impossible to select a link during a video.

Sub-specification 1

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3

l3

l2

Sub-specification 3

Abstract Characters

Trailer

Dates

l2l3




No adaptation is needed.

Sub-specification 1

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3

l3

l2

Sub-specification 3

Abstract Characters

Trailer

Dates

l2l3




and so on. . .

Sub-specification 1

Poster

Abstract Characters

Trailer

Dates

l1

l2

l3

l3

l2

Sub-specification 3

Abstract Characters

Trailer

Dates

l2l3


Conclusion

Outline




4 Conclusion


Conclusion

Conclusion and future works

Conclusion :

A uniform approach to deal wih the adaptation problem.

temporal-hypermedia.

Proposition of an incremental adaptation which takes intoaccount the user interactions.

Future Works :

Extend the framework by adding or deleting objects.

Adapt standard multimedia description languages (e.g., SMIL).


Questions

Questions ?

Thank you for your attention !

[email protected]


adapting the hypermedia structure in a generic multimedia ...€¦ · setup box low cpu mobile...

Documents