Dynamic Hypermedia Generations through a Mediator

using CRM and Web Service

Jen-Shin HongNational ChiNan University,Taiwan

jshong@ncnu.edu.tw

From digital archives to aesthetic hypermedia exhibitions

• Integrating distributed digital archives– focus on exhibition semantic template design methodology for developing auxiliar

y tools for exhibition design– using CRM as a mediating ontology– integrate the digital archives into E-Commerce chain using Web Service

• Styling for aesthetic hypermedia presentations– transform XML-based exhibition document into aesthetic hypermedia exhibitions– based on a fine-grained modularization framework for hypermedia authoring– now marching towards intelligent styling technologies

• Example scenario: Find, in all digital archives, all the photos and descriptions of Chang Kai-shek, the ph

otos of his mother, …, and then automatically generate aesthetic hypermedia exhibitions.

TemplateEditior

Exhibitionsemantictemplates

ExhibitionDocument Generator

ExhibitionEditor

thesaurus

CRM

CRMExpert

Mediator

HypermediaDocument

Logical Structure

Digital Archives

IntelligentStylor

DEMO

Framework for generating exhibition XML document

Modularization framework for hypermedia presentations

1m

1

m

Content DocumentLogical Structure

Page

Block

Mono-modalMedia Container

Temporal info

Spatial info

Aesthetic info

Exhibition Element

Integration

Final presentation

Block 1Block N

Background Layer

Background Audio Layer

Images Layer

Text Layer

Title Layer

Switch Layer

Interaction info

widthheight

startimeItem duration

rgbrotationalpha

Imagegroup

Textsgroup

Container-levle

Container-levle

Page-level

Page-level

Page-level

Page-level

Digital Archive Media ObjectsEntering, Playing, Exiting

Layer Effects

Modularizedmedia handler

X,Y

url

Intelligent styling

《秋登蘭山寄張五》作者：孟浩然

北山白雲裡，隱者自怡悅。 相望始登高，心隨雁飛滅。 愁因薄暮起，興是清秋發。 時見歸村人，沙行渡頭歇。 天邊樹若薺，江畔洲如月。

何當載酒來，共醉重陽節。

keyword= ” river ”keyword= ” leaf ”keyword= ” fog”keyword= ” boat ”

keyword= ” mountain ”keyword=”cloud”

emotion= ” nature ”emotion= ” antique ”

style= ” china ”

metadataKeyword=” 孟浩然 ”Keyword=”poem”

character counting

Text parsingmajor keywordidentification

know ledge basecolor setting rules

theme selectiontext handler selectiontitle handler selection

effect selectiontemporal constraintlayout constraint

optimizationfont setting

handler metadata

content

presentation

database

Primitive ExhibitionElement Repository

Automatic / Manual Exhibition ElementComposer

siteMap Composer

Intelligent styler

media handler selectionparameter adjustment

optimisizationconstraint solving

TOC Composer

title handler

text handler

image handler

effect handler

Modulated HO

MPEG 7Content-BasedMedia Retrieval

Standard

CIDOC CRMOntology

Digial Archive/document

MetadataAnnotation

MetadataAnnotation

Data Retrieval Processor(attribute match, semantic inference, content-based retrieval)

logical contentdocumentstructures

ExhibitionElementSemantictemplates

CIDOC CRMpath mapping toDaily concepts

tool

ExhibitionElementtemplateauthoring

Semanticmapping

paths

TOC XML

Web site XML

Adaptive onlineexhibition

Reference logicalstructure

database

module

module XML-based files

Knowledge basedata

reference

Switch blockhandler

Backgroundtheme handler

…..

Adaptive styling rulesand knowledge base

Overall Framework

Web Service, SOAP, WSDL, UDDI

Client

Server

SOAP Client

SOAP ServiceWSDL document

interact

SOAP SOAP

Mediator 1

QueryFormulation

QueryDispatch

WSDLWeb Service

RDF 3-tuplesrepository

WSDLWeb Service

RDF 3-tuplesrepository

WSDLWeb Service

RDF 3-tuplesrepository

SOAP

CRM

Mapping

DigitalArchives

Mapping

DigitalArchives

Mapping

DigitalArchives

QueryInterface

Approach 1 for mediator design

• transform digital archives into repositories of RDF statements• each digital archive need a mapping from its XML schema • this approach facilitates the implementation of the mediator

• Example scenario in approach 1– A client send a request to the mediator to ask for information about

a “E21.person” instance– The mediator extract and integrate all relevant RDF statements

relevant to the E21.person instance

Client (C)

Mediator

Museum DA

Museum DA

Museum DA

Museum DA

Museum DA

SOAPRDF statements embedded in SOAP

SOAP

RDF statements embedded in SOAP

WSDL

WSDL

<subject_class>E21.Person</subject_class><subject>person’s name</subject>

SOAP 1 SOAP 3

QueryFormulation

QueryRewritting

WSDL 1

XML 1DigitalArchive

WSDL 2

XML 2DigitalArchive

WSDL 3

XML 3Digital

Archive

SOAP 2

CRM

QueryRewritting

QueryRewritting

QueryInterface

Mediator 2

• each digital archive implements a Web Service based on its own XML metadata schema • such Web Service for each archive is easy to implement• need complex query rewriting in the mediator for querying each digital archive

Approach 2 for mediator design

Query model design in detail

• Step 1: define essential atomic concepts for each CRM entity (e.g., E21.person: mother, sibling, children, photographer, photo, text…)

• Step 2: map each atomic concept to a CRM path and choose essential constraints for each concept

• Step 3: formulate the query by concatenating the primitive daily concepts and specify the value of the constraints– e.g.: photo((mother(a person)))

• Constraint: taken at 1965

– e.g.: text(sibling(mother(a person)))• Constraint: male

– e.g: a person’s child’s photographer’s mother’s text descriptions …

Example scenario 1

• example query: find the mother’s name of John Doe

• atomic concept: mother• CRM path for mother

– E21.Person (John Doe) P98B.was_born E67.Birth P96F.by_mother E21.Person (mother’s name)

• Constraint- not necessary in such query

• query: find the children’s names of John Doe• atomic concept: child• CRM path for child

– E21.Person (John Doe) P96B.gave_birth E67.BirthP98F.brought_into_life E21.Person (child’s name)

• constraints• E67.Birth:

– P7F.took_place_at (birth place- who was born at Taiwan)– P10F.falls_within (birth time- who was born within 2nd war)– …

• E21.Person (2nd) – P76F.has_contact_point (current address: who currently stay in

Taiwan)– P107B.is_current_or_former_member_of (organization, who is

with National Taiwan University)– …

Example scenario 2

Issues to be explored further

• derive the CRM paths and choose essential constraints for more atomic concepts

• mapping digital archives to CRM based on WSDL?• temporal and spatial reasoning• performance and scalability issue• approach 2: query rewriting in the mediator