12/13/10

1

webofdata webofpeople webofac2on

AlanDixLancasterUniversity

andTalis

www.hcibook.com/alan/papers/JWS-2010-world-of-action

aboutme

IworkatLancasterneartheLakeDistrict

andBirminghamintheMidlandsofEngland

12/13/10

2

…but

althoughIspeakEnglishIamnotEnglish

IamWelsh

rydwi’nCymraeg

…andlive...

inTiree,Scotland...thesunniest...andwindiestplaceintheUK

12/13/10

3

todayIamnottalkingabout…

•  situateddisplays,eCampus,smalldevice–largedisplayinterac2ons

•  visualisa2onandsampling

•  funandgames,virtualcrackers,ar2s2cperformance,slow2me

•  physicalityandproductdesign

•  crea2vityandbadideasandmodellingdreamsandregret!

…orevenlotsoflights

hQp:/www.hcibook.com/alan/projects/firefly/

12/13/10

4

...butIamtalkingabout

theweb

web

data

•  HTML,images,PDF•  hypertextlinks•  websearch

12/13/10

5

web

data

•  web2.0•  socialmedia

•  socialnetworking

people

vfridge(dot.com)photolurking

vfridge...lookingtothewebfuture...in1999

inthemidstofdot.comyears...

dominantview:– expec2ng‘shakeout’– smallnumberoflargeplayers–  futureofwebasTV‐stylebroadcastmedium

wethoughtdifferently....

12/13/10

6

thewebsharervision(1999)

“Theweb/Internetisnotjustamediumforpublishing,butapoten2alsharedplace.

Everyonemaybeawebsharer—notapublisherofformalpublic'content',butpersonalorsemi‐privatesharingofinformal'bitsandpieces'withfamily,friends,localcommunityandvirtualcommuni2es...”

soundsprescient(web2.0!)....andwastranslatedintoaproduct(vfridge)

sadlythecompanydied

buttheyoucans2llplaywithvfridgetoday

12/13/10

7

web

data

•  peoplewanttodothings

BillGates:“The future of search is verbs.”

EstherDyson:"when people search, ...   they are looking for ac9on"

ac2onpeople

web

data

butmustnotforget

thatattheheartoftheweb

iscomputa2on

ac2onpeople

computa2on

12/13/10

8

computa2on

data

•  seman2cweb– RDF,OWLetc,opendata,linkeddata,data.gov.uk

ac2onpeople

computa2on

data

•  seman2cweb•  recommendersystems– Amazonforbooks,butnowubiquitous

ac2onpeople

12/13/10

9

computa2on

data

•  seman2cweb•  recommendersystems

•  intelligentuserinterfaces– promisedlong...

ac2onpeople

onCue...moredot.comtales

computa2on

data

butallfittogether

globaldata+individualinterac2on=>personalisedac2on

ac2onpeople

12/13/10

10

focusingonac2on

howcanthesystemhelp?

2metoact

•  whentoact(ini2a2ngac2on)– detec2nglociofac2onincurrentac2vity

•  whattoacton(performingac2on)– sugges2ngparameters/valuesinac2ons

•  howtoact(con2nuingac2on)– proposingfutureac2ons

12/13/10

11

whentoact

detec2nglociofac2onincurrentac2vity

data‐driveninterac2on

iden2fylociatpointofcrea2on

offeralterna2veRDForXMLformatsorusemarkupinwebpage– dedicatedmarkup

e.g.zLinks

– microformatshumanreadabletext...

...butalsomachinereadable forsearchenginesorplug‐ins

<p class="vcard">Hi, my name is <span class="fn">Jamie Jones</span> and I dig microformats!</p>

microformats.org

zitgist.com/products/zlinks

12/13/10

12

iden2fylociatpointofuse–Snip!t

1

usersselectsinwebpageandpresses“Snip!t”bookmarklet

2

Snip!tpopsuppagewithsuggestedthingstodowiththesnip(andsavesitforlater,likebookmark)

iden2fylociatpointofuse–Snip!t

recognisesvariousthingse.g.dates

playyourselfatwww.snipit.org

12/13/10

13

classofsystems‘datadetectors’

•  late1990s–  Intelselec2onrecogni2onagent–  AppleDataDetectors(BonnieNardi)–  CyberDesk(AndyWoodledtoonCue)

•  recently–  MicrosovSmartTags–  Googleextensions–  Citrine–clipboardconverter–  CREOsystem(Faaberg,2006)

•  wayback–  Microcosm(Hypertextexternallinkage)

syntac2c/regexp

‘seman2c’/lookup

Snip!tusescombina2on

architecture

Snip!t–server‐side‘intelligence’ (onCue–wasclient‐side–internetspeedatthe2me!)

recognisers+services(inheritedfromonCue):

•  recognisers:– scantextforpoten2aldata

•  services:– matchdatatoac2ons

12/13/10

14

architecture

simplerecognisers–  regularexpressions,tablelookup

e.g.postcodes,personalnamesfromcensusdata

differentkindsofrecogniserchaining:–  fromseman2cstowiderrepresenta2on

e.g.postcodesuggestslookforaddress–  fromseman2ctoseman2c

e.g.domainnameinURL–  fromseman2ctoinnerrepresenta2on

e.g.fromAmazonauthorURLtoauthorname

representa2onvs.seman2csveryimportant

whattoacton

sugges2ngparameters/valuesinac2ons

12/13/10

15

personalontologies

•  alluse‘general’categories:•  postcode,name,place

•  linkingtopersonalontology– usersownen22esandcategories

•  howtobuild?– byhand(duringusefulinterac2ons)– automa2cally(miningfiles,emails,etc.)

–  e.g.Gnowsisandotherseman2cdesktopprojects

me

Azrina

supervises

Geoff

supervises

Devina

married

Project:TIM

member

member

spreadingac2va2onoverontology

Person Univ City Country

Vivi

UoAAthens

Greece

George

UoPTripolis

m 1 m 1 m 1

spreadac2va2onthroughrela2oninstances

weakerspreadthrough1‐mlinksthanm‐1

long‐termmodifica2onofschemarela2onweights

ini2alac2va2onthroughuse

schema

instances

Costas

e

12/13/10

16

contextinforms

butwhatistherela2onship?maybeseman2cmarkuponform– goodSemWebstyle...butnotverypersonal

...ormoreinference...

HotelsRUs

AlanDix

LancasterUniv.

Name

Org.

entryoffirstfieldsetscontextforrestofform

contextinforms‐inference

matchtermsinformtoontologylookfor‘leastcostpaths’

•  numberofrela2onshipstraversed,fan‐out

HotelsRUs

AlanDix

LancasterUniv.

Name

Org.

Person:ADix

name_of

Inst:ULanc

name_of

memberPerson:Devina

?

member

colleague

12/13/10

17

contextinforms‐inference

matchtermsinformtoontologylookfor‘leastcostpaths’

•  numberofrela2onshipstraversed,fan‐out

latersuggestbasedonrules

HotelsRUs

Name

Org.

AkriviKa2fori

Univ.ofAthens

Person:?

name_of

Inst:?

name_of

member

Person:Vivi

Inst:UoA

member

howtoact

proposingfutureac2ons

12/13/10

18

singlestep–nextac2on

seenitalready...

•  markupordatadetectors‐>loci

•  findwebservicesthatusethedata

•  stronglytypeddataisthelink

loca2ngwebservicesfordatatype

manywebservicesdesignedforhumanuseaddmeta‐informa2ontoservices–  internal(seman2cpagemarkup)

– external(e.g.Snipit,MilanSearchCompu2ng)

<urlservice><type>name</type> <2tle>switchboard.com</2tle><descpaQern>lookupUSperson$nameatswitchboard.com</descpaQern><urlpaQern>hQp://www.switchboard.com/bin/cgiqa.dll?SR=&amp;MEM=1&amp;LNK=33:4&amp;F=${forename}&amp;L=${surname}</urlpaQern></urlservice>

www.snipit.org

12/13/10

19

reweavingthehiddenwebthroughuserinterac2on

hiddenwebapplica2on webpageswith

microformatsordatadetctors

meta‐datadescribinginput

webofdatasta2canddynamic

proposingsequencesofac2ons

•  longhistory(lotsofworkearly1990s)•  limitedsuccess–  interleavedtasks– generalisa2on

•  dataontologyhelps:‐)–  input/outputlinkslike‘stringofpearls’– ontologytypeallowssinglesteplearning

12/13/10

20

howtogetlinks?

•  userinterac2on:– drill‐downfrompreviousvalues

•  systeminference:– sameform‐fieldlinkingasbefore

sowhat?