reinventing the inventory

CécilePicard‐LimpensDr.ComputerScienceccl.picard@gmail.com

FreddyLimpensPh.DComputerSciencefreddy.limpens@inria.fr

HowwillIgetridofalltheserustycoffeemakers??

1.  Makingvisibleonthewebthestockof2ndhandshops("ressourceries",EmmauscommuniMes,SalvaMonArmy,etc.)

2.  HelpingtheseorganizaMonsdigiMzingandcataloguingtheirstock

3.  EnhancingcategorizaMonsandsearchincatalogswithsemanMctechnologies

Trainingdataclustersofobjects

associatedtoaclass

(tag)

1.Takeapicture

2.AUTOMATICshaperecogni;on:‐ Findclosestcluster‐ linktagtoobject

Hotliquidcontainer

Hotliquidcontainer

coffeemakercoffeepot

teapot =subClassOf

Seman;ctechnologiesSetofontologies

describingclassesofobjects(tags)andtheirrelaMons

id:hl‐123456tags:hotliquidcontainer☐coffeemaker coffeepot☐teapot

3.SEMI‐AUTOMATICrefiningofthetagging‐ AutomaMcallysuggestrelatedtags(ontology)‐ ManuallyvalidateorcorrectsuggesMons

Picture

AUTOMATICshaperecogni;on:‐ Findclosestcluster‐ linktagtoobject

Hotliquidcontainer

RELATEDWORK

ImageanalysistoolswithmachinelearningandstaMsMcalmodelingtechniques

•  FIRE(FlexibleImageRetrievalEngine),acontent‐basedimageretrievalsystem

ThomasDeselaers,RWTHAachenUniversity

•  LEARteam:visualobjectrecogniMonforobjectcategorydetecMon

INRIA‐LJKGrenoble

•  Mediacycle:allowstobrowseimagelibrariesbyorganizingthemintoclusterstakingintoaccountshape,colorortexture(viaopencvlibrary)UniversitédeMons&numediart,Belgium

?

?

?

Thegoal:FindingsemanMcally

RelatedtagsToenhancesearching

coffeemaker

Theidea:1./MappingtagsWithontologies’concepts

Hotliquidcontainer

coffeemakercoffeepot

teapot

=subClassOf

www.slideshare.net/fabien_gandon/web‐smanMque‐et‐web‐social‐1700977

www.slideshare.net/fabien_gandon/web‐smanMque‐et‐web‐social‐1700977

www.slideshare.net/fabien_gandon/web‐smanMque‐et‐web‐social‐1700977

Theidea:2./MiningsemanMcrelaMonsFromtags’structureandfeatures

String‐basedmapping

Coocurringtags

Resultsfor"coffeemaker":

coffeemaker

Relatedresults:

Resultsfor"teapot":

Resultsfor"coffeepot":

1. Theuserenter"coffeemaker"

2. ThesystemsuggestsaddiMonalresultsthankstosemanMcrelaMons

•  AnautomaMcarchivingofsecond‐handobjectsandtheireasyretrievingbyapotenMaluser

•  Agoodpictureofsustainabledevelopment

•  Allthetechniquesusedaimedtobefreeandopensource

•  BenchmarkcurrentshaperecogniMonmethods onourspecificproblem

•  Lookingforavailableontologies/folksonomiesofeverydayobjectstobootstrapsemanMcfuncMonnaliMes

•  PracMcalexperimentina«ressourcerie» (hnp://courtcircuioelleMn.wordpress.com/)