sketchbased interface on a handheld augmented reality system
DESCRIPTION
Sketchbased interface on a handheld augmented reality system. Rhys Moyne Honours Minor Thesis Supervisor: Dr. Christian Sandor. TINT. Augmented Reality (AR). Adding virtual information to the real world Aids user in understanding the world - PowerPoint PPT PresentationTRANSCRIPT
Sketchbasedinterfaceonahandheldaugmentedrealitysystem
RhysMoyneHonoursMinorThesis
Supervisor:Dr.ChristianSandor
TINT
AugmentedReality(AR)
Addingvirtualinformationtotherealworld Aidsuserinunderstandingtheworld Mergesrealworld(cameraimage)andvirtual
objects Trackingisneededtocalculatelocationof
objectsanduserintheenvironment
ARDisplayTechnologies
Head-mounted Handheld
Motivation
HandheldARsystemsrequiredifferentwaysofinteractionduetosizeconstraint
Exisitingmethodssuchaspinchglovesorwristpadsarenotsuitable
FutureARdevicessuchasmobilephonesarelikelytohavetouchscreens
Sketch-basedinputinhandheldaugmentedrealityislargelyunexplored
DirectManipulationandSketch-basedInterface
DirectManipulation
DirectManipulation
Useractionsaffectobjectimmediately Example:drivingacar
Userturnssteeringwheelleftandwheelmovesleft Nocommand“TURNLEFT”
“Matchinguser'sgestureswiththeobservedvirtualmotion”(Dragicevicetal.,p.2)
Sketch-basedinterface
Sketch-basedinterface
Allowsusertodirectlyinteractsimilartopenandpaper Morenatural Hasbeenexploredinareassuchasmodelling,
animation,userinterfaceprototyping Gestures
ResearchQuestion
Isasketchbasedinterfaceasuitableinteractionmethodinahandheldaugmentedrealitysystem?
ResearchApproach
LiteratureReview Iterativeprototypes
Informalqualitativefeedbackontechniques (Userstudy)
DevelopmentApproach
Createademoillustratinginteractiveexplorationinasimpletestscene MakeuseofTINTframework
Addtracking Addanimation
Directmanipulationinterface(completeby18September) Morecomplicatedphysics(18September) GestureRecognition(18September)
PorttoMobileAugmentedReality(30September) Projectionofcameraimageontovirtualobjects
Demo
ThiscanbeusedasabasetocontrolvisualisationsinTINT
Illustrateshowtocontrolobjectstoexplore
TINT(ThisisnotTINMITH)
TINMITH–HMDprototypingplatform TINT–Handheldaugmentedrealityprototyping
platform UsedtoprototypeARapplicationsthatmaybe
possibleonfuturemobilephones WritteninPythonallowingfastdevelopment
Implementation
ARToolkitTracking
Calculateswherethemarkerisrelativetothecameraposition
Usescomputervisiontechniquestoidentifymarker
Allowsthevirtualobjectstobeplacedincorrectlocation
CompizPhysics
$1GestureRecognizer
Summary
Howtointeractivelycontrolvisualisationsinhandheldaugmentedreality?
Thanks,Questions?
ReferencesCompiz.org,2009,'Compiz',<http://www.compiz.org/>,accessed3September2009.
Dragicevic,P,Ramos,G,Bibliowitcz,J,Nowrouzezahrai,D,Balakrishnan,R&Singh,K2008,'Video
browsingbydirectmanipulation',inTwentysixthannualSIGCHIconferenceonHumanfactorsin
computingsystems,ACM,Florence,Italy,pp.237246.
Igarashi,T,Matsuoka,S&Tanaka,H1999,'Teddy:asketchinginterfacefor3Dfreeformdesign'in
Proceedingsofthe26thannualconferenceoncomputergraphicsandinteractivetechniques,ACM,
pp.409416.
Kato,H&Billinghurst,M1999,'MarkertrackingandHMDcalibrationforavideobasedaugmentedreality
conferencingsystem',inProceedingsofAugmentedReality1999(IWAR'99),IEEE,SanFrancisco,
CA,pp.8594.
Piekarski,W&Thomas,BH2001,'TinmithMetro:newoutdoortechniquesforcreatingcitymodelswithan
augmentedrealitywearablecomputer',inProceedingsofFifthInternationalSymposiumon
WearableComputers,IEEE,Zurich,pp.3138.
Sandor,C,Cunningham,A,Eck,U,Urquhart,D,Jarvis,D,Dey,A,Barbier,S,Marner,M&Rhee,S2009,
'Egocentricspacedistortingvisualizationsforrapidenvironmentexplorationinmobilemixedreality',
in8thIEEEandACMInternationalSymposiumonMixedandAugmentedReality(ISMAR'09),ACM,
Orlando,Florida.
Shneiderman,B1983,'DirectManipulation:astepbeyondprogramminglanguages',Computer, vol.16,no.8,pp.57-69.
sleepygeek.org,n.d.,'$1gesturerecognizerinpython',<http://sleepygeek.org/projects.dollar>,accessed3September2009.
Wobbrock,JO,Wilson,AD&Li,Y2007,'Gestureswithoutlibraries,toolkitsortraining:a$1recognizerfor
userinterfaceprototypes'inProceedingsofthe20thannualACMsymposiumonuserinterface
softwareandtechnology,ACM,Newport,RhodeIsland,pp.159168.