multi(touch) gesture research

18
Multi(Touch) Gesture Research Lecture: Journal Club – spring 2010 Florian Weil University of Art Linz – Master: Interface Culture

Upload: florian-weil

Post on 01-Nov-2014

3.617 views

Category:

Design


0 download

DESCRIPTION

A list of important academic conferences for gesture based interaction, and a summary of 4 papers about gestures on different screen size.

TRANSCRIPT

  • 1. Multi(Touch) Gesture Research Lecture: Journal Club spring 2010 Florian Weil University of Art Linz Master: Interface Culture
  • 2. Questions Which differences exist in gesture interaction on different screen sizes? How is the research community for gesture interaction organized? Which conferences exist? Who are the key researcher and other important researcher?
  • 3. Different screenformats - Small Small Screens Smart Phones
  • 4. Different screenformats - Medium Netbooks Tablet PCs
  • 5. Different screenformats - Large MultiTouch Displays TableTop Displays
  • 6. Different screenformats extra large Touch Walls
  • 7. Researcher & People Explored Keynote and Opening Speakers Reviewer Lists Papers Could not find key roles Good balance of academic (University) and economic driven research (Microsoft etc.)
  • 8. Conferences & Community Computer Human Interaction (CHI) Interactive Tapletop and Surfaces (ITS) Tangible, Embedded, and Embodied Interaction (TEI) Gesture Workshop (GW)
  • 9. Computer Human Interaction (CHI) Big and general conference about Human and Computer Interaction Special Session about surfaces and tabletop Interaction with gesture interaction Organizer Georgia Institute of Technology Brigham Young University Microsoft Research / University of Washington Place Mainly USA and Canada, sometimes Europe Atlanta, Boston, Florence, San Jose, Montreal...
  • 10. Tangible, Embedded, andEmbodied Interaction (TEI) Medium big conference on Tangible, Embedded, and Embodied Interaction. Very good for gesture research for tangible devices. Sponsors: Nokia, Microsoft Research, Philips, Fraunhofer, ACM, SIGCHI Place: Europe and North America Portugal, USA, UK, Germany, ...
  • 11. Interactive Tapletop and Surfaces Medium and pretty young conference (started 2006) with focus on interaction design in connection with surfaces and tabletop systems, like reactable Very good for research in (multiTouch) gesture interaction Organizer: Sriram Subramanian, University of Bristol, UK Antonio Krger (DFKI GmbH) And other... Place: Very often in Europe Saarbrcken, Banff, Amsterdam, Newport
  • 12. Gesture Workshop Small conference / workshop with focus on gesture interaction in general Mostly focus on free form and auditive gestures Organizer University Bielefeld, Adetti, University of South Brittany, Place Only in Europe Bielefeld, Lisbon, Ile de Berder, Genova, London, ...
  • 13. Researched PapersAnne Roudaut, Eric Lecolinet and Yves Guiard, MicroRolls: expanding touch-screen input vocabulary bydistinguishing rolls vs. slides of the thumb, Proceedings of CHI 2009, Boston, MA, USA, 2009, pp. 927-936..Tom Moscovich and John F. Hughes, Indirect mappings of multi-touch input using one and two hands,Proceedings of CHI 2008, Florence, Italy, 2008, pp. 1275-1284.Chi Tai Dang, Martin Straub, Elisabeth Andr, Hand distinction for multi-touch tabletop interaction,Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.Mathias Frisch, Jens Heydekorn, Raimund Dachselt, Investigating multi-touch and pen gestures fordiagram editing on interactive surfaces, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 149-156Alexander Schick, Florian van de Camp, Joris Ijsselmuiden and Rainer Stiefelhagen, Extending touch:towards interaction with large-scale surfaces, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp.117-124.
  • 14. Small Screen Gesture with Thumb http://www.youtube.com/watch?v=bfH0-OqgbLw Context: during movement, one hand interaction Categories: Drag, Swipe, Rubbing, MicroRolls Testings (10 people, Aged 23-28) MicroRoll 2x faster than contex menu UI MicroRoll same as fast as easy Toolbar, faster than difficult toolbar MicroRoll Gesture itself: Robust and easy to learn Good perfomance (influenced by the position of the gesture) Good combination with TapTap, TapRoll, RollMark gestures
  • 15. Medium screen: uni or bimanual gesture Context: TableTop systems and Medium Screens Motivation: investigate perfomance and the right task for uni and bimanual gestures Approach: Testing the commands align, positioning, rotation, scaling of digital objects. Result: Unimanual interaction for visual rotation, transporting, rotating, and stretching Bimanual interaction for control of two individual (control) points (example tasks: window manipulation, image croping etc.) Perfomance differences are small, so the designer can safely interchange between the two methods
  • 16. TableTop Screen: Hand Distinction Context: TableTop systems and Large Screens Motivation: Distinguish one-hand and two-hand gestures improves gesture systems more stable and accurated gesture recognition avoiding of conflicts in multi-user systems Approach: use the anatomy information of the user hand and combine them with touch point and finger orientation data. Result: Average: 96% successfully hand recognition Thumb need a more detail observation Heuristic formular works fine, but constant values needs improvements
  • 17. TableTop Screen: Hand Distinction Source: Chi Tai Dang, Martin Straub, Elisabeth Andr, Hand distinction for multi-touch tabletop interaction, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.
  • 18. Large Screen Gesture via Pointing http://www.youtube.com/watch?v=cV60gwiM5HM Context: Big static screen, some objects are not reachable Categories: Pointing and Touch gestures Seamlessly direct object manipulation with pointing and touch User test results: User think it is a very useful extension Very intuitiv and easy learning interaction Objects are easier to reach and less exhausting compared to touch-only systems User did not really use these two interactions for the same task