cosc 4107: human computer interaction lecture 2: understanding and conceptualizing interaction
DESCRIPTION
COSC 4107: Human Computer Interaction Lecture 2: Understanding and conceptualizing interaction. Recap. HCI has moved beyond designing interfaces for desktop machines About extending and supporting all manner of human activities in all manner of places - PowerPoint PPT PresentationTRANSCRIPT
11
COSC 4107: Human Computer InteractionCOSC 4107: Human Computer Interaction
Lecture 2: Understanding and Lecture 2: Understanding and conceptualizing interactionconceptualizing interaction
22
RecapRecap HCI has moved beyond designing interfaces HCI has moved beyond designing interfaces
for desktop machinesfor desktop machines About extending and supporting all manner About extending and supporting all manner
of human activities in all manner of placesof human activities in all manner of places Facilitating user experiences through Facilitating user experiences through
designing interactionsdesigning interactions Make work effective, efficient and saferMake work effective, efficient and safer Improve and enhance learning and trainingImprove and enhance learning and training Provide enjoyable and exciting entertainmentProvide enjoyable and exciting entertainment Enhance communication and understandingEnhance communication and understanding Support new forms of creativity and expressionSupport new forms of creativity and expression
33
Understanding the problem Understanding the problem spacespace
• What do you want to create?What do you want to create?• What are your assumptions?What are your assumptions?• Will it achieve what you hope it will?Will it achieve what you hope it will?
44
A framework for analysing the A framework for analysing the problem spaceproblem space
Are there problems with an existing Are there problems with an existing product?product?
Why do you think there are problems?Why do you think there are problems? Why do you think your proposed ideas Why do you think your proposed ideas
might be useful?might be useful? How would you see people using it with How would you see people using it with
their current way of doing things?their current way of doing things? How will it support people in their How will it support people in their
activities?activities? Will it really help them?Will it really help them?
55
An exampleAn example
What were the assumptions made by What were the assumptions made by cell phone companies when cell phone companies when developing WAP (Wireless developing WAP (Wireless Application Protocol) services?Application Protocol) services?
Was it a solution looking Was it a solution looking for a problem?for a problem?
66
Assumptions: realistic or wish-list?Assumptions: realistic or wish-list?
People want to be kept informed of up-to-date People want to be kept informed of up-to-date news wherever they are news wherever they are - reasonable- reasonable
People want to interact with information on the People want to interact with information on the move move - reasonable- reasonable
People are happy using a very small display and People are happy using a very small display and using an extremely restricted interface using an extremely restricted interface - not - not reasonablereasonable
People will be happy doing things on a cell People will be happy doing things on a cell phone that they normally do on their PCs (e.g. phone that they normally do on their PCs (e.g. surf the web, read email, shop, bet, play video surf the web, read email, shop, bet, play video games) games) - reasonable only for a very select bunch - reasonable only for a very select bunch of usersof users
77
From problem space to design From problem space to design spacespace
Having a good understanding of the Having a good understanding of the problem space can help inform the problem space can help inform the design spacedesign space• e.g. what kind of interface, behavior, e.g. what kind of interface, behavior,
functionality to providefunctionality to provide But before deciding upon these it is But before deciding upon these it is
important to develop a conceptual important to develop a conceptual modelmodel
88
Conceptual modelConceptual model
Need to first think about how the system Need to first think about how the system will appear to users (i.e. how they will will appear to users (i.e. how they will understand it)understand it)
A conceptual model is a high level A conceptual model is a high level description of:description of:• ““the proposed system in terms of a set of the proposed system in terms of a set of
integrated ideas and concepts about what it integrated ideas and concepts about what it should do, behave and look like, that will be should do, behave and look like, that will be understandable by the users in the manner understandable by the users in the manner intended”intended”
99
First steps in formulating a First steps in formulating a conceptual modelconceptual model
What will the users be doing when What will the users be doing when carrying out their tasks?carrying out their tasks?
How will the system support these?How will the system support these? What kind of interface metaphor, if any, What kind of interface metaphor, if any,
will be appropriate?will be appropriate? What kinds of interaction modes and What kinds of interaction modes and
styles to use? styles to use? Always keep in mind when making design Always keep in mind when making design decisions how the user will understand the decisions how the user will understand the underlying conceptual model underlying conceptual model
1010
Conceptual modelsConceptual models
Many kinds and ways of classifying Many kinds and ways of classifying themthem
Here we describe them in terms of Here we describe them in terms of core activities and objectscore activities and objects
Also in terms of interface metaphorsAlso in terms of interface metaphors
1111
ActivityActivity
A company is building a wireless A company is building a wireless information system to help tourist information system to help tourist find their way around an unfamiliar find their way around an unfamiliar city.city.
What would they need to find out to What would they need to find out to develop a conceptual model?develop a conceptual model?
1212
Conceptual models based on Conceptual models based on activities activities
Giving instructionsGiving instructions• issuing commands using keyboard and function issuing commands using keyboard and function
keys and selecting options via menuskeys and selecting options via menus ConversingConversing
• interacting with the system as if having a interacting with the system as if having a conversationconversation
Manipulating and navigatingManipulating and navigating• acting on objects and interacting with virtual acting on objects and interacting with virtual
objectsobjects Exploring and browsingExploring and browsing
• finding out and learning thingsfinding out and learning things
1313
1. Giving instructions1. Giving instructions Where users instruct the system and tell it Where users instruct the system and tell it
what to dowhat to do• e.g. tell the time, print a file, save a filee.g. tell the time, print a file, save a file
Very common conceptual model, underlying Very common conceptual model, underlying a diversity of devices and systemsa diversity of devices and systems• e.g. CAD, word processors, VCRs, vending e.g. CAD, word processors, VCRs, vending
machinesmachines Main benefit is that instructing supports Main benefit is that instructing supports
quick and efficient interactionquick and efficient interaction• good for repetitive kinds of actions performed good for repetitive kinds of actions performed
on multiple objectson multiple objects
1414
2. Conversing2. Conversing Underlying model of having a conversation Underlying model of having a conversation
with another humanwith another human
Range from simple voice recognition menu-Range from simple voice recognition menu-driven systems to more complex ‘natural driven systems to more complex ‘natural language’ dialogueslanguage’ dialogues
Examples include timetables, search engines, Examples include timetables, search engines, advice-giving systems, help systemsadvice-giving systems, help systems
Recently, much interest in having virtual Recently, much interest in having virtual agents at the interface, who converse with agents at the interface, who converse with you, e.g. Microsoft’s Clippyyou, e.g. Microsoft’s Clippy
1515
Pros and cons of conversational Pros and cons of conversational modelmodel
Allows users, especially novices and Allows users, especially novices and technophobes, to interact with the system in a technophobes, to interact with the system in a way that is familiarway that is familiar• makes them feel comfortable, at ease and less scaredmakes them feel comfortable, at ease and less scared
Misunderstandings can arise when the system Misunderstandings can arise when the system does not know how to parse what the user saysdoes not know how to parse what the user says• A child types into a search engine “Ask Jeeves for A child types into a search engine “Ask Jeeves for
Kids”, Kids”, http://www.ajkids.com/http://www.ajkids.com/, uses natural language , uses natural language question:question:
““How many legs does a centipede have?”How many legs does a centipede have?” and the and the system responds:system responds:
1616
Y o u a s k e d : H o w m a n y l e g s d o e s a c e n t i p e d e h a v e ? J e e v e s k n o w s t h e s e a n s w e r s : W h e r e c a n I fi n d a d e fi n i t i o n f o r t h e m a t h t e r m l e g ? W h e r e c a n I fi n d a c o n c i s e e n c y c l o p e d i a a r t i c l e o n ? c e n t i p e d e s ? W h e r e c a n I s e e a n i m a g e o f t h e h u m a n a p p e n d i x ? W h y d o e s m y l e g o r o t h e r l i m b f a l l a s l e e p ? W h e r e c a n I fi n d a d v i c e o n c o n t r o l l i n g t h e g a r d e n p e s t ? m i l l i p e d e s a n d c e n t i p e d e s ? W h e r e c a n I fi n d r e s o u r c e s f r o m B r i t a n n i c a . c o m o n l e g ?
1717
3. Manipulating and navigating3. Manipulating and navigating Involves dragging, selecting, opening, closing Involves dragging, selecting, opening, closing
and zooming actions on virtual objects and zooming actions on virtual objects
Exploit’s users’ knowledge of how they move Exploit’s users’ knowledge of how they move and manipulate in the physical worldand manipulate in the physical world
Exemplified by (i) what you see is what you Exemplified by (i) what you see is what you get (WYSIWYG) and (ii) the direct get (WYSIWYG) and (ii) the direct manipulation approach (DM)manipulation approach (DM)
Shneiderman (1983) coined the term DM, Shneiderman (1983) coined the term DM, came from his fascination with computer came from his fascination with computer games at the timegames at the time
1818
Core principles of DMCore principles of DM
Continuous representation of objects and Continuous representation of objects and actions of interestactions of interest
Physical actions and button pressing Physical actions and button pressing instead of issuing commands with complex instead of issuing commands with complex syntaxsyntax
Rapid reversible actions with immediate Rapid reversible actions with immediate feedback on object of interestfeedback on object of interest
1919
Why are DM interfaces so Why are DM interfaces so enjoyable?enjoyable?
Novices can learn the basic functionality quicklyNovices can learn the basic functionality quickly Experienced users can work extremely rapidly to Experienced users can work extremely rapidly to
carry out a wide range of tasks, even defining new carry out a wide range of tasks, even defining new functions functions
Intermittent users can retain operational concepts Intermittent users can retain operational concepts over timeover time
Error messages rarely neededError messages rarely needed Users can immediately see if their actions are Users can immediately see if their actions are
furthering their goals and if not do something elsefurthering their goals and if not do something else Users experience less anxietyUsers experience less anxiety Users gain confidence and mastery and feel in controlUsers gain confidence and mastery and feel in control
2020
What are the disadvantages What are the disadvantages with DM?with DM?
Some people take the metaphor of direct Some people take the metaphor of direct manipulation too literallymanipulation too literally
Not all tasks can be described by objects and not Not all tasks can be described by objects and not all actions can be done directlyall actions can be done directly
Some tasks are better achieved through Some tasks are better achieved through delegatingdelegating• e.g. spell checkinge.g. spell checking
Can become screen space ‘gobblers’Can become screen space ‘gobblers’ Moving a mouse around the screen can be slower Moving a mouse around the screen can be slower
than pressing function keys to do same actionsthan pressing function keys to do same actions
2121
ActivityActivity
http://www.vendweb.com/For-Sale-Cohttp://www.vendweb.com/For-Sale-Cold-Drink-Vending-Machines.htmld-Drink-Vending-Machines.htm
What instructions must be issued to What instructions must be issued to obtain a can of soft drink or a bar of obtain a can of soft drink or a bar of chocolate?chocolate?
Which one do you like? Why?Which one do you like? Why? What problems can arise with using What problems can arise with using
them?them?
2222
4. Exploring and browsing4. Exploring and browsing
Similar to how people browse Similar to how people browse information with existing media (e.g. information with existing media (e.g. newspapers, magazines, libraries, newspapers, magazines, libraries, pamphlets)pamphlets)
Information is structured to allow Information is structured to allow flexibility in a way user is able to flexibility in a way user is able to search for informationsearch for information• e.g. multimedia, web e.g. multimedia, web
2323
ActivityActivity
What conceptual models are the What conceptual models are the following applications based on?following applications based on?• A 3-D video gameA 3-D video game• The Windows environmentThe Windows environment• A web serverA web server
1. Direct manipulation/Virtual environment2. DM + Conversing +Exploring3. Instructing + Exploring + browsing
2424
Conceptual models based on Conceptual models based on objectsobjects
Usually based on an analogy with Usually based on an analogy with something in the physical worldsomething in the physical world
Examples include books, tools, Examples include books, tools, vehiclesvehicles
Classic: Star InterfaceClassic: Star Interfacebased on officebased on officeobjectsobjects
Johnson et al (1989)
2525
Another classic: the spreadsheet Another classic: the spreadsheet (Bricklin)(Bricklin)
Analogous to ledger Analogous to ledger sheetsheet
Interactive and Interactive and computationalcomputational
Easy to understandEasy to understand Greatly extending Greatly extending
what accountants what accountants and others could do and others could do
www.bricklin.com/history/refcards.htm
2626
Which conceptual model is Which conceptual model is best?best?
Direct manipulation is good for ‘doing’ types of Direct manipulation is good for ‘doing’ types of tasks, e.g. designing, drawing, flying, driving, tasks, e.g. designing, drawing, flying, driving, sizing windowssizing windows
Issuing instructions is good for repetitive tasks, Issuing instructions is good for repetitive tasks, e.g. spell-checking, file management e.g. spell-checking, file management
Having a conversation is good for children, Having a conversation is good for children, computer-phobic, disabled users and specialised computer-phobic, disabled users and specialised applications (e.g. phone services)applications (e.g. phone services)
Hybrid conceptual models are often employed, Hybrid conceptual models are often employed, where different ways of carrying out the same where different ways of carrying out the same actions is supported at the interface - but can actions is supported at the interface - but can take longer to learntake longer to learn
2727
Interface metaphorsInterface metaphors Interface designed to be similar to a physical Interface designed to be similar to a physical
entity but also has own propertiesentity but also has own properties• e.g. desktop metaphor, web portalse.g. desktop metaphor, web portals
Can be based on activity, object or a combination Can be based on activity, object or a combination of bothof both
Exploit user’s familiar knowledge, helping them to Exploit user’s familiar knowledge, helping them to understand ‘the unfamiliar’ understand ‘the unfamiliar’
Conjures up the essence of the unfamiliar Conjures up the essence of the unfamiliar activity, enabling users to leverage of this to activity, enabling users to leverage of this to understand more aspects of the unfamiliar understand more aspects of the unfamiliar functionalityfunctionality
2828
Benefits of interface metaphorsBenefits of interface metaphors
Makes learning new systems easierMakes learning new systems easier Helps users understand the Helps users understand the
underlying conceptual modelunderlying conceptual model Can be very innovative and enable Can be very innovative and enable
the realm of computers and their the realm of computers and their applications to be made more applications to be made more accessible to a greater diversity of accessible to a greater diversity of usersusers
2929
Problems with interface Problems with interface metaphors metaphors
Break conventional and cultural rulesBreak conventional and cultural rules• e.g. recycle bin placed on desktope.g. recycle bin placed on desktop
Can constrain designers in the way they Can constrain designers in the way they conceptualize a problem spaceconceptualize a problem space
Conflict with design principlesConflict with design principles Forces users to only understand the system in Forces users to only understand the system in
terms of the metaphorterms of the metaphor Designers can inadvertently use bad existing Designers can inadvertently use bad existing
designs and transfer the bad parts overdesigns and transfer the bad parts over Limits designers’ imagination in coming up with Limits designers’ imagination in coming up with
new conceptual modelsnew conceptual models
3030
Conceptual models: from Conceptual models: from interaction mode to styleinteraction mode to style
Interaction mode:Interaction mode: • what the user is doing when interacting with a what the user is doing when interacting with a
system, e.g. instructing, talking, browsing or system, e.g. instructing, talking, browsing or otherother
Interaction style:Interaction style:• the kind of interface used to support the mode, the kind of interface used to support the mode,
e.g. speech, menu-based, gesturee.g. speech, menu-based, gesture
3131
Many kinds of interaction Many kinds of interaction styles available…styles available…
CommandCommand SpeechSpeech Data-entryData-entry Form fill-inForm fill-in QueryQuery GraphicalGraphical WebWeb PenPen Augmented realityAugmented reality Gesture and even...Gesture and even...
3232
Interacting via GPRS enabled Interacting via GPRS enabled cell phone…cell phone…
Drawing an elephant by walking round the streets of a city Drawing an elephant by walking round the streets of a city (or other mode of transport) and entering data points along (or other mode of transport) and entering data points along the way via the cell phone the way via the cell phone
Example:Example: Brighton and Hove(UK) by J. Wood by foot, track Brighton and Hove(UK) by J. Wood by foot, track length 11.2km (see www.gpsdrawing.com for more length 11.2km (see www.gpsdrawing.com for more examples)examples)
GPRS(General Packet Radio Service)GPRS(General Packet Radio Service) http://www.cellular-news.com/gprs/ http://www.cellular-news.com/gprs/
3333
Making art by recording where Making art by recording where walking in a citywalking in a city
3434
Which interaction style to Which interaction style to choose?choose?
Need to determine requirements and user Need to determine requirements and user needsneeds
Take the budget and other constraints into Take the budget and other constraints into accountaccount
Also will depend on suitability of Also will depend on suitability of technology for activity being supported technology for activity being supported
This topic will be covered more later when This topic will be covered more later when discuss how to actually design conceptual discuss how to actually design conceptual modelsmodels
3535
ActivityActivity
Examine the IE Explorer and describe Examine the IE Explorer and describe the various forms of analogy and the various forms of analogy and composite interface metaphors that composite interface metaphors that have been used in its design. have been used in its design.
3636
Interaction paradigmsInteraction paradigms
Another form of inspiration for Another form of inspiration for conceptual modelsconceptual models
From the desktop to ubiquitous From the desktop to ubiquitous computing computing (embedded in the (embedded in the environment)environment)
3737
Examples of new paradigmsExamples of new paradigms Ubiquitous computing (mother of them all)Ubiquitous computing (mother of them all) Pervasive computingPervasive computing Wearable computingWearable computing Tangible bitsTangible bits Augmented realityAugmented reality
• http://www.se.rit.edu/~jrv/research/ar/http://www.se.rit.edu/~jrv/research/ar/
Attentive environmentsAttentive environments• http://www.almaden.ibm.com/software/user/http://www.almaden.ibm.com/software/user/
Attentive_Environments/index.shtmlAttentive_Environments/index.shtml
Transparent computingTransparent computing http://domino.research.ibm.com/comm/http://domino.research.ibm.com/comm/
wwwr_thinkresearch.nsf/pages/coverstory100.htmlwwwr_thinkresearch.nsf/pages/coverstory100.html
and many more….and many more….
3838
Two examples: BlueEyes (IBM) Two examples: BlueEyes (IBM) and Cooltown (HP)and Cooltown (HP)
Visionary approaches for Visionary approaches for developing novel conceptual developing novel conceptual paradigmsparadigms
http://www.almaden.ibm.com/cs/BlueEyes/index.htmlhttp://www.cooltown.com/cooltown/index.asp
3939
Summary pointsSummary points Important to have a good understanding of the Important to have a good understanding of the
problem spaceproblem space Fundamental aspect of interaction design is to Fundamental aspect of interaction design is to
develop a conceptual modeldevelop a conceptual model Interaction modes and interface metaphors Interaction modes and interface metaphors
provide a structure for thinking about which kind provide a structure for thinking about which kind of conceptual model to developof conceptual model to develop
Interaction styles are specific kinds of interfaces Interaction styles are specific kinds of interfaces that are instantiated as part of the conceptual that are instantiated as part of the conceptual modelmodel
Interaction paradigms can also be used to inform Interaction paradigms can also be used to inform the design of the conceptual modelthe design of the conceptual model