Leonardo's Laptop: Leonardo's Laptop: Human Needs and the New ComputingHuman Needs and the New Computing

Ben Shneiderman Ben Shneiderman (ben@cs.umd.edu)(ben@cs.umd.edu)

Founding Director (1983-2000), Human-Computer Interaction Laboratory Founding Director (1983-2000), Human-Computer Interaction Laboratory Professor, Department of Computer ScienceProfessor, Department of Computer Science

Member, Institutes for Advanced Computer Studies &Member, Institutes for Advanced Computer Studies &Systems ResearchSystems Research

University of MarylandUniversity of Marylandben@cs.umd.eduben@cs.umd.edu

Human-Computer Interaction Laboratory

Interdisciplinary research community - Computer Science & Psychology - Information Studies & Education (www.cs.umd.edu/hcil)

Scientific ApproachScientific Approach (beyond user friendly)(beyond user friendly)

• Specify users and tasksSpecify users and tasks• Predict and measurePredict and measure

time to learntime to learn speed of performancespeed of performance rate of human errorsrate of human errors human retention over timehuman retention over time

• Assess subjective satisfactionAssess subjective satisfaction (Questionnaire for User Interface Satisfaction)(Questionnaire for User Interface Satisfaction)

• Accommodate individual differencesAccommodate individual differences• Consider social, organizational & cultural contextConsider social, organizational & cultural context

Design IssuesDesign Issues

• Input devices & strategies Keyboards, pointing devices, voice Direct manipulation Menus, forms, commands

• Output devices & formats Screens, windows, color, sound Text, tables, graphics Instructions, messages, help

• Collaboration & communities• Manuals, tutorials, training

www.awl.com/DTUI usableweb.com hcibib.org useit.com

Library of CongressLibrary of Congress

• Scholars, Journalists, CitizensScholars, Journalists, Citizens

• Teachers, StudentsTeachers, Students

Visible Human Explorer (NLM)Visible Human Explorer (NLM)

• DoctorsDoctors

• SurgeonsSurgeons

• ResearchersResearchers

• StudentsStudents

NASA Environmental DataNASA Environmental Data

• ScientistsScientists

• FarmersFarmers

• Land plannersLand planners

• StudentsStudents

Bureau of CensusBureau of Census

• Economists, Policy Economists, Policy makers, Journalistsmakers, Journalists

• Teachers, StudentsTeachers, Students

NSF Digital Government InitiativeNSF Digital Government Initiative

• Find what you needFind what you need• Understand what you FindUnderstand what you Find

UMd & UNC

www.ils.unc.edu/govstat/

Information VisualizationInformation Visualization

The eye…

the window of the soul,

is the principal means

by which the central sense

can most completely and

abundantly appreciate

the infinite works of nature.

Leonardo da Vinci (1452 - 1519)

Information Visualization: Using Vision to Think Information Visualization: Using Vision to Think

• Visual bandwidth is enormous Human perceptual skills are remarkable

Trend, cluster, gap, outlier... Color, size, shape, proximity...

Human image storage is fast and vast

• Opportunities Spatial layouts & coordination Information visualization Scientific visualization & simulation Telepresence & augmented reality Virtual environments

Treemap - Stock market, clustered by industryTreemap - Stock market, clustered by industry

Current Research - TimeSearcherCurrent Research - TimeSearcher

• Time series Stocks Weather Genes

• User-specified patterns

• Rapid search

Leonardo’s LaptopLeonardo’s Laptop

The old computing is about what computers can do,

The New Computing is about what people can do

mitpress.mit.edu/leonardoslaptop

www.cs.umd.edu/hcil/newcomputing

An Inspirational Muse:An Inspirational Muse: Leonardo da Vinci (1452-1519) Leonardo da Vinci (1452-1519)

Renaissance Man• Combined Combined

science & art science & art• Integrated Integrated

engineering & esthetics engineering & esthetics• Balanced Balanced

technology advances technology advances & human values & human values

• Merged Merged visionary & practical visionary & practical

Mona LisaMona Lisa

Lady with Ermine & Leda with SwanLady with Ermine & Leda with Swan

Remarkable Drawing SkillRemarkable Drawing Skill

Faces of Old MenFaces of Old Men

Anatomical DrawingsAnatomical Drawings

Machine Gun and Giant CrossbowMachine Gun and Giant Crossbow

Why Leonardo Inspires UsWhy Leonardo Inspires Us

He integrated - Scientific outlook - Practical technology - Artistic skill

Goals for The New ComputingGoals for The New Computing

1) Usable: Reliable& comprehensible

2) Universal: Diverse users & varied equipment

3) Useful: In harmony with human needs

1) Usable: Ending User Frustration 1) Usable: Ending User Frustration

• Goal - make computer usage less frustrating• Identify top ten frustrations • Measure severity & frequency in lost time• Determine if the situation is improving

• Related areas • Errors• Time delays• Emotional reactions

1) Frequent frustrating experiences1) Frequent frustrating experiences

Networking & WebNetworking & Web

Application & System CrashesApplication & System Crashes

1) Frequent frustrating experiences1) Frequent frustrating experiences

1) Time diary study1) Time diary study

Self reports & observations (64 UMD & 47 Towson)• Pre-session survey:

• demographic information• computer experience and attitudes• level of computer anxiety, mood

• Users spent 1 hour & report their frustrating experiences• Post-session survey:

• assess mood after the session• overall frustration level• loss of time

Florida Institute of Technology (Florida Institute of Technology (e3.se.fit.edu:5335/ufse3.se.fit.edu:5335/ufs))

1) Results1) Results

Frustration scale

0

10

20

30

40

50

60

70

80

90

100

1 2 3 4 5 6 7 8 9

Internet Applications Operating Systemtimed out/dropped/refused connections (32)

error messages (35) crashes (16)

long download time (23) freezes (24) wrong response (10)

web page/site not found (17) missing/ hard to find features (23)

slow response (8)

email (15) crashes (13) unexpected message boxes (6)

1) Minutes lost – UMD & Towson1) Minutes lost – UMD & Towson

EmailOSWeb browsingOther minutes lostProductive minutes

Total minutes: 9485

7968

Total minutes lost: 4250

3652

1513

568UMD

Towson 353294

902 877

1) Next Steps1) Next Steps

• Validate results with other users• professional • elderly• novice

• Develop more precise monitoring software e.g. www.bugtoaster.com

• Explore ways to improve:• Online help & help desks• Customer service & online communities• Education & training• Software & interface re-design

2) Universal: Digital Divide Remains Troubling2) Universal: Digital Divide Remains Troubling

 

U.S. Department of Commercewww.ntia.doc.gov/ntiahome/dn/

0

10

20

30

40

50

60

70

80

90

100

Less ThanHigh School

High SchoolDiploma / GED

Some College BachelorsDegree

BeyondBachelors

Degree

Perc

ent

Sept. 2001

Aug. 2000

Dec. 1998

Oct. 1997

Percent of Internet Use by Educational Attainment

2) Universal Usability in Practice2) Universal Usability in Practice

www.otal.umd.edu/uupractice/

• User diversity: Accommodate users with different skills, knowledge, age, gender, disabilities, disabling conditions (mobility, injury, noise, sunlight), literacy, culture, income, etc.

• Technology variety: Support broad range of hardware, software, and network access

• Gaps in user knowledge: Bridge the gap between what users know and what they need to know

Communications of the ACM, May 2000

2) Universal: Diverse Users & Varied Equipment2) Universal: Diverse Users & Varied Equipment

3) Useful: Generative Theories3) Useful: Generative Theories

Predictive & explanatory theories are useful, but the big step forward will be generative theories

Theories of human needs to guide our invention of new technologies

• Jefferson: Life, Liberty & the Pursuit of Happiness

• Roosevelt: Freedom of speech & expression, religion, from want, from fear

• Maslow: Hierarchy of human needs• Physiological

• Safety

• Love

• Esteem

• Self-Actualization

• Covey: Living, Loving, Learning & Leaving a legacy

3) Theories of Human Needs3) Theories of Human Needs

Relationships• Self: working on your own

• Family & Friends: 2-50 close intimates • Colleagues & Neighbors: 50-5000 acquaintances • Citizens & Markets: 5000 and more

 

3) Human Needs 3) Human Needs forfor Relationships Relationships

Activities

• Collect: Information

• Relate: Communication

• Create: Innovation

• Donate: Dissemination

3) Human Needs for Activities3) Human Needs for Activities

3) Activities and Relationship Table (ART)3) Activities and Relationship Table (ART)

Relationships Relationships

SelfSelf

Family & FriendsFamily & Friends

  

Colleagues & NeighborsColleagues & Neighbors

    

Citizenry & MarketsCitizenry & Markets

  

Activities

Collect Relate Create Donate

Skeptics corner - Are relationships more complex?

- Are these useful activities?

Activities and Relationship Table (ART)Activities and Relationship Table (ART)

Relationships

Self

Family & Friends

 

Colleagues & Neighbors

  

Citizenry & Markets

 

Activities

Collect Relate Create Donate

IdenticamIdenticam PhotoDiaryPhotoDiary

PhotoFinderPhotoFinder

PhotoMesaPhotoMesa

AlbumAlbum sharing sharing

StoryStarterStoryStarter Family Family photo photo history history

PhotoFinderPhotoFinder Kiosk Kiosk

PhotoWallPhotoWall

PhotoFinderPhotoFinder Webstarter Webstarter

PhotoQuiltPhotoQuilt PhotoPhoto sharing sharing

Activities and Relationship Table (ART)Activities and Relationship Table (ART)

Relationships

Self

Family & Friends

 

Colleagues & Neighbors

  

Citizenry & Markets

 

Activities

Collect Relate Create Donate

Medical logMedical log DiaryDiary

Find-a- Find-a- Friend Friend

MusicListsMusicLists Family Family vacation vacation history history

InfoDoorsInfoDoors

GatherEmailGatherEmail

Send-a-LinkSend-a-Link

WebBushesWebBushes

WorldWideWorldWide Med Med

Million Million person person communitiescommunities

MedicalMedical diagnosis diagnosis

TouristTourist sharing sharing

3) Future Directions3) Future Directions

• E-learning: The new education

• E-business: The new commerce

• E-healthcare: The new medicine

• E-government: The new politics

• Mega-creativity

• Grander Goals & The Next Leonardowww.cs.umd.edu/hcil/newcomputing

• Action Items• Developers: Apply usability guidelines

& testing methods• Web producers: Develop UU statements• Managers: Provide responsible leadership• Journalists: Raise public expectations• Policy makers: Raise & clarify requirements• Funders: Expand research on usability• Educators: Disseminate scientific results • Researchers: Explore bold new visions

Getting to the Golden Age of UsabilityGetting to the Golden Age of Usability

Leonardo da Vinci (1452-1519)Leonardo da Vinci (1452-1519)

Three lessons

1) Usable: Reliable&

comprehensible

2) Universal: Diverse users & varied equipment

3) Useful: In harmony with human needs

Human-Computer Interaction Laboratory20th Anniversary – May 29-30, 2003

www.cs.umd.edu/hcil

The old computing is about what computers can do,

The New Computing is about what people can do

ACM Code of EthicsACM Code of Ethics

In a fair society, all individuals would have equal opportunity to participate in, or benefit from, the use of computer resources regardless of race, sex, religion, age, disability, national origin or other such similar factors.

1) Results1) Results

• Frustrating experiences: 228 145• Top problem sources:

• web browsing• email• system (OS)• word processing• other internet use• video/audio software• chat and instant messaging

• Top 3 approaches • knew how to solve • unable to solve• figured out

• file browsers• programming tools• spreadsheet programs• graphic design programs• presentation software• database programs• hardware

• Bottom 3 approaches• consulted manual/book• consulted online help• restarted the program

UMD Towson

• Universal Usability Statement• Browser Requirements • Basic System Requirements • Input Devices• Display• Audio/Video• Network Connection• Access for users with disabilities• Diverse Users • User support • Contact Information

 

www.universalusability.org

2) Universal: Diverse Users & Varied Equipment2) Universal: Diverse Users & Varied Equipment