msr data mountain using spatial memory for data management written by: george roberston, mary...

MSR Data MountainMSR Data Mountain

Using Spatial Memory for Data Using Spatial Memory for Data ManagementManagement

Written by: George Roberston, Mary Czerwinski, Kevin Larson, Daniel C. Robbins, David Thiel, and Maarten van Dantzich

Presentation by: Krishnan Ram

Capstone Fall 2004

Key QuestionsKey Questions

What is Spatial Cognition?What is Spatial Cognition?

What is the Data Mountain?What is the Data Mountain?

How does the Data Mountain work?How does the Data Mountain work?

How have users responded to the Data How have users responded to the Data Mountain concept?Mountain concept?

What can this idea contribute to the What can this idea contribute to the Capstone project?Capstone project?

Real-World Spatial CognitionReal-World Spatial Cognition

Can be thought as how we perceive Can be thought as how we perceive objects in space and their relationships to objects in space and their relationships to one anotherone another

ExamplesExamples Remembering where we left our glassesRemembering where we left our glasses Distinguishing our current body orientation Distinguishing our current body orientation

with respect to the environment.with respect to the environment. What do I need to do to get where I need to What do I need to do to get where I need to

go?go?

Krishnan Ram

Some theories of spatial cognition say we perform certain tasks such as how to get to the local store by creating an internal representation of the outside world. We use the relationships between different objects to aide in finding our way or to accomplish the task at hand. For example, on the way to the local store, turn down the street after the barbershop.This is an example of using certain visual cues to help us navigate.

Spatial Cognition in a Virtual Spatial Cognition in a Virtual SettingSetting

Can 3D Human Spatial Cognition be Can 3D Human Spatial Cognition be applied in a virtual environment?applied in a virtual environment?

Spatial Cognition in a Virtual Spatial Cognition in a Virtual SettingSetting

Can 3D Human Spatial Cognition be Can 3D Human Spatial Cognition be applied in a virtual environment?applied in a virtual environment?

The answer is yes. Research has shown The answer is yes. Research has shown that adding borders, paths, directional that adding borders, paths, directional cues, and audio cues make navigating 3D cues, and audio cues make navigating 3D space easier.space easier.

This concept can be applied to Document This concept can be applied to Document Management Systems.Management Systems.

A DMS is a workspace or environment A DMS is a workspace or environment where one can manipulate and view where one can manipulate and view multiple documents in a common space.multiple documents in a common space.

Document Management Systems

Document Management SystemsDocument Management Systems

2-Dimensional2-Dimensional Windows ExplorerWindows Explorer IE FavoritesIE Favorites

3-Dimensional3-Dimensional Web ForagerWeb Forager Xerox PARC Information Visualizer Xerox PARC Information Visualizer

Krishnan Ram

Examples of 2D systems- Microsoft Windows My Documents folder.

Example of 2D System:Example of 2D System:Windows ExplorerWindows Explorer

Example of 3D System:Example of 3D System:Web ForagerWeb Forager

Data MountainData Mountain

What is the Data Mountain project?What is the Data Mountain project?

Data MountainData Mountain

What is the Data Mountain project?What is the Data Mountain project? It is a Document Management System that It is a Document Management System that

uses a 3D virtualized environment with a 2D uses a 3D virtualized environment with a 2D interaction scheme.interaction scheme.

3D perception used to maximize amount 3D perception used to maximize amount of documents represented (due to 3D of documents represented (due to 3D space) with minimum cognitive load.space) with minimum cognitive load.

Reducing Cognitive LoadReducing Cognitive Load

Our pre-attentive ability to recognize Our pre-attentive ability to recognize spatial relationships based on simple spatial relationships based on simple depth cues (occlusion, perspective views) depth cues (occlusion, perspective views) makes it possible to place documents at a makes it possible to place documents at a distance (thus reducing space used on distance (thus reducing space used on desktop) without consciously thinking desktop) without consciously thinking about it. about it.

Reducing Cognitive LoadReducing Cognitive Load

We judge many spatial relationships in the We judge many spatial relationships in the real world without implicitly thinking about real world without implicitly thinking about it.it.Creating a virtual 3D world can allow us to Creating a virtual 3D world can allow us to utilize implicit cognition to help identify utilize implicit cognition to help identify where documents were placed.where documents were placed.We often remember the approximate We often remember the approximate position of where we last placed position of where we last placed something.something.

DescriptionDescription

Documents can be placed in any arbitrary Documents can be placed in any arbitrary position on an inclined plane (hence the name position on an inclined plane (hence the name Data “Mountain”) with a simple interaction tool Data “Mountain”) with a simple interaction tool such as the mouse.such as the mouse.Documents appear in thumbnail views on the Documents appear in thumbnail views on the plane.plane.User has complete control where they place a User has complete control where they place a document.document.One fixed viewpoint.One fixed viewpoint.Increase amount of data in viewing field by Increase amount of data in viewing field by making it 3D.making it 3D.

DescriptionDescription

The current Data Mountain prototype is The current Data Mountain prototype is being used and tested as an alternative to being used and tested as an alternative to the Favorites feature in Microsoft’s Internet the Favorites feature in Microsoft’s Internet Explorer. Explorer.

Internet ExplorerInternet Explorer

IE uses a 2D DMS to keep track of a IE uses a 2D DMS to keep track of a user’s favorites internet websites.user’s favorites internet websites.

Each site is shown as purely text, Each site is shown as purely text, displaying the URL or title of the website.displaying the URL or title of the website.

Favorites can be grouped into a hierarchy Favorites can be grouped into a hierarchy depending on the user’s preference.depending on the user’s preference.

Data Mountain FeaturesData Mountain Features

Favorite websites are stored as thumbnail Favorite websites are stored as thumbnail images.images.

The thumbnails can be placed anywhere The thumbnails can be placed anywhere on the Data Mountain using the mouse.on the Data Mountain using the mouse.

Grouping is done by location.Grouping is done by location.

Title of page is shown as a pop up when Title of page is shown as a pop up when mouse hovers over it.mouse hovers over it.

Page Avoidance Behavior (explained later)Page Avoidance Behavior (explained later)

View of Data Mountain DesktopView of Data Mountain Desktop

With 100 Websites

Sensory Cues Aiding in Spatial CognitionSensory Cues Aiding in Spatial Cognition

Visual CuesVisual Cues Perspective viewsPerspective views OcclusionOcclusion Landmarks on the planar surfaceLandmarks on the planar surface Shadows cast by thumbnailsShadows cast by thumbnails

Auditory CuesAuditory Cues Dynamic sound effectsDynamic sound effects

Krishnan Ram

There are many sensory cues used in the Data mountain that aide in spatial cognition. Visual cues such as persective views, occlusion, shadows and landmarks on the planar surface help faccilitate depth perception. Auditory cues supplement these visual cues. the auditory cues are dynamic, for example when moving a thumbnail the sound will either speed up or slow down depending on how fast you move the mouse. Also spatial location is indicated by the volume of the sound. that is, the louder the sound the closer the page is to the base of the mountain.

Data Mountain InteractionData Mountain InteractionDocuments stored as thumbnail icons on 3D Documents stored as thumbnail icons on 3D plane.plane.

When a thumbnail is clicked the document When a thumbnail is clicked the document moved into the preferred viewing positionmoved into the preferred viewing position

Krishnan Ram

As i said before the user uses their mouse to move the thumbnails aroudn the mountain. when they wish to view a thumbnail, they click on the specific thumbnail and it is moved into the preferred viewing postition. to return the page to thumbnail view you just click on it again.

Data Mountain InteractionData Mountain Interaction

To aide in searching, pop ups of the title of To aide in searching, pop ups of the title of each thumbnail are shown whenever the each thumbnail are shown whenever the mouse passes over themmouse passes over them

Pop ups are instantaneous (no delay) and Pop ups are instantaneous (no delay) and a halo is outlined around the thumbnail it a halo is outlined around the thumbnail it refers torefers to

Thumbnails are moved around by simply Thumbnails are moved around by simply dragging them with the mousedragging them with the mouse

Movement: Page Avoidance BehaviorMovement: Page Avoidance Behavior

What happens to the other pages when What happens to the other pages when you move a thumbnail through their you move a thumbnail through their common space?common space?

Movement: Page Avoidance BehaviorMovement: Page Avoidance Behavior

What happens to the other pages when What happens to the other pages when you move a thumbnail through their you move a thumbnail through their common space (collisions)?common space (collisions)?

Three design methods exploredThree design methods explored Do nothingDo nothing ‘‘Tall Grass’ SimulationTall Grass’ Simulation Page Avoidance BehaviorPage Avoidance Behavior

Krishnan Ram

one important concept that came up during the design of the data mountian. what happens when you move a thumbnail through locations on the the mountain that are occupied with other pages. basically it is a question of what do you do about collisions. there where three designs that the Microsoft research team explored, the first was simply to do nothing and allow pages to pass right over one another. this had some problems because it was easy to place documents right on top of each other making it difficult to read. also it gave a lifeless feeling to the desktop. the second method explored was the 'tall grass' simulation which if you think about what happens when you walk through tall grass and as you pass the grass is pushed aside and when u pass by the grass returns to is original position. this also had some problems because you could still place the thumbnail in a apparently vacant position but when the other pages move back to their location they can be blocked.the third method is called the page avoidance behavior. here a minimun distance between two pages is held fixed and as you move through other pages they are displaced accordingly to make room for the new thumbnail. this prevents two pages from being placed in the same position and you see the end result of a drag as soon as u stop moving the thumbnail. the only problem is, that in a densly populated area the displacement of pages can be quite widespread.

User StudyUser Study

A user study was conducted to determine A user study was conducted to determine the effectiveness of the Data Mountainthe effectiveness of the Data Mountain

The study compared the Internet The study compared the Internet Explorer’s Favorites mechanism and the Explorer’s Favorites mechanism and the Data Mountain’s document management Data Mountain’s document management systemsystem

MethodMethod

Thirty-two IE users were separated into 3 Thirty-two IE users were separated into 3 groupsgroups Group 1:Stored & retrieved web pages using Group 1:Stored & retrieved web pages using

IE FavoritesIE Favorites Group 2: Stored & retrieved web pages using Group 2: Stored & retrieved web pages using

Data Mountain (version 1)Data Mountain (version 1) Group 3: Stored & retrieved web pages using Group 3: Stored & retrieved web pages using

Data Mountain (version 2)Data Mountain (version 2)

Krishnan Ram

32 Experienced IE users (age 18-50) were screened adn then randomly separted into 3 groups. the first stored and retrieved web pages using Internet exploers favorites mechanism. the second used a earlier version of the data mountain which didnt have the page avoidance behavior and pop up titles. the third used the latest version of the data mountain with all the features i just mentioned.

MethodMethod

Each participant were told to store 100 Each participant were told to store 100 web pages in any organizational structure web pages in any organizational structure they wanted using IE Favorites, DM1 or they wanted using IE Favorites, DM1 or DM2 (depending on their group)DM2 (depending on their group)Then participants were shown 1 of 4 Then participants were shown 1 of 4 different retrieval cues and asked to find different retrieval cues and asked to find the corresponding website within a 2 min the corresponding website within a 2 min period.period.25 trials for each cuing condition.25 trials for each cuing condition.

ResultsResults

Four main variables measuredFour main variables measured Reaction time: Amount of time taken to Reaction time: Amount of time taken to

retrieve websiteretrieve website Incorrect Retrievals: Number of incorrect Incorrect Retrievals: Number of incorrect

pages selected before finding the correct onepages selected before finding the correct one Failed attempts: Participant went over 2 minsFailed attempts: Participant went over 2 mins Participants Ratings of softwareParticipants Ratings of software

Retrieval CuesRetrieval Cues

Title Title, Summary, & Thumbnail

Summary Thumbnail

Bezerk - The Free Online Entertainment Network

Bezerk - The Free Online Entertainment Network

The new, FREE premier online entertainment network features YOU DON'T KNOW JACK the netshow, the online version of the irreverent quiz show party game CD-ROM!

The new, FREE premier online entertainment network features YOU DON'T KNOW JACK the netshow, the online version of the irreverent quiz show party game CD-ROM!

ResultsResultsData Mountain v. IE4: Reaction Time

0

2

4

6

8

10

12

14

16

18

20

All Summary Thumbnail Title

Retrieval Cue

Rea

ctio

n T

ime

(in

sec

on

ds)

IE4

DM 1

DM 2

ResultsResultsData Mountain v. IE4: Incorrect Retrievals

0.00

2.00

4.00

6.00

8.00

10.00

12.00

14.00

16.00


Retrieval Cue

Nu

mb

er o

f In

corr

ect

Ret

riev

als

IE4

DM 1

DM 2

ResultsResultsData Mountain v. IE4: Failed Attempts

0

2

4

6

8

10

12

14


Retrieval Cues

Nu

mb

er

of

Fail

ed

Att

em

pts

IE4

DM 1

DM 2

ResultsResults

Questionnaire Item IE4 First Data Mount

ain

Second Data Mountai

n

I like the software. 3.4 (1.0) 3.3 (1.2) 3.7 (0.7)

The software is efficient. 3.6 (1.1) 2.9 (1.2) 3.3 (0.8)

The software is easy to use. 3.6 (1.1) 4.0 (0.9) 4.0 (1.1)

The software feels familiar. 4.0 (0.7) 3.3 (1.2) 3.4 (1.2)

It is easy to find the page I am looking for with the software.

3.4 (1.0) 3.3 (1.0) 3.4 (1.0)

Organizing web pages is easy with the software. 3.4 (1.1) 3.7 (1.1) 3.8 (0.8)

If I came back a month from now I would be still be able to find many of these web pages.

3.2 (0.8) 4.1 (0.6) 3.6 (1.3)

I was satisfied with my organization scheme. 3.2 (1.2) 3.4 (0.8) 3.1 (1.2)

My organizing scheme was very similar to the organization in my home Favorites folder.

3.9 (1.5) 3.6 (1.4) 3.4 (1.6)

Scale: 1-Disagree 5- Agree

ConclusionConclusion

It is apparent that spatial memory playing It is apparent that spatial memory playing a significant role in 3D virtual a significant role in 3D virtual environments.environments.

The incorporation of multiple sensory cues The incorporation of multiple sensory cues in the Data Mountain increased the in the Data Mountain increased the reaction time and decreased the number reaction time and decreased the number of failed attempts and incorrect retrievals.of failed attempts and incorrect retrievals.

Contributions to the CapstoneContributions to the Capstone

In the Virtualized Classroom project the In the Virtualized Classroom project the individual items (videostream, audio individual items (videostream, audio control, slides, Mimio, instructor) should be control, slides, Mimio, instructor) should be customizable so the student can place customizable so the student can place them in such a position that is familiar to them in such a position that is familiar to them and so reduce the cognitive load by them and so reduce the cognitive load by using implicit spatial memory cues.using implicit spatial memory cues.

Krishnan Ram

By using spatial memory.

Contributions to the CapstoneContributions to the Capstone

In the Augmented New York project, In the Augmented New York project, virtualized spatial memory plays a large virtualized spatial memory plays a large role. The virtualized city and the real city role. The virtualized city and the real city must have some common spatial features must have some common spatial features so that the user can easily distinguish so that the user can easily distinguish where they are and find where they want where they are and find where they want to go. to go.