document resume ed 352 628 author title pub date · 2014. 4. 9. · document resume ed 352 628 cs...

14
DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing, Analyzing and Presenting Qualitative Data. PUB DATE Dec 92 NOTE 14p.; Paper presented at the Annual Meeting of the National Reading Conference (42nd, San Antonio, TX, December 2-5, 1992). PUB TYPE Speeches/Conference Papers (150) Guides Non- Classroom Use (055) EDRS PRICE MF01/PC01 Plus Postage. DESCRIPTORS *Data Analysis; *Editing; Higher Education; *Hypermedia; Information Sources; *Qualitative Research; Research Methodology; Research Tools IDENTIFIERS *Data Maps; Discourse Communities; EntryWay; Text Design; Text Organization ABSTRACT Making diagrams of the relationships among data is not a new idea: however, the utility of computerized hypertext techniques makes the task more feasible, on a wider scale of data. Data maps using "EntryWay" (a hypertext editing program) were made based on qualitative data from eight different research projects, including: a discourse analysis of 100 postings on an electronic bulletin board; transcripts of interviews with students; transcripts of lessons for preservice teachers on the nature of learning in music classes; transcripts of videotapes of mathematics lessons, and observation notes of preschool children at play. From the eight studies, four specific uses for data maps emerged: (1) as navigational aids; (2) as prompts for further investigation; (3) as demonstrations of relationships; and (4) as cognitive supports. Data maps add a new tool for researchers in the visualization, analysis, and display of their data. (Fifteen figures representing data maps are included.) (RS) *********************************************************************** Reproductions supplied by EDRS are the best that can be made from the original document. ***********************************************************************

Upload: others

Post on 15-Mar-2021

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

DOCUMENT RESUME

ED 352 628 CS 011 126

AUTHOR Horney, MarkTITLE Data Maps: A Hypertext Technique for Visualizing,

Analyzing and Presenting Qualitative Data.PUB DATE Dec 92NOTE 14p.; Paper presented at the Annual Meeting of the

National Reading Conference (42nd, San Antonio, TX,December 2-5, 1992).

PUB TYPE Speeches/Conference Papers (150) GuidesNon- Classroom Use (055)

EDRS PRICE MF01/PC01 Plus Postage.DESCRIPTORS *Data Analysis; *Editing; Higher Education;

*Hypermedia; Information Sources; *QualitativeResearch; Research Methodology; Research Tools

IDENTIFIERS *Data Maps; Discourse Communities; EntryWay; TextDesign; Text Organization

ABSTRACTMaking diagrams of the relationships among data is

not a new idea: however, the utility of computerized hypertexttechniques makes the task more feasible, on a wider scale of data.Data maps using "EntryWay" (a hypertext editing program) were madebased on qualitative data from eight different research projects,including: a discourse analysis of 100 postings on an electronicbulletin board; transcripts of interviews with students; transcriptsof lessons for preservice teachers on the nature of learning in musicclasses; transcripts of videotapes of mathematics lessons, andobservation notes of preschool children at play. From the eightstudies, four specific uses for data maps emerged: (1) asnavigational aids; (2) as prompts for further investigation; (3) asdemonstrations of relationships; and (4) as cognitive supports. Datamaps add a new tool for researchers in the visualization, analysis,and display of their data. (Fifteen figures representing data mapsare included.) (RS)

***********************************************************************

Reproductions supplied by EDRS are the best that can be madefrom the original document.

***********************************************************************

Page 2: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

.3

Data Maps:A Hypertext Technique for

Visualizing, Analyzing and PresentingQualitative Data

bY

Mark Homey215 Education

School of EducationUniversity of OregonEugene, Oregon 97403

Internet: [email protected]

-PERMISSION TO REPRODUCE THISMATERIAL HAS BEEN RANTED BY

TO THE EDUCATIONAL RESOURCESINFORMATION CENTER (ERIC)."

U.S. DEPARTMENT Of EDUCATIONOffice of Educational Research and Improvement

EDUCATIONAL RESOURCES INFORMATIONCENTER (Erna

M4'his document has been reproduced asreceived from the person or organizationoriginating it

CI Minor changes have been made to improvereproduction quality

Points ot yiewor opinions stated in this docu-ment do not necessarily represent officialOERI position or policy

Presented at the National Reading Research ConferenceDecember 2-5, 1992San Antonio, Texas

2

BEST COPY AVAILABLE

Page 3: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

Data Maps: A Hypertext Technique forVisualizing, Analyzing and Presenting Qualitative Data

Mark HomeyUniversity of Oregon

Figure 1 shows a data map. This data map was created with a hypertext editingprogram called Entry Way.

EntryWay Menu BarPull down menus controllingall Entry Way functions.

Map Tokens representingcategories: "Threads"

Map Title

TOPICS Woad be NsV* E-wwill swim.idirbuted among Ow

Map Description Lines denotingcategory membership

Map Tokens representingdata fragments: "Nodes"

Figure 1. Topics Data Map taken from E-Mail

Hypertext documents are written and read using a computer and have three salientcharacteristics distinguishing them from standard, printed documents:

The content of a hypertext document is segmented into discrete elements called"nodes." Nodes can be very small, consisting of only a single word, or verylarge, with many pages of text, or even a whole book. Nodes can containgraphics, diagrams, pictures, and even video dips, as well as text.

Page 4: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

Hypertext nodes are "linked" together by a variety of mechanisms. These linkscan be used to form nodes into semantic networks, or for categorization.

Hypertext readers and authors "navigate" from node to node by followinglinks.

The map in Figure 1 shows categorical relationships among 100 messages posted onan electronic bulletin board. The messages form a discussion about policy issues among16 members of a university faculty. For this map, the messages were categorized by topics.This map is part of a hypertext document, called E-MAIL, created as part of a discourseanalysis of electronic communications.1 E-MAIL contains 100 nodes, each containing oneelectronic message such as the one shown in Figure 2:

Map I Links !Nodes Go .. Ln I

G54MAIN

mtElsom000k

ausamaansais

tlectronic-ou/general 054, d-laurillard, 1206 chars, 25- Oct -90 11:47 This is acomment to message 45 There is /are comment(s) on this message.

I know were a "Napoleonic institution', but I have a natural suspicion of top-downsolutions. Incremental solutions - 'tinkering' - must have a better chance of success.The OU institution IS a collection of talented individuals, and proceeding on many frontshas amassed a lot of overtone* and expertise - I would bet a top -down approach overthe last 5 years would not have produced as much. Apart from anything else,individuals' enthusiasms carry them much further than de pushes from the top.However, we all recognise the down-side to this. Moreover, we know where theproblems tie, in a quite specific way. An incremental approach would target thoseareas we all know to be problematic - external contracts, co-ordination of approachesto the EC etc - and change those. A forum like this, bringing together the expertise andexperience culled from the years of individual endeavour, seems to me like a good wayforward, if we can end up with immediately implementable suggestions forimprovements to the existtng system. Hiving off the experiments to an R14 soundslike ghettoising the developments we all want to see integrated into a normal approachto course productin and presentation.

Figure 2. E-MAIL Message Node

In addition, E-MAIL contains nodes representing a variety of categories, such as thoseshown on the map in Figure 1, which is itself an E-MAIL node. On the map, nodes arerepresented by "tokens." In this map the 100 messages are represented by the boxes downthe diagonal and the topic categories by the words around the map edges (In EntryWaynomenclature such categorical nodes are called "Threads," as in "the thread of an

I More information about EntryWay and its use for qualitative research can be found in "Supporting MultiplePerspectives: Case Studies of Using Hypertext in Qualitative Research" (Homey, 1992), which can be foundin the Proceedings of the Qualitative Research in Education Conference, Athens, Georgia, January 2-5, 1992.

National Reading Conference 1992:Data Maps 2

Page 5: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

argument") The lines drawn from the categories to the messages show which messagesbelong to which categories. Other maps taken from E-MAIL are shown in Figures 3-6:

Figure 3. Distribution of Individual Posting to E-MAIL

National Reading Conference 1992:Data Maps 3

Page 6: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

raPoork

r4Masoos

.mw--..77---.'ZItt\\: 1111%.illkllr-0-441111711P.-A1111111"4741"....

_ - ---:.,%":,. ;1.4,1*a

se............

.

..,,,.

gr Alm:64w1 r rif-ri--r FITh=1;fil 7-,; ---:::PP:f-,..471

...,1--.3.._..,,,.1 r- 1,-. ,.......% \ IP'

rrt--: 44,,, #rif--. is..;;..;,.:-1:-* , ilk

r r- ,

irf- N

AV) ,1 I)

0%1;11

-......-

1lb:111.4F 1 \rr--

arKag

jatEmants ............... I rr--- 4,,a 0,.m.', T0......

-__ A . ... p - . . . . - -- - -- - -..... - -- - - r -r - 4 !

r-rr---.f._-_.,.ffr__Affront.* rri-------,

. nrri

jelMoorrtsfa

*Yates

People Distribution II

Figure 4. Version 2 of Individual Contributions to E-MAIL

I Map I Links 'Nodes' Go I Ullafrastrusture

IfInpefEleftrfaieSIMI Avitesabous014 428 041

I I :015 029 4345

I r416 / N

47I 48 054I

030 037

017 418 43( 44 049 460

460 061 464021 Gil \9

042I 4020 022

083toopDOVN

024I.."4S142$

I s..026 452

427 054

434 032Dflivoorg

033 038 47111

11 Rai1M.dei047

039

DopodisifaMtakowi-

4366

468 070 at G$

I /071 019

MARKET023

043

N4340 457

453

4356 4159 073

CommentMaa462

443

ass

Goo 491

4912

495

0%

097

01

4101

Tfrafs065

06 4679

1

472

Call Mows*010 011 012 413 034 034 440 0104

Elestromietibrarg SCHMUTZER

IontElsorncook

StelfatCoratfronll074

GIS 07$

OutComatry 0103

Figure 6. Map of Reply Relationships From E-MAIL

National Reading Conference 1992:Data Maps 4

Page 7: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

The Comment Map shown in Figure 5 is somewhat different than the others. Herethe 100 messages, labeled G10 to G110, are related one to another by "binary links" ratherthan categorical associations. Binary links represent semantic relationships. In this casethe links show how the messages were entered as replies to one another. For instance,the cluster of nodes in the upper left corner are the nodes of the "Infrastructure" thread.This topic was initiated in message G14. Message G15 was entered as a reply to G14, andwas in turn commented upon by message G16. There were two replies to G16, and so on.This map thus shows the message reply structure of each conversational topic.

National Reading Conference 1992:Data Maps

Page 8: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

Examples of Data Maps

To date, seven different educational researchers and graduate students have madedata maps using Entry Way. Examples of these maps are found below following a briefdescription of the associated research projects and hypertext documents.

E-MAIL Discourse analysis of 100 postings to an electronic bulletinboard. Messages entered by university faculty membersdiscussing policy issues. Analysis targeted on examining thecharacteristics of computer-mediated communicationamong teachers and students involved in Distance Learning

RETELL Transcript of interview with two student, Clint and Sue.Students are responding to questions regarding the plot,setting, and characters a short story read in electronic form.Transcript analyzed for reading comprehension.

ASSESSMENT Transcripts of 22 students reflecting on their first experienceas clinical speech pathologists. Transcripts analyzed to showstudent pre-dispositions towards positivist andconstructionist teaching styles.

CONCEPTS Transcript of lesson for pre-service teachers on the nature oflearning in music classes. Transcript analyzed to illustrateconcept development.

COLLOQUIUM Transcripts interviews with eight teachers on the topic ofmid-life changes. Transcript elements categorized accordingto teacher needs, administrative perceptions, and copingmechanisms.

GEOFF Transcript of interview with gifted Transcriptelements categorized on the student's likes, dislikes,strengths, and weaknesses in various content areas inpreparation of an Individualized Educational Program (IEP).

MATH LESSONS Transcripts of video tapes of two mathematics lessons.Transcript elements categorized by lesson content, activitytype, and questioning strategies used by the instructor.Analysis directed toward identifying relationships betweenquestioning techniques and activity structures.

PLAY Observation notes of pre-school children at play in a daycare facility. Analysis focused on the development ofspontaneous collaboration in a self-directed play context.

National Reading Conference 1992:Data Maps o 6

Page 9: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

T? F? OViews Define Picture

Covet

Echo

Cf act

Clint CodesFal se

Pf aPeval

ct

Seval

Sf act

Done

Dont Know

Predict

Monitor

Purpose

Knowledge

Figure 6. Coding of Clint Nodes from RETELL

Done

T? F? OViews Define Picture Echo

Ceval

Cfact

Sue CodesFalse

Peval

Seval

Sf act

Predict

Monitor

Purpose

Knowledge

Figure 7. Coding of Sue Nodes from RETELL

National Reading Conference 1992:Data Maps

Page 10: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

Mare *isTuplesTempl a te netts 1

Wham,INIstylotvattett

UtvevetteMHO*

OS Comfits.*** [slutitlauftait

LfactivityLataatWOOttealarCtilissric

LfiaNllLasovettMaio

MidstCS Amy

Linen

ItasotlairilvaliPtriwa

CSIlebitavInattottli

IL Mho* J MMus IRPM..

LC,ti.I

tE elICilwItittracyravioli

Mystic111 EaMsol

SCiatell

likaapett

ilitusetOfriitt

OfectivityIntim

trageac051mhilma

DIPIstaa I DCVO'Damp 11

Davits*111Ccaothir

IlamotDaviovevt

111Cpttseas

locriblaDa howl

DCVsocliPoyeas*activity

IllthapvecDC14*Mma

tCcoovestitClionvLOAM

11414/105

Figure 8. All Coding Categories From ASSESSMENT

Bmap

Dearpolde

Wan Ms

rSetiol

ii w503

1.41

806

Boz

yVV

B09

810

811

B12

Ltatlost

[Sarno

ttarellio

Laspvort

ttanwl

ttliterscy

tayatesICilbsamt

Commeeel

gain"

acmoret

Figure 9. Coding for Subject "B" From ASSESSMENT

National Reading Conference 1992:Data Maps iii 8

Page 11: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

Concept Development

Figure 10. All Coding of Transcript from CONCEPTS

Figure 11. Coding for Administrative Perceptions from COLLOQUIUM

National Reading Conference 1992:Data Maps

11

9

Page 12: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

Figure 12. Questions vs Activity Structures of Lesson A from LESSONS

Figure 13. Questions vs Activity Structures of Lesson B from LESSONS

National Reading Conference 1992:Data Maps 1210

Page 13: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

Description

Strengths

This thread refers to whatGeoff believes are hisstrengths.

8061

egglirleat

Figure 14. Coding of Strengths from GEOFF

Spaceshipsdirect

entailer

"VE0065\ 6066

1306,78068

806900610,y.1111101301, 906111 00612

00613twEvaluste 8.614

0061580616

RIGHT

web seniMete SIM -Ace

losS01.0

Figure 15. Coding of "Spaceship" Episode front PLAY

National Reading Conference 1992:Data Maps

:3

11

Page 14: DOCUMENT RESUME ED 352 628 AUTHOR TITLE PUB DATE · 2014. 4. 9. · DOCUMENT RESUME ED 352 628 CS 011 126 AUTHOR Horney, Mark TITLE Data Maps: A Hypertext Technique for Visualizing,

Uses of Data MapsFrom these eight studies four specific uses for data maps have emerged:

As navigational aidsTo prompts to further investigationTo demonstrations of relationshipsAs cognitive supports

Figure 5 captures a map in use as a navigational lid. A reader is shown selecting the"GOTO" option from a menu which appears whenever a map token i& clicked by thecursor. In this way, researchers can move about their data, finding and reading relevantdata. If a print out of the data nodes is made that includes the node titles, then maps canalso assist manual forms information retrieval.

Data maps create a visual image of categorical relationships that might otherwise gounnoticed. For instance Figure 11 suggests a contradiction in teachers ideas about theiradministrators. The coding represented on this map show teachers making manynegative comments about school administrators (categories "Impossible," "Do Nothing,"and "TreatDiff'), but yet also report trusting administrators. This clue about teacherattitudes was overlooked until made explicit by the map. Similarly, after looking atFigure 13, the researcher realized that her two categories ASwar(mup), and ASrevie(w),were so close in their definitions, as actually used during coding, that they should bemerged. Maps can also point out areas where data analysis might need to be re-conceptualized. For example, after looking at the 22 maps like those shown in Figures 8and 9, the researcher realized that her basic coding strategy was not extracting theinformation she expected and in6tead pointed to a different set of categories. In theseways data maps lead researchers into deeper and alternative investigations of their data.Some maps can serve as demonstrations of particular points researchers wish to makeabout their data. The maps in Figures 12 and 13 were used to demonstrate that this mathteacher was well organized (i.e. classroom activities succeeded one another in an orderlypattern, with few entanglements caused by moving back and forth between differenttypes of activity) and ask a wide variety of questions throughout all phases of the lesson.Figures 6 and 7 demonstrate the differences between two students' reaction to a story.Clint was frustrated by the assignment and repeatedly during the interview stated that hewas "Done" with the reading assignment, even though he responded "Don't Know" tomost questions about the story, and frequently asked if the interview was "Finished."S' 'e, on the other hand, was able to supply a wide variety information about what shehad read.

The last use for data maps is encapsulated in the aphorism "Making a map is betterthan having a map." It appears that map making gives researchers the opportunity toquietly consider their data as they add and remove nodes, move tokens from place toplace, draw and erase link and inclusion lines, and by literally untangling relationshipsduring the creation of coherent displays. The result of this contemplation maybe newinsights into the data and its implications.

Making diagrams of the relationships among data is not a new idea. However, theutility of computerized hypertext techniques make the task more feasible, on a widerscale of data. This adds a new tool for researchers in the visualization, analysis anddisplay of their data.

National Reading Conference 1992:Data Maps 12

4