authentic assessment - electronic portfolioselectronicportfolios.org/portfolios/hawaii2007.pdf ·...

11

Click here to load reader

Upload: buithuy

Post on 04-Jun-2018

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Authentic Assessment - Electronic Portfolioselectronicportfolios.org/portfolios/Hawaii2007.pdf · Electronic Portfolios and Digital Storytelling ... Summative Assessment FOR Learning

1

Voice and Interactivity inePortfolios:

Digital Stories and Web 2.0

Helen C. Barrett, Ph.D.

Researcher and ConsultantElectronic Portfolios and Digital Storytelling

for Lifelong and Life Wide Learning

Based on 2 papers inProceedings

• Authentic Assessment withElectronic Portfolios using CommonSoftware and Web 2.0 Tools– http://electronicportfolios.org/web20.html

• Purposes of Digital Stories inePortfolios– http://electronicportfolios.org/digistory/purposes.html

What is a Portfolio?

• A purposeful collection of work thatdemonstrates efforts, progress andachievement in one or more areas[over time]

• Multiple purposes

– Learning/Process

– Assessment/Accountability

– Marketing/Employment

An electronic portfolio provides anenvironment where students can:

• collect their work in a digital archive

• select specific pieces of work (hyperlink toartifacts) to highlight specific achievements

• reflect on the learning demonstrated in theportfolio, in either text or multimedia form

• set goals for future learning (or direction) toimprove

• celebrate achievement through sharing thiswork with an audience, whether real orvirtual

Purposes for Assessment

Assessment OF

Learning=

SummativeAssessment

Assessment FORLearning

=

Formative(Classroom-based)

Assessment

Authentic Assessment• where students generate

• rather than choose a response

• “The terms alternative assessment, authenticassessment, or performance-based assessmentare often used synonymously "to mean variantsof performance assessments that requirestudents to generate rather than choose aresponse" (Herman, Aschbacher, and Winters, 1992, p. 2).

Page 2: Authentic Assessment - Electronic Portfolioselectronicportfolios.org/portfolios/Hawaii2007.pdf · Electronic Portfolios and Digital Storytelling ... Summative Assessment FOR Learning

2

www.qca.org.ukages3-14

Metaphors for portfolios

• Checklist of skills/competencies

• Resume/C.V. on steroids

• Test

• Story of deep learning

State of the Art of e-PortfolioDevelopment

• Publishing environments:

– Optical media (CD-R, DVD-R)

– WWW

• Authoring environments:

– Common Tools

– Customized (Commercial) Systems

– Open Source Tools

– Web 2.0 Technologies

Planning Issues

• What is your purpose?

• Software capabilities: allowinteraction between teachers andstudents around learning activitiesand products

• Internet access? Poor or good?

What is your purpose?

• authentic assessment (formativefeedback)

• showcasing best work and growthover time

• When used in formative, classroom-basedassessment, teachers (and peers) canreview the portfolio document, and provideformative feedback to students on wherethey could improve.

Software capabilities

• allow interaction between teachersand students around learningactivities and products:

– Students: create, store artifacts andreflections and organize their work,preferably with hyperlinks

– Teachers: review the work and providefeedback in narrative form (based on arubric, if available)

Page 3: Authentic Assessment - Electronic Portfolioselectronicportfolios.org/portfolios/Hawaii2007.pdf · Electronic Portfolios and Digital Storytelling ... Summative Assessment FOR Learning

3

Today’s Tool ChoicesPoor Internet Access?

• Microsoft Office

– Word

– Excel

– PowerPoint

• Other Options:Apple iLife06– iDVD

– iWeb

• Web Page Editors(DreamWeaver, Front Page)

These tools do not requireInternet access to createelectronic portfolios.

Good Internet Access?

• TaskStreamor any commercial fee-basedsystem

• Think.coma free commercial service toeducation (Oracle)

These tools require only abrowser and good Internetaccess to create electronicportfolios because they areApplication Services Providers(ASP) - the software is on thecompany server.

Office - Word, Excel, PowerPoint

Advantages

• On most personalcomputers

• Common toolset

• Easy to create hyperlinks

• Easy to add comments

• Does not require Internetaccess to developportfolios (students workoff-line)

Disadvantages

• Set up own system forstoring and organizing files,and managing thefeedback on student work(probably using TrackChanges in Word orComments in all tools)

• Data aggregation must beset up by teacher withanother tool, like Excel, notautomated

• Files should be translatedinto Web-compatibleformat before postingonline (HTML or PDF)

Better for publishing on CD

Apple’s iLife06Advantages

• Seamless integrationof video/audio intoportfolios created withiWeb (or iDVD) andiMovie, iPhoto, iTunesand Garage Band.

• Use iDVD for creatingDVD portfolios(primarily video orimage/slide shows).

• Use iWeb to publishweb-based portfolios(create off-line andthen upload).

Disadvantages

• Cost $59 (free onnew Macintoshcomputers)

• Requires server topublish web pages(or .Mac account)or DVD writer (foriDVD)

This is Macintosh-only software.

NOTE: the new Macs also run

Windows software.

Web 1.0 vs. Web 2.0DoubleClick

Ofoto

Akamai

mp3.com

Britannica Online

personal websites

domain name speculation

page views

screen scraping

publishing

content management systems

directories (taxonomy)

stickiness

Netscape

Google AdSense

Flickr

BitTorrent

Napster

Wikipedia

blogging

search engine optimization

cost per click

web services

participation

wikis

tagging ("folksonomy")

syndication

Google O'Reilly, T. (2005)

Web 2.0 Technologies

Advantages

• Free, often open-source tools on theWWW

• “Me Publishing

• SharedResources

• Shared Writing

• Media CreationOnline

Disadvantages

• Requires highertechnologycompetency

• Mostly not securewebsites

“Small Pieces, Loosely Joined”

“Me” Publishing

• Blogs

– Blogger, LiveJournal

• Social Networking

– MySpace, Friendster, Elgg

• Content Management Systems

– Plone, Drupal

Page 4: Authentic Assessment - Electronic Portfolioselectronicportfolios.org/portfolios/Hawaii2007.pdf · Electronic Portfolios and Digital Storytelling ... Summative Assessment FOR Learning

4

Shared resources

• Photo Sharing

– Flickr, PhotoBucket

• Media Sharing

– vimeo.com, ourmedia.org,youtube.com, video.google.com

• Bookmarks

– BackFlip.com, iKeepBookmarks.com,del.icio.us

Shared Writing

• Wikis

– WikiSpaces (hosted site with freesubscriptions for teachers)

– MediaWiki (Open Source - used byWikipedia)

• Word Processors

– Writely (owned by Google)

– Zoho tools

Media Creation Online

• Video

–BubbleShare, JumpCut,PrimaryAccess

• Podcasts (audio)

–odeo, podomatic

Open Source ePortfolio Tools• The Open Source Portfolio (OSPI)

– Created by U.S. higher education for collegestudents

– Integration with Sakai

• Elgg

– Created as a combined blog and socialnetworking tool

– Allows students to create groups, integrationwith Moodle

• Open University (U.K.)

– Under development - integration with Moodle

ePortfolio “Mash-up”

ePortfolio “Mash-up”

Small pieces, loosely joined

Lifetime Personal

Web Space Conventional vs. Reform Instruction

• Teacher-directed

• Didactic teaching

• Short blocks of instruction on singlesubject

• Single media

• Individual work

• Teacher as knowledge dispenser

• Ability groupings

• Assessment of fact knowledge anddiscrete skills

• Student exploration

• Interactive modes of instruction

• Extended blocks of authentic andmultidisciplinary work

• Multimedia

• Collaborative work

• Teacher as facilitator

• Heterogeneous groupings

• Performance-based assessment

SRI (1993)

Page 5: Authentic Assessment - Electronic Portfolioselectronicportfolios.org/portfolios/Hawaii2007.pdf · Electronic Portfolios and Digital Storytelling ... Summative Assessment FOR Learning

5

ApproachHierarchical vs. Network

Structured

Controlled

Designed

Managed

Broadcast

Courses

Centralized LMS**Learning Management

System

Information Technology - Corein Information

Networked

Turbulent

Emergent

Adaptive

Aggregation

Ecosystem

Decentralized PLE**Personal LearningEnvironment

Interaction Technology -Core in Interaction

Arina (2006)

Portfolio Differences

Assessment OF Learning

• Purpose prescribed

• Artifacts mandated -scoring for external use

• Organized by teacher

• Summative (Past topresent)

• Institution-centered

• Requires extrinsicmotivation

Assessment FOR Learning

• Purpose negotiated

• Artifacts chosen -feedback to learner

• Organized by learner

• Formative (Present tofuture)

• Student-centered

• Intrinsically motivating

ePortfolio 1.0 - ePortfolio 2.0

• Hierarchical, Designed

• Metaphor: Portfolio asTest

• Data-driven

• Focus on Standardization

• Feedback from AuthorityFigures

• Large, complex systems

• Networked, Emergent

• Metaphor: Portfolio asStory

• Learner-driven

• Focus on Individuality,Creativity

• Feedback from Communityof Learners

• Small pieces, looselyjoined - "Mash-ups"

Continued…

ePortfolio 1.0 - ePortfolio 2.0(continued)

• Web-based Form

• Positivist

• Accountability-driven

• Proprietary

• Digital Paper (text &images)

• Local Storage (harddrives, CD)

• Blog and Wiki

• Constructivist,Connectivist

• Learning-focused

• Open Standards

• Digital Story(multimedia)

• Network Storage(Lifetime PersonalWeb Space)

“every day-ness”How can we make ePortfolio

development a natural processintegrated into everyday life?

Lifelong and Life Wide Learning

Social Learning

How can we integrate ePortfolioswith what we know about social

learning and interactivity?

Page 6: Authentic Assessment - Electronic Portfolioselectronicportfolios.org/portfolios/Hawaii2007.pdf · Electronic Portfolios and Digital Storytelling ... Summative Assessment FOR Learning

6

Architecture of Interaction

(Web 2.0)allows a

Pedagogy of Interaction

(ePortfolio 2.0)

Emerging Models for Portfolios

•mPortfolios

• iPortfolios

•Digital Stories

•Mobile

• Interactive

•Voice

Voice

Individual Identity

Reflection

Meaning Making

Why Digital Stories in ePortfolios?

• Reflection is the “heart andsoul” of portfolios

• Digital Stories canhumanize any model ofePortfolio

• Digital Stories add VOICE

Website with links to movies

http://electronicportfolios.org/digistory/purposes.html

Page 7: Authentic Assessment - Electronic Portfolioselectronicportfolios.org/portfolios/Hawaii2007.pdf · Electronic Portfolios and Digital Storytelling ... Summative Assessment FOR Learning

7

Digital Storytelling Process

• Learners create a 2-4 minutedigital video clip

– First person narrative[begins with a written script ~ 400 words]

– Told in their own voice [record script]

– Illustrated (mostly) by still images

– Music track to add emotional tone

Anchorage8th grade

Digital Stories and e-Portfolios• highly motivating project-based learning

activity

• powerful artifacts in electronic portfolios

• Importance of reflection in e-portfolios

• Tools for scaffolding reflection: bloggingand digital storytelling

• Storytelling: reflection on experience toimprove learning (McDrury & Alterio)

• the role of reflection in brain-basedlearning (Zull)

A Dozen Purposes for DS in EP

• Introduction of Self

– Voice & Personality

– Legacy

– Biography

– Memoir

• Artifacts

– Evidence of Collaboration

– Documentary

– Record of Experience

– Oral Language

• Reflection

– Transition

– Decision

– BenchmarkingDevelopment

– Change over Time

Voice & Personality

• Voice is often missing from electronicportfolios, both literally andrhetorically.

• A digital story provides that voice:listening to the author, we hear a realperson, getting a sense of theirunique personality.

Victoria’s 1st Grade Reflection

Legacy

• Digital stories can provide us with anopportunity to leave a legacy of ourfamily stories for those who comeafter us.

• Legacy stories are usually told abouta person or place.

Legacy & Jonathan

Biography

• A biography provides the facts abouta life, whether of the storyteller oranother person.

Victoria’s 2nd Grade Autobiography

Page 8: Authentic Assessment - Electronic Portfolioselectronicportfolios.org/portfolios/Hawaii2007.pdf · Electronic Portfolios and Digital Storytelling ... Summative Assessment FOR Learning

8

Memoir

• Whereas a legacy story is told for or aboutanother person or place, a memoir is verypersonal, told in the first person, focusingon the memories of the storyteller.

• Memoirs are autobiographical in nature, butare much more personal and reflective.

• They are often much longer than a typicaldigital story.

Dad & No Ideas

Reflection - Transition

• Some learners reflect on the majorchanges or transitions in their lives.

• Reflection can help us make sense ofthese changes.

• Telling digital stories could also helpthe transition to retirement or anyother major life change.

Coming Full Circle & Changes

Reflection - Decision

• Digital stories can be used to eitherweigh the options in a decision to bemade

• or document the process used tomake decisions.

Choices and Changes

Benchmarking Development

• (Joe’s Kean podcast)

• at each point (of development) adigital story snapshot would be anextremely appropriate part of aportfolio

Change over time

• Ss maintain a collection of work overtime

• Ss recognize when growth andchange has occurred

• Ss reflect on the changes they see intheir own performance

• Process has the potential to increasestudents’ self esteem.

Victoria’s Kindergarten Reflection

Evidence of Collaboration

• Much of the work in both schools andthe workplace is the result ofcollaboration

• a digital story could provideexplanation of the process.

Page 9: Authentic Assessment - Electronic Portfolioselectronicportfolios.org/portfolios/Hawaii2007.pdf · Electronic Portfolios and Digital Storytelling ... Summative Assessment FOR Learning

9

Documentary

• A digital video can take the place of aresearch paper or a PowerPointpresentation.

• Story takes on characteristics of adocumentary, often fact-basedwithout emotional content.

What is Digital Storytelling?

Record of Experience

• Often no concrete product that can berepresented in a discrete artifact.

• could be used to reflect on anddocument an experience

• could provide the final evidence of aproject-based learning activity

Chevak

Oral Language

• learning to speak in a second language

• early childhood students learning to read in theirnative language

• learners record their voice, speaking or reading outloud at different stages of development

• demonstrating growth over time.

• "podcast" could be an audio-only digital storywithout the visual component

How to Develop Digital Stories

Process and Tools

Process to develop digital stories

• 1.Script development: write the story, oftenwith a group called a story circle to providefeedback and story development ideas

• 2.Record the author reading the story (audiorecording and editing)

• 3.Capture and process the images to furtherillustrate the story (image scanning andediting)

• 4.Combine audio and images (and anyadditional video) onto a timeline, add musictrack (video editing)

• 5.Present or publish finished version of story

Tools - Audio

• Mac

– Audacity O/S

– SoundStudio($50) T=14 days

– GarageBand*(Apple’s iLife06Tools)

– iPod andmicrophone

• Windows

– Audacity O/S

– Audio RecordWizard ($25S/W)

– any Windows-compatible audiorecordingprogram

Page 10: Authentic Assessment - Electronic Portfolioselectronicportfolios.org/portfolios/Hawaii2007.pdf · Electronic Portfolios and Digital Storytelling ... Summative Assessment FOR Learning

10

Microphones

• Microphone +Mixer OR

• USB MicrophoneOR

• iPod recorder

– Belkin

– Griffin

Web 2.0 Collaborative writingtools

–for script development andcollaborative writing:

–Writely.com or any wiki

Web 2.0 Audio editing tools

–(primarily created to captureand publish podcasts online):

–odeo.com, podomatic.com

Web 2.0 Image sharing tools

–(primarily created to shareimages online):

–Flickr.com, PhotoBucket.com

Web 2.0 Video editing tools

–(primarily created to create andpublish short video clipsonline):

–BubbleShare.com,JumpCut.com,PrimaryAccess.org

Web 2.0 Media publishingservices

–(primarily created to sharevideo online):

–vimeo.com, ourmedia.org,youtube.com, video.google.com

Page 11: Authentic Assessment - Electronic Portfolioselectronicportfolios.org/portfolios/Hawaii2007.pdf · Electronic Portfolios and Digital Storytelling ... Summative Assessment FOR Learning

11

What’s Your Story?

Richness not possible in print

Audiences worldwide but mostlikely small and intimate.

My Final Wish…

May all yourelectronic portfolios

become dynamiccelebrations and stories

of deep learningacross the lifespan.

Dr. Helen Barrett

• Research Project Director,The REFLECT Initiativesponsored by TaskStream

[email protected]

• http://electronicportfolios.org/