Transcript
Page 1: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

DesignforNext

12thEADConferenceSapienzaUniversityofRome

12-14April2017

Copyright©2016.Thecopyrightofeachpaperinthisconferenceproceedingsisthepropertyoftheauthor(s).Permissionisgrantedtoreproducecopiesoftheseworksforpurposesrelevanttotheaboveconference,providedthattheauthor(s),sourceandcopyrightnoticeareincludedoneachcopy.Forotherusespleasecontacttheauthor(s).

TheValueofAgileMethodsinDesigningforBehaviouralChange:ACaseStudy

DirkPloosvanAmstela,MartineHeemskerka,ReintJanRenesa,b,SanderHermsena*

aUtrechtUniversityofAppliedSciences,NetherlandsbWageningenUniversity,Netherlands*Correspondingauthore-mail:[email protected]

Abstract: Past research on designing for behavioural change mostly concernedlineardesignprocesses,whereasinpractice,Agiledesignmethodsareincreasinglypopular.ThispaperevaluatesthepossibilitiesandlimitationsofusingAgiledesignmethods in theory-driven design for behavioural change.Weperformed a designcase study, consisting of a student design team working on improving waitingexperiencesatSchipholAirportsecurityandcheck-in.Our study showed that Agile design methods are usable when designing forbehavioural change.Moreover, theBehavioural Lenses toolkit used in the designprocessisbeneficialinfacilitatingtheory-drivenAgiledesign.ThecombinationofanAgiledesignprocessandtoolstoevidentiallyinformthedesignenabledthedesignteam to formulate viable and interesting concepts for improving waiting-lineexperiences.However, limitations alsooccurred: amismatchbetween the rate atwhich the Scream method proceeded and the time and momentum needed toconductin-depthresearch.

Keywords: Agile design, theory-driven design, behavioural change, waitinglinebehaviour

1.IntroductionDesigningforbehaviouralchangeiscurrentlyontheriseinthepublicandthecommercialsector,notleastbecauseofthegrowinginsightsintotheeffectofourbehaviouronourhealth(Freeetal.,2013)andourplanet(Griggsetal.,2013).Theriseofphenomenasuchasnudging(Thaler&Sunstein,2008),socialdesign(VanderZwaag,2016),andservicedesign(Stickdorn&Schneider,2012)inprofessionalandeducationalpracticetypifythisdevelopment.Designingforbehaviouralchangeiscomplexand,therefore,needstheoreticalgrounding,increasingthedesign’sefficacy(seeMichieetal.,2009;Noar,Benac&Harris,2007;Taylor,Connor,&Lawton,2011)andthedesigners'decisionalaccountability(VanWoerkum&Aarts,2012).

Inrecentyears,lineardesignprocesses,suchastheDoubleDiamond(DesignCouncil,2015;VanEssen,Hermsen,&Renes,2016),haveinformeddesignresearchprojectsaimedatbehavioural

Page 2: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

DirkPloosvanAmstel,MartineHeemskerk,ReintJanRenes,SanderHermsen

2

change.However,inbusinesspracticeandeducation,Agileprojectsareincreasinglyprevalent.Inshort,Agileisamethodderivedfromsoftwaredevelopment.Itembraceschangeratherthanfollowingapre-determinedplan(Jongerius&Berghuis,2012).Awell-knownexampleofanAgileworkingmethodisScrum.Usedbyagenciesinthecreativesectortodevelopinteractiveproducts(Chicken,2015),Scrumcontraststhelinearapproachesassociatedwithtraditionallinearworkingmethodsbyusinganiterativeprocess;itincorporates‘sprints’insteadofworkingstepbystep.Thesprintscompriseaniterativesequenceofstepstoimprovethedesign(Lee,2012).

Scrum’sbasicprinciples–user-orientedapproach,aself-propelledteam,flexiblescope–arepotentiallyverysuitablefordesigningforbehaviouralchange.Theuser-orientedapproach–prioritisingrelevancetotheenduserandnottheteam,customer,orproduct(Jongerius&Berghuis,2012)–mirrorsasimilaruserorientationindesigningforbehaviouralchange.Astrongemphasisofthisapproachisthetargetaudience(enduser)andtheaccompanyinggoal(changingspecificbehaviour).Theuser-orientedapproachdoesnotcommentonortrytoinfluencethechoiceofinstruments(Hermsen,Renes&Frost,2014,Hermsenetal.,2015).

AnothersimilaritybetweenScrum’sprinciplesanddesigningforbehaviouralchangeisthe'flexiblescope'principle,whichdoesn’tdeterminetheresultinadetailedwayattheprocess’sbeginning;theproductshouldinsteadfittheclient’svisionandgoals(Jongerius&Berghuis,2012).Designingforbehaviouralchangesimilarlyfocusesonregularevaluationandadjustingconceptsaccordingly.

DifferencesalsoexistbetweenScrum’sprinciplesanddesigningforbehaviouralchange.Scrumhasapoortrackrecordinencouragingcreativityandconductingappliedresearch(VanHout&Gootjes,2015;Lee,2012).Thelattercanadverselyimpactontheapplicationofdesigningforbehaviouralchangebecauseusingevidencetoinformdesignscanbetime-consuming(Hermsen,Renes&Frost,2014,Hermsenetal.,2015).

Inthispaper,weevaluate(1)towhatextentnon-lineardesignmethods,suchasAgileandScrum,applytodesigningforbehaviouralchange,and(2)towhatextenttheorycaninformtheAgiledesignprocess.Todoso,weconductacasestudyinwhichagroupofdesignstudentsworkedonimprovingwaiting-lineexperiencesatSchipholAirport,theNetherlands.ThiscasestudycandemonstratehowtopursuethesegoalsbyapplyingAgiledesignprocessesforbehaviouralchangeinbusiness

2.Method2.1Thecasestudy:improvingairportwaitinglineexperienceOurdesigncasestudywascommissionedbytheAmsterdamAirportSchiphol,andconsistedofastudentdesignteamworkingonadesignquestionaboutimprovingwaitingexperiencesattheairport’ssecuritycheck.AsoneofEurope’sbiggestandmostpopularairports,SchipholAirportattachesgreatimportancetoenhancingtheirservices,implementingcentralisedsecurityintheentireterminalinJune2015.Travellersqueuebeforeenteringthesecuritycheck,whichisconsideredachallengetomakingitamorepositiveexperience.Schiphol’scommissionsoughtsolutionstopositivelyinfluencethewaitingexperienceofpassengerswaitinginthisqueue.Aconsortiumof[LeftBlankforPeerReview]assembledamultidisciplinaryteamofinternationalstudentswithdifferentacademicbackgroundstofulfiltheassignment.TheteamworkedaccordingtoScream,anAgiledesignprocessbasedontheScrummethod(VanHout&Gootjes,2015).TheteamusedtheBehaviouralLensestoolkit(Hermsen,Renes&Frost,2014,Hermsenetal.,2015)foruserexperienceresearchandconceptevaluation,asameansofinformingthedesignprocesswiththeoryfromthebehaviouralsciences.

Page 3: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

TheValueofAgileMethodsinDesigningforBehaviouralChange

3

2.2.1ScreamMethod

TheScreammethodisaversionofScrumespeciallyadaptedforcreativeprocesses.IthasthreedistinctadditionstothemoregeneralAgileworkflow:(1)implementingIdeationinthesprintplanning,(2)useoftheDesignMethodToolkit(MediaLabAmsterdam,2016),and(3)implementingTranslatesessionshalfwaythrougheverysprinttofilterandtranslateallresults(VanHout&Gootjes,2015).TheSchipholprojectinvolvedseventhree-weeksprints,eachstartingwithanIdeationbrainstormingsessionforidentifyinganddraftingideas.Themostpromisingideasareselectedanddividedintotasks,andtheteamdefinesclearsprintgoals(VanHout&Gootjes,2015).Deliverdesignproducts(prototypes)thatprovideanswerstothemainquestion,definedattheproject’sstart,isthemaingoalofeachScreamsprint.Duringasprint,theindividualdesignproductsareaccomplishedusingtheiterativeprincipleof‘research,create,andtranslate’(VanHout&Gootjes,2015).Creatingadesignproductinvolvesresearchandcreation.Thecreateddesignproductisevaluatedusingstakeholders’theoreticalinput.Ideally,atthisevaluation,thedesignproductisadaptedtoamoreaccurateversionorendproduct.Duringtheoverallprocess,theseinstrumentsadaptandimprovethroughiterativerepetitioninthesprints.

Totranslateresearchinsightsintoconcretedesignrequirements,halfwaythrougheachsprint,atranslatesessioninvolvingalltheproject’sstakeholderstookplace,definingessentialdemandsfortheoptimisedsolution(VanHout&Gootjes,2015).

2.2.2BehaviouralLensestoolkit

Togroundthedesignprocessintheoryfromthebehaviouralsciences,theteamusedtheBehaviouralLensestoolkit(Hermsenetal.,2015;VanEssen,Hermsen&Renes,2016),whichenablesdesignerstoconducttheory-drivenuserresearchandconceptevaluations.ItisbasedonthemainprinciplesofthePersuasivebyDesignModelofBehaviourChange(Hermsen,Renes&Frost,2014),whichhasaproventrackrecord(Hermsen,Renes&Frost,2014;Hermsenetal.,2015,2016;VanEssen,Hermsen&Renes,2016)inusingtheorytoinformdesigns.TheBehaviouralLensestoolkitwasfreelyavailabletothedesignteamthroughouttheproject,aspartofthelargerDesignMethodToolkit(MediaLabAmsterdam,2016;seefigure1).ThedesignteamcouldusetheBehaviouralLensestoolkitastheysawfit.Duringsprintone,weconductedanintroductoryworkshop,informingthedesignteamabouttheBehaviouralLensestoolkit’sbasicprinciplesandapplication.

Thedesignteamcreatedthedesignproductusingtheiterativeprincipleof‘research,create,andtranslate’.Creatingadesignproductinvolvesresearchandcreation.Thecreateddesignproductisevaluatedusingthestakeholders’theoreticalinput.Ideally,atthisevaluation,thedesignproductisadaptedtoamoreaccurateversion.

2.2MeasuresWeconductedovertparticipatoryobservationthroughouttheproject.Inourroleastutors,wehelpedthestudentdesignteamtheoreticallygroundtheirdesignsusingtheBehaviouralLensestoolkit,butonlyifrequested.Weattendedtranslateandreviewsessions,providingtheteamwithcriticalquestionsfortheoreticallygroundingtheirresearchresultsandconcepts.Thestudentdesignteamcouldalsocorrespondwithusbyemailorphone.

Duringthesessions,wetookunstructuredfieldnotes,collectedemailswithquestionsfromthedesignteam,andkeptadiary,notingwhenthedesignteamrequestedsupport.Subsequently,weconductedtri-weekly,semi-structuredinterviews(ateachsprint'send)withtheteam‘experts’onthetopicofdesigningforbehaviouralchange.Theinterviews’mostimportanttopicsandaccompanyingquestionsregardedtheAgileworkflowandapplyingtheBehaviouralLenses.We

Page 4: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

DirkPloosvanAmstel,MartineHeemskerk,ReintJanRenes,SanderHermsen

4

askedthedesignteamwhereandhowtheypractisedthesetools,whattheirexperienceswere,towhatleveltheyappliedandappropriatedthetools,andtowhatextenttheyfelttheywereexpertsofbehaviourchangedesignwithintheteam.Wealsousedavisualanaloguescale(VAS,Funke&Reips,2012)tomeasuretheperceivedvalueoftheusageofTheBehaviouralLensespersprint(regardingresearchonthetargetaudience,thegroundingoftheprototypesandthebehaviourallensesasevaluationtool):ona10cmline,withoneendcorrespondingto'notatall'andtheotherendcorrespondingto'verymuchso',thedesignteammemberscouldindicatetheirpositionregardingtheirexpertiseandtheusabilityoftheBehaviouralLensestoolkit.

Figure1:TheBehaviouralLensesasdescribedintheMediaLabDesignToolkit

3.Results3.1Stages,sprintsanddesignedproductsInfigure2,thearrowfromlefttorightindicatestheproject’soverallprogress.Thefirstthreesprintsaresprintsaimedatanalysis,tozoominonthetargetgroupandtheirbehaviour.Thefourthsprintistransitional;startingwithmakingdefinitivechoicesregardingthespecificchoiceforatargetgroup.Inthiscase,thedesignteamchosetoworkwiththeleisureflyerratherthanabusinessaudience.Inthisfourthsprint,thefinalconcepttosolvethemainquestionwasalsoselected.Thefifthsprintisanintervention-developingphase,translatingtheselectedconceptintopracticalinterventionsforbehaviourchange.Thesixthsprintisevaluative,validatingtheconceptandinterventions.

Sprintsonetosixresultedinseveraldesignedproducts.Sincethefirstsprintisintroductory,therewerenotmanyproducts.Duringsprinttwo,aculturalprobeandauserprofileweredeveloped,gaininginsightsintothetargetgroup.Aculturalprobe(Stickdorn&Schneider,2012)isamethodforgaininguserinsightsfromauserperspective,withoutthepresenceofthedesigner,whereasauserprofileisadesignproductcomprisingacollectionofalluserinsights.Theculturalprobe’sanduserprofile'smaingoalistotranslateinsightsintoacustomerjourneymap,inthiscasearichoverviewoftheprocessatravellergoesthroughwhenpassingthroughsecurity,inspiringthenextsprint.

Insprintthreethedesignteammadeobservationsatthewaitingline,tomaptheleisureflyer’scurrentbehaviourandanalysefrictionsbetweenmeaningfulandunfilledtime.Insprintfour,thedesignteamorganisedabrainstormsession.OnestudentdevelopedaHarrisProfile(Harris,1982)usinginsightsfromtheBehaviouralLenses.Thegoalofthisdesignproductistotesttowhatextentthedifferentconceptscorrespondwiththerequirementsofsuccessfulconceptsingeneral.Atthe

Page 5: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

TheValueofAgileMethodsinDesigningforBehaviouralChange

5

endofsprintfour,thedesignteamdeliveredthreeconceptualprototypesasananswertothemainquestion,validatedbytheHarrisProfile.Theconceptualprototypetheychoseforfurtherdevelopmentwas‘LeaveYourWorriesBehind’Usingamobileapplicationandseveralscreens,theleisureflyercan(1)receiveinformationaboutthesecurityprocessand(2)beentertainedwhilewaiting.

Figure2:Stagesandsprintsduringtheproject,designproductspersprint,anddirectandindirectapplicationoftheBehaviouralLensesduringseveralsprints

Insprintfive,thedesignteamdeveloped'preparatoryscreens'–screensplacedinthearealeadingtothesecuritycheckgates,withtheintentofhelpingtravellersduringthesecurityprocess.Insprintsix,evaluatingtheuser’swillingnesstoparticipateinthefinalconceptatthewaitinglinewasthemaingoal.Thedesignteamconstructedatestplanandupdatedadiarylogontheresponsestotheconcept.Thisfinalevaluationdidnotleadtofurtheriterations.

3.2Designingforbehaviouralchange,theAgilewayTheteamstartedwithmanypreconceivedideasaboutthebehaviouroftheirtargetaudience.Theyfeltobligedtoprovetheseassumptionsandusethemasastartingpointfortheirresearch.Intheinitialsprints,theteamusedthefirsthalfofthesprint(thefirst1.5weeksfromstarttotranslatesession)toconductresearch,mainlytryingtofillinformationgapsthathadbecomeapparentintheprevioussprint.Inthemid-sprinttranslatesession,thedesignteamsoughttofilterandcategorisetheirresearchresults,turningthemintoideasforthesprint’ssecondhalf,wheretheycreatedorimprovedaprototype.

Page 6: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

DirkPloosvanAmstel,MartineHeemskerk,ReintJanRenes,SanderHermsen

6

Figure3:initial(left)andadapted(right)versionoftheculturalprobe

ThisAgiledesignmethodhelpedthedesignteamfocusonapracticalapproach,translatingresearchintoanactualprototype.Byinvolvingtheclientinthedesignprocess,theAgileapproachalsopreventedapossibleexpectationgapbetweenthedesignerandtheclient.Attheendoftheproject,theclientstatedtheirsatisfactionwiththeendresultofthedesignprocess.

AnexampleoftheiterativenatureoftheAgiledesignprocessisthecreationoftheculturalprobeinsprintthree.Figure3demonstrateshowtheculturalprobeevolvedfromitsinitialformtoitsfinalversion.Atfirst,thedesignteamconductedresearchonthepsychologyofwaitinglines(Norman,2008).Basedonprinciplesfromthisresearch,thedesignteamcreatedaninitialculturalprobe,retrievingexpectationsandmemoriesofwaitinglineexperiencesandfrictionsbetweenexpectationsandreality.Theinitialversionoftheculturalprobewasevaluatedbypresentingittoourteamofresearchers.Duringtheevaluation,itbecameapparentthattheinitialculturalprobewasoverlybiasedbyhowthedesignteamperceivedthewaitinglineexperience,ratherthanactualbehaviourdisplayedbythetargetgroup.ThedesignteamappliedtheBehaviouralLensesasanevaluativetool,translatingtheinitialversiontoonemorebasedonactualbehaviour.

Unfortunately,theAgileworkingmethodhadatendencytoleadtoareducedfocusonresearch.Becauseofthepracticalgoalsetatthebeginningofeachsprint,theteamfeltpressuredtocreateadesignedartefactineverysprint.Thesprintsonlyhadathree-weekduration,sothedesignteamperceivedtimepressureasalimitingfactor.Theresultingpressurereducedtheirwillingnesstoconductresearchandincreasedthetendencytocreateconceptsbasedonpremises,evenwhenconfrontedwiththepossiblenegativeeffectsofminimalresearch.Attheproject'send,theteamfeltthatanincreasedfocusoncreationandalesserfocusonresearchcouldverywellhavehadconsequencestotheconcept'spotentialefficacy,becausetheylackedcrucialinformationabouttheirtargetaudience.

TheplacementoftheTranslatesessions(inthemiddleofeachsprint)furtheraugmentedthedetrimentaleffectoftimepressure.Althoughthesesessionsaffordedthedesignteamnewinsights,

Page 7: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

TheValueofAgileMethodsinDesigningforBehaviouralChange

7

thesessionswerelesseffectivethanexpected.Theteamhadalreadyfinishedtheirresearchwhenthesesessionsoccurred,andtherewasnotmuchadditionaltimeforresearchinthesecondhalfofthesprint,afterthetranslatesession.Moreover,intheTranslatesessionsexpertsfromoutsidetheteamwereinvitedtoprovidefeedback.Becauseofthetimingofthisfeedback,itwasnotalwaysfollowedup.

3.3AgiledesignusingtheBehaviouralLensesDuringthesprints,TheBehaviouralLensestoolkitwasusedtogroundthedesignoftheprototypesintheoryfromthebehaviouralsciences.Figure2showswhereandhowthedesignprocessusestheBehaviouralLensestoolkit.

Insprinttwo,thedesignteamattemptedtogaininsightintothetargetaudienceusingaculturalprobeandbycreatingauserprofile.Beforemakingtheobservationsrequiredforcreatingthesedesignresearchproducts,thedesignteamusedtheBehaviouralLensesforgeneratinghypothesesandresearchdesign.TheymadeanobservationlistandsurveypartlybasedonthreeBehaviouralLenses:‘WantingandBeingAbleTo’,‘KnowingandBelieving’and‘HabitsandImpulses’.ThedesignteamparticipatedinasessionaboutobservationusingtheBehaviouralLensesanddecidedtofocusontheleisureflyerasthespecifictargetaudience.

ThedesignteamchosetousetheBehaviouralLensesasamethodinsprintthreetoconductactionresearchbycreatingandtestingonefriction-relievingconcept,particularlybetweencurrentbehaviourandtargetbehaviour.Duringthetranslatesessiontheirresultswerediscussedfromabehaviouralchangeperspective;however,unliketheinitialplan,categorisingresearchresultsusingtheBehaviouralLenseswascancelledduetotimeconstraints.

Insprintfour,thedesignteamusedtheBehaviouralLensestocategorisetheirearlierresearchresultsandevaluateconceptsdevelopedinprevioussprints.Thissessionprovidedaclearoverviewofchallengesandopportunities,andthedesignteamusedthesetoimprovetheirconcept.Itledtoasignificantchangeintheconcept,forcingthedesignteamtochoosebetweentwokindsoftargetbehaviour,andselectingamorespecifictargetgroup.Lateroninthesprint,abrainstormsessionusingtheBehaviouralLensestookplace.Timeconstraintsmeantthedesignteamcouldnotprocessallfindingsintotheconceptsinsprintfour;however,theydidmanagetomakeaHarrisprofile,incorporatingsomeoftheopportunitiesandchallenges.

Insprintfive,preparatoryscreenswerecreatedasoneofthefinalconcept’sdeliverables:aconsequenceofachallenge(thefriction)foundinsprintfour.TheBehaviouralLenseswereindirectlyapplied:thedesignteamstudiedandappliedtheunderlyingtheoryoftheBehaviouralLenses.

Duringthesixthandfinalsprint,thedesignteamtestedthehigh-fidelityprototype.Theydecidednottotestthecreativeconcept,butthewillingnessofleisureflyersinthewaitingareaforsecuritytoparticipateintheconcept.ThedesignteamdidnotusetheBehaviouralLensesfortheirtestdesign,butwhileobserving,theyfoundtheBehaviouralLens‘WantingandBeingAbleTo’verysuitableforinterpretingtheresults.Mosttestpersonsdidnothavethetimetoparticipateintheconcept,andtheycouldnotscantherequiredQRcode.Thesetestresultsarenotprocessedinthefinalconceptbutareincludedfordiscussionintheresearchpaperasafinaldeliverable.

Atthebeginningoftheproject,thedesignteamdidnotusetheBehaviouralLensestoolkittoitsfullpotentialforresearchingthetargetaudience.ThedesignteamfeltthiswasduetotheirlackofknowledgeoneffectivelyusingtheBehaviouralLensesfortheirresearch.ThedesignteamalsostatedtheyfounditdifficulttocombinetheBehaviouralLenseswithotherdesignmethodsfromtheDesignMethodToolkit.However,oncethedesignteamlearnedmoreabouttheBehaviouralLenses,

Page 8: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

DirkPloosvanAmstel,MartineHeemskerk,ReintJanRenes,SanderHermsen

8

theynotedthattheirperceivedvalueofthemincreased.Additionally,interviewswithtwostudentsfromtheteamconfirmedincreasedappreciationoftheBehaviouralLensesaftermappingoutchallengesandopportunitiesconcerningtheirprototype.

4.DiscussionThecurrentpaperevaluateswhether(1)Agileisapplicableasamethodtodesigningforbehaviouralchangeand(2)toolssuchastheBehaviouralLensesarevaluableforinformingtheAgiledesignprocess.Todoso,weanalysedtheuseoftheBehaviouralLensesduringaprojectwithSchipholAirport.Inthisproject,adesignteamofstudentsfromdifferentbackgroundsresearchedanddevelopedadiversityofconceptstocreateamorepositiveexperienceatwaitinglinesofaspecifictargetgroup:LeisureFlyers.TheconceptsweredeliveredtoSchipholstakeholdersaftertesting.Duringthesixdesignsprints,weconductedobservatoryresearchandinterviewsabouttheAgileworkflowandtheuseoftheBehaviouralLensestoolkit.

OurresearchdemonstratedthattheBehaviouralLensesweresometimesappliedinadirectwayatfirst(e.g.intheuserprofile,culturalprobe,whichwerecreatedusingtheBehaviouralLenses),andthen,lateron,inamoreindirectway(e.g.thecustomerjourneymap,whichwascreatedwithoutdirectapplicationoftheBehaviouralLenses,butwiththeLensesinmind).TheapplicationoftheBehaviouralLensesinthefirstphaseof‘targetgroupanalysis’wereappliedinadirectway,whereasatlaterstages‘conceptualizing’,‘development’and‘evaluation’theirapplicationwasmoreindirect,notbyusingtheLensesbutbykeepingtheLensesinmind.Duringtheproject,theBehaviouralLensesdemonstratedtheirimportanceinthetheoreticalvalidationofthepresenteddesignproducts.However,theprojectshowedsomeshortcomingswhenresearchingthetargetgroup.Thespecifictargetgroupandtargetbehaviourweredefinedrelativelylateandindirectlybecauseoftheproduct-orientedapproachandthehighspeedofthesprints.Subsequently,theactualdesigningwaslessfocusedthandesired.

TheBehaviouralLenseswereappliedmoreeffectivelyrelativelylateinthedesignprocess:insprintthreeandfurtheron.Ourresearchshowedthatthiswasaconsequenceofaknowledgeandexperiencegapinhowandwherethetoolsareapplied.Duringtheinterviewattheendofthesecondsprint,thedesignteaminformedustheyconsideredtheBehaviouralLensestobeasubstituteforothertoolsintheMediaLabToolkit.Furthermore,thedesignteamfeltitwashardtotranslateinsightsfromtheBehaviouralLensesintootherresearchmethods,suchastheculturalprobe.ThelearningcurveoftheBehaviouralLensestoolkitseemstoosteepforinexperiencedusers,resultinginthembeingunabletostarttheirresearchwithouthelpfromexpertsinthefieldofbehaviouralchangeorpeoplewhousetheBehaviouralLensesonaregularbasis.

4.1.ConclusionsandrecommendationsforfurtherresearchFirstly,thisresearchcombinestwoelements:designresearchpractice–especiallywithinthefieldofdesigningforbehaviouralchange–inwhichdevelopingmethodswheretheoryinformsthedesignprocesshasseenmuchprogress;andindustrypracticeinwhichnewandAgiledesignmethodsaregainingtraction.Secondly,thisresearchdemonstratesthecomplexitiesofusingAgiledesignforbehaviouralchange,showstherearelimitstoaviablespeedofworking,andstressestheimportanceofevaluation.Thirdly,ourresearchprovidessomestartingpointstodevelopmoreadaptivetoolstomakeiteasiertousetheBehaviouralLensesinAgiledesignprocesses.

TosignificantlyimproveAgiledesignprocessesforbehaviouralchange,werecommend:(1)implementanexplanatorypre-sprinttofosterthinkingaboutwaysofusingtheorytoinformthe

Page 9: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

TheValueofAgileMethodsinDesigningforBehaviouralChange

9

designprocess–itwouldmakesensetoinviteexpertsduringthisphase.(2)Includeresearchers(preferablywithabackgroundinthebehaviouralsciences)asparticipantsoftheScrumteam.(3)Adaptorrewriteuserstories(analreadyexistingprocedureatthestartofasprint),makingthetargetbehaviouranexplicitgoalofthesprint.And(4)beforesprintone,informusersoftheBehaviouralLensesandtheircomplementaryandconstructiveapplicationsforotherdesignproducts,suchasuserprofiles,culturalprobes,customerexperiencemaps,andcustomerjourneys.

ReferencesHermsen,S.,Mulder,S.,Renes,R.J.,&VanderLugt,R.(2015):UsingthePersuasivebyDesignModel

toinformthedesignofcomplexbehaviourchangeconcepts:twocasestudies.In:Proceedings,11thConferenceoftheEuropeanAcademyofDesign.Paris,UniversitéParisRenéDescartes.

Hermsen,S.,Renes,R.J.,&Frost,J.H.(2014).PersuasivebyDesign:aModelandToolkitforDesigningEvidence-BasedInterventions.In:MakingtheDifference.Proceedings,CHISparks2014.TheHague,Netherlands:TheHagueUniversityofAppliedSciences.

VanEssen,E.,Hermsen,S.,&Renes,R.J.(2016).Developingatheory-drivenmethodtodesignforbehaviourchange:twocasestudies.in:P.Lloyd&E.Bohemia,eds.,ProceedingsofDRS2016:Design+Research+Society–Future-FocusedThinking,Volume4,pp1323-1338.

Hermsen,S.,VanderLugt,R.,Mulder,S.,&Renes,R.J.(2016).HowIlearnedtoappreciateourtamesocialscientist:experiencesinintegratingdesignresearchandthebehaviouralsciences.in:P.Lloyd&E.Bohemia,eds.,ProceedingsofDRS2016:Design+Research+Society–Future-FocusedThinking,Volume4,pp1375-1389.

Chicken,S.(2015).Leanandgooddesign–amarriagemadeinheaven?URL:http://www.designcouncil.org.uk/news-opinion/lean-and-good-design-marriage-made-heaven.Accessed:2016-12-21.(ArchivedbyWebCite®athttp://www.webcitation.org/6mvBDfEsj)

DesignCouncil,(2015).Doublediamonddesignprocess.In:InnovationbyDesign.URL:http://www.designcouncil.org.uk/sites/default/files/asset/document/innovation-by-design.pdf.Accessed:2016-12-21.(ArchivedbyWebCite®athttp://www.webcitation.org/6mvBx6dh5)

Free,C.,Phillips,G.,Galli,L.,Watson,L.,Felix,L.,Edwards,P.,…Haines,A.(2013).TheEffectivenessofMobile-HealthTechnology-BasedHealthBehaviourChangeorDiseaseManagementInterventionsforHealthCareConsumers:ASystematicReview.PLoSMedicine,10(1),e1001362.doi:10.1371/journal.pmed.1001362

Funke,F.,&Reips,U.-D.(2012).WhysemanticdifferentialsinWeb-basedresearchshouldbemadefromvisualanaloguescalesandnotfrom5-pointscales.FieldMethods24,310–327.doi:10.1177/1525822X12444061.

Griggs,D.,Stafford-Smith,M.,Gaffney,O.,Rockström,J.,Öhman,M.C.,Shyamsundar,P.,…Noble,I.(2013).Policy:Sustainabledevelopmentgoalsforpeopleandplanet.Nature,495(7441),305–307.doi:10.1038/495305a

Harris,J.S.(1982).NewProductProfileChart.IEEEEngineeringManagementReview,10(3),17–25.doi:10.1109/emr.1982.4305929

JongeriusP.&BerghuisG.(2012).GetAgile.ScrumforUX,design&development.Amsterdam:BISPublishers.

Lee,R.C.(2012).TheSuccessFactorsofRunningScrum:AQualitativePerspective.JournalofSoftwareEngineeringandApplications,05(06),367–374.doi:10.4236/jsea.2012.56043

MediaLabAmsterdam(2016).DesignMethodToolkit.URL:http://medialabamsterdam.com/toolkit/.Accessed:2016-12-21.(ArchivedbyWebCite®athttp://www.webcitation.org/6mvARqFur)

Page 10: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

DirkPloosvanAmstel,MartineHeemskerk,ReintJanRenes,SanderHermsen

10

Michie,S.,Abraham,C.,Whittington,C.,McAteer,J.,&Gupta,S.(2009).Effectivetechniquesinhealthyeatingandphysicalactivityinterventions:Ameta-regression.HealthPsychology,28(6),690–701.doi:10.1037/a0016136

Noar,S.M.,Benac,C.N.,&Harris,M.S.(2007).Doestailoringmatter?Meta-analyticreviewoftailoredprinthealthbehaviorchangeinterventions.PsychologicalBulletin,133,673–693.doi:10.1037/0033-2909.133.4.673

Norman,D.(2008).ThePsychologyofWaitingLines.URL:http://www.jnd.org/ms/Norman%20The%20Psychology%20of%20Waiting%20Lines.pdf.Accessed:2016-12-21.(ArchivedbyWebCite®athttp://www.webcitation.org/6mvCIoEz8)

Stickdorn,M.,&Schneider,J.(2012).Thisisservicedesignthinking.Oxford,UK:Wiley&Sons.Taylor,N.,Conner,M.,&Lawton,R.(2011).Theimpactoftheoryontheeffectivenessofworksite

physicalactivityinterventions:Ameta-analysisandmeta-regression.HealthPsychologyReview,6,33–73.doi:10.1080/17437199.2010.533441

Thaler,R.,&Sunstein,C.(2008).Nudge:Thegentlepowerofchoicearchitecture.NewHaven,Conn.:Yale.

VanderZwaag,A.(2016).Looksgood,feelsgood,isgood.Howsocialdesignischangingourworld.Eindhoven,NL:Lecturis.

VanHout,M.&Gootjes,G.(2015).Scream!AnIntegratedApproachforMultidisciplinaryDesignTeamsinHigherEducation.Edulearn15Proceedings,2157-2167.

Woerkum,C.van,&Aarts,N.(2012).Accountability:Newchallenges,newforms.JournalofOrganisationalTransformation&SocialChange,9(3),271–283.doi:10.1386/jots.9.3.271_1

AbouttheAuthors:

DirkPloosvanAmstelisresearcherattheResearchGroupCrossmedialCommunicationinthePublicDomain(Publab)attheUtrechtUniversityofAppliedSciences;hisworkfocusesonevaluatingthepracticalapplicationofmodelsandtoolsindesignsforbehaviouralchangebyreflectivepractitioners(studentsandprofessionals)intheirdailypractice.

MartineHeemskerkisresearcherinthefieldofdesignforbehaviouralchange,campaignstrategies,humanengagementandsocialmediaatUtrechtUniversityofAppliedSciences(Publab&CrossmediaBusinessResearchGroup).

ReintJanRenesisprofessor(lector)ofcross-mediacommunicationinthepublicdomainatPublab.Hespecializesinresearchinto(health)communicationandbehaviouralchange.

SanderHermsenisseniorresearcheratPublab;hisworkfocusesonevaluatingdesignsforbehaviouralchangeandincreasingtheirefficacy,andondevelopingmodelsandtoolkitsthatmakeinsightsfromthebehaviouralsciencesavailablefordesigners.

Acknowledgements:Wewouldliketothankthecommissioner,SchipholAirport,themembersofthestudentDesignTeams,especiallyLizzaKempeandMyrtheKoops,andourcolleaguesfromtheMedialabattheAmsterdamUniversityofAppliedSciences


Top Related