cria-les6 rapporterentest.pptx engels

7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels

1/19

Create a Rich Internet Application

Les 6 Reporting

Informatica Communicatie Academie

Hogeschool Arnhem Nijmegen


2/19

Contents of this lesson

Analysing data

Reporting

Assignment


3/19

Framework usability testing


4/19

Analysing quantitative data.Where are the problems

Analysing qualitative dataWhere are the problems

What causes these problems?Observations, questionnaires, .

What is the dimension (size) and severity of theproblems

Give suggestions for improvement

Analysing data


5/19

Example: Find Colleagues....

Analysing data


6/19

Example: Find Colleagues....

Analysing data


7/19

Analysing data

Scenario: Invite collegue Linked-In

User-01 User-02 User-03 User-04 User-05

Wrong clicking 2 1 0 2 3

Questions asked 2 2 0 1 4

Time needed to compl 30 20 15 20 40

0

5

10

15

20

25

30

35

40

45

User-01 User-02 User-03 User-04 User-05

Wrong clicking

Questions asked

Time needed to complete task


8/19

0

5

10

15

20

25

30

35

40

45

Userr-01 User-02 User-03 User-04 User-05

Wrong clicking

Questions asked

Time needed to complete task

Conclusion:

1. Four testers needed support2. Four testers needed asking questions to complete the tasks (invite a colleague)3. Testers were making mistakes (wrong clicking) when completing the tasksRecommendations:1. Put this function on start page2. Give online support in using this function

Conclusion and recommendations


9/19

Analysing data

Task Name Totally agree Agree Do not know Do not agree Totally disagree

1 Renting a Bike

1.1 Bike are easy to select 3 2 3 2 01.2 Pimping the bike makes fun 2 5 3 0 0

1.3 Suggested Bike type conforms to my profile 0 1 6 1 2

1.4 Accesoires are easy to select 1 4 5 0 0

0

1

2

3

4

5

6

7

Totally agree Agree Do not know Do not agree Totally disagree

Suggested Bike type conforms to my profile

Antwoord


10/19


11/19

Analyseren kwantitatieve gegevensWhat are the Metrics we want to use?

1. In relationship to the test goals;2. Depend on the selected scenarios;3. Focus on usabilityand functionality;Note: What is right or wrong (the standards you apply to)

Follow these steps (mandatory):

1. Process the data in Excel;

2. Make graphs in Excel;3. Draw conclusions from the data and graphs in Excel;4. Write suggestions for improvements.

Summary


12/19

Analyseren kwantitatieve gegevens

How to work?

Scenario Rent a BikeWhich scenarios

do we want to

use?

Rent a Bike

Scenarios

Testgoals

1. Right bike with the right person

2. Easy to select(a) en fun to pimp(b)

3. Accesoires are easy to select and usefull

for my tour

Decision about

the metrics1. Qualitative ordinale scale ranging from:

Totally agree, Agree, Dont know,Disaggree and totally disagree.

Posttask questions about Profile and

Recommended bike.

2. (a) Measurement of time, clicks and

needed guidance.

(b) Qualitative ordinale scale ranging

from: Totally agree, Agree, Dont

know, Disaggree and totally disagree

Posttask questions about pimping

the bike.

3. Etc.


13/19

Data collection

Identifier Description Observations Suggestion4.1 Bikes are easy to select 1. Difficulty with finding the right button for

selection;

Give button a colour.

2. Carousel of presenting bikes ends

abruptly and are confusing

3. Not possible to change selected bike in

the same screen

4. 3D picture of bike makes fun!

5. Money presentation is not clear to the

user

6. Next and Previous buttons are not visible

4.2 Pimping the bike makes fun ETC.

Scenario: 4. Renting a Bike


14/19

Analysing data

Dimension and severity of the problems

Global Local

Moderate (4.1 3) Change selected bike

new navigation needed

additional functionality

rework on design and

program

(4.1 1) Finding right button

(4.1. 2) Carousel end abrupt

easy to repair in one form

Severe (4.1. 6) Next and previous

buttons

due to MySql implementation

new version of MySql in

relationship to style sheets

used

(4.1 5) Help function is not

working

technical problem

change help library

Example how to classify problems:


15/19

Give advise how to solve problems

Determine priority

Problem Recommendation

1e priority 4.1 1 Finding right button Easy to repair and is needed for earning

money

Reconsider colours for accepting an offer

Reconsider shapes of buttons

4.1. 2 Carousel end abrupt Easy to repair and is needed for earning

money

Important to give user a sense of

understanding

related to his profile.

4.1. 6 Next and previous buttons Switch to latest versions of MySql, PHP

and Unix

Dont allow Ascii character set (use UTF)

Reconsider classes in style sheet

2e priority (4.1 5) Help function is not working system is rather self explaining

reconsider help text

reconsider interactive help

4.1. 3 Change selected bike Reconsider functionality Renting a bike

Add, delete, modify in one screen (also for

bookings etc.)

Example of priority classification


16/19

Usability Report

Will be one report!

Contains test design, conducting the test, analysingresults, drawing conclusions and writingrecommendations for improvements.

Conforms to the guidelines of reporting

Contents

Introduction

Approach and covered chapters

SEE THE EXAMPLE STRUCTURE REPORT !!!


17/19

Usability Report

A good Usability Report:

1. A chapter does not start with a table, graph orsummary.

2. The measurements are presented in the appendices.

3. Measurements are presented and analysed in Excel.

4. Supported graphs are presented in the report.

5. A graph contains an explanation and a conclusion.


18/19

Opdracht: Usability test & rapport

Perform a usability test with approximately 5 people.

Process and analyse the results.

Write a usability report outlining the problemsencountered.

Write recommendations for (usability/functional)improvements .

Approach


19/19

Hand over evidence of the usability tests:

CD-ROM containing the usability tests performed

usability test report

Approach

cria-les6 rapporterentest.pptx engels

Documents