how test programs and methods evaluate and how to deal ... · voice of customer mission profile 6...
TRANSCRIPT
![Page 1: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/1.jpg)
How test programs and methods evaluateand how to deal with that?
- an old technique in a new coat -
Harry Roossien
Sr. Reliability Systems Engineer
Plantronics B.V.
![Page 2: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/2.jpg)
Contents
1. Intro and growth
2. Customers and QFD
3. Tailored testing and example
4. Conclusions
![Page 3: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/3.jpg)
1. Growing
• Why are testplans growing?
• Will it continue?
• How to handle this?
![Page 4: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/4.jpg)
Evolution
![Page 5: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/5.jpg)
Extra test
Basic Q/R program
Green environment
Growth
Basic Q/R program
Field complaint
Basic Q/R program
Extra test
Field return
Basic Q/R program
Extra test
Basic Q/R program
Extra test
Extra test Extra test
Extra test
Extra test
Extra test
• Fear - Risk averse = continuation
• Many reasons for adding – even big programmes always to small
• Need for speed and quality and cost reductions
=> Back to basics
Q/R growth
Competition
New tests/methods
Big data
Control
Supplier
Exposure
Field info
Re-use
Cost reduction
![Page 6: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/6.jpg)
... because it can
Rational
![Page 7: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/7.jpg)
Customers ... (Kano-model)Customer satisfied (expectations)
Fun
ction
imp
lemen
ted
Basic needs
Delighters
![Page 8: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/8.jpg)
... and technicians
• Rational
• Quantification
• Control
• Reliability
• Predictability
![Page 9: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/9.jpg)
2. Quality Function Deployment
• Why are customers so difficult?
• How do we get a handshake?
• What means Quality Function Deployment?
![Page 10: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/10.jpg)
QFD model
Customer and users
- emotional behaviour -• Emotional behaviour and responses
difficult to test• Extensive market studies, long time,
expensive, too late to steer development
• Qualitative research
Developers and technicians - rational behaviour -
• Ratio to test and predict• Characterization• Quantitative research possible
and Reliability Engineers
Tools FMECA, RRA, MTBF, QFD, testing etc.Ratio – control/Feeling - experience
![Page 11: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/11.jpg)
QUALITY FUNCTION DEPLOYMENT (QFD)
Project: Mohite/Santana Colored cells means that this item is affected
Revision: EB7 Legend: 1 = poor 10 = excellent, current ratings presents opinion of design team
Date: 26-11-2015
TECHNICAL FUNCTIONS
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
* agreed delighters (MS1) VO
CU
STO
ME
R R
AT
ING
Glu
e re
sid
ues
Foa
m s
ealin
g in
suff
icie
nt
Ca
ble
sea
ling
insu
ffic
ien
t
Insu
ffic
ien
t g
lue
curi
ng
Co
nta
ct/g
lue
rela
xati
on
Ba
tter
y co
nta
ctin
g/s
pri
ng
s
Ba
tter
y te
rmin
als
Ba
tter
y em
pty
(sw
itch
)
Ca
ble
per
form
an
ce
Hea
dse
t /c
ab
le t
ou
chin
g f
ace
Ca
ble
no
t st
raig
ht,
ea
rpa
ds
turn
ed
Ca
ble
no
t cl
ean
, st
icky
Sku
ffin
g,
wea
r, r
esid
ues
Po
or
lase
rma
rkin
g
Ga
ps
an
d s
cra
tch
es
Ca
ble
so
cket
Ea
rpa
d d
efec
t @
rep
lace
men
t
Co
mp
on
ent
bre
aka
ge
Pro
du
ct n
ot
da
ma
ged
(u
se,
test
)
Dis
colo
rati
on
, w
earo
ut,
use
tra
ces
En
v. f
rien
dly
ap
pea
ran
ce
Ch
lori
des
in c
ap
s
Use
r fr
ien
dly
ap
p
Ch
arg
e ca
se d
esig
n
No
shi
ny
bo
x (v
s p
rice
)
Po
or
smel
l
Dissatisfiers in red - brand reputation RS
RS
RS
RS
RS
TR
JG HR
TS
EK
PS
PS
BT
RS
RS
TR
GS
RS
HR
HR
HR
HR
BT
VOICE OF CUSTOMER MISSION PROFILE 6 RISKS
Basic needs (Kano)
Good looking design* All day use. Good looking customer, ergonomics6 5 3 8 6 6 8 7 4 4 6 6 4 5 7 4 6 8 vervorming kabel, plakkerigheid, kabel contact tegen gezicht, PLT marking moet goed blijven, krassen
OOB experience Unboxing 4 4 2 7 6 4 4 6 2 3 2 7 4 6 4 6 vervormd uit doos
Dead units/Dead on Arrival Hypothesis x % 7 8 6 6 8 8 6 6 Production, connect/disconnect, button activated, shorts, tranport (temp diff.)
Pairing comfort App as pairing help + voice prompts7 6 6 8 8 6 Interruptions when moving, tapping headset
Audio performance, good streaming 6 8 6 8 4 6 6 Android, antenna, sample dependend, interruptions, quality, breakage, contact stability, glue
Delighters (Kano)
Fit & stability* Positioning capsules (turn) 5 6 4 4 6 4 6 speaker breakage, glueing, microclip, pouch, earpad release
All day use* 16 hours (4 hours active, rest idle), deep sleep. 6 6 6 8 4 4 6 6 6 6 6 7 volume level, contact resistance, gold plating batt and contacts
Longer listening time* 5 hours (BBGO=4,5 hrs) 7 8 6 6 8 6
Good idle wearing* Not in regular, will be in sports version5 6 4 4 6 6 6
Better switch between connections* PC, tel. via app 6 6 6 nog te testen (beta test), monkey testing (2 knoppen tegelijk etc.)
Moist protection* IPx4--> IP52, incl. sweat 7 8 8 8 6 5 8 6 6 foam, nanocoating,
Language voice prompts* 8 8
Improvement charge case* battery full, product not afffected, good UI6 6 durability test (neckband/case will change)
Click feeling
Performance
Reliability experience & return rate Less masterchef, more equiment, better reliable for customer5 5 8 6 3 6 6 4 8 7 4 4 6 6 4 6 7 2 6 6 6 4 status, compare BBGO2
Production quality/output Fail proof processes, see above6 4 6 4 4 6 6 4 8 6 7 8 8 7 6 7 6 6 6
TECHNICAL RATING 5 7 6 3 7 6 5 8 7 4 4 6 6 5 5 7 4 6 6 6 6 4 8 ## ## ##
Rationeel (technisch)
“Em
oti
on
eel”
(u
ser)
![Page 12: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/12.jpg)
Example
• How it works in practice
![Page 13: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/13.jpg)
And... insightM
arke
t p
erce
pti
on
s
Technical functions
5 6 7 6 5 7 5 6 4 6
9
9
8
9
B 9
Add score/numbers
Excellent technical function
Poor customer satisfaction
shamed red ‘smiling’
Quantification – product maturity for use
![Page 14: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/14.jpg)
Alt. Reliability “growth”
![Page 15: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/15.jpg)
QFD
Quality Function Deployment pro’s
1. Focus and Insight• VoC + delighters
• Transferfunction/Relation E & R
2. Quantification• Score matrix
3. Relationships clear• One function more relations
• Strength of relation
Quality Function Deployment con’s
1. VoC study• Basic needs
• Delighters
2. Transfer to functional blocks/risks• Language (technicians)
3. Stuck to standard programs• Customer requirements w/o use case
![Page 16: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/16.jpg)
3. Tailored Testing
• How to incorporate testing in QFD?
• What are the basics for test tailoring?
• How does it work in practice?
![Page 17: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/17.jpg)
The concept based on QFD
Voice of customer- basic needs- expectations- surprises
(wow)
![Page 18: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/18.jpg)
Adding technical functions (control)
Voice of customer- basic needs- expectations- surprises
(wow)
Voice of technicians- basic functions- technical modules
![Page 19: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/19.jpg)
And reliability/testing?
• Technical functions are • understood – (Physics of Failure)
• testable
• quantifyableReliability Evaluation- analysis- testing
we will never understand the human.....
Voice of customer- basic needs- expectations- surprises
(wow)
Voice of technicians- basic functions- technical modules
![Page 20: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/20.jpg)
Lost from QFD – add ReliabilityM
arke
t p
erce
pti
on
Technical functions
Rel
iab
ility
Eva
luat
ion
RELIABILITY FUNCTION DEPLOYMENT (RFD)
Project: Colored cells means that this item is affected
Revision: Legend: 1 = poor 10 = excellent, current ratings presents opinion of design team
Date:
TECHNICAL FUNCTIONS
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
* agreed delighters (MS1) VO
CU
STO
ME
R R
AT
ING
Dissatisfiers in red - brand reputation
VOICE OF CUSTOMER MISSION PROFILE 6 RISKS
Basic needs (Kano)
Good looking design* All day use. Good looking customer, ergonomics6 5 3 8 6 6 8 7 4 4 6 6 4 5 7 4 6 8
4 4 2 7 6 4 4 6 2 3 2 7 4 6 4 6
7 8 6 6 8 8 6 6
7 6 6 8 8 6
6 8 6 8 4 6 6
Delighters (Kano)
Fit & stability* Positioning capsules (turn) 5 6 4 4 6 4 6
6 6 6 8 4 4 6 6 6 6 6 7
7 8 6 6 8 6
5 6 4 4 6 6 6
6 6 6
7 8 8 8 6 5 8 6 6
8 8
6 6
Performance
Reliability experience & return rate 5 5 8 6 3 6 6 4 8 7 4 4 6 6 4 6 7 2 6 6 6 4
Production quality/output 6 4 6 4 4 6 6 4 8 6 7 8 8 7 6 7 6 6 6
TECHNICAL RATING 5 7 6 3 7 6 5 8 7 4 4 6 6 5 5 7 4 6 6 6 6 4 8 ## ## ##
TEST RESULTS EVALUATION/TEST CONDITIONS
FAIL u u u u u u u u u VIsual inspection
FAIL u u u u u u u u Packaging inspection
PASS u u Tumbling test 1 m
PASS u u Moisture test IPx2, IPx4
3 dec. u u u u u Salt mist test 24 hrs
3 dagen OK u u u Sweat test 5 + 60 min
u u u u u u u u Durability pouch test 2400 x
u u u u u u u u Cable/bend relief rob.
3-dec u Halogen test Cl
Vervalt, want tumble goed u Vibration/shock test 6 hr
4-dec u u u Thermal shock
![Page 21: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/21.jpg)
Example
• How it works in practice
![Page 22: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/22.jpg)
Test reduction
![Page 23: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/23.jpg)
Tailored testing
Tailored testing pro’s
1. More value of test• Effectiveness score
• “always pass” removed
• insight what you test (Tech.Funct.)
2. Less tests and prioritizing• Only tests with value for function
3. Direct relation to customer• Customer affected issues first
• Fast benefits from test
Tailored testing con’s
1. Tailored testing competence• Experience
• PoF
2. Oustide confort zone• Language (technicians)
• Insecure - fear
3. Extra work• Next to standard programs
• Miss out benefits
![Page 24: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/24.jpg)
Conclusion
• Growth of data is given, especially in big data and social data, but to control• customer power
• customer is strange.... (Kano, emotional)
• QFD helpfull tool, not only for quality but as well for reliability and testing• to trigger customer expectations and give overview and insight
• to rationalize in technical terms and baseline for test tailoring
• to quantify how you perform, show status and progress
• Test tailoring can help to keep effective and less testing• shows effectiveness of test (better 3x specific than general)
• helps with prioritation
• points you at black spots (no test for a function)
![Page 25: How test programs and methods evaluate and how to deal ... · VOICE OF CUSTOMER MISSION PROFILE 6 RISKS Basic needs (Kano) Good looking design* All day use. Good looking customer,](https://reader033.vdocuments.us/reader033/viewer/2022060323/5f0d9e877e708231d43b406a/html5/thumbnails/25.jpg)
QFD & TT
• An old technique in a new look