making your results visible - a test result dashboard and comparison tool

42
REPAUTO Reporting made better

Upload: xiaoxing-hu

Post on 23-Jan-2018

6.545 views

Category:

Software


0 download

TRANSCRIPT

Page 1: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

REPAUTOReporting made better

Page 2: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

INTRODUCTIONJames Farrier• Test Engineering Lead Fiserv• Love warm weather and walks along the beach

Xiaoxing Hu• Test Engineer• Evangelizing Ruby to C# developers• Don’t try to poach him! I will be watching…

Page 3: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

THANKS TO

• Sumit Poddar• Tim Goodwin• Brian Brewer

• Team at FISERV (Especially Tristan Worley)

Page 4: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

STORY TIME

Page 5: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Sometimesthings just go

WRONG

Page 6: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

AUTOMATION EVERYWHERE what, where, who?

Page 7: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

“So, for our XXXXX iPhone app we have 8 UNIT TESTS all together. One of the unit tests is just an EXAMPLE though. ☺ ”

-Developer(Yes he really did put the smiley face in there)

Page 8: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

WHY are we doing this?

Page 9: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

One framework to rule them all…and selenium to bind them

Page 10: Making Your Results Visible - A Test Result Dashboard and Comparison Tool
Page 11: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Seconf 14 - Allure

http://allure.qatools.ru

Page 12: Making Your Results Visible - A Test Result Dashboard and Comparison Tool
Page 13: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Thousands ofTESTS

Page 14: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

9/10 testers agree ‘FLAKES are bad’

Page 15: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Devices are HARD

Page 16: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

ANYTHING can go wrong

Page 17: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

ANYTHING…

Page 18: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

So many DEVICES

Page 19: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Network PROBLEMS…

Page 20: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Boy who CRIED wolf

Page 21: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Information OVERLOAD

Page 22: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

DEBUGGINGis hard

Page 23: Making Your Results Visible - A Test Result Dashboard and Comparison Tool
Page 24: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Why don’twe try

something NEW?

Page 25: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

CENTRALIZED

Page 26: Making Your Results Visible - A Test Result Dashboard and Comparison Tool
Page 27: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Pick out the FLAKES

Page 28: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

HISTORY and COMPARISON

Page 29: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Easy TRIAGING

Page 30: Making Your Results Visible - A Test Result Dashboard and Comparison Tool
Page 31: Making Your Results Visible - A Test Result Dashboard and Comparison Tool
Page 32: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

How di

d we BUILD it?

Page 33: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Allure ADAPTORS

Page 34: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

MV

C

Page 35: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Thin Model

Page 36: Making Your Results Visible - A Test Result Dashboard and Comparison Tool
Page 37: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Controller Simplified

Page 38: Making Your Results Visible - A Test Result Dashboard and Comparison Tool
Page 39: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

https://github.com/xiaoxinghu/datacraft

Page 40: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

$ dcraft build sync.rb

Page 41: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Same Good View

Page 42: Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Positive feedback => [email protected] Technical support => [email protected] Negative feedback => [email protected] Github – https://github.com/xiaoxinghu/repauto

FEEDBACK / QUESTIONS