The future of automated testing

Gojko Adzic@gojkoadzic

http://gojko.net

Change the balance ofexpected vs unexpected

Opportunity #1

github.com/minimaxir/big-list-of-naughty-strings

gojko.github.io/bugmagnet

aws.amazon.com/device-farm

browserstack.com

saucelabs.com

Prediction #1:

cloud device farms + browser farms +

known testing heuristics =

Automated UI mutation testing

mturk.com

usertesting.com

Prediction #2:

Automated crowd-sourcecoordination tools

● Real humans, real devices,● statistically significant, cheap enough● Smoke testing as a service● Automated focus groups

Assisting humans inmaking testing decisions

Opportunity #2

no-mans-sky.com

bbc-news.github.io/wraith

github.com/xebia/VisualReview

domreactor.com

applitools.com

https://github.com/hugs/tapsterbot

Prediction #3:

automated cloud services +probes +

videos/screenshots +approval testing =

Automated selection ofapproval-style UI tests

github.com/jamesshore/quixote

galenframework.com

popapp.in

Prediction #4:

New languages forautomated tests against wireframes or prototypes

Dealing with thingsimpossible to predict

Opportunity #3

hotjar.com

trackjs.com

Prediction #5:

Automated tests forbehaviour changes in

production

● Eg Applitools + hotjar + mturk● On a small part of the user base in production● Integrated into CI

Big Brother, Big Data

Opportunity #4

tensorflow.org

www.dmtk.io

http://news.mit.edu/2016/faster-automatic-bug-repair-code-errors-0129

Prediction #6:

Big-data threat/riskmodelling

● Directing exploratory testing● Combined with mutations/approvals

Prediction #6:

Big-data threat/riskmodelling

● Directing exploratory testing● Combined with mutations/approvals