Upload File

mutation testing

16
Mutation testing Raúl Ávila

Upload: raul-avila

Post on 16-Aug-2015

136 views

Category:

Software


0 download

Report

Tags:

TRANSCRIPT

Page 1: Mutation testing

Mutation testing

Raúl Ávila

Page 2: Mutation testing

I want you to increase the

test coverage of our legacy systems from 0% to more

than 50%…no matter how!

OK!

Page 3: Mutation testing

Test Coverage = 100%

Page 4: Mutation testing

Is there any other (automatic) way to measure the quality of

our tests?

Mutation Testing!

Page 5: Mutation testing

Mutation testing: process

1. Modify production code

• Modifications are called mutations

2. After each mutation -> Run test suite

3. If the suite passes -> Mutation has survived

4. If the suite fails -> Mutation killed!

New metric: mutation coverage

Page 6: Mutation testing

Mutation testing in Java

Integration with Maven

Page 7: Mutation testing

Example 1

Page 8: Mutation testing

Example 1: missing assertions

Page 9: Mutation testing

Example 2

Page 10: Mutation testing

Example 2

Page 11: Mutation testing

Example 2: insufficient test cases

Page 12: Mutation testing

Example 2: insufficient test cases

Page 13: Mutation testing

Examples 3

Page 14: Mutation testing

Examples 3

Page 15: Mutation testing

Examples 3: verify interactions

Page 16: Mutation testing

Thank you

https://github.com/raulavila/pit-example

https://github.com/raulavila/pit-example

Mutation Testing in Python - GOTO Bloggotocon.com/.../slides/AustinBingham_MutationTestingInPython.pdf · Mutation Testing in Python Austin Bingham ... exception handler deletion

Open Challenges in Mutation Testing

Oop 2015 – Mutation Testing

Mutation Testing - Voxxed Days Bucharest 10.03.2017

A Weak Mutation Testing Framework for BPMN · C. Mutation Testing Mutation testing or Strong Mutation [5] is one of the most effective techniques to evaluate the quality of a test

Mutation Testing for Model based requirements€¦ · Mutation Testing Mutation Testing is a method of inserting faults into models based requirements to test whether the tests pick

Testing Delegation Policy via Mutation Analysis

MuClipse: Mutation Testing for Eclipsemuclipse.sourceforge.net/docs/muclipsebinder.pdfMuClipse: Mutation Testing for Eclipse A comprehensive report of accomplishments during Independent

Mutation Testing - The University of Edinburgh

Mutation-Based Testing

Mutation Testing: Development and Challenges - · PDF fileMutation Testing: Development and Challenges Keynote - Lisbon, Nov 20th, 2012 Mutation Testing: Development and Challenges

Lecture 7 Advanced Topics in Testing. Mutation Testing Mutation testing concerns evaluating test suites for their inherent quality, i.e. ability to reveal

Semantic Mutation Testing

Program-based Mutation Testing - Computer Science

Mutation Testing - University of Texas at Dallasewong/SE6367/03-Lecture/28-Mutation-Testing-t… · Mutation Testing Mutation Testing (©2013 Professor W. Eric Wong, The University

Mutation Testing: A comparison of mutation selection methods

Mutation Testing - ARIADcmlrisks.com/Resources/Pdf/Mutation Testing Slide Kit.pdf · CML Treatment Failure: More Threatening Than It Appears Mutation Testing . Content •Mutations

Quick Guide To Genetic Testing · Quick Guide To Genetic Testing TEST TCF4 Mutation Analysis MAGEL2 Mutation Analysis SLC29A3 Mutation Analysis Premature Ovarian Failure Panel** Methylation

Who Watches the Watchmen? - Mutation Testing

Mutation testing

Enabling Mutation Testing for Android Apps - … Mutation Testing for Android Apps ... as compared to other well know mutation tools. CCS CONCEPTS • Software and its engineering

A Systematic Literature Review of How Mutation Testing ... · KEY WORDS: mutation testing; systematic literature review; application 1. INTRODUCTION Mutation testing is defined by

2016 java-sig-mutation-testing

Mutation Testing - School of Informatics

A Mutation Testing Tool for Java Programs Ett verktyg for ... · foundation of mutation testing and emphasizes the role of efficient mutation operators. Mutation operators determine

Literature Survey on Mutation Testing August 2014 ... - …parsai.net/files/research/Literature Survey on Mutation Testing.pdfsoftware in question, mutation testing frameworks are

Mutation testing in Java

Faster Mutation Analysis via Equivalence Modulo States · Mutation Analysis •Mutation analysis is a fundamental software analysis technique •Mutation Testing [DeMillo & Lipton,

An Oversight on Mutation Testing - IJERT Journal · MUTATION TESTING: The best way to find a test case, that efficiently works on software faults is, mutation testing. Seeding defects

TESTING WEB APPLICATIONS WITH MUTATION …offutt/documents/theses/UpsornPraphamontripong...TESTING WEB APPLICATIONS WITH MUTATION ANALYSIS by ... TESTING WEB APPLICATIONS WITH MUTATION

Software Logic Mutation Testing Presented by

[AnDevCon 2016] Mutation Testing for Android

Mutation Testing implements Grammar-Based Testing · Grammar-Based Integration Mutation Testing also called ”interface mutation testing” Testing connections among separate program

A Mutation Testing Tool for Java Programs Mutation Testing Tool for Java Programs Mattias Bybro ... foundation of mutation testing and emphasizes the role of efficient mutation

Mutation testing in php with Humbug