increase testability with code seams
TRANSCRIPT
Increase Testability with Code Seams
@LlewellynFalco
SEAMS
BATTERY TESTING
BATTERY TESTING
Why is Testing Hard?1. Setup2. Lot’s of paths3. Global state4. Lot’s of clutter5. Environment6. Uncontrollable
Variables
7. UI8. Money9. Dates10.Mobile11.Database12.Integration
13.Wait Times14.XPath15.Finding
Elements16.Timing17.Failure cases
Automated checking is a tactic of testing, and can have considerable value... …Checking through an API beneath the GUI level can be particularly useful.In designing such low-level checks, programmers and testers can profitably work together.
We are more doubtful of automated checking at the GUI level. GUIs are notoriously fussy.
CASE #3: Automated checking.
We wanted to demonstrate full-on automated checking, while at the same time staying with the FocusWriter example. FocusWriter does not provide an API for testing, which required us to automate through the GUI, and so theheadaches began.
TESTING EDIT PROFILE
TESTING EDIT PROFILE
????
TESTING EDIT PROFILE
BYPASS LOGIN
https://github.com/login?return_to=https://github.com/settings/profile&user_name=isidore&password=Password123
BYPASS EVERYTHING
https://github.com/EditProfile/?data={“Name”: “Llewellyn Falco”, “photo”:”http://”….}
Testing Pyramid
Slow
Medium
Fast
1-5%
5-15%
80-90%
TESTING EDIT PROFILE
By.xpath("//div[@class='canvas- graph']//div[contains(text(),Location)][input]/following-sibling::h4”)
TESTING EDIT PROFILE
By.id(”locatation_input”)
DarkFunction Editor Test1. Open df editor2. Find File -> Find New -> Find Animation set3. Navigate to github -> dark function editor -> Testing Resources -> StarWarsImages -> SWAII.sprites4. Open5. Add animation6. Add animation (1)7. Add animation (2)8. Rename animation 1 -> animation a9. add animation10 . find animation 3 confirm exists.
DarkFunction Unique Name
DarkFunction Unique NameGiven animation names: animation, animation 2When I ask for a new name Then I get animation 3
DarkFunction Editor Test1. Open df editor2. Find File -> Find New -> Find Animation set3. Navigate to github -> dark function editor -> Testing Resources -> StarWarsImages -> SWAII.sprites4. Open5. Add animation6. Add animation (1)7. Add animation (2)8. Rename animation 1 -> animation a9. add animation10 . find animation 3 confirm exists.
VS.
DarkFunction Editor Seams
Functional
Deterministic
All inputs in
All results out
NON-FunctionalGet inputs as needed (global state, file, database…)
Result vary (dates, random, environment)
Store results (global, disk, database, transient)
public double calculate(double amount){
int step1 = (int) (amount * 2);double step2 = step1 * 1.5;return step2;
}
All results out
All inputs in
Deterministic
public int Advance(){
return steps++;}
All inputs in?
All inputs in?
Deterministic?public int age(DateTime birthDate){
var timeSpan = DateTime.Now - birthDate;
var age = DateTime.MinValue + timeSpan;
return age.Year-1;}
public void saveFile(Person info, string fileName){
File.WriteAllText(fileName, info.ToString());}
All results out?
WHY FUNCTIONAL IS EASIER FOR TESTS
Unit Test
Production Code
DoVerify
WHY FUNCTIONAL IS EASIER FOR TESTS
Unit Test
Production Code
DoVerify
Functional Harness
public static Output function(inputs)
STEPS
1. Determine functional parts2. Separate3. Extract4. Compare against intention
SEPARATING FUNCTIONAL PIECES
Non-Functional
Functional
List
SEPARATING FUNCTIONAL PIECES
Non-Functional
Functional
List
List2
PEEL*http://lfal.co/PeelAndSlice
SLICE
return sample
*http://lfal.co/PeelAndSlice
Why is Testing Hard?1. XPath2. Finding Elements3. Global state4. Dates5. Failure cases6. Wait Times7. Mobile
8. Setup9. Lot’s of paths10.Environment11.Uncontrollable
Variables12.UI13.Money
14.Dates15.Database16. Integration17.Finding Elements18.Timing
Fix: Global State
Resourceswww.ApprovalTests.com
21 episode youtube series
#MobProgrammingGuidebook
Contact Information@LlewellynFalcohttp://LlewellynFalco.Blogspot.comhttp://www.approvaltests.com