unit and functional testing for ios platform

8/11/2019 Unit and Functional Testing for Ios Platform

1/81

Christopher M. Judd

Unit and FunctionalTesting for the iOS

Platform

Thursday, January 13, 2011


2/81

Christopher M. JuddPresident/Consultant of

leader

Columbus Developer User Group (CIDUG)



3/81

Remarkable Ohio

Free

Developed for eTech Ohio and Ohio Historical Center



4/81

University System Of Ohio

FreeDeveloped for eTech Ohio and University System Of Ohio



5/81

Chmod

Free Judd Solutions



6/81

December 2008 issue



7/81

How many of you are currently orhave developed applications for the

iOS Platform?



8/81

How many of you have ever unit or

functionally tested your iOS

application?



9/81

How many of you have ever

unit tested on anotherplatform or language?



10/81

Why arent you testingyour iOS applications?



11/81Thursday, January 13, 2011


12/81

iOS unit and functional testing is

neither straight forward or easyThursday, January 13, 2011


13/81

iOS Unit Testing Challenges

Toooo many steps to get startedNo green bar/red bar

Cant run individual testsUnit test template code contains to muchUnit tests can not be debugged out of the box

Little documentationMultiple targetsOnly includes very basic testing support

No mock framework included



14/81

iOS Functional Testing Challenges



15/81

iOS Functional Testing Challenges



16/81

Testing Coverage

The Objective-C Programming Language



17/81

Testing Coverage




18/81

Unit Testing



19/81

Unit Testing Basics


Wh U i T ?


20/81

Why Unit Test?

Improves designFacility change and refactoringSimplifies integrationProvides executable documentation



21/81

includes also known as

SenTestingKit



22/81

Logic Test == Unit TestApplication Test == More Functional Test



23/81

Getting Started


S d i


24/81

http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-

Unit_Testing_Applications/unit_testing_applications.html#/

apple_ref/doc/uid/TP40007959-CH20-SW3

Setup documentation


S d i
http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3


25/81

http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-

Unit_Testing_Applications/unit_testing_applications.html#/

apple_ref/doc/uid/TP40007959-CH20-SW3

Setup documentation

or

ios developer guide unit testing


U it T ti S t St
http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3http://developer.apple.com/library/ios/#documentation/Xcode/Conceptual/iphone_development/135-Unit_Testing_Applications/unit_testing_applications.html%23//apple_ref/doc/uid/TP40007959-CH20-SW3


26/81

Unit Testing Setup Steps

1. Add unit test bundle target

2. Make unit test target active3. Add group for test classes4. Add unit test class


Add U it T t B dl T t


27/81

Add Unit Test Bundle Target


M k U it T t T t A ti


28/81

Make Unit Test Target Active


Add G f T t Cl


29/81

Add Group for Test Classes


Add U it T t Cl


30/81

Add Unit Test Class

Should end in TestShould be in a separate directory

Must be have UnitTeststarget checked


G t d T t Cl


31/81

Generated Test Class*Test.h

*Test.m


Generated Test Class


32/81

Generated Test Class*Test.h

*Test.m


Create Custom User Templates


33/81

Create Custom User Templates

*Test.m



34/81

!B


35/81

!Bor

Build > Build

with unit test targetselected

or



36/81

False

Nothing to

worry aboutReal FailureThursday, January 13, 2011


37/81

Writing Unit Tests


Basic Unit Test


38/81

Basic Unit Test

*Test.m must extend SenTestCase

must return void andtake no parameters

test methods mustbegin with test


Assert Macros


39/81

Assert Macros

STAssertNil(a1, description, ...)

STAssertNotNil(a1, description, ...)

STAssertTrue(expression, description, ...)

STAssertFalse(expression, description, ...)

STAssertEqualObjects(a1, a2, description, ...)

STAssertEquals(a1, a2, description, ...)

STAssertEqualsWithAccuracy(left, right, accuracy, description, ...)

STAssertThrows(expression, description, ...)STAssertThrowsSpecific(expression, specificException, description, ...)

STAssertThrowsSpecificNamed(expr, specificException, aName, description, ...)

STAssertNoThrow(expression, description, ...)

STAssertNoThrowSpecific(expression, specificException, description, ...)

STAssertNoThrowSpecificNamed(expr, specificException, aName, description, ...)

STFail(description, ...)

STAssertTrueNoThrow(expression, description, ...)STAssertFalseNoThrow(expression, description, ...)


Basic Unit Test Example


40/81

Basic Unit Test Example

*Test.m


Test Target


41/81

- (void) testSimple {

Simple* simple = [[[Simplealloc] init] retain];

STAssertEquals(3, [simple coolMethod], @"");

[simple release];}

Test TargetClasses under test must also target Test target or

add your application target as direct dependency

Solutions



42/81

Debugging Unit Tests



43/81



44/81

NSLog does not even work by default



45/81

http://www.grokkingcocoa.com/how_to_debug_iphone_unit_te.htmlThursday, January 13, 2011
http://www.grokkingcocoa.com/how_to_debug_iphone_unit_te.htmlhttp://www.grokkingcocoa.com/how_to_debug_iphone_unit_te.html


46/81

Delete the Run Script


47/81

Delete the Run Script

Delete


Create otest Executable


48/81

/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/

iPhoneSimulator3.1.sdk/Developer/usr/bin/otest

Create otest Executable


Configure Arguments


49/81

Configure Argumentsname of

unit testbundle

I dontevenknow


Run Tests


50/81

Run Testswith unit test target and

executable selected !

orBuild > Build and Go

test resultsThursday, January 13, 2011

Run Tests


51/81

Run Testswith unit test target and

executable selected !

orBuild > Build and Go

test resultsNo more RedbarThursday, January 13, 2011


52/81

Additional

Unit TestingThoughts


http://www.mulle-kybernetik.com/software/OCMock/
http://www.mulle-kybernetik.com/software/OCMock/http://www.mulle-kybernetik.com/software/OCMock/


53/81

p y

hamcrest http://code.google.com/p/hamcrest/

http://code.google.com/p/uispec/

http://code.google.com/p/uispec/http://code.google.com/p/uispec/http://code.google.com/p/hamcrest/http://code.google.com/p/hamcrest/http://www.mulle-kybernetik.com/software/OCMock/


54/81

Functional Testing



55/81

UI Automation



56/81

Included in



57/81



58/81

Device Simulator



59/81


60/81

Running

UI AutomationScripts



61/81

1. Start Instruments

2. Select Automation Instrument

3. Select Target App4. Select Script5. Record (Play)


Test Results


62/81



63/81

Element Tree


64/81

UIATarget

UIAApplication

UIAWindow

UIANavigationBar

UIATableViewUIATableCell

Element Tree

UIATarget.localTarget().frontMostApp() .mainWindow().tableViews()[0].cells()[0]


Technique to visualize element tree


65/81

UIATarget.localTarget() .logElementTree();

q



66/81


67/81

Instead of

window.scrollViews()[0].textViews()[0].setValue("CodeMash is cool!!!");

window.scrollViews()[0].textViews()["note"].setValue("CodeMash is cool!!!");

use



68/81

UITarget.localTarget().captureScreenWithName("help_screen");

Does not work in simulator :(



69/81

When things dont work



70/81

When things dont work

UIATarget.delay(1);

add


Make it easier with tuneup
https://github.com/alexvollmer/tuneup_jshttps://github.com/alexvollmer/tuneup_jshttps://github.com/alexvollmer/tuneup_js


71/81

Make it easier with tuneupprovides templates and asserts

https://github.com/alexvollmer/tuneup_jsThursday, January 13, 2011

Page Object
https://github.com/alexvollmer/tuneup_jshttps://github.com/alexvollmer/tuneup_jshttps://github.com/alexvollmer/tuneup_jshttps://github.com/alexvollmer/tuneup_jshttps://github.com/alexvollmer/tuneup_jshttps://github.com/alexvollmer/tuneup_jshttps://github.com/alexvollmer/tuneup_jshttp://www.cheezyworld.com/2010/11/09/ui-tests-not-brittle/


72/81

http://www.cheezyworld.com/2010/11/09/ui-tests-not-brittle/Thursday, January 13, 2011
http://www.cheezyworld.com/2010/11/09/ui-tests-not-brittle/http://www.cheezyworld.com/2010/11/09/ui-tests-not-brittle/http://www.cheezyworld.com/2010/11/09/ui-tests-not-brittle/


73/81

works with other instrumentscan run in the simulator or the device

no command-line automationno fixtures (setup, teardown)

difficult to debug (element tree & delays)little documentationtest run must be manually stopped


UI Automation Resources


74/81

UI Automation Resources

UI Automation Reference Collectionhttp://developer.apple.com/library/ios/#documentation/DeveloperTools/Reference/UIAutomationRef/_index.html

Session 306 - Automation User Interface Testing withInstruments

http://developer.apple.com/library/ios/#documentation/DeveloperTools/Reference/UIAutomationRef/_index.htmlhttp://developer.apple.com/library/ios/#documentation/DeveloperTools/Reference/UIAutomationRef/_index.html


75/81

iCuke

https://github.com/unboxed/icukeThursday, January 13, 2011

Cuke Script
https://github.com/unboxed/icukehttps://github.com/unboxed/icukehttps://github.com/unboxed/icuke


76/81

Cuke Script



77/81

can be automatedhuman readableeasy to write

can only run on simulator

little documentationcan not run in instruments


Resources


78/81

http://pragprog.com/magazines/2010-07/bdd-on-iphone-icukeThursday, January 13, 2011

Great iOS Resources
http://pragprog.com/magazines/2010-07/bdd-on-iphone-icukehttp://pragprog.com/magazines/2010-07/bdd-on-iphone-icuke


79/81

Great iOS Resources




80/81

President/Consultant/Author

email: [email protected]

web: www.juddsolutions.com

blog: juddsolutions.blogspot.comtwitter: javajudd

Christopher M. Judd


Attributions
mailto:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]


81/81

http://www.organicdesign.co.nz/File:Warning.svg

Attributions

http://www.flickr.com/photos/heliotrop3/4310957752/
http://www.flickr.com/photos/heliotrop3/4310957752/http://www.flickr.com/photos/heliotrop3/4310957752/http://www.organicdesign.co.nz/File:Warning.svghttp://www.organicdesign.co.nz/File:Warning.svg

unit and functional testing for ios platform

Documents