acceptance & integration testing with behat (pbc11)

Acceptance & Integration

Testing Using Behat

Ben WaineEmail: [email protected]

Twitter: @bwaine

Saturday, 29 October 11

mailto:[email protected]

mailto:[email protected]

Pair Programming

Say hello to the person next to you....


Set Up

USB Stick


Set Up

For instant set up:

1) Copy code into a new vhost with the web root pointing at the ‘public’ folder.

2) Uncomment line 13 in: tests/acceptance/features/bootstrap/UIContext.php

3) Install Sahi from the misc folder.


Set Up

If setting up today run the Behat command using behat.phar

eg: php behat.phar --tags demo1

If you have previously set up, run the behat command

eg: behat --tags demo1

Goto: tests/acceptance/


Me

Sky BetPHP / MySQL Stack

PHPUnit / Selenium / Behat

Software EngineerPHP Developer


Roadmap

•Intro To Behaviour Driven Development

•Introducing Behat

•Gherkin & Steps

•API / Service Layer Testing

•UI Testing

•Phabric - Dynamic Fixture Creation


joind.in

http://joind.in/talk/view/4328




What Marco Said......


Stories


What is BDD?


Introducing Behat....


Resistance is futile.......Saturday, 29 October 11

Origins in Rubys cucumber

What Does It Test?

ScriptsAPI’s

Web PagesModels


Integration Testing !=

Unit Testing


Anatomy Of A Behat Test



Describes the behaviour in a storyHuman ReadableSamples Later


PHP that maps to lines of the gherkin.Behat parses gherkin and runs the associated steps.

Writing Behat Tests

$ben > cd /path/to/projects/tests$ben > behat --init


Bootstrap Behat. Provides you with a structure

Writing Behat Tests


Feature Files

Feature: Home Page When visiting the PHPCon site As a site visitor I need to be able to see what ` conferences are coming up


Name of testDescription of test

ScenariosScenario: Get all conferences Given there is conference data in the database When I go to the homepage Then I should see three conferences in a table


Scenario. Multiple scenarios in a single feature file

ScenariosGiven

(Some Context)

When (Some Event)

Then (The Outcome)


Keywords. Always follow the same formula

Given (Some Context)

Given there is conference data in the database


Sets up some state or context

When (Some Event)

When I go to the homepage

When I use the findConferences method

When I am on "/index.php"

When I fill in "search-text" with "PHP"


Executes whatever it is your testing. A http call, a method invocation, a page load

Then (The Outcome)

Then I should see three conferences in a table

Then I should get a array of three conferences

Then I should see "PHPNW"


An assertion.Has it worked? Are we seeing what we expect to see.

ConferenceService.feature

Feature: ConferenceService Class In order to display conferences on PHPCon site As a developer I need to be able to retrieve conferences

Scenario: Get all conferences Given there is conference data in the database When I use the findConferences method Then I should get a array of three conferences AND it should contain the conference “PHPNW”


Written By our TESTERS - Fed In From BAsHow is this feature executed?Each step is reusable! MENTION PHP METHODS + ANNOTATIONS!!!!

Class Methods & Annotations


Written By our TESTERS - Fed In From BAsHow is this feature executed?Each step is reusable! MENTION PHP METHODS + ANNOTATIONS!!!!

/ Everybody Stand Back /

Behat Knows Regular Expressions


PHP Annotations used to map steps to linesBehat supplies regex.

Demo One

Behat’s - Regex Fu


Introducing....... The Sample Domain


My Amazing PHP Conference Website


Service Layers


Demo One


Fill in the Feature Context File public function __construct(array $parameters) { $params = array( 'user' => $parameters['database']['username'], 'password' => $parameters['database']['password'], 'driver' => $parameters['database']['driver'], 'path' => $parameters['database']['dbPath'], );

$con = \Doctrine\DBAL\DriverManager::getConnection($params);

$confMapper = new \PHPCon\Conference\Mapper($con); $confService = new \PHPCon\Conference\Service($confMapper);

$this->service = $confService; }


The Feature context file- Ever feature gets a instance. Set up some resources. - Set up the object to test - similar to PHPUnit’s set up method.

Fill in the Feature Context File

/** * @Given /^there is conference data in the database$/ */ public function thereIsConferneceDataInTheDatabase() { $fileName = self::$dataDir .

'sample-conf-session-data.sql'; self::executeQueriesInFile($fileName); }


Remember - Given sets the state.Loads an sql fixture to the DB.

Fill in the Feature Context File

/** * @When /^I use the findConferences method$/ */ public function iUseTheFindConferencesMethod() { $this->result = $this->service->findConferences();

}


Remember - When executes the thing you want to test.

Fill in the Feature Context File /** *@Then /^I should get an array of (\d+) conferences$/ */ public function iShouldGetAnArrayOfConferences

($numberOfCons) { assertInternalType('array', $this->result); assertEquals($numberOfCons, count($this->result)); }


Remember - This verifies the output Also - identified a number. Passes the number into the method.

/** * @Then /^it should contain the * conference "([^"]*)"$/ */ public function itShouldContainTheConference

($confName) { $names = array();

foreach($this->result as $conf) { $names[$conf->getName()] = true; }

if(!array_key_exists($confName, $names)) { throw new \Exception("Conference "

. $confName . " not found"); } }


Exceptions == Test Failures


Passing Behat Test

Demo Two


Exercise One

Testing a service layer with Behat.


Exercise One

Open the PDF in the misc folder. Read through Section One.

Start Coding :)


Failing Test


If exceptions are encountered .....

Passing Test!


What about the UI?


We’ve covered testing a service class. But how do you test the UI?

Mink


Part of the Behat Project.A abstraction over a number of different browser testing tools.

Mink

Goutte Sahi

Zombie.js


Goutte - headless browserSahi - like seleniumZombie.js -

Extend Mink Context

Use Bundled steps to create higher level abstractions.

Includes predefined steps


Back To: My Amazing PHP Conference

Website!


We need a UI to testintroducing.....

Example

Scenario: View all conferences on the homepage Given there is conference data in the database When I am on "/index.php" Then I should see "PHPNW" in the ".conferences" element And I should see "PHPUK" in the ".conferences" element And I should see "PBC11" in the ".conferences" element

Using Minks Bundled Steps


This is ok - but ties the feature to your implementation.

Link FeatureContext.php

to UIContext.php



# features/bootstrap/UIContext.php

use Behat\Behat\Context\ClosuredContextInterface, Behat\Behat\Context\BehatContext, Behat\Behat\Exception\PendingException;

use Behat\Gherkin\Node\PyStringNode, Behat\Gherkin\Node\TableNode;

require_once 'mink/autoload.php';

class UIContext extends Behat\Mink\Behat\Context\MinkContext{

}

class FeatureContext

public function __construct(array $parameters) { $this->useContext('subcontext_alias', new UIContext($parameters));

! // REST OF FEATURE CONSTRUCTOR

}


1) Linking feature files2) All steps included ‘out the box’

Demo Three

A Behat UI Test (Using Mink + Goutte)



Exercise Two

Testing the UI with Mink and the headless browser Goutte.


Exercise Two

Open the PDF in the sources folder. Read through Section Two.

Start Coding :)


Scenario: View all conferences on the homepage Given there is conference data in the database When I am on the "home" page Then I should see "PHPNW" in the "conferences table” And I should see "PHPUK" in the "conferences table” And I should see "PBC11" in the "conferences table”

Abstracting your scenario


class UIContext extends Behat\Mink\Behat\Context\MinkContext{ protected $pageList = array( "home" => '/index.php'); protected $elementList = array( "conferences table" => '.conferences');

Mink Feature Context


A simple abstraction that makes a map of pages > urls and elements > css selectors. Example of step delegation. Now you never change the feature file. Just steps.

/** * @When /^I am on the "([^"]*)" page$/ */ public function iAmOnThePage($pageName) {

if(!isset($this->pageList[$pageName])) { throw new Exception( 'Page Name: not in page list'); } $page = $this->pageList[$pageName]; return new When("I am on \"$page\""); }



/** * @Then /^I should see "([^"]*)" in the "([^"]*)"$/ */ public function iShouldSeeInThe($text, $element) { if(!isset($this->elementList[$element])) { throw new Exception( 'Element: ' . $element . ‘not in element list'); } $element = $this->elementList[$element]; return new Then("I should see \"$text\" in the \"$element\" element"); }



Demo Four

A Behat UI Test (Using Mink + Goutte)UI implementation abstracted away from Gherkin.



Exercise Three

Abstracting the UI implementation away from the Gherkin.


Exercise Three

Open the PDF in the sources folder. Read through Section Three.

Start Coding :)


Javascript Testing withSahi


Back To: My Amazing PHP Conference

Website!


We need a UI to testintroducing.....

@javascriptScenario: Use autocomplete functionality to complete a input field Given there is conference data in the database When I am on the "home" page When I fill in "search-text" with "PHP" And I wait for the suggestion box to appear Then I should see "PHPNW"

Example


Mention @tagsSO you need to test java script. Headless browser isn’t suitable.

@javascriptScenario: Use autocomplete functionality to complete a input field Given there is conference data in the database When I am on the "home" page When I fill in "search-text" with "PHP" And I wait for the suggestion box to appear Then I should see "PHPNW"

Great Reuse


These are supplied by Mink. Woohoo!REUSE

// In the UIContext class /**

* @Given /^I wait for the suggestion box to appear$/ */ public function iWaitForTheSuggestionBoxToAppear() { $this->getSession()->wait(5000, "$('.suggestions-results').children().length > 0" ); }


Get session - gets you minkWait, Then execute jquery!

Demo Five

UI Testing With Sahi



Exercise Four

UI Testing With Sahi


Exercise Four

Open the PDF in the sources folder. Read through Section Four.

Start Coding :)


Data


How do you supply your data?

SQL Fixture


Can be difficult to maintain.Hides Data in a fixture NOT in your scenarios.

Phabric


Demo Five

Dynamic fixture creation with Phabric.



Case Study: Behat at Sky Bet


Whats the problem we are solving.Three elements of the team.Delivering the product first time. Correctly.

The Problem



The Business Analyst


BA / Product owner has all the knowledge Write stories

The Tester


Testers test implementation vs the story

The Developer


Dev - write the codeAutomate the process of testing if code meets the requirements of a story

The Problem



BA’s Write Stories

Testers Write Gherkin

Developers Write Steps + Code

BDD - Skybet Workflow



BDD - Skybet Workflow

Less Defects

Fewer times through this cycle



The Place Of Acceptance & Integration Tests



Balance.


Jason HugginsThe place of acceptance and integration tests

A whole world of trouble.


Takes a long time to run, Harder to implement, when they break you have to do this again!not as reassuring!

joind.in





Questions?


Behat Github Page: https://github.com/Behat/Behat

Mink On Github: https://github.com/Behat/Mink

Website: http://behat.org/

Phabric On Github: https://github.com/benwaine/Phabric

Links


https://github.com/Behat/Mink

https://github.com/Behat/Mink

http://behat.org/

http://behat.org/

https://github.com/benwaine/Phabric




acceptance & integration testing with behat (pbc11)

Technology