i love apis 2015: end to end testing: bug squashing for developers

End To End Testing: !Bug Squashing For API Developers !

Ozan Seymen – Apigee Principal Architect Saulius Zukauskas – Apigee Principal Architect

API testing: agenda

©2015 Apigee. All Rights Reserved.

•  Popular testing methodologies •  API testing best practices •  Popular open source tools

Test-Driven Development

What is Test-driven development?


•  Understand the requirements. •  Write test cases first (and let them all fail!). •  Write code to make tests pass. •  Refactor the code often.

What is Test-driven development?


Is your team doing TDD?


What is important for TDD process to work?


•  Maintaining set of common test cases. •  Getting all development team onboard. •  If possible, get the product owners involved.

Behavior-Driven Development

BDD

“You are not doing BDD until you embrace TDD”

KEEP CALM AND

EMBRACE TDD

(if you want to do proper BDD)


BDD


BDD is a software development process with TDD in its heart

BDD – a software development process




Business analyst

developer

tester

DEFINE DOCUMENT USER STORIES TOGETHER!!!



define / document

automated "tests guide

provide feedback "on progress

specifications use as basis of tests

3 Amigos

developer

tester

business analyst

BDD – ¡Three Amigos!


Specifications – what do they contain?

•  Express the desired behavior and expected outcomes •  Desired behavior that has business value •  Express using examples (specification by example) •  Outside-in

BDD – ¡Three Amigos!


Specifications – How to specify?

•  Semi-formal format borrowed from user story specifications •  BDD imposes no rules – simplicity and standardization •  Dan North and Chris Matts suggested Given/When/Then

BDD – Given/When/Then


Given -  Set of preconditions -  State before action/trigger

When -  An event occurs (trigger/action)

Then -  Assert outcome of the event

GIVEN there is 1 coffee left in the machine and I have deposited 1$, WHEN I press the coffee button THEN I should be served a coffee.

Express behavior in terms of these statements:

BDD – Gherkin


• When you come to document behavior, you need a language • Understood by humans and code • Gherkin – business readable, domain-specific language

BDD – Gherkin


Feature: User trades stocks

Scenario: User requests a sell before close of trading

Given I have 100 shares of MSFT stock

And I have 150 shares of APPL stock

And the time is before close of trading

When I ask to sell 20 shares of MSFT stock

Then I should have 80 shares of MSFT stock

And I should have 150 shares of APPL stock

And a sell order for 20 shares of MSFT stock should have been executed

BDD – benefits of Gherkin


•  Documentation generation •  Executable specifications •  Tooling for editors •  Reusable snippets shared publicly •  Tools integration

Once you have standardized the language…

BDD – testing


Scenario Automated tests Progress feedback

BDD – tooling for automated testing


APICLI

YADDA

Integration Testing

What is integration testing?


•  Very important for API development •  Testing your software components as a group •  Client to API + API to backend system

Integration testing tools for APIs

©2015 Apigee. All Rights Reserved. •  26 ©2015 Apigee. All Rights Reserved.

APICLI

YADDA

Integration testing flow – Apigee-based APIs


Write test cases

Write API bundle code

Deploy API bundle code to Apigee

Run Integration

testing

Refactor

Apickli for API testing


Scenario: As an ecommerce store user I would like to list all the available categories

Given I set User-Agent header to apickli And I set Accept header to application/json When I GET /v1/store/categories Then response code should be json And response code should be 200 And response body should contain categories

Apickli for API testing


Scenario: Correct room availability to airbnb.com whenever I do single night booking Given that the resort [Resort] is set in airbnb.com And the room type [RoomType] is set up in airbnb.com And the hotel has [Available Rooms] rooms available for sale When I make a new single night booking Then airbnb.com should have [bcomNewRoomsToSell] rooms available

Integration testing

DEMO TIME!


Unit Testing

API proxy testing


Do you think it is possible to test an Apigee proxy fully with integration testing?

No…

API proxy testing – integration test enough?


Test Runner Apigee Target Systems

3rd Party Service callouts? Async?

API proxy testing – integration test enough?


Isolation/Coverage

Unit testing – other benefits


•  Code can be tested locally without deployment to Apigee first •  Can create hooks to enforce testing during commit •  Much faster than integration testing

Unit testing – boundary principle


Test within your boundaries – don’t test libraries you don’t control

Unit testing – types of policies


Unit testing – tooling


Unit testing - automation


“Imperfect tests, run frequently, are much better than perfect tests that are rarely run”

Unit testing

DEMO TIME!


Mocking

Mocking – why?


•  Test backend systems are always down •  Test backend systems are slow •  Test backend systems have inconsistent data

End-to-end testing


Oct 14 – 02:50PM APIGEE AND NODE.JS: BUILDING MOCK BACKENDS

Environments

API proxy testing – environments


Environment Apigee Target Data Type of testing Development Mock Target Data and behavior from mocks Full Integration Integration Actual Backend (DEV) Data and behavior from DEV build of

target APIs Partial Integration

UAT Actual Backend (DEV/UAT) Data and behavior from DEV or UAT build of target APIs

Smoke

PRE Actual Backend (PROD) Data and behavior from target APIs in production

Smoke

PROD Actual Backend (PROD) Data and behavior from target APIs in production

Smoke

Smoke testing – API bundle deployed properly, access all target endpoints correctly, certificates deployed correctly, configuration is correct

METRICS

Metrics


Questions?

i love apis 2015: end to end testing: bug squashing for developers

Technology