jeff bramwell enterprise applications architect farm credit services of america jeff bramwell...

19
Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Creating Quality Software A Look at Visual Studio 2010 Testing Tools September 10 th , 2010 Russ Wagner Director of Enterprise Architecture Farm Credit Services of America

Upload: magdalen-powers

Post on 24-Dec-2015

220 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Jeff BramwellEnterprise Applications ArchitectFarm Credit Services of America

Creating Quality Software

A Look at Visual Studio 2010 Testing Tools

September 10th, 2010

Russ WagnerDirector of Enterprise ArchitectureFarm Credit Services of America

Page 2: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Omaha Team System

User GroupTake the Survey!

http://bit.ly/OTSUGSurvey

www.OTSUG.org twitter.com/OmahaTSUG

Page 3: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Visual Studio 2010 Test ToolsVisual Studio 2010

Professional

Visual Studio 2010

Premium

Visual Studio 2010

Ultimate

Visual Studio

2010 Test Professiona

lLab Management

Microsoft Test Manager

Basic Unit Tests

Run Only

Generic Tests

Ordered Tests

Coded UI Tests

Load Tests

Web Perf. Tests

Test Impact Analysis

Code Coverage

Database Unit Tests

Page 4: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of
Page 5: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Test Manager

− Create:− Test plans− Test suites− Test configurations− Test cases

− Shared Steps

− All artifacts stored within TFS

Page 6: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Manual Tests are Fun!

Page 7: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Test Manager (cont’d)

− Create and run manual tests− File bugs− Manual tests can be recorded

− Use recordings to “fast forward” through tests

− Can also be used to created Coded UI Tests

− Inputs can be parameterized

Page 8: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Work Item Types

− Test Case− Test actions− Expected results− Parameter values− Related items− Etc.

− Shared Steps− One or more test steps shared across test

cases

Page 9: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Data Collection

− Records:− Actions− ASP.NET Client Proxy− Event Log− IntelliTrace− Network Emulation− System Information− Test Impact− Video Recorder

Page 10: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Automation is Better!

Page 11: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Coded UI Tests

− Provides automated UI testing− Support for WinForms, WPF, & ASP.NET

− Silverlight support expected by end of year− Can convert manual tests to Coded UI

tests− Can create by recording user actions− Inputs can be data-driven

(parameterized)− Test cases can be linked to user

requirements− C# and VB supported

Page 12: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Demo

Page 13: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Changes Wrecked Your Tests?

Page 14: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Test Impact View

− Identifies − Code Changes− Calling Test− Impacted Tests

− Run/Debug existing tests− Obfuscated binaries not supported

Page 15: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Traditional Load Testing

Page 16: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Load Test

− Executes test(s) based on test scenario

− Supports all test types

− Supports network and browser emulation

− Run ad-hoc or as part of a scheduled build

Page 17: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Demo

Page 18: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of
Page 19: Jeff Bramwell Enterprise Applications Architect Farm Credit Services of America Jeff Bramwell Enterprise Applications Architect Farm Credit Services of

Resources and Links− Omaha Team System User Group

− www.otsug.org − Testing the Application

− http://bit.ly/VisualStudioTesting − Coded UI Tests Supported Platforms

− http://bit.ly/CodedUIPlatforms − Visual Studio 2010 Test Case Import Utilities

− http://tcmimport.codeplex.com/− Test Scribe

− http://bit.ly/TestScribe − Visual Studio Hands-on-Labs and Sample Data

− http://bit.ly/VS2010HOL

− Remote Test Runner− http://rtr.codeplex.com

Jeff

Bra

mw

ell

jbra

mw

ell@

ots

ug

.org

Ru

ss W

ag

ner

rwag

ner@

ots

ug

.or

g