crmug uk november 2015 - testing testing! panel discussion with scott durow, sarah critchley and...
TRANSCRIPT
explore
engage
elevate
Testing, Testing!Chair: Scott Durow, MVP
Panel: Sarah Critchley and Priscilla Tse
13:45 – 14:35
explore engage elevate
Scott Durow – Dynamics CRM MVP
Solution Architect
CRMUG Committee Member
Dynamics CRM MVP
Email: [email protected]
Twitter: @scottdurow
Blog: http://scottdurow.develop1.net
explore engage elevate
Sarah Critchley
Developer & Consultant
Experience with CRM 2011, 2013 & 2015 in both Online and On-Premise environments
Passionate about CRM
Email: [email protected]
Twitter: @DynamicCRMCat
Blog: crm.fueledbysleep.com
explore engage elevate
Priscilla Tse
Technical Team Lead, Senior CRM Technical Consultant, Technical Writer
Experienced in end-to-end implementation of Dynamics CRM4 to CRM2015/online for government agencies, health sectors and multinational cooperation.
Email: [email protected]
Blog: DynamicsCRMGirl.wordpress.com
LinkedIn: https://uk.linkedin.com/pub/priscilla-tse/14/9b3/a41
explore engage elevate
Bridging the gap
You are here!
Happy UsersUSER ACCEPTANCE
TESTING
………………………
Software is tested in the
"real world" by the intended
audience or business
representatives
INTEGRATION, SYSTEM &
REGRESSION TESTING
………………………
Combine software together
and ensure it meets
requirements with no
unwanted side-effects
UNIT TESTING
………………………
Isolate small pieces of
testable software and
ensure it behaves as you
expect
explore engage elevate
Let’s collaborate together and answer…
explore engage elevate
Case Study – Upgrade of CRM4 to CRM Online
explore engage elevate
Infinite Time & Budget?
100% Unambiguous Requirements?
Massive Dedicated Test Team?
Let’s be pragmaticand not
theoretical!
explore engage elevate
Unit Testing Challenges (from discussions)
Moqs and fakes working for the tests (automated testing)
Javascript is a challenge to unit test (all client side) –multiple browsers and things are difficult to control
Scalability testing (Possible performance issues)
Standardisation between developers – is everyone writing the same way? Practicing standards
Testing data migration is difficult at this stage
Commenting code/tracing and knowledge transfer (can cover all of them)
explore engage elevate
Integration, System & Regression Test Challenges (from discussions)
Developers understanding specification and not working straight away
Testing security roles
Configuration entities – testing right setup
Firewalls/infrastructure challenges (environmental readiness) – Dev -> QA -> UAT
Mobile and different applications
explore engage elevate
User Acceptance Test Challenges (from discussions)
Time Commitments and the cascade in this (time management) – scheduling in this time
Control of changes and coherent release tracking – bug tracking which things have been fixed and which things haven’t
The above point if is particular for retesting also
Positive test evidence
Data and how this is relevant to the user
Differences between test and live and mismatches
Good representation of tests
The difference between training and testing (chicken and egg) and avoiding bias
Representative users to do representative things/roles – replicating a normal and a non-typical day
Feedback being sent back e.g. what did it do to not work, what are the replication steps.
explore
engage
elevate
5 minutes of…
Unit TestingScott Durow
explore engage elevate
♥
explore engage elevate
AAA
ASSEMBLE
ACT
ASSERT
explore engage elevate
AAA
ASSEMBLE
ACT
ASSERT
explore engage elevate
Reasons why Unit Testing fails to deliver value…
explore engage elevate
Top Reason Unit Testing fails to deliver value…
explore
engage
elevate
5 minutes of…
QA & Formal TestingSarah Critchley
explore engage elevate
Sarah’s Top tips - QA & Formal Testing
Know what your testing
Business Processes vs Documented Functionality
WHAT are you doing?! WHY are you doing it?!
explore engage elevate
Sarah’s Top tips - QA & Formal Testing
What are you testing? Why are you testing it?
• Business Process
• Documented Functionality
explore engage elevate
Sarah’s Top tips - QA & Formal Testing
Formal testing techniques
Shooting for and around the goal
Positive & Negative Testing
explore engage elevate
Sarah’s Top tips - QA & Formal Testing
Exploratory testing
Testing without an Ego
Benefits and Challenges
explore
engage
elevate
5 minutes of…
User Acceptance TestingPriscilla Tse
explore engage elevate
User Acceptance Testing (UAT) … Involves …
UAT
Testers
Test System
Test Scripts
explore engage elevate
Test Scripts: Start Early and Iterate
Test Scripts
explore engage elevate
Test System: Is Built By …
Test System
Dev Team
Data Migration Team
Deployment Team
Collaboration
explore engage elevate
Testers: Support UAT Testers
Testers / End Users
Quality Feedback
Product Champion
explore
engage
elevate
Call to action: Accept and expect bugs and work
together to find them as early as possible.
explore
engage
elevate
Final thoughts?
explore
engage
elevate
Please fill in your feedback forms for this session!