Newport News Shipbuilding Takes the Pain out of Compliance & TestingSeptember 21, 2016, SAP TechEd Conference
Deborah RogersQA & Automated Test Lead
22
Agenda
• Intro to NNS
• NNS Applications
• Takeaways Summary
• Business Needs & Drivers for Functional Test Automation
• Automation Goals
• Approach
• Project Benefits
• Results
• Best Practices
• Future Plans & Expansion
3
Who We Are – Our Business
• Over a century designing, building, overhauling and repairing ships for the U.S. Navy, the U.S. Coast Guard and world navies
• The nation's sole industrial designer, builder and refueler of nuclear-powered aircraft carriers
• One of only two companies capable of designing and building nuclear-powered submarines
• One of the nation’s leading providers of major surface combatants (destroyers, cruisers, high endurance cutters, and amphibious assault ships) for the U.S. and international navies
• Have built over 40 percent of the U.S. Navy’s current surface combatant fleet
• After-market services – maintenance, repair, and overhaul –
support a wide array of naval and commercial vessels
• A wide variety of products and services to the commercial energy industry and other government customers, including the Department of Energy
4
Core Competencies
Leveraging our world-class facilities, highly skilled workforce and culture of safety, ethics and compliance
Nuclear Operations
Heavy Manufacturing Engineering &Program Management
5
Huntington Ingalls Facts
• Annual revenues of approximately $7 billion and current backlog of $21.3 billion
• Employees: approximately 35,000; largest industrial employer in Virginia, largest private employer in Mississippi
• Key Locations: – NEWPORT NEWS SHIPBUILDING
• Newport News, VA (Nuclear Aircraft Carriers, Submarines, Overhaul)• Virginia Beach, VA (AMSEC, Fleet Support)• San Diego, CA (Continental Maritime of San Diego, Fleet Repair & Support)
• Broomfield, CO (SN3, Nuclear Facility Management and Environmental Remediation)
• Panama City, FL (Undersea Solutions Group, Manned and Unmanned Undersea Vehicles)
• Houston, TX (UniversalPegasus International, Engineering and Project Management Services to Domestic and International Energy Markets)
– INGALLS SHIPBUILDING• Pascagoula, MS (Surface Combatants, Amphibs, CG large cutters)
The Nation’s Leading Military Shipbuilder
6
Newport News Shipbuilding• Sole supplier of U.S. Navy Aircraft Carriers
• One of two builders constructing Virginia- Class nuclear submarines
• Exclusive provider of refueling services for nuclear-powered aircraft carriers
• Largest non-governmental provider of fleet maintenance services to the Navy
• Largest industrial employer in Virginia – about 20,000 employees
• Home of one of the Western Hemisphere’s largest dry docks and cranes
77
What You Will Learn Today
• How Newport News Shipbuilding uses automation for stress-free SOX compliance
• How functional test automation enables over 80% time savings with every regression testing cycle
• How automated business process testing keeps customers happy with reliable quality across EHS, Payroll, and Materials Management processes
88
Key Takeaways
• Learn how you can support compliance with business process documentation, easy-to-capture screenshots and compliance data that make your life and your auditor’s lives easier
• See how to accelerate regression testing cycles so that your team can spend more time on value-added activities and less on manual tasks
• Discover how to avoid testing in silos, quickly uncover defects, improve quality, and achieve high test coverage even in the face of continuous system changes
99
NNS Applications
• SAP®
– including modules for HR, Payroll, Finance, Planning, Scheduling, Materials, EH&S
• .NET
• Mainframe
• C#
• Teamcenter®
1010
Business Needs & Drivers for Functional Test Automation
• NNS required a solution to regression test SAP Support Packs
• Needed end-to-end testing to ensure processes flowed across the enterprise landscape
• Required a tool that could not only support SAP, but also Teamcenter and Windows®
• Desired a solution with no coding involved; Wanted functional team members to be comfortable without the need to learn dedicated programming skills
1111
Automation Goals
• Validate critical business processes to avoid business disruption
• Reduce production defects; Improve the quality of testing
• Quickly build and maintain complex end-to-end tests
• Maintain the integrity of existing systems
• Reduce testing cycles
• Save time and money
• Replicate tests the same way every time for greater confidence
1212
Approach
• Organization & Executive Support: Established support from CIO, Systems Engineering, and Software Development
• Project Start Up & Training: Initially gathered the end-to-end workflow processes with the input of 20 team members.
– Today only one person manages the “cradle to grave” tests.
• Building the Automation Portfolio: Developed a centralized, robust library of mission critical repeatable tests, sorted by business process
1313
Audit Documentation for SOX Compliance
Screen shots obtained from a demonstration Worksoft system
1414
Audit Documentation for SOX Compliance
Screen shots obtained from a demonstration Worksoft system
1515
Goods Receipt with Execution Log
Screen shots obtained from a demonstration Worksoft system
1616
Time Entry with Execution Log
Screen shots obtained from a demonstration Worksoft system
1717
Planning Run with Execution Log
Screen shots obtained from a demonstration Worksoft system
1818
MRP List with Execution Log
Screen shots obtained from a demonstration Worksoft system
1919
Approach
• Moving to Automated Document Generation: Used Worksoft Certify Business Process Procedure™ (BPP) to create automated documentation for auditors to ensure SOX compliance
– BPP is very customizable; Ability to include use filters; Include an expansive level of detail
– Screen shots are saved with testing steps– System used to capture before and after screen shots (which are
timely to produce manually)– Automated system set up to collect critical data– Technical level of detail is critical for auditors
2020
Certify Business Process Procedure
Screen shots obtained from a demonstration WorkSoft system
2121
Certify BPP Template List
Screen shots obtained from a demonstration WorkSoft system
2222
Audit Documentation for SOX Compliance
2323
Results
Business Process Coverage• NNS is using Worksoft Certify® to automate the functional testing of processes that
support key areas in Planning, Scheduling, Materials Management, Group Pegging and Distribution, Inventory management, Payroll, Radiological controls
• 90% of tests to support highly critical business processes have been completed• 47 business process scenarios (workstreams) covered
Greater Frequency in Quality Assurance & Defect Identification• 200 regression tests run 6 times a year, every other month. • Previously 16 team members ran tests manually – spending 177 hours.• Staff has their time back. Now, automated run time is less than 40 hours. This
includes time spent on “fixes” and repairs. • Testing prior to releases uncovers defects headed for production. Team able to catch
and fix before production.
2424
Project Benefits
• Reduced Test Cycles: Regression testing time is reduced from 4 weeks to 1 week
• Time Savings: 80% time savings
• More Defects Uncovered: defects detected before entering production (greater defect removal efficiency)
• Getting Time Back: Systems engineers and software development analysts were both needed for testing previously. Now systems engineers are dedicated to other higher value-added projects
• Improved Quality: More comprehensive, reliable test coverage for EHS, Payroll, and Materials Management business processes
• Capturing “Tribal” Knowledge: Knowledge has been centralized & documented
2525
Best Practices & Learnings
• Training is Key: NNS arranged for 20-30 team members to be available part-time over a 6 week time frame to get mission-critical tests up and running; Create a central resource for knowledge.
• Map Out Business Processes: Take the time to do this. Key learnings take place during the process!
• Utilize Experts: NNS subject matter experts and a Worksoft consultant worked closely to map the connections of each system across the enterprise landscape. This core understanding was critical for fast start up.
2626
Future Plans & Expansion Beyond SAP
Increase Customization of SOX Compliance Documentation• Want to continue to impress auditors with comprehensive data
Expansion in Testing Beyond SAP• Plans for C#, .net, mainframe applications testing• Teamcenter (Siemens PLM)
2727
Citations
• SAP® is the registered trademark of SAP SE in Germany and in several other countries.All SAP screen shots used with permission from SAP SE.
• Worksoft® Worksoft Certify® and Worksoft Certify Business Process Procedure® are registered trademarks of Worksoft, Inc.
All Worksoft screen shots used with permission from Worksoft, Inc.
• Teamcenter® is a registered trademark of Siemens Product Lifecycle Management Software Inc.
• Windows® is a registered trademark of Microsoft.
• Individual elements of this presentation may not be copied or distributed without the express written consent of Huntington Ingalls Industries.