Download - Using Virtualization to Improve Testing
Using Virtualization to Improve Testing
Anil DesaiIEEE Computer Society, Austin Chapter
April 18th, 2007
Speaker Information Anil Desai
◦ Independent consultant (Austin, TX)◦ Author of virtualization books and articles
Managing / Scripting Microsoft Virtual Server SearchServerVirtualization.com The Definitive Guide to Virtual Platform Management
◦ Info: http://AnilDesai.net or [email protected]
I. An Overview of Virtualization Technology
II. Virtualization Features & Scenarios
III. Virtualization Benefits for Dev/Test
IV. Comparing Virtualization Approaches
V. Using Virtualization Features for Dev/ Test
VI. Managing and Optimizing Virtualization
Presentation Overview
An Overview of Virtualization
Technology
Virtualization abstracts the underlying physical structure of various technologies◦ Examples:
Storage virtualization Network virtualization
Server virtualization◦ Creates multiple isolated environments◦ Allows multiple OS’s and workloads to run on the same
physical hardware◦ Solves the problem of tight coupling between OS’s and
hardware
What is Virtualization?
Virtualization Architecture
Benefits of Virtualization
Virtualization Scenarios
Simplified administration Hardware
independence/portability Increased hardware
utilization Server consolidation Decreased provisioning
times Improved security
Software Development Testing / Quality
Assurance Product evaluations /
demonstrations Training Disaster Recovery
Virtualization Features
Emulated Hardware Platform
Component Specifications
Chipset Intel 440BX
CPU Based on the host CPU (single CPU only)
BIOS AMI BIOS
Video S3 Trio 32/64 with 4MB of video memory
Memory Up to 3.6GB
Input Devices PS/2 Mouse and Keyboard
Floppy Drives Up to two 1.44MB 3.5” floppy drives
Communications Ports
2 Serial Port1 Parallel Port
IDE Controllers Two channels, each of which supports up to two devices each (up to four IDE total devices)
SCSI Controllers Up to four Adaptec 2940 SCSI Controllers (each supports up to 7 devices; 28 devices total)
Network Interfaces
Up to four Intel 21140 10/100Mb network interface cards
Understanding Virtual Hard Disks
Virtual Network Overview
Virtual Network Examples
Virtualization Features & Scenarios
Deployment StepsPlanning
• Determining hardware requirements• Coordination with business leaders
Purchasing• Hardware selection• Approvals processes• Budgeting
Physical Deployment• Finding rack space• Physical "racking"• Network and power connections
Server Configuration• OS Settings• Application installation• Network Settings
Server Consolidation
Load-Balancing
Training / Test Labs
Getting Started◦ Migrate existing apps / physical machines◦ Create new virtual machines from scratch
Virtualization may not work well for:◦ Resource-intensive applications
VMs may have RAM/CPU/SMP limitations◦ Performance testing◦ Hardware compatibility testing◦ Specific hardware requirements
USB Custom hardware devices
Virtualization Candidates
Conversion of an existing physical machine into a virtual machine◦ Operating system, settings, and all data
Physical-to-Virtual (P2V)
Virtualization Benefits for
Development / Testing
Simplified Administration Duplicating / recreating intermittent
problems Quick Deployment Portability (Moving / Copying VMs)
◦ For troubleshooting and recreating defects◦ Load-balancing
Standardized hardware configuration State management for virtual machines
Technical Benefits for Dev/Test
Setting up a complex test lab◦ Testing multi-tier applications ◦ Isolated networks◦ Simulating multiple clients
Rapid setup and tear-down of test environments◦ Consistent configurations◦ Ability to easily roll-back changes◦ Automation of VM setup and software installation
Development/Testing-Related Scenarios
Can revert virtual machines to their initial state
Can create “snapshots” after changes◦ Can roll back to a particular
snapshots
Virtual Machine Roll-Backs
Estimating VM Resource Requirements
Number of VMs Estimated
memory per VM Estimated disk
space per VM Resource usage
estimates
VM Name CPU Memory Disk Network
WebApp01 Low Low Medium High
WebApp02 Low High Low Low
WinXPTest Low Low Medium Low
FileServer01 Low Medium High High
Determining VM Placement
Workload CPU Util. Memory Util. Disk Util. Network Util.
Public Web Server
Low Low Low High
Web Application Server
Medium Medium Low Medium
Middle-Tier Server (CRM Application)
Medium High Low Low
Database Server (CRM Application)
High High High Medium
Approach: Categorize VMs based on resource utilizationCombine VMs that have “compatible” workloads
Comparing Virtualization
Solutions
Virtualization Approach Overview
Applications
• Server applications• Office productivity applications
Operating System
• Device Drivers• Services
Hardware
• CPU, Memory, Disk, Network hardware• Other peripherals
Server-Level Virtualization Example
•Supported guest OS's•Windows XP, Windows Server 2003, Linux, etc.
Virtual Machines
•Microsoft Virtual Server 2005 R2
Virtualization Layer
•Windows Server 2003 R2•Device Drivers
Operating System
•CPU, Memory, Disk, Network•PeripheralsHardware
Application-Layer Virtualization
• Citrix, Microsoft SoftGrid, Terminal Services
Server Virtualization
• VMware Server, Microsoft Virtual Server
Hardware-Level Virtualization
• VMware ESX Server, XEN, Microsoft Hypervisor (“Viridian”)
Desktop Virtualization
• Virtual PC 2007, VMware Workstation, Parallels Workstation
Virtualization Options
Virtual Server vs. VirtualPC
Virtual Server 2005 VirtualPC
Improved performance (multi-threaded)
Web-Based Administration
Scripting and automation support (COM API)
Improved security Advanced networking Manageability SCSI Device Support Reliability/availability
features (clustering)
Optimized for one or a few concurrent VMs (single-threaded)
Simplified administration
Sound card emulation Easier file sharing Automatic client
desktop resizing
Selecting the Best ApproachWorkload Virtualization
RecommendationNotes
Datacenter Server Consolidation
Hardware-Level orServer-Level
Performance is a key factor
Server applications are typically complex
Software Development and Testing Environments
Server-Level Manageability is a key requirement.
Users must be able to change hardware settings and OS levels.
Sharing End-User Productivity Applications
Application-Level orRemote Application Execution
Scalability is important. Applications are less
complex.
Using Virtualization for Development and Testing
Create overall test plans and requirements◦ OS and version requirements◦ Service Packs / updates, etc.◦ Hardware configurations for VMs
CPU, Memory, Disk Space, Network configuration Create a naming convention for VMs Create base images Create network address conventions
◦ IP address ranges and subnets◦ Support for multi-tier applications◦ Multiple networks (host-only, routed, NATs, etc.)
Setting up a Test Lab
Designing Base VM Images Goals:
◦ Minimize the number of base images◦ Include as much functionality as possible
Base Client•Windows XP Professional Ed., SP2•Backup Agents•Anti-malware utilities•Security settings
Base Server
•Windows Server 2003 R2•Backup Agents•Anti-malware utilities•Security settings
Database Server
•All Base Server Components, plus:•SQL Server 2005 SP1•Database security configuration
Disk Hierarchy Example
Windows Server 2003
Windows Server 2003 R2
SQL Server 2000 SP4
SQL Server 2005 SP2
Web Server (IIS 6.0 enabled)
Web Server with SQLExpress database
Media-based deployments◦ Automatic mounting of ISOs
Network-based installations◦ Automated OS Deployment
Image-based or PXE Booting◦ Application Deployment
OS Startup Scripts and Network shares
Third-party software distribution tools
Deploying Software
Presentation Servers
Application Servers
Data Access Layers
Database Servers
Operating System / Network Services
Creating Application Stacks
Common operations can be scripted or automated
Test Lab Management Applications◦ Web-based◦ Client-based
Automating Virtualization
Virtual Server COM API
Managing & Optimizing
Virtualization
Establish a base library of images◦ Ensures consistency◦ Helps in troubleshooting◦ Prepare VMs for duplication (SysPrep)
Create a Library of ISO files Manage virtual machines as if they were physical
machines◦ Security updates
Automatic Updates (if supported in Guest OS) Microsoft Baseline Security Analyzer (MBSA) Windows Server Update Services (SUS)
◦ Patches◦ Corporate security standards
Configure anti-spyware / anti-malware exceptions◦ *.vhd, *.vud, *.vsv, *.iso
VM Maintenance
Profile your applications◦ Windows System Monitor
Counter Logs◦ Event Viewer◦ Task Manager◦ Windows Management Instrumentation (WMI)◦ Microsoft Operations Manager (MOM)◦ Systems Management Server (SMS)
Monitoring Approach:◦ Host Server: Aggregate performance data◦ Guest OS: Detailed resource usage
Managing Performance
VM Backup and Recovery Backup and Recovery
◦ Option 1: Shut down/save state of the VM Copy all required files. Resume the VM
◦ Option 2: Use Backup Agents within the Guest OS.
Automating backups:◦ Build scripts/applications to automate virtual machine
backup and recovery: 1) Save state of the virtual machine 2) Copy all related files 3) Resume the virtual machine
Backup VM files from the host file system Host-Level Backup Options:
Implementing Host-Level Backups
Cold Backups
•Stop VM & copy files•Can be scripted•Longest downtime
Warm Backups
•Pause VM & copy files•Minimal downtime
Hot Backups
•Backup while VM is running•File system snapshots•Can be risky
For More Information Resources from Anil Desai
◦ Web Site (http://AnilDesai.net)◦ E-Mail: [email protected] ◦ Keystone Learning Course:
“Microsoft SQL Server 2005: Implementation and Maintenance (Exam 70-431)”
◦ The Rational Guide to Managing Microsoft Virtual Server 2005
◦ The Rational Guide to Scripting Microsoft Virtual Server 2005
Summary / Conclusion
Q & A, Discussion