emc data domain for archiving are you kidding?...may 31 10.6 tb 19x 554 gb june 30 15.4 tb 21x 706...
TRANSCRIPT
1
EMC Data Domain for Archiving – Are You Kidding?
Bill Roth / Bob Spurzem EMC
EMC
SYMANTEC VISION 2012
Agenda
• EMC Introduction
• Data Domain Enterprise Vault Integration
• Data Domain NetBackup Integration
• Q & A
2 EMC
SYMANTEC VISION 2012
EMC Introduction
3 EMC
SYMANTEC VISION 2012
Data Domain:
Leadership and Innovation A history of industry firsts
First deduplication NAS
First deduplication volume replication
Largest deduplication
array
First deduplication directory replication
First deduplication virtual tape library
First deduplication nearline storage
Fastest backup controller
Cascaded replication
2003 2004 2005 2006 2007 2008 2009 2010 2011 2012
First distributed processing
First long-term retention
system for backup and
archive
First inline deduplication for
compliant archiving
SYMANTEC VISION 2012
Deduplication Dramatically Reduces Storage Capacity Requirements
Deduplication 10–30 times less data stored versus fulls + incrementals with typical retention policies
0
10
20
30
1 5 10 15 20
Weeks in Use
Dat
a St
ore
d
Deduplication storage
Traditional storage
SYMANTEC VISION 2012
Backup Data Reduction/Deduplication Time series of large enterprise implementation
48%
46%
40%
27%
24%
15%
7%
6%
4%
8%
12%
15%
16%
14%
14%
15%
16%
14%
7%
17%
22%
25%
28%
31%
10% 13%
18%
20%
26%
21%
25%
1H '11
1H '10
2H '09
1H '09
2H '08
2H '07
In Use Now In Pilot/Evaluation In Near-term Plan In Long-term Plan Past Long-term Plan Not in Plan
Over three years, in-use rates for backup with deduplication have risen from 15% to 48%
Source: Wave 15 Storage Study – Q2 2011, published 5/16/11, large-enterprise sample; H ‘07, n=151; 2H ‘08, n=127; 1H ‘09, n=147; 2H ‘09, n=182; 1H ‘10, n=146; 1H ‘11, n=31;TheInfoPro (www.theinfopro.com)
SYMANTEC VISION 2012
Data Domain Basics Easy integration with existing environment
Replication
CIFS, NFS, NDMP
Ethernet
Virtual Tape Library (VTL) over
Fibre Channel
DD890 appliance
Control Tier
Target Tier Disaster Recovery Tier
DD890 appliance
Backup and Archive Applications
EMC
Symantec
CommVault
IBM
HP
Veeam
Quest
SYMANTEC VISION 2012
Second Friday Full Backup
B C D E F L G H
Data Deduplication: Technology Overview Store more backups in a smaller footprint
A B C D E F G H I J
Friday Full Backup
A B C D A E F G
Mon Incremental A B H
Tues Incremental C B I
Thurs Incremental A C K
Weds Incremental E G J
Backup Estimated
Data Logical Reduction Physical
Monday Incremental 50 GB 7–10x 5 GB
Tuesday Incremental 50 GB 7–10x 5 GB
K L
Wednesday Incremental 50 GB 7–10x 5 GB
Thursday Incremental 50 GB 7–10x 5 GB
Second FRIDAY FULL 1 TB 50–60x 18 GB
TOTAL 2.2 TB 7.6x 288 GB
FRIDAY FULL 1 TB 2–4x 250 GB
SYMANTEC VISION 2012
Retain: Store More for Longer with Less Over one year of retention in 3U of Data Domain deduplication storage
Week 1
Backup Cumulative Estimated Physical
Data Logical Reduction
April 14 3.4 TB 10x 326 GB
April 21 4.6 TB 13x 364 GB
April 28 5.8 TB 14x 402 GB
May 31 10.6 TB 19x 554 GB
June 30 15.4 TB 21x 706 GB
TOTAL 15.4 TB 21x 706 GB
April 7 2.2 TB 8x 288 GB
Week 2
Week 3
Month 1
Month 2
Month 3
First Full 1 TB 4x 250 GB
SYMANTEC VISION 2012
Data Integrity: Data Invulnerability Architecture
Other RAID 6 NVRAM Snapshots
End-to-end data verification Checksum Deduplication, write to disk Verify
Self-healing file system Cleaning Expired data Defrag Verify
Deduplication
Local Compression
RAID
File System
Generate Checksum
Verify Data
Verify the file system metadata integrity
Verify user data integrity
Verify stripe integrity
End-to-end data verification
SYMANTEC VISION 2012
Data Domain Infrastructure and Ecosystem Supports a variety of workloads and data types
VMware Microsoft Exchange Microsoft SharePoint Oracle, SAP Other
Application Servers Midrange and Mainframe
EMC DLm1000
Application Storage
NAS, SAN, DAS
Symantec NetBackup Symantec Backup Exec
Backup Applications
Symantec Enterprise Vault
Archive Applications
Primary storage
Network
Disaster Recovery
Replication over WAN
IBM i
SYMANTEC VISION 2012
EMC Data Domain Enterprise Vault Integration
12 Presentation Identifier Goes Here
SYMANTEC VISION 2012
• Support for E-Mail, SharePoint, and File-System Archiving (FSA)
• EV 8 Introduced new “Data Domain” storage type
– Makes EV8 aware that the DDR appliance provides compression, deduplication, & retention-lock features (as of SP3)
• Supports EV Collections
– Recommended w/DD to reduce total file count
– New “collection-focused” integration guide published
• DD qualified on Symantec EV Support matrix
– For both EV8 & EV9, EV10 pending
• Archive data from Symantec Enterprise Vault can be co-located next to backup data on the same Data Domain platforms
Symantec Enterprise Vault Solution Highlights
SYMANTEC VISION 2012
• Direct write of EV savesets to DD share
– many small files written ( < 100K typical for email archiving, CIFS)
– one email may produce several small files
– DD may not be able to support total # files, or ingest rate
• Collections
– Savesets are written to DD share, then collected at a later date
– same performance issues as direct write + incur a re-read of all the data
Collections w/Migration (recommended)
– this is a multistep process – with DD being the “secondary storage”
– collects these small savesets into .cab files (10MB)
– moves collections to DD according to schedule
– Cannot be used with Retention Lock
Symantec Enterprise Vault Recommended method of writing data to DD
SYMANTEC VISION 2012
Enterprise Vault with Collections/Migration
Exchange Server
Primary storage: Collection process: • “collects” EV savesets into 10MB
.cab files on TEMP storage • deletes original savesets
SQL server
File Server
LAN
Directory Vault Store Group Vault Store Audit Monitoring Reporting
Secondary Storage: DD CIFS Share Migration Process: • .cab files moved to DD
according to migration schedule
EV server
SYMANTEC VISION 2012
Symantec Enterprise Vault Integration Details –Setup Temp Storage for Vault Store Partition
SYMANTEC VISION 2012
Symantec Enterprise Vault Integration Details – Select device settings and choose collection software
SYMANTEC VISION 2012
Symantec Enterprise Vault Integration Details – Set collection schedule and size, Select “Migrate”
SYMANTEC VISION 2012
Symantec Enterprise Vault Integration Details – Select Migration software and Schedule
SYMANTEC VISION 2012
Symantec Enterprise Vault Integration Details – Point to DD CIFS share, ENABLE “Migrate all Files”
SYMANTEC VISION 2012
EMC Data Domain NetBackup Integration
21 Presentation Identifier Goes Here
SYMANTEC VISION 2012
EMC Data Domain Integration
• Distributed Segment Processing
– Executes On Backup Servers & Data Domain systems
– Segments Incoming Backup Streams
– Fingerprints Segments
– Identifies Unique Segments
– Unique Segments Are Compressed
– Compressed Segments Are Written To The Data Domain System
• Advanced Load Balancing & Failover
– Interface Group Feature
• Optimized Duplication
– Low Bandwidth Managed File Replication Feature
– Encrypted Managed File Replication Feature
22 Presentation Identifier Goes Here
SYMANTEC VISION 2012
Distributed Segment Processing
23 Presentation Identifier Goes Here
Fingerprint
NetBackup Media Server
A B C D E B D Segment
Unique?
Compress
A B C E D
Data Domain System
Write
SYMANTEC VISION 2012
Optimized Duplication
• Managed File Replication: Low Bandwidth Replication
– The low-bandwidth Replicator option reduces the WAN bandwidth utilization
– This option is useful if optimized duplication is being performed over a low-bandwidth network (WAN) link
– This option provides additional compression during data transfer and is recommended only for optimized duplication jobs that occur over WAN links that have fewer than 6 Mb/s of available bandwidth
24 Presentation Identifier Goes Here
SYMANTEC VISION 2012
Advanced Load Balancing & Failover
25 Presentation Identifier Goes Here
NetBackup
Media
Server
Advanced Load Balancing & Failover
Streams Load Balanced Across Network Links In Interface Group
All Backup Servers Connect To The Same Registered Interface
Transparent Link Failover For Network Failures
NetBackup
Media
Server
NetBackup
Media
Server
SYMANTEC VISION 2012
Advanced Load Balancing & Failover
Presentation Identifier Goes Here
NIC NIC
NetBackup Media Servers
Failed Link Will
Not Be Used
For New Jobs
Active Job
Transparent
Failover To An
Operational Link
NIC NIC
NetBackup Media Servers
Operational
Link Used For
An Active Job
SYMANTEC VISION 2012
Data Domain VTL
• Support for up to 64 concurrently active VTLs per Data Domain system
• Support for 1 to 256 tape drives per Data Domain system depending on the model number
• Up to 32000 slots per VTL
• Up to 64000 slots per Data Domain system
• Up to 100 CAPs (Cartridge Access Ports) per VTL
• Up to 2000 CAPs per Data Domain system
27 Presentation Identifier Goes Here
Thank you!
Copyright © 2012 Symantec Corporation. All rights reserved. Symantec and the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. This document is provided for informational purposes only and is not intended as advertising. All warranties relating to the information in this document, either express or implied, are disclaimed to the maximum extent allowed by law. The information in this document is subject to change without notice.
Presentation Identifier Goes Here 28