![Page 1: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/1.jpg)
TiBS
Fermilab – HEPiX-HEPNTRay Pasetes
October 22, 2003
![Page 2: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/2.jpg)
Problem
• AFS full backups > 40 hours
• UNIX full backups > 20 hours
• Operator assisted tape mounts
• Mandate for automated operations
![Page 3: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/3.jpg)
Investigation
• March – July 2003
• Software evaluated included– Veritas Netbackup– SyncSort– IBM/Tivoli TSM– Amanda– Teradactyl/TiBS
![Page 4: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/4.jpg)
Criteria
• Support for IBM AFS and OpenAFS
• Reduce backup windows < 24 hours
• Complete automation
• Scalable
• Reliable
• Affordable
![Page 5: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/5.jpg)
EvaluationAFS/
OpenAFS
< 24Window
Automated Scalable Reliable Affordable
Veritas No Yes Yes Yes Yes No
SyncSort No Yes Yes Yes Yes No
IBM Yes Yes Yes Yes Yes No
Amanda Yes Yes Yes Yes Yes No*
TiBS Yes Yes Yes Yes Yes Yes
![Page 6: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/6.jpg)
Notes: Veritas
• No support for OpenAFS
• No ongoing development for AFS
• No bug fixes for current AFS offering
• Pricing– Per seat, by OS, #CPUs, and CPU type– Number of tape drives
• Different pricing for SAN attached drives
– Lots of add-on feature charges
![Page 7: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/7.jpg)
Notes: SyncSort
• No support for AFS
• Pricing– Per seat, UNIX or Windows– Number of tape drive slots in library
• Different pricing for SAN attached drives
– Pricing came in packs• May not fit current equipment.• I.E. 170 tape slot pack for 120 slot library• 25 pack UNIX licenses for 18 UNIX systems
![Page 8: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/8.jpg)
Notes: IBM
• Actively supporting AFS and OpenAFS
• Can do single file restores for AFS
• Pricing– Vague pricing unless we were willing to
commit to significant purchase– Per seat, OS, CPU type
![Page 9: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/9.jpg)
Notes: Amanda
• AFS support enhanced by internal work
• Pricing– The support effort to maintain the product was
not available
![Page 10: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/10.jpg)
Notes: TiBS
• Support for AFS and OpenAFS
• Pricing– Client
• Per OS, irregardless of clients• Enterprise (all supported OSes)
– Server• Per process (number of parallel backups)
![Page 11: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/11.jpg)
Decision
• July 2000, decision to deploy TiBS• Production -- August 2000
– 400GB of data, all AFS– Only part of CSI backups migrated
• Currently, ~1.6TB– 140+ total systems
• AFS, HFS+, NTFS, UNIX file systems.
– IRIX, Linux, OSX, Solaris, Tru-64, W2K, XP– Backups for CSI and SCS migrated
• Backup Window ~< 5 hours
![Page 12: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/12.jpg)
TiBS: How does it work?
TiBS == True incremental Backup System• First backup is a full backup over the network• All subsequent backups are incrementals over
the network• Subsequent weekly and full tapes generated
from previous Fulls, Weeklies and incrementals at the server, without client participation
• All data staged to spooling disk first
![Page 13: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/13.jpg)
More on TiBS
• Incremental data – Mirrored in disk cache– Merged with previous incrementals daily
• Does allow for direct-to-tape backup– Can not use merge process
• One-pass restore
![Page 14: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/14.jpg)
Additional Benefits
• AFS– Reports on volumes that need salvaging– Consistency check between vldb and fileservers– Look up individual AFS files before restoration
• General– Hostaudit reports any new partitions/disks on a
backup client– Merge process auto-checks integrity of tapes– Lost tapes can be reconstructed from previous tapes– User initiated backups -- laptops– Support has been excellent
![Page 15: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/15.jpg)
Cons
• May require large caching disk– Typically 10% of total data backed up– Cache needs to be at least as large as largest
filesystem
• Requires a larger library– Or more aggressive tape handling– Reliance on previous tapes to create data
![Page 16: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/16.jpg)
Keep in Mind
• Non-traditional scalability factors– Size of individual filesystems vs. overall
storage– Disk/cache and tape speed vs. network speed– CMU-CS backs up 7TB using a single sparc,
512MB memory, 280GB cache, 4DLT8Ks.
• Higher reliance on previous backups
• Failed backups have higher significance
![Page 17: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/17.jpg)
More on Teradactyl
• Roots are from CMU– Birthplace for AFS– CMU ECE and H&SS departments are beta
sites
• Very open to customizing solutions– K5/KCA authentication
![Page 18: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/18.jpg)
Summary
• Originally purchased for CSI AFS backups and UNIX server backups (20 systems total)
• Proved to be very scalable on current hardware and has expanded to two groups, 140+ systems
• We are now backing up desktops, laptops, Windows and Mac OSX as well as AFS and traditional UNIX systems
• Does not require enterprise version of Linux OS
![Page 19: TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003](https://reader035.vdocuments.us/reader035/viewer/2022070412/5697bf8e1a28abf838c8cf88/html5/thumbnails/19.jpg)
Additional Information
• FNAL– http://www-oss.fnal.gov/csi/afs/stats/tibs/html/bindex.html– Ray Pasetes <[email protected]>– Kevin Hill <[email protected]>
• Vendor– http://www.teradactyl.com