1 copyright © 2014 m. e. kabay. all rights reserved. backups csh5 chapter 57 backups m. e. kabay...

42
Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

Upload: nora-spencer

Post on 22-Dec-2015

224 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

1 Copyright © 2014 M. E. Kabay. All rights reserved.

Backups

CSH5 Chapter 57Backups

M. E. Kabay & Don Holden

Page 2: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

2 Copyright © 2014 M. E. Kabay. All rights reserved.

Topics

Backup BloopersDefinitions and NeedsStrategiesArchives, Maintenance

and RetentionStorageDisposalCostsOptimizing Frequency

Page 3: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

3 Copyright © 2014 M. E. Kabay. All rights reserved.

Backup Bloopers

BerkshireNet Margot Kidder Digital Technologies Group Amtrak Reservations Newcastle University Prof Sun Valley Ski Resort Stanford University Grad School of Business McAfee’s QuickBackup 2.04

US Customs US National Archives MIT “Cheating Scandal” Office of the Vice President of the USA Norwegian Banks Swisscom Mobile GSM Network Failure Macomb County (Michigan) Sheriff’s Dept Electronic Voting Machines

Page 4: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

4 Copyright © 2014 M. E. Kabay. All rights reserved.

BerkshireNetFeb 96 -- RISKS 17.83 BerkshireNet, Pittsfield, MA

Swastikas and racist messages

Masqueraded as provider's administrator

Erased data on two computers

Shut down system Down 12 hours

no current backupolder deleted files

restoredbut several days of data

lost

Page 5: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

5 Copyright © 2014 M. E. Kabay. All rights reserved.

Margot KidderSept 96 -- People Online via

RISKS 18.46Computer virus was last

straw Led to nervous

breakdownUnidentified virus

apparently destroyed only copy of her book

No backup

Page 6: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

6 Copyright © 2014 M. E. Kabay. All rights reserved.

Digital Technologies Group

Oct 96 -- APDigital Technologies Group lost all computer files

and backupsU$17,000 direct costsloss of months of work1-week shutdownseriously damaged

credibility as ISPDisgruntled ex-employeeAlleged perpetrator

arrested

Page 7: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

7 Copyright © 2014 M. E. Kabay. All rights reserved.

Newcastle University Prof

1997-08Prof. David NewellSchool of Clinical & Laboratory

ResearchExpert in cancer research and

anti-cancer drugsComputer + 5 floppy disks stolenContained only copy of his research dataThieves kindly returned his disks

Page 8: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

8 Copyright © 2014 M. E. Kabay. All rights reserved.

Sun Valley Ski Resort

1997-12Computer-based ID for skiers to use liftsHard disk crash wiped recordsNo backupsThousands of users had to re-register

Page 9: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

9 Copyright © 2014 M. E. Kabay. All rights reserved.

Stanford University Grad School of Business1998-03 Installed additional disk capacity on serversReloaded files from a corrupt backup tapeAll faculty and student files destroyedMany faculty and graduate students lost

research data – because they didn’t keep their OWN backups!

Page 10: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

10 Copyright © 2014 M. E. Kabay. All rights reserved.

US Customs

1998-10Hard disk failureChain of system failures6 hour downtime

80,000 requests backloggedSys admins shut down modem lines

Importers had auto-redialEach redial counted as new request

Customs Service deleted 45,000 import requestsRequired resubmission from importers

Page 11: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

11 Copyright © 2014 M. E. Kabay. All rights reserved.

US National Archives

1999System problem wiped 43,000 messages from e-mail

systemBut contractor responsible for backups had made no

backupsSomeone had also turned off system loggingAssistant Archivist said, “Safest way to save important

messages is to print them out.”

Page 12: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

12 Copyright © 2014 M. E. Kabay. All rights reserved.

MIT “Cheating Scandal”2000-03Boston Globe reported “cheating scandal”

22 students in cell bio class had wrong grades

Turned out a grad student had sorted the names but not included the grades. . . .

No backups, so no records of correct gradesNo logs, no tracking, no nothing

Page 13: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

13 Copyright © 2014 M. E. Kabay. All rights reserved.

Office of the Vice President of the USA

1998-04Migrated e-mail server to Windows NT4Moved e-mail files to a new partitionForgot to include that partition in backup

schedule1999-05

Staffers discovered zero backups for e-mail for over a year

Page 14: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

14 Copyright © 2014 M. E. Kabay. All rights reserved.

Macomb County (Michigan) Sheriff’s Dept2002-05: RISKS 22.08Lost 50,000 photos of criminals

Hard drive crashedHad some pictures printed out as backupsBut had made no electronic backups at all on

any medium

J. L. ParsonW32.Blaster.B

D. L. SmithMELISSA

R. E. RutkowskiUr-spammer

T. C. CowlesUr-spammer

Page 15: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

15 Copyright © 2014 M. E. Kabay. All rights reserved.

Electronic Voting Machines2004 election period saw growing concern about

electronic voting machinesEntirely proprietary (secret) code

Most had no audit trail of any kindTrust the electronic counts without

means of verificationDocumented cases of votes being

switched to opposite partyDemands growing for paper trail

Print ticket to allow user to see vote supposedly registered by machine

Place tickets in ballot box as backup measure in case of recount

Page 16: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

16 Copyright © 2014 M. E. Kabay. All rights reserved.

DefinitionsBackups – copies of data files or records

Should be on different deviceTape, hard disk, CD, DVD…

May be on same disk (*.wbk, *.bak etc.)Units & abbreviations

KB = kilobyte = 1024 bytes (characters)MB = megabyte = 1024 KB = 1,048,576 bytesGB = gigabyte = 1024 MB = 1,073,741,824 bytesTB = terabyte = 1024 GB = 1,099,511,627,776

bytesPB = petabytes = 1024 TB = 1.126 E15 bytesEB = exabytes = 1.153 E18 bytes

Page 17: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

17 Copyright © 2014 M. E. Kabay. All rights reserved.

Backups

Page 18: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

18 Copyright © 2014 M. E. Kabay. All rights reserved.

Needs Provide valid information in

case of data corruption or loss

Satisfy legal requirements for access to storable data, as for audit purposes;

In forensic examination of data to recognize and characterize a crime, and to identify suspects;

For statistical purposes in research;

To satisfy requirements of due care and diligence in safeguarding corporate assets;

To meet unforeseen requirements.

Page 19: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

19 Copyright © 2014 M. E. Kabay. All rights reserved.

Backup Media Following slides are

built using information and images from the Computer Desktop Encyclopedia v 26.1b.

Copyright © 2013 Computer Language Corp. All rights reserved.

Used with permission.

Page 20: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

20 Copyright © 2014 M. E. Kabay. All rights reserved.

Mag Tape Cartridges

Capacities range from a few GB to 100 GB per unit (2013)

Page 21: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

21 Copyright © 2014 M. E. Kabay. All rights reserved.

Tape Libraries (PB total)

From CDE; courtesy Iomega Corporation and Storage Technology Corporation

Page 22: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

22 Copyright © 2014 M. E. Kabay. All rights reserved.

Optical Disks

CD (compact disk) 650 MB capacity~3 Mbps transfer rate

DVD (“digital videodisk” “digital versatile disk” “DVD”4.7 GB single-side single-layer8.5 GB single-side double-layer9.4 GB double-sided single-layer17 GB double-sided double-layerTransfer rates ~200 Mbps

Page 23: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

23 Copyright © 2014 M. E. Kabay. All rights reserved.

DVD Types

Standards from the DVD ForumDVD-R: DVD-Recordable

Write-once, read-many “DVD-dash-R” or “DVD-minus-R”4.7 GB standard

DVD-RW: DVD-Read-WriteWrite many, read many“DVD-dash-RW” or “DVD-minus-RW”4.7 GB standardRewrite 1,000 times

Page 24: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

24 Copyright © 2014 M. E. Kabay. All rights reserved.

DVD Types (cont’d)

Standards from the DVD+RW AllianceDVD+R: DVD+Recordable

Write-once, read many4.7 GB

DVD+RW: RVD+ReadWriteWrite many, read many4.7 GBSupports CAV recording format especially

good for data random accessDVD+RW drives typically read DVD-R

media as well

Page 25: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

25 Copyright © 2014 M. E. Kabay. All rights reserved.

Blu-ray Disks for BackupsDeveloped in 2002 by Sony, Hitachi, Philips…

Same size as CDs and DVDsSingle-layer: 25 GBDual-layer: 50 GB

Blu-ray BurnersInternalExternalIn 2013, about $60

Blu-ray softwareE.g., WinDVD, PowerDVD,

Handy Backup25 - 128 GB/disk depending on layers (1, 2, 3, 4)Speeds up to ~288 Mbps (may increase in future)

Page 26: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

26 Copyright © 2014 M. E. Kabay. All rights reserved.

Hard Drives for BackupsFor consumers: small external drivesUSB 2.0/3.0, Firewire

Maxtor, Seagate, Western Digital, ….In Mar 2014, ~$30/TB for 3 TB drive

For corporate serversNetwork Attached Storage (NAS)More expensive (2-10x)Fail-safe engineeringRAID technologySpecialized processorsRack-mounted or standaloneInstall disk drives to suit

Transfer rates ~3Gbps

WD MyBook 3 TB$125

Synology DS412+$1159 for 16 TB

Page 27: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

27 Copyright © 2014 M. E. Kabay. All rights reserved.

Browsing NAS Options (1)

https://www.synology.com/en-us/support/nas_selector

Page 28: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

28 Copyright © 2014 M. E. Kabay. All rights reserved.

Browsing NAS Options (2)

DISKLESS (Mar 2014): ~$800 ~$1,100 ~$1,200 ~$1,700

Mar 2014:5TB hard disks cost ~500 each

Page 29: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

29 Copyright © 2014 M. E. Kabay. All rights reserved.

Cloud Backup (1)Once connected to

‘NetBackup from

anywhereRetrieve from

anywhereWarnings:

ConfidentialityShared folders

may result in accidental deletion or sabotage

Xfr rate depends on ‘Net bandwidth

http

://w

ww

.thet

op10

best

onlin

ebac

kup.

com

/clo

ud-b

acku

p

Page 30: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

30 Copyright © 2014 M. E. Kabay. All rights reserved.

Cloud Backup (2) Consider for organizations too See “Why Cloud Backup: Top 10 Reasons”*

1. Achieve disaster recovery with secure offsite cloud backup2. Freedom from manual and complex tape backup tasks3. Predictable costs for simpler budgeting4. Reliable and guaranteed data recovery5. Minimized risks and costs of downtime6. Fast data restores7. Take advantage of service provider’s expertise and

resources8. Offload regulatory compliance requirements to service

provider9. Well-managed cloud more secure than your own10. Ease of setup and use, set-and-forget, no training required

* http://www.ironmountain.com/arma/docs/top_ten_reasons.pdf

Page 31: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

31 Copyright © 2014 M. E. Kabay. All rights reserved.

Strategies

Exclusive accessTypes by coverage

FullDifferentialIncrementalDelta

Types by targetSystemApplication

TestingWARNING:Always ask for a definition of“Daily “or “Partial” BU

Everything

Everything changed since the last full BU

Everything changed since the last BU of any type

All the records that have changed since the last BU

Page 32: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

32 Copyright © 2014 M. E. Kabay. All rights reserved.

Archives, Maintenance and RetentionRetention policiesRotation of mediaMedia longevity and technology changes

Media degradation(e.g., fungus*)

Software and hardware changes

Application programsOperating systemsTransport mechanismsData encoding schemes

What to keep?How long?

* See Mendham, S. (2005). A little care goes a long way. PC World.http://www.pcworld.idg.com.au/index.php/secid;3;id;461315701

Page 33: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

33 Copyright © 2014 M. E. Kabay. All rights reserved.

Storage

Environmental protectionOnsiteOffsite

Care during transportHomesSafesBanksData vaultsOnline backups

Humidity 40-60%Temp 50-70F

LocationStorage Type

Bad idea

Access?

Page 34: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

34 Copyright © 2014 M. E. Kabay. All rights reserved.

Offsite Storage Document Management Solutions Health Information Management Digital Archiving eDiscovery Online Backup Records Management and Storage Secure Shredding Data Backup and Recovery Disaster Recovery Technology Escrow Services Consulting and Professional Services Records Management Compliance Marketing Production and Fulfillment Services Film and Sound Archiving

http://www.ironmountain.com/services/

These functions are copied verbatim from Iron Mountain’s list of services.

Page 35: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

35 Copyright © 2014 M. E. Kabay. All rights reserved.

Iron Mountain

Page 36: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

36 Copyright © 2014 M. E. Kabay. All rights reserved.

DisposalScavenging

Dumpster® DivingScratch tapesDiskettes, cartridges

Data and media destructionErase destroyReformatting inadequateDegaussers inadequateRandom overwrites

Military-grade = 7 passes

Stop data remanence! “Wipe”

http://tinyurl.com/6dhnu2y

Page 37: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

37 Copyright © 2014 M. E. Kabay. All rights reserved.

Disposal (cont’d)Physical destruction

worksRecommended:

specialized shreddersIncineration (special

types)Secure collection points

Lockbox magnetic garbage

Mobile data destruction servicesPaper shreddersSpecial facilities for

tapes

Royal Media Shredder

http://tinyurl.com/24mwtb

Page 38: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

38 Copyright © 2014 M. E. Kabay. All rights reserved.

Secure Data Destruction Equipment for destroying documents:

Paper shredders (crosscut ONLY – see oval)See “Cross Cut Shredders – 5 Reasons Why They

Are Better” < http://tinyurl.com/65cuw52 > Considerations when evaluating

servicesCostsTypes of media processedOnsite vs offsiteChain of custody

assuranceRegulatory complianceEnvironmental

protection

Page 39: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

39 Copyright © 2014 M. E. Kabay. All rights reserved.

CostsTape costs

Tapes / BUCost/tape

Time costsHours/BUOperator cost/hour

Fixed costsStorage space, racks,

insurance, transport, hardware rental/maintenance, software. . .

Page 40: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

40 Copyright © 2014 M. E. Kabay. All rights reserved.

Optimizing FrequencyE(x) = P(u)*C(u) - P(n) *C(n)Wherex is particular strategy E(x) is the expected value or cost of the

strategyP(u) is the probability of having to use the

backup within a single dayC(u) is money saved by not having to redo all

the workP(n) is probability of not having to use the

backups at all C(n) is cost of making and storing BU

Page 41: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

41 Copyright © 2014 M. E. Kabay. All rights reserved.

Personal Notes on Kabay BUsTwo ~identical computers: MAIN & SPARE2 TB portable USB drives for alternate-day useViceVersa synchronization software (MS)AM:

Synch MAIN → USB (including Backups)Synch USB → SPARE

PMSynch SPARE → USBSynch USB → MAIN

Daily incremental BU 23:00 → MAIN HD & MAIN Flashdrive

Monthly FULL BU MAIN → TB drives in fire safe2014: more extensive use of Dropbox for active

files

Page 42: 1 Copyright © 2014 M. E. Kabay. All rights reserved. Backups CSH5 Chapter 57 Backups M. E. Kabay & Don Holden

42 Copyright © 2014 M. E. Kabay. All rights reserved.

DISCUSSION