1P l a n e t a r y D a t a S y s t e m

Data Integrity Compilation

Data Integrity Compilation

Presented by: Al Schultz

Location: PDS Management Council Meeting

USGS

Flagstaff, AZ

Date: July 8, 2008

2P l a n e t a r y D a t a S y s t e m

Primary Copy of Data Availability & DI

GEO Img1 PPI SBN Rings EN NAIF

Data Volume (TB)18.48 TB

14 TB 2 TB 0.48 TB 0.4 TB 0.02 TB 0.7 TB

Online Capacility (TB)

30 TB 27 TB (JPL)

4 TB 1.3 TB 1.0 TB 8 TB 0.2 TB

% of Archive which is Online100% 100% 100% 100% 100% 100% 100%

Online Archive Method (e.g., RAID System)

RAID 5 RAID RAID RAID 5 RAID 50

RAID RAID

Schedule to perform Online Archive DI check (e.g., daily, weekly)

Monthly

None Monthly

None N/A Per build Monthly

Online Archive DI Checksum Type(s) (e.g., MD5)

MD5 None MD5 MD5 MD5 CRC32 (catalog)

MD5

1 – IN updating RAID arrays. Once complete, checksums assigned and checked monthly for errors .

3P l a n e t a r y D a t a S y s t e m

2nd Copy of Data (Backup) Availability & DI

GEO Img PPI SBN Rings EN NAIF

Online Archive Backup Location

Server Room 2

USGS(MM) GEO (Mer,Mex), Rings (Voy)

SDSC Same room as RAID

Redwood, CA

UMD / EN

Iron Mountain, Co

Online Archive Backup Method (e.g., SDSC)

Copy Media Exchange

SDSC near-line

rsync 1TB Data Bricks

Rsync / tape

AIT

Online Archive Backup Schedule

With data release

As received monthly Nightly & weekly

Bi-monthly

Weekly / daily

Monthly & yearly

% Online Archive been Backed UP

100% USGS (<1%) GEO (73) Rings (<1%)

100% 100% 100% 100% 100%

Schedule to perform Online Archive Backup copy DI check

Monthly None None N/A Only at primary

None

Online Archive Back up copy DI Checksum Type(s)

MD5 None MD5 MD5 N/A N/A N/A

4P l a n e t a r y D a t a S y s t e m

3nd Copy of Data (Backup) Availability & DI

GEO Img PPI SBN Rings EN NAIF

Deep Archive Location

Offsite, St. Louis

NSSDC NSSDC NSSDC NSSDC N/A NSSDC

% of Deep Archive

100% 1% 50% Not known

1% N/A 100%

Deep Archive Method (e.g., NSSDC Tape System)

LTD4 tape

CD copies CD Not known

NSSDC tape system

N/A NSSDC tape system

Schedule to perform Deep Archive DI check

4x per year

None - None N/A N/A Once per 6 months

Deep Archive Checksum Types(s)

LTD4 built in

None - MD5 & CRC32

N/A N/A MD5

% Deep Archive DI Checked

100% None 0% Prior to delivery

0% N/A 0%

5P l a n e t a r y D a t a S y s t e m

PDS Node System

GEO Img PPI SBN Rings EN NAIF

Primary LocationWUSTL JPL UCLA UMD Mountain

view, CaJPL-EN JPL

Bld 230

Backup Location

WUSTL & offsite

JPL UCLA Next to primary

Redwood City, Ca

JPL-EN JPL Bld 230

Backup Methodtape tape tape rsync 1 TB Data

Brickstape RAID

Backup Schedule

Daily & 4x per year

daily monthly Weekly, bi-nightly

Bi-monthly

daily N/A

Mirror Site Location

N/A USGS Az GEO Node Rings Node

N/A N/A N/A UMD N/A

Mirror Test Schedule

N/A None N/A N/A N/A Every 6 months

N/A

Mirror Backup Method

N/A Unknown N/A N/A N/A Rsync N/A

6P l a n e t a r y D a t a S y s t e m

PDS Node Disaster Recovery

GEO Img PPI SBN Rings EN NAIF

Plan Approval DateN/A N/A N/A - N/A JPL

annually-

Plan Test Schedule

N/A N/A N/A - N/A N/A -