evolution of a prototype archival system for preserving & reviewing electronic records 2008 saa...
TRANSCRIPT
![Page 1: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/1.jpg)
Evolution of a Prototype Evolution of a Prototype Archival System for Archival System for
Preserving & Reviewing Preserving & Reviewing Electronic RecordsElectronic Records
2008 SAA Annual MeetingAugust 30, 2008
![Page 2: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/2.jpg)
Presented by:Presented by:Chair: Stephannie Oriabure, Archivist, NARAChair: Stephannie Oriabure, Archivist, NARABrooke Clement, Archivist, NARA, andBrooke Clement, Archivist, NARA, andDr. William Underwood, Georgia Tech Research Dr. William Underwood, Georgia Tech Research
InstituteInstitute
![Page 3: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/3.jpg)
OverviewOverview
What were the Issues?Our ApproachArchival ProcessingPreservationNew TechnologiesConclusion
![Page 4: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/4.jpg)
Electronic Records at the Electronic Records at the George H.W. Bush Pres. LibraryGeorge H.W. Bush Pres. Library
One of the first presidential libraries to have a significant amount of e-records ◦Word Processing Files◦Databases ◦Spreadsheets◦Presentations◦Email◦Computer Programs◦Scanned Paper Records
![Page 5: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/5.jpg)
Where We BeganWhere We Began
The archival functions needed to process paper records are well understood.
We had few tools to identify, view or review electronic records in response to FOIA requests
Tools Initially Needed:◦File Format Identification Tool◦Viewers for Records in Legacy File Formats◦Tools Redacting E-records◦Tools for Converting Legacy to Current Formats
![Page 6: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/6.jpg)
Approach: Approach: Evolutionary PrototypingEvolutionary Prototyping
Result: Integrated set of tools called PERPOS
![Page 7: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/7.jpg)
Archival Activities Supported by Archival Activities Supported by PERPOSPERPOS
![Page 8: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/8.jpg)
AccessioningAccessioning
![Page 9: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/9.jpg)
Intellectual Intellectual Arrangement/DescriptionArrangement/Description
![Page 10: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/10.jpg)
FOIA Processing: Create a CaseFOIA Processing: Create a Case
![Page 11: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/11.jpg)
SearchSearch
![Page 12: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/12.jpg)
Results Set Results Set
![Page 13: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/13.jpg)
ReviewReview
Checkout Container in ART, then…
…open Container in the APT and Change the Activity to “Review.”
![Page 14: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/14.jpg)
Review: Closing a RecordReview: Closing a Record
![Page 15: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/15.jpg)
Review: Withdrawal SheetsReview: Withdrawal Sheets
![Page 16: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/16.jpg)
Review: Closed RecordReview: Closed Record
![Page 17: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/17.jpg)
Review: RedactionReview: Redaction
![Page 18: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/18.jpg)
Review: RedactionReview: Redaction
![Page 19: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/19.jpg)
Review: RedactionReview: Redaction
![Page 20: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/20.jpg)
Review: RedactionReview: Redaction
![Page 21: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/21.jpg)
Create FOIA Collection and Create FOIA Collection and Finding AidFinding Aid
![Page 22: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/22.jpg)
FOIA CollectionFOIA Collection
![Page 23: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/23.jpg)
FOIA Finding AidFOIA Finding Aid
![Page 24: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/24.jpg)
PreservationPreservation
![Page 25: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/25.jpg)
Resources for Preserving RecordsResources for Preserving Records
![Page 26: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/26.jpg)
Preservation: Conversion to a Preservation: Conversion to a Viewable FormatViewable Format
![Page 27: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/27.jpg)
Preservation: Record Converted to Preservation: Record Converted to a Viewable Formata Viewable Format
![Page 28: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/28.jpg)
Research in Assisting Archivists in Research in Assisting Archivists in Processing E-RecordsProcessing E-Records
Automatically filling in withdrawal information
Automatic description of items, file units (folders), and record series
![Page 29: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/29.jpg)
Documentary Forms of Documentary Forms of Presidential E-RecordsPresidential E-Records
AgendaBar ChartBiographyBriefing MemoDecision MemoCorrespondenceDiaryExecutive OrderInformation MemoJob ApplicationListsMailing ListMemoMinutes of MeetingNational Security
DirectiveNewsletter
Nomination to FederalOffice
NotesPresidential StatementPress Pool ReportPress ReleaseRecommended
TelephoneCall
Referral MemoResumeScheduleSignature MemoSituation ReportSummaryTranscript of SpeechTranscript of News
Conference
![Page 30: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/30.jpg)
Documentary FormDocumentary Form
Documentary form is “the rules of representation used to convey a message – that is, the characteristics of a document which can be separated from the determination of the particular subjects, or places it concerns. Documentary form is both physical and intellectual.
The intellectual form of a document is "the sum of a record's formal attributes that represent and communicate the elements of the action in which the record is involved and of its immediate context, both documentary and administrative."
The physical form of a document is “the overall appearance, configuration, or shape, derived from its material characteristics and independent of its intellectual content.”
(L. Duranti, Diplomatics: New Uses for an Old Science)
![Page 31: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/31.jpg)
Grammar for the Documentary Grammar for the Documentary Form of a MemorandumForm of a Memorandum
![Page 32: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/32.jpg)
Document Type Recognition and Document Type Recognition and Metadata ExtractionMetadata Extraction
TokenizerWordlist LookupSentence SplitterHepple POS TaggerNamed entity TransducerIntellectual Element Transducer + Rules for
Intellectual ElementsSUPPLE Parser + Document Type Grammars
and semanticsExtract Record Metadata
![Page 33: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/33.jpg)
Parse Tree and Metadata Parse Tree and Metadata Extracted from RecordExtracted from Record
![Page 34: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/34.jpg)
Extracted Metadata Inserted in Extracted Metadata Inserted in Withdrawal Form & Automatic Withdrawal Form & Automatic Item Description Item Description
Item Description:A memorandum,dated April 27,1992 from EDEHoliday to SamSkinner regardingCaliforniaEarthquake.
![Page 35: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/35.jpg)
PERPOS is Still EvolvingPERPOS is Still Evolving
PERPOS has evolved into a Prototype E-Record Repository and Archival Processing System.
However, archivists have identified additional needs, for example,
◦ Need for more precise search criteria such as search by: Office, Series, Date, and Type of Document
◦ Need to explore alternatives for providing E-FOIA Collections to Library Researchers.
◦ Need for experience in processing e-mail
![Page 36: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/36.jpg)
Summary: Research Results and Summary: Research Results and BenefitsBenefits
Evolutionary Prototyping is a good strategy of system development when there is a need to learn more about the problem. The system evolves until the prototype meets all the needs and has thus evolved into a system.
PERPOS ◦ Has been demonstrated to support to a high degree both
systematic and FOIA processing of e-records. ◦ Environment for learning new requirements for
processing electronic records and discovering new opportunities for improving the process.
◦ Environment for exploring preservation strategies.◦ Environment for experimental application of advanced
information technologies to support archival tasks.
![Page 37: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/37.jpg)
Additional InformationAdditional Information
Publications:
◦ D. Carter, B. Clement, S. Laib, and W. Underwood, “Results of Pilot Testing of FOIA Processing Using PERPOS.”
◦ S. Oriabure, L. Spencer, and W. Underwood, “Launching E-Records with a PERPOS,” 2005 NAGARA Meeting.
◦ S. Laib and W. Underwood, “FOIA Processing in the Presidential Electronic Records PilOt System.”
◦ Underwood, et al. “Reference Manual for PERPOS: An Electronic Records Repository and Archival Processing System, Version 3.1.”
These and other publications are available at:http://perpos.gtri.gatech.edu
![Page 38: Evolution of a Prototype Archival System for Preserving & Reviewing Electronic Records 2008 SAA Annual Meeting August 30, 2008](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649e2a5503460f94b17796/html5/thumbnails/38.jpg)
Questions from the AudienceQuestions from the Audience
Thank you!