evolution of a prototype archival system for preserving ...€¦ · systematic and foia processing...
TRANSCRIPT
![Page 1: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/1.jpg)
Evolution of a Prototype Archival System for
Preserving & Reviewing Electronic Records
2008 SAA Annual MeetingAugust 30, 2008
![Page 2: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/2.jpg)
Presented by:Chair: Stephannie Oriabure, Archivist,
Presidential Materials Staff, NARA;Brooke L. Clement, Archivist,
George Bush Presidential Library, NARA; andDr. William Underwood, Georgia Tech Research
Institute
![Page 3: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/3.jpg)
Overview
What were the Issues?
Our Approach
Archival Processing
Preservation
New Technologies
Conclusion
![Page 4: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/4.jpg)
Electronic Records at the George H.W. Bush Pres. Library
One of the first presidential libraries to have electronic presidential records, particularly from hard drives◦ Word Processing Files
◦ Databases
◦ Spreadsheets
◦ Presentations
◦ Computer Programs
◦ Scanned Paper Records
![Page 5: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/5.jpg)
Where We Began
The archival functions needed to process paper records are well understood.
We had few tools to identify, view or review electronic records in response to PRA/FOIA requests
Tools Initially Needed:◦ File Format Identification Tool
◦ Viewers for Records in Legacy File Formats
◦ Tools Redacting E-records
◦ Tools for Converting Legacy to Current Formats
![Page 6: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/6.jpg)
Approach: Evolutionary Prototyping
Computer Scientists
Build Tools
Archivists Test Tools
Experience
Archivists Formulate
New Require-ments
Result: Integrated set of tools called PERPOS
![Page 7: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/7.jpg)
Archival Activities Supported by PERPOS
PERPOS Repository
Accession
(Ingestion)
Arrange
Preserve Search
Review
Describe
![Page 8: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/8.jpg)
Accessioning
![Page 9: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/9.jpg)
Intellectual Arrangement/Description
![Page 10: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/10.jpg)
PRA/FOIA Processing: Create a Case
![Page 11: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/11.jpg)
Search
![Page 12: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/12.jpg)
Results Set
![Page 13: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/13.jpg)
Review
Checkout Container in ART, then…
…open Container in the APT and Change the Activity to “Review.”
![Page 14: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/14.jpg)
Review: Closing a Record
![Page 15: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/15.jpg)
Review: Withdrawal Sheets
![Page 16: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/16.jpg)
Review: Closed Record
![Page 17: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/17.jpg)
Review: Redaction
![Page 18: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/18.jpg)
Review: Redaction
![Page 19: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/19.jpg)
Review: Redaction
![Page 20: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/20.jpg)
Review: Redaction
![Page 21: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/21.jpg)
Create FOIA Collection and Finding Aid
![Page 22: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/22.jpg)
FOIA Collection
![Page 23: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/23.jpg)
FOIA Finding Aid
![Page 24: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/24.jpg)
Preservation
Recover Passwords/
Decrypt
• Encrypted, or password protected files
Repair
• Files corrupted by media deterioration or file transmission errors
Conversion
• For some legacy file formats, there is not a viewer available
![Page 25: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/25.jpg)
Resources for Preserving Records
![Page 26: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/26.jpg)
Preservation: Conversion to a Viewable Format
![Page 27: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/27.jpg)
Preservation: Record Converted to a Viewable Format
![Page 28: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/28.jpg)
Research in Assisting Archivists in Processing E-Records
Automatically filling in withdrawal information
Automatic description of items, file units (folders), and record series
![Page 29: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/29.jpg)
Documentary Forms of Presidential E-Records
AgendaBar ChartBiographyBriefing MemoDecision MemoCorrespondenceDiaryExecutive OrderInformation MemoJob ApplicationListsMailing ListMemoMinutes of MeetingNational Security
DirectiveNewsletter
Nomination to FederalOffice
NotesPresidential StatementPress Pool ReportPress ReleaseRecommended Telephone
CallReferral MemoResumeScheduleSignature MemoSituation ReportSummaryTranscript of SpeechTranscript of News
Conference
![Page 30: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/30.jpg)
Documentary Form
Documentary form is “the rules of representationused to convey a message – that is, thecharacteristics of a document which can be separatedfrom the determination of the particular subjects, orplaces it concerns. Documentary form is both physicaland intellectual.
The intellectual form of a document is "the sum ofa record's formal attributes that represent andcommunicate the elements of the action in which therecord is involved and of its immediate context, bothdocumentary and administrative."
The physical form of a document is “the overallappearance, configuration, or shape, derived from itsmaterial characteristics and independent of itsintellectual content.”
(L. Duranti, Diplomatics: New Uses for an Old Science)
![Page 31: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/31.jpg)
Grammar for the Documentary Form of a Memorandum
![Page 32: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/32.jpg)
Document Type Recognition and Metadata Extraction
TokenizerWordlist LookupSentence SplitterHepple POS TaggerNamed entity TransducerIntellectual Element Transducer + Rules for
Intellectual ElementsSUPPLE Parser + Document Type Grammars
and semanticsExtract Record Metadata
![Page 33: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/33.jpg)
Parse Tree and Metadata Extracted from E-Record
![Page 34: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/34.jpg)
Extracted Metadata Inserted in Withdrawal Form & Automatic Item Description
Item Description:
A memorandum,
dated April 27,
1992 from EDE
Holiday to Sam
Skinner regarding a
California
Earthquake.
![Page 35: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/35.jpg)
PERPOS is Still Evolving
PERPOS has evolved into a Prototype E-Record Repository and Archival Processing System.
However, archivists have identified additional needs, for example,
◦ Need for more precise search criteria such as search by:
Office, Series, Date, and Type of Document
◦ Need to explore alternatives for providing E-FOIA Collections to Library Researchers.
◦ Need for experience in processing e-mail
◦ Functional ability to notify proposed openings to the former and current presidents pursuant to the Presidential Records Act.
![Page 36: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/36.jpg)
Summary: Research Results and Benefits
Evolutionary Prototyping is a good strategy of system development when there is a need to learn more about the problem. The system evolves until the prototype meets all the needs and has thus evolved into a system.
PERPOS ◦ Has been demonstrated to support to a high degree both
systematic and FOIA processing of e-records.
◦ Environment for learning new requirements for processing electronic records and discovering new opportunities for improving the process.
◦ Environment for exploring preservation strategies.
◦ Environment for experimental application of advanced information technologies to support archival tasks.
![Page 37: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/37.jpg)
Additional Information
Publications:
◦ D. Carter, B. Clement, S. Laib, and W. Underwood, “Results of Pilot Testing of FOIA Processing Using PERPOS.”
◦ S. Oriabure, L. Spencer, and W. Underwood, “Launching E-Records with a PERPOS,” 2005 NAGARA Meeting.
◦ S. Laib and W. Underwood, “FOIA Processing in the Presidential Electronic Records PilOt System.”
◦ Underwood, et al. “Reference Manual for PERPOS: An Electronic Records Repository and Archival Processing System, Version 3.1.”
These and other publications are available at:http://perpos.gtri.gatech.edu
![Page 38: Evolution of a Prototype Archival System for Preserving ...€¦ · systematic and FOIA processing of e-records. Environment for learning new requirements for processing electronic](https://reader036.vdocuments.us/reader036/viewer/2022063011/5fc66a38323b2904284d7589/html5/thumbnails/38.jpg)
Questions from the Audience
Thank you!