how to manage your data...2018/06/01 · “the arms acquisition process: the effect of internal...
TRANSCRIPT
![Page 1: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/1.jpg)
How to Manage Your DataLisa Spiro, Kathy Weimer, Jean Aroom and
Clinton HeiderJune 2018
This workshop draws heavily on materials from the University of Minnesota Libraries, New England Collaborative Data Management Curriculum, MIT Libraries & DataOne.
![Page 2: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/2.jpg)
Quick Poll: Raise Your Hand If You Have Ever...● Forgotten what you called a file and/or where
you put it● Discovered unnecessary duplicates, then
struggled over which to keep● Lost data due to hardware failure, lost devices,
etc.
![Page 3: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/3.jpg)
Objectives for This Session1. Understand the importance of managing data.2. Learn how to create a good data management plan.3. Name and organize your files effectively.4. Manage versions of files.5. Create tidy data.6. Document your data to promote future use
(including by you). 7. Know options for storing, backing up and archiving
your data.
![Page 4: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/4.jpg)
1.Why Managing Your Data Matters
![Page 5: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/5.jpg)
What Is Research Data?“the information recorded or produced in any form or media during the course of a research investigation”(Rice Research Data Management Policy)Examples:● experimental results● lab notebooks ● protocols● charts● publications
![Page 6: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/6.jpg)
Why Is Managing Your Data Important?● Keep track of your data, working more efficiently.● Prevent data loss.● Uphold standards of research integrity.● Make it easier to share and re-use data.● Meet funder, university & increasingly journal
requirements.● Be kind to Future You and your collaborators.
![Page 7: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/7.jpg)
2. How to create a data management plan
![Page 8: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/8.jpg)
Use a Data Inventory to Understand, Track & Share Your DataPlan for, monitor & prepare to share your data by recording:● what the dataset is ● who is responsible for it● how data were created● where it is● how important it is● who can access & edit it● where it is stored and preserved
![Page 10: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/10.jpg)
Key Principles1. Investing some time in organizing your data
now will save you time later.2. Be clear and consistent.3. Work out your data organization procedures
with collaborators.4. Document your procedures.5. Understand that there is no one right way; it’s
what works for you.
![Page 11: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/11.jpg)
3. Organize Your Data
![Page 12: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/12.jpg)
How to Create a Hierarchical File System1. Figure out what kind of data you have (e.g. images,
spreadsheets, documents, etc.)
2. Organize your files in a predictable, easy-to-sort way.
3. Use relevant categories to organize folders (e.g. Project/Site/Date).
4. Select a naming convention for folders.
![Page 13: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/13.jpg)
Example of a Directory Structure
Nikola Vukovic
![Page 14: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/14.jpg)
What to Avoid…
Overlapping categories
MIT
Too much depth
![Page 15: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/15.jpg)
Another Option: TagsPros:• More flexibleCons:• Harder to be consistent.• May lose tags in moving to different computers.• Systems that support tags:
-Evernote -Windows 10 (limited)-Gmail -Mac OS 10.12-Zotero
![Page 16: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/16.jpg)
The Problem of File Names
http://phdcomics.com/comics.php?f=1323
![Page 17: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/17.jpg)
Principles for Effective File Naming● Files are distinguishable from each other within their
containing folder.
● Files are easy to locate, browse and sort.
● If files are moved to other storage platform, their names will retain useful context.
(EDINA and Data Library, n.d.) | RDMRose
![Page 18: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/18.jpg)
File Naming Best Practices
• Be descriptive: Use shared, meaningful terminology. Incorporate relevant terms such as project name, place, date, experiment, instrument, subject, etc.
Example: AirQual_Lufkin_Sensor1_201709007
• Be consistent: Use the same structure and terms across projects so that files fall into a useful order (for sorting) and you can easily identify them.
Example: AvSAT_Ric_2017 AvSAT_Ric_2016 AvSAT_UTx_2017
![Page 19: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/19.jpg)
Guidelines for File NamingGuideline ExampleAvoid special characters, like / , . # ?
Exp01a.xls, NOT Exp#1.a.xls
Don’t use blank spaces. Use CamelCharacters or _ to link together keywords.
Site01_Sensor002, NOT Site1 Sensor 2
Use yyyymmdd for dates 200180617, NOT 0617218
Use leading zeroes, e.g. 0001, 001, etc
Experiment002.xls, NOT Experiment2.xls
![Page 20: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/20.jpg)
Which file naming scheme works the best?
A. bridgedata1bridgedata2bridgedata3
B. bridge1_sensor2_02142013 bridge1_sensor2_02152013 bridge1_sensor2_02162013
C. madisonavebridge_sensor2_20130214 madisonavebridge_sensor2_20130215 madisonavebridge_sensor2_20130216
D. madisonavebridge_sensor2_feb142013 madisonavebridge_sensor2_02152013 madbridge_s2_feb162013 University of Minnesota Libraries
![Page 21: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/21.jpg)
Exercise
Instructions: Review the handout, then partner with 2-3 people to decide on a file naming system in order to sort by interviewee name.
3 minutes to discuss
University of Minnesota Libraries
![Page 22: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/22.jpg)
4. Manage Versions
![Page 23: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/23.jpg)
Versioning: Which one is authoritative?DataAnalysis.xlsDataAnalysis2.xlsDataAnalysisSept2017.xlsDataAnalysisFinal.xlsDataAnalysisFinalFINAL.xls
![Page 24: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/24.jpg)
Manual Options for Managing Versions
• Retain original, raw files and significant iterations.• Use careful file naming: record major changes via whole
numbers (v01), minor via an additional number (v02_01)• Put older versions in an archive folder.• Create a version control table:
![Page 25: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/25.jpg)
Accessing Version History on Box.com
https://community.box.com/t5/Organizing-and-Tracking-Content/Accessing-Version-History/ta-p/50452
![Page 26: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/26.jpg)
More Automated Option: Version Control“Version control is a system that records changes to a file or set of files over time so that you can recall specific versions later.” (Pro Git)
![Page 27: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/27.jpg)
Why Use Version Control?• Keep track of file versions.• See who does what.• Access any version of file.• Synchronize and share, so that latest version is
available to all collaborators.• Roll back changes.• Enable branches of project.
![Page 28: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/28.jpg)
Manage and Access Versions of Files with Git(Hub)https://github.com/rzach/git4phi
![Page 29: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/29.jpg)
Software for Managing Versions
• Through Box, Google Drive & other storage services
Version control software:• Subversion: supported by Rice OIT; free• GitHub: Public repositories are free. Researchers can receive to 5 free private repos, research groups up to 20
![Page 30: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/30.jpg)
5. Create tidy data.
![Page 31: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/31.jpg)
The Problems with Messy Data• Difficult to analyze
• Requires time to clean
• Confusing to other users– and to Future You
• Raises questions about your credibility
![Page 32: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/32.jpg)
Keep Your Data Tidy§ Make each variable a column & each observation a row§ Make column headers variable names§ Atomize your data; put only a single piece of information
in each cell (e.g. city, state, country)§ Be consistent in how you will handle empty values (e.g.
NULL, leave blank)
![Page 34: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/34.jpg)
What issues do you see with this spreadsheet?
Stanford U Libraries
![Page 35: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/35.jpg)
6. Document your data.
![Page 36: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/36.jpg)
Why Document Data?• Makes it easier for you to interpret your own data
• Facilitates collaboration, sharing, and reuse
• Promotes successful long-term preservation of data
New England Collaborative Data Management Curriculum
![Page 37: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/37.jpg)
Create a Readme File to Document File or Directory
Typical contents:● What: title & description● When: date of data collection● Who: name & contact info of creator● Where: location where data was captured● How:
○ Method of data collection, creation or processing○ Restrictions on accessing files
https://data.research.cornell.edu/content/readme
![Page 38: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/38.jpg)
Files to replicate Sean Bolks and Richard J. Stoll, “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution 44, no. 5 (October 1, 2000): 580–603.
File Contenttable1.dta Stata data file with data for Table 1table1.do Stata .do file with commands to replicate Table 1table2.dta Stata data file with data for Table 2table2.do Stata .do file with commands to replicate Table
Simple Example of a ReadMe File
![Page 39: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/39.jpg)
“A codebook is an essential document that informs the data user about the study, data file(s), variables, categories, etc., that make up a complete dataset. The codebook may include a dataset’s record layout, list of variable names and labels, concepts, categories, cases, missing value codes, frequency counts, notes, universe statements, and so on.”http://www.ddialliance.org/training/getting-started-new-content/create-a-codebook
Create a Codebook to Describe the Contents of Data Files
![Page 41: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/41.jpg)
ExerciseThink through creating a readme file for one of your datasets (real or imagined) or the “Dr. Psi” data using this template from Cornell.
See “Guidelines for writing ‘readme’ style metadata” http://data.research.cornell.edu/sites/default/files/SciMD_ReadMe_Guidelines_v4_1_0.pdf
![Page 42: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/42.jpg)
7. Store, Backup and Archive Data
![Page 43: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/43.jpg)
Data Storage Definition● The media (optical or magnetic) to which you
save your data files and software.● All storage media are vulnerable to risk and
obsolescence.● Storage media should be evaluated and
updated every 2-5 years.
New England Collaborative Data Management Curriculum
![Page 44: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/44.jpg)
Data Storage Considerations● Location (Internal/External HD, Network, Remote)● Disk size or storage quota● Computing performance● Accessibility
![Page 45: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/45.jpg)
Data Backup Definition● Allows you to restore your data if original data is
lost or damaged due to:○ Hardware or software malfunction○ Environmental disaster (fire, flood)○ Theft○ Unauthorized access
>> TEST YOUR BACKUP PLAN!New England Collaborative Data Management Curriculum
![Page 46: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/46.jpg)
3-2-1 Backup RuleSave 3 copies of your data.
Use 2 types of storage.
Keep 1 remote copy.
3
2
1
![Page 47: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/47.jpg)
Data Backup Summary
Backup type Backed up Backup time Restore time Storage space
Full/snapshot All data Slowest Fast High
Differential All data since last full Moderate Moderate Moderate
Incremental Only new/ modified files Fast Slowest Lowest
Mirror Only new/ modified files Fastest Fastest Highest
![Page 48: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/48.jpg)
Overview of Data Storage, Backup and Sharing Options at Rice
Options for faculty/ staff: https://kb.rice.edu/page.php?id=70762Options for students: https://kb.rice.edu/page.php?id=65636
Network Storage● storage.rice.edu - U: drive, departmental shares● Research Data Facility (RDF) - larger scale storage for research projects
Backup Options● storage.rice.edu backups/snapshots● Crash Plan for Rice workstations
Data Sharing/Collaboration Tools - Google Drive, Rice Box, Globus Connect
![Page 49: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/49.jpg)
Storage: storage.rice.edu● Location: Networked● Storage quotas
○ Undergraduates: 2 GB○ Graduates, Staff, Faculty: 5 GB○ Colleges, Depts, Centers, Institutes: 40 GB
● Performance - Subject to network● Accessibility
○ NetID folder: Private, not shared○ Groups: Any Rice NetID holder by request
![Page 50: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/50.jpg)
\\storage.rice.edu
![Page 51: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/51.jpg)
Storage: Research Data Facility● Location: On Site (Rice PDC) network data shares● Storage quotas
○ 500GB per researcher○ Additional storage available with cost recovery○ Cost $70/TB/year, prorated monthly by use
● Performance - Subject to network● Accessibility
○ Based on NetID and ADRICE security groups○ Can be shared to multiple users in a research group
![Page 52: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/52.jpg)
Backup: storage.rice.edu● Location: On-site● Procedure: Full replication● Frequency: Daily● Retention
○ Personal access: 2 weeks○ Request IT restoration: 6 months
![Page 53: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/53.jpg)
\\storage.rice.edu\?-home\~snapshot
![Page 54: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/54.jpg)
Backup: CrashPlan● Availability: Rice-owned computers● Cost: $82.56/year/person (up to 4 devices)● Location: Off-site cloud storage● Procedure: Incremental● Frequency: Adjustable up to every minute● Retention: Adjustable up to forever
https://kb.rice.edu/page.php?id=72955
![Page 55: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/55.jpg)
CrashPlan PROe or crashplan.rice.edu
![Page 56: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/56.jpg)
Sharing: Google Drive● Unlimited storage for low risk data● Can be used for collaboration within Rice● Integrates nicely with G-suite productivity apps● Files aren’t local and performance is limited● No provisions for retention of orphaned data● Accessibility
○ Login to G-Suite apps with your Rice NetID
![Page 57: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/57.jpg)
Sharing: Rice Box● Web based file sharing tool similar to Dropbox● Approved by Rice for sharing secure data● Accessibility
○ Rice NetID○ Share folders with Rice colleagues or external
collaborators○ Add emails of external collaborators to a folder
and send invitations
![Page 58: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/58.jpg)
Sharing: Globus Connect● Widely used service for large data exchange
between participating institutions● Can be used in our HPC environment or from
your desktop with Globus Connect Personal● Accessibility
○ Contact CRC to be added to license○ Arrange for access to peer institution end points
![Page 59: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/59.jpg)
Product Use Location Quota Performance Accessibility
Storage S/B Rice Data Center 2-5-40 GB Network NetID
Google Drive S/C Global Cloud Unlimited Internet NetID & External
RDF S/B Rice Data Center 500GB free Network NetID
Rice Box S/C US Cloud Unlimited Internet NetID & External
CrashPlan B Off-site cloud Unlimited Internet Your NetID
![Page 60: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/60.jpg)
Data Security● Confidential (SSN, CC#, DL#)
○ Financial records○ Health records○ Education records
● Sensitive (Birth date, address, emergency contact, EID/SID)
![Page 61: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/61.jpg)
Security Classification
Rice On-Site Most Secure
Rice Cloud Contract Semi-Secure
Low Risk(Public Data)
CampusPress, RDF Google Drive
Moderate Risk(Sensitive Data) RDF Rice Box
High Risk(Confidential Data)
StorageConfluence
Rice BoxCrashPlan
High Risk(Regulated Data) Storage CrashPlan
![Page 62: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/62.jpg)
Data Archiving Definition● Provides a final version of your data.
● Stored for the long-term.
● May be shared publicly through a data archive.
![Page 63: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/63.jpg)
Why Archive Your Research Data with a Data Repository?
● Conform to publisher or funder requirements● Get cited
○ “studies that made [gene expression microarray] data available in a public repository received 9% … more citations than similar studies for which the data was not made available.” (Piowowar & Vision, 2013)
● Promote future research
![Page 64: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/64.jpg)
Data Archiving OptionsPublic Repositories:● Discipline based repository (e.g. GenBank or PANGEA)● General data repository (e.g. FigShare or Dataverse)● Institutional repository (e.g. Rice Digital Scholarship
Archive)
Private Approaches:● Long-term storage
![Page 65: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/65.jpg)
Rice Data Sharing Option: Rice Digital Scholarship Archive
https://scholarship.rice.edu/
![Page 66: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/66.jpg)
Questions to Ask in Evaluating a Data Repository1. How well will the data be preserved? How stable is the
repository?2. What kind of reputation does the archive have in the
community?3. Does the repository facilitate citation of the data?4. Does the repository allow you to describe the data fully
and make it discoverable?5. Are there curators who can help to deposit the data?6. What are the costs of deposit, if any?
![Page 67: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/67.jpg)
Data Archiving Caveats● Do not share confidential data (unless it has
been de-identified and approved through IRB).● Consult with your collaborators before
publishing data.● It may be possible to embargo data so that it is
not available until the related publication is released.
![Page 68: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/68.jpg)
Tools and Resources
![Page 69: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/69.jpg)
Use OSF to Manage Your Research Workflow and Collaborate
• Organize files in one place
• Share with collaborators• Control files access• Integrate with tools like
Box• Track versions• Make work citable • Facilitate reproducibility• Free & open sourcehttps://osf.io/
![Page 70: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/70.jpg)
Rename Your Files
•All PlatformsoPSRenamer
•MacoName Changer
•WindowsoBulk Rename Utility
University of Minnesota Libraries
![Page 71: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/71.jpg)
ResourcesBorer, Elizabeth T., et al “Some Simple Guidelines for Effective Data Management.”
Bulletin of the Ecological Society of America (2009): 205–14.DataOne Primer on Data Management,
https://www.dataone.org/sites/all/documents/DataONE_BP_Primer_020212.pdfDataverse, Data Management Plans, http://best-practices.dataverse.org/data-
management/ICPSR Guide to Social Science Data Preparation and Archiving,
http://www.icpsr.umich.edu/icpsrweb/content/deposit/guide/Svend Juul et al, “Take good care of your data,”
http://www.epidata.dk/downloads/takecare.pdfUK Data Archive, Managing and Sharing Data: Best Practices for Researchers,
http://www.data-archive.ac.uk/media/2894/managingsharing.pdf
![Page 72: How to Manage Your Data...2018/06/01 · “The Arms Acquisition Process: The Effect of Internal and External Constraints on Arms Race Dynamics,” The Journal of Conflict Resolution](https://reader035.vdocuments.us/reader035/viewer/2022070915/5fb5730420c8747866711d42/html5/thumbnails/72.jpg)
Thanks!Please contact [email protected] with any questions.Visit us online at http://researchdata.rice.edu/.Help us shape future workshops! Please complete this evaluation: http://library.rice.edu/requests/course-evaluation-form