chromatophore - a nave cephfs backup and …...research at libr • neuroscience-based, clinical and...
TRANSCRIPT
![Page 1: Chromatophore - A Nave CephFS Backup and …...Research At LIBR • Neuroscience-based, clinical and developmental research: 1. To develop neuroscience-based individually predic.ve](https://reader033.vdocuments.us/reader033/viewer/2022050403/5f8098a6ad837155f37507dd/html5/thumbnails/1.jpg)
Chromatophore-ANa.veCephFSBackupandArchiveTool
BradyDeetzLaureateIns.tuteforBrainResearch
![Page 2: Chromatophore - A Nave CephFS Backup and …...Research At LIBR • Neuroscience-based, clinical and developmental research: 1. To develop neuroscience-based individually predic.ve](https://reader033.vdocuments.us/reader033/viewer/2022050403/5f8098a6ad837155f37507dd/html5/thumbnails/2.jpg)
ResearchAtLIBR
• Neuroscience-based,clinicalanddevelopmentalresearch:1. Todevelopneuroscience-basedindividuallypredic.veassessments.2. Todevelopnovelbrain-bodybasedinterven.ons• Focus:mood,anxiety,addic.on,orea.ngdisorders.
3. Touseexperimentalsystemstoquicklytestassessmentsandinterven.ons.
![Page 3: Chromatophore - A Nave CephFS Backup and …...Research At LIBR • Neuroscience-based, clinical and developmental research: 1. To develop neuroscience-based individually predic.ve](https://reader033.vdocuments.us/reader033/viewer/2022050403/5f8098a6ad837155f37507dd/html5/thumbnails/3.jpg)
MyUnfortunateInheritanceNovember2015
• 1PB-SpectraLogicT950e• LocalDisks• SpectraLogicBlackPearl• 400TB-OracleZFS• 100TB-EMCIsilon
![Page 4: Chromatophore - A Nave CephFS Backup and …...Research At LIBR • Neuroscience-based, clinical and developmental research: 1. To develop neuroscience-based individually predic.ve](https://reader033.vdocuments.us/reader033/viewer/2022050403/5f8098a6ad837155f37507dd/html5/thumbnails/4.jpg)
CephDesign
• 8xOSDnodes– 256GBRAM– 2xIntelS3610forOS– 24x6TBEnterpriseSATA(24slotchassis)– 2xIntelP3700– 2xXeon2660V4
• 28x2.0GHz– MellanoxConnectX-4(40Gbps)->BrocadeVDX6940
![Page 5: Chromatophore - A Nave CephFS Backup and …...Research At LIBR • Neuroscience-based, clinical and developmental research: 1. To develop neuroscience-based individually predic.ve](https://reader033.vdocuments.us/reader033/viewer/2022050403/5f8098a6ad837155f37507dd/html5/thumbnails/5.jpg)
CephDesign(Cont…)
• 2xMDS(ac.ve/standby)+3xMONnode– 128GBRAM– 2xIntelS3610forOS– 2xXeon2643V4• 12x3.4GHz
– MellanoxConnectX-4(40Gbps)->BrocadeVDX6940
![Page 6: Chromatophore - A Nave CephFS Backup and …...Research At LIBR • Neuroscience-based, clinical and developmental research: 1. To develop neuroscience-based individually predic.ve](https://reader033.vdocuments.us/reader033/viewer/2022050403/5f8098a6ad837155f37507dd/html5/thumbnails/6.jpg)
Chromatophore?
• UsesCephFS’sna.velibraries• Parallel(MPI+OpenMP)• Backupstodifferentkindsoftargets– Ceph– SpectraLogicS3– AmazonS3– Glacier– Tar– POSIXfilesystems
![Page 7: Chromatophore - A Nave CephFS Backup and …...Research At LIBR • Neuroscience-based, clinical and developmental research: 1. To develop neuroscience-based individually predic.ve](https://reader033.vdocuments.us/reader033/viewer/2022050403/5f8098a6ad837155f37507dd/html5/thumbnails/7.jpg)
WorkerThread
WorkerThread
WorkerThread
WorkerThread
WorkerThread
WorkerThread
WorkerThread
WorkerThread
WorkerThread
WorkerThread
WorkerThread
WorkerThread
WorkerThread
WorkerThread
WorkerThread
WorkerThread
ConfigFile(JSON) BackupHistory(HDF5)
![Page 8: Chromatophore - A Nave CephFS Backup and …...Research At LIBR • Neuroscience-based, clinical and developmental research: 1. To develop neuroscience-based individually predic.ve](https://reader033.vdocuments.us/reader033/viewer/2022050403/5f8098a6ad837155f37507dd/html5/thumbnails/8.jpg)
Wheretogetit?
• WillbereleasedbytheendofthisDecember– Excuses…• S.llwri.ngunittests• Valida.ngDS3codewithSpectraLogic• RecentlyportedfromPythontoJava
• hkps://github.com/bdeetz/chromatophore