Tazro Inutano Ohta DBCLS, ROIS twitter.com/inutano github.com/inutano speakerdeck.com/inutano

RaaS Prototype 📄📄

📄📄

Apache Mesos + Chronos

manager

Node Node Node Node Node

Public/Private Docker Registry

Dockerfiles

workflow.json

📦📦 📦

🔡Data

📦

Storage

post

post/get

transfer

push

pull

run

mount

📡

🔡

User

Research Activity Time Course

Details of Project Design Sampling Primary Data Data Processing

& AnalysisPublicationText, FigsWet Experiments

BioProject BioSample Genbank, DRASMART Protocol

https://www.docker.com/whatisdocker/

Docker

https://mesosphere.com/learn/

🐳

Mesos!Master

🐳Mesos Slave

Node Node Node

🐳!Galaxy

🐳

Aurora🐳

Mesos Slave

🐳 BWA

🐳

samtools

L2VPN

🐳 Docker Container Overlay Cloud

🐳

Mesos!Master 🐳

Mesos Slave

Node Node Node

🐳!Galaxy

🐳

Aurora🐳

Mesos Slave

🐳 BWA

🐳

samtools

L2VPN

🐳 Docker Container

🐳!CLI-

manager

🐳!Chronos

Overlay Cloud w/ RaaS manager

🐳

Mesos!Master 🐳

Mesos Slave

Node Node Node

🐳!Galaxy

🐳 Mesos Slave

🐳 BWA

🐳

samtools

L2VPN

🐳 Docker Container

🐳!CLI-

manager🐳!

super!cool!

scheduler

New Scheduler Required

🐳

Mesos!Master

🐳 Mesos Slave

Node Node Node

🐳!Galaxy

🐳

Aurora🐳

Mesos Slave

🐳 BWA

🐳

samtools

L2VPN

🐳 Docker Container

1 2 3

4

1. Run Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received executer, 4. run docker container

How tools are executed

🐳

Mesos!Master

🐳 Mesos Slave

Node Node Node

🐳!Galaxy

🐳

Aurora🐳

Mesos Slave

🐳 BWA

🐳

samtools

L2VPN

🐳 Docker Container

1: Each node mount NFS. 2: Galaxy has the NFS path as file path in the conf. 3: Mesos Slave Container has a path to NFS as a mounted volume (docker command option -v). 4: Tool Container also has a path to NFS.

NFS

1

2 3

4

How data stored

🐳!Mesos Master

🐳Mesos Slave

Node Node Node

🐳!Galaxy

🐳 Mesos Slave

🐳 BWA

🐳

samtools

L2VPN

🐳 Docker Container

🐳!CLI-

manager

🐳!Marathon

more portability?

🐳!SCS

1

1