ravi garg – let’s do itkordinglab.com › lab_teaching_2016 › session_5 › intro to...images,...

27
Demystifying Docker RAVI GARG – LET’S DO IT 11/29/2016 1

Upload: others

Post on 03-Jul-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Demystifying DockerRAVI GARG – LET ’S DO IT

11/29/2016 1

Page 2: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

How many of you have faced the issue “It works on my machine but not somewhere else” ?

11/29/2016 2

Page 3: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

What were the issues?Different operating system

Different servers

Conflicting software/dependencies/version requirements

Different toolsets

Basically different environment

11/29/2016 3

Page 4: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

What we will learn?What is Docker? What it does? Why Docker?

How is it different from virtual machines?

Images, Containers, Docker-file, Docker-hub and Workflow

Installation and Demo

11/29/2016 4

Page 5: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Intuition

11/29/2016 5

Page 6: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Why and When Docker?To solve the issue “It runs on my machine but not anywhere else.”

Many potential use cases mainly inclined for Software developers

But has value for Scientists and Researchers as well

11/29/2016 6

Page 7: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Conventional Software development

11/29/2016 7

Page 8: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Matrix from hell

11/29/2016 8

Page 9: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Analogy – Shipping Industry

11/29/2016 9

Page 10: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Another matrix from hell

11/29/2016 10

Page 11: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Solution –Shipping Container

11/29/2016 11

Page 12: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Solution - Containers

11/29/2016 12

Page 13: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Eliminates matrix from hell

11/29/2016 13

Page 14: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Seriously Why?BUILD ONCE AND RUN ANYWHERE◦ A clean, safe, hygienic, portable runtime environment for your

application◦ No worries about missing dependencies, packages and other pain

points during deployment◦ Run each app in its own isolated container, so you can run various

versions of libraries and other dependencies for each app without worrying.

◦ Reduce/eliminate concerns about compatibility on different platforms, either your own or your customers.

◦ Cheap, zero-penalty containers to deploy services. A VM without the overhead of a VM. Instant replay and reset of image snapshots.

11/29/2016 14

Page 15: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

So finally what is Docker?“Docker is software containerization platform which wraps a piece of software in a complete file system (called container) that contains everything needed to run: code, runtime, systemtools, system libraries, which thereby guarantees that the software will always run the same regardless of its environment”

In simple words every thing from source code, dependencies, binaries i.e. all the bare minimum get packed into Linux Containers◦ Units of software delivery◦ Run everywhere

◦ Regardless of kernel version◦ Regardless of host distro

◦ Run anything◦ If it can run on host, it can run in the container

11/29/2016 15

Page 16: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Difference with VMs

11/29/2016 16

Page 17: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Containers vs VMs

11/29/2016 17

Side note : A hypervisor or virtual machine monitor (VMM) is a piece of computer software, firmware or hardware that creates and runs virtual machines. A computer on which a hypervisor runs one or more virtual machines is called a host machine, and each virtual machine is called a guest machine.

Page 18: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Internals

11/29/2016 18

Page 19: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Let’s get technical: Docker Image, Container, Docker-file.DOCKER IMAGE is a inert, immutable, file that's essentially a snapshot of a container. It doesn’t have state and never changes. It is a set of layers. You start with base layer, make changes which are saved in layers forming another image.DOCKER CONTAINERS is a running instance of the image. They're lightweight and portable encapsulations of an environment in which to run applications.DOCKER FILE is a text document that contains all the commands a user could call on the command line to assemble an image.

“IF AN IMAGE IS A CLASS, THEN FILE IS THE DEFINITION AND CONTAINER IS AN INSTANCE OF A CLASS—A RUNTIME OBJECT.”

11/29/2016 19

Page 20: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Docker-Hubhttps://hub.docker.com

11/29/2016 20

Page 21: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Git AnalogyDocker Git DescriptionImage Repository Collection of

commitsContainer Clone Used for local

executionDocker-hub Github Remote server

11/29/2016 21

Page 22: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Docker workflow - 1

11/29/2016 22

Page 23: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Docker workflow in wordsFind an Image on Docker hub

Pull the Image from Docker hub

Run the Image on Docker host (Container)

Stop the instance

Commit the changes made to the instance (optional)

Remove the instance

Remove the image

11/29/2016 23

Page 24: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Docker workflow in commandsdocker search ubuntu

docker pull ubuntu

docker images

docker run –it ubuntu bash

apt-get install this and that

git clone git://…./mycode

pip install –r requirements.txt

docker ps –a (-l)

docker commit containerName imageName

docker rm containerName

docker rmi imageName

docker push

11/29/2016 24

Page 25: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Installation and DemoPavan’s PyGlmnet

Eva’s Project (optional)

11/29/2016 25

Page 26: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Docker commandsdocker search

docker pull

docker images

docker run

docker ps

docker commit

docker rm

docker rmi

docker-machine ls

11/29/2016 26

Page 27: RAVI GARG – LET’S DO ITkordinglab.com › lab_teaching_2016 › session_5 › Intro to...Images, Containers, Docker-file, Docker-hub and Workflow Installation and Demo 11/29/2016

Questions

11/29/2016 27