hpc in the cloud

39
HPC in the Cloud Guy Tel-Zur

Upload: lilly

Post on 23-Feb-2016

31 views

Category:

Documents


0 download

DESCRIPTION

HPC in the Cloud. Guy Tel- Zur. http://aws.amazon.com/console/. Sign In. EC2 Dashboard. EC2 AMI for scientific computing in Python and R. AMI ID : ami-84bd41ed. Source: http://www.r-bloggers.com/ec2-ami-for-scientific-computing-in-python-and-r/. Launching Instance. Connect using PuTTY. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: HPC in the Cloud

HPC in the CloudGuy Tel-Zur

Page 2: HPC in the Cloud

http://aws.amazon.com/console/

Page 3: HPC in the Cloud

Sign In

Page 4: HPC in the Cloud

EC2 Dashboard

Page 5: HPC in the Cloud

EC2 AMI for scientific computing in Python and R

AMI ID: ami-84bd41ed

Source: http://www.r-bloggers.com/ec2-ami-for-scientific-computing-in-python-and-r/

Page 6: HPC in the Cloud
Page 7: HPC in the Cloud
Page 8: HPC in the Cloud
Page 9: HPC in the Cloud
Page 10: HPC in the Cloud
Page 11: HPC in the Cloud

Launching Instance

Page 12: HPC in the Cloud
Page 13: HPC in the Cloud

Connect using PuTTY

Page 14: HPC in the Cloud
Page 15: HPC in the Cloud

Install VNC serverfrom the following packages: * xtightvncviewer * xvnc4viewer

Page 16: HPC in the Cloud

Add a user

As root:

useradd telzurmkdir /home/telzurchown –R telzur /home/telzursu telzur

Page 17: HPC in the Cloud

Passwordless ssh

ssh-keygen -t dsacd .sshcat ./id_dsa.pub >> authorized_keys2

Use a lightweight window manager such as icewm

Page 18: HPC in the Cloud

Open ports 5800,5900-5901…in the security group for VNC to work

Page 19: HPC in the Cloud

Install a light window managerapt-get install icewm

Page 20: HPC in the Cloud

HPC Cluster

Page 21: HPC in the Cloud

16 cores

Page 22: HPC in the Cloud

EBS /dev/sdh /volchange made in /etc/fstab

Page 23: HPC in the Cloud

Installations

• yum install • gcc• gcc-c++• gcc-gfortran• Lapsck• Python-devel

• Need more repositories:• rpm -Uvh

http://download.fedora.redhat.com/pub/epel/5/x86_64/epel-release-5-4.noarch.rpm

• yum install atlas.x86_64 blas.x86_64 lapack.x86_64• yum groupinstall XFCE (startxfce4)• yum install glibc-devel.i386

Page 24: HPC in the Cloud

Test MPI

Page 25: HPC in the Cloud
Page 26: HPC in the Cloud

1:41 AM PDT We are currently investigating latency and error rates with EBS volumes and connectivity issues reaching EC2 instances in the US-EAST-1 region.2:18 AM PDT We can confirm connectivity errors impacting EC2 instances and increased latencies impacting EBS volumes in multiple availability zones in the US-EAST-1 region. Increased error rates are affecting EBS CreateVolume API calls. We continue to work towards resolution.2:49 AM PDT We are continuing to see connectivity errors impacting EC2 instances, increased latencies impacting EBS volumes in multiple availability zones in the US-EAST-1 region, and increased error rates affecting EBS CreateVolume API calls. We are also experiencing delayed launches for EBS backed EC2 instances in affected availability zones in the US-EAST-1 region. We continue to work towards resolution.3:20 AM PDT Delayed EC2 instance launches and EBS API error rates are recovering. We're continuing to work towards full resolution.4:09 AM PDT EBS volume latency and API errors have recovered in one of the two impacted Availability Zones in US-EAST-1. We are continuing to work to resolve the issues in the second impacted Availability Zone. The errors, which started at 12:55AM PDT, began recovering at 2:55am PDT5:02 AM PDT Latency has recovered for a portion of the impacted EBS volumes. We are continuing to work to resolve the remaining issues with EBS volume latency and error rates in a single Availability Zone.6:09 AM PDT EBS API errors and volume latencies in the affected availability zone remain. We are continuing to work towards resolution.

Quality of Service ????

Page 27: HPC in the Cloud

BBC

Page 28: HPC in the Cloud

Who is affected by EC2?So

urce

: htt

p://

ec2d

isab

led.

com

/(p

artia

l list

)

Page 29: HPC in the Cloud
Page 30: HPC in the Cloud
Page 31: HPC in the Cloud
Page 32: HPC in the Cloud

Saving the computer as an AMI

Page 33: HPC in the Cloud
Page 34: HPC in the Cloud
Page 35: HPC in the Cloud

2 X 16cores !

Page 36: HPC in the Cloud
Page 37: HPC in the Cloud

Add graphical WM (xfce4) using remote desktop (VNC) – Open port

Page 38: HPC in the Cloud

Price

$1.60/hour for this xlarge machine

$4,290 for 1 year$6,590 for 3 years

This is the TCO !

Page 39: HPC in the Cloud

vi /etc/ssh/sshd_config

Change: password authentication from no to yes

Rload sshd by /etc/init.d/sshd reload