cac linux clusterintro

Introduction to Using the

V4 Linux ClusterCornell Center for Advanced Computing

April 10, 2023 www.cac.cornell.edu 1

Drew DolgertJodie Sprouse

http://www.cac.cornell.edu/~ajd27/intro.html

2.1 Connecthttp://www.cac.cornell.edu/~ajd27/intro.html

CAC

What is it?

Login Node

Scheduler

ajd27@linuxlogin2.cac.cornell.eduajd27@linuxlogin1.cac.cornell.edu

ls

firstrun/1469.OU

pwd

/home/ajd27

SSH Server

BASH

xclockX11 Server

Window

SSH Server

BASH

xclockX11 Server

Window

SSH Server

BASH

xclockX11 Server

Window

SSH Server

BASH

xclockX11 Server

Window

X11 X11X11

SSH

http://www.cac.cornell.edu/~ajd27/intro.htmlWeb site

Your computer linuxlogin2

Download intro.tar.gzwith webbrowser

Send with Secure Copy

3 Set Up Home Directory

http://www.cac.cornell.edu/~ajd27/intro.html

3.1 Transfer Files3.2 cd and ls3.3 Getting Help

The Shell

lscdcatgrepfindlessechopwdexitrmlogoutman

mkdirfgbgsshifforexportcutsedawkmakexargs

difftouchchmodaliasumaskheadtailtoptarmvlnexpr

pushdpopdsourcesortsleeppushdpopdpsnohuptimedate

N O W

VariablesWorking

Directory

(other things)

/

bin home usr

ajd27 srl6

dev

/

bin home usr

ajd27 srl6

dev

$HOME~ajd27

~

/

bin home usr

.. srl6

.

relative../../srl6

/

bin home usr

ajd27 srl6

dev

rooted/home/ajd27/dev

/

bin home usr

ajd27 srl6

bin

${PATH}/bin:$HOME/bin

4.1 Starting: Read Examples of Sessions

DIRECTORY_WHERE_I_PUT_THE_GOOD_STUFF

Scheduler

Job

export VAR

echo *.txtYou type:

echo s0.txt s1.txt s2.txtecho hears:

s0.txt s1.txt s2.txtecho answers:

Substitution

process

sim<input.txtsim>output.txtsim 2>err.txt

process

grep less

grep Mop *.txt | less

grep -C -i 2 mop <s0.txt >> mop.txt

switches redirects

argumentspath

gediteclipsenanoemacsvi

sensibleprogrammer

get-it-donedo-it-all

did what?

5.1 Starting: Develop Commands to Run the Program

5.2 Run a Simple Script

Run in batch!

Login Node

Scheduler

v4 v4dev v4-64g

Choosing a Queue

Schedulinga Queue

-A Account/project-N Job name-l Nodes,walltime-j Join out-error

TODOFor compute node

#PBS For scheduler

Read 6.1 and 6.2

Do 6.3 Submit a Script

input filesbatch file

job

job outoutput files

SchedulerYour script

What runs(and how you find out what ran)

eligible

running

blocked

removed

completedStates of a jobaccording to scheduler

$TMPDIR

$HOME

$TMPDIR

$TMPDIR

$TMPDIR

/v4scratch/$USER

Shared Drives

Read 7.1

Do 7.2 Use the local drive

Interactive #PBS -Ilinuxlogin2$ nsub local.shExecuting interactiveqsub: waiting for job 1085387.scheduler.v4linux to startqsub: job 1085387.scheduler.v4linux ready

-bash-3.1$ hostnamecompute-3-48.v4linux

PI

projectaccount disk

CPU

consulting

Control

member disk

CPU

member disk

CPU

help@cac.cornell.eduhttp://www.cac.cornell.edu/help

This talk http://slidesha.re/eAzPXh

Broader View

Can’t finish on lab computer.Have to write more complex simulation.Need a research portal.

by Kman999 on Flickr: 225483156

Mike Ross of corestore.org, wikipedia.

Flickr by liewcf/268421712

Rob Shenk on Flickr rcsj/2500928072/

aitor_mac on Flickr mac_mania/3914910630/

anti_christa on Flickr antichrista/4499789643/

on Flickr by turbojoe/457215996

on Flickr by vlashton/2103759668/

eberg_canada on Flickr eberg/555034750

house-n-baby { Lea }'s house-n-baby/2669683890

susanica/2702214137/