cac linux clusterintro
DESCRIPTION
Introduction to Using Linux Clusters at Cornell Center for Advanced ComputingTRANSCRIPT
Introduction to Using the
V4 Linux ClusterCornell Center for Advanced Computing
April 10, 2023 www.cac.cornell.edu 1
Drew DolgertJodie Sprouse
http://www.cac.cornell.edu/~ajd27/intro.html
2.1 Connecthttp://www.cac.cornell.edu/~ajd27/intro.html
CAC
What is it?
Login Node
Scheduler
[email protected]@linuxlogin1.cac.cornell.edu
ls
firstrun/1469.OU
pwd
/home/ajd27
SSH Server
BASH
xclockX11 Server
Window
SSH Server
BASH
xclockX11 Server
Window
SSH Server
BASH
xclockX11 Server
Window
SSH Server
BASH
xclockX11 Server
Window
X11 X11X11
SSH
http://www.cac.cornell.edu/~ajd27/intro.htmlWeb site
Your computer linuxlogin2
Download intro.tar.gzwith webbrowser
Send with Secure Copy
3 Set Up Home Directory
http://www.cac.cornell.edu/~ajd27/intro.html
3.1 Transfer Files3.2 cd and ls3.3 Getting Help
The Shell
lscdcatgrepfindlessechopwdexitrmlogoutman
mkdirfgbgsshifforexportcutsedawkmakexargs
difftouchchmodaliasumaskheadtailtoptarmvlnexpr
pushdpopdsourcesortsleeppushdpopdpsnohuptimedate
N O W
VariablesWorking
Directory
(other things)
/
bin home usr
ajd27 srl6
dev
/
bin home usr
ajd27 srl6
dev
$HOME~ajd27
~
/
bin home usr
.. srl6
.
relative../../srl6
/
bin home usr
ajd27 srl6
dev
rooted/home/ajd27/dev
/
bin home usr
ajd27 srl6
bin
${PATH}/bin:$HOME/bin
4.1 Starting: Read Examples of Sessions
DIRECTORY_WHERE_I_PUT_THE_GOOD_STUFF
Scheduler
Job
export VAR
echo *.txtYou type:
echo s0.txt s1.txt s2.txtecho hears:
s0.txt s1.txt s2.txtecho answers:
Substitution
process
sim<input.txtsim>output.txtsim 2>err.txt
process
grep less
grep Mop *.txt | less
grep -C -i 2 mop <s0.txt >> mop.txt
switches redirects
argumentspath
gediteclipsenanoemacsvi
sensibleprogrammer
get-it-donedo-it-all
did what?
5.1 Starting: Develop Commands to Run the Program
5.2 Run a Simple Script
Run in batch!
Login Node
Scheduler
v4 v4dev v4-64g
Choosing a Queue
Schedulinga Queue
-A Account/project-N Job name-l Nodes,walltime-j Join out-error
TODOFor compute node
#PBS For scheduler
Read 6.1 and 6.2
Do 6.3 Submit a Script
input filesbatch file
job
job outoutput files
SchedulerYour script
What runs(and how you find out what ran)
eligible
running
blocked
removed
completedStates of a jobaccording to scheduler
$TMPDIR
$HOME
$TMPDIR
$TMPDIR
$TMPDIR
/v4scratch/$USER
Shared Drives
Read 7.1
Do 7.2 Use the local drive
Interactive #PBS -Ilinuxlogin2$ nsub local.shExecuting interactiveqsub: waiting for job 1085387.scheduler.v4linux to startqsub: job 1085387.scheduler.v4linux ready
-bash-3.1$ hostnamecompute-3-48.v4linux
PI
projectaccount disk
CPU
consulting
Control
member disk
CPU
member disk
CPU
Broader View
Can’t finish on lab computer.Have to write more complex simulation.Need a research portal.
by Kman999 on Flickr: 225483156
Mike Ross of corestore.org, wikipedia.
Flickr by liewcf/268421712
Rob Shenk on Flickr rcsj/2500928072/
aitor_mac on Flickr mac_mania/3914910630/
anti_christa on Flickr antichrista/4499789643/
on Flickr by turbojoe/457215996
on Flickr by vlashton/2103759668/
eberg_canada on Flickr eberg/555034750
house-n-baby { Lea }'s house-n-baby/2669683890
susanica/2702214137/