pyladies talk: learn to love the command line!

LEARN TO LOVE THECOMMAND LINE

Thursday, 19 February, 2015

Google MontrealShopify Montreal

IN LOVE WITH...THE COMMAND LINE

/ /

http://cli-talk.bitballoon.com

Blanca Mancilla bluciam @Blanckus

LinuxCommand.org

You have Linux installed and running. TheGUI is working fine, but you are gettingtired of changing your desktop themes.You keep seeing this "terminal" thing.

WHAT IS THE COMMANDLINE?

Anybody with little or no experience?What do you know about it?

What are you expecting to learn tonight?

WHAT IS THE COMMANDLINE?

Specifically, the computer program is the operatingsystem (UNIX or nowadays Linux) and the interface is

what we called the .

THE COMMAND LINEAND THE SHELL

A command-line interface (CLI) is a means of interacting with a computer program where the user issues commands to the program in the form of successive lines of text (command lines).

https://en.wikipedia.org/wiki/Command-line_interface

shell

TYPES OF SHELLS IN LINUXshbashcsh and tcshkshread more...

HOW DO I KNOW WHICHSHELL?

~ $ w h i c h b a s h/ b i n / b a s h~ $ w h i c h s h/ b i n / s h~ $ w h i c h c s h~ $ e c h o $ S H E L L/ b i n / b a s h~ $ s h$ e c h o $ S H E L L/ b i n / b a s h$ p s - p $ $ P I D T T Y T I M E C M D1 7 7 9 3 p t s / 2 8 0 0 : 0 0 : 0 0 s h$ ^ D~ $ p s - p $ $ P I D T T Y T I M E C M D1 5 6 1 5 p t s / 2 8 0 0 : 0 0 : 0 1 b a s h

THE INSPIRATION

by Jeroen JanssensData Science at the Command Line

—Chris H. WigginsAssociate Professor in the Department of Applied Physics

and Applied Mathematics at Columbia Universityand Chief Data Scientist at The New York Times

The Unix philosophy of simple tools, eachdoing one job well, then cleverly pipedtogether, is embodied by the commandline. Jeroen expertly discusses how to

bring that philosophy into your work indata science, illustrating how the

command line is not only the world of fileinput/ output, but also the world of data

manipulation, exploration, and evenmodeling.

APPENDIX: COMMANDSalias awk aws bash bc bigmler body cat cd chmod colscowsay cp csvcut csvgrep csvjoin csvlook csvsort csvsql

csvstack csvstat curl curlicue cut display drake dseq echoenv export feedgnuplot fieldsplit find for git grep headheader in2csv jq json2csv less ls man mkdir mv parallel

paste pbc pip pwd python R Rio Rio-scatter rm

SOME DETAILSNOW!

Yes! Of course.

FOR LOOPS?

f o r i i n * p d f ; d o e v i n c e $ i ; d o n e

FOR LOOPS: l y c e u m $ l s * p d fH o w T o B e A P r o g r a m m e r . p d f S E N G 3 0 2 0 - 0 . 1 . p d f t e a c h i n g - p r g m . p d fS E N G 3 0 1 0 - B A R T - R e q - v 1 - 1 - 3 d . p d f S E N G 3 0 2 0 _ 0 7 s 2 . p d f: l y c e u m $ e v i n c e * p d f: l y c e u m $ f o r i i n * p d f ; d o e v i n c e $ i ; d o n e

or even

FOR LOOPSIn a script

f o r i i n * p d fd o e v i n c e $ id o n e

f o r i i n ` l s * p d f `d o e v i n c e $ id o n e

More info

CHECK IF A FILE EXISTS ANDIF NOT ...

c l i - t a l k : $ [ - f i n d e x . h t m l ] & & e c h o " Y e s , w e h a v e a p r e s e n t a t i o n ! " \| | e c h o " P A N I C "

CHECK IF A FILE EXISTS ANDIF NOT ...

Let's try a demo

CHECK IF A FILE EXISTS ANDIF NOT ...

c l i - t a l k : $ l o c a t e * 9 7 6 8 . J P G

GLOB PATTERNS:REAL MAGIC!

Strictly speaking, there are neither regular expressionsnor patterns used in pattern recognition.

They are .glob patterns

GLOB PATTERNS:REAL MAGIC!

l s a p p / * . { e r b , s c s s , r b , y m l }

v i p u b l i c _ h t m l / [ i I ] * . h t m *

My favorite: Move all image files for the years 2010 to 2012 into .

GLOB PATTERNS:REAL MAGIC!

my_dir

m v { I M G , i m g } * 2 0 1 [ 0 1 2 ] * . { j p g , J P G , p n g , g i f } m y _ d i r

FIND A RESOURCEANYWHERE IN YOUR HARD

DRIVE

versus

FIND A RESOURCE ...locate find

L o r i B i z : $ l o c a t e * . e r bL o r i B i z : $ f i n d . - n a m e * . e r b

find . -name *.erb -exec ls {} \;

find . -name *.erb -exec grep mytableauthor {} \;

find . -name *.erb -exec grep -H mytableauthor {} \;

find . -name *.scss -exec grep -H mytableauthor {} \;

find . -name *.scss -exec grep -n -H mytableauthor {} \;

FIND A RESOURCE...

FIND AND REPLACE TRAILINGSPACES IN SOURCE CODE

FIND ... TRAILING SPACES INSOURCE CODE

c l i - t a l k $ g r e p " \ s \ + $ " i n d e x . h t m l

... REPLACE TRAILING SPACESIN SOURCE CODE

L o r i B i z $ f i n d . - n a m e * . e r b - e x e c g r e p - H n " \ s \ + $ " { } \ ; L o r i B i z $ f i n d . - n a m e * . e r b - e x e c g r e p - H n " \ s \ + $ " { } \ ; - e x e c v i { } \ ;

# O n c e i n v i f i n d a n d r e p l a c e u s i n g t h e c o m m a n d: % s / \ s \ + $ / /

MAKING BACKUPS OFGIT REPOSITORIESsuperspreadsheet.wordpress.com

MAKING BACKUPS OF ...1. pull from the bare repository2. commit local changes3. push changes to the bare repository

Pull and Commit

MAKING BACKUPS OF ...

1 # ! / b i n / s h 2 # 3 # A u t o m a t i c p u l l a n d c o m m i t o n t h e d i r e c t o r i e s l i s t e d i n d i r s _ t o _ p u l l 4 5 C R O N L O G = " / c o m p l e t e / p a t h / t o / p u l l c o m m i t p u s h . l o g " 6 C O M M I T M S G = " / c o m p l e t e / p a t h / t o / m s g A u t o C o m m i t " 7 e c h o > > $ C R O N L O G 8 e c h o " N i g h t l y g i t a u t o - c o m m i t f o r t h e a b s e n t m i n d s : $ ( d a t e ) " > > $ C R O N L O G 9 f o r i i n ` c a t / c o m p l e t e / p a t h / t o / d i r s _ t o _ p u l l `1 0 d o ( c d $ i ;1 1 e c h o " P U L L $ i $ ( d a t e ) " > > $ C R O N L O G ;1 2 g i t p u l l > > $ C R O N L O G 2 > & 1 ;1 3 e c h o " C O M M I T $ i $ ( d a t e ) " > > $ C R O N L O G ;1 4 g i t c o m m i t - a - F $ C O M M I T M S G > > $ C R O N L O G 2 > & 11 5 e c h o > > $ C R O N L O G )1 6 d o n e 1 7 e c h o > > $ C R O N L O G ;

Push

MAKING BACKUPS OF ...

1 # ! / b i n / s h 2 # 3 # A u t o m a t i c p u s h o n t h e d i r e c t o r i e s l i s t e d i n d i r s _ t o _ p u s h 4 5 C R O N L O G = " / c o m p l e t e / p a t h / t o / p u l l c o m m i t p u s h . l o g " 6 e c h o > > $ C R O N L O G 7 e c h o " N i g h t l y g i t a u t o - p u s h f o r t h e a b s e n t m i n d s : $ ( d a t e ) " > > $ C R O N L O G 8 f o r i i n ` c a t / c o m p l e t e / p a t h / t o / d i r s _ t o _ p u s h ` 9 d o ( c d $ i ;1 0 e c h o " P U S H : $ i $ ( d a t e ) " > > $ C R O N L O G1 1 g i t p u s h > > $ C R O N L O G 2 > & 11 2 e c h o > > $ C R O N L O G1 3 ) ;1 4 d o n e1 5 e c h o > > $ C R O N L O G ;

: from the Greek word for time, χρόνος chronos.

MAKING BACKUPS USING ...cron

https://en.wikipedia.org/wiki/Cron

MAKING BACKUPS USING ...Cron is a time-based job scheduler thatSysadmins use to schedule jobs to run

periodically at fixed times, dates, orintervals (i.e. download email at regular

intervals).

MAKING BACKUPS USING ...c r o n t a b - e

minute hour dayOfMonth month dayOfWeek command

3 2 * * * / c o m p l e t e / p a t h / t o / p u l l _ c o m m i t 2 > / c o m p l e t e / p a t h / t o / p u l l _ c o m m i t . e r r5 2 * * * / c o m p l e t e / p a t h / t o / p u s h 2 > / c o m p l e t e / p a t h / t o / p u s h . e r r

Blog post in development!

CREATING A COPY OF A GITREPOSITORY WHICH IS NOT

QUITE A COPY

THE ENDAre you in love yet?

JavaScript source code for the slides taken from.

I encourage you to try it!

THE ENDreveal.js