ece599/692 - deep learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfgoogle cloud...

33
ECE599/692 - Deep Learning Chengcheng Li Date: 08/23/2018

Upload: others

Post on 23-Jan-2021

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

ECE599/692 - Deep Learning

Chengcheng Li

Date:08/23/2018

Page 2: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Content

• Course Information

• Google Cloud Platform

Page 3: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Course Website

Page 4: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Google Cloud Platform (GCP)

• Deep learning/neural network usually takes lots of computation resource• Storage• Memory• GPU

• GCP consists of a set of physical assets, such as computers and hard disk drives, and virtual resources, such as virtual machines (VMs).

• Use GPC for course projects

Page 5: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Google Cloud Platform (GCP)

• Education grants have been applied for this course. $50 credits are available for each students. To get the credits, you need:

• Email Chengcheng with Subject "599 - Google Cloud Account Request" or "692 - Google Cloud Account Request”

• Redeem your code• Pricing

• Calculate based on resource• Remove unnecessary occupations to avoiding incurring

charges• What if I use up all credits?

Page 6: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Redeem Students CodeStep1:receiveemailfromDr.Qi,meormaybeGCP,whichlookslikethefollowingfigure

Page 7: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Redeem Students CodeStep2:findandclicktheStudentCouponRetrievalLink

Page 8: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Redeem Students CodeStep3:fillouttheform.UTKemailisrequired.

Page 9: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Redeem Students CodeStep4:verifyyouremail

Page 10: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Redeem Students CodeStep5:receiveemailfromGCP,findtheCouponCodeandclick[here]toredeem

Page 11: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Redeem Students CodeStep5:pasteyourcodeandfillouttheform.It’sdone.

Page 12: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Checking Credits

Page 13: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Concepts

• Projects

• Instances• Virtual machine

• Buckets• Data/objects storage

Page 14: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Ways to Interact With GCP

• Google Cloud Platform Console

• Command-line interface• gcloud• cloud shell

Page 15: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

GCP Docs

Page 16: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

GCP Help

Page 17: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Projects

• Any GCP resources that you allocate and use must belong to a project.

• Each GCP project has:• A project name, which you provide.• A project ID, which you can provide or GCP can

provide for you.• A project number, which GCP provides.

• Existing projects vs new self-created projects

Page 18: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Check Projects

Page 19: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Create Projects

Page 20: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Remove Projects

Page 21: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Instances

• An instance is a virtual machine (VM)• Create an instance by using the Google Cloud

Platform Console or the gcloud command-line tool

• Each instance belongs to a project, and a project can have one or more instances.

• Remove unnecessary instances to avoid incurring charge

Page 22: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Create New Instances

Page 23: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are
Page 24: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Remove Instances

Page 25: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Bucket

• Buckets contain objects/datasets.• A bucket is always owned by the project

team owners group.• Creating Storage Buckets

• console • GSUTIL

• Access Cloud Storage bucket

Page 26: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Create Bucket

Page 27: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Upload Data

Page 28: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Access Public Bucket

• gsutil isaPythonapplication thatletsyouaccessCloudStoragefromthecommand line.

• Everybuckethasitsuniquename.

Page 29: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

gcloud• Gcloud isatoolthatprovides theprimary command-line

interfacetoGoogleCloudPlatform.• Youcanusethistooltoperformmanycommonplatform tasks

either fromthecommand-line orinscriptsandotherautomations.

• ClicktheActiveCloudShellbuttoninthetoolbartoaccessit

Page 30: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

gcloud• Itisaterminalwhereyoucancreatefiles, installpackage,run

yourcodeandetc.

Page 31: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are

Walkthrough

• Set up your project• Select or create a GCP project

• Set up your environment• Install packages and dependences

• Prepare data• Create a bucket or access an public bucket

• Prepare your code • Write or download the code

• Run the code with gcloudhttps://cloud.google.com/ml-engine/docs/tensorflow/getting-started-training-prediction

Page 32: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are
Page 33: ECE599/692 - Deep Learningweb.eecs.utk.edu/~hqi/deeplearning/lecture01-intro-gcp.pdfGoogle Cloud Platform (GCP)• Education grants have been applied for this course. $50 credits are