tecnologias de cloud e data centerngarcia/old/tcdc1415/aula 2.pdf · tecnologias de cloud e data...
TRANSCRIPT
Tecnologias de Cloud e Data Center (11489)
Ano Lectivo 2014/2015 * 1º Semestre !
Mestrado em Engenharia Informática
!Aula 2 19/02/2015
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
1
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center
• Programa
1. Conceitos de computação em Cloud e sua evolução, arquiteturas e infraestruturas
2. Padrões, estratégias, oportunidades, riscos, estratégias de implementação de sistemas de computação em Cloud
3. Tecnologias de rede e de armazenamento de dados
4. Tecnologias de Virtualização.
5. Redes, Storage area networks e armazenamento de dados em Datacenters
6. Escalonamento e Migração de Recursos e Balanceadores de carga
7. Segurança no Datacenter. Firewalls, VPNs e VLANs
2
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center• It was a gradual evolution that started in the 1950s with mainframe computing.
• Multiple users were capable of accessing a central computer through dumb terminals, whose only function was to provide access to the mainframe. Because of the costs to buy and maintain mainframe computers, it was not practical for an organization to buy and maintain one for every employee. Nor did the typical user need the large (at the time) storage capacity and processing power that a mainframe provided. Providing shared access to a single resource was the solution that made economical sense for this sophisticated piece of technology.
• After some time, around 1970, the concept of virtual machines (VMs) was created.
• Using virtualization software like VMware, it became possible to execute one or more operating systems simultaneously in an isolated environment. Complete computers (virtual) could be executed inside one physical hardware which in turn can run a completely different operating system.
• The VM operating system took the 1950s’ shared access mainframe to the next level, permitting multiple distinct computing environments to reside on one physical environment. Virtualization came to drive the technology, and was an important catalyst in the communication and information evolution.
• In the 1990s, telecommunications companies started offering virtualized private network connections.
• Historically, telecommunications companies only offered single dedicated point–to-point data connections. The newly offered virtualized private network connections had the same service quality as their dedicated services at a reduced cost. Instead of building out physical infrastructure to allow for more users to have their own connections, telecommunications companies were now able to provide users with shared access to the same physical infrastructure. (this and following slides were adapted from http://thoughtsoncloud.com/2014/03/a-brief-history-of-cloud-computing/)
3
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center
• The following list briefly explains the evolution of cloud computing:
• Cluster computing: Solving problems with parallel computing
• Grid computing: Solving large problems with parallel computing
• Utility computing: Offering computing resources as a metered service
• SaaS: Network-based subscriptions to applications
• Cloud computing: Anytime, anywhere access to IT resources delivered dynamically as a service
4
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center
5
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center
Cloud computing has been credited with increasing competitiveness through cost reduction, greater flexibility, elasticity and optimal resource utilization. Here are a few situations where cloud computing is used to enhance the ability to achieve business goals.!1. Infrastructure as a service (IaaS) and platform as a service (PaaS)!2. Private cloud and hybrid cloud!3. Test and development!4. Big data analytics!5. File storage!6. Disaster recovery!7. Backup
6
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center
The five characteristics that define cloud computing are:!!1. On-demand self-service. !2. Ubiquitous network access. "3. Resource pooling. !4. Rapid elasticity. !5. Measured service."
7
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center
The five characteristics that define cloud computing are:!!1. On-demand self-service. This means provisioning or de-provisioning computing resources as needed in an automated fashion without human intervention. An analogy to this is electricity as a utility where a consumer can turn on or off a switch on-demand to use as much electricity as required.!2. Ubiquitous network access. This means that computing facilities can be accessed from anywhere over the network using any sort of thin or thick clients (for example smartphones, tablets, laptops, personal computers and so on).
8
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center
3. Resource pooling. This means that computing resources are pooled to meet the demand of the consumers so that resources (physical or virtual) can be dynamically assigned, reassigned or de-allocated as per the requirement. Generally the consumers are not aware of the exact location of computing resources. However, they may be able to specify location (country, city, region and the like) for their need. For example, I as a consumer might want to host my services with a cloud provider that has cloud data centers within the boundaries of Australia.!4. Rapid elasticity. Cloud computing provides an illusion of infinite computing resources to the users. In cloud models, resources can be elastically provisioned or released according to demand. For example, my cloud-based online services should be able to handle a sudden peak in traffic demand by expanding the resources elastically. When the peak subsides, unnecessary resources can be released automatically.!5. Measured service. This means that consumers only pay for the computing resources they have used. This concept is similar to utilities like water or electricity.
9
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center
Three main service models of cloud computing are:!!1. Software as a service (SaaS). Applications hosted by a provider on a cloud infrastructure are accessed from thin or thick clients over the network or a program interface (for example, web services). Examples are Google Docs,IBM SmartCloud Docs, IBM SmartCloud Meetings, Saleforce.com’s CRM application and so on.!2. Platform as a service (PaaS). Providers deliver not only infrastructure but also middleware (databases, messaging engines and so on) and solution stacks for application build, development and deploy. IBM SmartCloud Application Services and Google App Engine are two examples of PaaS.!3. Infrastructure as a service (IaaS). It is the delivery of computing infrastructure as a service. IBM SmartCloud Enterprise+, SoftLayer cloud and Amazon EC2 are some examples of IaaS.!There are others services emanating from these main services. Storage as a service (STaaS) and communications as a service (CaaS) are two such variants.
10
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center
Now let’s look at the cloud deployment models.!!Public cloud. This is where computing resources provided by a cloud provider are used by different organizations through public Internet on a pay as you go (PAYG) model. Cloud providers ensure some sort of separation for resources used by different organizations. This is known as multitenancy.!!Private cloud. This is where cloud infrastructure is solely owned by an organization and maintained either by this organization or a third party and can be located on site or off-site. Computing resources are behind the corporate firewall.!!Community cloud. Here, cloud infrastructure is owned and shared by multiple organizations with a shared concern.!!Hybrid cloud. It is the combination of any type of cloud model mentioned above connected by standardized or proprietary technology.
11
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center
The National Institute of Standards and Technology defines hybrid cloud as “a composition of two or more clouds (private, community or public) that remain unique entities but are bound together, offering the benefits of multiple deployment models.” Although this definition sounds very reasonable, it does not cover all aspects of hybrid clouds.!!Often, hybrid cloud refers to a combination of a public cloud service and a private cloud on-premises; however, hybrid clouds could also consist of two public clouds provided by different providers or even a combination of a cloud and traditional IT. Actually, a setup where existing systems on a traditional IT infrastructure are combined with a public cloud service is currently the most frequent use case of a hybrid cloud.
12
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center
Let’s discuss possible deployment models. There are five defined cloud deployment models, from a private cloud on-premises to a public cloud service with a cloud service provider.!!!!!!!!!!
13
!UNIVERSIDADE DA BEIRA INTERIOR Faculdade de Engenharia Departamento de Informática
!Nuno M. Garcia, [email protected]
Tecnologias de Cloud e Data Center
• https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/Wf3cce8ff09b3_49d2_8ee7_4e49c1ef5d22/page/IBM Cloud Computing Reference Architecture 3.0
CLOUD Computing – IBM Cloud Computing Reference Architecture
Getting cloud computing right
14
Overview of Data Centre & Cloud Computing
15
Agenda• Objective • Introduction • Module Overview
-‐ Consolidation Overview -‐ Virtualization Overview -‐ Automation for Cloud Overview
• Summary • References
16
Objectives
• Provides advance networking skills and concepts on data center and cloud computing. • Prepare the participants to acquire industry certification towards Cloud Computing. !
17
Introduction
• Module will cover the concepts, case study and hands-‐on for Consolidation, Virtualization and Automation of Cloud.
• Module duration is 40 hours which comprises of theory, case study and hands-‐on.
• Upon completion of the course, the participants will be issued with “Certificate of Attendance”.
18
Module Overview
• Day 1 -‐ Overview & Consolidation • Day 2 & 3 – Virtualization • Day 4 -‐ Automation for Cloud • Day 5 – Demo
19
Module Overview
Agility
Time
NetworkVirtualization
Consolidation Improved Utilization, Efficiency
Automation Policy-‐based Adaptive Infrastructure
Virtualization Improved Flexibility, Responsiveness
Application Virtualization
Semi-‐Automated Provisioning
Data Center Consolidation
Dynamic ServiceAutomation
Storage Virtualization
Server Virtualization
Static Provisioning
Branch Infrastructure Consolidation
Server Consolidation
StorageConsolidation
20
Day 1 -‐ Consolidation
• Reduce data center and server sprawl • Reduce power and cooling costs • Implement a unified fabric (e.g. Cisco Nexus data center switches)
21
Day 2 & 3 -‐ Virtualization
• Great enabler of consolidation • Desktop virtualization • Server virtualization
‒ allows more applications to run on fewer compute resources • Storage virtualization • Network virtualization – allows a single network infrastructure to carry traffic from multiple customers or compute environments, while ensuring that traffic remains separated
22
Day 4 -‐ Automation
• Automation of resource element manager and service orchestration tasks
• Reduces provisioning time • Simplifies management and optimizes resource pools
23
Cloud Computing Model from NIST
24
Cloud Computing Model from NIST
• Cloud computing is a model for enabling convenient, on-‐demand network access to a shared pool of configurable computing resources • Networks, servers, storage, applications, and services that can be rapidly provisioned and released with minimal management effort or service provider interaction.
25
Cloud Computing Model from NIST
26
Essential Characteristics• On-‐demand self-‐service A consumer can unilaterally provision computing capabilities automatically without requiring human interaction with each service’s provider.
• Broad network access Capabilities are available over the network and accessed through standard mechanisms that promote use by heterogeneous thin or thick client platforms (e.g., mobile phones, laptops, and PDAs).
• Resource pooling The provider’s computing resources can be pooled to serve multiple consumers using a multi-‐tenant model, with different physical and virtual resources dynamically assigned and reassigned according to consumer demand.
27
Essential Characteristics -‐ Cont.
• Rapid elasticity. ‒ Capabilities can be rapidly and elastically provisioned. ‒ In some cases done automatically to quickly scale out and rapidly released to quickly scale in.
• Measured Service. ‒ Cloud systems can automatically control and optimize resource use by leveraging a metering capability at some level of abstraction appropriate to the type of service
‒ e.g., storage, processing, bandwidth, and active user accounts.
28
Service Models
• Cloud Software as a Service (SaaS) Use the provider’s applications running on a cloud infrastructure.
• Cloud Platform as a Service (PaaS) Deploy onto the cloud infrastructure consumer-‐created or acquired applications created using programming languages and tools supported by the provider.
• Cloud Infrastructure as a Service (IaaS) Provision processing, storage, networks, and other fundamental computing resources where the consumer is able to deploy and run arbitrary software, which can include operating systems and applications.
29
Deployment Models• Private cloud ‒ operated solely for an organization. ‒ may be managed by the organization or a third party. ‒ may exist on premise or off premise.
• Community cloud ‒ shared by several organizations and supports a specific community that has shared concerns (e.g., mission, security requirements, policy, and compliance considerations).
‒ may be managed by the organizations or a third party. ‒ may exist on premise or off premise. ‒ gCloud
30
Deployment Models – cont.
• Public cloud ‒ available to the general public or a large industry group ‒ owned by an organization selling cloud services. • Hybrid cloud ‒ a composition of two or more clouds (private, community, or public) that remain unique entities
‒ bound together by standardized or proprietary technology that enables data and application portability
‒ cloud bursting for load balancing between clouds.
31
Comparing Cloud Service Models
32
Examples of Public Cloud Service Providers
33
Amazon Web Services (AWS)• Provides offering in the cloud for organizations requiring
computing power, storage & other services. • According to Amazon, AWS allows users to “take advantage of
Amazon.com’s global computing infrastructure,” which is the heart of Amazon’s retail business & transactional enterprise.
• Offers the following services: ‒ Elastic Compute Cloud (EC2) ‒ Simple Storage Service (S3) ‒ Simple Query Service (SQS) ‒ CloudFront ‒ SimpleDB
34
Google • Google App Engine allows building & hosting web applications on the Google
infrastructure: ‒ Supported programming languages are Python & Java (more?). ‒ Free up to a certain level of used resources, after which fees are charged for
additional storage, bandwidth, or CPU cycles required by the application. • Google Apps offers business emails and collaboration: ‒ Includes several applications with similar functionality to traditional office suites,
including Gmail, Google Calendar, Talk, Docs, and Sites. ‒ Has a number of security & compliance products to provide email security &
compliance for existing email structures. ‒ Standard Edition is free and offers the same amount of storage as regular Gmail
accounts. ‒ Premier Edition is based on a per-‐user license model & associated storage level.
35
Windows Azure• Part of Microsoft’s strategy of lessening its emphasis on the desktop and
shifting more resources to web-‐based products.
• Provides an OS that serves as a runtime for the apps
• Provides a set of services that allows development, management, and hosting of managed apps at Microsoft data centers
• Azure Services Platform includes the following services:
‒ .NET Services
‒ SQL Services
‒ Windows Live Services
• Pricing is based on a consumption model including compute time, storage, API calls, etc.
36
Salesforce.com & Force.com• Salesforce.com offers cloud-‐based CRM solution which includes Sales,
Marketing, Service, and Partners. Pricing is on a per-‐user basis, with different rates and support packages posted online.
• Force.com allows developers to create add-‐on apps that integrate into the main Salesforce.com apps, and are hosted on Salesforce.com’s cloud infrastructure.
‒ Apps are built using Apex, a proprietary programming language for the platform
‒ Pricing is on a per-‐developer basis, with different support packages allowed for varied levels of storage, API calls, etc.
• AppExchange is a directory of apps built for Salesforce.com by third-‐party developers, which users can purchase and add-‐on to their Salesforce environment.
37
RightScale• Provides services in the cloud to assist organizations in managing cloud
deployments offered by other Cloud Service Providers (CSPs), including vendors such as AWS, FlexiScale, and GoGrid.
• Pricing is based on a number of editions from Developer through Enterprise level, with associated features & server times.
• RightScale Cloud Management Platform allows organizations to manage & maintain their cloud deployments through one web-‐based management platform, while at the same time take advantage of offerings by more than one CSPs, which includes the following:
‒ Cloud Management Environment ‒ Cloud Ready ServerTemplates ‒ Adaptable Automation Engine ‒ Multi-‐Cloud Engine
38
Cloud Foundry (VMware)• A VMware-‐led open source project that provides a platform for building, deploying and
running cloud apps
• Supported languages including Spring for Java developers, Rails and Sinatra for Ruby developers, Node.js & other JVM languages/frameworks including Groovy, Grails & Scala.
• Supported Application Services include RabbitMQ, MongoDB, MySQL & Redis.
• Includes the following:
‒ CloudFoundry.com – a complete hosted platform environment (a commercial service, currently still in beta & can be accessed for free)
‒ CloudFoundry.org – an open source project where developers and community members can collaborate & contribute to the project
‒ Micro Cloud Foundry – a complete version of Cloud Foundry that runs in a virtual machine on a developer’s Mac or PC (a full instance that provides the flexibility of local development while preserving options for future deployment & scaling of apps).
39
(Some) Other Cloud Service Providers• Workday – provides human resources & financial management
products • ProofPoint – provides services related to securing enterprise
email infrastructure, with solutions for email security, archiving, encryption & data loss prevention.
• GoGrid – provides cloud hosting that allows users to build scalable cloud infrastructure in multiple data centers using dedicated and cloud servers, elastic F5 hardware load balancing, and cloud storage with total control through automation and self-‐service.
40
Summary
• Introduction on data centre and cloud computing. • Module overview on consolidation, virtualization and automation of cloud. • Three cloud service model. • Essentials characteristics of cloud model. • Public cloud service providers. !
!
41
References• Virtualized Multi-‐Tenant Data Center Solution for Infrastructure-‐as-‐a-‐Service. http://www.cisco.com/en/US/solutions/collateral/ns340/ns517/ns224/ns836/white_paper_c11-‐604559.html
• The NIST Definition of Cloud Computing (Draft). Mell, Peter & Grance, Timothy. http://csrc.nist.gov/publications/drafts/800-‐145/Draft-‐SP-‐800-‐145_cloud-‐definition.pdf
• Cloud Security and Privacy, An Enterprise Perspective on Risk and Compliance. Mather, Tim; Kumaraswamy, Subra; & Latif, Shahed. O’Reilley (2009).
42
ContributorsCommittee Members Academies
1. Chia Tien Yau
Temasek Polytechnic2. Lim Chee Yong
3. Simon Ngeow
4. Dr Yap Chern Nam
5. Simon Eng Nanyang Polytechnic
6. Francis TeoSingapore Polytechnic
7. Lau Chung Meng
8. Ivan Wee Republic Polytechnic
9. Gremar SempioInstitute of Technical Education
10. Vincent Poh
11. Ng Tock Hiong43
Thank You
44