cloud computing openstack_discussion_2014-05
DESCRIPTION
Bài trình bày của anh Nhân VNG về OpenStackTRANSCRIPT
Cloud Computing
OpenStack
VNG – Infrastructure platform
Tran Anh Nhan – IRD department head
Pham Tran Kim Chi – Lead System Engineer
May 2014
Cloud Computing - OpenStack - VNG - IRD
Agenda
• VNG - IRD
• What is Cloud Computing?
• OpenStack Architecture
• OpenStack Networking
• Deployment Model
• Ceilometer
Cloud Computing - OpenStack - VNG - IRD
New Section VNG Corp introduction
Cloud Computing - OpenStack - VNG - IRD
VNG Corporation
• Game publisher/developer (VLTK, VLCM,
Gunny, Boom, Khu vuon tren may,
ZingPlay …)
• Online music/media (ZingMP3, ZingTV)
• Social network (Zing Me, Zalo)
• E-commerce (123mua.vn, 123pay.vn)
Cloud Computing - OpenStack - VNG - IRD
IRD Department Research and build the infrastructure platform for VNG to enhance business, optimize quality and cost, meet the new technology.
• Content Delivery Network (CDN) system is used by all VNG products that want to optimize static bandwidth.
• Live-streaming system is a streaming platform for Zing events, Talk TV.
• OpenStack provides servers and networks for some products with a small scale (in pilot phase. Project Team is receiving feedback for further enhancement).
• Object storage (in POC phase).
Cloud Computing - OpenStack - VNG - IRD
New Section What is Cloud Computing?
Cloud Computing - OpenStack - VNG - IRD
References
• Gartner
• Synergy research
• The National Institute of Standards and
Technology (NIST)
• Cloud computing today
• 451 Research
Cloud Computing - OpenStack - VNG - IRD
Number & trend
Cloud Computing - OpenStack - VNG - IRD
Number & trend
Cloud Computing - OpenStack - VNG - IRD
What is Cloud computing?
Cloud Computing - OpenStack - VNG - IRD
What is Cloud computing?
Cloud Computing - OpenStack - VNG - IRD
What is Cloud computing?
Cloud Computing - OpenStack - VNG - IRD
Cloud Services
Cloud Computing - OpenStack - VNG - IRD
Cloud Services
• AWS #1 of cloud services provider - What services AWS provide? – Amazon Web Services (AWS) continues to dominate
the IaaS and PaaS space in terms of revenue. AWS: 3.8$B revenue (2013)
– Compute & Networking (Amazon EC2, Auto Scaling, Elastic Load Balancing, Route 53 ,..)
– Storage & CDN (Amazon S3, Amazon Glacier a low cost storage for backup, Amazon EBS, Cloud Front/CDN)
– DB – Cache: RDS (MySQL, Oracle, SQL Server, and PostgreSQL), DynamoDB (NoSQL data store), ElastiCache (In-Memory Caching Service), Redshift (Data Warehouse Service)
– Application services: Elastic Transcoder,..
Cloud Computing - OpenStack - VNG - IRD
Cloud Orchestration Framework
Cloud Computing - OpenStack - VNG - IRD
New Section OpenStack Architecture
Cloud Computing - OpenStack - VNG - IRD
History
• OpenStack is an open source IaaS
initiative for managing and creating huge
groups of virtual private servers in a cloud
computing environment. It was initially
developed by Rackspace and NASA.
Cloud Computing - OpenStack - VNG - IRD
Cloud Computing - OpenStack - VNG - IRD
Nowadays
Cloud Computing - OpenStack - VNG - IRD
Servers Storage
Network switch Network switch Network switch
Virtualization Solution (VMWare VCenter,
Citrix XEN Server, Ovirt, Proxmox….)
Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)
Cloud Computing - OpenStack - VNG - IRD
Cloud Infrastructure
• Modular architecture
• Designed to easily scale out
• Based on set of core services
Cloud Computing - OpenStack - VNG - IRD
OpenStack Platform
Servers Storage
Network switch Network switch Network switch
Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)
Cloud Computing - OpenStack - VNG - IRD
Infrastructure As A Service Overview
Cloud Computing - OpenStack - VNG - IRD
Infrastructure As A Service roles
• Cloud Ops: monitor/add/remove physical compute nodes, storage nodes, controller nodes, network nodes.
• App Owner: add/remove/upgrade cloud services, check billing status.
• Dev Ops: launch/ terminate/ scale instances, storage. Register/ unregister new image. Backup/ restore instances/ storage. These tasks can be done via dashboard or API.
• App Devs: call the dev ops tasks inside application logical flow.
Cloud Computing - OpenStack - VNG - IRD
OpenStack Architecture
Cloud Computing - OpenStack - VNG - IRD
OpenStack Architecture
On-Demand Self-Services
Resource
pooling
Broad
Network
Access
Mesearued
services
Cloud Computing - OpenStack - VNG - IRD
OpenStack Architecture
Hypervisor
Server
Storage Network
Nova compute Cinder Neutron
Cloud Computing - OpenStack - VNG - IRD
Cloud Computing - OpenStack - VNG - IRD
New Section OpenStack Networking
Cloud Computing - OpenStack - VNG - IRD
OpenStack Networking
Cloud Computing - OpenStack - VNG - IRD
Network Node Compute Node
phy-br-
em2
phy-br-
em2
em1: 172.16.0.2 em1: 172.16.0.3
em2: no ip address
em2: no ip address
Nova API …
ovs/ br-int
dnsmasq
dchp agentIP name space
Nova Compute …
tap-xx
qvo-xx
int-br-em2
tap-xx qvb-xx
Linux bridge
qbr-xxxxx
Instance
eth0
ovs/ br-int
qvo-xx
int-br-em2
veth
Neutron API0.0.0.0:9696
management network
dedicated physical VLAN for neutron traffic between nodes
neutron ovs plugin
veth
Cloud Computing - OpenStack - VNG - IRD
Cloud Computing - OpenStack - VNG - IRD
New Section Deployment Model
Cloud Computing - OpenStack - VNG - IRD
Cinder
API
COROSYNC + HAProxy
Controller 01 Controller 02
Rabbit
MQ
Keyston
e
Glance
API
Nova
API
PACEMAKER
Compute node 1
Compute node n
Ceph node 1
Ceph node n
QE
MU
Driver
Ceph node 2Compute node 2
RBD Driver
Cloud Computing - OpenStack - VNG - IRD
OpenStack Networking
Neutron Server
Switch Interface
Driver
Physical switch
Controller Node
OVS Plugin
OVS Plugin
Openvswitch
Instances
Compute Node
Neutron OVS agent
DHCP
InstancesInstances
OVS Plugin
Openvswitch
Instances
Compute Node
Neutron OVS agent
InstancesInstances
L3 Agent DHCP L3 Agent
Cloud Computing - OpenStack - VNG - IRD
Feature
• Launch instance
• Snapshot/ restore instance
• Attach device to instance
• Snapshot/ restore attach device
• Scale up instance
• Internal network for instances
• Provide instances with VLAN as product
requires.
• Instances are stored totally in Ceph Storage.
Cloud Computing - OpenStack - VNG - IRD
DEMO
Cloud Computing - OpenStack - VNG - IRD
New Section Ceilometer
Cloud Computing - OpenStack - VNG - IRD
OpenStack Architecture
On-Demand Self-Services
Resource
pooling
Broad
Network
Access
Mesearued
services
Cloud Computing - OpenStack - VNG - IRD
Monitoring
• Monitor physical host by cacti, graphite,
zabbix.
• Monitor instances status by ceilometer.
• Monitor OpenStack statistics by
ceilometer.
Cloud Computing - OpenStack - VNG - IRD
Ceilometer
• Objectives
• Ceilometer component
• Ceilometer collect data
• Access collected data
Objectives
• Provide a infrastructure to collect
any information in OPS.
• Publish information for other
monitoring.
• Integrate with Heat for trigger auto
scale.
Celiometer - OpenStack - VNG - IRD
Ceilometer collect data
• Bus listener
• Polling agent
• Push agents
Celiometer - OpenStack - VNG - IRD
Cloud Computing - OpenStack - VNG - IRD
Ceilometer
Cloud Computing - OpenStack - VNG - IRD
Process meter
Access collected data
• Via API
• Via Ceilometer command
Celiometer - OpenStack - VNG - IRD
Cloud Computing - OpenStack - VNG - IRD
DEMO
Cloud Computing - OpenStack - VNG - IRD
Q & A