vng/ird - cloud computing & openstack discussion 3/5/2014

Cloud Computing

OpenStack

VNG – Infrastructure platform

Tran Anh Nhan – IRD department head

Pham Tran Kim Chi – Lead System Engineer

May 2014

Cloud Computing - OpenStack - VNG - IRD

Agenda

• VNG - IRD

• What is Cloud Computing?

• OpenStack Architecture

• OpenStack Networking

• Deployment Model

• Ceilometer

New Section VNG Corp introduction

VNG Corporation

• Game publisher/developer (VLTK, VLCM,

Gunny, Boom, Khu vuon tren may,

ZingPlay …)

• Online music/media (ZingMP3, ZingTV)

• Social network (Zing Me, Zalo)

• E-commerce (123mua.vn, 123pay.vn)

IRD Department Research and build the infrastructure platform for VNG to enhance business, optimize quality and cost, meet the new technology.

• Content Delivery Network (CDN) system is used by all VNG products that want to optimize static bandwidth.

• Live-streaming system is a streaming platform for Zing events, Talk TV.

• OpenStack provides servers and networks for some products with a small scale (in pilot phase. Project Team is receiving feedback for further enhancement).

• Object storage (in POC phase).

New Section What is Cloud Computing?

References

• Gartner

• Synergy research

• The National Institute of Standards and

Technology (NIST)

• Cloud computing today

• 451 Research

Number & trend

What is Cloud computing?

Cloud Services

• AWS #1 of cloud services provider - What services AWS provide? – Amazon Web Services (AWS) continues to dominate

the IaaS and PaaS space in terms of revenue. AWS: 3.8$B revenue (2013)

– Compute & Networking (Amazon EC2, Auto Scaling, Elastic Load Balancing, Route 53 ,..)

– Storage & CDN (Amazon S3, Amazon Glacier a low cost storage for backup, Amazon EBS, Cloud Front/CDN)

– DB – Cache: RDS (MySQL, Oracle, SQL Server, and PostgreSQL), DynamoDB (NoSQL data store), ElastiCache (In-Memory Caching Service), Redshift (Data Warehouse Service)

– Application services: Elastic Transcoder,..

Cloud Orchestration Framework

New Section OpenStack Architecture

History

• OpenStack is an open source IaaS

initiative for managing and creating huge

groups of virtual private servers in a cloud

computing environment. It was initially

developed by Rackspace and NASA.

Nowadays

Servers Storage

Network switch Network switch Network switch

Virtualization Solution (VMWare VCenter,

Citrix XEN Server, Ovirt, Proxmox….)

Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)

Cloud Infrastructure

• Modular architecture

• Designed to easily scale out

• Based on set of core services

OpenStack Platform

Servers Storage

Network switch Network switch Network switch

Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)

Infrastructure As A Service Overview

Infrastructure As A Service roles

• Cloud Ops: monitor/add/remove physical compute nodes, storage nodes, controller nodes, network nodes.

• App Owner: add/remove/upgrade cloud services, check billing status.

• Dev Ops: launch/ terminate/ scale instances, storage. Register/ unregister new image. Backup/ restore instances/ storage. These tasks can be done via dashboard or API.

• App Devs: call the dev ops tasks inside application logical flow.

OpenStack Architecture

On-Demand Self-Services

Resource

pooling

Network

Access

Mesearued

services

Hypervisor

Server

Storage Network

Nova compute Cinder Neutron

New Section OpenStack Networking

OpenStack Networking

Network Node Compute Node

phy-br-

em1: 172.16.0.2 em1: 172.16.0.3

em2: no ip address

Nova API …

ovs/ br-int

dnsmasq

dchp agentIP name space

Nova Compute …

tap-xx

qvo-xx

int-br-em2

tap-xx qvb-xx

Linux bridge

qbr-xxxxx

Instance

ovs/ br-int

qvo-xx

int-br-em2

Neutron API0.0.0.0:9696

management network

dedicated physical VLAN for neutron traffic between nodes

neutron ovs plugin

New Section Deployment Model

Cinder

COROSYNC + HAProxy

Controller 01 Controller 02

Rabbit

Keyston

Glance

PACEMAKER

Compute node 1

Compute node n

Ceph node 1

Ceph node n

Driver

Ceph node 2Compute node 2

RBD Driver

OpenStack Networking

Neutron Server

Switch Interface

Driver

Physical switch

Controller Node

OVS Plugin

Openvswitch

Instances

Compute Node

Neutron OVS agent

InstancesInstances

OVS Plugin

Openvswitch

Instances

Compute Node

Neutron OVS agent

InstancesInstances

L3 Agent DHCP L3 Agent

Feature

• Launch instance

• Snapshot/ restore instance

• Attach device to instance

• Snapshot/ restore attach device

• Scale up instance

• Internal network for instances

• Provide instances with VLAN as product

requires.

• Instances are stored totally in Ceph Storage.

New Section Ceilometer

On-Demand Self-Services

Resource

pooling

Network

Access

Mesearued

services

Monitoring

• Monitor physical host by cacti, graphite,

zabbix.

• Monitor instances status by ceilometer.

• Monitor OpenStack statistics by

ceilometer.

Ceilometer

• Objectives

• Ceilometer component

• Ceilometer collect data

• Access collected data

Objectives

• Provide a infrastructure to collect

any information in OPS.

• Publish information for other

monitoring.

• Integrate with Heat for trigger auto

scale.

Celiometer - OpenStack - VNG - IRD

Ceilometer collect data

• Bus listener

• Polling agent

• Push agents

Ceilometer

Process meter

Access collected data

• Via API

• Via Ceilometer command

vng/ird - cloud computing & openstack discussion 3/5/2014

cloud computing openstack

vng ird openstack networking

cloud computing environment

vng ird history openstack

vng ird agenda vng ird

vng ird cloud services

vng ird infrastructure

vng products

Technology

social accountability in action - vng international€¦ ·...

vng mannual

vng balance gnstiet -...

ird-ri752 - dtic

accelerometros entek ird

developing a communication strategy for a - vng...

anupdateonosm tothenfvrg · pdf...

a zoom on membase vng

i 1 integrated ird ird

chartr200 vng-eng - installation guide (en)

cloud_computing_openstack_discussion_2014-05 -vng

ird mechanalysis

vng/eng - amtronix...whether you choose videonystagmography...

ird resolution challenge

lb ird structuring

ird – guide presentation

danobat-overbeck grinding...

presentation ird direct

strategic planning in a local government - vng international

medtrak vng operating manual 09-05-14 - scottpt.commedtrak...