Download - Testbed for Heterogeneous Cloud
1
PERUMAL KUPPUUDAIYAR RESEARCH ENGINEER, CLOUD SERVICES LAB.12- APRIL - 2016
Testbed for Heterogeneous Cloud
2
Topics• Test bed Requirements• Physical Layout• Software Stacks• Integration• Use case Demo
◦ Interactive 3D Image rendering : Ray Tracing of a 3D Blender model using Intel’s Xeon Phi and Embree Kernel.
08/04/2015
3
Requirements• Managing Heterogeneous Resources• Fault tolerance and High availability• Support mixed workloads (MPI, Spark, Storm, etc.)• Application portability • Near bare metal performance• Multi-node orchestration for parallel tasks• Telemetry and workload characterisation• …….
4
Physical Layout
5
Software Stacks
Light weight portable application container
Minimal Linux OS- Systemd for running services, - Etcd for clustering hosts together,- Fleet for distribution across cluster Mesos + Marathon +Zookeeper
Resource Management & Scheduling
Telemetry and Monitoring Systems
Weave creates a virtual network to connects Docker containers deployed across multiple hosts and enables their automatic discovery
Container Cluster Manager
….
6
Integration
08/04/2015
StorageMemoryCPU GPUMIC NIC
fleet SDS dockeretcd SDN telemetry mesos
Marathon Kubernetes And other FWs...
Phys
ical L
ayer
DCO
SFr
amew
orks
Service Orchestration(Bare Metals, Micro services (containers), KVM and Cloud formation Interface)
Serv
ice
Bare metal(fleet units)
Dockerised Applications Cloud formation
Clusters of Containers
(POD)
TELECONFERENCE 7
Use Case – Ray Tracing
08/04/2015
• In computer graphics, ray tracing is a technique for generating an image by tracing the path of light through pixels in an image plane and simulating the effects of its encounters with virtual objects.
• The technique is capable of producing a very high degree of visual realism, usually higher than that of typical scanline rendering methods, but at a greater computational cost.
8
Demo – 3D Image Interactive Rendering
Remote ClientTestbed Infrastructure
SSH and X11 Display Forwarding
VPN/SSH Tunnel3D Designer create 3D contentsusing CPU node
Interactive Renderingusing Xeon Phi & Embree Kernel
3D Designer create 3D contentsusing CPU node Se
rvic
e Ga
tew
ay- F
W
Submit Job (2 CPU based blender instance &1 Xeon Phi Embree pathtracer)
Orc
hest
rato
r
CPU + Xeon Phi
CPU Node
CPU Node
CPU + GPU Node
9
DEMO
08/04/2015
10
Questions?
Thank You