ecocloud - alliance · in-memory analytics recommendation system media streaming nginx, http server...
TRANSCRIPT
Babak Falsafiecocloud.ch
EcoCloudEnabling Eco-friendly Smart Data
Information Technology (IT): Five Decades of Exponential Growth
IT is at the core everything we do & has become an indispensable pillar for a modern day society!
Intel 4004, 1971
Intel Xeon, 2014
92,000 ops/sec
266,000,000,000 ops/sec
A Brief History of IT
§ From computing-centric to data-centric§ Consumer Era: Internet-of-Things in the Cloud
1970s-
PC Era
Mobile Era
Mainframes1980s 1990s Today+
Consumer Era
Two Inflection Points for IT
1. Big Data§ Data grows faster than 10x/year§ Platforms improve at 1.5x/year§ Huge demand on scaling platform capacity
2. Platforms§ Silicon slowly getting denser§ But, Silicon efficiency has halted§ IT energy not sustainable
Data is Shaping Future of IT
§ Data growth (by 2015) = 100x in ten years [IDC 2012]§ Population growth = 10% in ten years
§ Monetizing data for commerce, health, science, services, ….§ Big Data is shaping IT & pretty much whatever we do!
Data Shaping All Science & Technology
Science entering 4th paradigm§Analytics using IT on
§ Instrument data§ Simulation data§ Sensor data§ Human data § …
Complements theory, empirical science & simulation
Data-centric science key for innovation-based economies!
Datacenters Growing Fast
BC 332.
Source: James Hamilton, 2012
Daily IT growth in 2012 = IT first five years of business!
Warning! Datacenters are not Supercomputers
• Run heterogeneous data services at massive scale• Driven for commercial use• Fundamentally different design, operation, reliability, TCO• Density 10-25KW/rack as compared to 25-90KW/rack• Tier 3 (~2 hrs/downtime) vs. Tier 1 (upto 1 day/downtime)• ……and lots more
Datacenters are the IT utility plants of the future
Supercomputing Cloud Computing
≠
Internet-of-Things (IoT) Growing Fast Too
9
Source: IDC Worldwide and Regional IoT forecast, EMC Digital Universe with Research and Analysis by IDC
28 Billion Connected Devices
4 zettabyttes of Data, 10% of Digital Universe$7 Trillion Market Revenue
Good News: Chips are Getting Denser
0.01
0.1
1
130 nm
90 nm
65 nm
45 nm
32 nm
22 nm
14 nm
10 nm
$/Transistor
Moore’s Law continuesIntel [ISSCC’15]
Improved packaging2.5D/3D Chips
3D XPoint by Intel & MicronNon-volatile memory [IntelPR’15]
Bad News:Chips are out of power!
0
1
10
100
1,000
10,000
100,000
1,000,000
10,000,000
1985 1990 1995 2000 2005 2010Year of Introduction
Num Transistors (in Thousands)Relative PerformanceClock Speed (MHz)Power Typ (W)NumCores/Chip
Higher Demand + Lower Efficiency: Datacenter Energy Not Sustainable!
§Modern datacenters è 20 MW!§ In modern world, 6% of all electricity and growing fast!
Billio
n Ki
low
att h
our/y
ear
2001 2005 2009 2013 2017 0
4080
120160200240280 Datacenter
Electricity DemandsIn the US(source: Energy Star)
65 million Swiss homes
A Modern Datacenter
17x football stadium, $3 billion
? IT’s Future
BridgingTechnologies
Big Data Big Energy
The first & only academic research center of its kind
A Center for multi-disciplinary energy-efficient data-centric technologies research
(founded in 2011)
Center to bring efficiency to data§ 16 faculty, 50 researchers§ 6M CHF/year external funds
Mission:§ Energy-efficient data-centric IT§ From algorithms to machine infrastructure§ Technologies to maximizing value for data
ecocloud.ch
Our Vision:Holistic Optimization of Datacenters
Holistic optimization• Algorithms to
infrastructure• Cross-layer• Paradigms to monitor,
manage & reduce energy
Open technologies!
Algorithm
Infr
astr
uctu
re
Integrated Cooling: CMOSAIC
3D server chipTwo-phase liquid cooling
§ Enables higher thermals§ Dramatically better heat removal
Prototyped by IBM
PCB
Micro-HeaterLiquid
Micro-Channels
Integrated Thermal Management @ Credit Suisse
• Designed fine-grain power/thermal sensors
• Deployed in Credit Suisse site• Synergistic server load/thermal
provisioning• Real-time monitoring of 5K
servers
50% better energy efficiency!
In-Memory AnalyticsRecommendation System
Media StreamingNginx, HTTP Server
Web Search Apache Solr & Nutch
Web ServingNginx, PHP server
Data ServingCassandra NoSQL
Graph AnalyticsGraphX
Data CachingMemcached
Data AnalyticsMachine learning
Cloud Benchmarking with CloudSuite 3.0 (parsa.epfl.ch/cloudsuite)
Building block for Google PerfKit, EEMBC Big Data!
Cavium ThunderXScale-Out Processor
48-core 64-bit ARM SoC[based on “Clearing the Clouds”, ASPLOS’12]:• Designed to serve data• Specialized chip design for servers• 10x better efficiency than Xeon
dbtoaster.org
Compilation of offline analytics into online/incremental engines Aggressive code specialization
Data Stream
Low-latency stream processing Up to 6 OOM faster than commercial systems
110
1001000
10000100000
100000010000000
Q3 Q9 Q10 Q11 Q14 Q15 Q21
DBToaster:Breaking Up Data Jams
Bringing it All Together
EcoCloud founded in 2011§A center for eco-friendly smart data§Bridging the data & platform efficiency gap§Strong industrial partnership program§Real impact (industry, Switzerland/EU and beyond)
For more information please visit us at ecocloud.ch
Thank You!