2013 01-15 - ldndevops - 3 ways to run infra on cleaner clouds
DESCRIPTION
This is the slide deck I used when presenting about how to run your infrastructure on cleaner clouds at the monthly London Devops meetup, held at Forward Technology in Camden. This was the first time I'd given this talk outside of a greentech/cleanweb focussed audience, and it seemed to go down well.TRANSCRIPT
3 ways to run your infrastructure on cleaner clouds
LDNdevops Jan 2013
Sunday, 20 January 13
Who am I
• Chris Adams
• Working as a Product Manager at AMEE
• Background in devops/ruby mainly
• @mrchrisadams everywhere online
Sunday, 20 January 13
http://nsidc.org/arcticseaicenews/2012/09/arctic-sea-ice-extent-settles-at-record-seasonal-minimum/
Sunday, 20 January 13
How it affects you
https://twitter.com/shloky/status/262948315119886336/photo/1
See the red circle? That’s Sandy flooding your servers
Sunday, 20 January 13
How it affects Joel
https://twitter.com/spolsky/statuses/263288111692382208
Sunday, 20 January 13
I do ops, what can I do?
Sunday, 20 January 13
Ouch.
“Data centers are power-hungry, and Facebook's Oregon center in Crook County is no exception, using 28MW. While that's fairly standard, it has doubled the power use of the county...The entirety of Crook County uses just under 30MW...[Data Center Knowledge via SlashDot; Image: Tom Raftery]”
Jan 31, 2012 via Gizmodo
http://gizmodo.com/5880804/facebooks-oregon-data-center-uses-as-much-power-as-the-entire-county
Sunday, 20 January 13
DCD Industry Census 2011: Market Growth
MARKET GROWTH
59%
Russia
About the sample?
» Sample size operates almost 100,000 FACILITIES – projected increase of 7% into 2012
» Sample operates 7.7 MILLION RACKS – projected increase of 15% into 2012
» Sample consumes 31 GW OF ENERGY – projected increase of 19% into 2012 (where 1 GW is
power used by 750,000 to 1 million homes)
» 2010-11 investment about US$30 BN – expected to rise to US$35 BN in next 12 months (i.e.
equivalent to nominal GDP of Kenya, Costa Rica or Lithuania)
Growth in the data center sector is common to
all markets covered by the Census, although
the extent of growth varies according to the
urgency of the market’s IT requirements, already
established facility base and the capability of its
resource base to fund, develop and maintain
new facilities.
‘Growth’ in the context of data center markets
can take a number of forms to meet increased
IT demand:
» The construction of new facilities.
» The extension or upgrading of existing
facilities to cope with increased IT demand.
» Increased use of outsourcing.
This map overlays census data on data center investment 2011-2012 with GDP data from the World Bank
Key
z Growth GDP 4% Investment 2011-12
z Growth GDP 2.5%
- 4%
z Growth GDP <2.5%
(% growth in GDP 2011-12
Source: World Bank and
central banks)
50%
Central USA23%
West USA
23%
East USA
19%
Colombia
11%
Mexico
74%
Turkey
35%
Italy
31%
Nordics
26%
Argentina
47%
MENA
44%
China
43%
India
43%
Brazil
59%
Russia
54%
Australia
118%
SE Asia
25%
UK26%
Germany
8%
Canada
16%
Benelux
10%
France
9%
Spain
26%
Argentina
50+
0
© DatacenterDynamics, London 2011.
http://www.dcd-intelligence.com/Industry-Census/Data-centre-Market-Growth-2011-2012
Sunday, 20 January 13
© 2006 Bruno & Lígia RodriguesSunday, 20 January 13
Dirty cloud:
High CO2
Sunday, 20 January 13
Clean cloud:
Low/no Co2
Sunday, 20 January 13
How to measure it
•CO2 / Kwh
•CO2 / compute hour
Sunday, 20 January 13
PUE?
•efficient != green
Sunday, 20 January 13
34
PUE?Data Centre Supply Carbon Intensity PUE IT Carbon Intensity
Typical 0.5kg CO2/kWh 1.5 0.75kg CO2/kWh
Good PUE mostly coal-fired power 0.8kg CO2/kWh 1.2 0.96kg CO2/kWh
Poor PUE but mostly renewables 0.2kg CO2/kWh 3.0 0.6kg CO2/kWh
http://www.romonet.com/blog/coal-fired-clouds
In US - most Cloud Dc’s are coal powered as it is lowest cost elecDC with good PUE run on coal-fired power emits 50% more CO2/kWh than DC with poor PUE run on mostly renewablesElec supply is more impt than PUE is assessing how Green a DC isThere is a CUE metric but is poorly adopted atm
http://www.slideshare.net/TomRaftery/open-source-cloud-platforms-cloudstack-collab - slide 18
Sunday, 20 January 13
CO2 / compute hour
Sunday, 20 January 13
Electricity sourceEmissions factor
HardwareStandard power
consumption
Data centrePower Usage
Effectiveness (PUE)
Physical building and layoutOccupancy levelExternal temperature & humidity
http://www.slideshare.net/francinebennett/strata-london-slide-deck-14558889
Sunday, 20 January 13
What if I did want to switch?
Sunday, 20 January 13
•switch region
•switch supplier
•offset
Sunday, 20 January 13
Dashboard
http://,mastodonc.com/dashboard
Sunday, 20 January 13
Switch region
• If AWS, switch from us-east (coal) to us-west (hydro). Same toys, same price, 66% CO2 saving
• If on Rackspace, a switch to London gives certified green power
Sunday, 20 January 13
Switch supplier
• How well are you already doing?
• Do you need API compatibiilty?
• Are you really scaling up and down that much?
Sunday, 20 January 13
0
0.25
0.50
0.75
1.00
Icelan
d
Switz
erlan
d
Swed
en UK
US (a
vera
ge)
Chin
a
Aust
ralia
Kg CO2e per KWh of national grid electricity
Source: Defra via Amee
http://www.slideshare.net/francinebennett/strata-london-slide-deck-14558889
Sunday, 20 January 13
RARR MY INFRA RUNS ON MAGMA
• EC2 compatible providers - Greenqloud
cc michi_s - http://www.flickr.com/photos/32864130@N08/4542203306/
Sunday, 20 January 13
greenqloud
http://greenqloud.com/trulygreen/
Sunday, 20 January 13
Other providers
• France - Full of nukes (low CO2/kwH)
• Germany - full of solar
• Swiss - Full of extremely organised and punctual people
Sunday, 20 January 13
In the UK?
Infinity Martlesham
Super efficient (PUE 1.2) DCRuns on biofuelHAS ITS OWN FARM2ms ping from London
The bulk of the electricity produced from the biomass plant is utilised for IT, not cooling
http://infinitysdc.net/locations/martlesham/
Sunday, 20 January 13
Offset
• (Or choose supplier that offset their power)
• Least attractive option, but better than nothing.
• Good example would be Memset in UK, but others exist
Sunday, 20 January 13
Interested?
• http://cleanweb.org.uk
• @cleanwebuk / #cleanweb
• ##cleanweb on freenode
• Cleanweb UK on meetup.com
• That guy down there
Sunday, 20 January 13
Thanks!
• @mrchrisadams
• http://cleanweb.org.uk
• http:// chrisadams.me.uk
Sunday, 20 January 13
Credits• Various slides and content borrowed from:
• Francine Bennet, MastodonC
• http://www.slideshare.net/francinebennett/strata-london-slide-deck-14558889
• Andy Piper, VMware
• http://www.slideshare.net/andypiper/making-a-cleaner-cloud
• Tom Raftery, Greenmonk
• http://www.slideshare.net/TomRaftery/open-source-cloud-platforms-cloudstack-collab
Sunday, 20 January 13