iwsm2014 megsus14 - gqm on energy for saas - cetic
DESCRIPTION
IWSM SoftwareTRANSCRIPT
Energy related Goals and Questions for Cloud Services
Jean-Christophe<dot>DEPREZ<at>CETIC<dot>beScientific Coordinator
&Christophe<dot>PONSARD<at>CETIC<dot>be
Measurement and Metrics for Green and Sustainable Software (MeGSuS '14)
IWS Mensura – Rotterdam, the Netherlands
© CETIC – www.cetic.be 11/03/2014 2
CETIC Presentation
• Accredited Research Centre~40 researcher in 3 departmentsCreated in 2001
• Applied Research at EU and Reginal level• Technology Transfert Agent to (inter-)Regional IndustryMission
• SotA/Techno Evaluation and Coaching (HW/SW)• Trusted Third Party• Connect Industry to latest research results
Serving Industry
• EU: FP7 – Coordinator and Participants• EraNets and Interreg• Regional Research project (Plan Marshall 2.vert)
International Involment
• Technological Checks • Feasibility Studies• R&D 1-1 Projects
Regional Funding for Contract Research
© CETIC – www.cetic.be 11/03/2014 3
Software & System
Engineering
Futur Internet
Internet of Things
Overall Expertise• Process & Product Quality• Optimization• Modelling• Security
• Cloud Computing • Semantic Web• Big Data• Open Source & Open Data
• Programmable Systems• Smart Objects • Wireless Sensor Network
© CETIC – www.cetic.be 11/03/2014 4
Positioning
ACADEMICS
ICT INDUSTRY
• Technology transfer
• Proof-of-Concept• Feasibility studies• Applied Research
Technology Readiness Level
© CETIC – www.cetic.be 11/03/2014 5
A bit of History• Beginning – late 80’s– Hardware was consuming– Software did the best it could with the little it had
• From 90’s– Hardware keeps improving– Software developers started neither to care about
optimizing their algorithms nor their code hacks for better time and space efficiency became things of the past .
• From 2010’s– Even less worries since applications run in the Cloud
© CETIC – www.cetic.be 11/03/2014 6
Should the Software Industry care?
• Organisations and corporate responsibility– Cloud consumption augment– Once eScience and other HPC lead their way to Cloud,
Providers will likely come up with pricing according to consumption
• People slightly modify their behaviour to preserve the climate– Soft Developers are no better or worst than majority– But as others, the effort should be moderate and
guidance and assistance is needed
© CETIC – www.cetic.be 11/03/2014 7
ASCETIC Business Requirements
• 17 interviews with
© CETIC – www.cetic.be 11/03/2014 8
ASCETIC Business Requirements
• 17 interviews with
© CETIC – www.cetic.be 11/03/2014 9
Resulted in 7 Business Requirements
• BG1 - Support EU organisations to achieve ICT decarbonisation progress. (Lisbon Treaty)
• BG2 - Ecological and Economical balance• BG3 - Support organisations to achieve social responsible behavior• BG4 - Provide ASCETiC users with means to properly control and
monitor pricing models based on energy consumption• BG5 - Provide ASCETiC users with means to properly monitor and
optimise energy consumption• BG6 – Server side computing and data handling have lacked focus• BG7 - Provide ASCETiC stakeholders with a sustainable solution
based on recognized standards
© CETIC – www.cetic.be 11/03/2014 10
Goal Question Metrics (GQM)
• A pragmatic approach to self-evaluate• Assisting in – Identify Generic Goals with clear definitions whose
evaluation is based on– Patterns of Interesting Questions– Associated to measurable KPI or Metrics
(= whose measurements can be obtained without much change in working habits)
© CETIC – www.cetic.be 11/03/2014 11
Goals
• ISO 25000 – SQuaRE (replaces ISO9126)– 25010 – Quality Models • Software Product Quality Model (Developer view)• (System) Quality in Use Model (Operator & User view)
• Not much about Energy … hidden behind– Performance Efficiency … Resource Utilisation
Resources can be many things and indirectly some resources consume energy
– Freedom from risk … environmental risk mitigationUnless we believe energy shortage is likely …
© CETIC – www.cetic.be 11/03/2014 12
Goal 1 – SaaS Energy Consumption Behaviour
Effectiveness• In short– Do the best we can with what we have– Address BG2 (eco balance) and BG3 (corp. respons.)
• Energy Consumption Behaviour Effectivenessis the degree to which a software product is deployed and configured in a way to reduce the operating cost for the software product operator (or SaaS provider) taking the energy cost into account.
© CETIC – www.cetic.be 11/03/2014 13
Goal Template – SaaS Energy Consumption Behaviour
EffectivenessSaaS Energy Consumption Behaviour Effectiveness
Object Server-side software of a Cloud application
Purpose (Qualitative) characterization of the energy consumption behavior effectiveness on representative workload
Quality Focus Effectiveness of Energy Consumption Behaviour
Point of View Providers of a Cloud Application (SaaS Provider)
Context Identify the different deployment alternatives with the mosteffective energy consumption behavior according to various representative workloads
© CETIC – www.cetic.be 11/03/2014 14
Goal 2 – SaaS Energy Efficiency
• In short– Learn about energy leaks to improve in next versions– Address BG5 (monitor) and BG6 (comp & data)
• SaaS Energy Efficiencyis the degree to which energy expanded by a software system in operation is in relation to the software tasks executed and the results achieved.
© CETIC – www.cetic.be 11/03/2014 15
Goal Template – SaaS Energy Efficiency
SaaS Energy Efficiency
Object Server-side software features or components of a Cloud application
Purpose (Qualitative) characterization of the energy efficiency on representative workloads
Quality Focus Energy Efficiency
Point of View Development team and Project Manager of a Cloud Application
Context Identify the energy consumption of various features or components of an application to be provided as a service in the Cloud to facilitate later refactoring activities to improve the application code with regards to energy consumption.
© CETIC – www.cetic.be 11/03/2014 16
Industry Use Case - News Asset
© CETIC – www.cetic.be 11/03/2014 17
NewsAsset Deployment Alternatives
• Moving to a SaaS model• Alternative 1: Isolate customer
1 VM per customer with NewsAsset server• Alternative 2: Multitenant
1 load balancer, n VM each with a NewsAsset server instancem VM with file and database servers
© CETIC – www.cetic.be 11/03/2014 18
Template of Questions for Energy Consumption Behaviour
EffectivenessWhat can we play with– VM have technical characteristics• CPU frequency, memory and disk size, …
– Modular Applications have sub systems Si made of components cij • Components can be co-located on same VM (vmk) or not
Both together define Deployment Alternatives (Dm)
– Representative Workloads (for typical classes of customers) wl
© CETIC – www.cetic.be 11/03/2014 19
Template of Questions for Energy Consumption Behaviour
Effectiveness• How much energy is consumed by a vmk deployed
with a set of cij’s (from a deployment alternative Dm) installed when the workload wl is applied?– Energy consumed can be• Total• Chronological (evolution of energy consumption over time)• Comparative (to other measures that influence energy
consumption)
– Question can be asked for VMs with different characteristics with different set of components installed on them and for different customer workloads
© CETIC – www.cetic.be 11/03/2014 20
Conclusion
• Similar question template can be defined for Energy Efficiency– Nightly builds – only select 1 or 2 alternative
deployments– Focus analysis on variability between workloads
• A first release of Papyrus and Acceleo projects– Papyrus project – Profile to augment UML with
stereotypes with KPI monitoring information– Acceleo project – To extract KPI monitoring information
from UML models and transform it in a textual format (human readable and to come: OVF fragments)
© CETIC – www.cetic.be 11/03/2014 21
Future Work
• Migrate to Eclipse Luna and new version of Papyrus and Acceleo
• Include monitoring for additional KPIs (on quality of service, protection, experience, etc.)
• Handle monitoring for trade-off KPIs
Energy related Goals and Questions for Cloud Services
Jean-Christophe<dot>DEPREZ<at>CETIC<dot>beScientific Coordinator
&Christophe<dot>PONSARD<at>CETIC<dot>be
Measurement and Metrics for Green and Sustainable Software (MeGSuS '14)
IWS Mensura – Rotterdam, the Netherlands