hpc in the cloud impact on future enterprise architectures
Post on 24-Jan-2016
28 Views
Preview:
DESCRIPTION
TRANSCRIPT
HPC in the CloudImpact on Future Enterprise Architectures
Dr. Tirumale K (TK ) RameshThe Boeing Company
NCOIC Cloud Computing Working Grouptirumale.k.ramesh@boeing.com
NCOIC PanelNAVAIR Military Aviation Architecture Conference
September 22, 2010
Approved for Public ReleaseDistribution Unlimited
NCOIC-DefDaily-TKR20100917
Cloud Computing & High Performance ComputingDefinitions and Synergies
Cloud Computing A paid-for service model for delivery and consumption of computing allowing
organizations to access to applications, deployment and infrastructure platforms as a service provided on-demand
Infrastructure services which is more of a la carte with control for infrastructure provisioning is not what Cloud offers at least for now
What Cloud provides is an on-demand infrastructure as a whole (Infrastructure as a Service-IaaS) via set of pre-packaged menu options to choose the infrastructure from the providers
High Performance Computing (HPC) A computational model in which high performance is delivered to support
highly compute-intensive calculations mainly by using parallel algorithms with tightly-coupled, data-intensive inter-process communication, running on hundreds or even thousands of processors or cores.
HPC in the Cloud- Setting up a configuration of distributed cloud resources as a tightly coupled HPC engine to meet requirements of locality of reference, communication bandwidth and latency from node to node
2
Cloud Computing Impact on Future Enterprise Architectures (EA) It is predicted that in next 10+ years as Cloud Computing(CC) grows and matures, it
impacts and may redefine and advance the EA of an organization There is even more interest of EA to global organizations to sustain global
competition and support for interoperability in a global ecosystem environment Users would be able to buy cost-effective mission-critical processes as cloud services
and general buying habits of organizations may change from “buy all once” mindset to “buy breed of needed services”
3
Adaptable and scalable architecture to support changing buying habits and support for ecosystem of cloud computing
EvolvableArchitectures
Organizations to re-examine organizational security policies
Organizations to re-examine organizational security policies
Organizations to have high level control over data & network
Organizations to have high level control over data & network
Organizations to periodically evaluate vendor technologies and risk management including COTS technologies risks
Organizations to periodically evaluate vendor technologies and risk management including COTS technologies risks
Organizations to engage pro-actively in architecture implementations in cloud-For example designs that support integrating multiple CC interfaces
Cloud Services
Future Enterprise Architecturesdemands
demands
Cloud Service & Delivery Model Trade-offs
4
IaaS
PaaS
SaaS
Private
Public
Hybrid
User Responsible for Security
Vendor Responsible for Security
Ada
ptat
ion
toFu
ture
Arc
hite
ctur
es
Rel
iabi
lity
Inte
rope
rabi
lity
secu
rity
Rel
iabi
lity
Inte
rope
rabi
lity
Ada
ptat
ion
to
Futu
re A
rchi
tect
uresOpen Standard
Specifications
Proprietary Specifications
better
concerns better
better better
better better
PaaS(IaaShigh cost)
With balanced options, Security is still an issue for global operations
Basis Criteria's: Future Architectures, Security, Interoperability and Reliability
Trade-off from EA CentricTrade-off from EA Centric
Trade-off from Secured & global ops Centric
Trade-off from Secured & global ops Centric
PaaS
Trade-off from EA CentricTrade-off from EA Centric
Hybrid(Open arch)
Trade-off from Secured & global ops centric
Trade-off from Secured & global ops centric
Hybrid
Trade-offs
Cloud in Open Architecture Global Environment
Most of cloud providers expose APIs but have specific implementations that do not permit interoperability
– Ope
Some Open Standards under development including OGF’s Open Cloud Computing Interface- OCC (Open Cloud Consortium) is working on obtaining consensus on open standards and best practices
The Cloud Security Alliance is a non-profit organization that is working on promoting the use of best practices for providing security assurance 5
RoutingRouting
SwitchingSwitching FirewallsFirewalls
Application DeliveryApplication Delivery
Cloud Providers Cloud ProvidersVirtualizationVirtualization
Service-Oriented ArchService-Oriented Arch
PublicCloud PublicCloud
PrivateCloud PrivateCloud
HybridCloud HybridCloud
Open Standards
Enables open architecture
Provides global interoperability and portability
High Performance Computing (HPC) in the Cloud- Are there Cost Savings?
HPC in the Cloud offers the possibility of creating applications that would otherwise be prohibitive in HPC infrastructure costs to many HPC application developers Transforming HPC to Cloud via virtualization of cloud infrastructure and adapting
to HPC usage patterns of cloud resources Primary determinants of HPC performance are data locality and locality of
reference, and communications latency and bandwidthCurrently most of the HPC providers cannot guarantee these but possible in the
near future Today, nobody would build an HPC cloud for great grand challenge scientific
applications as the business is not profitable HPC users are far too small and does not take full advantage of cloud scaling
As HPC usage moves more from scientific users to main stream enterprise users, HPC cloud will become more economical
6
High Performance Computing (HPC) in the Cloud for Future EA
HPC benefits in future enterprise global operations As organizations in future become smarter in global collaborative work using 3D web
technologies and other collaborative computing technologies , it creates an opportunity for HPC to tap into much broader main stream enterprise user base and instantiate an architecture view in future enterprise architectures
HPC in the Cloud migration path for future EA First migrate via SaaS by tapping some acceleration HPC applications as a Cloud
Service to use with traditional HPC data centers (some FPGA vendors are interested in this)
Better Security in SaaSBetter Adaptation to Future Enterprise Architectures to support HPC for main
stream usersSlowly migrate to IaaS (full provisioning of HPC resources in Cloud)
So, is it all good news to migrate HPC to Cloud to save cost? No, not yet.More learning curve and initial efforts needed Initial high cost leading to lot of wait and watch now
7
High Performance Computing (HPC) in the Cloud- What are the Gaps?
8
HPC (Traditional P & D computing with high throughput HW and optimized SW stack)
HPC (Traditional P & D computing with high throughput HW and optimized SW stack)
Dynamic and adaptive workload management to fully utilize cloud resources
Gaps for Migration of HPC to Cloud
Cloud Fabric Scalability: Intelligent management of resources from network all the way up to processor/multi-core level( to gain fine-grain multi-threading parallelism)
Need virtualization of accelerators on the cloud to migrate any Hybrid HPC to cloud
CloudComputing
More compute intensiveapplications today demands HPC acceleration via CPU/GPU, CPU/FPGA
Some HPC in Cloud offerings todayPenguin’s HPC-as-a ServiceTM
Open Question: Is the Cloud robust enough to handle the massive computing cycles and very high system throughput needed for an
effective HPC environment?
Cloud Computing Open Architecture to leverage COTS HPC solutions and dramatically decrease the cost for doing HPC – a clear lift off opportunity for HPC to enter main stream
Cloud in Open Architecture EnvironmentImpact to HPC in the Cloud
Security and Legal/Legislation Issues Impact Potential exposure of sensitive and valuable information processed in HPC in the
Cloud HPC have well developed security layers in a single HPC data center
environment Security providers are looking to enhance the security of cloud offerings such as
cloud-based intrusion prevention which allows users to monitor network activity for malicious behavior
This requires integrating traditional HPC security layers with higher level cloud security layer for HPC offerings in cloud
There is no doubt that Cloud Computing is still in its infancy and many offerings remain insecure or poorly documented
Need to put more trust in security suppliers Private cloud architectures may be holding well at a good level in the enterprise, but
open standards to facilitate managing across global competing platforms is still far away for global operations
Currently opportunities are opening up for HPC in private Clouds
9
Secured Cloud Computing for GlobalOperations- Are We There Yet?
I say it is a Mixed BagSecurity is a major concern
Some cloud opponents argue that customer data is more secure when managed internally and not throw it on cloud
Some cloud supporters argue that Cloud Providers have a strong incentive to maintain trust so that they can provide a higher level of security in the near future
Expectations going forwardMost organizations experimenting with small implementations as Private
and Hybrid Cloud architecturesPrivate Cloud may move into the mainstream well before truly global
standards may even come into play Eventually there will be one standard that some experts argue may even
take longer for standardization (10+ years)
10
Final Thoughts
Delivering Secured Cloud Computing for Global Operations is not the responsibility of one single organization We need a well established framework for collaborations of all stakeholders
(Industries, Consumers, Government and Academia) Fundamentally Cloud needs to be a “Virtual Connector” to achieve “Net centricity”
Future Enterprise divides into community of people, processes, information, knowledge and services interconnected by a smarter network to achieve maximum benefit of its resources with reduced cost
11
Cloud (Virtual Connector
Cloud (Virtual Connector
People(Stakeholders) People(Stakeholders)
Information/ Knowledge/
Information/ Knowledge/
ProcessesProcesses
Org
aniz
atio
nal
inte
rope
rabi
lity
Semantic
interoperability
Smart Network(technology enabler)
Smart Network(technology enabler)
EA View as a Cloud Fabric
Technical
interoperability
Final Thoughts
Commercial and Military Aviation Architecture need to align with the global enterprise architecture in order to support today’s global business using key technology pointers Recommended migration plan is to first apply SoA in Aviation Architectures and transform
them to cloud offerings Take the architectural principle of SOA and applying it to an infrastructure offered by
cloudFinally integrate into HPC usage in the long run within a comprehensive enterprise
architectural framework to support global interoperability Network Technology is only an enabler for future aviation architectures implemented on
Cloud but network itself is not a major problem
NCOIC can help in providing the necessary guidance in the proliferation of Cloud Computing in support of future enterprise open architectures that evolves and uses emerging technologies rendered on the cloud that can be accessed via cloud services
Cloud computing can provide highly cost effective implementations of the architecture but Security is still the main issue
12
13
Thank You!
top related