web service programming and cloud computing
DESCRIPTION
Web Service Programming and Cloud Computing. Bigger view of programming. What we learnt are mostly small, standalone programming tasks In real world an application involves several tiers and languages RPC Client/server architecture Browser, http server Browser, http server, DB - PowerPoint PPT PresentationTRANSCRIPT
Web Service Programming andCloud Computing
1
Bigger view of programming• What we learnt are mostly small, standalone programming tasks• In real world an application involves several tiers and languages
– RPC– Client/server architecture– Browser, http server – Browser, http server, DB– Browser, http server, application server, DB– … …
• Languages involved– Client side: Html, javascript, xml, css, xslt;– Server side: php, java, python, map/reduce, J2EE, sql, …
2
3
Web Service
4
Service Oriented Architecture
Discovery agency
ProviderRequesterinteract
findpublish
5
Registry
A concrete SOA
WSDL
Web Service ProviderSOAPService
Consumer
Points to description
publish
DescribesService
FindsService
Communicates withXML Messages
6
Web Service definition• “encapsulated, loosely coupled, contracted software objects
offered via standard protocols” --ZapThink Research
– Encapsulated–Web Service implementation is invisible to entities outside the service–Exposes an interface but hides details
– Loosely Coupled–Service and consumer software can be redesigned independently
7
History of Interface Definition Languages (IDLs)
• IDL has a long history in distributed computing– DCE (Distributed Computing Environment) – CORBA IDL, OMG (Object Management Group)– COM IDL, Microsoft– WSDL
• Traditional IDLs– Specifying what to call: the operation names, their signatures,
exceptions. This is the job of IDL. – Agreeing on how to make an invocation: the mechanism of naming,
activation, data encoding. This is what distributed standards such as CORBA or COM do.
• WSDL needs to specify the both: the operation provided by the service, and the mechanism to access the service.
8
Web Service Description Language
• WSDL defines– What the service is: the operations the service provides, including the
signature of the operation –- what– Access specification: details of the data format and protocol necessary to
access the service’s operation–- how– Location of the service: details of the network address, such as a URL –-
where
9
WSDL functionality view
OperationPort Type
MessageBinding
Port Service
Supports
Input & Output
Provides
How to encode
Formats & ProtocolsHow to invoke
Implements
Interface
Endpoints
– What– how– where
Legend:
In WSDL 2.0, portType is changed to interface.
10
WSDL document structure viewWSDL specification
abstract part
types
messages
operations
port types
concrete part
bindings
services andports
11
<?xml version="1.0"?> <definitions name="Procurement" targetNamespace="http://example.com/procurement/definitions" xmlns:tns="http://example.com/procurement/definitions" xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:soap="http://schemas.xmlsoap.org/wsdl/soap/" xmlns="http://schemas.xmlsoap.org/wsdl/" >
<message name="OrderMsg"> <part name="productName" type="xs:string"/> <part name="quantity" type="xs:integer"/> </message>
<portType name="procurementPortType"> <operation name="orderGoods"> <input message = "OrderMsg"/> </operation> </portType>
<binding name="ProcurementSoapBinding" type="tns:procurementPortType"> <soap:binding style="document" transport="http://schemas.xmlsoap.org/soap/http"/> <operation name="orderGoods"> <soap:operation soapAction="http://example.com/orderGoods"/> <input> <soap:body use="literal"/> </input> <output> <soap:body use="literal"/> </output> </operation> </binding>
<service name="ProcurementService"> <port name="ProcurementPort" binding="tns:ProcurementSoapBinding"> <soap:address location="http://example.com/procurement"/> </port> </service></definitions>
port and service
binding
operation and port type
messages
abstract part
concrete part
12
<definitions … name="BNQuoteService"><message name="getPriceRequest"> <part name="isbn" type="xsd:string"/> </message><message name="getPriceResponse"><part name="return" type="xsd:float"/> </message><portType name="BNQuotePortType"><operation name="getPrice">
<input name="getPrice" message="tns:getPriceRequest"/><output name="getPriceResponse" message="tns:getPriceResponse"/>
</operation></portType>
<binding name="BNQuoteBinding" type="tns:BNQuotePortType"><soap:binding style="rpc" transport="http://schemas.xmlsoap.org/soap/http"/> <operation name="getPrice"><soap:operation/>
<input><soap:body use="encoded" encodingStyle="http://schemas.xmlsoap.org/soap/encoding/" namespace="urn:xmethods-BNPriceCheck"/> </input>
<output> <soap:body use="encoded"
encodingStyle="http://schemas.xmlsoap.org/soap/encoding/" namespace="urn:xmethods-BNPriceCheck"/>
</output></operation>
</binding><service name="BNQuoteService">
<documentation>Returns price of a book at BN.com given an ISBN number</documentation> <port name="BNQuotePort" binding="tns:BNQuoteBinding">
<soap:address location="http://services.xmethods.net:80/soap/servlet/rpcrouter"/></port>
</service></definitions>
13
Visual representation
14
WSDL structure—interconnection viewWSDL document
Types (type information for the document, e.g., XML Schema)
Message 1 Message 4Message 3Message 2
Operation 1 Operation 3Operation 2
Message 5
Interface (abstract service)
binding 1
endpoint 1
binding 2
endpoint 2
binding 3
endpoint 3
binding 4
endpoint 4
Service (the interface in all its available implementations)
Abs
trac
t des
crip
tion
of th
e se
rvic
eC
oncr
ete
desc
riptio
n of
the
serv
ice
By Gustavo Alonso and Cesare Pautasso
15
A WSDL example<?xml version="1.0"?><definitions name="PriceCheck"
targetNamespace="http://www.skatestown.com/services/PriceCheck" xmlns:pc="http://www.skatestown.com/services/PriceCheck" xmlns:avail="http://www.skatestown.com/ns/availability" xmlns:wsi="http://ws-i.org/schemas/conformanceClaim/" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:soap="http://schemas.xmlsoap.org/wsdl/soap/" xmlns="http://schemas.xmlsoap.org/wsdl/"><types> …</types><message> …</message> <message> … </message><portType> … </portType><binding> … </binding><service> … </service></definitions> This example is from Steve Graham et al: Building Web
Services with Java
16
PortType
<portType name="PriceCheckPortType">
<operation name="checkPrice">
<input message="pc:PriceCheckRequest"/>
<output message="pc:PriceCheckResponse"/>
</operation>
</portType>
• <portType> defines the interface of web service. Just as Java Interface declaration;– Will change the name to <interface> in WSDL 2.0.
• It consists of a sequence of operation declarations.• WSDL can have zero or more <portType>s. Typically just one. • It has a name attribute, must be unique.
– The binding will refer the portType by its name
17
Operation
• Operation defines a method signature;– Name, input, output, and fault
• Input and output elements are associated with messages; • Different combinations of input/output define different
operations types.
<operation name="checkPrice">
<input message="pc:PriceCheckRequest"/>
<output message="pc:PriceCheckResponse"/>
</operation>
18
Operation Types• The request-response type is the most common operation type, but WSDL
defines four types:– Request-response: The operation can receive a request and will return a response
<operation name="checkPrice"> <input message="pc:PriceCheckRequest"/> <output message="pc:PriceCheckResponse"/> </operation>
– One-way: The operation can receive a message but will not return a response. <operation name=“cancellation”> <input message=“tns:orderCancellation”/></operation>
– Notification:The operation can send a message but will not wait for a response<operation name=“notification”> <output message=“tns:promotionNotification”/></operation>
– Solicit-response:The operation can send a request and will wait for a response<operation name=“cancellation”> <output message=“tns:pushThis”/> <input message=“tns:reponseToPush”/></operation>
• Different types are decided by the order/occurrences of input and output.
19
Messages <message name="PriceCheckRequest"> <part name="sku" element="avail:sku"/> </message> <message name="PriceCheckResponse"> <part name="result" element="avail:StockAvailability"/> </message>
• Describe the abstract form of input, output, or fault. • A WSDL file can have zero or more messages. • Each message has a name, which is unique within the document. • Each message has a collection of <part> elements.
20
Part
<part name="sku" element="avail:sku"/><part name="result" element="avail:StockAvailability"/>
• A <part> element can be compared to a parameter in a method.• A part element has two properties: one is name, the other is its
kind. • Kind can be a type or an element
– Element refers to an element defined in XML Schema– Type refers to a simpleType or a complexType in XSD
• In corresponding sku definition is: <xsd:element name="sku" type="xsd:string" />
21
Types in WSDL
<types> <xsd:schema targetNamespace="http://www.skatestown.com/ns/availability" > <xsd:element name="sku" type="xsd:string" /> <xsd:complexType name="availabilityType"> <xsd:sequence> <xsd:element ref="avail:sku"/> <xsd:element name="price" type="xsd:double"/> <xsd:element name="quantityAvailable" type="xsd:integer"/> </xsd:sequence> </xsd:complexType> <xsd:element name="StockAvailability" type="avail:availabilityType" /> </xsd:schema> </types>• The default type system is XML Schema;
– Theoretically you can use any type system, such as Java types. • To be used in<part> element;• We can also import XML Schemas
22
SOAP request message<soapenv:Envelope xmlns:soapenv=“http://schema.xmlsoap.org/soap/evelope/” xmlns:xsd=“http://www.w3.org/2001/XMLSchema” xmlns:xsi=“http://www.w3.org/2001/XMLSchema-instance”> <soapenv:Body> <sku xmlns=“http://www.skatestown.com/ns/availability”>123</sku> </soapenv:Body></soapenv:Envelope> • Relevant part of the WSDL file:<xsd:element name="sku" type="xsd:string" /> <message name="PriceCheckRequest"> <part name="sku" element="avail:sku"/> </message><operation name="checkPrice"> <input message="pc:PriceCheckRequest"/> <output message="pc:PriceCheckResponse"/></operation>
Envelope
Body
MessagePayload
Header #1
Header #0
23
SOAP response message<soapenv:Envelope xmlns:soapenv= … xmlns:xsd=… xmlns:xsi=… > <soapenv:Body> <StockAvailability xmlns= … > <sku> 123 </sku> <price xmlns=“”>100.00</price> <quantityAvailable xmlns=“”>
12 </quantityAvailable> </StockAvailability> </soapenv:Body></soapenv:Envelope>
• Relevant part of the WSDL file:<xsd:complexType name="availabilityType"> <xsd:sequence> <xsd:element ref="avail:sku"/> <xsd:element name="price" type="xsd:double"/> <xsd:element name="quantityAvailable" type="xsd:integer"/> </xsd:sequence></xsd:complexType>
<message name="PriceCheckResponse"> <part name="result" element="avail:StockAvailability"/></message>
<operation name="checkPrice"> <input message="pc:PriceCheckRequest"/> <output message="pc:PriceCheckResponse"/></operation>
24
Binding <binding name="PriceCheckSOAPBinding" type="pc:PriceCheckPortType"> <soap:binding style="document" transport="http://schemas.xmlsoap.org/soap/http" /> <operation name="checkPrice"> <soap:operation soapAction = "http://www.skatestown.com/services/PriceCheck/checkPrice" /> <input> <soap:body use="literal" /> </input> <output> <soap:body use="literal" / </output> </operation> </binding>• Name of the binding should be unique;• Link to the portType is achieved by the portType name
– This explains why portType name should be unique.• Typically, there is only one <binding> element;• Defines:
– Invocation style: rpc vs. document– SOAPAction– Input message appearance: literal or encoded– Output message appearance
25
Service <service name="PriceCheck"> <port name="Pricecheck" binding="pc:PriceCheckSOAPBinding"> <documentation> <wsi:Claim conformsTo="http://ws-i.org/profiles/basic/1.0" /> </documentation> <soap:address location ="http://www.skatestown.com/services/PriceCheck"/> </port> </service>• Contains a set of <port> elements;• <port> combines the interface binding with a network address specified by a
URI;• A web service can be available in different web addresses;
26
Tools
• WSDL parser: WSDL4J• Apache Axis
– Invoking SOAP web service;– Translate WSDL to Java, and vice versa;– Mapping Java into XML Schema, and vice versa;– Host web service;– API for manipulating SOAP;
27
Mapping between Java and WSDL in JAX-RPC
<message name="fooRequest"><part name="para1" type="xs:string"/>
</message><message name="fooResponse">
<part name="para2" type="xs:float"/></message><portType name="FooBar">
<operation name="foo"><input message="y:fooRequest"/><output message="y:fooResponse"/>
</operation></portType>
• A simple example
public interface FooBar extends java.rmi.Remote{ public float foo(java.lang.String para1)
throws java.rmi.RemoteException;}
28
• Multiple input parameters
public interface FooBar extends java.rmi.Remote{ public float foo(String param1, int param2, boolean param3)
throws java.rmi.RemoteException;}
<message name="fooRequest"><part name="param1" type="xs:string"/><part name="param2" type="xs:int"/><part name="param3" type="xs:boolean"/>
</message><message name="fooResponse">
<part name="para2" type="xs:float"/></message><portType name="FooBar">
<operation name="foo"><input message="y:fooRequest"/><output message="y:fooResponse"/>
</operation></portType>
29
• Multiple output parameters<message name="fooRequest">
<part name="param1" type="xs:string"/></message><message name="fooResponse">
<part name="param2" type="xs:int"/><part name="param3" type="xs:boolean"/><part name="param4" type="xs:float"/>
</message><portType name="FooBar">
<operation name="foo"><input message="y:fooRequest"/><output message="y:fooResponse"/>
</operation></portType>
public interface FooBar extends java.rmi.Remote{ public void foo(String param1, javax.xml.rpc.holders.IntHolder param2,
javax.xml.rpc.holders.BooleanHolder param3,javax.xml.rpc.holders.FloatHolder param4,
) throws java.rmi.RemoteException;}
30
Mapping XML Schema to Java
public class Address {private String street;private String city;public String getCity(){return city; }public void setCity(String c){city=c; }… …
}
<complexType name="Address"><sequence>
<element name="city" nillable="true" type="xsd:string"/><element name="street" nillable="true" type="xsd:string"/>
</sequence></complexType>
• Class has to have correct getters and setters;• In axis, you can use WSDL2Java and Java2WSDL to do the mapping.
60-440 31
03-60-440 Mashups
60-440 32
03-60-440 Mashups
60-440 33
Mashups
• From Wikipedia– Mashup (music), a musical genre of songs that consist entirely of parts of
other songs – Mashup (video), a video that is edited from more than one source to
appear as one – Mashup (web application hybrid), a web application that combines data
and/or functionality from more than one source
• Combine data from multiple sources. – Mostly the data sources lay outside of the organizational boundaries
• Create a new and distinct web service that was not originally provided by either source.
• Content is typically sourced via a web API or a RSS Feed
Mashup
60-440 34
Mashup example• The ChicagoCrime.org Web site
– A mapping mashup– One of the first popular mashups– Mashes crime data from the Chicago Police Department’s online database with
cartography from Google Maps– The concept and the presentation are simple and the composition of crime and
map data is visually powerful
The following slides are borrowed from Umut Orhan
Mashup
60-440 35
Why mashup
• Everybody needs customized applications, tailored to his/her own requirements, taste, style.
• DIY in software/web application construction– There are many building blocks (web APIs, web services)– there are also some tools to assemble the building blocks
• It is like end-user programming
60-440 36
Mashup flavours• Presentation mashups: e.g. Google Maps apps, with emphasis
on presentation• This is the shallowest form of mashup in the sense that underlying data
and functionality don’t meet. Information and layout is retrieved and either remix or just placed next to each other. Many of the Ajax desktops today fall into this category and so do portals and other presentation mashup techniques.
• Data mashups: merging data from different sources• Business mashup: combination of above. combines data
integration, presentation plus addition functionality, such as collaboration features
Mashup
60-440 37
Map mashups
• Locational information presented graphically using maps in a specified context
• Google Maps API opened the floodgates– mash all sort of data from nuclear disasters to Boston’s CowParade cows
onto maps
• Other APIs– Microsoft (Virtual Earth)– Yahoo (Yahoo Maps)– AOL (MapQuest)
Mashup G
enres
60-440 38
Photo and Video
• Photo/video hosting and social networking sites resulted interesting mashups.– Flickr– YouTube– Facebook
• Metadata associated with the hosted images and videos– Who took the picture– What it is a picture of– Where and when it was taken– So on…
Mashup G
enres
60-440 39
Search and shopping
• Exist long before the term Mashup was coined– Combinations of B2B technologies or screen-scraping to aggregate
comparative price data– eBay– Amazon– …
Mashup G
enres
60-440 40
News
• News sources such as BBC and Reuters have used syndication technologies like RSS and Atom since 2002.
• Personalized newspaper by Syndication feed mashups• Doggdot.us, combines feeds from the techie-oriented news
sources Digg.com, Slashdot.org and Del.icio.us
Mashup G
enres
60-440 41
Content provider
• Web Protocols– REST Services– SOAP Web Services– RSS/Atom
• Screen Scraping– Scraping is the process of using software tools to parse and analyze
content that was originally written for human consumption in order to extract semantic data structures representative of that information that can be used and manipulated programmatically.
60-440 42
Mashup platforms• IGoogle• Yahoo Pipes• Openkapow• IBM QedWiki• Microsoft popfly• Google Mashup Editor (migrated to Google App
Engine)• … …
Mashup platform
s
60-440 43
Yahoo! pipes
• Visual development environment for generating data-oriented mashups
• Development is based on:– Dragging gadgets (pipes) from a
toolbox and dropping them in work zone
– Specifying data input– Interconnecting gadgets through
pipes– Specifying data output format
Mashup platform
s
60-440 44
Ajax• AJAX (Asynchronous JavaScript and XML) • Ajax and AJAX• Characteristic: increased responsiveness and interactiveness of
web pages – exchanging small amounts of data with the server – entire web page does not have to be reloaded each time the user
performs an action. • Not a technology itself, but a term refer to the use of a group of
technologies• The "core" and defining element of Ajax is the XMLHttpRequest
object, which gives browsers the ability to make dynamic and asynchronous data requests without having to reload a page, eliminating the need for page refreshes.
Web 2.0
The following slides are from Jimmy LinThe iSchoolUniversity of Maryland
60-440 45
“Old-School” Web Applications
server-side systems
backend database
browser
Inte
rfac
e
Webserver
HTTP request
HTTP response
1
user does something
2
browser sends request to server
3
server generates Web page as a response to the request
4
data is returned in response to the request
5
browser replaces view with data sent from server
60-440 46
Characteristics• User-driven: Things only happen when the user does something
(e.g., clicks on a link or button)• Views defined by URLs: You can bookmark something and come
back to it; use the forward/backward button• Simple user interaction model: Not that many things you can do
in browser• Synchronous Interaction: System responses are synchronized
with user-driven events
60-440 47
Synchronous Interactions
browser
server-side
Time
user activity user activity user activity
server processing server processing
Request
Request
Res
pons
e
Res
pons
e
browser server-side systemsHTTP request
HTTP response
12
45 3
1
2
3
4
5
60-440 48
LAMP
Linux
Apache
MySQL
PHP/Python/Perl
So what do you run on the server side?
60-440 49
From “Old-School” to Ajax
browser
Inte
rfac
e
request
response
Ajax intermediates between the interface and the server.
server-side systems
backend database
Webserver
data management
Ajax“engine”
interaction management
60-440 50
Inside the Browser
browser
HTML / CSSdata
other data(e.g. images)
Inte
rfac
e
Ren
derin
g En
gine
HTTP request
HTTP response
60-440 51
Enter JavaScript
browser
HTML / CSSdata
other data(e.g. images)
Inte
rfac
e
Ren
derin
g En
gine
HTTP request
HTTP response
JavaScript Engine
JavaScriptcode
60-440 52
Enter Ajax
browser
HTML / CSSdata
other data(e.g. images)
Inte
rfac
e
Ren
derin
g En
gine
HTTP request
HTTP response
JavaScript Engine
XMLdata
JavaScriptcode
XMLHttpRequestHTTP request
60-440 53
From Synchronous Interactions…
browser
server-side
Time
user activity user activity user activity
server processing server processing
Request
Request
Res
pons
e
Res
pons
e
60-440 54
To asynchronous Interactions
browser
server-side
Time
user activity
server processing server processing
Request
Request
Res
pons
e
Res
pons
e
client-side processing
60-440 55
Components of an Ajax Interaction
1. A client event occurs (captured by JavaScript event handlers)
2. An XMLHttpRequest object is created and configured
3. An asynchronous request is made to the server via the XMLHttpRequest object
4. Server processes request and returns data, executing a callback in the XMLHttpRequest object
5. The HTML DOM is updated based on response data
60-440 56
DOM• Document Object Model: platform- and language-independent
way to represent XML– Adopts a tree-based representation– W3C standard, supported by modern browsers
• JavaScript uses DOM to manipulate content– To process user events– To process server responses (via XMLHttpRequest)
60-440 57
Ajax: Things to watch out for!• Hype• Application development/maintenance cost
– Brower incompatibilities– Many different approaches and tools– For many things, lack of agreed-on best practices
• Behavior is not ‘Web-like’ – Standard things often don’t work correctly (e.g., browser ‘back’ button,
bookmarks) – Usability issues for users with disabilities
• Security issues
Cloud computing
58
What is cloud computing• Cloud
– Datacenter hardware and software that the vendors use to offer the computing resources and services
• Cloud computing – Refer to both the cloud and the services provided
• Why called cloud computing– the computing happens out there "in the clouds”– wikipedia: "the term derives from the fact that
most technology diagrams depict the Internet or IP availability by using a drawing of a cloud."
59
Definition of cloud computing• A large-scale distributed computing paradigm • Driven by economies of scale• Provider has a pool of abstracted, virtualized, dynamically-
scalable resources– Computing power, storage, platforms, and services
• Delivered to customers on demand• 5 Characteristics (NIST 2009)
– On demand self-service– Broad network access– Resource pooling– Rapid elasticity– Measured service
60
Timeline of cloud computing
61
From Dr. Javier Soriano
Evolution of cloud computing
62
Economic reason for cloud computing
63
Challenge of cloud computing: Elasticity
• Animoto.com:– Started with 50 servers on Amazon EC2– Growth of 25,000 users/hour– Needed to scale to 3,500 servers in 2 days (RightScale@SantaBarbara)
64
RPC • In the early 1980’s, software was not yet “distributed”, only “copied around”• Programmers wanted to install software once on a server, and then call it
remotely over a network from many clients• “Remote Procedure Call” (RPC)• Several major efforts were made to do RPC over the next 25 years• All suffered from at least one of the common “fallacies of distributed
computing”:– The network is secure– The network is homogeneous– The network is fast enough
• HTTP partially fulfilled the need in the early 1990’s– Programmers could make HTTP GET requests in those days, but the language
support for it was not great until recent years
65
Early days of distributed computing
• 1980’s: – RPC using C/C++– EDI (Electronic Data Interchange)– Microsoft DCOM
• 1990’s: – CORBA (for Unix/Linux only)– HTTP (so-called REST web services)
• Still no way to distribute an application across multiple computers that was:– standards-based– platform-independent
66
SOA (Service Oriented Architecture)• They would be standards-based, platform-independent, and
immune to firewalls– some kind of XML would be the wire format
• Each service’s contract would be expressed in a formal manner and registered in a catalog
– programming languages could “parse” this contract and utilize it at runtime, like an interface in Java
– there would be a “factory” call that returned a reference to the currently preferred implementation of a given service contract
– software architects would “compose” designs by shopping among available services
• Network and machine speed and capacity would increase to make the overhead of XML tolerable– massive software reuse would be achieved
67
Another form of out sourcing• Differences
– Scalability – ‘pay per use’, flexible arrangement
68
Three basic service models• Users: use software on thin
clients. – Do not need to download and
install the software – E.g. google doc, online tax
• Developers: use some languages, APIs, servers to develop and deploy an application – Do not need a server to host
the application
• Network architect
69
Basic service models
70
Service Model ArchitecturesCloud Infrastructure
IaaS
PaaS
SaaS
Infrastructure as a Service (IaaS) Architectures
Platform as a Service (PaaS)Architectures
Software as a Service (SaaS)
Architectures
Cloud Infrastructure
SaaS
Cloud Infrastructure
PaaS
SaaS
Cloud InfrastructureIaaS
PaaS
Cloud Infrastructure
PaaS
Cloud InfrastructureIaaS
71
Cloud Infrastructure as a Service (IaaS)• Also known as Hardware as a Service (HaaS).• Service provider owns the equipment; responsible for housing, running and
maintaining it.• Client typically pays on a per-use basis, creates virtual machines (VMs) on
demand– They have full access to these VMs
• Strengths:– Can control and configure environment– Familiar technologies– Limited code lock-in
• Weaknesses:– Must control and configure environment– Requires administrative skills to use
• e.g. Amazon Web Service, Rackspace, GoGrid
72
73
PaaS• Platform provides hardware architecture and software
framework (including application frameworks)• Developers provide an application, which the platform runs
– They don’t work directly with VMs
• Strengths:– Provides higher-level services than IaaS– Requires essentially no administrative skills
• Weaknesses:– Allows less control of the environment– Can be harder to move existing software
• e.g. Google App Engine, which supports Java and Python, and Engine Yard, which supports Ruby on Rails.
74
SaaS• Very common in the IT community• Software companies host their software themselves and then
upgrade to maintain users• e.g. Salesforce.com –online CRM, Live.com, Zoho, Google Docs,
Microsoft Web Apps 2010
75
76
Three Features of Mature SaaS Applications
• Scalable– Handle growing amounts of work in a graceful manner
• Multi-tenancy– One application instance may be serving hundreds of companies– Opposite of multi-instance where each customer is provisioned
their own server running one instance• Metadata driven configurability
– Instead of customizing the application for a customer (requiring code changes), one allows the user to configure the application through metadata
76
77
SaaS Maturity Levels
• Level 1: Ad-Hoc/Custom• Level 2: Configurable• Level 3: Configurable, Multi-
Tenant-Efficient• Level 4: Scalable,
Configurable, Multi-Tenant-Efficient
77Source: Microsoft MSDN Architecture Center
SaaS
PaaS
IaaS
Amazon Google Microsoft Salesforce
Service Delivery Model Examples
78
Cloud Deployment Models• Private cloud
– enterprise owned or leased
• Community cloud– shared infrastructure for specific community
• Public cloud– Sold to the public, mega-scale infrastructure
• Hybrid cloud– composition of two or more clouds
79
Case studies
80
Google Cloud• Started with Google Apps• Platform as Service later on• Replace office software
– Gmail– Google Docs (word processing and spreadsheets)– Google video for business– Google sites (intranet sites and wikis)
• Google Cloud Connect• 500,000+ organizations use Google Apps • GE moved 400,000 desktops from Microsoft Office to Google Apps
81
Google App Engine• Exposes the Google Infrastructure to the outside world
– BigTable– Python Language runtime– Access to some google api’s (authentication , image, manipulation)
• APIs– Python Runtime, The Python environment in which your app runs; CGI,– sandbox features, application caching, logging– Datastore API, BigTable – Google’s Database– Images API, the image data manipulation service– Mail API, sending email from your app– Memcache API, the distributed memory cache– URL Fetch API, accessing other Internet hosts from your app– Users API, integrating your app with Google Accounts– You should expect to see more API’s exposed. More specifically the
Google API’s for Docs , GWT , etc82
Amazon Cloud• Amazon cloud components
– Elastic Compute Cloud (EC2)– Simple Storage Service (S3)– SimpleDB
83
84
Amazon Cloud Users: New York Times and Nasdaq
• Both companies used Amazon’s cloud offering• New York Times
– Used EC2 and S3 to convert 15 million scanned news articles to PDF (4TB data)
– Took 100 Linux computers 24 hours (would have taken months on NYT computers
– “It was cheap experimentation, and the learning curve isn't steep.” – Derrick Gottfrid, Nasdaq
• Nasdaq– Uses S3 to deliver historic stock and fund information– Millions of files showing price changes of entities over 10 minute
segments– “The expenses of keeping all that data online [in Nasdaq servers] was too
high.” – Claude Courbois, Nasdaq VP– Created lightweight Adobe AIR application to let users view data
85
Salesforce Cloud
• Started with information management service that could replace traditional business software technology
• Pioneered software-as-a-service market (esp. CRM tools)• 5,000+ Public Sector and Nonprofit Customers use
Salesforce Cloud Computing Solutions• Moving beyond SaaS into the platform-as-a-service
market
86
Salesforce.com in Government• President Obama’s Citizen’s Briefing Book
– 134,077 Registered Users– 1.4 M Votes – 52,015 Ideas– Peak traffic of 149 hits per second
• US Census Bureau Uses Salesforce.com Cloud Application– Project implemented in under 12 weeks – 2,500+ partnership agents use Salesforce.com for 2010
decennial census – Allows projects to scale from 200 to 2,000 users overnight to
meet peak periods with no capital expenditure
87
88
Facebook’s Use of Open Source and Commodity Hardware
• 400 million users + 250,000 new users per day• 100,000 transactions per second, 10,000+ servers• Built on open source software
– Web and App tier: Apache, PHP, AJAX– Middleware tier: Memcached (Open source caching)– Data tier: MySQL (Open source DB)
• Thousands of DB instances store data in distributed fashion (avoids collisions of many users accessing the same DB)
Drawbacks • Excessive dependence on the Internet• Subject to ISP and Cloud Service Providers’ disclosure policy• Inappropriate for sensitive, classified data• Data replication, coherency, integrity loss
89