![Page 1: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/1.jpg)
UltraUltra--scale escale e--Commerce Transaction Commerce Transaction
Services with Lean MiddlewareServices with Lean Middleware
Paul FremantlePaul Fremantle
CTO and CoCTO and Co--FounderFounder
[email protected]@wso2.com
##pzfreopzfreo
http://pzf.fremantle.orghttp://pzf.fremantle.org
![Page 2: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/2.jpg)
Contents
• Challenges at extreme scale deployment
• A case study – online retailer
• What is lean software?
• What are the challenges in Cloud?
• Why is Platform-as-a-Service important
![Page 3: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/3.jpg)
http://www.flickr.com/photos/theplanetdotcom/
![Page 4: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/4.jpg)
Case Study: Problem Definition
• Millions of power sellers connecting directly to APIs
• Accessing APIs via slow and fast connections
• Load balancing to an ultra-scale backend cluster
• ~1bn large message transactions/day
![Page 5: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/5.jpg)
Enterprises with these challenges
![Page 6: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/6.jpg)
The challenges of ultra-scale integration
• Absolute rigor for service/API definitions
• Peaks and troughs in load
– In this case “Cyber Monday”
• Slow clients, large messages
• Patch and system management
• Monitoring
– Monitor latency, memory, CPU, message size (by “bucket”
• All at 5 mins, 15 mins, 1 hr, 24 hrs
– Alerting when the “queue” depth increases
![Page 7: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/7.jpg)
Deployment Architecture
![Page 8: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/8.jpg)
![Page 9: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/9.jpg)
Outcomes of this architecture
• Initial test production Q4/2009, ramp up during 2010
• Ramped up incrementally to 600m transactions/day
• On 36 JVM instances
• Expected to grow to 1bn/day during 1H2011
• Significantly more robust
• Handling around Other groups now using the ESB
• 80+ instances throughout the organization
• Looking add Governance Registry during 2011
• Better reliability, better scalability, lower TCO
![Page 10: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/10.jpg)
Lean
http://www.flickr.com/photos/akalat/
![Page 11: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/11.jpg)
Lean and Open Source• Lean
– Triumph of the Lean Production System, John Krafcik, 1988, Sloan Management Review
• What is “Lean Software”
– Designed to do just enough
• No muda
• Only focus on real requirements – not feature checklists
– Agile Development and Minimum Viable Product
• Decide as late as possible, Code as fast as possible
– Modular so that unnecessary code isn’t even loaded
– No duplicate code (unfortunately a typical result of M&A)
• Open Development model complements Lean strongly:
– Shared requirements, testing and architecture decisions
– Iterative Agile development model based on milestones and continuous build
![Page 12: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/12.jpg)
Why Lean and Open Source for our e-tailer?
• Lean– Simpler cleaner configuration:
• Easier to configure, easier to fix
• Highly effective solution
– Lower hardware costs for the same workload
– Less money spent on consultants:• 80 instances in production in a year with
approximately 1/3 person year onsite support
• Open Source– Not the only factor in purchasing:
• Test production “shoot-out” between Open Source and Proprietary
– Better insight, better partnership, community
![Page 13: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/13.jpg)
Enterprise Architecture
![Page 14: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/14.jpg)
Modularity enables Lean
![Page 15: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/15.jpg)
Taking Lean Open Source into the Clouds
![Page 16: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/16.jpg)
• Security
• Resource sharing inside an organization
– Central Limit Theorem and Private Cloud
• Agility
• Shared Nothing for Data, Cache and
Processing
– Designing systems so they scale effortlessly
• More than just Infrastructure-as-a-Service
– Getting the right shared services
Cloud Challenges
![Page 17: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/17.jpg)
Moore’s Law for Data
• Online data went from
– 5 exabytes in 2002 to
– 281 exabytes in 2009
That is doubling every 15 months
• The only way to deal with this expansion is to create new applications
– Its not just the volume, but new types of data
– Need the “Industrial Revolution” for Software Development
![Page 18: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/18.jpg)
Platform-as-a-Service (PaaS)
• PaaS is about making it
simpler, faster and more repeatable
to develop, deploy and manage applications
– Shared Multi-tenant Services
– Such as Identity, Application Server, Queues, Logs,
Metering, Configuration Repository and Registry
– Allows developers to focus on the logic and design
– Commonality at a higher level creates efficiencies
(shared memory, better load distribution)
![Page 19: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/19.jpg)
Enterprise IT in 2015+
![Page 20: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/20.jpg)
• Lean
– All the same benefits are magnified in a cloud
– Efficiency that is valuable in fixed deployments is invaluable in large dynamic deployments!
• Available on private, public, on-premise
– Getting locked into a specific public PaaS will have long term repercussions
– Open Source is a huge protection against this
• The correct set of core “services”
– Not just App Server, but Identity, Registry, Data, Cache, ESB, BPMS, Billing, Logging, etc
• Open Standard interfaces to common services
– Enables modular usage
• Self-service, multi-tenancy, elasticity, metering, incremental deployment and testing
What to look for in a PaaS
![Page 21: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/21.jpg)
Stratos – Carbon as a PaaS• A full middleware platform available as-a-service
• Based on OSGi
• Self-service, Multi-tenant, Elastic, Metered and Billed
• Completely Open Source under the Apache License
– Available in the cloud, on-premise and private cloud
• Isolates applications from the Infrastructure
– Currently supports vSphere, Eucalyptus, Ubuntu, Amazon
• Provides
– Application Server, ESB, Governance Registry, Business Process Management Server, Business Activity Monitoring, Rules, Data Services
http://wso2.org/downloads/stratos
![Page 22: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/22.jpg)
Carbon/Stratos and Enterprise Architecture
![Page 23: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/23.jpg)
What can a PaaS do for you?
• Integrate multiple internal and cloud data sources and present via JSON to a Mobile Client
• Provide all the building blocks to build SaaS applications
• Give developers in your organization the perfect balance of control and freedom to innovate
• Automate governance
A good PaaS is a platform for innovation
![Page 24: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/24.jpg)
About WSO2WSO2 is a fast-growing software company operating globally offering:
• A comprehensive on-premises platform - WSO2 Carbon
• A unique cloud platform - WSO2 Stratos
WSO2 has next generation vision and technology
• Called out as a visionary in the SOA market
• WSO2 Cloud and On-Premise platforms have a completely unified architecture allowing WSO2 to scale up both aspects of the business in parallel
In 5 years WSO2 has grown:
• More than 115 employees and more than 75 customers
• Doubled revenue and bookings every year
• The Open Source business model WSO2 implements creates strong customer pull, high customer satisfaction, and a total of more than 1 million product downloads
Company website: http://wso2.com
Developer Site and Open Source Forge: http://wso2.org
![Page 25: Ultra-scale e-Commerce Transaction Services with Lean Middleware](https://reader033.vdocuments.us/reader033/viewer/2022051608/54445c8eb1af9f600a8b48a2/html5/thumbnails/25.jpg)
Thank You
Thank you very much for your time
If you wish to find out more, please come talk to
us at Booth #102!