Retail sector example for

Using the WSO2 ESB with SAP ERP

© WSO2 2012. Not for redistribution. Commercial in Confidence.

Nalaka Umagiliya – Head of Business Systems (Retail Sector), John Keells Holdings PLC Harsha Senanayake - Head of Enterprise Solutions, John Keells Holding PLC Sumedha Rubasinghe – Architect, Chair-Management Committee Data Technologies, WSO2 Asanka Abeysinghe - Director, Solutions Architecture, WSO2

WSO2 Background

-  Founded in 2005 by recognized leaders in XML, Web services technologies, standards and open source

-  Primary contributors to Apache Web Services projects started in 2001 -  Funded by Intel Capital & Quest Software ($11M) -  Technology OEM’d by IBM, Progress, Software AG, Alcatel, EMC,

and CA -  Global offices:

-  Palo Alto, USA - Portsmouth, UK - Sydney, Australia - Colombo, Sri Lanka

-  145+ employees and growing

WSO2 Platforms and PaaS WSO2 Carbon Enterprise Middleware Platform

WSO2 Stratos Cloud Middleware Platform

WSO2 StratosLive Java PaaS

On-premise on physical or virtualized environments

Cloud-native (multi-tenant & metered), deployed as private or public PaaS

Public Java PaaS operated by WSO2

Full suite of products – start with one, click to add more

Full benefits of cloud – from using VMs to building higher level PaaS or SaaS apps

Instant access to middleware – as-a-Service

In production at 100+ F1000 enterprises; 1B txn per day at eBay

Manage central ops, enable developers to self-provision middleware services

Pay just for what you use; flexible billing

Common Code Base •  Complete middleware stack •  OSGi-based componentized platform •  100% open source and standards

WSO2 support engagement model

-  QuickStart -  Development

Support -  Development

Services -  Production

Support -  Turnkey

Solutions

John Keells Group -  Founded in 1870; A proud history spanning 140 years

-  Sri Lanka’s highest market capitalized company - Exceeds USD 1.6 billion

-  Group’s 9 listed companies contributes to 15 % of Colombo Stock Exchange market cap

-  Group Revenue – Rs.60.5 billion in 2010-11

-  10,000+ Employees

-  Present in key sectors of Sri Lankan economy (Transportation, Property, Leisure, Consumer Foods & Retail, Information Technology & BPO, Financial Services & Plantation Services)

-  A Full Member of the World Economic Forum

-  First Sri Lankan company to be listed overseas – GDRs listed on the Luxembourg Stock Exchange with a AAA+ credit rating

-  Ranked among the “200 Best under a Billion” in Asia Pacific by Forbes

-  LMD's Most Respected Entity in Sri Lanka – Placed first in four out of five years, since inception

-  Signatory to the UN Global Compact

BU - KeellsSuper

-  Keells Super is one of the leading supermarket chains in the country which has been in operation for the last 20 years

-  Keells Super was Instrumental in popularizing Modern trade in Sri Lanka -  Currently at 42 outlets and expanding

First  Retailer  to    implement  a  leading  ERP  in  Sri  Lanka  –  2004/5  

Introduced  the  first  Loyalty  program  in  Retail  with  Integrated  CRM  and  BI  in  Sri  Lanka  

The  First  and  only  online  supermarket  in  Sri  Lanka  -­‐  KeellsSuper.com  

Real-­‐Jme  stock  taking  using  handheld  scanners  (Recognized  as  a  case  study  by  Motorola)   Introduced  the  first  Retail  Radio  in  Sri  Lanka    

(Keells  Super  Radio)    

Business Requirement

-  Streamline the SAP and POS integration - Eliminate the performance issues and failures faced with the current SAP and POS integration

-  Seamless integration with the online store – keellssuper.com

.com

Business Requirements Required Integration scenarios

Direction DescriptionArticle  masters  -­‐  new  and  changesCondition  masters  -­‐  price  changesVendor  masters  -­‐  new  and  changesCustomer  master  (credit  customers)Bonus  Buy  Conditions  /  PromotionsDownload  phys.  inv.  docs,  upload  phys.  inv.  count  dataCredit  l imits  Stock  balancesGift  vouchers  master  dataApplication  acknowledgementsFinancial  transcationsUpload  day-­‐end  closing  POSUpload  sales  data  (compressed)Inventory  countsGift  vouchers  -­‐  issues

Inbound(POS  -­‐  >  Head  office)

Outbound(Head  office  -­‐>  POS)

Technical Requirements

-  Guaranteed delivery - message queuing and guaranteed delivery semantics -  Unreliable and slow networks (specially in outstations), POS Server outages

-  Minimize changes to existing infrastructure – POS -  Quality of service (QOS) requirements

-  Exactly Once In Order – E.g. Price changes -  Exactly Once – E.g. Sales data

-  Better performance without impacting the ERP system -  Avoid using synchronous BAPIs/RFC and adopt IDOC based integration which is used by

almost all SAP ERP Retail customers -  Message throttling

-  Prioritization of Messages -  Price changes Vs Article description change

-  Light weight, simple and easily maintainable integration middleware

Component Architecture :

Solution Architecture

SAP Receiver ESB POS

Sender SQL

ç (1) Query Sales line-items by Polling •  Update on message successfully accepted by the

ESB - (Update TRANFFERED_TO_ESB =“TRUE”)

ç (3) Post IDOC ‘WPUUMS01’

è (4) Technical ack - IDOC created successfully /failed messages if reprocessed in SAP.

(2) Transform/Map to IDOC structure - WPUUMS01 has limit on max line items per IDOC therefore will need to be split into multiple IDOCs

è (7) Update on Application ack - UPDATE record: •  ALEAUD message status and update field

TRANSFFERED_SAP _APPLICATION_ACK = “TRUE” and update field TRANSFFERED

è (5) Update on Technical ack - UPDATE record : •  TRANFFERED_TO_SAP_TEC_ACK=“TRUE”

Polling Consumer Spilter Message translator (XSLT)

è (6) Application ack - (ALEAUD) (status, message) – Multiple ALEAUD messages if reprocessed in SAP.

Store and Forward

Content-Based Router

Content-Based Router

Message flow and Enterprise Integration Patterns used

Notations from the book Enterprise Integration Patterns - Gregor Hohpe

Deployment architecture - Sizing

-  500k transactions on an average month

-  1 million on seasonal months

-  Avg Size of a message - 100kb – 5mb

Direction Message  Type    #  of  IDOCs  on  May  2011  ALEAUD                                                                    4,569  ARTMAS                                                              75,189  COND_A                                                          325,517  CREMAS                                                                          214  DEBMAS                                                                              19  WPDBBY                                                                          646  WVINVE                                                                    4,110  ZFI_CRED                                                                          301  ZMM_STOCK                                                              11,592  ZSDGV                                                                          491  WPUFIB                                                                    5,058  WPUTAB                                                                    1,339  WPUUMS                                                                    8,565  WVINVE                                                              33,866  ZSDGVRE                                                                    4,140  

Outbound(Head  office  -­‐>  POS)

Inbound(POS  -­‐  >  Head  office)

Deployment architecture

Production Server Configuration DR Server 1:-CPU:- 4 Cores

RAM:- 8 GB

Storage :- 50 GB

Server 2: CPU:- 2 Cores

RAM:- 4 GB

Storage :- 140 GB

Development Server Configuration

CPU:- 4 Cores

RAM:- 8 GB

Storage :- 105 GB

Project Challenges & Lessons learnt

-  What worked in the Lab with sophisticated load test tools can break in the real environment -  When you have multiple components (SAP ERP, POS,

50+ end points over unreliable networks) it’s difficult to simulate a real production environment

-  Strike a balance between offshore and onsite model

-  Have frequent project / steering committee meeting to ensure EVERYONE is on the same page to avoid surprises

Results

-  Scalability -  Lower TCO -  Peace of mind

Summary

-  Bus architecture to connect 40+ POS endpoints -  Transform and throttle messages based on SAP specification -  Cater for higher load -  Pull model to minimize the infrastructure changes -  Map EIPs to handle message flows and QoS -  Convert SQL data into SAP iDOCs

Future Project Enhancements ?

More Info

§  Corporate website: http://wso2.com

§  Developer portal: http://wso2.org

§  Business development team: bizdev@wso2.com

§  John Keells SAP and WSO2 Professional services

§  Website : http://www.sgit.keells.com

§  Business development team : info.sgit@keells.com

19

lean . enterprise . middleware