scrawler soa dependency tracker sandeep phukan oracle ssi prestige tech park, bangalore, india...

sCrawlerSOA Dependency Tracker

Sandeep PhukanOracle SSI

Prestige Tech Park, Bangalore, India

sandeep.phukan@oracle.com

Agenda

• What is Dependency• Computational Graphs for Dependency• Designtime Vs Runtime• Oracle SOA Gaps• sCrawler Abilities• Crawling Algorithm• Demo• References• Questions And Answers

What is Dependency

• Dependency is a relationship between one entity to another

• In SOA Context, dependency means– Which endpoints are referred to by a BPEL or ESB Service

– Which types of Adapters are referred to by BPEL or ESB Service

– Which external services / Abstract WSDLs are referred by BPEL or ESB Service

– Given a change to a particular Service, which other services might be impacted immediately, etc

Computational Graphs for Dependency

• Graphs can be directed or undirected– ESB Request Response BPEL (bi-directional)– ESB One Way BPEL (unidirectional)

• Multi Graphs allow more than a single relationship to be modeled– InboundAdapter to ESB one to Many– BPEL to ESB Many to One

• Cyclic Relationships can be identified– ESB1 BPEL1BPEL2…… ESB1

Designtime Vs Runtime

Runtime

ChangeTime

DesignTime

Oracle SOA Gaps

• There is no graphical means to track Designtime dependencies end to end– InboundAdapter ESB BPEL ESB OutboundAdapter

• Time Consuming Tasks – Track manually via Enterprise Manager– Heavy on XML– Refer to JDeveloper Source Code– Requires good understanding of Oracle SOA Internals

• Difficult to do quick Impact Analysis

Visibility Use Case

Visibility Use Case (contd)

Visibility Use Case (contd)

sCrawler Abilities

• Provides a graphical end to end view of SOA Designtime Artifacts– ESB Services– BPEL Processes– Inbound and Outbound Adapters– Abstract WSDLS– External Services– Message Exchange Patterns

• No understanding of Oracle SOA required

• Zero configuration, Completely Automatic– Only input is URL of a SOA Artifact– Runs as a Standalone Application

sCrawler Abilities (contd)• Scalable

– Thread Pools, Thread Safe, Deterministic response time – 263 Artifacts,166 Relationships, 101 Integration Scenarios crawled in 22

secs at an average of 72 ms per artifact on Oracle Application Server running on a single 2.2Ghz CPU using 8 worker threads

• Complete separation of concern: sCrawler Graph Vs Visualization

• Can be plugged with any XML based graphics Rendering Engine– sCrawler Flex via BlazeDS– sCrawler SVG via Batik– sCrawler Microsoft Documents via Apache POI

sCrawler Abilities (contd)

• Quick and Effective Impact Analysis– Finding bottlenecks (Fan Out, Fan In)– Finding Impacted Services or Processes

• Graph can be extended for– Discovering Paths for Parallel Deployment– Automatic endpoint testing via Stubs– Endpoint monitoring for an Integration Scenario– Development Effort Estimation

sCrawler Abilities (contd)Worker Threads Average Time Per Artifact(ms) Total Generation Time(secs)

1 110 32

4 85 25

10 80 23

20 72 21

sCrawler Abilities (contd)

Graphical Abstractions

sCrawler Abilities (contd)

Message Exchange Patterns

sCrawler Abilities (contd)

Cyclic Views

sCrawler Abilities (contd)

Graphical Impact Analysis

sCrawler Abilities (contd)

Ease of Use

sCrawler Abilities (contd)

Pluggable Front end

Crawling Algorithm

Process

Process

Process

Process

Process

Iterative Recursive Algorithm: Simple Approach• If runtime of process is NULL, return graph• Else, add parent Node to graph and find list of

immediate children• If list is NULL, return graph• Else, for each child in children, add child Node to

graph and link [parent,child]• Call Step 1 with child runtime O(nlogN)

Demo

References

1. http://code.google.com/p/scrawler/

2. http://www.oracle.com/technology/pub/articles/scrawler_sandeep_phukan.html

3. http://blogs.oracle.com/SoaRanch/sCrawler%20Paper.pdf

4. http://blogs.oracle.com/SoaRanch/2008/12/soa_process_dependency_trackin.html

Questions & Answers