webinar: it's the 21st century - why isn't your data integration loosely coupled?
TRANSCRIPT
It's the 21st Century: ���Why Isn't Your Data Integration Loosely Coupled?WebinarTuesday, May 19th10:00am PDT / 1:00pm EDT
Today’s Discussion Topics
• Why isn’t your data integration loosely coupled• SnapLogic introduction and demonstration• Recommended next steps• Discussion
Copyright © 2015, Intellyx, LLC
3
It’s the 21st Century
Why Isn’t Your Data Integration Loosely Coupled?
Jason Bloomberg President
@theebizwizard
About Jason Bloomberg
• President of Intellyx
• Advise companies on their digital transformation initiatives & help vendors communicate their agility stories
• Write for Forbes & Wired on Digital Transformation
• Buy my latest book, The Agile Architecture Revolution
Copyright © 2015, Intellyx, LLC 4
What’s a Connector?
• Programs that know how to interact with an underlying business application
• Performs two-way communication
• Can be specific to an application or class of applications through a standard communication protocol
Copyright © 2015, Intellyx, LLC 5
Phot
o Cre
dit:
Tom
Woo
dwar
d ht
tps:
//w
ww
.flic
kr.c
om/p
hoto
s/bi
onic
teac
hing
/
Challenge: Tight Coupling
• Any change in the data format or interface requirements for either end of any interaction would require an update of the connector
• Can also become a single point of failure or a bottleneck that limits scalability
• Introduces brittleness to the application environment
Copyright © 2015, Intellyx, LLC 6
A failed interaction may result
Data Integration Limitations
• Traditional connectors may perform data transformations
• Typically require strict, rigid data mapping between endpoints
• Mappings created at design time
Copyright © 2015, Intellyx, LLC 7
Phot
o Cre
dit:
Loo
uis
K.
http
s://
ww
w.f
lickr
.com
/pho
tos/
bona
part
y/
Loose Coupling
• Abstract underlying code with contracted interface
• Separation of concerns between consumers & providers
• Can change underlying code without breaking interaction, as long as endpoints comply with contract
Copyright © 2015, Intellyx, LLC 8
Phot
o Cre
dit:
Ra
y Fo
ster
htt
ps:/
/ww
w.f
lickr
.com
/pho
tos/
9441
8464
@N
08/9
6313
9307
3/si
zes/
c/
SOA to the Rescue?
• Service-Oriented Architecture (SOA) in part intended to resolve limitations of traditional connectors
• By abstracting interfaces to software as Web Services, interactions could now be loosely coupled
Copyright © 2015, Intellyx, LLC 9
Phot
o Cre
dit:
Tho
mas
_sly
htt
ps:/
/ww
w.f
lickr
.com
/pho
tos/
tom
sly/
Loose Coupling with SOA
• Possible to change the underlying software (consumer or provider) without breaking interaction – Both endpoints must
conform to Web Services contract
• Document style contracts include XML Schemas for specifying data formats – Rigid & strongly typed
Copyright © 2015, Intellyx, LLC 10
Phot
o Cre
dit:
Gid
eon
Bur
ton
http
s://
ww
w.f
lickr
.com
/pho
tos/
wak
ingt
iger
/
Limitations of Web Services-Based SOA
• Web Services largely fell short in delivering loose coupling
• Web Services still required an underlying software implementation
• Typically became part of the Enterprise Service Bus (ESB) – Traditional piece of integration
middleware exposing connectors – Supported the XML-based Web Services standards – ESBs typically centralized & heavyweight, not
cloud-friendly
Copyright © 2015, Intellyx, LLC 11
REST to the Rescue?
• Representational State Transfer (REST) – Architectural style intended to build
hypermedia applications that generalized the behavior of the Web
– Became a lightweight, HTTP-based approach for building application programming interfaces (APIs)
Copyright © 2015, Intellyx, LLC 12
Phot
o Cre
dit:
Custom Media Types
• REST loose coupling depends upon Standard Internet Media Types (formerly called MIME types)
• Internet Media Types designed for display metadata – HTML, PDF, etc.
• REST’s answer for custom data formats are Custom Media Types
• Introduce tight coupling – How to communicate, maintain, & version them?
Copyright © 2015, Intellyx, LLC 13
Phot
o Cre
dit:
Pe
n W
agge
ner
http
s://
ww
w.f
lickr
.com
/pho
tos/
epw
/434
1554
771/
size
s/z/
The Schemaless Data Trap
• JSON often favored over XML because it is schemaless
• No fixed metadata representing data syntax or semantics
• Problem: interpretation of data falls to underlying logic
Copyright © 2015, Intellyx, LLC 14
Another shell game
Phot
o Cre
dit:
Van
essa
Dua
lib h
ttps
://w
ww
.flic
kr.c
om/p
hoto
s/re
rinh
a/
Design-Time Introspection
• Schemas and other metadata relevant to the interaction do need not be known before the integration is set up
• SnapLogic Snaps automatically gather such metadata – Automate the
configuration of the integration
Copyright © 2015, Intellyx, LLC 15
Phot
o Cre
dit:
Okk
o Py
ykkö
htt
ps:/
/ww
w.f
lickr
.com
/pho
tos/
data
_op/
Data Integration Dos & Don’ts
• Do: – Plan ahead for horizontal
scalability and fault tolerance (cloud friendliness)
– Favor document-centric data formats
• Don’t: – Use rigid, centralized middleware – Rely heavily on fixed schemas
Copyright © 2015, Intellyx, LLC 16
Phot
o Cre
dit:
aud
io-l
uci-
stor
e.it
http
s://
ww
w.f
lickr
.com
/pho
tos/
audi
oluc
isto
re/
Today’s Discussion Topics • Why isn’t your data integration loosely coupled• SnapLogic introduction and demonstration• Recommended next steps• Discussion
• Experienced Team: Leadership from Informatica, Salesforce, Sybase, Cognos, CA
• Headquarters: San Mateo, California• Investors: Andreessen Horowitz & Ignition• Advisory Board: AstraZeneca, HP, Symantec,
Yahoo• Customers: Adobe, Acxiom, AstraZeneca,
Blackberry, Bloomin’ Brands, CapitalOne, Cisco, Cognizant, Danone, Fox Sports, GamesStop, GE, HP, IDG, iRobot, RocketFuel, Target, Yelp, Uber, USF, Xactly
SnapLogic: Unified Platform to Connect Faster
Why SnapLogic Elastic Integration?
Modern Architecture
Connected: 300+ Snaps
Productive User Experience
Unified Platform
We can do more in two hours with SnapLogic than we could in two days with traditional solutions.
Discussion and Next Steps
@SnapLogic
Facebook.com/SnapLogic Plus.google.com/+SnapLogic
Learn more at !www.SnapLogic.com !!
Jason Bloomberg
President, Intellyx
@theebizwizard
Send email NOW to [email protected] to download this presentation
Thank You!
Copyright © 2015, Intellyx, LLC