big data on a small budget
Post on 19-Oct-2014
558 views
DESCRIPTION
A recent presentation by Maximal BA for SAP CrystalGo.TRANSCRIPT
Big Data on a Small Budget.Chris Jones, Maximal BAJune 13, 2013
Chris Jones, Maximal BAJune 13, 2013
Big Data on a Small Budget with SAP Sybase IQ and SAP Crystal Server Analytics Edition.
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 3
Agenda
• Introduction
• What is Big Data?
• SAP Crystal Server Analytics Edition
• SAP Sybase IQ
• SAP Sybase Portfolio – Additional Business Opportunity for ARP Partners
• SAP Sybase Portfolio – Success Stories
• Positioning
• SAP Real-Time Data Platform
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 4
Introduction
Chris Jones
Maximal BA
www.maximal-b-a.com
Leading independent provider of SAP Database and Technology solutions.
What is Big Data?
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 6
Data DoublesEvery 18 months
80% of EnterpriseData Is Unstructured
Information Is a Strategic Corporate Asset
An Information Explosion is Driving Change
Web
Data Marts
Enterprise Applications
Spreadsheets
Data Warehouses
Databases
Events
© 2013 SAP AG or an SAP affiliate company. All rights reserved.
Thank You!
Contact information:
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 8
Dat
a V
olu
me
Customer Data
Automobiles
Machine Data
Smart Meter
7.9 Zettabytes
!Point of Sale
Mobile
Structured Data
Click Stream
Social Network
Location-based Data
Text Data
IMHO, it’s great!
RFID
Future20152011
Large volumes (petabyte is normal)
VOLUME
Fast collection, processing & consumption
VELOCITY
Multiple data formats
VARIETY
Clean, coherent information
1.8 Zettabytes
Competitive differentiator for business
VALIDITY
VALUE
Big Data offers New opportunities
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 9
Introducing: SAP BI Analytics Edition
Analys
is
Mod
eling
Tran
sform
Load
CDC
Calcula
te
Mod
els
Prese
ntat
ion
Discov
ery
Answers
IQ
Sybase IQ
2010 SAP-Sybase Confidential
Data Sources e.g. Oracle 11g, IBM DB2, ASE,Microsoft SQL Server ….
Heter
ogen
eous
Data
Operational Data
SAP BI Analytics Edition
A Complete Best Of Breed Stack Now In One Complete Package
Extrac
t
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 10
SAP Crystal Sever Analytics Edition.
The SAP Crystal Server analytics edition is a new offering that takes the existing SAP Crystal solutions portfolio to a whole new level and aligns it to SAP’s data management strategy by bundling them with SAP Sybase IQ and SAP Data Integrator.
The Crystal Server analytics edition includes the following:-
• SAP Crystal Server
• SAP Data Integrator
• SAP Sybase IQ
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 11
DiscoveryReporting
Dashboards
BI Analytic EditionsBest of breed for organizations of all sizes
DiscoveryReporting
DashboardsAnalysis
BI Platform16,17,18
(Single server full use)
Edge Data Services†RUNTIME10,11,12,13
(Max 3 CPU)
Sybase IQ EnterpriseRUNTIME14,15
(Max 16 cores)
BI Platform7,8,9
(Single server full use)
Data IntegratorRUNTIME4,5,6
(10 CPU / instance)
Sybase IQ EnterpriseRUNTIME1,2,3
(32 cores/instance)
BI Platform(Full use)
DiscoveryReporting
DashboardsAnalysis
SAP BusinessObjects BI suite, analytics
edition
SAP BusinessObjects BI platform, analytics
edition
SAP Crystal Server, analytics edition
SAP BusinessObjects BI, Edge analytics
edition
A la carte
Data IntegratorRUNTIME4,5,6
(10 CPU / instance)
Sybase IQ EnterpriseRUNTIME1,2,3
(32 cores/instance)
BI Platform(Full use)
Edge Data IntegratorRUNTIME 4, 5, 6
(Max 3 CPU)
Sybase IQ EnterpriseRUNTIME 22, 23
(Max 16 cores)
Industry Content Industry Content Industry Content Industry Content
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 12
SAP Sybase IQ: Market Leader for Extreme-Scale EDW and Analytics
High performance analytics server Columnar RDBMS (stores data in columns-
versus rows) Optimized for managing and accessing massive
amounts of data for analytics (versus transactions)
Accelerates analytics and reporting Up to 1000-times faster than traditional
transactional databases Handles structured and unstructured data High compression and low TCO Highly scalable grid architecture
• 2500+ customers with over 4800+ installations worldwide
• Used by twice as many companies as the next leading provider
• Patented data compression dramatically reduces data storage requirement; cuts TCO
• Only column-based solution to support full text search, in-database analytics, and federated analytics
• 96%+ customer satisfaction rates
• Leader, 2012 Gartner Magic Quadrant for Data Warehouse DBMS
SAP Sybase IQ Facts
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 13
Conventional RDBMS
SummariesAggregates
1 – 2 TB
Indexes0.5 – 3 TB
Base table“RAW data”no indexes0.9 – 1.1 TB
2.4-6 TB0.25 - 0.9 TB
Base table: 0.2 - 0.5 TB
Indexes: 0.05 - 0.3 TB
Summ/Aggr: 0 - 0.1 TB
INPUT DATA:
1 TBSource: flat files,
ETL, replication, ODS
LOAD LOAD
Lowest TCO from Data Compression
Sybase IQ stores data in 40% to 90% less space
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 14
Sybase IQ - Smarter Answers Now
Speed and Flexibility Up to 1000-times faster than traditional
transactional databases High-speed analytics performance handles
volumes of ad-hoc queries in “real-time” Simple and complex analytics on structured and
unstructured data
Lower TCO Compression reduces volume by up to 70% Less storage and maintenance resources Easy to learn and use requiring minimal training
Mature and Proven 2200 customers with over 4500 deployments Consistently ranked as data warehouse market
leader by leading analysts
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 15
2200 + Customers
96% Customer satisfaction rating
4500 Installations
SAP Sybase IQ: Market Leader for Extreme-Scale EDW and Analytics
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 16
SAP Sybase Products – Authorized Reseller Program
• SAP Sybase Adaptive Server Enterprise
• SAP Sybase SQL Anywhere
• SAP Sybase PowerDesigner
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 17
SAP Sybase Adaptive Server Enterprise
Key Features
• High performance ‒ Gain predictable, consistent, and scalable applications
• Data compression ‒ Reduce storage requirements for relational and unstructured data
• Administration‒ Simplify database monitoring, management, and maintenance
• SAPs strategic vision for business applications fully encompasses the underlying SAP Sybase ASE database
Business Benefits
• Faster processing with millions of transactions per minute on large and growing databases
• Low total cost of ownership through efficient use of storage, processors, and staff resources
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 18
SAP Sybase SQL Anywhere
• Mobile Data Management Solution
• Design and deploy custom database-powered applications that automatically synchronize business data to thousands of mobile computing devices and remote offices
• Harmonize your data securely, reliably, and with zero administration
• Empower users with access to vital data – anytime, anywhere, on any device
• Streamline rollouts with automated deployment and rapid application development
• Support for all leading computing platforms
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 19
SAP Sybase PowerDesigner
SAP Sybase PowerDesigner is:
1) A key component of the sap real-time data platform
2) A standalone product with open support for all major platforms worldwide
• Deliver previous enhancements as promised
3) Key to heterogeneous alignment with SAP RTDP and SAP Business Suite
• Net new development of capabilities benefiting SAP & Non-SAP alike
RTDP(Next generation
applications)
SAP ERP
OPEN(New & Legacy Applications)
SAP Sybase PortfolioCustomer Success Stories
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 21
SAP Sybase IQ & Business Objects
“Combining SAP BusinessObjects and SAP Sybase IQ is the perfect solution to support our business intelligence vision. In the business intelligence system, the database is the least visible but most important part of the solution and SAP Sybase IQ has demonstrated its superiority in that regard in our Capital Markets business”Tobias Schmitz-Harbauer, Head of the Performance Analysis, Department of the Capital Markets Business, Landesbank Berlin AG
Business Challenges Consolidate all capital market department information into a single data store
that represented a single version of the truth and that could also be accessed by management, traders, sales people and others when needed
Technical Challenges Create a single management information system that would enable users to
generate reports, run queries, create interactive dashboards, and add or structure data in other ways to make optimal business decisions and provide first-rate client service.
Benefit Provides a single source for immediate, accurate and comprehensive overviews
of Capital Markets sales and investments
Query response times 45 times faster than previous RDBMS-based system
Simplifies and speeds data loading into analytics data stores
Reduces maintenance requirements
Reduces costs by decreasing required storage space by 5 times
Improves client service due to system’s rapid response time
“ ”
SingleManagement System
45x Faster
query response time
Reduced required storage by
5x
LandesBank Berlin
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 22
SAP Sybase PowerDesigner.
• Industry Healthcare – medical technology development and manufacturing
• Created a centralised Enterprise data model – globally available
• Business Analysts can directly locate and access information they need
• Freed up the BI data architects to focus on business intelligence development rather than end-user support
• Over 150 source systems
• “Getting the right information into the hands of the people who need it as quickly as possible is a key IT goal. SAP Sybase PowerDesigner enables us to do that.”
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 23
SAP Sybase SQL Anywhere.
TicketMaster
Challenge
• Ticketing, payment and customer relationship management solution
• Systems are deployed into client sites with small or non-existent IT staffs
• Requires a database to power its solution that could be deployed and managed with minimal administration
• However, the high demands of the application meant it was not acceptable that this would come at the expense of performance or features.
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 24
SAP Sybase SQL Anywhere.
TicketMaster
Solution
• SQL Anywhere – powerful & low maintenance database solution
• Ease of administration enables Ticketmaster to install the ticketing systems directly into client sites that have non-existent IT
Key Benefits
• Increased revenue via improved seat management,
• Enhances customer experience through individual seat-level ticket selection using advanced database locking
• Reduces fraud through optimization of ticket tracking
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 25
SAP Sybase Adaptive Server Enterprise
India national Rail System
HMS Technologies. Military Logistics
MIQS - Medical Software
European Southern Observatory
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 26
Positioning
SAP Sybase ASE - Online Transactional Processing
SAP Sybase SQL Anywhere – Mobile Data Applications
SAP Sybase IQ – Business Intelligence, ‘Big Data’
SAP Sybase PowerDesigner - Collaborative Enterprise Modelling Solution
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 27
In-Memory / Real-time
SAP Real-Time Data Platform
Stream Analytics Mobile & Embedded
Open Data Warehouse
High Performance OLTP
Information and Real-time Data Movement
Inte
gra
ted
M
od
eli
ng
an
d
Me
tad
ata
Inte
gra
ted
Sy
ste
ms
M
an
ag
em
en
t an
d
La
nd
sc
ap
e
Common programming APIs
SAP Real-time Data PlatformProduct portfolio
SAP Real-Time Data Platform use cases● Customer choice to run SAP Business
Suite, SAP Sybase ASE, or SAP HANA
● Database for mission-critical custom-built applications
● Enterprise data warehousing (including real-time replication)
● Data synchronization between enterprise and mobile databases
● Operational analytics and continuous intelligence
● Data enrichment and quality governance
● Data federation and retention (including near-line storage)
● Big data performance (including Hadoop, unstructured information integration, and text analysis)
Business warehouse
Mobile appsBusiness
apps
SAP HANA
SAP Sybase ESP
SAP Sybase SQL Anywhere
Business intelligence
SAP Sybase IQSAP Sybase ASE
SAP Data ServicesSAP Sybase Replication Server
SA
P S
yb
as
e
Po
we
rDe
sig
ne
rS
AP
In
form
ati
on
Ste
wa
rd
SA
P S
olu
tion
Ma
na
ge
r
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 28
Thank-you
Chris Jones
Maximal BA
www.maximal-b-a.com