denodo datafest 2017: lowering it costs with big data and cloud modernization
TRANSCRIPT
Tekin Mentes
Data Architect
LOWERING IT COSTS
WITH BIG DATA AND
CLOUD MODERNIZATION
LOGITECH CONFIDENTIAL: NOT FOR DISTRIBUTION
ANALYTICS AT SCALESUPPORTING OUR GROWING BUSINESS
ANALYTICS AT SCALE – THE BEGINNING
• Create a decentralised self-service analytics environment for traditional business reporting and
analytics (Descriptive and Diagnostic Analytics). Becomes a purely EXPLICIT experience.
• Allowing for a centralised, cross-functional shared advanced analytics service tasked to deliver Predictive and Prescriptive analytics to the organisation.
• A minimal investment, with leveraged return.
Mode ITraditional Analytics
Mode IIModern Analytics
Source: Gartner
Sou
rce:
Fir
stm
ark
Structured Semi-Structured Unstructured
Bat
ch
Dat
a V
elo
city
Re
al-T
ime
Social Media Sentiment
Predictive Analytics
Demand ForecastingPrice violations on
Retail sites
Data Warehousing Text Mining
Security Video Analysis
Retail Data scrapping
Machine Learning
ioT
Multi site ERP
Marketing Funnel
Sales Channel Mgmt
Smart Home
Natural Language Processing (NLP) VR Gaming
Device Events
CHALLENGES
Scalability Agility
Cost Adaptation
Business – determine what questions to askIT – Structures the data to answer the question
IT – Delivers a platform to enable creative discoveryBusiness – Explores what questions could be asked
Business Intelligence
Data Discovery
Things business knows
Things business might not know
Questions businessis unaware of
Questions known to business
LOGITECH ANALYTICS
Cloud Analytics
Data Virtualization
Abstract access
A single semantic repository
Tool Agnostic Architecture
Centralized, governed
secured data layer
Scalable
Efficient
Reliable
Managed
Cloud empowers IT organizations to redefine the way data services are produced and delivered
“By 2018, organizations with data virtualization capabilities will spend 40% less on building and managing data integration processes for connecting distributed data assets.” - Gartner
REFERENCE ARCHITECTURE
Metadata Management, Data Governance, Data Security
Cost and Usage Pattern
Sensor DataMachine Data LogsSocial DataClickstream DataInternet DataImage and Video
Cloud Applications
EnterpriseApplications
Data Sources Data Insights
Self-Service /Data Discovery
Reporting
Predictive AnalyticsStatistical AnalyticsSentimental AnalyticsText AnalyticsData Mining
Data VirtualizationData Collection
Real-Time Data Access (On-Demand / Streaming)
CDC
ETL
EDW
ODS
Cloud DW
NoSQL
Data Warehouse
File Storage (S3)
Batch DW Spark SQL
NoSQLSearch Search
Big Data
In-Memory
AnalyticalAppliances
Real-Time Decision Support
Alerts
Scorecards/Dashboards
SOLUTION ARCHITECTURE
Amazon Web Services
AWS GlacierAWS S3 AWS Redshift
Pentaho DI
Pentaho Operations Mart
Cloudwatch SNSIAM Cloudtrail EMR SPARK Python / R
AWS RDS
Denodo Data Virtualization
Tableau Pentaho BA Data Interfaces Web ServicesOBIEE CUBES
Snowflake
Text Analytics
BENEFITS
• Embraced cloud as a model for achieving innovation through increased efficiency, reliability
and agility, enabling broader audience to consume IT services via self-service
• Reusability and template development, rapid innovation within governance/security
structure, balanced costs, risks and service levels
• More business insights by leveraging all data, empower people with instant access to all
the data they want, the way they want it.
• Respond faster time to solution than traditional data integration – Speed to Market
• Array of connection options from structured to unstructured data
• Business Layer, enabling data consistency through single object, multiple consumers
30-Oct-17LOGITECH CONFIDENTIAL: NOT FOR
DISTRIBUTION12
DATA VIRTUALIZATION – ROADMAP
LESSONS LEARNT
• Paradigm shift – Traditional RDBMS to Columnar Database
• Denodo - Data Delivery Platform
• Tools will change, Data will stay – Need a platform that keeps all together
• Need of Governance for Modern Analytics
• IT is enabler, not producer!
