the right data warehouse: automation now, business value thereafter
TRANSCRIPT
![Page 1: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/1.jpg)
Grab some coffee and enjoy the pre-show banter before the top of the hour!
![Page 2: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/2.jpg)
The Briefing Room
The Right Data Warehouse: Automation Now, Business Value Thereafter
![Page 4: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/4.jpg)
Twitter Tag: #briefr
The Briefing Room
! Reveal the essential characteristics of enterprise software, good and bad
! Provide a forum for detailed analysis of today’s innovative technologies
! Give vendors a chance to explain their product to savvy analysts
! Allow audience members to pose serious questions... and get answers!
Mission
![Page 5: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/5.jpg)
Twitter Tag: #briefr
The Briefing Room
Topics
This Month: BIG DATA
May: DATABASE
June: ANALYTICS & MACHINE LEARNING
2014 Editorial Calendar at www.insideanalysis.com/webcasts/the-briefing-room
![Page 6: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/6.jpg)
“ “ The first rule of any technology used
in a business is that automation applied to an efficient operation will magnify the efficiency. The second is that automation applied to an inefficient operation will magnify the inefficiency. -Bill Gates
![Page 7: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/7.jpg)
Twitter Tag: #briefr
The Briefing Room
Analyst: Robin Bloor
Robin Bloor is Chief Analyst at The Bloor Group
[email protected] @robinbloor
![Page 8: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/8.jpg)
Twitter Tag: #briefr
The Briefing Room
WhereScape
! WhereScape is a data warehousing software company
! It offers WhereScape 3D, software for planning and reality-testing data warehousing and business intelligence projects; and WhereScape RED, an integrated development environment used for building, deploying and managing data warehouses and data marts.
! WhereScape RED allows developers to automate the data warehousing life cycle
![Page 9: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/9.jpg)
Twitter Tag: #briefr
The Briefing Room
Guest: Mark Budzinski
Mark Budzinski is the President of WhereScape USA. In this role, Mark sees firsthand the challenges that IT organizations face and their desire to better serve the business community with agile, rapid development of data warehouses and related data driven projects. His career has spanned management positions at Intel, Sequent Computer Systems, RadiSys, and Applied Microsystems. He holds an MBA from the Univ. of Oregon, a Master’s Degree in Computer Science from the Univ. of Southern California, a BS in Industrial Engineering from Lehigh Univ., and is a graduate of The Buckley School of Public Speaking.
![Page 10: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/10.jpg)
Mark Budzinski
President
WhereScape USA, Inc.
WhereScape Bloor Group Briefing
Big Data: Are We There Yet?
April 1, 2014
![Page 11: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/11.jpg)
So What Problem Are We Trying to Solve, Again?
¡ Big data = new insights from new sources to answer old questions
¡ Hadoop is a fabulous new technology, not a religion
¡ Business value is *still* where the holy grail is found
¡ Connecting *all* data, in the right form to the business constituency at the pace the business needs it…isn’t *that* the problem worth solving?
![Page 12: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/12.jpg)
Eh, Do You See That Animal Over There?
¡ IT has its hands full
¡ ETL has we know it, isn’t helpful
¡ The business employs all kinds of tricks to work around IT
¡ We hide the whole mess in human capital ¡ Consultants ¡ Politics ¡ Excuses
![Page 13: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/13.jpg)
WhereScape: What We Believe
¡ Getting the data right is critically important, yet business users can seldom articulate what they want until they see it
¡ Business users/consumers of data must be served at their pace
¡ Automate as much of the process as possible
¡ Standards matter
¡ Document everything; later changes demand it
¡ The historical record that “data warehouses take too long to build and are too hard to change” must evolve to a paradigm whereby IT delivers value continuously, manages ongoing changes cost effectively, and mitigates risk throughout
![Page 14: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/14.jpg)
Some of Our Customers
![Page 15: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/15.jpg)
ETL Is Not The Same Thing As…
Move Data
Transform Data
Load Data From Sources including OLTP, files, Hadoop, etc.
Create Database Objects
such as Models, Views, Facts, Dimensions, Indexes
Documentation
![Page 16: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/16.jpg)
WhereScape Value Proposition
¡ We empower IT organizations to build, deploy, and manage their data in a timeframe and manner that creates utter enthusiasm in the business community
¡ Time to results dramatically decreases - faster
¡ Costs decrease: license and human capital - cheaper
¡ Quality is higher: documentation & transparency - better
¡ Risk is mitigated: automation & methodology – with confidence
By automating development, you get more from your “data investment”
![Page 17: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/17.jpg)
Data Warehouse Automation Software: RED
RED is an Automated Data Warehouse Development Platform That Builds Native Target Database Objects, Documents Them, And Schedules Data To Be Loaded. RED Works Well With ETL Tools, or as an ELT Solution Using Native Loaders (e.g. Teradata TPT)
![Page 18: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/18.jpg)
Automation Use Cases
End-to-End Data Warehouse
Development Tool
Including All ETL
Complement to Enterprise ETL, Used
For Rapid/Agile Build Out of a View or Semantic Layer
Green Field
Clean Up Hand-Written
Code and Scripts
Manage Deployments
Rewrite & Recast Heterogeneous
Database Solutions
Big Data Integration
ELT 2.0
Configuration Management
Semantic Layer
![Page 19: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/19.jpg)
“WhereScape RED’s tight integration with the target database and built-in best practices are empowering our resource-constrained development team to tackle a large implementation that will enable us to quickly deliver value to our institution and members.”
Su Rayburn, Director of Business Intelligence Services
![Page 20: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/20.jpg)
“Our results using WhereScape have been extremely impressive. WhereScape enabled us to design, develop, document and deploy a production-ready solution in 6-8 weeks. Using traditional data warehouse development methods would have taken us 6-8 months.
Ryan Fenner, VP, Data Solutions Architect, Union Bank
![Page 21: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/21.jpg)
“We estimate the development lifecycle is 20-25% of what it was previously when we were hand coding.”
Dan Mosher, Director of Enterprise Data Warehousing
![Page 22: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/22.jpg)
Summary
WhereScape’s approach with data warehouse automation yields customer results that are stunning: faster, cheaper, and more manageable
![Page 23: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/23.jpg)
Twitter Tag: #briefr
The Briefing Room
Perceptions & Questions
Analyst: Robin Bloor
![Page 24: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/24.jpg)
![Page 25: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/25.jpg)
Is the Data Warehouse Dead?
u It’s all about data flow
u The number of data sources is increasing dramatically; some (like the weather) don’t directly relate to corporate data entities
u Inconvenient data structures (documents, text, etc.) make a single database engine an impossibility
u No database product can handle the scale required
![Page 26: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/26.jpg)
Is the Data Warehouse Dead?
u It’s all about data flow, and there needs to be a control point (or several) for that flow
u There needs to be a comprehensive integrated map of all data used by the business
u This means that there needs to be a LOGICAL data warehouse
u Whether there is a single physical data warehouse is a detail of the implementation
![Page 27: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/27.jpg)
Big Data and the Data Reservoir
![Page 28: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/28.jpg)
The Biological System Analog
u Our human control system works at different speeds: • Almost instant reflex • Swift response • Considered response
u Organizations will gradually implement similar control systems
u This suggests a data-flow- based architecture
u Memory is the Data Warehouse
![Page 29: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/29.jpg)
Data Warehouse Design
The design issue:
u In the past a data warehouse design could remain fairly static for a while – it rarely saw dramatic change
u Those days are probably over for many businesses
u The warehouse design process now needs to have a maintenance aspect
u It also needs to embrace Hadoop and think in terms of “logical warehouse”
![Page 30: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/30.jpg)
u How does the typical WhereScape engagement proceed in terms of: product only/training/consultancy?
u What is the typical time frame from project initiation to operating warehouse (green field)?
u What factors impact that time frame?
u What are your customers (who use Hadoop) using it for?
![Page 31: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/31.jpg)
u How would you characterize the role of Hadoop in the data warehouse?
u Do you become involved in database migrations? If so, what are the contexts for such projects?
u Do you have any direct competition?
![Page 32: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/32.jpg)
Twitter Tag: #briefr
The Briefing Room
![Page 33: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/33.jpg)
Twitter Tag: #briefr
The Briefing Room
Upcoming Topics
www.insideanalysis.com
2014 Editorial Calendar at www.insideanalysis.com/webcasts/the-briefing-room
This Month: BIG DATA
May: DATABASE
June: ANALYTICS & MACHINE LEARNING
![Page 34: The Right Data Warehouse: Automation Now, Business Value Thereafter](https://reader033.vdocuments.us/reader033/viewer/2022052602/55a244891a28abfc448b483e/html5/thumbnails/34.jpg)
Twitter Tag: #briefr
The Briefing Room
THANK YOU for your
ATTENTION!
Images borrowed from the Internet: Slide 29: http://evaporatedpast.com/2013/09/07/art-is-never-finished-only-abandoned-leonardo-da-vinci/