wherescape, the pioneer in data warehouse automation software
TRANSCRIPT
![Page 1: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/1.jpg)
THE PIONEER INDATA WAREHOUSE
AUTOMATION SOFTWARE
![Page 2: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/2.jpg)
Datavaultautomationconference – Utrecht– 6October2011
Whythispresentation?
![Page 3: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/3.jpg)
COMPANY BACKGROUND• Founded in 2000 in Auckland, New Zealand
by data warehouse experts• 120+ Employees• US – Global Head Office, Portland• UK – European Head Office, Reading• NZ – Development, Auckland
Supported Targets:
![Page 4: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/4.jpg)
USA:Wells Fargo BankNIKEGE AviationIPC SubwayJuniper NetworksNordstromDelta Credit UnionMed Assets
EuropeTescoVodafoneAONXerox HSBCMAN InvestmentsNetwork Rail Sainsbury’sZurich Insurance Volkswagen
Asia PacificMGM MacauAbano InternationalSingtel OptusEricsson VietnamTelstra AUReserve Bank of AustraliaMinistry of DefenceWestfieldQBE InsuranceEnergy AustraliaAstraZenecaAir New ZealandTelecomVodafoneXero
Vodafone Qatar
ABSA Barclays Bank
GLOBAL CUSTOMER BASE700+ WORLDWIDE
![Page 5: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/5.jpg)
SOME OF OUR CUSTOMERS
![Page 6: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/6.jpg)
WHAT WE DO
Profiles, Plans, DesignsRight.
Builds, Documents, Automates Now.
![Page 7: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/7.jpg)
VALUE PROPOSITION
• 1st integrated development environment (IDE) that manages the entire data warehouse lifecycle (Plan & Build)
• Builds data warehouses 10-100 times faster than a traditional approaches
• Data driven approach de-risks projects and automatically applies best practice whilst auto documenting…
DATA WAREHOUSE AUTOMATION
![Page 8: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/8.jpg)
REQUIREMENTS
DW framework
Profile
Logical Model
Physical Model
DB Architecture
Storage Mgmt
Index Mgmt
OLAP Design
ETL Mapping
ETL Dev
Version Control
Workflow
Deployment
Maintenance
Word/Excel
Mainly in-house solutions
Informatica
Microstrategy
IBM Clear Case
Trillium
AbInitioDataStage
TOAD
PowerDesigner
Enterprise Architect
Cognos
JIRA
SSMS
SSIS
SSAS
SVN
IBM Clear Quest
Change tool
Change tool
Change tool
Change tool
Change tool
Change tool
Informatica
ERwin
DB Management Tools
DataStage
Documentation
TRADITIONAL APPROACH
Over complicatedInefficient
![Page 9: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/9.jpg)
DW Framework
Profile
Physical Model
DB Architecture
Storage Mgmt
Index Mgmt
OLAP Design
ETL Mapping
ETL Dev
Version Control
Workflow
Deployment
Maintenance
Logical Model
Documentation
METADATA
WhereScape RED
WhereScape 3D
THE WHERESCAPE WAY
SimplificationAutomation
![Page 10: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/10.jpg)
MANAGING AN EDW/BI ENVIRONMENTIS CHALLENGING
• Too many development tools & skills
• Siloed with a high cost of change
![Page 11: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/11.jpg)
MANAGING AN EDW/BI ENVIRONMENTJUST GOT EASIER
• One tool, one skillset, low cost of change
• Non-proprietary & Non-disruptive
![Page 12: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/12.jpg)
SQL
• I set-based SQL• Scale with your RDBMS or Big Data platform
• Easy migration path to other technologies
• You’re in control, no black boxes
• Don’t we all talk SQL?
DATA WAREHOUSE AUTOMATION
😀
![Page 13: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/13.jpg)
PROCESS
• Different activities warrant different approaches• Model-driven development vs.• Data-driven development
• Bring the agile back in our profession• Break down the barriers between profiles• Don’t limit yourself to “coding only” activities
DATA WAREHOUSE AUTOMATION
![Page 14: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/14.jpg)
“A 3 year project has now been completed in 6 months thanks to WhereScape and agile development.”
![Page 15: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/15.jpg)
Discovery—Rapidlycreateworkingsolutions,whichareputinfrontofbusinessstakeholdersforreviewinsprintsnolongerthan30days.
Production Build—Becomesanassemblyprocess,closelyfollowingstandardsandcommoditizedimplementationpatterns
![Page 16: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/16.jpg)
Redlineshowscurrentdate
![Page 17: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/17.jpg)
THE DATA QUADRANT MODELRONALD D. DAMHOF
DevelopmentStyle
Systematic
Opportunistic
I II
III IV
Research,Innovation&
Design
“ShadowIT,Incubation,
Ad-hoc,Onceoff”
Push/Supply/Source driven Pull/Demand/Productdriven
DataPush/PullPoint
ContextFacts
![Page 18: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/18.jpg)
SCOPE
• End-to-end• Full life cycle -> identify your bottlenecks
• Analysis: source profiling• DevOps / CI• Test Automation• Documentation
• Any modeling style?
DATA WAREHOUSE AUTOMATION
![Page 19: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/19.jpg)
WHERESCAPE ARCHITECTURE
![Page 20: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/20.jpg)
![Page 21: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/21.jpg)
CLASSIC KIMBALLStar Schema
![Page 22: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/22.jpg)
HISTORICAL ODS + CLASSIC KIMBALLData Store Star Schema
![Page 23: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/23.jpg)
NORMALIZED EDW3NF Star Schema
![Page 24: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/24.jpg)
RAW + BUSINESS DATAVAULTData Vault Data Vault
![Page 25: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/25.jpg)
RAW DATAVAULT + STAR SCHEMAData Vault Star Schema
![Page 26: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/26.jpg)
DATA LAKE + STAR SCHEMAStar Schema
![Page 27: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/27.jpg)
COMPETITION
• Very few automation software packages• Traditional ETL suites• Set of templates• But typical: PPP
DATA WAREHOUSE AUTOMATION
![Page 28: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/28.jpg)
• Teradata is an important platform
![Page 29: WhereScape, the pioneer in data warehouse automation software](https://reader031.vdocuments.us/reader031/viewer/2022022414/587953eb1a28abb1418b6841/html5/thumbnails/29.jpg)