improve the health of your big data

23
QuerySurge TM Webinar: Improve the Health of your Data built by Speakers Laura Poggi Director of Marketing Bill Hayduk Founder / CEO Martin Henry- Lester Product Specialist the Data Testing solution for Big Data

Upload: rtts

Post on 29-Jun-2015

116 views

Category:

Software


1 download

DESCRIPTION

How healthy is your data? Data health is a multi-dimensional indicator of the integrity and effectiveness of your organization's most valuable asset. It is something that is increasingly difficult to be sure of when your data is growing in size and complexity, and when your team is becoming more dispersed. Get insight into your Big Data like never before with the Data Health Dashboards in QuerySurge, the leading Data Testing software. These dashboards will enable you to easily see trends in both your data and your team's performance. In this webinar, you will learn how to: - Improve your data quality - Reduce your costs & risks - Accelerate your data testing cycles - Share information with your team - Gain a holistic view of the health of your data

TRANSCRIPT

Page 1: Improve the Health of Your Big Data

QuerySurgeTM

Webinar:Improve the

Health of your Data

built by

Speakers

Laura PoggiDirector of Marketing

Bill HaydukFounder / CEO

Martin Henry-LesterProduct Specialist

the Data Testing solution for Big Data

Page 2: Improve the Health of Your Big Data

built by

QuerySurge ™

about FACTS

Software:developers of QuerySurgeFounded: 1996

Locations:

New York (HQ), Atlanta, Philadelphia, Phoenix

Primary expertise:Software quality & testing services and solutions

Customer profile:Fortune 1000 & mid-size600+ customers

Strategic Partners:IBM, Microsoft, HP, Oracle, Teradata, HortonWorks

RTTS is the leading provider of software quality for critical business systems

QuerySurgeTMthe developers of

Page 3: Improve the Health of Your Big Data

built by

QuerySurge ™

Current Data Trends

Page 4: Improve the Health of Your Big Data

Data Impact in Business

Walmart handles > 1 million customer transactions every hour.

Facebook handles 40 billion photos from its user base.

Google processes 1 Terabyte per hour

Twitter processes 85 million tweets per day

eBay processes 80 Terabytes per day

built by

QuerySurge ™

Page 5: Improve the Health of Your Big Data

“Data warehouses are more critical than ever to business operations. Their value keeps growing because they represent a company’s crown jewels.”

- Forbes

built by

QuerySurge ™

Current Data Trends

Data WarehousesTechnologies: traditional vendors Oracle, IBM, Microsoft, Teradata, SAP, other

Page 6: Improve the Health of Your Big Data

built by

QuerySurge ™

Current Data Trends

“85% of data is coming from net-new data sources” (mobile, social media, web, etc.)- Hortonworks CEO Rob Bearden

“Analysts estimate enterprise data growth of 50x y-o-y through 2020” -Hadoop Summit 2014

Solution: Big DataTechnologies: Hadoop, NoSQL, In-Memory DB

Large Data growth

Page 7: Improve the Health of Your Big Data

Relational DB & Data Warehousing

Source Data

@

BI, Analytics & Reporting

Ingestion

built by

QuerySurge ™

Sample Use Case: New Data Architecture

Page 8: Improve the Health of Your Big Data

built by

QuerySurge ™

The Bad Side of Data

Page 9: Improve the Health of Your Big Data

built by

QuerySurge ™

Page 10: Improve the Health of Your Big Data

Strategic Decisions based on BI (may) = $competitive advantage$but…

Strategic Decisions based on Bad Data (will) = a loss of $millions$

“Poor data quality cost companies $8.2 million annually…25% reported that bad data was costing them more than $20 million every year…4% put the figure up to $100 million”

- Gartner survey

built by

QuerySurge ™

The Business Effect of Data

“Most companies estimate they're analyzing a mere 12% of the data they have.”- Forrester Research study

these companies are using BI to provide a competitive advantage…

Page 11: Improve the Health of Your Big Data

built by

QuerySurge ™

The SolutionTest & Monitor

the Health of Your Datawith

QuerySurge

the Data Testing solution for Big Data

Page 12: Improve the Health of Your Big Data

What is QuerySurge ™?

the collaborative Data Testing solution

that finds bad data & provides a holistic view

of your data’s healthData Testing

built by

the Data Testing solution for Big Data

Page 13: Improve the Health of Your Big Data

Improve the Health of your Data

• Reduce your costs & risks

• Improve your data quality

• Accelerate your testing cycles

• Share information with your team

with QuerySurge ™ you can:

built by

QuerySurge ™

Page 14: Improve the Health of Your Big Data

QuerySurge Finds Bad Data

SQL

SQL

SQL

SQL

SQL

SQL

QuerySurge pulls data from data sources QuerySurge pulls data from target data

store QuerySurge compares data quickly QuerySurge populates data widgets,

reports

How?

widgets, reports

built by

QuerySurge ™

Page 15: Improve the Health of Your Big Data

QuerySurge™ Architecture

Web-based… Installs on...

Linux

Connects to…

…any JDBC compliant data source

built by

QuerySurge ™

Page 16: Improve the Health of Your Big Data

the QuerySurge advantage

Automate the testing effort kickoff, tests, comparison, auto-emailed results

Speed up testing up to 1,000 x faster

Schedule test runs when you need them run immediately, periodically, or after an event

Test across different platforms data warehouse, Hadoop, NoSQL, database, flat file, XML

Collaborate Data Health dashboard, shared tests & reports

Verify more data verifies up to 100% of all data

built by

QuerySurge ™

Page 17: Improve the Health of Your Big Data

Design Library• Create Query Pairs (source & target SQLs)

– Create by writing SQL– Create visually with Data Wizards

QuerySurge™ Modules

Scheduling Build groups of Query Pairs Schedule Test Runs

‒ Run now‒ Run every Friday at 11pm‒ Automatically run after ETL job

built by

QuerySurge ™

Page 18: Improve the Health of Your Big Data

Deep-Dive Reporting Examine and automatically

email test results

Run Dashboard View real-time execution Analyze real-time results

QuerySurge™ Modules

built by

QuerySurge ™

Page 19: Improve the Health of Your Big Data

New Module to Monitor your Data’s Health

built by

QuerySurge ™

Data Health Dashboard• view data reliability & pass rate

• add, move, filter, zoom-in on any data widget & underlying data

• verify build success or failure

Page 20: Improve the Health of Your Big Data

built by

QuerySurge ™

individual Data Widgetsadd, drop, move, filter, print, zoom-in, zoom-out on

any widget & underlying data

New Module to Monitor your Data’s Health

Page 21: Improve the Health of Your Big Data

built by

QuerySurge ™

Smith, Steve

more Data Widgetsadd, drop, move,

filter, zoom-in, zoom-out on any

widget & underlying data

New Module to Monitor your Data’s Health

Page 22: Improve the Health of Your Big Data

Collaboration

Testers - functional testing - regression testing- result analysis

Developers / DBAs- unit testing- result analysis

Data Analysts- review, analyze data - verify mapping failures

Operations teams - monitoring- result analysis

Managers- oversight- result analysis

Share information on the health of your data

built by

QuerySurge ™

Page 23: Improve the Health of Your Big Data

Contact us if your team would like:

(1) a Trial in the Cloud of QuerySurge, including self-learning tutorial that works with sample data for 3 days or

(2) a downloaded Trial of QuerySurge, including self-learning tutorial with sample data or your data for 15 days or

(3) a Proof of Concept of QuerySurge, including a kickoff & setup meeting and weekly meetings with our team of experts for 30 days

http://www.querysurge.com/compare-trial-options for more information, Go here

QuerySurge

built by

QuerySurge ™

TRIAL IN THE CLOUD

the Data Testing solution for Big Data