archiving is a no-brainer - bloor analyst and rainstor executive discuss

RRain

1

Archive is a No Brainer

Speakers & Topics

2

Philip Howard, Research Director Bloor

Deirdre Mahon, VP Marketing RainStor

§  What is an Archive §  Industry Trends §  Key Requirements §  Best Prac>ces §  Customer Examples

Database archiving

Philip Howard Research Director, Bloor Research

telling the right story Confidential © Bloor Research 2013

Agenda

" What is database archiving?

" Why is it increasingly important?

" What sort of features do you need?

" What trends do we see and what differentiates products?


What is database archiving?

Online, low cost, highly compressed storage that requires no change to access methods

Not back-up Not e-mail archive

Not CSV or XML files


Two scenarios

Access support for originating application

SQL support


Why is database archiving increasingly on the agenda?

" Availability of cloud-based archiving

" Availability of Hadoop/HDFS-based archiving

" Synergy with data migration


What you need 1

You need to know what data to archive


What you need 2

You don’t just archive a record, you archive all the other data related to that record – to preserve referential integrity – which means discovering

and understanding business entities in their entirety.


What you need 3

" High compression rates " Low cost storage


What you need 4

Loading and

access

Without indexes


What you need 5

Information Lifecycle Management not Industrial Light & Magic


What you need 6


The trend towards Hadoop

But Hadoop/HDFS is insufficient on its own because the compression is not good enough

and neither is the security


Other trends

" Compression will (almost) become commoditised (but not yet)

" Deployments will built on top of Hadoop/HDFS or in the cloud (or both)

" In data warehousing environments data virtualisation (federation) will be used to interconnect warehouses, marts and archives

" Differentiation will focus on: " Ease of establishing what data to archive " Performance – both for loading and retrieval


Conclusion

" Database archiving looks more and more like a mandatory activity

" DIY approaches won’t cut it because of a) the work involved and b) because you won’t get either the cost savings or performance you could do

" Deployments will increasingly be on low-cost clustered hardware or in the cloud

RainStor®

18

Create Value from Your Historical Data and Meet Regulatory Demands.

The Data Archive

RainStor® -‐ Proven

19

20 of World’s Largest Communica>ons

Providers

15 Strategic Solu>on & Technology Partners

10 of World’s Biggest Banks & Financial

Ins>tu>ons

Drivers & Business Challenges Solved

20

10X ReducGon (Compared to tradi>onal) Cost

Deployed in 90 Days (End-‐to-‐end Solu>on)

Complexity

Meets & Exceeds (Industry & Regulatory) Compliance

Historical AnalyGcs (Standards-‐based)

Create Value

Archive Solu>ons Analy>cal Archive Compliance Archive

21

Comply

Analy>cal Archive: End-‐to-‐end

22

QUERY/ ANALYZE

SQL BI Tools; Hive, MapReduce

SCALE -‐ Any PlaWorm

COMPRESS LOAD/ VALIDATE

Billions Records/Day

10-‐40X (90%+)

AVAILABILITY ReplicaGon

DW Source

Move RETAIN /DISPOSE

Rules Based

IN STORE QUERY GOVERN

SECURE -‐ Enterprise-‐grade

Analy>cal Archive -‐ Key Capabili>es

23

QUERY GOVERN

§  Standard SQL 92, 99 §  MapReduce, Pig, Hive §  BI Tools

§  Rules based Data Disposi>on §  WORM (17a-‐4) §  Legal Hold §  Record-‐level Reten>on §  Audit Trail

DATA IN

§  Works with standard ETL §  ODBC/JDBC Compa>ble §  FastConnect™ for Teradata §  Validate -‐ Fingerprint

STORE

§  Compression -‐ 20-‐40X §  Immutable Data Model §  Encryp>on & Masking §  Authen>ca>on §  Schema Evolu>on

CAPACITY BUY-‐BACK

INSTANT ACCESS NO FINES

SAVE YOU MONEY

Fits with Your Enterprise

24

EDW’S

Deployment PlaWorms

Scale-‐out NAS HDFS

Cluster / DAS

Cloud

Worm

Teradata -‐ Analy>cal Archive Solu>on

25

QUERY/ ANALYZE

SQL BI Tools; Hive, MapReduce

SCALE -‐ Any PlaWorm

COMPRESS LOAD/ VALIDATE

Billions Records/Day

10-‐40X (90%+)

AVAILABILITY ReplicaGon

TERADATA

FastConnect™ RETAIN /DISPOSE

Rules Based

GOVERN

SECURE -‐ Enterprise-‐grade

FastForward™

SEC 17a-‐4(f) Compliance Archive Requirements

26

Records stored in non-‐eraseable media (WORM)

Recording process must be verifiable

Fully Accessible to AuthoriGes & Backed-‐up

Records should be Recognizable & IdenGfiable

Downloadable to any acceptable medium

27

Global Financial Services Lower Compliant Data Reten>on Costs by a Decimal Point! Challenges §  Cost: Data volumes in disparate trading

applica>ons growing at 70-‐100% / Year -‐ Storage costs rising @ 60% / Year

§  Compliance: Must provide performant EBS and other queries for SEC

SoluGon §  A RainStor Archive for storing and repor>ng

against historical trade data §  13 years of history loaded from Sybase IQ §  Daily feed from trading applica>on to RainStor §  Runs on low-‐cost NAS Tier 3 storage and VMs §  RainStor completely replaced Sybase IQ

ü  90% cost savings -‐ $5M ROI ü  6 Projects live -‐ 13 more in

progress.

90% Storage Cost Reduc>on

“ It’s like shrink-wrapping your data…forever!” – VP, Technology

Benefits ü  30X Data Compression ü  3X Faster Query Compared to Sybase

28

Retain Cri>cal Analy>cs Data at Lowest Cost

§  Ini>ally 60TB Offload Business & Compliance Queries

§  Run Na>vely on Hadoop SQL + MapReduce

40X Compression

RAINSTOR SOLUTION: Offload Historical Data from Teradata to RainStor

Meets SLAs for Business Query Savings on TD Licenses

Capacity Buy-‐Back -‐ $Millions Saved on Sopware & Hardware

Enterprise DW

FastConnect™ Dell Servers R720s

Cloudera Hadoop

400TB

ü ü ü

§  Gone through the pain so you don't have to. –  Crea>ng an archive is not easy! –  RainStor Makes it simple, cost effec>ve, compliant-‐ready & fast to deploy

§  Solving archiving problems for world leaders -‐ 10 years of proven experience. –  Enabled customers to deploy cost efficiently without compromise –  Support and service rated as world class by our customers

§  Technology soluGons that create business value. –  Transforms archiving to be a strategic asset.

Why RainStor®

Thank You

30

Archive is a No Brainer

archiving is a no-brainer - bloor analyst and rainstor executive discuss

Software

conclusion database

based archiving synergy

availability of cloud

data migration

store query

challenges cost

trends compression

cost savings