financial services trihug

14
© 2012 Datameer, Inc. All rights reserved. Page 1 © 2012 Datameer, Inc. All rights reserved. Hadoop in Financial Services Adam Gugliciello, Solutions Engineer February, 2012

Upload: trihug

Post on 08-May-2015

1.753 views

Category:

Technology


0 download

DESCRIPTION

Hadoop based applications are becoming critical in the financial services arena for the analysis and correlation of large volumes of structured and unstructured data. In addition, the Dodd-Frank Act signifies the largest US financial regulatory change in several decades and requires much greater transparency on financial data. In this session, we will answer common questions and demonstrate use cases in how Hadoop and Datameer help with asset management and risk management, fraud detection and data security. Leave this session knowing about:Financial data and Hadoop. What data lends itself to Hadoop? What doesn’t?Benchmarks from real-world uses of Hadoop in financeHow to effectively migrate, manage, and analyze financial data using Hadoop

TRANSCRIPT

Page 1: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 1

© 2012 Datameer, Inc. All rights reserved.

Hadoop in Financial Services

Adam Gugliciello, Solutions Engineer

February, 2012

Page 2: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 2

Data Warehouse

Expensive

ETL

Slow

Business Intelligence

Expertise

Hadoop

Economical

Raw Load

Fast

Drag and Drop,Spreadsheets

Self Service

A Different Approach…

Page 3: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 3

Internal Asset MovementInternal Asset Movement

Focus: Institutional RiskIdentify departmental asset movement

• Actual “Rogue Trader” identified using Datameer

Craft an early-warning system for future detectionAggregate sources and correlateNet result: reduced risk

Page 4: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 4

Client Risk ProfilingClient Risk Profiling

Focus: Bank Assets• Identify profile-scoring features in loans and mortgages• Build qualifying models with Datameer• Test models against existing data• Provide recurring reports

Focus: Client Assets• Monitor risk across product offerings for all client assets• Develop common base of client characteristics for models• Analyze risk types: default, liquidity, attrition risk• Monitor: transactions, web, email, chats and call logs (all of the

different ways clients interact with the bank)Net result: correlation and increases agility

Page 5: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 5

SLA AnalyticsSLA Analytics

Focus: Infrastructure PerformanceCompanies are using Datameer to aggregate all logs to HadoopTransform log-data into actionable insight into IT systems performanceMeasure conformance to existing SLA’sReduce the batch windowNet result: reduced costs

Page 6: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 6

Security & FraudSecurity & Fraud

Focus: Client protectionRun statistical models against customer profilesDetect anomalies with pattern-recognition algorithmsIdentify and investigate identity theftDetect and prevent fraudProtect customer assetsNet result: protected customers

Page 7: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 7

Data Quality & ProfilingData Quality & Profiling

Focus: ProfilingUse profiling techniques to assess and score of client accountsRun complex data quality rules and modelsBuild exception reporting

Focus: Data QualityEnable data stewards to run ad hoc analysis and dashboardsDrive iterative processes to refine dataNet result: reduce risk and cost

Page 8: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 8

Security InfrastructureSecurity Infrastructure

Focus: infrastructure protectionMonitor external intrusionsDetect suspicious trafficView security aggregatesCorrelate disparate attack sourcesNet result: increased security

Page 9: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 9

Dark Pools and Cost Savings

Focus: Trade and Partner Analyses•Financial Institutions often hold large positions that they want to trade in ways that don't affect public markets•Dark pools are private venues that enable trading for this practice•It’s a big data problem:

• Large volumes• High velocity• Low visibility

Page 10: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 10

All talk, little action

indication of interest,action (quote/buy/sell/fulfill),“symbol”,“quantity”,“price”

Footer

HeaderFinancial Information eXchange (FIX)

Page 11: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 11

Order Family Analysis

sell

cancel

Time

Instrument

Vendor

buy

Analyze Order Families

Page 12: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 12

A Second in the life…

Page 13: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 13

Cut through the noise

Page 14: Financial services trihug

© 2012 Datameer, Inc. All rights reserved. Page 14

Questions and Answers….