analyze telecom fraud at hadoop scale

13
Page 1 Diyotta, Inc. All Rights Reserved Analyze Telecom Fraud at Hadoop Scale 29 th June 2016 Sanjay Vyas Co-founder & COO, Diyotta

Upload: hadoop-summit

Post on 07-Jan-2017

249 views

Category:

Technology


4 download

TRANSCRIPT

Page 1: Analyze Telecom Fraud at Hadoop Scale

Page 1

Diyotta, Inc. All Rights Reserved

Analyze Telecom Fraud at Hadoop Scale

29th June 2016

Sanjay Vyas

Co-founder & COO, Diyotta

Page 2: Analyze Telecom Fraud at Hadoop Scale

Page 2

Diyotta, Inc. All Rights Reserved

Telecom-Relevant Glossary

• CDR – Call Detail Record

• Any phone call generates a CDR

• IPDR – IP Detail Record

• Any internet browsing activity generates an IPDR

• IVR – Interactive Voice Response

• Automated telephone response system usually for typical queries

Page 3: Analyze Telecom Fraud at Hadoop Scale

Page 3

Diyotta, Inc. All Rights Reserved

Fraud in Telecom

Global Mobile Industry

$2.2T

Revenue Losses due to

Fraud

$46.3B

Reference: http://www.argyledata.com/files/Telecom-Fraud-101-eBook.pdf

Page 4: Analyze Telecom Fraud at Hadoop Scale

Page 4

Diyotta, Inc. All Rights Reserved

A Day In Life of Telecom Data (Fraud Use-Case)

Source Systems

Ingestion Pipelines

Target Data Sets

Fraud Analysis

Minataur

Page 5: Analyze Telecom Fraud at Hadoop Scale

Page 5

Diyotta, Inc. All Rights Reserved

Legacy State for Fraud Analytics

Monolithic Script Based file Ingestion

MinataurFraud Application

• Limited capacity for processing

• Cannot Scale for Volume/Velocity

• Cannot do on-demand real-time Analytics

Page 6: Analyze Telecom Fraud at Hadoop Scale

Page 6

Diyotta, Inc. All Rights Reserved

Business Challenges

• Business not able to

• analyze IPDR Data due to the sheer

volume

• ingest streaming data from IVR

systems for fraud analysis

• Perform on-demand real-time fraud

analytics for deeper insights

Page 7: Analyze Telecom Fraud at Hadoop Scale

Page 7

Diyotta, Inc. All Rights Reserved

IT Challenges with Hadoop Adoption

• Skill Gap

• Limited in-house expertise on evolving technologies and keep up the pace

• Enterprise Standards

• Manual coding suffers from quality/maintenance issues and is inconsistent

• Scalability across data and technology

• Real-time, social media, multi-processing engines

• Data Lineage

Page 8: Analyze Telecom Fraud at Hadoop Scale

Page 8

Diyotta, Inc. All Rights Reserved

Solution Components

Page 9: Analyze Telecom Fraud at Hadoop Scale

Page 9

Diyotta, Inc. All Rights Reserved

Solution Architecture for Fraud Use-Case

Page 10: Analyze Telecom Fraud at Hadoop Scale

Page 10

Diyotta, Inc. All Rights Reserved

Diyotta Modern Data Integration Platform

Page 11: Analyze Telecom Fraud at Hadoop Scale

Page 11

Diyotta, Inc. All Rights Reserved

Page 11

Diyotta, Inc. All Rights Reserved

Diyotta Architecture

Page 12: Analyze Telecom Fraud at Hadoop Scale

Page 12

Diyotta, Inc. All Rights Reserved

Page 12

Diyotta, Inc. All Rights Reserved

Customer Success Story

Page 13: Analyze Telecom Fraud at Hadoop Scale

Page 13

Diyotta, Inc. All Rights Reserved

Q&A

Sanjay Vyas

Email: [email protected]

Web: http://www.diyotta.com

Trial: www.Diyotta.com/try