hunting criminals with hybrid analytics strata hadoop v4

17
1 1 Hunting criminals with hybrid analytics, semi-supervised learning & agent feedback David Talby SVP Engineering Atigeo Claudiu Branzan Senior Engineering Lead Atigeo

Upload: claudiu-branzan

Post on 12-Apr-2017

377 views

Category:

Data & Analytics


0 download

TRANSCRIPT

Page 1: Hunting criminals with hybrid analytics   strata hadoop v4

11

Hunting criminals with hybrid analytics, semi-supervised learning & agent feedback

David Talby

SVP EngineeringAtigeo

Claudiu Branzan

Senior Engineering LeadAtigeo

Page 2: Hunting criminals with hybrid analytics   strata hadoop v4

2

Why Semi-Supervised Learning & Feedback?

50+Schemes(and counting)

99.9999%‘Good’ messages

6+Monthsper case

Page 3: Hunting criminals with hybrid analytics   strata hadoop v4

3Why Hybrid Analytics?

Ignore more rules

Unusual timing of

eventsUnusualpersonal network

Teamwork & scale

Think & talk differently

Page 4: Hunting criminals with hybrid analytics   strata hadoop v4

4Why Hybrid Analytics?

Rules & Policies

Time Series

AnalysisLink

Analysis

Ensemble Learning

Natural Language

Page 5: Hunting criminals with hybrid analytics   strata hadoop v4

5Stream processing

Kafka

Email Stream

Account transactions Stream

Email NLP Features

People graph

Transactions time series

Page 6: Hunting criminals with hybrid analytics   strata hadoop v4

6User Analysis Iteration

Email NLP Features

User graph

Transactions time series

Graph Features

Time SeriesFeatures

NLP Features

Agent Feedback

Trai

n / T

est C

lass

ifier

Page 7: Hunting criminals with hybrid analytics   strata hadoop v4

77

Thank You!Notebooks for this talk are freely available

[email protected]

[email protected]

Try xPatterns Connect at: http://xpatterns.com/connect/

Page 8: Hunting criminals with hybrid analytics   strata hadoop v4

© 2015 Atigeo, Corporation. All rights reserved. Atigeo and the xPatterns logo are trademarks of Atigeo. The information herein is for informational purposes only and represents the current view of Atigeo as of the date of this presentation. Because Atigeo must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Atigeo, and Atigeo cannot guarantee the accuracy of any information provided after the date of this presentation. ATIGEO MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Page 9: Hunting criminals with hybrid analytics   strata hadoop v4

9

Page 10: Hunting criminals with hybrid analytics   strata hadoop v4

10

Page 11: Hunting criminals with hybrid analytics   strata hadoop v4

11

Page 12: Hunting criminals with hybrid analytics   strata hadoop v4

12

Page 13: Hunting criminals with hybrid analytics   strata hadoop v4

13

Page 14: Hunting criminals with hybrid analytics   strata hadoop v4

14

Page 15: Hunting criminals with hybrid analytics   strata hadoop v4

15

Page 16: Hunting criminals with hybrid analytics   strata hadoop v4

16

Page 17: Hunting criminals with hybrid analytics   strata hadoop v4

17