adtech pipeline: kafka->apex->geode

6
Prepared for: © 2016, Ampool, Inc. All Rights Reserved A Distributed, Memory-Centric, Object Store for Closed Loop Analytics

Upload: apache-apex

Post on 18-Jan-2017

291 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: AdTech Pipeline: Kafka->Apex->Geode

Prepared for:© 2016, Ampool, Inc. All Rights Reserved

A Distributed, Memory-Centric, Object Store for Closed Loop Analytics

Page 2: AdTech Pipeline: Kafka->Apex->Geode

Prepared for:© 2016, Ampool, Inc. All Rights Reserved

In-Memory Distributed Sys

Low-latency Comms.

Key-Value Store

Function Pushdown

+

High Throughput

Table Store

Native InterfacePluggable Store Manager

Java API

MASH (CLI Ext)

Java API

Building on PROVEN In-memory Technology…

Smart Data Tiering

Mature Event Model

Tunable Consistency

Metadata/ Catalog

Security AuthZ

Page 3: AdTech Pipeline: Kafka->Apex->Geode

Prepared for:© 2016, Ampool, Inc. All Rights Reserved

In-Memory Distributed Sys

Low-latency Comms.

Key-Value Store

Function Pushdown

+

High Throughput

Table Store

Native InterfacePluggable Store Manager

Java API

MASH (CLI Ext)

Java API

Smart Data Tiering

Mature Event Model

Tunable Consistency

Metadata/ Catalog

Security AuthZ

…makes it ENTERPRISE READY

✅Ease of Use

✅Security

✅High Availability

✅Dynamic Scaling

Page 4: AdTech Pipeline: Kafka->Apex->Geode

Prepared for:© 2016, Ampool, Inc. All Rights Reserved

Users

View ContentHave InterestsServed Ads

Publishers

Add ContentUpdate Interests

ACME CorpServe Ads/ ContentCapture EventsServe analytics

Ad Tech: A simple illustrative analytics use-case

Ad Server Infra/ Logs

Ad Ad Ad …

Ad Ad Ad …

Advertisers

Create AdsUpdate InterestsAd Performance

Data/ Admin

Monitor data flow service & infrastructure

Events

Page 5: AdTech Pipeline: Kafka->Apex->Geode

Prepared for:© 2016, Ampool, Inc. All Rights Reserved

Analytics: Kafka, Apex, Ampool serving Advertisers

Kafka

Advertisers

Ad Logs& Updates

DT RTSAd Performance

Top AdsTop Camp.$ Revenue

Page 6: AdTech Pipeline: Kafka->Apex->Geode

Prepared for:© 2016, Ampool, Inc. All Rights Reserved

Demo Pipeline Setup: Detailed Data Flow

KafkaData Generator

Ingest Streaming Analytics Ad-hoc Queries

Use

rs

Ads

Cont

ent

Ad Server Logs

U-C-A Updates

Ad Server Logs

Batch ProcessingContent-Ad

Apex

Ad Server

Users

Ads

Content

Kin Ad Server

Kin Users

Kin Ads

Kin Content

Mout Ad LogMout Users Mout Ads Mout Content

User-Ad Top Events

StrCounter

TopCamps TopAds

AD/Content Meta LookupFrom Ampool Table

Enrichment/TransformationsAnalytics of interest

(TBD)Mout Camp Mout Ad