grokking tech talk 15: architectural decisions @ parcel perform

Architecture Decisions@ Parcel Perform

1. Concepts

2. Communication flows

3. Batch or Stream

4. Monitoring

Agenda

Concepts

EH123456789VN

1Z8836X4043036971

You lose what you don’t store

Parcel ID Status Updated At

1Z25959204 Customs Investigation

2016-09-30 15:42:24

1Z25959204 Out for delivery

2016-10-01 15:42:24

Parcel ID Updated At

1Z25959204 2016-10-01 15:42:24

Event Created At

Customs Investigation

2016-09-30 15:42:24

Out for delivery

2016-10-01 15:42:24

An example from e-commerce friends

Order ID Status Amount

LZD-1942658 delivered $505

Product Unit Value Unit Count

Kindle Reader

$250 1

Joel on Software

$85 3Product Action Count

Joel on Software

Add 5

Joel on Software

Remove 2

Product Unit Value

Kindle Reader

$250

Joel on Software

$85

Concepts (cont)

Sync/Async Request

Message Queue (MQ)

Batch Processing

Stream Processing

Message Queue

Message Queue

Uh.. whatever?

Communication Flows

● Why the RED flow?● What should go to Kafka?● HTTPS or Socket?

Data Processing

Data Processing (cont)

Downside: no streaming

Monitoring

Monitoring (cont)

http://vizceral.parcelperform.com/

Dudes I ran out of slides!