apache kafka

@diego_pacheco Software Architect | Agile Coach

Apache Kafka A high-throughput distributed messaging system.

Apache Kafka A high-throughput distributed messaging system.

Apache Kafka A high-throughput distributed messaging system.

No JMS Stuff

Apache Kafka A high-throughput distributed messaging system.

Activity Stream Processing / Offline log processing

+ Real-time Pub/Sub Messaging

Apache Kafka A high-throughput distributed messaging system.

Uses Apache Zookerper

Apache Kafka A high-throughput distributed messaging system.

“Distributed Publish-Subiscribe messaging system, Hight Troughtput, Persistent, Partitioning Messages, Parallel data lod into Hadoop.”

Apache Kafka A high-throughput distributed messaging system.

Pure offline log processing are: Real-time, High Performance, Hight Troughtput

Lightweight business logic(and not lots) to deliver that.

Apache Kafka A high-throughput distributed messaging system.

Pure Messasing issues(ActiveMQ/RabbitMQ): NO API for Batching, Transactional, No persistence means, multiple consumers are limited by arch.

Apache Kafka A high-throughput distributed messaging system.

Kafka bridges the gap beetween both issues!

Apache Kafka A high-throughput distributed messaging system.

Producer Test

Apache Kafka A high-throughput distributed messaging system.

Consumer Test

Apache Kafka A high-throughput distributed messaging system.

Supports *Activity Stream Processing*, like: Facebook/Scribe and Apache Flume.

*Activity Stream Processing* => Collecting, Aggregating, larges ammout on data, very present on social business. Later you often do offline analysys with hadoop. A.K.A Offline log Aggregation.

Apache Kafka A high-throughput distributed messaging system.

Apache Kafka A high-throughput distributed messaging system.

Apache Kafka A high-throughput distributed messaging system.

@diego_pacheco Software Architect | Agile Coach

Thank You !

Apache Kafka A high-throughput distributed messaging system.