apache kafka

Download Apache Kafka

Post on 06-May-2015

1.281 views

Category:

Technology

1 download

Embed Size (px)

DESCRIPTION

Apache Kafka

TRANSCRIPT

  • 1.Apache Kafka A high-throughput distributed messaging system.@diego_pachecoSoftware Architect | Agile Coach

2. Apache KafkaA high-throughput distributed messaging system. 3. Apache KafkaA high-throughput distributed messaging system. No JMS Stuff 4. Apache KafkaA high-throughput distributed messaging system.Activity Stream Processing /Offline log processing+Real-time Pub/Sub Messaging 5. Apache KafkaA high-throughput distributed messaging system.Uses ApacheZookerper 6. Apache KafkaA high-throughput distributed messaging system.Distributed Publish-Subiscribemessaging system, HightTroughtput, Persistent,Partitioning Messages, Paralleldata lod into Hadoop. 7. Apache Kafka A high-throughput distributed messaging system.Pure offline logprocessing are:Real-time,High Performance,Hight TroughtputLightweight business logic(andnot lots) to deliver that. 8. Apache KafkaA high-throughput distributed messaging system.Pure Messasingissues(ActiveMQ/RabbitMQ):NO API for Batching,Transactional,No persistence means, multipleconsumers are limited by arch. 9. Apache KafkaA high-throughput distributed messaging system. Kafka bridges the gap beetween both issues! 10. Apache KafkaA high-throughput distributed messaging system.Producer Test 11. Apache KafkaA high-throughput distributed messaging system.Consumer Test 12. Apache KafkaA high-throughput distributed messaging system.Supports *Activity Stream Processing*, like: Facebook/Scribe and Apache Flume.*Activity Stream Processing* => Collecting, Aggregating, largesammout on data, very present on social business. Later you often dooffline analysys with hadoop. A.K.A Offline log Aggregation. 13. Apache KafkaA high-throughput distributed messaging system. 14. Apache KafkaA high-throughput distributed messaging system. 15. Apache KafkaA high-throughput distributed messaging system. 16. Apache Kafka A high-throughput distributed messaging system. Thank You !@diego_pachecoSoftware Architect | Agile Coach