Upload File

the many faces of apache kafka: leveraging real-time data at scale

  • Home
  • Internet
  • The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
54
The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale Neha Narkhede, Co-founder & Head of Eng @ Confluent 1

Upload: messaging-meetup

Post on 13-Apr-2017

252 views

Category:

Internet


0 download

Report

TRANSCRIPT

Page 1: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale

The Many Faces of Apache Kafka: Leveraging Real-time

Data at Scale Neha Narkhede, Co-founder & Head of Eng @ Confluent

1

Page 2: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 3: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 4: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 5: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 6: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 7: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 8: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 9: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 10: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 11: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 12: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 13: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 14: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 15: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 16: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 17: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 18: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 19: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 20: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 21: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 22: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 23: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 24: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 25: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 26: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 27: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 28: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 29: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 30: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 31: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 32: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 33: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 34: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 35: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 36: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 37: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 38: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 39: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 40: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 41: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 42: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 43: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 44: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 45: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 46: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 47: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 48: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 49: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 50: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 51: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 52: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale
Page 53: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale

• Mission: Make Kafka-based Stream Data Platform a practical reality everywhere

• Product •  Stream processing integration for Kafka •  Connectors for streaming data flow to systems •  Monitor end-to-end data flow •  Schemas and metadata management •  Upcoming release – Confluent Platform 2.0 in December

53

confluent

Page 54: The Many Faces of Apache Kafka: Leveraging Real-time Data at Scale

Confluent is hiring @nehanarkhede

http://confluent.io/careers


Apache Kafka Lightning Talk

Kafka Streams: The Stream Processing Engine of Apache Kafka

Making Apache Kafka Elastic with Apache Mesos

Apache Kafka - Martin Podval

User's Guide Apache Kafka Software Release 2 diagram shows the parts (green) of Apache Kafka: Core Apache Kafka (light green), including the Kafka client API and the Kafka broker

Intro to Apache Kafka

Scaling MQTT With Apache Kafka

Apache Kafka - · PDF fileOverview What is Apache Kafka? Data pipelines Architecture How does Apache Kafka work? Brokers Producers Consumers Topics

Apache Kafka Best Practices

Spring for Apache Kafka · 2020. 8. 12. · 4.1. Using Spring for Apache Kafka . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Evaluation of Apache Kafka in Real-Time Big Data Pipeline ... · Apache Kafka in the pipeline architecture. 3.1 Apache Kafka Architecture . Kafka [9] is an open source, distributed

STREAM PROCESSING AT LINKEDIN: APACHE KAFKA & APACHE … SF... · STREAM PROCESSING AT LINKEDIN: APACHE KAFKA & ... One of the initial authors of Apache Kafka, ... Introduction to

Apache Kafka Lesson Learned

Apache Kafka Overview - docs.cloudera.com

Kafka Tutorial - Introduction to Apache Kafka (Part 1)

Stream Processing using Apache Spark and Apache Kafka

Decoupling Decisions with Apache Kafka

Apache Apex Kafka Input Operator

Building Distributed Semantic Job Queue with Kafka · Apache Kafka Overview What is Apache Kafka ? Run as a cluster on one or more servers that can span multiple DC Apache Kafka®

Kafka in Production - WordPress.com · Apache Kafka Apache Kafka is an open-source stream processing platform developed by the Apache Software Foundation written in Scala and Java

Introduction to Apache Kafka

apache kafka event stream processing solution is Apache Kafka? Apache Kafka is a Stream Processing Element (SPE) taking care of the needs of event processing. Apache Kafka was initially

Authorization in Apache Kafka - Seattle Kafka Meetup - Ashish Singh

An Introduction to Apache Kafka

Chapter 1: An Introduction to SMACK · Figure 4-11: Apache Cassandra cache. Chapter 5: The Broker - Apache Kafka Figure 5-1. Apache Kafka typical scenario. Figure 5-2. Apache Kafka

 · Apache Kafka Introduction to Apache Kafka Apache Kafka Architecture explanation Practical Examples on Apache Kafka SCALA, PYTHON, SPARK Course Content

Apache Kafka

Spark streaming with apache kafka

Apache Kafka at LinkedIn

Cloudera Distribution of Apache Kafka

Slides - Apache Kafka® Architecture & Fundamentals Explained€¦ · for Apache Kafka (aligns to Confluent Developer Skills for Building Apache Kafka course) Confluent Certified

Integrating Apache Hive with Kafka, Spark, and BI · 2020-05-10 · Data Access Apache Hive-Kafka integration Related Information Apache Kafka Documentation Perform ETL by ingesting

Data Pipelines with Apache Kafka

Apache Kafka - Free Friday

Apache Kafka - RainFocus · Apache Kafka Scalable Message ... Introduction& Motivation Apache Kafka -Scalable Message Processing and more! Apache Kafka -Overview ... • Apache Spark