rideon
TRANSCRIPT
RideOn.
Design
Design
Design
Design
Design
Design
Cluster
Kafka
Storm
Limitation
“The way it works is that if you choose a sampling rate of 0.05, it will pick a random element of the next 20 events in which to increase the count by 20. So if you have 20 tasks for that bolt, your stats could be off by +-380.”
-- Nathan Marz
Monitoring V2
Take Aways
• Moving pieces + monitoring =
def :
Worked at Proofpoint
Studied at BS, Computer Science Harvey Mudd College
Contact linkedin.com/in/mydiemho https://github.com/mydiemho
A Foodie that writes code
Tips
• Shuffle grouping => Hot spot
• Kafka parallelism <= N * consumer parallelism
Ingestion
Ingestion