streaming benchmark
TRANSCRIPT
Howmanytweetsareprocessed/second?
Insertread_ts Insertwrite_ts
100tweets/second
Subsetof100tweets/second
Latency:
∑ (𝑤𝑟𝑖𝑡𝑒() − 𝑟𝑒𝑎𝑑())./010234./056786 /total_tweets_processed
winStart:windowstarttime;winEnd:windowEndtime
FewtuningsIconsidered
§Numberofcomputebolts
§Consumerspouts.
§Javaheapsize.Playsanimportantrole.
§Tried2ofthegroupings.
Recommendation
Storm• Lowlevelapis:• builder.setBolt("parse-bolt",newParseTweetBolt(),parallel*3).shuffleGrouping("tweet-spout");
• Betterunderstandingofarchitectureisrequired.
• Configurationtunings
Flink• Hidesdetails:• flatMap(newParseTweetBolt())