Download - Siddhi CEP 1st presentation
![Page 1: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/1.jpg)
A HIGH PERFORMANCE COMPLEX EVENT PROCESSING ENGINE
http://siddhi.sourceforge.net/
![Page 2: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/2.jpg)
INTRODUCTION
• What is CEP?
• Why Siddhi? • Our project
• What have we done?
• What are yet to come?
![Page 3: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/3.jpg)
WHAT IS CEP ?
![Page 4: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/4.jpg)
WHAT IS CEP
In abstract, the tasks of the CEP is to identify
meaningful patterns, relationships and data
abstractions among unrelated events and fire an
immediate response such as an Alert message.
![Page 5: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/5.jpg)
WHY SIDDHI?
![Page 6: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/6.jpg)
WHY SIDDHI?
• Current CEP solutions and their Cons
• Project objectives
• Improvements from Research
![Page 7: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/7.jpg)
CURRENT CEP SOLUTIONS
• S4 • STREAM• Esper• SASE• Cayuga• TelegraphCQ• HiFi• Aurora• CompAS.• Niagara
![Page 8: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/8.jpg)
WHAT ARE THE PROBLEMS WITH THEM?
• Proprietary
• Not enough support for complex queries
• Less efficient
High latency and High memory consumption
![Page 9: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/9.jpg)
PROJECT OBJECTIVES
Primary Objective
• Carrying out research to come up with effective algorithms approaches to implement A High Performing CEP engine.
• Coming up with an effective architecture for a CEP Engine which can detect events in a computationallyefficient way.
![Page 10: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/10.jpg)
PROJECT OBJECTIVES CONT'D...
Secondary Objective
• Finding out a query language that will be sufficient to express the full set of pattern queries.
• Provide additional features, such as out of order arrival of events.(Optional)
![Page 11: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/11.jpg)
For State Machine
SASE: High-Performance Complex Event Processing over Streams
For Pipeline Architecture
Aurora: a new model and architecture for data stream management
For Query Plan Management
Query Processing, Resource Management,
and Approximation in a Data Stream
Management
From Research
![Page 12: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/12.jpg)
Siddhi Architecture
![Page 13: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/13.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
User Input a Query
![Page 14: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/14.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Compiling the query
![Page 15: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/15.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Query get compiled into an object model
![Page 16: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/16.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Query Object Model is parsed to the Siddhi Manager
![Page 17: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/17.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Event arrives to the Input Adapter
![Page 18: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/18.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Convert the Event to a tuple and place it to the input event queue
![Page 19: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/19.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Processor takes the tuple from the queue
![Page 20: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/20.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Executing the queries…Other Events arrives at the same time
![Page 21: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/21.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Non matching event thrown away
![Page 22: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/22.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
![Page 23: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/23.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Matching Event creates the output Event
![Page 24: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/24.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Pushing generated Events to the output queue
![Page 25: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/25.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
User get notified through output Adapter
![Page 26: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/26.jpg)
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Same procedure happens again and again…
![Page 27: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/27.jpg)
SIDDHI CORE
![Page 28: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/28.jpg)
PROGRESS SO FAR...
![Page 29: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/29.jpg)
PROGRESS SO FAR...
• Initial research √
• System Design √
• Web site
• 1st iteration
• Improved Siddhi API
• 2nd iteration
o Done up to Simple Query processing
![Page 31: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/31.jpg)
Demo
![Page 32: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/32.jpg)
QUESTIONS?
![Page 33: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/33.jpg)
"Los Angeles Smart Grid Demonstration Project"- It forecasts electricity demand, respond to peak load events, and improves sustainable use of energy by consumers.http://ceng.usc.edu/~simmhan/pubs/simmhan-usctr2011-smartgridinformatics.pdf
Where can Siddhi be used?
![Page 34: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/34.jpg)
Los Angeles Smart Grid Demonstration Project
![Page 35: Siddhi CEP 1st presentation](https://reader035.vdocuments.us/reader035/viewer/2022081418/5588f754d8b42aad418b4678/html5/thumbnails/35.jpg)
THANK YOU!