siddhi cep 1st presentation
Post on 23-Jun-2015
870 Views
Preview:
DESCRIPTION
TRANSCRIPT
A HIGH PERFORMANCE COMPLEX EVENT PROCESSING ENGINE
http://siddhi.sourceforge.net/
INTRODUCTION
• What is CEP?
• Why Siddhi? • Our project
• What have we done?
• What are yet to come?
WHAT IS CEP ?
WHAT IS CEP
In abstract, the tasks of the CEP is to identify
meaningful patterns, relationships and data
abstractions among unrelated events and fire an
immediate response such as an Alert message.
WHY SIDDHI?
WHY SIDDHI?
• Current CEP solutions and their Cons
• Project objectives
• Improvements from Research
CURRENT CEP SOLUTIONS
• S4 • STREAM• Esper• SASE• Cayuga• TelegraphCQ• HiFi• Aurora• CompAS.• Niagara
WHAT ARE THE PROBLEMS WITH THEM?
• Proprietary
• Not enough support for complex queries
• Less efficient
High latency and High memory consumption
PROJECT OBJECTIVES
Primary Objective
• Carrying out research to come up with effective algorithms approaches to implement A High Performing CEP engine.
• Coming up with an effective architecture for a CEP Engine which can detect events in a computationallyefficient way.
PROJECT OBJECTIVES CONT'D...
Secondary Objective
• Finding out a query language that will be sufficient to express the full set of pattern queries.
• Provide additional features, such as out of order arrival of events.(Optional)
For State Machine
SASE: High-Performance Complex Event Processing over Streams
For Pipeline Architecture
Aurora: a new model and architecture for data stream management
For Query Plan Management
Query Processing, Resource Management,
and Approximation in a Data Stream
Management
From Research
Siddhi Architecture
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
User Input a Query
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Compiling the query
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Query get compiled into an object model
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Query Object Model is parsed to the Siddhi Manager
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Event arrives to the Input Adapter
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Convert the Event to a tuple and place it to the input event queue
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Processor takes the tuple from the queue
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Executing the queries…Other Events arrives at the same time
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Non matching event thrown away
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Matching Event creates the output Event
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Pushing generated Events to the output queue
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
User get notified through output Adapter
Siddhi Manager
User
Input AdaptersOutput Adapters
Compiler
Same procedure happens again and again…
SIDDHI CORE
PROGRESS SO FAR...
PROGRESS SO FAR...
• Initial research √
• System Design √
• Web site
• 1st iteration
• Improved Siddhi API
• 2nd iteration
o Done up to Simple Query processing
Demo
QUESTIONS?
"Los Angeles Smart Grid Demonstration Project"- It forecasts electricity demand, respond to peak load events, and improves sustainable use of energy by consumers.http://ceng.usc.edu/~simmhan/pubs/simmhan-usctr2011-smartgridinformatics.pdf
Where can Siddhi be used?
Los Angeles Smart Grid Demonstration Project
THANK YOU!
top related