cuts unite dsml for dataflow modeling
DESCRIPTION
CUTS UNITE DSML for Dataflow Modeling. By Pooja Varshneya. Component Workload Emulator (Coworker) Utilization Test Suite (CUTS). CUTS is a framework comprising of various system execution modeling (SEM) and system trace analysis tools. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/1.jpg)
CUTS UNITE DSML for
Dataflow Modeling
By Pooja Varshneya
![Page 2: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/2.jpg)
Component Workload Emulator (Coworker) Utilization Test Suite
(CUTS)
CUTS is a framework comprising of various system execution modeling (SEM) and system trace analysis tools.
Enable system developers and tester to conduct system integration testing during the early stages of the software lifecycle.
Assists in locating and rectifying quality-of-service problems during development phase of DRE systems.
Facilitates continuous system integration testing throughout the software lifecycle.
![Page 3: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/3.jpg)
CUTS
![Page 4: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/4.jpg)
UNITE UNITE is a system execution trace analysis tool.
Uses a dataflow model that is used to extract metrics of interest based for QoS evaluation.
Log messages are used to capture metrics of interests, such as time an event was sent or values of elements in an event.
Metrics of interest within the log messages are identified using message constructs.
QoS evaluation equation to applied to a dataflow model to evaluate QoS attributes, such as end-to-end response time, latency, and scalability.
![Page 5: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/5.jpg)
EXAMPLE
SQLite DB
LF1: {STRING owner} receive request{INT reqid} at {INT recvtime}
LF2: granting access at {INT replytime} to request{INT reqid}
LF2.replytime – LF1.recvtime
Evaluation Function
Log Format
LF1.reqid = LF2.reqid
Relation
![Page 6: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/6.jpg)
Need for DSML As dataflow models increase in size in terms of
number of log formats and relations amongst them, it becomes difficult for DRE developers to manage the complexity.
DSML provides an easy to use visual interface for creating dataflows.
Preserves the semantics of the language.
Enforces creation of valid relations between log formats by constraint checking.
Prevents duplication of dataflows.
![Page 7: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/7.jpg)
![Page 8: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/8.jpg)
CUTS UNITE DSMLCUTS UNITE DSML Datagraphs can be defined as
DM = (LF, CR, f)
A set LF of log formats that have variables V identifying what data to extract from log messages.
A set CR of causal relations that specify the order of occurrence for each log format such that
C Ri,j means LFi → LFj , or LFi occurs before LFj
A user-defined evaluation function f based on the variables in LF.
![Page 9: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/9.jpg)
CUTS UNITE DSMLCUTS UNITE DSML Unit Test can be defined as
UT = (fa , fe ,G, S)
fa is an aggregation function used to convert a data set to a single value. Examples : AVERAGE, MIN, MAX, and SUM.
fe is an evaluation function used to evaluate log-format attributes.
For a given aggregation function fa, grouping G is used to identify data sets that should be treated independent of each other.
A Service S defines any external utility that can process the results generated by UNITE. Examples : gnuplot
![Page 10: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/10.jpg)
CUTS DSML Meta-Model
![Page 11: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/11.jpg)
CUTS DSML Constraints View
Connection.src (“Type”) == Connection.dst(“Type”)
![Page 12: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/12.jpg)
DaDatagraph Example
Log Format
Relation
Key
![Page 13: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/13.jpg)
CUTS UNITE InterpreterUDM based interpreter
Validates the models against XML schema definition.
Parses the datagraphs and unit tests to generate XML based configuration files
<datagraph_name>.datagraph <UnitTest_name>.unite
Uses Xerces DOM parser to create XML Document.
![Page 14: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/14.jpg)
Interpreter Output
UnitTest_Login.uniteDatagraph_Login.datagrap
h
![Page 16: CUTS UNITE DSML for Dataflow Modeling](https://reader035.vdocuments.us/reader035/viewer/2022081512/56814548550346895db21783/html5/thumbnails/16.jpg)
DEMO