mark kotanchek, evolved analytics -...
TRANSCRIPT
![Page 1: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/1.jpg)
Mark Kotanchek, Evolved Analytics
Reducing Barriers The DataModeler GUI
1
![Page 3: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/3.jpg)
www.evolved-analytics.com
Need & Perspective Matter
❖ Rapid data analysis
❖ Human-interpretable models
❖ Insight generator
❖ Variable selection
❖ Trustable models
❖ Active design of experiments
3
Analysis for the Real World
![Page 4: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/4.jpg)
www.evolved-analytics.com
Symbolic Regression
❖ Evolve models from variables, operators and constants
❖ Reward simplicity & accuracy
❖ Many disparate hypotheses are developed, assessed and refined
❖ different model structures
❖ different variable combinations
4
![Page 5: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/5.jpg)
www.evolved-analytics.com
Optionizer not Optimizer
❖ Human provides the initial framework
❖ Data provides the story
❖ Human extracts the insight and meaning
❖ Breaks the conventional hypothesis-testing approach
5
![Page 6: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/6.jpg)
www.evolved-analytics.com
Implications
❖ Transparency
❖ human-interpretable models
❖ metavariables
❖ Trustable Models
❖ agree where constrained by data
❖ diverge when not constrained
❖ Active Design-of-Experiments
❖ collect data iteratively
❖ target potential optima
❖ target locations of uncertainty — maximum value experiment!
6
![Page 7: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/7.jpg)
www.evolved-analytics.com
Trustable Models
❖ The impact of variables depend upon the parameter settings
❖ Visualization involves choosing a reference and looking at projections of the model variables
❖ Moving sliders allows “what if” exploration
7
bw
male
rvolume
rweight
preCr
0.5
1.0
1.5
2.0
bw0.5
1.0
1.5
2.0
male
0.5
1.0
1.5
2.0
rvolume0.5
1.0
1.5
2.0
rweight
0.5
1.0
1.5
2.0
preCr
cr7POD
Reference Point
Ensemble Disagreement
Trust decreases away from observed
values
Here a data point was
chosen as a reference
www.evolved-analytics.com
![Page 8: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/8.jpg)
www.evolved-analytics.com
Implementation
❖ 400+ Functions & Symbols
❖ Fully documented
❖ Intelligent functions & meta-functions
❖ Use notebook interface for analysis & audit trail
❖ 100% Mathematica
8
![Page 11: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/11.jpg)
www.evolved-analytics.com
DataModelerUI
❖ No Shift-Enter
❖ Balance ease-of-use vs. power
❖ 100% Mathematica
❖ Data-centric
10
![Page 14: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/14.jpg)
www.evolved-analytics.com13
We have the ability to output selected graphics to a report
![Page 15: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/15.jpg)
www.evolved-analytics.com14
Options for explorers provide fine control but
intelligent defaults
![Page 16: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/16.jpg)
www.evolved-analytics.com
Data Completeness
15
Developed models must cover a specified
fraction of the data with numeric predictions
![Page 17: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/17.jpg)
www.evolved-analytics.com
Correlation Chart
16
Tooltips layer information
![Page 18: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/18.jpg)
www.evolved-analytics.com
Correlation Matrix Plot
17
DataModeler can handle correlated
inputs and provide focus as to their impact
priority
![Page 19: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/19.jpg)
www.evolved-analytics.com18
Inspectors provide feedback during the
model searchRound comments let us track our
assumptions and actions during the modeling
workflow
As we develop understanding, we want to adjust the settings used in
the model search
On a multi-core CPU, multiple
independent evolutions will run in parallel
![Page 20: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/20.jpg)
www.evolved-analytics.com19
By default, each independent evolution (modeling run) archives
a model file
Many models are returned from each
independent evolution (modeling run)
![Page 21: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/21.jpg)
www.evolved-analytics.com20
We can apply filters to select subsets of models
Selected models can be shown
in context
Selected models can be archived
Interesting metavariables can be
available in subsequent modeling as a building
block
The number of simultaneous explorers is
adjustable
![Page 22: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/22.jpg)
www.evolved-analytics.com21
We can apply filters and save the resulting
variable set
Here we are looking at the
presence of models in at least 10% of the
models
The Variable Presence Distribution
Chart shows the diversity of presence across independent
model searches
![Page 23: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/23.jpg)
www.evolved-analytics.com22
The model dimensionality table lets us see how changing the number of variables affects the
modeling potential and which variable combinations are most popular for a specific number of
inputs
![Page 24: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/24.jpg)
www.evolved-analytics.com23
This function lets us look at the most
popular combinations of inputs in the models
being explored
We have the ability to define variable sets of interest from this view
![Page 25: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/25.jpg)
www.evolved-analytics.com24
The Response Plot Explorer lets us interactively explore
the response behavior from a specified point
![Page 26: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/26.jpg)
www.evolved-analytics.com25
The Ensemble Prediction plot shows
the prediction as well as the spread of the embedded
models. Outliers can also be displayed
The residual plot lets us look for
structural errors based upon input
values
![Page 27: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/27.jpg)
www.evolved-analytics.com26
We can also evaluate the developed
models using conventional statistical
metrics
![Page 28: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/28.jpg)
www.evolved-analytics.com
Further Information
❖ www.evolved-analytics.com
❖ Evolved Analytics LLC3411 Valley Drive Midland, MI 48640+1-989-785-0513
❖ Evolved Analytics Europe BVBAAntoine Coppenslaan, 27/11, 2300 Turnhout Belgium Phone: +32-148-00-414
27
Evolved AnalyticsEvolving Daily. Learning Always.
![Page 29: Mark Kotanchek, Evolved Analytics - Mathematicalibrary.wolfram.com/infocenter/Conferences/9054/Data...Intelligent functions & meta-functions Use notebook interface for analysis & audit](https://reader035.vdocuments.us/reader035/viewer/2022080720/5f79b870c3f8bd1f8438170b/html5/thumbnails/29.jpg)
www.evolved-analytics.com
Acknowledgments
❖ Evolved Analytics!
❖ Arthur Kordon!
❖ Katya Vladislavleva!
❖ Theresa Kotanchek!
❖ Pronto Analytics!
❖ Ariel Sepúlveda
28