tibco analytics meetup · 2020-04-03 · customer engagement analyst data scientist citizen data...

TIBCO Analytics Meetup

TIBCO Data Science Team

April 2020

© Copyright 2000-2020 TIBCO Software Inc.

The information in this document is confidential information of TIBCO Software Inc. and/or its affiliates. Use, duplication, transmission, or republication for any purpose without the prior written consent of TIBCO is expressly prohibited.

This document (including, without limitation, any product roadmap or statement of direction data) illustrates the planned testing, release and availability dates for TIBCO products and services. This document is provided for informational purposes only and its contents are subject to change without notice. TIBCO makes no warranties, express or implied, in or relating to this document or any information in it, including, without limitation, that this document, or any information in it, is error-free or meets any conditions of merchantability or fitness for a particular purpose.

The material provided is for informational purposes only, and should not be relied on in making a purchasing decision. The information is not a commitment, promise or legal obligation to deliver any material, code, or functionality. The development, release, and timing of any features or functionality described for our products remains at our sole discretion.

During the course of this presentation, TIBCO or its representatives may make forward-looking statements regarding future events, TIBCO’s future results or our future financial performance. These statements are based on management’s current expectations. Although we believe that the expectations reflected in the forward-looking statements contained in this presentation are reasonable, these expectations or any such forward-looking statements could prove to be incorrect and actual results or financial performance could differ materially from those stated herein. TIBCO does not undertake to update any forward-looking statement that may be made from time to time or on its behalf.

CONFIDENTIALITY & DISCLAIMER


TIBCO Analytics Meetupopportunities to learn and network

Meetup group keeps growing and now has 825+ members!

Join this TIBCO Analytics Meetup group and receive automatic invites to future TIBCO Analytics Meetups

And you’ll get links to slides and Youtube recordings!

https://bit.ly/3aDL7ww


Welcome and TIBCO Connected Intelligence update by Michael O’ConnellDemo - Life Expectancy data analysis to understand longevity by Steven HillionDemo - Formula 1 simulator predictions for lap time and crashes by Colin GrayTIBCO Community update by Heleen SneltingLive Q&A

Please submit your questions at any time via Q&A optionWe will answer at the end or will get back to you via email

Agenda


5

by Michael O’Connell

Data Science update


TIBCO CONNECTED INTELLIGENCE

Swap Logoif neededIn master slide

6

TIBCO Connected Intelligence

Metadata

Master & Reference Data

Transactional Data

Powered by shared data assets

INFORMATION MANAGEMENT

Metadata (Data Governance, Data Catalog)

MDM / RDM

DATA OPERATIONS

Data Virtualization Master and Reference Data Management

Data Store 1 Data Store n EDW/Lake

Spark Compute & Store

METADATA

UNIFYDATA

DATA SOURCES

Enterprise Application 1

Enterprise Application n

Streaming Sources

In-memoryData Grid

...

EVENTS

Streaming / Events

INTEGRATION

Hybrid Integration

APIManagement

INTERCONNECTEVERYTHING

ANALYTICSACTIONS Data Science Operations AnalyticsVisual Analytics

PREDICTCONFiDENTLY

Cloud Native Open Platform AI Foundation



7

InsightEmpower everyone and

every system with data-driven insights &

predictions

DataSimplify data

access, wrangling, and exploration

1Action

Automate and act in real time

LearningLearn and optimize for the best outcomes, all

the time

Retail

Government Hospitality Manufacturing

TelecommunicationsTransportation

& LogisticsFinancial Services

Energy

Healthcare

2

3

4


TIBCO Connected Intelligence


8

Modeling+ Visual composition + Multilingual Notebook+ Native ML & OS + AWS, AZURE, GCP+ AutoML, data prep

Operations Deployment+ Model lifecycle mgt+ Batch automation+ Real-time event processing+ REST, Apps, embedding

Data Access / Prep+ Distributed compute+ Feature engineering+ Reusable templates

Medic eg researcher on epidemic monitoring

Engineer eg aerodynamics engineer

Marketeer eg customer engagement analyst

Data ScientistCitizen Data Scientist

Data ScientistCitizen Data Scientist

Analytics OperationsIT / Software Engineer

FUNCTION

USER orAUTOMATION

Business UserAnalytic Operations IT / Administration

Business Applications+ Engineering/IoT+ Customer analytics+ Risk management+ Supply Chain

Visual Analytics& Data Science


TIBCO Data Science


9

Spotfire Visual Analytics Appshttps://www.tibco.com/products/tibco-spotfire/learn/demos



https://www.tibco.com/products/tibco-spotfire/learn/demos


10

DEVELOPER DATA SCIENTIST BUSINESS ANALYST• Stays in Spotfire, but can view

discussions and analyses in TDS

• Enter parameters for Team Studio analysis + visual results in Spotfire

• Maintain interactivity in Spotfire while running jobs in Team Studio

• Gets notifications of long running jobs completing in email via automation services

• Example of business users:• Medical reviewers, Clinicians, • Translational scientists

• Example of use cases:• Healthcare Analytics• IoT / F1 Car Performance

• Develops analyses in Team Studio and Spotfire

• Configures analyses for use by Spotfire user

• Design data access (data sources, connection to Spotfire)

• Scalability/HPC in TeamStudio• Design interface in Spotfire• Develop Python, R and PySpark

scripts.

• Example of use cases:• Health Outcomes Modeling,

IoT Digital Twin• Python and ML libraries• Spark MLlib scalable machine

learning with PySpark

• Creates Team Studio MODS (custom operators) and advanced Python/R scripts

• Interconnects different analytics platforms and libraries, e.g. SageMaker, TensorFlow

• Shares reusable functions and connectors across the Data Science team

• Develops analyses in Team Studio• Example of use cases:

• Spark MLlib scalable machine learning applications

• AI engines in AWS or local workstations

• Microservices for interconnecting platforms

TIBCO Data Science - Personas


11

Full R and Python capabilities• R and Python engines -- included out of the

box; client and server• R Dataframes to Spotfire Datatables• Python pandas to Spotfire Datatables• Map objects (e.g. .wkb)• Spatial libraries: gdal, rgdal, …

Statistics and Cloud Services• Matlab, SAS and other compute engines• TIBCO Data Science (point-click)• Cloud Services - AWS, Azure, GCP

Spotfire: Embedded Data Science



Location data – accurate geocoding, earth curvature

Multi-layer – inbuilt + WMS, TMS, Shape, ESRI services

Multi Coordinate systems – NAD27, NAD83, WGS84 overlays

Map Chart APIs – Map Chart as UX for location-based navigation

Spatial Data Functions - for advanced analytics e.g. optimal routes, contours, trade areas, ..Map anything – not just geographies

Spotfire: Geo-Analytics




13

Real Time Data Visualization• User selects time window• Data Streams shows live-updates• Calculations (forecast) on live visuals

Users and Data• Many real-time data sources supported• Simple data source connector • Brush-linking – static & real-time

visuals• Same behavior as rest of Spotfire

Spotfire: Data Streams

Real-Time Awareness and Action



Spotfire: Data Wrangling

Visual data wrangling – smart joins

Script expressions & data functions – embedded R, Python• Author and audit with automatically recorded dataflow steps• Edit from data canvas – including upstream



15

by Steven Hillion

Life Expectancy Demo


How a small team of data scientists and analysts came together in just

three days to analyze health outcomes around the globe

Read more on the TIBCO Community Blog

https://community.tibco.com/feed-items/tibco-gartner-analytics-showdown

17

by Colin Gray

F1 Simulator Demo


TIBCO’s Own Digital Twin

BigData London 2019

The winning lap! 🡪

TIBCO Formula 1™ - Simulator


Live Streaming Spotfire Dashboard

TIBCO - F1™ 2019 Simulator - Architecture

Cloud, Laptop or On-Premise

Flogo IoT App

PostgreSQL

TIBCO Data Streams

TIBCO Streaming

MessageBroker AMS®

ML Repository

TIBCO Data Science

UDP Data

Stream


As used by the official Formula 1™ e-sportsChampionship and teams

1. Predict final lap time, in real-time as someone races their lap2. Predict the likelihood of a crash occurring which damages the car

TIBCO F1™ - Simulator – Data Science


No or little data was available before eventData needed to be manually generatedEvery race track is different

How to simulate different drivers?Higher standard of accuracy in Formula 1

Data and Modeling

Multiple technologies involved which all must integrate fully

i.e. data generated and models must be compatible across each

Technology

The Data Science Challenge:

21

F1™ Predictions – The Data Available

• One Lap of Brazil Circuit generates ~ 104,800 data points per lap• 10 rows of data per second• 131 columns per row

Track and Position Tyre, Brake, Suspension Driver Style, Behaviour


22

F1™ Damage Predictions – The Models

Solution: 2 Models – predicting different severities of crash

Model 1: Actual damage is 0 – predict probability for No, Some and Severe damage by the end of the lap

Model 2: Some damage present - predict probability of whether there be more (possibly severe) damage by the end of the lap

If there is already 100% damage, there is nothing to predict


Predicting likelihood of crashing and damaging the car…By analysing track position, each tyre’s surface i.e. on track or off track, steering etc. can we predict this?

23

by Heleen Snelting

TIBCO Community Update



24

TIBCO Community the platform for our users! community.tibco.com



25© Copyright 2000-2019 TIBCO Software Inc.

https://community.tibco.com/blog


https://community.tibco.com/blog



https://bit.ly/2QWTfQS

https://www.tibco.com/covid19

https://bit.ly/2QWTfQS

https://www.tibco.com/covid19


27

Data Science Festival - TIBCO4Good

https://bit.ly/2JxYXo8

https://www.tibco.com/tibco4good


https://bit.ly/2JxYXo8

https://www.tibco.com/tibco4good


28

Spotfire Data Functions - Complete Set!

https://community.tibco.com/exchangeuse filters on page to help select items

https://bit.ly/2GGraIl

https://bit.ly/2EPx4Z8

https://bit.ly/2EPx4Z8 3 different items have been published


https://community.tibco.com/exchange

https://bit.ly/2GGraIl




29

Natural Language Generation

https://community.tibco.com/exchangeuse filters on page to help select items

https://bit.ly/2ymal48

Wikipedia edits Analysis example ready to learn and use!


https://community.tibco.com/exchange

https://bit.ly/2ymal48


30

Anomaly Detection - Latest Assets

https://www.tibco.com/solutions/anomaly-detection

https://bit.ly/39zsOay

https://bit.ly/2JvkNZt


https://www.tibco.com/solutions/anomaly-detection

https://bit.ly/39zsOay

https://bit.ly/2JvkNZt


31

Hands-on with Data Science

3rd Wednesday of every month at 9AM PT

● Free 30-minute webinar● Interactive presentation aimed

at helping new and advanced practitioners of data science and machine learning

● Recordings on https://www.tibco.com/events/dr-data-science-office-hours


https://www.tibco.com/events/dr-data-science-office-hours


32

Spotfire Youtube Channel

Subscribe to find all this content:

● TIBCO Analytics Meetup recordings

● ‘what’s new in Spotfire’ sessions by Spotfire Product Managers - new on Youtube!

● Dr Spotfire sessions

● Spotfire Enablement videos

https://www.youtube.com/user/TibcoSpotfire


https://www.linkedin.com/groups/12253057/

https://www.youtube.com/user/TibcoSpotfire

https://www.linkedin.com/groups/12253057/


33

Spotfire Enablement Hub

https://community.tibco.com/wiki/spotfire-enablement-hub


https://community.tibco.com/wiki/spotfire-enablement-hub



https://bit.ly/2R583wM

https://bit.ly/2R583wM


35

Benefits to you:● Network with peers● Showcase TIBCO acumen● Boost TIBCO skills● Access product releases● Provide feedback● Create content● Redeem special rewards● Free!

What’s in it for you?Engage with TIBCO on your own terms...

https://league.tibco.com/join/customer


https://league.tibco.com/join/customer

36

What’s new pages in… for example TIBCO Spotfire

https://community.tibco.com/wiki/whats-new-tibco-spotfire

Customer Orientation and Customer Success Center - ideal for on-boarding and staying up to date

• https://community.tibco.com/wiki/tibco-spotfire-customer-orientation

• https://community.tibco.com/wiki/tibco-data-science-team-studio-orientation-page

• https://community.tibco.com/wiki/tibco-data-science-workbench-customer-orientation

• https://community.tibco.com/wiki/tibco-spotfire-customer-success-center

Dr Spotfire and Dr Data Science

https://community.tibco.com/wiki/doctor-spotfire-office-hours


AutoML for TIBCO Data Science

https://community.tibco.com/modules/automl-tibcor-data-science-team-studio

TIBCO Analytics Meetup pages with recordings and presentations

https://community.tibco.com/wiki/tibco-analytics-meetup

TIBCO Community links to bookmark


https://community.tibco.com/wiki/whats-new-tibco-spotfire

https://community.tibco.com/wiki/tibco-spotfire-customer-orientation

https://community.tibco.com/wiki/tibco-data-science-team-studio-orientation-page

https://community.tibco.com/wiki/tibco-data-science-workbench-customer-orientation

https://community.tibco.com/wiki/tibco-spotfire-customer-success-center

https://community.tibco.com/wiki/doctor-spotfire-office-hours


https://community.tibco.com/modules/automl-tibcor-data-science-team-studio

https://community.tibco.com/wiki/tibco-analytics-meetup

Questions & Contact

Michael O’[email protected]@MichOConnell

Heleen Snelting [email protected]@HeleenSnelting

TIBCO Communitycommunity.tibco.com

TIBCO Exchangecommunity.tibco.com/exchange

Spotfire Trialspotfire.tibco.com/trial


mailto:[email protected]

mailto:[email protected]

https://community.tibco.com/wiki/tibco-spotfire-community-wiki

http://community.tibco.com/exchange

https://spotfire.tibco.com/trial

tibco analytics meetup · 2020-04-03 · customer engagement analyst data scientist citizen data...

Documents