ian james september 2017 - community-dev.tibco.com

September 2017

TIBCO Spotfire®

Getting Started with Spotfire Ian James

© Copyright 2000-2017 TIBCO Software Inc.

”... To stay ahead in motorsport, you have to continually innovate and be able to make quick decisions based on sound information and judgment. Working

with the TIBCO Insight Platform will enable us to optimize our performance in these areas, benefitting not only our strategic decisions at the racetrack, but

also how we operate back at the factory,”

– Toto Wolff, head of Mercedes-Benz Motorsport.

http://www.computerweekly.com/feature/Formula-1-Mercedes-team-turns-to-big-data-in-quest-for-victory-in-Grand-Prix


Part 1 – Product Overview

•  Introductions

•  Spotfire Releases

•  Spotfire Architecture and Clients

•  Data Access Techniques

•  Data Wrangling Capabilities

•  Data Source Viewer

TIBCO Spotfire® Lunch & Learn Agenda

Part 2 - Demonstration

•  Load Data

•  Build Dashboard

•  Mash Data / Relate

•  Fix data and verify

•  Data Drill

•  Mapping

•  TERR Capability


TIBCO Spotfire® - Example Data Visualisations

4

© Copyright 2000-2013 TIBCO Software Inc. 5

TIBCO Spotfire® - Enhancements for last 24 Months

Spotfire 7.5

Spotfire 7.6

Spotfire 7.7

Spotfire 7.8

Spotfire 7.9

Spotfire 7.10

•  Enterprise Enhancements -  Highly Scalable Arch -  Centralized

Management •  New Connectors

-  Spark -  Salesforce.com

•  Annotations •  Collaboration •  Multi Window Support

•  Visual Enhancements -  Waterfall Chart -  KPI Matrix -  Cross Table formatting -  TMS Layers for Maps -  Distance selection on

Maps -  Box Plot enhancements

•  Google Analytics Connector

•  Transformations in from Data Panel

•  Add Rows Recommendation

•  New APIs -  KPI Chart -  Page Layout

•  Server Security Enhancements

•  Transformation: -  Edit Transformations -  Replace Values

•  Mapping Enhancements -  Nautical Miles -  Get map coordinates

•  Improved TERR Compatibility to 99% of CRAN packages

•  Spotfire Server “Sites” •  Connectors:

-  MS Azure HDInsight -  Apache Knox -  SAP SSO

•  Visual Enhancements -  KPI Matrix design -  Cross Table sorting -  Table formatting -  Zoom visibility control

•  Manage Page Tab Sizes •  Edit Add Rows setup •  TERR Aggregation functions •  Server Console

improvements •  Attivio Connector

Throughout all of these releases, we have constantly added functionality to: -  Business Author bringing closer to parity with the Analyst client -  TIBCO Enterprise Runtime for R (TERR) in order to support more open source R packages -  Data Panel in order to simply navigation and make working with data sources easier -  Existing Data Connectors to support more native functionality and additional releases -  Automation Services to support tasks for exporting data and additional email delivery options

https://community.tibco.com/wiki/whats-new-tibco-spotfire

•  Mapping Enhancements -  Rotate markers -  Quick auto zoom

•  PDF export -  More features -  Themes

•  In-database performance improvements

•  Data Wrangling API •  Better TERR debugging •  Connectors:

-  SAP BW improvements


TIBCO Spotfire® Architecture

TIBCO Spotfire® Architecture


TIBCO Spotfire® 7.9

TIBCO Spotfire® - Architecture (Version 7.5 and above)

Spotfire Server & Node Manager


TIBCO Spotfire® Data Access

TIBCO Spotfire® Data Access


TIBCO Spotfire® – Data Access – In-Memory

Spotfire Client Spotfire Server Data Source(s)

SQL Query over JDBC

Spotfire Information Link “Spotfire Data Table”

Oracle, SQL, DB2, … Teradata, Netezza, …

Hadoop thru, Spotfire Advanced Data Services…

Spotfire Analyst on the Windows PC or

Consumer / Business Author with a browser

Data

•  Data extracted & stored in machine memory (RAM) •  10’s millions rows on laptop •  100’s millions on web client


TIBCO Spotfire® – Data Access – In-Memory

Spotfire Client Data Source(s)

“Spotfire Data Table”

Txt files, XLS, Shapefiles, CSV SBDF etc

Spotfire Analyst on the Windows PC or Embedded

Data for Consumer / Business Author with a

browser

Data

•  Data extracted & stored in machine memory (RAM) •  10’s millions rows on laptop •  100’s millions on web client


TIBCO Spotfire® – Data Mashing

Spotfire Client

Relationship between two tables Eg:- Customer_ID=Customer_ID Data

“Data Table and/or External Data”


Spotfire Analyst on the Windows PC or Embedded

Data for Consumer / Business Analyst

through the browser •  Data extracted & stored in machine memory (RAM)

•  10’s millions rows on laptop •  100’s millions on web client


TIBCO Spotfire® – Data Access – In-Database

Spotfire Client Direct (by-pass server) Data Source(s)

Add “Connection”

Including (not exclusive list): •  Teradata •  SAPBW •  Vertica •  Greenplum •  SQL Server •  MS SSAS •  Postgres

Spotfire Analyst on Windows PC or

Consumer / Business Analyst through the

browser

“External Data”

Custom API query

Summary return values

•  Oracle •  Exadata •  Netezza •  MySQL •  HortonWorks •  Cloudera •  ADS


TIBCO Spotfire® – Data Access – On-Demand

Spotfire Client Spotfire Server and/or Direct Connection

Data Source(s)

Add “On Demand Table”

Mix and match extracted and

connected sources

Spotfire Analyst on the Windows PC or

Consumer / Business Analyst through the

browser

SQL or custom query

Parameterized Query

Matching details



TIBCO Spotfire® In-line Data Cleansing

TIBCO Spotfire®


•  Edit the incorrect values directly in the Data Panel, Table Visual or Details on Demand View

•  Underneath it is a Data Transformation that replaces the value

•  Theoretically, you could have implemented the same thing before using ”calculate and replace column”

•  Note, nothing is changed in the underlying data source

TIBCO Spotfire® - Inline Data cleansing

TIBCO Spotfire® – Replacing Specific Values

•  The replace specific value logic is: •  For the row with

Key=X if the value of column A is Y replace the value of Column Y with Z

•  So: if the value changes in the data source after you created the replace value transformation, the transformation will no longer have any effect.



TIBCO Spotfire® Data Transformations

TIBCO Spotfire®


Accessed from the Source View in Spotfire Analyst.

TIBCO Spotfire® – Edit Data Transformations


•  Spotfire Analyst is supported. •  Edit a data transformation in a

data transformation group. •  Remove a data transformation

group. •  Remove a data transformation

from a group or data source. •  Insert a data transformation

into an existing transformation group.

•  Move data transformations up and down within a data transformation group.

TIBCO Spotfire® – Edit Data Transformations

A data transformtion that is part of a data source is presented

like this.

Insert transformation creates a new step.


TIBCO Spotfire® Location Analytics

TIBCO Spotfire® Location Analytics


•  Multi Layer Mapping Capability with zoom visibility for each layer

•  Use TMS, WMS Map Services

•  Acquire Long/Latitude Co-Ordinates on a right- click

•  Acquire distances point to point (Kms, Miles or Nautical Miles)

TIBCO Spotfire® – Location Analytics


TIBCO Spotfire® TERR

TIBCO Spotfire® TIBCO Enterprise Runtime for R


TIBCO Spotfire® – Advanced Analytics Curves

23

Selectfrompresetrangeoffunc1onstoaddaslines


TIBCO Spotfire® - Add Advanced Curves

24

Editse5ngsforcurve


TIBCO Spotfire® - Add Advanced Curves To Spotfire

Advancedcurvesadded


TIBCO Spotfire® - Expressions and Aggregations

EasilychoosefromsimpleSumtoStandardDevia1onbyRightClick


TIBCO Spotfire® - Expressions & Aggregations

Write/ModifyCustomExpressiontoinsertcalcula1ons


TIBCO Spotfire® - Data Relationship Functions

Insertdatarela1onshipfunc1ons


TIBCO Spotfire® - Configure Data Models

ConfigureClassifica1onmodel


•  Almost 10,000 CRAN community packages, or 99%, can be loaded in TERR. •  Full details on compatibility are available on

the TERR Documentation site.

•  Significant improvements to TERR performance in many areas.

•  TERR can now be used in RStudio to create interactive R Markdown notebooks.

•  A new Guide to Graphics in TERR, which provides tips and examples on using Javascript-enabled packages, certain open-source R packages, and the TERR RinR package to create graphics from TERR.

TIBCO Spotfire® – TERR


TIBCO Spotfire® - TERR Tools

TIBCOEnterpriseRun1meforRImport,RegisterandInstallDataFunc1ons


TIBCO Spotfire® - Data Function Process

RegisternewFunc1ons

Configureinputstofunc1on

Configureoutputs


•  https://www.tibco.com/spotfire

•  https://spotfire.tibco.com/demos •  https://spotfire.tibco.com/learn

•  https://ten.tibco.com/

• https://community.tibco.com/

TIBCO Spotfire® - Where to go for more Information


TIBCO Spotfire® - Webinars

https://www.tibco.com/events/live-spotfire-demonstration-APAC

Dr. Spotfire - live Q&A sessions (if you’re a night owl)

20+ sessions

500+ unique participants

Avg 200+ views / video

“I found the session extremely informative and you explained details very clearly.” - Michael Khalil, New York Life

“First, let me say that these sessions are a very positive development for TIBCO and Spotfire. So Kudo's to you, your team

and the decision makers that made this happen.” - Calvin Moree, Data Scientist, Blu Lotus Health

“Thanks for these sessions, they’re great.”- Mike Kalada, Sr.Spotfire Developer Pontoon Solutions

Differentiators from other webinars: 1.   Live Q&A free & open to all users

2.   Instituted “Featured content” to show off the latest

community releases, product features

3.   Caters to user spectrum from enthusiast to expert

4.   Curated video + time tagged summaries by topic on

Youtube for high playback value

Coursera style time-hyperlinked

summaries to session contents

https://www.tibco.com/events/dr-spotfire-s-office-hours https://www.youtube.com/channel/UCx3agqDZLbfrHNDUaxr0CXA https://www.tibco.com/blog/category/tips-and-tricks/

Thank you for attending our session today. We would really appreciate if you can provide us your feedback.


Q&A

Any suggestions on follow up sessions?

TIBCO Spotfire®

http://tibco.cm/2sO6Gne

ian james september 2017 - community-dev.tibco.com

Documents