transforming nfpa with knime...hadoop eco-system/storage knowledge management / analytics documented...

NFPA.ORG | © National Fire Protection Association. All rights reserved.

Transforming NFPA with KNIME

Save lives and reduce loss with information, knowledge and passion

3rd November, 2017 | Mohammed Ayub | Data Scientist

About Me


National Fire Protection Association (NFPA)

•120 year anniversary founded in 1896

•Non-Profit Trade Association with global

appeal

•Mission – We saves lives and reduce loss

with information, knowledge and passion

•Well-known for building electric codes and

fire protection standards

•Transformation ongoing efforts to

transform physical assets via analytics into

digital data and knowledge assets


Driving Business Use Cases with KNIME

• Powering Fire Analysis with Big Data

• Fire Department Comparison Tool

• Understanding the Fire Department Needs

• Understanding Fire Narratives for Automated Reporting

NFPA.ORG | NFPA Confidential. For Internal Use Only. | © National Fire Protection Association. All rights reserved. 5

Gathering

Fire Data

Compete with

IS/IT projects

Partial subset

Months

Extraction

Uses black box

scripts

Inflexible

Hours

Minimal

documentation

Error prone

Weeks

Analysis Reports

Fire Analysis: Traditional Workflow

Loading

Already 18

months old

Unpredictable

Months

Long and

text-heavy

Static

Years

NFPA.ORG | NFPA Confidential. For Internal Use Only. | © National Fire Protection Association. All rights reserved. 6

HADOOP

Eco-System/Storage

Knowledge

Management /Analytics

Documented and

replicable

Easy to modify

Minutes

Interactive and intuitive

design

Opens new questions

Minutes

Works on large,

complex datasets

Fast Computing

Minutes

Visualization

Transparent Scalable/FlexibleEfficient

Fire Analysis: New Workflow

Fire Data



• Powering Fire Analysis with Big Data Connectors





Fire Department Comparison Tool

• Compare/Cluster >30,000 fire departments across the United States

• Factors affecting Similarity: Past Incident History, Census Demographics,

Capabilities and Resources.

Benefits:

• Benchmarking fire departments

• Improve/Backfill other NFPA data sources - NFIRS, FSI, Surveys

• QA & QC for Clustered fire departments


Fire Department Comparison Tool

Google App Store:

https://play.google.com/store/apps/details?id=org.

nfpa.firstresponders

https://play.google.com/store/apps/details?id=org.nfpa.firstresponders


Assessing Fire Department Needs


Benefits:

• Efficiency - Reduce turn out time from Days to Minutes

• Transparency - Shorter learning curve for new analysts.

• Flexibility - Changing processes & user requirements







• Understanding Fire Narratives for Automated

Reporting


More than 500 thousand text narratives describing

• “What happened on the scene?”,

• Type of incident, Which services responded, What apparatus was used,

Actions taken and possible cause of ignition.

• Much more stuff that we don't want to know… (sensitive information)

Use Cases:

• Can we reduce the time taken to fill an incident report ?

• Can we establish Quality Control and Assurance ?

• How to query and assess related information ?

Text Mining Fire Dept. Narratives



Vehicle Rescue

Related (300)

Alarm Related

(700)

Hazardous Chemical

Related (400)

Building Related

(100)

Mixed - Vehicle,

Hazardous Chemical



Outcomes:

• Created a binary classifier for Fire Narratives. Accuracy >90% AUC 0.93

• Identifying important questions to ask a firefighter for incident reporting

• Comparing reporting styles

In Progress…

• Word Sense Disambiguation(Polysemy):

“Trump to fire rex tillerson” vs “fire caused at rex tillerson’s house”

• Data Shapes - Research and Develop Custom Nodes

• Ontology for Fire


Acknowledgements

Nathaniel Lin – President, Analytics Consult

Hylton Hanes – Sr. Data Analyst, NFPA

Ben Evarts – Data Analyst/Scientist, NFPA

Rahul Ghadge – Data Scientist, NFPA

KNIME Team – Iris, Tobias Kotter, Christian Dietz, Phil

Winters and many others…

TM

Contact:

Work: +1-617-984-7401

Email: [email protected]

LinkedIn:

https://www.linkedin.com/in/mohammedayub1/

mailto:[email protected]

https://www.linkedin.com/in/mohammedayub1/

transforming nfpa with knime...hadoop eco-system/storage knowledge management / analytics documented...

Documents