momentum in big data, iot and machine intelligence

Post on 13-Apr-2017

8.630 Views

Category:

Data & Analytics

1 Downloads

Preview:

Click to see full reader

TRANSCRIPT

Big Data Analytics for Internet of Things and Machine Intelligence

Shamshad AnsariPresident & CEO

Accure Inc.

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Agenda

• Introduction• Iot & Big Data• IoT Reference Architecture• IoT on Momentum

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Year 2020

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Big Numbers of Small ThingsYear 2020

$7.1 Trillion

$1.9 Trillion

50 Billion Connected Devices | Cisco

IoT Economic Vaule Added| Gartner

IoT Solutions Revenue| IDC

IoT Processor Cost Less

Than

$1Gartner

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

What is IoT?

• Objects connected to Internet and communicating with each other.

• Any object that can be turned on and off could be a part of the IoT.

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Business Opportunities

Monitor

OptimizeControl

Improved performance

Reduced costNew innovative

products

1% savings across all industries $150 Billion Savings

Source: GE

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Is IoT New?

We’ve doing this for many years Yes

This is really very facinating and looks like IoT will change

the world

If IoT is not new, why is this buzz now?- Widespread cell phone usage- Reduced price of sensors- Cheaper Internet connection- Improvded technology to handle and make use of data

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

How Big Data Relates to IoT?How much data?

Gas turbine comressor blade: 500GB/ day | GE

2015 2020

4.4

44

0.1324.4

OverallIoT

Zettabyte

An IoT Sensor generates about 0.5MB per variable per day

1000 sensors & 1000 variables = 500GB per day

IoT generates big data

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

IoT and Big Data

Data Ingestion Data Storage Data Processing

Data Reporting Action

A new mindset and technology is needed to handle IoT data

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

IoT Challanges

• Scale– Size and fast growing data– Large number of users

• Pace– Fast pace analysis, command and control and cost– Skill required to do data science and learn new platform

• Environment– Complex IoT infrastructure– Security and privacy– Lack of standards in data interoperability

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

IoT Solutions Until Now

• Complex and expensive• Cost of failing was huge• Mostly high-volume, homogenous devices,

where software needs are simple– For simple things like thermostat, refrigerator etc.

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Practical Solution Approach

• Think big. Start small• Start small– Experiment, learn, and refine

• Think big– scale

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Big Data IoT Architecture Requirements

• Be able to handle hardware and software hetrogenity

• Be able to scale big• Provide low latency

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Momentum as an IoT Platform

Momentum provides a configurable platform to manage IoT

• Per device level security• Massive scalability – millions of concurrent sensors• Real-time and batch analytics• Predictive analytics• Smart alerts

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

IoT Reference Architecture

Streaming Gateway

Adapter

Local Gateway

Scalable storage

Batch analytics

Realtime analytics Visualiza

tion

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Working Example:Smart Street Light Analytics

Environment Internal parts Weather

Temperature Temperature Temperature

Pressure Input voltage Pressure

Humidity Output voltage Humidity

Noise Light intensity Sand storm

Rain

Snow

Fog

External DataSensor Data

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Momentum in Smart Street Lights

• Data Ingestion• Predictive Model Building• Predictive analytics – batch• Realtime analytics

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Momentum Demo – How to create Streaming Hub

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Predictive ModelingFeature Engineering• Set A = weather + holiday + weekday + weekend features for the predicted day• Set B = number of vehicles that passed each pole in each of the previous 12

hours• Set C = number of vehicles that passed in each of the previous 12 days at the

same hour• Set D = number of vehicles that passed in each of the previous 12 weeks at the

same hour and the same dayTraing Sets• Training set 1: feature set A only• Training set 2: feature sets A+B• Training set 3: feature sets A+B+C• Training set 4: feature sets A+B+C+D

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Load Data to Momentum

-Specify your source data- RDBMS- NoSQL- Delimited files

- Full or continuos/incremental mode

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Pre-processing & Transformation

Provide transformation logic in the form of familiar SQL statement

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Predictive Modeling

Predictive Modeling without any programming

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Scoring

Model A+B+C is preferred as it has the lowest RMS

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Conclusion

• Momentum provide highly scalable IoT platform

• Big data analytics without any programming• Reduce implementation time and cost

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Next Step

Visit us at www.accureanalytics.com

For an online demo email us at info@accureanalytics.com

top related