the dtc paradigm in the neural age - datascienceseed · neural approach offers the higher accuracy...

102

Upload: others

Post on 22-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 2: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

OUR SPONSORS

Page 3: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

L’evoluzione della Computer Vision

nell’era neurale: scienza & impresa

Alessandro FerrariFounder, CEO ARGO Vision

Page 4: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

AGENDA∎WHO?

∎NEURAL AGEs

∎DTC EVOLUTION

∎ CYCLOPEYE: the «neural» sensor

∎ EXTRAs

∎Q&A

@vs_AR

Page 5: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

INFO

∎ FOCUSED ON COMPUTER VISION

∎ POINTERS TO SOURCES

∎NO FICTION

@vs_AR

Page 6: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 7: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

ARGO Vision is a startup that excels in Computer Vision and Machine Learning. We develop innovative and high-customizable AI-based solutions to boost your business up.

The ARGO Vision AI is empowering up dozens companies worldwide. Our engine is boosting firms in AR/VR, Smart Parking, Video-Analysis and Big Data solutions.

Page 8: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 9: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Skills and highlights

One Engine, Many

Markets

Open Innovation is a

Mantra

Customization and

Flexibility

Computer Vision Deep Learning Proprietary Code

Page 10: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Technologicalindependency

>80% long-termprojects

Awesome features

Financialindependency

Page 11: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

15,000+Sensors using our technology

25Scientific publications

600+Sensors using our AI engine

6People in the R&D team

20+Succesful projects since 2016

20+Training courses

Numbers matter

Page 12: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Programming

∎ Java web-services / EE

∎ Java beginner / expert

∎ C++ beginner / expert

∎ C# beginner / expert

∎ C beginner / expert

∎ JavaScript

∎ Python

∎ PHP

∎ more…

Science

∎ Big Data (Hadoop stack)

∎ Machine Learning w/ R

∎ Artificial Intelligence

∎ Computer Vision

∎ Cloud Computing

∎ Neural Networks

∎ more…

Technology

∎ Linux beginner / expert

∎ Linux device drivers

∎ Android expert

∎ Matlab/Octave

∎ Tensor Flow

∎ Spark / Scala

∎ MongoDB

∎ Spring

∎ more…

We Teach Stuff

Page 13: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

NEURAL AGEsThe proto-age

The ‘40s to 2012

First wave

The 2012 to present

«Conscious» age

The 2020: what’s next?

@vs_AR

Page 14: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

#historyLate ‘40s: McCulloch–Pitts, the artificial neuron.

The ‘50s: Rosenblatt, a successful use case.

Late ‘60s: Minsky and huge limitations to AI.

The ‘90s: Hinton & LeCun, the fathers of "deep".

more

Page 15: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 16: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 17: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 18: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 19: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

2012

Page 20: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 21: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

#2012“ImageNet Classification with deep convolutional neural networks” destroyed old school methods.

A mix of standard concepts (convolutional layers, pooling) with new insights (GPU, ReLU, Dropout).

The CNN error rate was %15.3, whereas the second closest was %26.2. Whoa!

more

Page 22: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

six folk facts

#Canada

Montreal seeks to be the world leader in AI research. Bengio is growing the next gen. of talents.

#Perception

Neural approach offers the higher accuracy ever. Often better than humans. Magic?

#Technology

GPUs , many open frameworks, thousands github projects, Gb of pre-trained models, etc.

#Rockstar

AI Scientists are media rock stars. A clip on youtube can reach for Millions views.

#Leadership

AI pioneers have left academia and entered the business world (LeCun, Andrew Ng, etc.).

#Dataset

A better (not only bigger) dataset is stronger than any good algorithm.

more

@vs_AR

Page 23: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

EVOLUTIONthe DTC paradigm

Page 26: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 27: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

@vs_AR

Page 28: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 30: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 31: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Detection, Tracking and Classification ofinstances of semantic objects of a certainclass (such as faces, humans, cars, etc.) indigital images and videos

more

@vs_AR

Page 32: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 33: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

FACE

HUMAN

CAR

PLATE

Page 34: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

@vs_AR

Page 35: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

2000

Page 37: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

2010

Page 39: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Today

Page 41: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

#analysis @vs_AR

Page 44: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 45: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 46: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

#generation (scary) @vs_AR

Page 47: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 48: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 49: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Which is real?LET'S PLAY

Page 50: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

#creativity

Page 51: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 52: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 53: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Cars

Page 56: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Humans

Page 58: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

#interaction

Page 59: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 60: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Adversarial Attacks

#Stickers!

In 2017, the attacker does notneed to know the image theyare attacking when constructingthe attack.

#Confidence

imperceptibly little noise foolsthe system but it is not enoughto fool us, the humans. Worstcase!

#Transferability

the AA not depend much on thespecific NN used - an AA patterntrained for one network seemsto confuse another one as well

#History

In 2014, a group of researchersfound that it was easy to foolConvNets with an imperceivablenoise addition.

#What?

Misclassification and falsenegative detections are themost interesting AA. Verydangerous!

#How

Adding noise, light aberrations /orientation or fooling “objects”(i.e. glasses) to the input. Toomuch simple.

@vs_AR

more

Page 61: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 62: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 63: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 64: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 65: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 66: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

State of the art face-det. NN

Page 68: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Q: an algorithm *really* detect faces?

@vs_AR

Page 69: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 70: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

BOOSTED CASCADEViola and Jones

The Viola–Jones object detection framework is thefirst object detection framework to provide competitiveobject detection rates in real-time proposed in 2001by Paul Viola and Michael Jones.[1][2]

Although it can be trained to detect a variety of objectclasses, it was motivated primarily by the problemof face detection.

- Performance: Fastest and most accurate ever,adjustable for other rigid objects (cars, humans, etc.)

- Features: One-class limitation, it’s a binary classifier.

- Idea: Haar features, integral image and early rejectionapproach.

more

Page 72: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

The anti make-up 2017

Page 74: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

From fashion to Hong Kong 2019

Page 75: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 76: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 77: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

LET’S RECAP

Trends

Many of the most important problems still remain open, both in terms of theory and in terms of applications.

Accuracy

NNs offer the highest accuracy ever in DTC. In some challenges, better than humans (i.e. face recognition).

GPU

GPU is a winning factor. All the “amazing” clip you have seen is thanks to GPUs acceleration (Nvidia / CUDA)

Evolution

From bounding box to more sophisticated description. The ultimate goal is the world comprehension. Semantic!

Framework

Detection, tracking and classification not separated anymore. One problem, one framework.

Dataset

From descriptive models to generative frameworks. Virtual data and labeling is the new frontier of NN improvement.

Page 78: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Neural Parking(AGLA Group, powered by ARGO Vision)

Page 79: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Financing a ventureItalian eco-system (2018)

more

<0.3B € - Top 15 Italian venture investments

110B € (360x) – only “virtuous” PMIs (approx. 52,000)

Page 80: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 81: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 82: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 83: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 84: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 85: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 86: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

CyclopEye Sensor

Page 87: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

CyclopEyethe neural assistant

Devices

∎ 4-6 lots per device

∎ PoE, low power

∎ 2 HD cameras

∎ Smart led

Services

∎ Space occupancy

∎ Find your car

∎ Analytics

∎ Profiling

Features

∎ Fully proprietary SW

∎ Accuracy: >99%

∎ Proprietary HW

∎ Fully stand-alone

@vs_AR

Page 88: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

CyclopEyethe neural (r)evolution

more

@vs_AR

Prototype (2016)

∎ Up to 4 lots per device

∎ Old-school classifiers

∎ Accuracy: up to 85%

∎ Dataset: 5k samples

∎ Training time: 1-5 dd

Release 1 (early 2017)

∎ Up to 6 lots per device

∎ Embedded Neural

∎ Accuracy: up to 97.0%

∎ Dataset: 50k samples

∎ Training time: 5-10 dd

Release 2 (late 2017)

∎ Up to 6 lots per device

∎ Embedded Neural ++

∎ Accuracy: >99%

∎ Dataset: 2M samples

∎ Training time: 1-5 dd

Release 3 (2019)

∎ Up to 6 lots per device

∎ More General Net ++

∎ Accuracy: >99.8%

∎ Dataset: 3M samples

∎ Training time: <12 hrs.

Page 89: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Arese Mall (Milan)

Page 90: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

5000+ Monitored lots up to 1M+ events / day

Page 91: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

drive customers from digital to physical

Page 92: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Basic

Revenues Revenues+ Revenues++

Advanced Ultimate

LED assistant“Passive” Analytics

Find-Your-Car

Parking ReservationCustomer Care ++

Third-party mktg ++Car Sharing ++

Page 93: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

The Smart Parking Competition

AGLA Group (powered by ARGO Vision)

Spain US_1 US_2

Vision Sensor

UltraSonic

In-ground

Smart lights

Info Panels

Page 94: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

5 414 601 3000

9000

25000

2017 2018 2019 2020 2021 2022

Neural Sensors (powered by ARGO Vision AI)

Installed sensors over time

Page 95: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

HOW FAR FROM ARTIFICIAL INTELLIGENCE?

@vs_AR

Page 96: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

more

https://www.youtube.com/watch?v=fa5QGremQf8

Page 97: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,
Page 98: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

PERFORMANCE?

Page 99: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

Human: 52%LipNet: 93%

Page 101: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,

OUR SPONSORS

Page 102: The DTC paradigm in the neural age - DataScienceSeed · Neural approach offers the higher accuracy ever. Often better than humans. Magic? #Technology GPUs , many open frameworks,