deep learning in storage - snia · 1 © 2016 wipro ltd | | confidential deep learning in storage...
TRANSCRIPT
![Page 1: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/1.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 1
Deep Learning in
Storage
Champak Kumar Dutta, Subhendu
Banerjee
Senior Architect
![Page 2: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/2.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 2
Deep Learning Applications in IT
Deep Learning Applications in Storage
![Page 3: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/3.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 3
Deep Learning Applications
IT - General
![Page 4: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/4.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 4
Image Processing Example (CNN)
![Page 5: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/5.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 5
Image Processing – Overview I
The easiest way to understand a convolution is by thinking of it as a sliding window function applied to a matrix. It becomes quite clear looking at a visualization:
The sliding window is called a kernel, filter, or feature detector. Here we use a 3×3 filter, multiply its values element-wise with the original matrix, then sum them up.
![Page 6: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/6.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 6
Image Processing – Overview II
https://adeshpande3.github.io/adeshpande3.github.io/A-
Beginner's-Guide-To-Understanding-Convolutional-Neural-
Networks/
![Page 7: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/7.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 7
Stock Prediction Example (RNN and LSTM)
![Page 8: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/8.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 8
Stock Market Example - Process
![Page 9: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/9.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 9
Person-Movie Relationship – RBM/Autoenc
M1 M2 M3 M4 M5 M6 M7 M8
P1 1 1 1
P2 1
P3 1
P4 1 1
P5 1
P6 1
Person to Model, Model to Person, Model Strength
SVD (Matrix representation)
![Page 10: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/10.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 10
RBM
https://deeplearning4j.or
g/restrictedboltzmannma
chine
![Page 11: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/11.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 11
NLP Example
Term Frequency, Inverse Document Frequency - tfidf
Word Representation
One hot: [1,0,0,0], [0,1,0,0], [0,0,1,0], [0,0,0,1]
Vector Representation and Cosine Similarity
Word2Vec
King Queen Man Woman
Familiarity 0.90 0.9 0.02 0.02
Wealth 0.90 0.99 0.5 0.5
Gender ….
Other Attr
![Page 12: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/12.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 12
Deep Learning Applications
IT - Storage
![Page 13: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/13.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 13
Prefetching
![Page 14: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/14.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 14
Vector Representation example
Physical location of block
File it belongs to
User who owns the file
Creation time
Access time
![Page 15: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/15.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 15
Use Cases
VM Migration
PreCopy and Post Copy
PostCopy results in network fault and copies faulted data. Also
prefetches pages
Vector representation – Pages belonging to schedulable
processes
Tiering
Block movement between Tiers
Predicting blocks to be accessed in near future
NFS - 4.2 has application hint for caching
Cache or no cache
No application intelligence
Local FS – Read ahead size
![Page 16: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/16.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 16
Capacity/Performance
![Page 17: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/17.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 17
Use cases
Power Consumption in Data Center – Historical Power
consumption Data, CPU Memory Utilization, IO/Network
Workload
Performance Modelling and Prediction inter-arrival time,
and sequential-scan run-length, queue time, seek and
rotational latency, transfer time, sequential/random,
read/write ratio – CART (Classification and Regression
Tree) model
Parameter selection – additive and subtractive
CART model - CUT points are chosen
RBM to get latent features - subsequent regression can find the metric
![Page 18: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/18.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 18
Predictive Failure
![Page 19: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/19.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 19
Use cases
“Recently, LSTM autoencoders and encoder-decoder
frameworks have been used as reconstruction
models where some form of reconstruction error is used as
a measure of anomaly. The idea behind such models is:
autoencoder is trained to reconstruct the normal time-series
and it is assumed that such a model would do badly to
reconstruct the anomalous time-series having not seen
them during training.”
![Page 20: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/20.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 20
Miscellaneous
![Page 21: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/21.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 21
Parameters
Load Balancing – some of the parameters
Latency
Response Time
Reject connection count
Generalized Resource Management
Protocol Detection
![Page 22: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/22.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 22
References
http://web.cs.iastate.edu/~cs577/handouts/svd.pdf
https://www.slideshare.net/ananth/word-representation-svd-lsa-
word2vec
http://ieeexplore.ieee.org/document/7576472/
https://www.quora.com/How-do-I-use-LSTM-Networks-for-time-
series-anomaly-detection
![Page 23: Deep Learning in Storage - SNIA · 1 © 2016 WIPRO LTD | | CONFIDENTIAL Deep Learning in Storage Champak Kumar Dutta, Subhendu Banerjee Senior Architect](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d2e007d83ca29a25fadc6/html5/thumbnails/23.jpg)
© 2016 WIPRO LTD | WWW.WIPRO.COM | CONFIDENTIAL 23
Champak, Subhendu
Senior Architect