who moved my bits? - snia · val bercovici technology & strategy . office of the cto . who...
TRANSCRIPT
![Page 1: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/1.jpg)
Val Bercovici Technology & Strategy Office of the CTO
Who Moved My Bits?
![Page 3: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/3.jpg)
![Page 4: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/4.jpg)
Research Layer Cake
Social Mobile Analytics Cloud
Storage Ramifications
Supply Chain Trends
![Page 5: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/5.jpg)
History – Storage Concentration
5
Access Latency
$$$ DISK
DRAM 2005
Nearline
Enterprise Short Stroke
NetApp, EMC, etc.
TAPE
![Page 6: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/6.jpg)
Trend – Storage diversity
6
Access Latency
$$$
DISK
DRAM
TAPE
2015 SCM?
FLASH SLC
eMLC MLC cMLC
TLC Nearline
Cloud Archive
Spin down
Performance
Capacity
?
![Page 7: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/7.jpg)
The new Bible
7
Slides: http://www.eclipsecon.org/2013/sites/eclipsecon.org.2013/files/OGrady_the-new-kingmakers-eclipsecon.pdf
E-Book: http://try.newrelic.com/rs/newrelic/images/The_New_Kingmaker.pdf
![Page 8: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/8.jpg)
8
![Page 9: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/9.jpg)
Wither SQL/ACID? (Big) Data Trends
![Page 10: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/10.jpg)
Data models originating from App Svcs offer in-built data mgnt features & granular SLAs
Physical Infrastructure
10
Application Development/Deployment (PaaS)
Devel Services Versioning Messaging Security/Id
entity
Emerging Architecture for App Development
Runtime Data Services
PaaS platforms bundle wide range of data services with pure app middleware features
File/Block Object Key-Value Columnar Relational Document Batch
Unified Infrastructure Orchestration Security | Provisioning | SLA Monitoring | Logging
Infra as a Service platforms offer storage management for free/fee
Storage (Disk/Flash) Server
Network
Physical infrastructure formally abstracted as all data/infra management is S/W defined
VMWare
VMWare App
Services
Data Services
Infra Services
Infra
Dedicated
VMWare App Stack Amazon
App Stack New app platforms are offering flexible data models for: Operational Efficiency Performance at scale
![Page 11: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/11.jpg)
Beyond the Hype
![Page 12: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/12.jpg)
Software Defined Everything
![Page 13: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/13.jpg)
OpenStack
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID
Image
Object Storage
Object Storage
Block Storage
Block Storage
Compute
Persistent, rapid, space-efficient instances
Shared Files
Shared FileSystems
![Page 15: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/15.jpg)
Enterprise Application Landscape
15
Application
Traditional Current/ Evolving Emerging Future PaaS
(CloudFoundry, Heroku, …)
Data Model
Block, File Key-Value Store
Columnar, Document,
Graph Polyglot
NoSQL NewSQL
![Page 16: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/16.jpg)
NetApp Application Managers: Context
16
NFS/ Block/ LRSE
cDOT
Application
Data Model
Server-side Persistence Store
Server
NetApp Application Manager
Operating System
Hypervisor
NAM Cluster
![Page 17: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/17.jpg)
Wither OSI? Networking Trends
Software Defined Networks
Network: 1.Virtualization 2.Correctness 3. Abstraction
![Page 18: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/18.jpg)
Future Networks? EthernetPCIMemory
![Page 19: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/19.jpg)
Wither Disk ? and later Wither Flash ??
19
1M
100K
10K
1K
100
10
1
![Page 20: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/20.jpg)
Why Storage Class Memory means the end of traditional Storage Networking. DRAM ≈ 20ns latency Assume 50ns SCM access time (DRAM speed) PCIe, InfiniBand latency ≈ 1 μsec = 21x latency Speed of light in optical fiber ≈ .65 ft / nsec
20
+
5’ server rack
5 ft = 15nsec = 1.75x penalty
10 ft = 30nsec = 2.5x penalty
+ 40 ft = 120nsec = 6x penalty
storage appliance
![Page 21: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/21.jpg)
New Data Center Storage Stack Circa 2017
21
Shared Storage
Distributed / Parallel Processing
Compute Node
Cache Node
Compute Node
Cache Node
Compute Node
Cache Node
Compute Node
Cache Node
Compute Node
Cache Node
Independent scaling
Persistence / Intelligent Caching Layer
Data Globally Managed by
Federated / Shared Storage
SCM
Mem Mem Interconnect
Host Cache
SW
XaaS
![Page 22: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/22.jpg)
Looking Back in order to
Look Forward!
![Page 23: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/23.jpg)
Historical Context
http://antranik.org/using-moores-law-to-predict-future-memory-trends/
![Page 24: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/24.jpg)
Science (Fiction?) http://www.singularity.com/charts/page70.html
![Page 25: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/25.jpg)
IBM Watson – Circa 2010! (SCM + Fast Interconnect + Hadoop)
http://en.wikipedia.org/wiki/Watson_(computer)
![Page 26: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?](https://reader030.vdocuments.us/reader030/viewer/2022011807/5c23979309d3f2e14f8bbf11/html5/thumbnails/26.jpg)