who moved my bits? - snia · val bercovici technology & strategy . office of the cto . who...
Post on 26-Dec-2018
215 Views
Preview:
TRANSCRIPT
Val Bercovici Technology & Strategy Office of the CTO
Who Moved My Bits?
Research Layer Cake
Social Mobile Analytics Cloud
Storage Ramifications
Supply Chain Trends
History – Storage Concentration
5
Access Latency
$$$ DISK
DRAM 2005
Nearline
Enterprise Short Stroke
NetApp, EMC, etc.
TAPE
Trend – Storage diversity
6
Access Latency
$$$
DISK
DRAM
TAPE
2015 SCM?
FLASH SLC
eMLC MLC cMLC
TLC Nearline
Cloud Archive
Spin down
Performance
Capacity
?
The new Bible
7
Slides: http://www.eclipsecon.org/2013/sites/eclipsecon.org.2013/files/OGrady_the-new-kingmakers-eclipsecon.pdf
E-Book: http://try.newrelic.com/rs/newrelic/images/The_New_Kingmaker.pdf
8
Wither SQL/ACID? (Big) Data Trends
Data models originating from App Svcs offer in-built data mgnt features & granular SLAs
Physical Infrastructure
10
Application Development/Deployment (PaaS)
Devel Services Versioning Messaging Security/Id
entity
Emerging Architecture for App Development
Runtime Data Services
PaaS platforms bundle wide range of data services with pure app middleware features
File/Block Object Key-Value Columnar Relational Document Batch
Unified Infrastructure Orchestration Security | Provisioning | SLA Monitoring | Logging
Infra as a Service platforms offer storage management for free/fee
Storage (Disk/Flash) Server
Network
Physical infrastructure formally abstracted as all data/infra management is S/W defined
VMWare
VMWare App
Services
Data Services
Infra Services
Infra
Dedicated
VMWare App Stack Amazon
App Stack New app platforms are offering flexible data models for: Operational Efficiency Performance at scale
Beyond the Hype
Software Defined Everything
OpenStack
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID
Image
Object Storage
Object Storage
Block Storage
Block Storage
Compute
Persistent, rapid, space-efficient instances
Shared Files
Shared FileSystems
Enterprise Application Landscape
15
Application
Traditional Current/ Evolving Emerging Future PaaS
(CloudFoundry, Heroku, …)
Data Model
Block, File Key-Value Store
Columnar, Document,
Graph Polyglot
NoSQL NewSQL
NetApp Application Managers: Context
16
NFS/ Block/ LRSE
cDOT
Application
Data Model
Server-side Persistence Store
Server
NetApp Application Manager
Operating System
Hypervisor
NAM Cluster
Wither OSI? Networking Trends
Software Defined Networks
Network: 1.Virtualization 2.Correctness 3. Abstraction
Future Networks? EthernetPCIMemory
Wither Disk ? and later Wither Flash ??
19
1M
100K
10K
1K
100
10
1
Why Storage Class Memory means the end of traditional Storage Networking. DRAM ≈ 20ns latency Assume 50ns SCM access time (DRAM speed) PCIe, InfiniBand latency ≈ 1 μsec = 21x latency Speed of light in optical fiber ≈ .65 ft / nsec
20
+
5’ server rack
5 ft = 15nsec = 1.75x penalty
10 ft = 30nsec = 2.5x penalty
+ 40 ft = 120nsec = 6x penalty
storage appliance
New Data Center Storage Stack Circa 2017
21
Shared Storage
Distributed / Parallel Processing
Compute Node
Cache Node
Compute Node
Cache Node
Compute Node
Cache Node
Compute Node
Cache Node
Compute Node
Cache Node
Independent scaling
Persistence / Intelligent Caching Layer
Data Globally Managed by
Federated / Shared Storage
SCM
Mem Mem Interconnect
Host Cache
SW
XaaS
Looking Back in order to
Look Forward!
Historical Context
http://antranik.org/using-moores-law-to-predict-future-memory-trends/
Science (Fiction?) http://www.singularity.com/charts/page70.html
IBM Watson – Circa 2010! (SCM + Fast Interconnect + Hadoop)
http://en.wikipedia.org/wiki/Watson_(computer)
top related