corporate presentation · implications for enterprise storage. market evolution will drive demand...
TRANSCRIPT
![Page 1: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/1.jpg)
Corporate Presentation2020
![Page 2: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/2.jpg)
Shuki BruckXtremIO co-founder
and Caltech professor
Introducing MemVerge
2
Charles FanVMware storage BU leader
and creator of VSAN
Yue LiCaltech post-doc and top
researcher on non-volatile memory
Founded by:
![Page 3: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/3.jpg)
World-class team in Silicon Valley assembled from:
Introducing MemVerge
3
![Page 4: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/4.jpg)
Digital Transformation is Widespread
91.1% of enterprises undergoing DX in the next three yearsMore data-centric business models will drive AI/ML-infused analyticsPerformance and availability implications for enterprise storageMarket evolution will drive demand for persistent memory technologies
4
DX Maturity Distribution
IDC: Digital Transformation Driving New “Big Memory” Requirements
![Page 5: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/5.jpg)
Realtime Workloads are on the Rise
Worldwide, data is growing at a 26.0% CAGR, and in 2024 there will be 143 zettabytes of data created
By 2021, 60-70% of the Global 2000 will have at least one mission-critical real-time workload
5IDC: Digital Transformation Driving New “Big Memory” Requirements
![Page 6: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/6.jpg)
PM Revenue Forecast, 2019 - 2023
6IDC: Digital Transformation Driving New “Big Memory” Requirements
Byte-Addressable Only
$0.00
$500.00
$1,000.00
$1,500.00
$2,000.00
$2,500.00
$3,000.00
Revneue ($M)
2019 2020 2021 2022 2023
REVE
NU
E ($
M)
$2609M
248% CAGR 2019-2023
$65M
![Page 7: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/7.jpg)
Long Term Forecast
Emerging memories are well on their way to reach $36 billion of combined revenues by 2030.
3D XPoint memory’s sub-DRAM prices are expected to drive revenues to over $25 billion by 2030
7
Emerging Memories Find Their Direction: Objective Analysis and Coughlin Associates
![Page 8: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/8.jpg)
Big Memory Definition
• Enables the ability to run applications in memory for improved performance and efficiency
• Leverages byte addressable persistent memory media
• Includes enterprise-class data services to handle tier 1 availability and management requirements
• Runs as a software-based memory virtualization layer on industry standard hardware
• The technology enabler for mission-critical real-time computing
8IDC: Digital Transformation Driving New “Big Memory” Requirements
CAPACITY STORAGE
BIG MEMORY
(DRAM, PM)
COMPUTE
CAPACITY STORAGE
MEMORY
COMPUTE
PERFORMANCESTORAGE
OLD MODEL BIG MEMORYCOMPUTING
![Page 9: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/9.jpg)
All applications live in memory
9
Our BIG MEMORY vision
![Page 10: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/10.jpg)
Open the door to Big Memory
10
Our Mission
A world of abundance, persistence and high availability
![Page 11: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/11.jpg)
11
Intel® optane™ dc persistent memoryRevolutionizing memory
![Page 12: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/12.jpg)
Not plug-and-playApp rewrite needed
Why Not All Apps Can Run in Memory yet…
12
Can’t share memorySiloed in servers
No Data ServicesCrash recovery is slow
![Page 13: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/13.jpg)
SoftwareSubscription
MemVerge Memory Machine™
13
VirtualizesDRAM & PMEM
Low LatencyPMEM over RDMA
Plug CompatibleNo re-writes
Memory Data ServicesSnapshot, Replication, Tiering
Memory Machine
Memory Machine
![Page 14: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/14.jpg)
Big Memory = Optane + Memory Machine
14
Multiple Memory Machines form amemory lake that makes memory
abundant
RDMA let’s Memory Machinescommunicate withultra-low latency
Intel Optane makes memory persistent
Memory Machine snapshots, replication, and lightning fast recovery make persistent memory
highly available
![Page 15: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/15.jpg)
Single-Node Memory Machine™ Implementation
15
Transparent Memory Service
Persistent Memory Allocator
Distributed Persistent Memory Engine
Big Memory Programming Model
SDK
Network ReplicationInstant SnapshotMemory Tiering
Machine LearningTrading / Market Data
Pub/Sub
In-Memory Analytics HPC
In-Memory Checkpointing
![Page 16: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/16.jpg)
Multi-Node Memory Machine™ Implementation
16
Transparent Memory Service
Persistent Memory AllocatorCluster Manager RDMA Transport
Big Memory Programming Model
SDK
RDMA RDMA RDMA RDMA
Distributed Persistent Memory Engine
CloningInstant SnapshotMemory Tiering RDMA Replication
Machine LearningTrading / Market Data
Pub/Sub
In-Memory Analytics HPC
In-Memory Checkpointing
![Page 17: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/17.jpg)
Microseconds matterIn-Memory databases used
Financial Services are Killer Apps for Big Memory
17
Data > memoryMore capacity needed
Growing blast zoneMemory data services needed
![Page 18: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/18.jpg)
According to IDC, by 2021, 60-70% of the Global 2000 organizations will have at least one mission-critical real-time workload. Below are just a few examples of use cases that are implementing Big Memory now.
Uses Cases: Real-Time Workloads
18
Latency-sensitive transactional workloads such as high-frequency
trading
Real-time big data analytics in financial
services, healthcare, and retail
AI/ML analytics and inferencing like fraud detection and smart
security
![Page 19: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/19.jpg)
Real Time Market Data Pub/Sub
Objectives1. Market data event stream
published to multiple subscribers with the lowest latency
2. Achieve fairness between the subscriber processes
3. Persist the event stream without incurring significant performance penalties
19
Memory Machine Use Case #1
Publisher
Subscribers
Memory Lake
![Page 20: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/20.jpg)
Real Time Market Data Pub/Sub
Solution1. Memory Machine™ software writes
market data event stream to an in-memory bus
2. Background process commits the event stream to Persistent Memory synchronously or asynchronously
3. The event stream is replicated over RDMA to memory of other servers
4. Subscriber processes across all servers read the event stream with low latency
20
Memory Machine Use Case #1
![Page 21: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/21.jpg)
Real Time Market Data Pub/SubResults with 210 Subscribers
21
Memory Machine Use Case #1
![Page 22: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/22.jpg)
Real Time Market Data Pub/SubResults
22
Memory Machine Use Case #1
0.5 uS Avg. latency local host
3 uS Avg. latency remote host
<2x avg.99.9% tail latency
![Page 23: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/23.jpg)
In-Memory Database Cloning & Crash Recovery
Problem1. Need to run analytics, reporting or
dev/test but concerned about taking performance hit on Primary instance
2. Application takes a long time to restart after crash or planned shutdown
23
Memory Machine Use Case #2
![Page 24: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/24.jpg)
In-Memory Database Cloning & Crash Recovery
Solution1. Memory Machine takes instant
snapshot, as frequently as every 1 minute
2. In-Memory Cloning easily creates a read replica of the primary instance using snapshot plus log replay
3. Fast restart from the database crash using snapshot plus log replay
24
Memory Machine Use Case #2
+
Snapshot
CloneReplay
Restart
![Page 25: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/25.jpg)
Results
25
Every MinuteFine grained Snapshots
FastClone and Crash Recovery
ZeroPerformance hit
In-Memory Database Cloning & Crash RecoveryMemory Machine Use Case #2
![Page 26: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/26.jpg)
Big Memory AI/ML Training and Inference
Problem1. When data is greater than the size
of DRAM, AI/ML performance slows down dramatically
2. Memory-intensive inference jobs take a long time to load and restart
26
Memory Machine Use Case #3
![Page 27: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/27.jpg)
Big Memory AI/ML Training and Inference
Solution1. Create big memory lakes
consisting of DRAM and PMEM to provide capacity needed for all data including models and embeddings
2. Fast data recovery and restart by using in-memory data snapshot
27
Memory Machine Use Case #3
SnapshotClone
ReplayRestart
Memory Lake
![Page 28: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/28.jpg)
Big Memory AI/ML Training and Inference
28
Memory Machine Use Case #3
Test results: 1000 libs (1 million records) case
0
5
10
15
20
25
30
1 2 4 8 16 32 64 128 256
TPS
Mongo+DRAM Memory Engine
0
100000
200000
300000
400000
500000
600000
700000
800000
900000
1000000
1 2 4 8 16 32 64 128 256
Data access latency
Mongo+DRAM(us) Memory Engine(us)
![Page 29: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/29.jpg)
Big Memory AI/ML Training and Inference
29
Memory Machine Use Case #3
Results
Up to 4xTransactions per second
Up to 100xLower latency
50%Cost savings vs DRAM
![Page 30: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/30.jpg)
1. Persistent Memory will be mainstream and data Infrastructure will be memory-centric.
2. Big Memory, consisting of PMEM and DRAM, will achieve petabyte-scale over clusters of servers interconnected by next-gen memory fabrics
3. Big Memory software will be needed to offer data services in memory, and every application will be run in-memory.
MemVerge Vision for Big Memory Industry
30
By 2025…
![Page 31: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/31.jpg)
MemVerge Vision for Big Memory Industry
31
Compute
Memory
Performance Storage
Capacity Storage
Compute
Big Memory
Capacity Storage
![Page 32: Corporate Presentation · implications for enterprise storage. Market evolution will drive demand for persistent memory technologies. 4 ... • The technology enabler for mission](https://reader033.vdocuments.us/reader033/viewer/2022051916/60080ffd10ccb561b42a617b/html5/thumbnails/32.jpg)
What happens in memorystays in memory…