thunderx2: end2end from silicon to system delivery€¦ · thunderx2: end2end –from silicon to...
TRANSCRIPT
![Page 1: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/1.jpg)
ThunderX2: End2End – From Silicon to System Delivery
Larry Wikelius – VP Software Ecosystem & Partner Enabling
![Page 2: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/2.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 2
Arm based Server CPUs are a compelling alternative
Highest performance
efficiency
Open architecture
Industry Standards
Broad ecosystem
Lowest TCO1991 2013 2017 2021
22 years
4 years
4 years
50 billionchips shipped
50 billionchips shipped
100 billionchips expected to ship
Arm: The industry’s architecture of choice130+ billion chips shipped since 1990
![Page 3: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/3.jpg)
Marvell – A Leader in Infrastructure Semiconductor Solutions
© 2019 Marvell Confidential, All Rights Reserved. 3
![Page 4: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/4.jpg)
Marvell Confidential
COMPANY FOUNDED
1995EMPLOYEES
5,000+LOCATED IN
Santa Clara, CA
R&D CENTERS
US, Israel, India,
Germany, China
4
Overview
MOST RESPECTED
SEMICONDUCTOR COMPANY PATENTS WORLDWIDE
10,000+
FY19 REVENUE
$2.9B
![Page 5: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/5.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 5
Marvell delivers the essential building blocks for infrastructure
StorageHDD & SSD controllers, Fibre Channel
SecurityFIPS and virtual offload
ComputingServer, baseband and embedded processors
NetworkingEthernet switches, PHYs, NICs
Data Center Storage SolutionsNVMe aggregators, accelerators
& converters
AutomotiveSecure Ethernet, PHYs, storage & Wi-Fi
Wireless ConnectivityWi-Fi access points & clients
Artificial IntelligenceAccelerators and offload processors
![Page 6: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/6.jpg)
6
In Production now
ThunderX2 Second Generation High-End Armv8-A Server SoC
Marvell designs the SOC
• Arm architectural license
• Custom micro-architecture design
• Optimized for key target workloads
![Page 7: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/7.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 7
Enabling the HW & System SW Ecosystem
Reference System Implementation
• Full Chip/System collateral
• SBSA and SBBR standards based
• Lead Partner ODM
• Reference FW Implementation – UEFI & BMC
• Upstream kernel support – prior to silicon
Chip and System Testing & Optimization:
• IHV AVL – networking & storage
• Stress and performance testing
• OS, compiler, tools enablement
![Page 8: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/8.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 8
Moving from x86 to Armv8/ThunderX2 made easy
Same development costs:
• OS, Tools & applications
• Management tools & infrastructure
Same deployment costs:
• Chassis, heat sinks, fans, power supply as x86
• Manufacturing tools & assemblies
![Page 9: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/9.jpg)
Success Stories with Target Use Cases
© 2019 Marvell Confidential, All Rights Reserved. 9
![Page 10: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/10.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 10
Marvell ThunderX2® well-suited for data center applications
Arm-nativeBig Data/HPC Cloud Compute
![Page 11: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/11.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 11
Marvell powers the world’s fastest Arm supercomputerDriven by 145,512 ThunderX2 cores
Securing U.S. nuclear arsenal
![Page 12: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/12.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 12
Marvell ThunderX2 enables efficient computing for Department of EnergyMaximizes usable operations instead of peak FLOPS for national security research
![Page 13: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/13.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 13
Marvell ThunderX2 is Azure’s Arm-based server platform of choice
![Page 14: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/14.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 14
Marvell ThunderX2 powers memory intensive applications at CEA
Running scenario modeling in support of France’s Nuclear Energy and Defense arsenal
![Page 15: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/15.jpg)
Marvell-University of Michigan Partnership
15
Built on long Cavium/Marvell-Michigan relationship
Deploy ThunderX for Big Data● 4800 Cores● 25 TB Memory● 40 & 100 Gbps networking● 3 PB Hadoop File System
Accelerating the software ecosystem for data science for ARM.
Directly consuming Linaro Big Data software builds
We bring an advanced user base in the data science domain
![Page 16: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/16.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 16
Cadence Commercial EDA Solution on Marvell ThunderX2
Xcelium™
Simulation
Indago™
Debug
Verification IP
JasperGold™
Formal
vManager™
Plan & Metrics
Specman™
Engine
Flexera™
Licensing
![Page 17: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/17.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 17
Benchmarks
![Page 18: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/18.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 18
Marvell ThunderX2 beats Intel
Xeon Skylake
ThunderX2
1.15
1
Maximum cores
1.15
1
Number of I/O lanes
1.33
1
Memory bandwidth
2
1
Full SoC perf/$
Better application
throughput
Lower application
latency
Flexible
networking/storage Compelling performance/$
Source: Intel & Marvell data sheets
![Page 19: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/19.jpg)
$0
$1,000
$2,000
$3,000
$4,000
$5,000
Marvell ThunderX2 Intel Xeon Skylake
Total cost
CPU CHIPSET
0
50
100
150
200
250
Marvell ThunderX2 Intel Xeon Skylake
Total power
CPU CHIPSET
© 2019 Marvell Confidential, All Rights Reserved. 19
Marvell ThunderX2 delivers a significantly lower TCO
15% LESS POWER 45% LOWER COST
Source: Intel & Marvell data sheets
![Page 20: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/20.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 20
Marvell ThunderX2 Processors are Optimized for Cloud
• Higher core count → Improved application throughput
• Higher thread count → More VMs per server
• Higher memory bandwidth & memory capacity → Improved application latency
• Lower acquisition cost – Better Performance/$$$
Comparison between Intel 6148 Gold with 32 core 2.2GHz
1 1.14 1.16 1.33 1.33
2.28
0
0.5
1
1.5
2
2.5
Intel Core Count IO Bandwidth Memory Bandwidth Memory Capacity Number of Threads
![Page 21: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/21.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 21
Marvell ThunderX2 Delivers Compelling Value Proposition for HPC
• More cores → Higher perf for compute bound applications
• Higher memory bandwidth → Higher perf for majority of HPC applications
• Lower acquisition cost → Better performance/$$$
11.14
1.33
0
0.2
0.4
0.6
0.8
1
1.2
1.4
Intel Core Count Memory Bandwidth
Comparison between Intel Skylake Gold 6148 vs. ThunderX2 CN9980
Source: AnandTech and other publicly-available sources
![Page 22: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/22.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 22
Marvell ThunderX2 is perfect for Android in the Cloud
Application
Native virtualization layer
Aarch64 0
2
4
6
Latency (lower is better)
Penalty ~ 5X
• Native execution, no emulation
• Full hypervisor/container support
• Highest Arm application density per $
Application
Emulation Layer (Arm to x86 translation)
x86
Source: Intel & Marvell data sheets
Intel
Intel
![Page 23: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/23.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 23
Call to Action – Now What?
![Page 24: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/24.jpg)
© 2019 Marvell Confidential, All Rights Reserved. 24
Linaro opportunities to further accelerate Arm based Server Adoption
• Continue to show leadership in upstream – especially kernel and compilers/tools
• Learn from and replicate Big Data Hadoop project
• Successful engagement with Apache
• Focused Use Case that has NO commercial alternative on Arm
• Work directly with lead end users
• Walk the Talk – drive internal development and deployment infrastructure to be 100% Arm based
• Expand lead end user engagements – HPC SIG is a model to further invest/grow
![Page 25: ThunderX2: End2End From Silicon to System Delivery€¦ · ThunderX2: End2End –From Silicon to System Delivery Larry Wikelius –VP Software Ecosystem & Partner Enabling](https://reader034.vdocuments.us/reader034/viewer/2022043004/5f851c89e3834b641b400fee/html5/thumbnails/25.jpg)