fusion-io open house - 9 million iops cleared for take off

32
Fusion-io Confidential—Copyright © 2013 Fusion-io, Inc. All rights reserved. Copyright © 2013 Fusion-io, Inc. All rights reserved. SDK Technology Open House March 26, 2013

Upload: sandisk

Post on 17-Dec-2014

2.165 views

Category:

Technology


2 download

DESCRIPTION

On March 9, 2013, Fusion-io announced the ability to deliver more than nine million I/O operations per second (IOPS) from a single ioDrive2. This feat showcases Fusion-io technology’s ability for issuing small persistent writes to POSIX files on an ioDrive2 at near DRAM speeds. We have begun to apply these leading-edge technologies to revolutionize common industry workloads, such as transaction logging. This work is the first wave of coming changes to the memory-storage hierarchy, where non-volatile memory is accessed like memory and managed like storage. Memory suppliers are working to provide a whole family of non-volatile memory mediums so companies like Fusion-io can build next-generation storage systems. This demonstration showcases an ioDrive that is being accessed at near-DRAM speeds, while being managed like storage through common file system mechanisms. http://www.fusionio.com/overviews/9m-iops-technology-showcase/

TRANSCRIPT

Page 1: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Fusion-io Confidential—Copyright © 2013 Fusion-io, Inc.  All rights reserved.Copyright © 2013 Fusion-io, Inc.  All rights reserved.

SDK Technology Open HouseMarch 26, 2013

Page 2: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Safe harbor disclosureForward Looking Statements

Certain statements in this presentation may constitute "forward-looking statements" within the meaning of Section 21E of the Securities Exchange Act of 1934 and Section 27A of the Securities Act of 1933, including, but are not limited to, statements concerning the expected benefits and value of our products and solutions to our customers and end users, our continued focus and investment on innovation, our efforts to expand our product portfolio, our position to capture market share and our expectations regarding market trends, our expectations concerning our technologies, products and solutions, including our ioMemory platform and software products, and our beliefs concerning the market for and benefits of our products and solutions, including our recently announced Fusion ioScale product line, and our recent acquisition of ID7. These statements are based on current expectations and assumptions regarding future events and business performance and involve certain risks and uncertainties that could cause actual results to differ materially from those contained, anticipated, or implied in any forward-looking statement, including, but not limited to, risks associated with changes in the demand for our products, the continued adoption by customers of our ioMemory platform products, changes in the competitive dynamics of our markets, our ability to develop or acquire new products to meet customer needs and expectations, including additional software solutions to be integrated with our storage memory products, our acquisition and strategic partner strategy and disruptions in our business, operations and financial results as a result of acquisitions and strategic partner relationships, as well as the risks inherent in the integration and combination of complex products and technologies from acquisitions, undetected errors, defects or security vulnerabilities in our products, worldwide economic conditions and the impact these conditions have on levels of spending on datacenter technology like ours, and such other risks set forth in the registration statements and reports that Fusion-io files with the U.S. Securities and Exchange Commission, which are available on the Investor Relations section of our website at www.fusionio.com. You should not rely upon forward-looking statements as predictions of future events. Although we believe that the expectations reflected in the forward-looking statements are reasonable, we cannot guarantee that the future results, levels of activity, performance or events and circumstances reflected in the forward-looking statements will be achieved or will occur. Fusion-io undertakes no obligation to update publicly any forward-looking statement for any reason after the date of this press release.

2

Page 3: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Fusion-io Confidential—Copyright © 2013 Fusion-io, Inc.  All rights reserved.Copyright © 2013 Fusion-io, Inc.  All rights reserved.

David Flynn, CEO & Chairman

Overview & Introductions

Page 4: Fusion-io Open House - 9 Million IOPs cleared for Take Off

April 10, 2023 4

MORE THAN HALF A BILLION DEVICESCONNECTED IN U.S. HOMES

Source: http://www.latimes.com/business/technology/la-fi-tn-internet-devices-homes-20130318,0,7223925.story

Page 5: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Source: http://www.pcadvisor.co.uk/news/digital-home/3435700/average-user-carries-29-devices----sophos/

AVERAGE USER: 2.9 CONNECTED DEVICES

Page 6: Fusion-io Open House - 9 Million IOPs cleared for Take Off

CLOUD TRANSACTIONSLOG TO PHYSICAL DATACENTERS

Page 7: Fusion-io Open House - 9 Million IOPs cleared for Take Off

D I S K D R I V E S : O B S O L E T E H A R D WA R E

D O S C O D E P E R S I S T S

Page 8: Fusion-io Open House - 9 Million IOPs cleared for Take Off

INEFFICIENCIES OF DISK ERA ARCHITECTURES

Page 9: Fusion-io Open House - 9 Million IOPs cleared for Take Off

REMOVE BOTTLENECKSTO MEET REAL-TIME DEMANDS

Page 10: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Evolution of Architecture

April 10, 2023 10

FLASH AS DISK

PC

IeS

AS

DRAM

NAND

Host CPU

RAIDController

AppOS

SC

SC

Super Capacitors

PC

Ie

DRAM

Host CPU

App

FLASH AS MEMORY

Data path Controller

OS

Page 11: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Consistent Application Performance

April 10, 2023 11

SSD Queuing behind slow writes causes SSD latency spikes

ioMemory

ioMemory balances read/write performance for consistent throughput

Page 12: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Evolution of Enterprise Flash

FLASH + DISK FLASH AS DISK FLASH BEYOND DISK FLASH AS MEMORY

Page 13: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Introductions

Pankaj MehraOffice of the CTO

Nisha TalagalaFusion-io Lead Architect

Page 14: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Fusion-io Confidential—Copyright © 2013 Fusion-io, Inc.  All rights reserved.Copyright © 2013 Fusion-io, Inc.  All rights reserved.

Beyond Flash: Runway to 9M+ IOPS

Pankaj MehraOffice of the CTO

Page 15: Fusion-io Open House - 9 Million IOPs cleared for Take Off

ACCESSED WITH THE SPEED AND SIMPLICITY OF MEMORY

MANAGED WITH THE FAMILIARITY AND CAPACITY OF STORAGE

Page 16: Fusion-io Open House - 9 Million IOPs cleared for Take Off

April 10, 2023 16

Hybrid Memory-Storage Hierarchy

L1, L2, L3 CPU Caches DRAM PersistentMemories Flash Hard Drive

Mi c ros ec ondsN anos ec onds

CYCLES TO WAIT

Hybrid Memory Storage Hierarchy

Main Memory System High Performance Disk System

Accessed Like Memory and Managed Like Storage

Mi l l i s econds

ACCESS DELAY

2 c y c l es 4 m i l l i on c y c l es

Page 17: Fusion-io Open House - 9 Million IOPs cleared for Take Off

TAP INTO PERFORMANCE NOT AVAILABLE WITH CONVENTIONAL SSDS

REDUCE SERVER COSTS BY HANDLING MORE WORKLOAD ON EACH SERVER

WRITE LESS CODE TO CREATE HIGH-PERFORMING APPS

EXTEND FLASH ENDURANCEBY REDUCING UNNECESSARY WRITES

… ALL WHILE USING A FAMILIAR FILE SYSTEM INTERFACE

Page 18: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Fusion-io Confidential—Copyright © 2013 Fusion-io, Inc.  All rights reserved.Copyright © 2013 Fusion-io, Inc.  All rights reserved.

9M IOPS: Cleared for TakeoffNisha Talagala, Lead Architect

Page 19: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Evolution of Enterprise Flash

FLASH AS DISK

Application

Application source code converts native data structures into block I/O

Conventional I/O Access

Block I/O

Proprietary Storage OS

FLAS H BE Y O N D D I SK

Application

Application source code does I/O with native data structures

Native: Enhanced I/O

Atomic I/OTransaction

Key-ValueTransaction

User-DefinedObject

Transaction

Open Interface Layer

FLAS H AS ME MO RY

Application

Application source code manipulates native data structures

directly in persistent memory

Native: Persistent Memory

High-speedLogging

MemoryTransaction

Checkpointed Memory

Open Interface Layer

Page 20: Fusion-io Open House - 9 Million IOPs cleared for Take Off

April 10, 2023 Fusion-io Confidential 20

9M IOPS: Technology Building Blocks

Transaction Logging Interface:Software library providing persistent transaction logging at memory speeds

Auto-Commit Memory:Transparently bonds persistent, byte-addressable memory with flash memory

directFS: POSIX file system native to ACM and flash memory

Page 21: Fusion-io Open House - 9 Million IOPs cleared for Take Off

April 10, 2023 21

directFS: Direct File System

▸Appears as Linux file system• Provides performance to applications “as is” • Focuses only on file namespace

▸Employs existing flash translation layer for:• Large virtualized addressed space• Direct flash access• Crash recovery mechanisms

▸Exports primitives through file namespace• Application access through directFS or straight to device

Page 22: Fusion-io Open House - 9 Million IOPs cleared for Take Off

22

directFS: Speed Through Simplicity

April 10, 2023

directFS

ReiserFS

Ext4

Btrfs

XFS

0 10000 20000 30000 40000 50000 60000 70000

L INES OF CODE

Page 23: Fusion-io Open House - 9 Million IOPs cleared for Take Off

23

directFS: Consistent Low Latency

Sample

La

ten

cy

s)

Fusion-io DFS vs XFS write latency1000 512 Byte Sequential Write with O_DIRECT

DFSXFS

April 10, 2023

Page 24: Fusion-io Open House - 9 Million IOPs cleared for Take Off

April 10, 2023 24

Auto-Commit Memory and Flash

Application

• Persistent data at near DRAM speed

• Capacity of flash• Convenience of a

POSIX file system

directFS File System

• Transparent bonding of persistent memory and flash

Auto-Commit Memory Software

• Fast persistent memory, with high-capacity flash

ioMemory

Write through

Page 25: Fusion-io Open House - 9 Million IOPs cleared for Take Off

April 10, 2023 25

ACM: A Persistent Memory

▸Persistent, granular, byte and cacheline size updates• Latency reductions 10x-20x• 32x-64x less data written to media

▸Direct memory access reduces CPU overhead

▸ Integrated with directFS for use with regular files

▸Automatic tiering across persistent memory and flash

▸First application offering of Storage Class Memory

Page 26: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Fusion-io Confidential—Copyright © 2013 Fusion-io, Inc.  All rights reserved.Copyright © 2013 Fusion-io, Inc.  All rights reserved.

9M IOPS DemonstrationHigh Speed Transaction Logging

Page 27: Fusion-io Open House - 9 Million IOPs cleared for Take Off

April 10, 2023 27

9M IOPS Under the Hood

▸ 64B writes to ACM/directFS log through user space microbenchmark

▸ Single ioDrive2 365GB MLC

▸ Commit latencies range from 1usat about 1M IOPS to 15us up to 8.8M IOPS

0 500 1000 1500 2000 2500 3000 3500 4000 45000

2000000

4000000

6000000

8000000

10000000

12000000

IOPS

64B Appends per Commit

Lo

gg

ing

IO

PS

Page 28: Fusion-io Open House - 9 Million IOPs cleared for Take Off

28

Practical Database Use Case: MySQL

April 10, 2023

B a s e l i n e S c e n a r i o 1 S c e n a r i o 2

0

2,000

4,000

6,000

8,000

10,000

12,000

14,000

16,000

18,000

8000

16,000 15,750

INN

OS

IM O

PS

/SE

C

Nearly as fast as disabling

the transaction log completely.

Log transaction through block I/O No Logging Log to Fusion-io ACM

Page 29: Fusion-io Open House - 9 Million IOPs cleared for Take Off

Fusion-io Confidential—Copyright © 2013 Fusion-io, Inc.  All rights reserved.Copyright © 2013 Fusion-io, Inc.  All rights reserved.

David Flynn Fusion-io CEO & Chairman

Page 30: Fusion-io Open House - 9 Million IOPs cleared for Take Off

April 10, 2023 30

FLASH LASTS THREE TIMES AS LONG

APPLICATION RESPONDS TWICE AS FAST

ELIMINATE THOUSANDS OF LINES OF CODE

USE HALFTHE FLASHTHE SERVERSTHE MEMORY

Page 31: Fusion-io Open House - 9 Million IOPs cleared for Take Off

AS AN SSD,FLASH ACCLERATES APPLICATIONS

AT FULL MATURITY,NON-VOLATILE MEMORY WILL

TRANSFORM SOFTWARE DEVELOPMENT

Page 32: Fusion-io Open House - 9 Million IOPs cleared for Take Off

f u s i o n i o . c o m | R E D E F I N E W H A T ’ S P O S S I B L E

T H A N K Y O U