blackpearl: spectra s3 vs. standard s3

BlackPearl: Spectra S3 vs. Standard S3

What is Spectra S3?

• Spectra S3 - a variation of Standard S3 popularized by Amazon. Used to archive and restore files to BlackPearl.

• Standard S3 is good for online, random access disk• Tape needs to write many files in sequence• Tape has a delay/latency on retrieval• Standard S3 doesn’t work with tape• Spectra S3 was created for tape• BlackPearl uses Spectra S3 to support tape• BlackPearl transfer rate with Spectra S3 exceeds 1 Gigabyte/second• Spectra S3, beyond archive and restore, includes over 200 API commands

STANDARD S3 PUT

Standard S3 - PUT

Standard S3 Public Cloud

Standard S3 Client

Standard S3 - PUT

Standard S3 Public Cloud

Standard S3 Client

“I am sending you one file and here it is.”

PUT file1.txt{file content}

Standard S3 - PUT

Standard S3 Public Cloud

Standard S3 Client

“I have received the file.”

200 OK

STANDARD S3 GET

Standard S3 - GET

Standard S3 Public Cloud

Standard S3 Client

Standard S3 - GET

Standard S3 Public Cloud

Standard S3 Client

“I am requestingone file.”

GET file1.txt

Standard S3 - GET

Standard S3 Public Cloud

Standard S3 Client

“Here is the file.”

200 OK{file content}

SPECTRA S3 PUT

Spectra S3 - Bulk PUT - 1

Spectra S3 BlackPearl

Spectra S3 Client

Spectra S3 - Bulk PUT - 1

Spectra S3 BlackPearl

Spectra S3 Client

“I will be sending youmultiple files. Here is a list of them and their sizes.”

START_BULK_PUT file1.txt 3GBfile2.txt 4GBfile3.txt 7GB

Spectra S3 - Bulk PUT - 1

Spectra S3 BlackPearl

Spectra S3 Client

“Okay. Here is your Job ID.”

200 OKJobId = 123ABC

Spectra S3 - Bulk PUT - 2

Spectra S3 BlackPearl

Spectra S3 Client

“Which files can I sendyou now?”

JOB_CHUNK JobId = 123ABC

Spectra S3 - Bulk PUT - 2

Spectra S3 BlackPearl

Spectra S3 Client

“You can send me these files”

200 OKfile1.txtfile2.txt

Spectra S3 - Bulk PUT - 3

Spectra S3 BlackPearl

Spectra S3 Client

“I am sending you one file for this job and here it is.”

PUT file1.txtJobId = 123ABC{file content}

Spectra S3 - Bulk PUT - 3

Spectra S3 BlackPearl

Spectra S3 Client

“I have received the file.”

200 OK

Spectra S3 - Bulk PUT - 4

Spectra S3 BlackPearl

Spectra S3 Client

“I am sending you one file for this job and here it is.”

PUT file2.txtJobId = 123ABC{file content}

Spectra S3 - Bulk PUT - 4

Spectra S3 BlackPearl

Spectra S3 Client

“I have received the file.”

200 OK

Spectra S3 - Bulk PUT - 5

Spectra S3 BlackPearl

Spectra S3 Client

“Which files can I sendyou now?”

JOB_CHUNK JobId = 123ABC

Spectra S3 - Bulk PUT - 5

Spectra S3 BlackPearl

Spectra S3 Client

“You can send me these files”

200 OKfile3.txt

Spectra S3 - Bulk PUT - 6

Spectra S3 BlackPearl

Spectra S3 Client

“I am sending you one file for this job and here it is.”

PUT file3.txtJobId = 123ABC{file content}

Spectra S3 - Bulk PUT - 6

Spectra S3 BlackPearl

Spectra S3 Client

“I have received the file.”

200 OK

SPECTRA S3 GET

Spectra S3 - Bulk GET - 1

Spectra S3 BlackPearl

Spectra S3 Client

Spectra S3 - Bulk GET - 1

Spectra S3 BlackPearl

Spectra S3 Client

“I want to retrieve multiple files. Here is a list of them.”

START_BULK_GET file1.txtfile2.txtfile3.txt

Spectra S3 - Bulk GET - 1

Spectra S3 BlackPearl

Spectra S3 Client

“Okay. Here is your Job ID.”

200 OKJobId = 123ABC

Spectra S3 - Bulk GET - 2

Spectra S3 BlackPearl

Spectra S3 Client

“Which files can I retrievefrom you now?”

JOB_CHUNK JobId = 123ABC

Spectra S3 - Bulk GET - 2

Spectra S3 BlackPearl

Spectra S3 Client

“You can retrieve these files”

200 OKfile1.txtfile2.txt

Spectra S3 - Bulk GET - 3

Spectra S3 BlackPearl

Spectra S3 Client

“I am requestingone file.”

GET file1.txtJobId = 123ABC

Spectra S3 - Bulk GET - 3

Spectra S3 BlackPearl

Spectra S3 Client

“Here is the file.”

200 OK{file content}

Spectra S3 - Bulk GET - 4

Spectra S3 BlackPearl

Spectra S3 Client

“I am requestingone file.”

GET file2.txtJobId = 123ABC

Spectra S3 - Bulk GET - 4

Spectra S3 BlackPearl

Spectra S3 Client

“Here is the file.”

200 OK{file content}

Spectra S3 - Bulk GET - 5

Spectra S3 BlackPearl

Spectra S3 Client

“Which files can I retrievefrom you now?”

JOB_CHUNK JobId = 123ABC

Spectra S3 - Bulk GET - 5

Spectra S3 BlackPearl

Spectra S3 Client

“You can retrieve these files”

200 OKfile3.txt

Spectra S3 - Bulk GET - 6

Spectra S3 BlackPearl

Spectra S3 Client

“I am requestingone file.”

GET file3.txtJobId = 123ABC

Spectra S3 - Bulk GET - 6

Spectra S3 BlackPearl

Spectra S3 Client

“Here is the file.”

200 OK{file content}