delivering the music in 265 milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf ·...

20
Delivering the Music in 265 Milliseconds* *Mean average playback Don’t make me wait for my music!

Upload: others

Post on 28-May-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Delivering the Music in 265 Milliseconds*

*Mean average playback

Don’t make me wait for my music!

Page 2: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Spotify in 60 Seconds (mean average)

Online music service with more

than 15 million tracks on

demand using unique

technology.

Freemium model (subscription

and ad-supported).

The largest music subscription

service of our kind.

Page 3: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Spotify in 60 Seconds (mean average)

• Founded: 2006 by Daniel Ek and Martin Lorentzon.

• Location: Available in 8 countries: USA, UK, Sweden,

Norway, Finland, The Netherlands, Spain and France

• Number of tracks: Over 15,000,000

• Registered users: Over 10,000,000

• Paying users: Over 2,000,000

Page 4: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Spotify in 60 Seconds (mean average)

• Goal: To make all the world’s music available instantly

to everyone, wherever and whenever they want it.

Number of employees: 400 +

• The name: A combination of spot and identify.

• Over 100 engineers

Page 5: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Features

Page 6: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Features

Metadata Search

Page 7: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Features

Highlights Radio Devices Offline

Mode

Page 8: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Features

Social: Spotify

Page 9: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Features

Social:Facebook

Page 10: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Features

Music

Page 11: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Spotify & AWS Retrospective

First experimented with AWS in 2009

Elastic MapReduce

(Content Analysis)

CloudFront

(Client Delivery & Popular Tracks)

S3

(Master Storage)

Page 12: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

The Need for Speed

Why is 265 ms mean average

playback experience important?

Local feel

Impatient users

Shoot for the moon principle

Makes for a fun technical

project

Harder, Faster, Better,

Stronger

Page 13: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Spotify’s Music Architecture (Before AWS)

SPOTIFY SITE

Master Storage

Tracker

Prod Storage

Ads*

Radio*

Browse

SearchDESKTOP P2P

AP

MOBILE/LIBSPOTIFY

HTTP ENCRYPTED *NYC PROJECT

Content

Page 14: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Spotify’s Music Architecture

SPOTIFY SITE

Tracker

Prod Storage

Ads*

Radio*

Browse

SearchDESKTOP P2P

AP

MOBILE/LIBSPOTIFY

HTTP ENCRYPTED *NYC PROJECT

S3Master Storage

Content

Page 15: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Streaming Sweet Tunes: SOP

Click Play…

Look in the client’s cache

Look in the P2P Neighboorhood

Look in production storage

Look in S3

Found It!

Page 16: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Streaming Sweet Tunes: Really Popular Songs

Click Play…

Look in the client’s cache

Look in the P2P Neighboorhood

Get CloudFront URL

Found It!

Page 17: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Delivering Clients via CloudFront

EMIL! CAN WEUPGRADE ALL

SPOTIFY CLIENTSIN 24 HOURS?

But Oskar! We don’thave the servers!

There is no Time!

I called our AWS Rep!CloudFront delivered

All ClientUpgrades!

HARDER,BETTER, FASTER,

STRONGER!

SWEET!

Page 18: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

R&D with AWS

One-off batch process jobs that require a massive

computing power…

S3 and Elastic MapReduce for data aggregation.

S3 and EC2 content analysis, finger printing and

content matching research.

AWS APIs to manage instances for big fast projects

Looking at reduced redundancy for low bit rates

Page 19: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

Summary

AWS is a part of Spotify’s Music Architecture…

Not used for user-facing services but rather to feed our

backend.

AWS is a part of Spotify’s development process…

We test ideas, run big jobs, and have a lot of fun with it!

For Spotify AWS is a reliable and high value solution…

Headache Medicine

Page 20: Delivering the Music in 265 Milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf · Spotify in 60 Seconds (mean average) Online music service with more than 15 million

There’s a new world of music

awaiting you…