the echo nest workshop for boston music hack day

API WorkshopNovember 21, 2010Paul [email protected]

Friday, November 20, 2009

mailto:[email protected]


World of Music Audio World of Music Text

listening reading

learning

Solutions

WHAT THE ECHO NEST DOES


Artist• Tag Cloud

• Similar Artists

• Familiarity

• Hotttnesss

• News

• Audio

• Images

• Video

• Reviews

• Biography

READING


0 2 4 6 8 10 12 14 16CDE

GAB

0 2 6 10 14 16! -2

! -1

0

1

2x 104

0 2 6 10 14 160

0.2

0.4

0.6

0.8

1

0 2 6 10 14 1615

10

15

20

25

0 2 4 6 8 10 12 14 16CDE

GAB

4

4

8 12

8 12

4 8 12

wave

form

loud

ness

a

udito

rysp

ectro

gram

chro

mag

ram

Dm7 G7 CM7 C#O Dm7 G7 CM7 C#O Dm7 G7 CM7 C#O Dm7 G7 CM7 C#O

segm

ent-s

ynch

rono

us

c

hrom

agra

m

2 4 6 8 10 12 14 16 segments

20

15

10

5

1

25

20

15

10

5

1

25

0 0.5 1 1.5 2 sec.

0 0.5 1 1.5 2 sec.0

0.2

0.4

0.6

0.8

1

C

D

E

F#G

B

C#

D#

F

G#AA#

0 0.5 1 1.5 2 sec.

segm

enta

tion

audi

tory

spe

ctro

gram

pitc

h fe

atur

estim

bre

feat

ures

20 40 60 80 100 120 140 160 180 200 220

20

40

60

80

100

120

140

160

180

200

220

Track•Tempo• Key• Time Signature• Mode• Sections• Pitch• Timbre• Tatums• Beats• Bars• Duration• Loudness• Metadata• Segments• Fade in• Fade out

LISTENING


developer.echonest.comFriday, November 20, 2009

http://developer.echonest.com/api/get_similar ?api_key=YOUR_API_KEY &id=music://id.echonest.com/~/AR/AR2UWUD1187B9B3B01&rows=3 &version=3

Query:

Response:


http://developer.echonest.com/api/get_beats?api_key=IH0CZD3ZS4I5EL0RS&id=music://id.echonest.com/~/TR/TRLFPPE11C3F10749F&version=3









CLIENT LIBRARIES

Echo Nest Web Services

Pyechonest

Echo Nest Remix Java

CocoaFlash Ruby

3RD PARTY

Processing

http://developer.echonest.com/pages/resourcesFriday, November 20, 2009

http://developer.echonest.com/pages/resources


The Echo Nest Artist API


>> from pyechonest import artist>>>> gaga = artist.search_artists(‘Lady Gaga’)[0]>> gaga<Artist ‘Lady Gaga’>

>> gaga.hotttnesss()0.86328906000000005

>> gaga.similar(2)[<Artist 'Ashley Tisdale'>, <Artist 'Britney Spears'>]

Get your gaga on ... from python


def wander(band, max=10): """ generate a playlist by wandering a seed artist neighborhood """ played = [] while max: if band.audio(): audio = random.choice(band.audio()) if audio['url'] not in played: play(audio) played.append(audio['url']) max -= 1 band = random.choice(band.similar())

ARTIST RADIO IN TEN LINES OF CODE


ArtistAPI artistAPI = new ArtistAPI(MY_ECHO_NEST_API_KEY); List<Artist> artists = artistAPI.searchArtist("Weezer”, false); if (artists.size() > 0) { for (Artist artist : artists) { List<Scored<Artist>> similars = artistAPI.getSimilarArtists(artist, 0, 10); for (Scored<Artist> simArtist : similars) { System.out.println(" " + simArtist.getItem()); } } }

Find Weezer’s neighbors in Java


Things you can build withThe Echo Nest

Artist API


PLAYLISTING


The Music Exploration SpaceMore engaging music discovery


The Echo Nest Track API


segments

2 4 6 8 10 12 14 16 segments

20

15

10

5

1

25

20

15

10

5

1

25

0 0.5 1 1.5 2 sec.

0 0.5 1 1.5 2 sec.0

0.2

0.4

0.6

0.8

1

C

D

E

F#G

B

C#

D#

F

G#AA#

0 0.5 1 1.5 2 sec.

segm

enta

tion

audi

tory

spe

ctro

gram

pitc

h fe

atur

estim

bre

feat

ures

auditory spectrogram

pitch features

timbre features

JEHAN STYLEFriday, November 20, 2009

beat markers

tempogram

tempo spectrum

0 5 10 15 20 25! -2

! -1

0

1

2x 104

0 5 10 15 20 25

72 96 143 190 2400

0.2

0.4

0.6

0.8

1

60

6072

96114

143

240

114

190

JEHAN STYLEFriday, November 20, 2009

chop sound into:

Sections

Bars

Beats

Segments

ALL SONG ELEMENTS ARE ITEMS IN A LIST

ECHO NEST REMIX API


>> from pyechonest import track>>>> t=track.upload("BillieJean.mp3")>> t.tempo{'confidence': 0.966, 'value': 116.944}

>> len(t.bars)142

>> len(t.segments)1259>> t.segments[10]

{'duration': 0.252, 'loudness_begin': -46.009, 'loudness_end': -44.121, 'loudness_max': -30.931, 'pitches': [0.342, 0.873, 0.843, 1.0, 0.511, 0.432, 0.841, 0.432, 0.691, 0.687, 0.329, 0.672], 'start': 2.50204, 'timbre': [19.50, 130.611, -114.94, 112.246, 28.369, -60.277, -23.689, -10.537, 4.514, 12.957, -25.44, 2.88], 'time_loudness_max': 0.0171}

Delving into ‘Billie Jean’


Things you can build withThe Echo Nest

Track API


The Click Track Detector

Nirvana

Britney SpearsFriday, November 20, 2009

The Loudness warThe loss of dynamic range in modern recordings


MUSIC VISUALIZATION


Song visualizations by using Echo Nest AnalysisVisualizing Kid-A

Visualizations by Chris MuellerFriday, November 20, 2009

The shape of the songVisualizing Song self similarity

Visualization by Chris Mueller

Reich, Steve – Music for 18 Musicians: Pulses

Madonna, Like A Prayer


http://open.spotify.com/track/3qeXCVaC4tO4gS2aPdlRmc

http://open.spotify.com/track/3qeXCVaC4tO4gS2aPdlRmc

SYNCHSTEP

MATCH MUSIC TO YOUR PACE


Cocoa framework for the Echo NestSong visualization on the iPhone


Synchronizing visualizations with musicBeethoven Hero

By Anita LillieFriday, November 20, 2009

THE ECHO NEST REMIX API


CLIENT LIBRARIES

Echo Nest Web Services

Pyechonest

Echo Nest Remix Java

CocoaFlash Ruby

3RD PARTY

Processing

http://developer.echonest.com/pages/resourcesFriday, November 20, 2009



>> song.segments[segment, segment, segment...]>> song.segments[10].start34.502>> song.segments[10].timbre[-30.2, -10.4, 4.5, 3.2...]>> song.segments[10].pitch[0.5, 0.13, 1.0, .... ]

>> song.beats.reverse()

>> for i in segments: i.stretch(2) i = i + othersong.segment[12]

ALL SONG ELEMENTS ARE ITEMS IN A LIST

>> You can mix elements, time stretch them, detect & change pitch, move themaround, repeat them on downbeats, find a closest match in another song, detect and modify volume envelopes, read/write mp3, aiff, wav


WHAT THE ECHO NEST REMIX API

DOES


def one(input_filename, output_filename): audiofile = audio.LocalAudioFile(input_filename) bars = audiofile.analysis.bars collect = audio.AudioQuantumList() for bar in bars: collect.append(bar.children()[0]) out = audio.getpieces(audiofile, collect) out.encode(output_filename)


MAKE WEB SITESFriday, November 20, 2009

st = modify.Modify() afile = audio.LocalAudioFile(in_filename) beats = afile.analysis.beats total = float(len(beats)) out_shape = (2*len(afile.data),)

for i, beat in enumerate(beats): delta = i / total new_ad = st.shiftTempo(afile[beat], 1 + delta / 2) out_data.append(new_ad) out_data.encode(out_filename)

Hyperingo


I’ve always wanted to hear Michael Jackson trying to sing

Amerie’s “One Thing”

MAKE MUSIC

-B.L.


MAKE MUSIC

Make a James Brown Machine


Let’s hear The Black Eyes Peas in 5/4.

-P.L.

MAKE MOVIESFriday, November 20, 2009

API WorkshopNovember 21, 2010Paul [email protected]




the echo nest workshop for boston music hack day

Technology

withthe echo nest artist

artist artist

withthe echo nest track

echo nest doesfriday

echo nest remix api

api workshopnovember

music visualization

steve music