tunepal: a cloud powered traditional music search engine

43
Dr Bryan Duggan DIT School of Computing [email protected] @ditcomputing http://tunepal.org http://facebook.com/tunepal http://tunepal.wordpress.com

Upload: bryan-duggan

Post on 08-Jul-2015

1.483 views

Category:

Education


0 download

DESCRIPTION

A presen

TRANSCRIPT

Page 1: Tunepal: A cloud powered traditional music search engine

Dr Bryan DugganDIT School of Computing

[email protected]@ditcomputing

http://tunepal.orghttp://facebook.com/tunepalhttp://tunepal.wordpress.com

Page 2: Tunepal: A cloud powered traditional music search engine
Page 3: Tunepal: A cloud powered traditional music search engine
Page 4: Tunepal: A cloud powered traditional music search engine

What is Tunepal?• The worlds leading search

engine for traditional Irish music

• Available on iOS, Android, iPad & Online (through a browser)

• Supports title searches & music searches

• 17,135 tunes from different collections (& growing)

• Around 10,000 mobile users (growing at a rate of around 200 new users

Page 5: Tunepal: A cloud powered traditional music search engine
Page 6: Tunepal: A cloud powered traditional music search engine

What is traditional music?

• Mostly dance music (Reels, Jigs, Hornpipes, Polkas etc.)

• Monophonic, Repetition• Conversational quality• Mostly in 2 octaves• Limited range of keys & modes• Quite a large corpus (~8000 tunes)• Uilleann pipes, flute, fiddle, concertina, bodhran,

banjo• Mostly listening music nowadays

Page 7: Tunepal: A cloud powered traditional music search engine

Collections

• (Petrie 1855; Bunting 1843; Joyce 1909)

• The Music of Ireland, The Dance Music of Ireland – 1001 Gems (O’Neill, 1903) (O’Neill, 1907)

• Ceol Rince Na hÉireann– (Breathnach 1963; Breathnach 1976;

Breathnach 1985; Breathnach 1996; Breathnach 1999)

• ABC– (Walshaw 2007)

• O’Neills (1997-2000) in ABC – (Chambers 2007)

– Norebeck (1997-2000)

X:422

T:Come West Along the Road

R:reel

S:Session

H:See also #432, in A. This version is

also played in A.

H:1st part similar to "Over the Moor

to Peggy", #710

D:Arcady: Many Happy Returns

D:Noel Hill & Tony McMahon: \'I gCnoc

na Gra\'i

Z:id:hn-reel-422

M:C|

K:G

d2BG dGBG|~G2Bd efge|d2BG dGBG|1 ABcd

edBc:|2 ABcd edBd||

|:g2bg egdg|(3efg dg edBd|1 g2bg

egdB|ABcd edBd:|2 gabg efge|dega

bage||

Page 8: Tunepal: A cloud powered traditional music search engine
Page 9: Tunepal: A cloud powered traditional music search engine

Way back in 1993…

Page 10: Tunepal: A cloud powered traditional music search engine

The First Tunepals

Page 11: Tunepal: A cloud powered traditional music search engine

Part Time PhD

• Modelling creativity in traditional Irish music

– MATT - A System for Modelling Creativity in Traditional Irish Flute Playing

– A Combinational Creativity Approach to Composing Traditional Irish Reels

• Modelling ornamentation & expressivness

• I was working the problem of transcription

• And then one Wednesday afternoon…

Page 12: Tunepal: A cloud powered traditional music search engine

MATT2

Page 13: Tunepal: A cloud powered traditional music search engine
Page 14: Tunepal: A cloud powered traditional music search engine

How does it work?

• Transcription– DSP

– ODCF (Onset detection)

– Pitch detection (peak picking, harmonicity)

– Matching (Edit Distance)

Page 15: Tunepal: A cloud powered traditional music search engine

Compensating for expressiveness

• Ornamentation

• The long note

• Reversing/doubling

• Phrasing/breaths

• Tempo deviation

• Background noise/instruments

• Most common instruments

Page 16: Tunepal: A cloud powered traditional music search engine

Contributions

• MATT2 Worked! (Success rate of 92%)

• TANSEY (Turn ANnotation from SEts using similaritY Profiles)

• ~1500 tune corpus

• Ornamentation Filtering

Page 17: Tunepal: A cloud powered traditional music search engine
Page 18: Tunepal: A cloud powered traditional music search engine

July 2009

Page 19: Tunepal: A cloud powered traditional music search engine

tunepal.org

Page 20: Tunepal: A cloud powered traditional music search engine

Tunepal for iOS/Android

• Tunes in the “cloud”

• Query-by-playing and title

• Released February 2010

• $4.99 on the app store

• Access 17,000+ tunes on a mobile device

• Geocoding

Page 21: Tunepal: A cloud powered traditional music search engine

How does it work?

• Native iPhone/Android clients

• ABC2MIDI, ABC2PS, ABC4J, ABCJS

• FMOD (iOS)

• Android NDK

• Transcription on the device

• Edit distance searches on the server

• MySQL/Apache/Tomcat/PHP

Page 22: Tunepal: A cloud powered traditional music search engine

Archiceture

Page 23: Tunepal: A cloud powered traditional music search engine
Page 24: Tunepal: A cloud powered traditional music search engine
Page 25: Tunepal: A cloud powered traditional music search engine
Page 26: Tunepal: A cloud powered traditional music search engine

Users in 30+ countries!

CountryQuery

Count

Ireland 10,613

USA 9,093

UK 4,507

Canada 1,136

Australia 1,046

France 987

Germany 804

Japan 695

Denmark 209

Netherlands 195

Spain 165

Sweden 148

Italia 126

New Zealand 98

Croatia 66

Switzerland 58

Romania 43

Norway 41

India 39

South Africa 23

Page 27: Tunepal: A cloud powered traditional music search engine

Analytics

• 184,160 iOS music searches• 70,521 Web searches• 52,484 Android searches• 330 music searches each day• 232 title searches per day• 17,135 scores downloaded• ~10,000 mobile users• Average 400 music searches per day• Average 400 title searches per day• ~300 downloads per month

Page 28: Tunepal: A cloud powered traditional music search engine

Irish Queries by Time of Day

0

200

400

600

800

1000

1200

1400

1600

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23

Page 29: Tunepal: A cloud powered traditional music search engine

In the media

• Irish Times (twice)

• Irish Daily mail

• Sunday Times - Top twenty cultural apps

• Foinse

• Top 25 grossing apps on iTunes (2 days)

• Top 50 grossing apps on iTunes (1 week)

Page 30: Tunepal: A cloud powered traditional music search engine
Page 31: Tunepal: A cloud powered traditional music search engine
Page 32: Tunepal: A cloud powered traditional music search engine

ISMIR2010

Page 33: Tunepal: A cloud powered traditional music search engine
Page 34: Tunepal: A cloud powered traditional music search engine

Sunday Times - February 2012

Page 35: Tunepal: A cloud powered traditional music search engine

John Creedon

• http://www.youtube.com/user/skooter500?feature=mhee#p/u/3/UGj1xjCk7Q4

Page 36: Tunepal: A cloud powered traditional music search engine

A grant

• Tunepal HD

• Marco Cascorina

• Morgan Conlan

• Jonathan Lynch

• Jamie Osler

• Lisa Shields

Page 37: Tunepal: A cloud powered traditional music search engine

Listening to ClareFM.ie this morning.

Heard a great tune…..interrupted by the Galway Races Used Tunepal……..it’s called The Parting………got it from The Session.org. So much fun……….. listening and learning Irish Trad.

Thank you so much for the good you have done and are doing!

It is ironic, but one of my mates has proudly proclaimed she has never had a cell phone, computer, nor opened an email account. She is utterly fascinated with Tunepal

“I’m sure you’re getting emails every day saying how much folks love your tunepal site and iphone app. I have the app and LOVVVVVVVVVE it! I use it every day. Awesome awesome awesome!

Getting a lot of use out of this app now. Everybody I have told so far is very impressed.”

It’s pure magic. Thanks a million for having made this diamond and share it with everyone. If there was a God, I’m quite sure that he would have you blessed !

I just wanted to thank you for the great idea and the great job you’ve done with Tunepal. It’s an excellent and very useful tool. Just what I whished for quite often.

I am really impressed with the app. It was 100% correct in identifying tunes when I played them on flute or whistle. Having worked in a previous life in ultrasonic testing of materials, I can appreciate some of the problems involved.

Page 38: Tunepal: A cloud powered traditional music search engine

The roadmap

• Tap to record• Tunepal for Android tablets• Transposition invariant searches• Retina graphics & better usability• Black background record screen• Tune sorting• Events (geo)• Tune synching across

devices• Musician finder service• Native browser record & DSP

Page 39: Tunepal: A cloud powered traditional music search engine

• New collections – Ryan’s Mammoth

collection)

– ‘Ancient Irish Music’, ed. P. W. Joyce (Dublin, 1873)

– ‘The Feis Ceoil Collection of Irish Airs’

– ‘O’Farrell’s Collection of National Irish Music for the UnionPipes’

Page 40: Tunepal: A cloud powered traditional music search engine
Page 41: Tunepal: A cloud powered traditional music search engine

Conclusions

• Mobile device is the right platform for this technology– Always on internet,

– CPU technology

– GPS

– Screen size

• Having a significant impact on how musicians learn tunes and acquire repertoire

• Making Apps is great fun, lots of nice things will happen to you

Page 42: Tunepal: A cloud powered traditional music search engine

Learn programming

Page 43: Tunepal: A cloud powered traditional music search engine

More information?

tunepal.org

facebook.com/tunepal

tunepal.wordpress.com

www.comp.dit.ie/bduggan

Search iTunes or Google Play for Tunepal