The C@merata task at MediaEval 2016: Natural Language Queries Derived
from Exam Papers, Articles and Other Sources against Classical Music Scores in MusicXML
Richard Sutcliffe, University of Essex
Cynthia Liem, Delft University of Technology
plus... Tom Collins, Lehigh University
Eduard Hovy, Carnegie-Mellon University Richard Lewis, Goldsmiths, University of London
Chris Fox, University of Essex Deane Root, University of Pittsburgh
2
Outline Applications Task Design Passages and Divisions Query Types and Music Scores Evaluation Metrics 2016 Campaign Results Conclusions
3
C@merata Task There is a series of 200 questions each year: • A short noun phrase in English referring to musical features in a score, • A short classical music score in MusicXML. Required Answer: • The location(s) in the score of the requested musical feature. We call each such location a passage.
4
Applications Linking musical references to scores: [ah25] repeated crotchet chords [dc364lh] tonic triad of E major [ah26] giant unison G from the entire orchestra Allowing experts to search scores interactively using phrases: triplet quavers against a chord in the bass Helping students to learn music theory: perfect cadence brings up an example in a score ah: Hopkins, A. (1982). The Nine Symphonies of Beethoven. London: Pan Books. dc: Cooke, D. (1995). Bruckner, (Joseph) Anton. In S. Sadie (ed), New Grove Dictionary of Music and Musicians, Volume 3, Section 7. Music (p362-366). London, UK: Macmillan.
5
Task Design There are 200 queries. We saw earlier that we have: Provided Question: • A short noun phrase in English referring to musical features in a score, • A short classical music score in MusicXML. Required Answer: • The location(s) in the score of the requested musical feature. We call each such location a passage.
6
Passages and Divisions We specify a passage as follows:
• a time signature, • a divisions value • a start bar and beat • an end bar and beat Example:
[4/4,1,1:1-2:4] time signature is 4/4. divisions value is 1 so we count in crotchets (quarter notes) Passage starts in bar 1 before the first crotchet (i.e. 1:1) Passage ends in bar two after the fourth crotchet (i.e. 2:4) Thus passage consists of the two complete bars (measures) numbered one and two.
7
What is a Divisions Value? The number of beats into which we divide a crotchet. A suitable value depends on what we wish to demarcate. Working in whole crotchets: Divisions = 1 Working in quavers: Divisions = 2 Working in quaver triplets: Divisions = 3 Working in semiquavers or quavers or triplet quavers: Divisions = 12 !! With Divisions = 12: one crotchet = 12 beats one quaver = 6 beats one quaver triplet = 4 beats one semiquaver = 3 beats Note: MusicXML uses the divisions concept and we got the idea from there.
8
Q: C D E F D E C in semiquavers repeated after a semiquaver A: [ 4/4, 4, 1:2-1:16 ] Q: semiquaver F# in the treble against a crotchet C in the bass A: [ 4/4, 4, 4:13-4:13 ]
9
Query Types In 2014 there were twelve types of query:
Type No Example simple_pitch 30 G5
simple_length 30 dotted quarter note pitch_and_length 30 D# crotchet
perf_spec 10 D sharp trill stave_spec 20 D4 in the right hand word_spec 5 word "Se" on an A flat
followed_by 30 crotchet followed by semibreve melodic_interval 19 melodic octave
harmonic_interval 11 harmonic major sixth cadence_spec 5 perfect cadence
triad_spec 5 tonic triad texture_spec 5 polyphony
All 200
10
In 2015 there were eight types of query, each modified in various ways:
Type No Example
1_melod 40 D4 minim eighth note in measure 9
1_melod qualified by
perf, instr, clef, time, key
40
trill on a quaver A G# in the Cello part in measures 29-39
sixteenth note C# in the left hand half note E3 in 2/2
sixteenth note G in G minor in measures 1-5
n_melod 20
F# E G F# A Do Mi Do Sol Do Mi Sol Do in bars 1-20
twenty semiquavers five note melody in bars 1-10
n_melod qualified by
perf, instr, clef, time, key
20
two staccato quarter notes in the Violin 1 crotchet, crotchet rest, crotchet rest, crotchet, crotchet rest, crotchet,
crotchet, crotchet, crotchet, crotchet in the Timpani melodic octave leap in the bass clef in measures 70-80
G4 B4 E5 in 3/4 rising G minor arpeggio
11
1_harm poss qualified by
perf, instr, clef, time, key
20
eighth note chord Bb, C, E chord of D minor in measures 109-110
harmonic minor sixth in the Violas dotted minim chord in the left hand
texture 6
monophonic passage homophony in measures 1-14 polyphony in measures 10-14 Alberti bass in measures 0-4
follow possibly qualified on
either or both sides by perf,
instr, clef, time, key
40
quavers F4 E4 in the oboe followed by quavers E2 G#2 in the bass clef quarter note minor third followed by eighth note unison
C followed by mordent Bb chord C4 G4 C5 E5 then a quaver
three eighth notes in the Violin I followed by twelve sixteenth notes in the Violin II in measures 87-92
synch possibly qualified in
either or both parts by perf,
instr, clef, time, key
14
four eighth notes against a half note crotchet D3 on the word “je” against a minim D2
four staccato quavers in the Violoncello against a minim chord Ab3 C4 F4 in the Harpsichord
All 200
12
In 2016 there are five types of query: 1_melod, n_melod, 1_harm, n_harm and texture 1_melod to n_harm can be qualified by perf, instr, clef, time, key All can be linked by follow or synch
Type No Example
1_melod 4 A#1 in bars 44-59 quarter-note rest in measures 1-5
1_melod qualified by perf, instr, clef, time,
key 36
dotted quarter note D6 in the first violin solo C5 in the oboe in measures 32 onwards
flute dotted half note only against strings half note on the tonic in the bass clef
A4 sung to the word 'bow'
n_melod 15
two-note dotted rhythm in measures 1-24 eight note rising passage in quarter notes
repeated Bb4 whole note D4 D5 A5 D6 in sixteenth notes repeated twice
two tied dotted minims in bars 72-88
13
n_melod qualified by perf, instr, clef, time,
key 45
dotted minims C B A in the Bass clef in bars 70-90 melodic interval of a minor 7th in the voice
rising arpeggio in the left hand in measures 1-10 five-note melody in the cello in measures 20-28
whole note rest, quarter note in the Violin 4 in measures 1-103
1_harm 17
7th triad in measures 1-3 Ia chord in bars 1-10
chord of C whole-note unison E2 E3 E4
chord III in bars 44-59
1_harm possibly qualified by perf,
instr, clef, time, key 23
chord of F#3, D4 and A4 in the lower three parts harmonic fifth in the oboe
harmonic octave in the bass clef harmonic perfect fourth between the Soprano and Alto in bars 1-9
cello and viola playing dotted minims an octave apart in bars 40-70
14
n_harm 25
interrupted cadence A5 pedal in bars 116-138
authentic cadence in measures 14-18 plagal cadence in bars 134-138
three consecutive thirds in bars 1-43
n_harm possibly qualified by perf,
instr, clef, time, key 15
consecutive sixths between the Altos and Basses in measures 73-80 flute, oboe and bassoon in unison in measures 1-56
consecutive descending sixths in the left hand alternating fourths and fifths in the Oboe in bars 1-100
Soprano and Alto moving one step down together in measures 1-12
texture 20
all three violn parts in unison in measures 1-59 polyphony in measures 5-12
homophonic texture in measures 125-138 imitative texture in bars 1-18
counterpoint in bars 1-14 All 200
15
Type No Example
follow possibly qualified on either or both sides by perf,
instr, clef, time, key
20
C D E F D E C in semiquavers repeated after a semiquaver eighth-note twelfth followed by whole-note minor tenth between
Cello and Viola D C# in the right hand, then F A G Bb in semiquavers in the left
hand B flat in the cbass followed a quarter note later by B natural in the
cbass 5 B4s followed by a C5
synch possibly qualified in either or both parts by perf,
instr, clef, time, key
13
quarter note E5 against a quarter note C#3 C#3 minim and E4 semibreve simultaneously
D3 in the bass at the same time as C5 in soprano 1 three-note chord in the harpsichord right hand against a two-note
chord in the harpsichord left hand in measures 45-52 A#3 in the piano and F#5 in the voice simultaneously
16
Q: three-note chord in the harpsichord right hand against a two-note chord in the harpsichord left hand in measures 45-52 A: [ 3/4, 1, 45:3-45:3 ], [ 3/4, 1, 51:1-51:3 ]
19
2016 Scores
Work Staves Scoring Lang bach_2_part_invention_no1_bwv772 2 hpd Eng.
beethoven_piano_sonata_no2_m4 2 pf Amer. beethoven_piano_sonata_no5_m1 2 pf Eng.
chopin_prelude_op28_no15 2 pf Eng. scarlatti_sonata_k281 2 hpd Eng. scarlatti_sonata_k320 2 hpd Amer.
schubert_an_die_musik_d547 3 S, pf Amer. bach_chorale_bwv347 4 SATB Amer.
beethoven_str_quartet_op127_m1 4 2 vn, va, vc Eng. bennet_weep_o_mine_eyes 4 SATB Eng.
20
handel_water_music_suite_air 4 2 vn, va, vc Amer.
palestrina_alma_redemptoris_mater 4 SATB Amer. schubert_str_quartet_no10_op125_d87_m3 4 2 vn, va, vc Eng.
morley_now_is_the_month_of_maying 5 SATTB Eng. weelkes_hark_all_ye_lovely_saints 5 SSATB Eng.
vivaldi_conc_4_vns_op3_no10_rv580 8 4 vn, 2 va, vc, db Amer. vivaldi_conc_vn_op6_no6_rv239_m1 8 3 vn, va, vc, db, hpd Amer.
mozart_symphony_no40_m4 10 fl, 2 ob, 2 bn, 2 hn, 2 vn, va, vc, db Eng.
beethoven_symphony_no3_m3 13 2 fl, 2 ob, 2 cl, 2 bs, 2 hn, 2 tpt, timp, 2 vn, va, vc, db, Amer.
handel_messiah_and_the_glory 18 fl, 2 ob, cl, bs, hn, tbn, tuba, SATB, hpd, 2 vn, va, vc, db Amer.
21
Evaluation of a Returned Passage Passage is beat correct if it starts at exactly the correct beat (as specified by the divisions value) in the correct start bar and also ends at the correct beat in the end bar. - Useful for applications of results which are themselves automatic. Passage is measure correct if it starts in the bar where the requested feature starts and ends in the bar where the requested feature ends. - Sufficient in many cases for humans to use.
22
Beat Precision (BP) is the number of beat correct passages returned by a system divided by the number of passages (correct or incorrect) returned. Beat Recall (BR) is the number of beat correct passages returned by a system divided by the total number of answer passages known to exist. Measure Precision (MP) is the number of measure correct passages returned by a system divided by the number of passages (correct or incorrect) returned. Measure Recall (MR) is the number of measure correct passages returned by a system divided by the total number of answer passages known to exist.
23
Participants
Runtag Leader Affiliation Country DMUN Andreas Katsiavalos De Montfort University England
KIAM Marina Mytrova Keldysh Institute of Applied Mathematics Russia
OMDN Donncha Ó Maidín University of Limerick Ireland
UMFC Paweł Cyrta Fryderyk Chopin University of Music Poland
24
2014 Results
Run BP BR BF MP MR MF CLAS01 0.713 0.904 0.797 0.764 0.967 0.854 DMUN01 0.372 0.712 0.489 0.409 0.784 0.538 DMUN02 0.380 0.748 0.504 0.417 0.820 0.553 DMUN03 0.440 0.868 0.584 0.462 0.910 0.613 LACG01 0.135 0.101 0.116 0.188 0.142 0.162 OMDN01 0.415 0.150 0.220 0.424 0.154 0.226 TCSL01 0.633 0.821 0.715 0.652 0.845 0.736 UNLP01 0.113 0.516 0.185 0.155 0.703 0.254 UNLP02 0.290 0.512 0.370 0.393 0.692 0.501
Maximum 0.713 0.904 0.797 0.764 0.967 0.854 Minimum 0.113 0.150 0.185 0.155 0.154 0.226 Average 0.420 0.654 0.483 0.460 0.734 0.534
25
2015 Results
Run BP BR BF MP MR MF CLAS01 0.604 0.636 0.620 0.639 0.673 0.656 DMUN01 0.311 0.739 0.438 0.332 0.788 0.467 DMUN02 0.242 0.739 0.365 0.265 0.809 0.399 DMUN03 0.294 0.739 0.421 0.316 0.794 0.452 OMDN01 0.817 0.175 0.288 0.817 0.175 0.288 TNKG01 0.061 0.488 0.108 0.073 0.586 0.129 UNLP01 0.126 0.430 0.195 0.149 0.508 0.230
Maximum 0.817 0.739 0.620 0.817 0.809 0.656 Minimum 0.061 0.175 0.108 0.073 0.175 0.129 Average 0.351 0.564 0.348 0.370 0.619 0.375
26
2016 Results
Run BP BR BF MP MR MF DMUN01 0.420 0.038 0.070 0.640 0.058 0.106 KIAM01 0.194 0.011 0.021 0.613 0.035 0.066 OMDN01 0.042 0.004 0.007 0.511 0.044 0.081 UMFC01 0.012 0.038 0.018 0.022 0.073 0.034
Maximum 0.420 0.038 0.070 0.640 0.073 0.106 Minimum 0.012 0.004 0.007 0.022 0.035 0.034 Average 0.167 0.023 0.029 0.447 0.053 0.072
27
2014 Results by Question Type
Type BP BR BF MP MR MF simple_pitch 0.645 0.736 0.677 0.685 0.787 0.720 simple_length 0.780 0.846 0.810 0.830 0.906 0.864
pitch_and_length 0.662 0.726 0.644 0.719 0.803 0.710 perf_spec 0.339 0.547 0.339 0.350 0.582 0.352 stave_spec 0.408 0.682 0.508 0.432 0.732 0.540 word_spec 0.487 0.771 0.520 0.487 0.771 0.520
followed_by 0.291 0.518 0.278 0.351 0.716 0.355 melodic_interval 0.396 0.417 0.402 0.471 0.501 0.481
harmonic_interval 0.185 0.207 0.188 0.269 0.329 0.281 cadence_spec 0.071 0.141 0.093 0.171 0.297 0.214
triad_spec 0.081 0.125 0.095 0.124 0.171 0.138 texture_spec 0.060 0.109 0.075 0.072 0.141 0.092
28
2015 Results by Question Type
Type BP BR BF MP MR MF 1_melod 0.450 0.764 0.508 0.467 0.801 0.531 n_melod 0.216 0.378 0.249 0.236 0.472 0.276 1_harm 0.261 0.426 0.285 0.289 0.471 0.317 texture 0.000 0.000 0.000 0.143 0.061 0.086 follow 0.172 0.415 0.217 0.247 0.486 0.275 synch 0.193 0.373 0.178 0.235 0.425 0.208
perf qualified 0.359 0.552 0.230 0.362 0.578 0.236 instr qualified 0.426 0.488 0.308 0.440 0.522 0.326 clef qualified 0.329 0.588 0.342 0.339 0.615 0.355 time qualified 0.187 0.476 0.248 0.211 0.544 0.281 key qualified 0.143 0.089 0.110 0.291 0.357 0.300
29
2016 Results by Question Type
Type BP BR BF MP MR MF 1_melod 0.232 0.044 0.054 0.520 0.101 0.129 n_melod 0.125 0.016 0.028 0.384 0.051 0.086 1_harm 0.076 0.023 0.019 0.300 0.033 0.035 n_harm 0.063 0.007 0.013 0.128 0.032 0.030 texture 0.000 0.000 0.000 0.000 0.000 0.000 follow 0.317 0.047 0.078 0.458 0.076 0.126 synch 0.000 0.000 0.000 0.103 0.011 0.018
30
Overall Conclusions We refined our ideas Some questions were chosen from real sources such as exam papers Questions got harder and hence more realistic This was difficult for participants!
32
Q: dotted crotchet against quavers in the bass in bars 1-43 A: [ 3/4, 2, 9:3-9:5 ], [ 3/4, 2, 10:3-10:5 ], [ 3/4, 2, 11:3-11:5 ], [ 3/4, 2, 12:3-12:5 ]
38
Q: passage in common time A: [4/4,1,1:1-4:4] Q: interval of a melodic sixth A: [4/4,4,1:1-1:2], [4/4,4,1:8-1:9] [4/4,4,1:9-1:10], [4/4,4,2:1-2:2], [4/4,4,2:8-2:9], [4/4,4,2:9-2:10], [4/4,4,3:1-3:2], [4/4,4,3:8-3:9], [4/4,4,3:9-3:10] Q: second A: None, because a second is harmonic by default Q: C followed by Eb A: [4/4,4,1:5-1:6], [4/4,4,1:13-1:14], [4/4,4,4:1-4:2], [4/4,4,4:9-4:10] Q: C followed by Eb in the bass clef A: [4/4,4,4:1-4:2], [4/4,4,4:9-4:10] Q: semiquaver E natural / sixteenth note E natural A: [4/4,4,2:3-2:4]
39
Work: J.S. Bach, Suite No. 3 in C Major for Cello, BWV 1009, Sarabande Extract:
Q: harmonic interval of a minor third A: [3/4,2,208:1-208:1] Q: minor third A: [3/4,2,208:1-208:1] (thirds are harmonic by default) Q: dotted quaver / dotted eighth note A: [3/4,4,206:5-206:7], [3/4,4,207:5-207:7], [3/4,4,208:5-208:7] Q: harmonic perfect fifth A: [3/4,1,206:1-206:1], [3/4,1,207:1-207:1], [3/4,4,208:5-208:7] (in last passage, C and G should be dotted but were not in the original) Q: simultaneous harmonic perfect fifth and harmonic eleventh A: [3/4,4,208:5-208:7] (same point, C and G are assumed dotted in this example)
40
Work: J. Dowland, King of Denmark's Galliard, P 40 Extract:
Q: perfect cadence A: [3/4,1,3:3-4:3] (We are assuming the cadence continues until the end of the bar) Q: four consecutive quavers / four consecutive quarter notes A: [3/4,2,2:3-2:6] Q: dotted minim in the bass / dotted half note in the bass A: [3/4,1,2:1-2:3] Q: harmonic fourth A: [3/4,1,1:1-1:1], [3/4,1,1:2-1:3], [3/4,1,4:1-4:3] (Note that there are two instances in bar (measure) 1 because the chord is played twice)
41
Work: J. Dowland, Pauana Dulandi, P 86 Extract:
Q: consecutive 5ths in the bass A: [4/4,1,2:1-2:4] Q: semibreve Bb in the treble clef / whole note Bb in the treble clef A: [4/4,1,1:1-1:4], [4/4,1,4:1-4:4] Q: octave followed two bars later by another octave A: [4/4,1,1:1-3:4] (assumed harmonic) Q: Vc triad A: [4/4,1,2:3-2:3]
42
Work: G.F. Handel, Messiah, HG xlv, "And the Glory of the Lord" Extract:
Q: crotchet rest / quarter note rest A: [3/4,1,1:1-1:1] Q: dotted crotchet followed by three quavers / dotted quarter note followed by three eighth notes A: [3/4,1,5:1-5:3], [3/4,1,6:1-6:3] Q: four hemidemisemiquavers / four sixty-fourth notes A: [3/4,4,3:9-3:9] Q: three quavers in a row / three eighth notes in a row A: [3/4,2,5:4-5:6], [3/4,2,6:4-6:6]
43
Work: G.F. Handel, Messiah, HG xlv, Overture Extract:
Q: D sharp crotchet / D sharp quarter note A: [4/4,1,22:1-22:1], [4/4,1,25:1-25:1] Q: D natural quaver / D natural eighth note A: [4/4,2,23:3-23:3], [4/4,2,24:4-24:4] Q: open VII triad in the first inversion A: [4/4,1,23:3-23:3] Q: melodic fourth in the bass clef A: [4/4,1,24:1-24:2]
45
Q: eight staccato notes in succession A: [4/4,1,17:1-17:4] Q: augmented melodic fourth A: [4/4,2,19:3-19:4], [4/4,2,20:4-20:5] Q: third A: [4/4,4,17:13-17:13], [4/4,2,19:2-19:2], [4/4,2,19:4-19:4], [4/4,4,19:9-19:9], [4/4,4,20:9-20:9] (these are assumed to be harmonic and can thus be across parts) Q: a quaver, then a major third / an eighth note, then major third A: [4/4,2,19:1-19:2], [4/4,2,19:3-19:4] (third assumed to be harmonic and to follow the quaver immediately) Q: change from bass to treble clef A: [4/4,1,17:2p] (recall that this means the clef change is immediately after 17:2)
46
Work: D. Scarlatti, Keyboard Sonata in D major, K 430 Extract:
Q: three fourths A: [3/8,2,56:1-56:3] (assumed consecutive) Q: treble clef F natural A: [3/8,2,62:2-62:2] Q: melodic octave A: [3/8,4,57:1-57:2], [3/8,4,57:2-57:6] (melodic must be stated, otherwise it is harmonic) Q: harmonic 5th followed by harmonic 4th A: [3/8,2,58:1-58:2], [3/8,2,62:1-62:2]
47
Architecture of Baseline System We have built a very basic system to perform the task: 1. Analyse the input xml file and extract questions and score files 2. For each question: • Parse question using Stanford Parser • Determine question type (similar to normal QA) • Parse the score file using Music21 • Based on question type, search for answer passages in score 3. Write out answers to output xml file
48
Linguistic Observations Queries are noun phrases Head noun group is the main feature (e.g. F#) PP modifiers qualify this (e.g. in the bass clef) A lot of terminology is used (e.g. semiquaver, soprano part, forte bar) Search based on query classification will work at least for simple examples.
49
Summary We are trying to find ways to link natural language descriptions of music to musical scores. Starting with the C@merata task, we are working with very simple tasks to develop the technology. Then we will progress to more complex tasks which are of genuine interest to musicologists. In due course, we aim to tie passages in musicological texts such as in Grove Online to the corresponding music scores.
50
Music Extracts symphony opening with a horn call over shimering strings Bruckner 4th Symphony http://www.youtube.com/watch?v=J8t1TzN0RRY Start: 0:00 End: 0:44 symphony closing with six unison chords Sibelius 5th Symphony http://www.youtube.com/watch?v=nkzrSZKA4cM Start: 9:36 End: 9:56 Nielsen 4th Symphony, Finale (shows two timpanists well) http://www.youtube.com/watch?v=yXDe1hj4HBo Start: 32:10 End: 32:48
51
Extracts Not Used symphony opening with two octave descending arpeggio Beethoven 9th Symphony string quartet opening including double stopping on all four instruments Beethoven op 127 symphony featuring a battle between two timpanists Nielsen 4th Symphony, Finale (not so good) http://www.youtube.com/watch?v=sD9I-UiYfW8 Start: 6:30 End: 7:08
52
Grove’s Dictionary of Music and Musicians • 1879-1889 George Grove, civil engineer, music administrator, writer and then Director of
Royal College of Music, wrote A Dictionary of Music and Musicians in four volumes. • 1904-910 Fuller Maitland edited the second edition - Grove's Dictionary of Music and
Musicians - in five volumes. • 1927 Henry Colles edited the third edition - in five volumes. • 1940 Henry Colles edited the fourth edition - in seven volumes. • 1954 Eric Blom edited the fifth edition - in nine volumes.
53
• 1980 Stanlie Sadie edited the sixth edition - The New Grove Dictionary of Music and Musicians - in twenty volumes. Contained 22,500 articles and 16,500 biographies.
• 2001 Stanlie Sadie edited the seventh edition - in 29 volumes. This was also available online. • 2009 Deane Root was appointed editor of Grove Music Online. By this time it contained more
than 50,000 articles. Grove is now considered to be the most comprehensive and scholarly source of information on Western Classical Art Music which exists. It is used daily by musicians and musicologists worldwide.
54
What might our queries be like in future? We will show some examples: • A natural language phrase describes a musical feature.
• A regular expression or other pattern could not capture it.
56
Some Examples Q: 'horn call over shimmering strings' A: Anton Bruckner, Symphony No. 4 "Romantic"
57
Some Examples Q: 'horn call over shimmering strings' A: Anton Bruckner, Symphony No. 4 "Romantic" Q: 'movement ending with six stacatto chords for full orchestra'
58
Some Examples Q: 'horn call over shimmering strings' A: Anton Bruckner, Symphony No. 4 "Romantic" Q: 'movement ending with six stacatto chords for full orchestra' A: Jean Sibelius, Symphony No. 5
59
Some Examples Q: 'horn call over shimmering strings' A: Anton Bruckner, Symphony No. 4 "Romantic" Q: 'movement ending with six stacatto chords for full orchestra' A: Jean Sibelius, Symphony No. 5 Q: 'symphony featuring a battle between two timpanists'
60
Some Examples Q: 'horn call over shimmering strings' A: Anton Bruckner, Symphony No. 4 "Romantic" Q: 'movement ending with six stacatto chords for full orchestra' A: Jean Sibelius, Symphony No. 5 Q: 'symphony featuring a battle between two timpanists' A: Carl Nielsen, Symphony No. 4 "The Inextinguishable"
61
What are the Characteristics of these Queries? Not very long Not that specific ('over', 'featuring') Use musical terms ('horn', 'strings', 'stacatto', 'chords', 'full orchestra', 'symphony', 'timpani') Also use non-musical terms, interpreted in a musical way ('shimmering', 'battle')
62
What are the Characteristics of these Queries? Not very long Not that specific ('over', 'featuring') Use musical terms ('horn', 'strings', 'stacatto', 'chords', 'full orchestra', 'symphony', 'timpani') Also use non-musical terms, interpreted in a musical way ('shimmering', 'battle') Nevertheless, experts can answer them!
63
Table 4. Results for simple_pitch Questions
Run BP BR BF MP MR MF CLAS01 0.959 0.972 0.965 0.982 0.995 0.988 DMUN01 0.717 0.674 0.695 0.790 0.743 0.766 DMUN02 0.729 0.729 0.729 0.798 0.798 0.798 DMUN03 0.955 0.972 0.963 0.968 0.986 0.977 LACG01 0.000 0.000 0 0.200 0.028 0.049 OMDN01 0.000 0.000 0.000 0.000 0.000 0.000 TCSL01 0.959 0.963 0.961 0.982 0.986 0.984 UNLP01 0.422 0.789 0.550 0.478 0.894 0.623 UNLP02 0.422 0.789 0.550 0.478 0.894 0.623
Maximum 0.959 0.972 0.965 0.982 0.995 0.988 Minimum 0.000 0.000 0.000 0.000 0.000 0.000 Average 0.645 0.736 0.677 0.685 0.787 0.720
64
Table 5. Results for simple_length Questions
Run BP BR BF MP MR MF CLAS01 0.904 0.988 0.944 0.915 1.000 0.956 DMUN01 0.858 0.852 0.855 0.879 0.874 0.876 DMUN02 0.863 0.889 0.876 0.884 0.911 0.897 DMUN03 0.955 0.985 0.970 0.967 0.997 0.982 LACG01 0.529 0.197 0.287 0.620 0.231 0.337 OMDN01 0.408 0.471 0.437 0.419 0.483 0.449 TCSL01 0.979 0.988 0.983 0.991 1.000 0.995 UNLP01 0.636 0.797 0.707 0.791 0.991 0.880 UNLP02 0.636 0.797 0.707 0.791 0.991 0.880
Maximum 0.979 0.988 0.983 0.991 1.000 0.995 Minimum 0.408 0.471 0.437 0.419 0.483 0.449 Average 0.780 0.846 0.810 0.830 0.906 0.864
65
Table 6. Results for pitch_and_length Questions
Run BP BR BF MP MR MF CLAS01 0.860 0.937 0.897 0.895 0.975 0.933 DMUN01 0.653 0.785 0.713 0.721 0.867 0.787 DMUN02 0.663 0.823 0.734 0.730 0.905 0.808 DMUN03 0.760 0.943 0.842 0.770 0.956 0.853 LACG01 0.157 0.196 0.174 0.172 0.215 0.191 OMDN01 0.714 0.032 0.061 0.714 0.032 0.061 TCSL01 0.723 0.892 0.799 0.754 0.930 0.833 UNLP01 0.460 0.696 0.554 0.582 0.880 0.701 UNLP02 0.460 0.696 0.554 0.582 0.880 0.701
Maximum 0.86 0.943 0.897 0.895 0.975 0.933 Minimum 0.460 0.032 0.061 0.582 0.032 0.061 Average 0.662 0.726 0.644 0.719 0.803 0.710
66
Table 7. Results for perf_spec Questions
Run BP BR BF MP MR MF CLAS01 1.000 0.862 0.926 1.000 0.862 0.926 DMUN01 0.407 0.379 0.393 0.444 0.414 0.428 DMUN02 0.407 0.379 0.393 0.444 0.414 0.428 DMUN03 0.741 0.690 0.715 0.741 0.690 0.715 LACG01 0.000 0.000 0.000 0.000 0.000 0.000 OMDN01 0.000 0.000 0.000 0.000 0.000 0.000 TCSL01 0.066 0.897 0.123 0.066 0.897 0.123 UNLP01 0.045 0.586 0.084 0.053 0.690 0.098 UNLP02 0.045 0.586 0.084 0.053 0.690 0.098
Maximum 1.000 0.897 0.926 1.000 0.897 0.926 Minimum 0.000 0.000 0.000 0.000 0.000 0.000 Average 0.339 0.547 0.339 0.350 0.582 0.352
67
Table 8. Results for stave_spec Questions
Run BP BR BF MP MR MF CLAS01 0.568 1.000 0.724 0.568 1.000 0.724 DMUN01 0.534 0.840 0.653 0.568 0.893 0.694 DMUN02 0.534 0.840 0.653 0.568 0.893 0.694 DMUN03 0.619 0.973 0.757 0.619 0.973 0.757 LACG01 0.165 0.240 0.196 0.174 0.253 0.206 OMDN01 0.000 0.000 0.000 0.000 0.000 0.000 TCSL01 0.661 0.987 0.792 0.661 0.987 0.792 UNLP01 0.173 0.440 0.248 0.230 0.587 0.331 UNLP02 0.173 0.373 0.236 0.241 0.520 0.329
Maximum 0.661 1.000 0.792 0.661 1.000 0.792 Minimum 0.000 0.000 0.000 0.000 0.000 0.000 Average 0.408 0.682 0.508 0.432 0.732 0.540
68
Table 9. Results for word_spec Questions
Run BP BR BF MP MR MF CLAS01 1.000 1.000 1.000 1.000 1.000 1.000 DMUN01 0.750 0.750 0.750 0.750 0.750 0.750 DMUN02 0.750 0.750 0.750 0.750 0.750 0.750 DMUN03 1.000 1.000 1.000 1.000 1.000 1.000 LACG01 0.044 0.250 0.075 0.058 0.333 0.099 OMDN01 0.000 0.000 0.000 0.000 0.000 0.000 TCSL01 0.261 1.000 0.414 0.261 1.000 0.414 UNLP01 0.067 0.833 0.124 0.067 0.833 0.124 UNLP02 0.067 0.833 0.124 0.067 0.833 0.124
Maximum 1.000 1.000 1.000 1.000 1.000 1.000 Minimum 0.000 0.000 0.000 0.000 0.000 0.000 Average 0.487 0.771 0.520 0.487 0.771 0.520
69
Table 10. Results for followed_by Questions
Run BP BR BF MP MR MF CLAS01 0.748 0.859 0.800 0.830 0.953 0.887 DMUN01 0.090 0.797 0.162 0.093 0.820 0.167 DMUN02 0.092 0.820 0.165 0.094 0.844 0.169 DMUN03 0.094 0.844 0.169 0.096 0.859 0.173 LACG01 0.003 0.008 0.004 0.068 0.156 0.095 OMDN01 0.567 0.133 0.215 0.567 0.133 0.215 TCSL01 0.733 0.688 0.710 0.842 0.789 0.815 UNLP01 0.000 0.000 0.000 0.025 0.695 0.048 UNLP02 0.000 0.000 0.000 0.260 0.633 0.369
Maximum 0.748 0.859 0.800 0.842 0.953 0.887 Minimum 0.000 0.000 0.000 0.025 0.133 0.048 Average 0.291 0.518 0.278 0.351 0.716 0.355
70
Table 11. Results for melodic_interval Questions
Run BP BR BF MP MR MF CLAS01 0.660 0.837 0.738 0.699 0.886 0.781 DMUN01 0.528 0.545 0.536 0.724 0.748 0.736 DMUN02 0.521 0.610 0.562 0.701 0.821 0.756 DMUN03 0.562 0.659 0.607 0.736 0.862 0.794 LACG01 0.000 0.000 0.000 0.158 0.024 0.042 OMDN01 0.000 0.000 0.000 0.000 0.000 0.000 TCSL01 0.894 0.683 0.774 0.904 0.691 0.783 UNLP01 0.000 0.000 0.000 0.000 0.000 0.000 UNLP02 0.000 0.000 0.000 0.000 0.000 0.000
Maximum 0.894 0.837 0.774 0.904 0.886 0.794 Minimum 0.000 0.000 0.000 0.000 0.000 0.000 Average 0.396 0.417 0.402 0.471 0.501 0.481
71
Table 12. Results for harmonic_interval Questions
Run BP BR BF MP MR MF CLAS01 0.158 0.429 0.231 0.353 0.957 0.516 DMUN01 0.415 0.386 0.400 0.585 0.543 0.563 DMUN02 0.415 0.386 0.400 0.585 0.543 0.563 DMUN03 0.492 0.457 0.474 0.631 0.586 0.608 LACG01 0.091 0.014 0.024 0.273 0.043 0.074 OMDN01 0.000 0.000 0.000 0.000 0.000 0.000 TCSL01 0.000 0.000 0.000 0.000 0.000 0.000 UNLP01 0.000 0.000 0.000 0.000 0.000 0.000 UNLP02 0.000 0.000 0.000 0.000 0.000 0.000
Maximum 0.492 0.457 0.474 0.631 0.957 0.608 Minimum 0.000 0.000 0.000 0.000 0.000 0.000 Average 0.185 0.207 0.188 0.269 0.329 0.281
72
Table 13. Results for cadence_spec Questions
Run BP BR BF MP MR MF CLAS01 0.238 0.625 0.345 0.286 0.750 0.414 DMUN01 0.083 0.125 0.100 0.333 0.500 0.400 DMUN02 0.083 0.125 0.100 0.333 0.500 0.400 DMUN03 0.167 0.250 0.200 0.417 0.625 0.500 LACG01 0.000 0.000 0.000 0.200 0.125 0.154 OMDN01 0.000 0.000 0.000 0.000 0.000 0.000 TCSL01 0.000 0.000 0.000 0.000 0.000 0.000 UNLP01 0.000 0.000 0.000 0.000 0.000 0.000 UNLP02 0.000 0.000 0.000 0.000 0.000 0.000
Maximum 0.238 0.625 0.345 0.417 0.75 0.500 Minimum 0.000 0.000 0.000 0.000 0.000 0.000 Average 0.071 0.141 0.093 0.171 0.297 0.214
73
Table 14. Results for triad_spec Questions
Run BP BR BF MP MR MF CLAS01 0.348 0.727 0.471 0.391 0.818 0.529 DMUN01 0.100 0.091 0.095 0.200 0.182 0.191 DMUN02 0.100 0.091 0.095 0.200 0.182 0.191 DMUN03 0.100 0.091 0.095 0.200 0.182 0.191 LACG01 0.000 0.000 0.000 0.000 0.000 0.000 OMDN01 0.000 0.000 0.000 0.000 0.000 0.000 TCSL01 0.000 0.000 0.000 0.000 0.000 0.000 UNLP01 0.000 0.000 0.000 0.000 0.000 0.000 UNLP02 0.000 0.000 0.000 0.000 0.000 0.000
Maximum 0.348 0.727 0.471 0.391 0.818 0.529 Minimum 0.000 0.000 0.000 0.000 0.000 0.000 Average 0.081 0.125 0.095 0.124 0.171 0.138
74
Table 15. Results for texture_spec Questions
Run BP BR BF MP MR MF CLAS01 0.182 0.500 0.267 0.273 0.750 0.400 DMUN01 0.100 0.125 0.111 0.100 0.125 0.111 DMUN02 0.100 0.125 0.111 0.100 0.125 0.111 DMUN03 0.100 0.125 0.111 0.100 0.125 0.111 LACG01 0.000 0.000 0.000 0.000 0.000 0.000 OMDN01 0.000 0.000 0.000 0.000 0.000 0.000 TCSL01 0.000 0.000 0.000 0.000 0.000 0.000 UNLP01 0.000 0.00 0.000 0.000 0.000 0.000 UNLP02 0.000 0.000 0.000 0.000 0.000 0.000
Maximum 0.182 0.500 0.267 0.273 0.750 0.400 Minimum 0.000 0.000 0.000 0.000 0.000 0.000 Average 0.060 0.109 0.075 0.072 0.141 0.092