b#: chord-based correction for multitouch braille input
TRANSCRIPT
![Page 1: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/1.jpg)
B# :: Chord-based Correction for Multitouch Braille InputHUGO NICOLAUKYLE MONTAGUETIAGO GUERREIROJOÃO GUERREIROVICKI L. HANSON
![Page 2: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/2.jpg)
motivation :: non-visual input
![Page 3: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/3.jpg)
motivation :: braille input
[Southern et al. 2012]
[Oliveira et al. 2011] [Azenkot et al. 2012]
![Page 4: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/4.jpg)
motivation :: fast typing (4x)
![Page 5: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/5.jpg)
problem :: error prone
50%
![Page 6: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/6.jpg)
challenge :: accurate input
![Page 7: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/7.jpg)
approach :: spellchecker
? ? ? ? ? ? ? ? ? ?
> e d k l o w u h k d _
![Page 8: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/8.jpg)
approach :: character-level
e x i l e d u n k s
> e d k l o w u h k d _
![Page 9: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/9.jpg)
B# :: chord-level spellchecker
h e l l o w o r l d
> e d k l o w u h k d _
![Page 10: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/10.jpg)
B# :: data collection
![Page 11: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/11.jpg)
B# :: data collection
11 blind participants :: ages 22 – 62 ::
3 females :: grade 1 braille ::
no touchscreen experience
![Page 12: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/12.jpg)
major results :: substitutions
Insertions Substitutions Omissions
23%
72%
5%
Overall Error Rate: 18%
![Page 13: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/13.jpg)
major results :: 43% single-dot error
omission
insertion
transposition
q g
i f
b k
![Page 14: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/14.jpg)
major results :: invalid characters
! t
![Page 15: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/15.jpg)
B# :: braille distance
[100010]
[100010]
= ?
-
![Page 16: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/16.jpg)
distance :: damerau-levenshtein
[100] – [110] + [010] – [010]
= 1 + 0 = 1
![Page 17: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/17.jpg)
B# :: scoring function
scoreword = wMSD(Chtyped, Chword) + ƒword
![Page 18: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/18.jpg)
evaluation :: B#, AOSP
![Page 19: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/19.jpg)
evaluation :: dataset
751 words :: 49% incorrect entries ::
word list with 213,133 entries
![Page 20: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/20.jpg)
results :: B# is more accurate
1 2 3 4 5 6 7 8 9 1025%
35%
45%
55%
65%
75%
56%
75%
28%39%
Acc
ura
cy
B#
Android
![Page 21: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/21.jpg)
results :: word correction
204 of 364
100 of 364
![Page 22: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/22.jpg)
results :: no gain beyond 5
1 2 3 4 5 6 7 8 9 1025%
35%
45%
55%
65%
75%A
ccura
cy
B#
Android
6%
9%
![Page 23: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/23.jpg)
results :: incorrectly corrected
Android B#
1.4%1.7%
![Page 24: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/24.jpg)
conclusion :: B#
![Page 25: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/25.jpg)
conclusion :: higher accuracy
2X
![Page 26: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/26.jpg)
future :: non-visual interface
![Page 27: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/27.jpg)
The End.HUGO [email protected], slides, and video @ http://web.ist.utl.pt/hugo.nicolau
![Page 28: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/28.jpg)
non-visual correction :: challenges
Automatic correction?
Word-completion?
How to provide corrections?
When to provide them?
How to users explore suggestions?
![Page 29: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/29.jpg)
B#: future improvements
Bi-grams, Tri-grams, N-grams
“Machine Learned” Distance Function
Personalized spellchecker
Leverage touch information
![Page 30: B#: Chord-based Correction for Multitouch Braille Input](https://reader033.vdocuments.us/reader033/viewer/2022052619/5561da7bd8b42a9d3f8b5bb6/html5/thumbnails/30.jpg)
B#: android’s proximity matrix
Fairly complex spellchecker
Dozen of features
Worthwhile doing