new interaction techniques

New Interaction Techniques

Department of Computer SciencesUniversity of Tampere, Finland

Department of Computer SciencesUniversity of Tampere, Finland

September – December, 2003

Grigori Evreinov

www.cs.uta.fi/~grse/

Adaptive Scan Interval

in novel Wrist PDAs button functionality is a key questionsingle-switch manipulation for text entry is also considered as a model for optimizing a menu selection task for physically challenged usersscanning mode is one of accessibility options used in MS Windows systemthis mode was applied with onscreen keyboard to choose highlight areas by pressing a hot key or using a switch-input device

Fossil Wrist PDA with Palm OS http://www.fossil.com/

TAUCHI MMIG G. Evreinov 01_21 04.11.2003



a performance with scan mode will depend on the congruence degree of

user actions and the way of presenting spatial-temporal structure of the

interface, while the feedback cues should play a role of strobe-signals to

stimulate user behavior and to stabilize temporal framework for

rhythmically-alternating cognitive and motor activities


recently diverse versions of the onscreen keyboards with a scanning option

were designed to provide alternative access for people who cannot move

any pointing device at all

some of them are based on forecast and prediction of user behavior, auto-

completion and phrase-based text entry

phrase entry technique can be based on complicated asymmetric

hierarchical structure with a huge number of branches to specify a phrase

category [1, 2]


http://www.enkidu.net/




http://www.wivik.com/Downloads/WiViK3UserGuide.pdf



a cyclic temporal sequence to simulate joystick’s state through a single switch operation by, when the right state appeared or was entered [2]http://www.computer-fuer-Behinderte.de/



demo1 demo2 demo3

eLocutor

[3] http://www.holisticit.com/eLocutor/Elocutorv2.htm


Adaptive Scan Intervalin eLocutor [2], to type the sentence “what is the date today” took 6 clicks

and 13 seconds after the first word was typed

however, before the first word was typed it was necessary to pass 6 levels

and make 6 clicks without any mistake

this procedure can take 14 seconds or more depending on a number of

alternatives on each used level

branching with a huge number of alternatives makes difficult not the

navigation itself but the waiting of the moment when a necessary menu

item will be accessible (activated)

another problem is: how to simulate “back step” or undo operation when

the user can manipulate only a single button (switch)?

that is, the problem is how to navigate and capture any item among the

long menu list with maximal efficiency in any moment when only a single

button is being used

[4]


Adaptive Scan Intervalthe problem of connectivity in complex cyclic menu can be decided through

access hierarchy for key-nodes and short-cycles

at the same time, if the system could individually and dynamically turn,

scan mode could be more flexible

real-time manipulation by scan-interval and adjustments of delays have

been investigated by Simpson and Koester [4], Lesher et al. [5], and

Bourhis [6]



Lesher et al. [5] developed a method for row-column scanning interface

based upon quantitative measures of scanning performance

the adjustment scheme optimized scanning delays after approximately

1200 selections (~240 words)

[5]


Adaptive Scan IntervalBourhis and Pino were built

EDITH system based on mathematical model (MHP) of the operator’s behavior and statistical analysis of experimental data [6]a behavior model includes a particular sequence of actions, they are: perception, cognitive processing and motor actions

Tact = Tp + Tc + Tm

Tp – perception cycle /period

Tc – cognition cycle

Tm – motion cycle

Tact – action times

Tact Tscan

Tthresholdselection

highlighting the menu item


the temporal diagram of the algorithm for measuring the user performance through visual-motor reaction time and correction of the scan interval

T0 – the first variable interval, T1 – the second variable interval and T2 = T1

Tthresh. - dynamical threshold Tthresh. = T0 + T1

Time

Tscan

RTi

T0 T2T1

selection selection

Adaptive Scan Intervalin any case, physical stimulus starts the motor reaction that could be measured

if the moment of stimulus is knownbased on real-time analysis the visual-motor reaction time, we can predict and optimize scan interval

[ see too DwellTimeInteraction.ppt ]



Two examples in testing of the adaptive scan interval. Changing for

T0 – low graph; periodic correction for T1 and RTi – upper graph.

one test phrase of six words could be enough to initialize the system, after this kind of calibration the proposed algorithm will automatically keep scan interval near convenient magnitude with given speed (increment dT)

demo4

D:\NIT_Software\Adaptive_Scan\Software\AdaptScanInterval\ScanInterval.exe


Usability-testing software for… Adaptive Scan

Interval


[ see too T-Adaptive Unit in DwellTimeInteraction.ppt ]


Private Sub ChangeScan()

rTime > 100 or tScan / 2

Yes

NoChangeScan

ArrThresh(nClick) = tThresh ArrCThresh(nClick) = tThresh ArrScan(nClick) = tScan t1 = 0: t2 = 0

ArrThresh(nClick) = rTime - tScan

nClick < (nAve + 1)

Yes

No

ArrDTmp(nClick) = rTime - tScan

aveThresh = tThreshShift of array and count of the sliding aveThresh

aveThresh < min lower limit

Yes

NoaveThresh = min

aveThresh < tThresh - tDelta

aveThresh > tThresh + tDelta

T0


TAUCHI MMIG G. Evreinov p 16_21 04.11.2003

aveThresh < tThresh - tDelta aveThresh > tThresh + tDelta

tScan = tScan - tDeltasDelta = sDelta - tDelta

ArrScan(nClick) = tScan

tScan = tScan + tDeltasDelta = sDelta + tDelta

sDelta > tIndex tDelta sDelta < (-1) tIndex tDelta

new current value

tThresh = tThresh + CInt(sDelta / 2)

sDelta = 0

tThresh = tThresh + CInt(sDelta / 2)

sDelta = 0

tThresh < 50 tThresh = 50

lower limit

ArrCThresh(nClick) = tThresh new current value

Private Sub ChangeScan()

tScan < 100

tScan = 100lower limit


change Line2 position

change Line1 position


Adaptive Scan IntervaltxtEntry_1Bt

n_aUsability-testing software for…



Start Click

imaging the 1st active group of menu items

imaging the 2nd active group of menu items

imaging the 3d active group of menu items

the First Click

changing content of the group

Start Click the 1st Click the 2nd Click the 3d Click

ERA DHL GWV

TIS CFP BXK

NO_ UMY QJZ

ERA DHL GWV

TIS CFP BXK

NO_ UMY QJZ

ERA

DHL

GWV

E

R

A

E

Time

TIS CFP BXK

NO_ UMY QJZ

ERA DHL GWV



Press-and-hold the key Up the 2nd Click

ERA DHL GWV E

Time

E

R

A

E

TIS CFP BXK

NO_ UMY QJZ

ERA DHL GWV

Press-and-hold the key Up

ERA DHL GWV

Time

E

R

A

Cancel

BackSp

Signs

StopEdit

File

TextEntry

Text entry will be switched into commands selection mode



0

1

2

3

4

5

E R A T I S N O sp D H L C F P U M Y G W V B X K O J Z

sPredicted Received

677.8 248.3 73.9

average times (and standard deviation) needed to choose any character at scan interval 460 ms regarding to predicted values (the left columns)summarized relative frequency of the characters per one thousand letters used during the test for each group (according to accessibility) is shown in the bottom

TAUCHI MMIG G. Evreinov p 21_21 04.11.2003

References[1] File, P., Todman, J., Higginbotham, J., Lesher, G.W., Moulton, B.J., Alm, N. CONTACT: A

Communication Aid Based on Pre-Prepared Phrases. AAATE’03, Contact_146-final.pdf

[2] Seveke, E. & Seveke, L. Computer aids for handicapped persons (MauSi scan). http://www.computer-

fuer-behinderte.de/

[3] Mehta, A. eLocutor version 2. http://www.holisticit.com/eLocutor/Elocutorv2.htm

[4] Simpson, R.C., Koester, H.H. Adaptive one-switch row-column scanning. IEEE Transactions on

Rehabilitation Engineering 7(4), (1999), 464-473.

[5] Lesher, G.W., Higginbotham, D.J., and Moulton, B.J. Techniques for automatically updating scanning

delays. Proc. of the RESNA 2000, (2000), 85-87. Available at:

http://www.enkidu.net/enkidu_research.html

[6] Bourhis, G., Pino, P. Temporal analysis of the use of an augmentative communication device. Proc.

AAATE’03. IOS Press, Netherlands (2003), 294-298.

[7] Specialized Input Systems. Onscreen keyboards. Assistive Technology Training Online Project, 2000-

2002. http://atto.buffalo.edu/registered/ATBasics/AdaptingComputers/Special/onscreenkeyboards.php

[8] Stephanidis, C., Savidis, A. Interface development toolkits for non-visual and switch-based interaction.

Proc. ERCIM News, Special Theme: Human Computer Interaction, 46 (2001, July) 14-15.

http://www.ercim.org/publication/Ercim_News/enw46/stephanidis2.html


http://atto.buffalo.edu/registered/ATBasics/AdaptingComputers/Special/onscreenkeyboards.php












new interaction techniques

Documents

scan mode

adaptive scan interval

usedtauchi mmig

switchinput devicetauchi

single button switch

single switch operation

necessary menu item

complex cyclic menu