ICAEA CONFERENCE 2020 DRAFT PROGRAMME Page 1

INTERNATIONAL CONFERENCE

INTERNATIONAL CIVIL AVIATION ENGLISH ASSOCIATION

supporting the use of English for aviation safety

DRAFT PROGRAMME

For more information

www.icaea.aero

ICAEA CONFERENCE 2020 DRAFT PROGRAMME Page 2

CONFERENCE 2020

The ICAEA Conference 2020 will be held in Dubai and be a full 3-day event. Fifteen years after the launch of the ICAO LPRs, this event will explore best practice in ICAO LPR test design and development. How effective are LPR tests in assessing the language and communicative needs of

pilots and controllers for licensing purposes? What equivalency do LPR test results have at the regional and international levels? How does the design of a test play a role in overall quality? How can we evaluate the effectiveness of the design of a test? What can we do to improve the design of existing LPR tests and develop new tests?

Following the publication of the LPR Test Design Guidelines on the ICAEA website and building on the TDG Workshops in 2019, this event will feature conference sessions for all participants in the mornings, and a choice of workshop streams in the afternoons.

WORKSHOP STREAM 1: Test Design Guidelines

WORKSHOP STREAM 2:

Test Development

Hands-on workshop activities for familiarisation with the TDG Criteria and Test Evaluation Tool for LPR test approval, selection and auditing purposes.

Practical guidance and workshop activities exploring how the TDG Criteria can be applied to improve and develop test design, test tasks and items.

DESIGNED FOR: CAA LPR Focal Points and other stakeholders from airlines & ANSPs who did not attend a TDG Workshop in 2019, and are interested to understand the new TDG Criteria.

DESIGNED FOR: Participants who attended a TDG Workshop in 2019, or, are involved in LPR testing, and are interested in how the TDGs can be applied to test development and maintenance.

ICAO LPR TEST DESIGN AND DEVELOPMENT

ICAEA CONFERENCE 2020 DRAFT PROGRAMME Page 3

CONFERENCE 2020 Day 1

MORNING SESSIONS

Main Room 8.00-8.30 Conference Check-in

8.30-8.45 Workshop Opening & Formalities ICAEA

8.45-9.15 Conference Introduction Expanding on the Test Design Guidelines – ICAEA TDG Development Team

9.15-10.00 Keynote 1: Best practice in language test development Drawing from mainstream language testing practices – Speaker 1

Break 10.00-10.30

Main Room 10.30-11.00 Case Study 1 Implementing the ICAO LPRs: Test Design – Speaker 2

11.00-11.30 Presentation 1 Linking the domain and test construct – Speaker 3

Lunch 11.30-13.00

AFTERNOON SESSIONS

STREAM 1: Test Design Guidelines STREAM 2: Test Development

Workshop Rooms

13.00-14.00 Workshop 1A TDG Criterion 2 Separate test instruments need to

be designed for pilots and air

traffic controllers.

Presentation Overview of steps in test development all Stream 2 participants

14.15-15.15 Workshop 1B TDG Criterion 6 Test instruments need to include

tasks and items which allow the

assessment to differentiate

between ICAO language

proficiency levels.

Group 1 Group 2

Workshop 2A - Listening Considerations for listening test item types. Pros and cons of different approaches.

Workshop 2B - Speaking Developing pilot-ATC role-play tasks. Content and the role of the task for effective elicitation.

Break 15.15-15.45

Workshop Rooms

15.45-16.45 Workshop 1C TDG Criteria 1 & 7 Test instruments need to include

tasks that directly assess how test takers use language in radiotelephony communication contexts.

Test instruments need to contain

tasks that assess test takers’

abilities to understand and

communicate in real-world

contexts.

Group 1 Group 2

Workshop 2B - Speaking Developing pilot-ATC role-play tasks. Content and the role of the task for effective elicitation.

Workshop 2A - Listening Considerations for listening test item types. Pros and cons of different approaches.

ICAEA CONFERENCE 2020 DRAFT PROGRAMME Page 4

CONFERENCE 2020 Day 2

MORNING SESSIONS

Main Room 8.00-8.45 Q&A Discussion Session Challenges in test development and maintenance

8.45-9.30 Keynote 2: Communicative Competence What are the implications for the LPRs? – Speaker 4

Break 9.30-10.00

Main Room 10.00-10.30 Keynote 3: Assessing Communicative Competence What are the implications for ICAO Level 6? – Speaker 5

10.30-11.00 Presentation 2 Identifying and assembling test development teams – Speaker 6

Lunch 11.00-12.30

AFTERNOON SESSIONS

STREAM 1: Test Design Guidelines STREAM 2: Test Development

Workshop Rooms

12.30-13.30 Workshop 1D TDG Criterion 4 Test instruments need to comprise

distinct sections with a range of

appropriate task types.

Group 1 Group 2

Workshop 2C - Listening Identifying and

developing content for

listening tests: type,

length and complexity.

Workshop 2D - Speaking Developing interactive

speaking tasks. Content

and the role of the task

for effective elicitation.

13.45-14.45 Workshop 1E TDG Criterion 5 Test instruments need to include

tasks that allow test takers to

engage in interactive and extended

communication.

Group 1 Group 2

Workshop 2D - Speaking Developing interactive speaking tasks. Content and the role of the task for effective elicitation.

Workshop 2C - Listening Identifying and developing content for listening tests: type, length and complexity.

Break 14.45-15.15

Workshop Rooms

15.15-16.00 Workshop 1F TDG Criteria 3 Test instruments need to contain

tasks dedicated to assessing

listening comprehension,

separately from tasks designed to

assess speaking performance.

Group 1 Group 2

Workshop 2E - Speaking Group work: Assembling a range of speaking task types and content to create a speaking test.

Workshop 2F - Listening Group work: Assembling a range of listening task types and content to create a listening test.

16.00-16.45 Group 1 Group 2

Workshop 2F - Listening Group work: Assembling a range of listening task types and content to create a listening test.

Workshop 2E - Speaking Group work: Assembling a range of speaking task types and content to create a speaking test

ICAEA CONFERENCE 2020 DRAFT PROGRAMME Page 5

CONFERENCE 2020 Day 3

MORNING SESSIONS

Main Room 8.00-8.45 Q&A Discussion Session Challenges in test development and maintenance

8.45-9.30 Keynote 4 International implementation of an ICAO LPR recognised test – Speaker 7

Break 9.30-10.00

Main Room 10.00-10.30 Case Study 2 Implementing the ICAO LPRs: Test Design – Speaker 8

10.30-11.00 Presentation 3 Moving from test design to delivery: The role of the interlocutor – Speaker 9

Lunch 11.00-12.30

AFTERNOON SESSIONS

STREAM 1: Test Design Guidelines STREAM 2: Test Development

Workshop Rooms

12.30-13.15 Workshop 1G TDG Criterion 8 Test banks need to comprise a

sufficient number of equivalent

versions, with each version of the

test representing the test

instrument in the same way.

Group 1 Group 2

Workshop 2G - Speaking Hands-on practice:

Creating a test overview

template for a complete

speaking test.

Workshop 2H - Listening Hands-on practice:

Creating a test overview

template for a complete

listening test.

13.30-14.15 Workshop 1H Recap of TDG Criteria 1 to 8 Applying the ICAO LPR Test

Evaluation Toolkit

Group 1 Group 2

Workshop 2H - Listening Hands-on practice: Creating a test overview template for a complete listening test.

Workshop 2G - Speaking Hands-on practice: Creating a test overview template for a complete speaking test.

Break 14.15-14.30

Workshop Rooms

14.30-15.30 Wrap-up Implementing the TDGs: Feedback

and discussion – “What’s next?”

Group 1 Group 2

Wrap-up Presentation of listening and speaking test templates to peers

Wrap-up Presentation of listening and speaking test templates to peers