griÉmÉtic – groupe de recherche interuniversitaire sur l...

11th conference of

The International Test CommissionJuly 2-5, 2018 • Montréal, Canada

On the Beat of Testing

We are the world’s learning company, on a mission to help people make progress in their lives through learning. Having delivered over 100 million online assessments, learning outcomes are at the heart of everything we do. Our world-class assessment solutions are designed to develop new, personalized ways of learning. Because where learning flourishes, so do people.

For every learner, at every stage

Illustration by Lucy Vigrasswww.pearson.com

Improving the science and practiceof testing and assessment

buros.org

• Expert psychometric services• Independent verification processes• Improved quality of proprietary testing programs

PSYCHOMETRIC CONSULTING

• Providing instructional and educational resources• Informing selection, development, and use of tests• Promoting responsible test use

ASSESSMENT LITERACY

• Authoritative reference materials• Mental Measurements Yearbooks• Tests in Print• Pruebas Publicadas en Español

TEST REVIEWS & INFORMATION

Improving the science and practiceof testing and assessment

buros.org

• Expert psychometric services• Independent verification processes• Improved quality of proprietary testing programs

PSYCHOMETRIC CONSULTING

• Providing instructional and educational resources• Informing selection, development, and use of tests• Promoting responsible test use

ASSESSMENT LITERACY

• Authoritative reference materials• Mental Measurements Yearbooks• Tests in Print• Pruebas Publicadas en Español

TEST REVIEWS & INFORMATION

Connecting talent and aspiration with opportunity

© 2018 Graduate Management Admission Council (GMAC). All rights reserved. Graduate Management Admission Council® is a registered trademark of GMAC in the United States and other countries.

The Graduate Management Admission Council (GMAC) is a global, nonprofit association of leading graduate business schools. We are committed to the work you do every day. Our GMAC suite of assessments and services addresses the diverse needs of graduate management education professionals and is built on decades of experience and rich data.

Our Market Intelligence provides actionable insights on issues facing the industry, including data trends, the latest research, survey reports, customized analytics and white papers.

Visit gmac.com for more information and current research

2018_ATP_ConferenceAd_15cmx21cm_PRINT_v5.indd 1 3/27/2018 6:40:56 PM

3July 2-5, 2018 • Montréal, Canada • itc-conference.com

ITC

Pres

iden

tial

Add

ress

Dear Colleagues and Friends,

The ITC is an association of national psychological associations, test commissions, publishers and other organizations. It also has a large individual member base. Membership covers most of the Western and Eastern European Countries and NorthAmerica, as well as countries in the Middle and Far East, and South Africa. The ITC is committed to promoting effective testing and assessment policies and to the properdevelopment, evaluation and uses of educational and psychological instruments. The ITC facilitates exchanges of information among members and others; facilitates cooperation toward the solution of problems associated with test development and use; and in otherways explores issues related to the construction, distribution, and use of tests, scales, and other methods used to assess personal and group qualities. The biennial conference of the International Test Commission has now been for many years a premier event in the world of psychological and educational testing. Practitioners and researchers dedicated to testing and assessment, test developers, testing companies, test publishers, regulators and policy makers: we all come together once every two years to discuss important international, regional and national developments in testing and assessment, to share ideas and to contribute to the evolutions of tomorrow in this important domain of knowledge and practice. I am delighted to welcome you all to the 11th Conference of the ITC in July 2018, in Montreal, Canada - a vibrant, fascinating and multicultural city, which has so much to offer. Just before the ITC Conference, Montreal will host the 29th International Congress of Applied Psychology (June 26-30, 2018), and during the same period will also be host to the renowned jazz festival (June 28-July 7, 2018). The ITC conference will surely be the jewel in this intellectual cornucopia. Who could ask for more? We cordially invite you to register for your attendance at the ITC2018, which promises to be a fantastic scientific event - the highlight of the year in testing and assessment. I am looking forward to meeting you in Montreal in the summer of 2018!

Dragos IliescuITC President

4 11th conference of The International Test Commission

Wel

com

e m

essa

ge

Dear colleagues,

I am very pleased to invite you to join us for the 11th Conference of the International Test Commission, which will be held in Montreal from July 2 to 5, 2018. You will love Montreal, there is no doubt about it! This major city combines European charm with the energy that is characteristic of North America, from its cutting-edge industries to its renowned art of living. During the summer season, it offers amazing sights and a night life that spreads out into the streets. That is why we chose to put the conference under the banner of music, with the Jazz Festival taking place in early July. This festival has existed for more than 30 years and has been named the world’s largest by Guinness World Records. Music enthusiasts will be delighted by this event. We have also decided that jazz should set the tone for the conference, as demonstrated by our chosen theme: On the beat of testing. Our scientific program is organized around four complementary sub-themes, which are as follows: a) Best practices in testing and assessment, b) Instruments and their validity, c) Effectiveness and efficiency including application in multicultural environments and d) Challenges, innovation and advances in technology. These sub-themes will be addressed in many ways, including by distinguished speakers and through innovative workshops. Diversity, a value Quebecers hold dear, is reflected by the range of speakers, their research and application fields, the issues they explore and the countries they come from to offer you an extremely rich program. The hotel that will host the participants is located in the heart of Montreal, close to the Jazz Festival, excellent restaurants, shops, numerous museums, the cobblestone streets of Old Montreal and a breathtaking view of the Saint Lawrence River from the Old Port. This exceptional location will let you enjoy a variety of activities in the city and explore Montreal’s unique multicultural atmosphere, a subtle mix of North American and European cultures. We have also kept in mind the early birds among you: they will be offered a 5 km run or a 3 km walk to experience the city in the early morning hours. My team and I look forward to welcoming a great number of you in Montreal for an exceptional conference in July 2018.

Nathalie Loye Chair of the Organizing Committee


Mes

sage

de

bien

venu

e

Chers collègues,

C’est avec un immense plaisir que je vous invite à vous joindre à nous pour la 11e édition de la Conférence de l’International Test Commission qui aura lieu du 2 au 5 juillet 2018 à Montréal. Aucun doute n’est possible, vous adorerez Montréal! Cette grande métropole combine le charme européen à l’énergie qui caractérise l’Amérique du Nord, des industries de pointe à un art de vivre reconnu. Pendant la saison estivale, elle offre des spectacles fascinants, une vie nocturne qui se déploie au fil des rues. C’est la raison pour laquelle nous avons choisi d’inscrire la conférence sous le signe de la musique puisque le Festival de jazz se tient début juillet. Ce festival existe depuis plus de 30 ans et a été consacré par le Guinness World Record comme le plus important de la planète. Les amoureux de la musique seront donc comblés et nous avons décidé que le jazz donnera le rythme à cette conférence comme en témoigne le thème choisi : On the beat of testing. Notre programme scientifique est organisé autour de 4 sous thèmes complémentaires et qui sont a) Best practices in testing and assessment, b) Instruments and their validity, c) Effectiveness and efficiency including application in multicultural environments et d) Challenges, innovation and advances in technology. Ces sous-thèmes seront abordés de multiples manières, notamment par des conférenciers de renom et dans des ateliers novateurs. La diversité si chère aux Québécois se reflète bien dans la variété des conférenciers, de leurs domaines de recherche et de pratique, des problématiques qu’ils explorent et des pays d’où ils arrivent pour vous proposer un programme d’une grande richesse. L’hôtel qui nous accueillera est situé en plein cœur de la ville de Montréal, à proximité des activités du Festival de jazz, des meilleurs restaurants, des boutiques, des nombreux Musées, des rues pavées du Vieux-Montréal et de la vue grandiose sur le fleuve Saint-Laurent depuis le Vieux-Port. Cette situation exceptionnelle vous permettra de profiter de multiples activités dans la ville, de vous plonger dans l’ambiance multiculturelle unique de Montréal située quelque part entre les cultures européenne et nord-américaine. Nous avons aussi pensé à ceux d’entre vous qui se lèvent tôt et leur proposons une course à pied de 5 km ou une marche de 3 km pour prendre le pouls de la ville au petit matin. Mon équipe et moi sommes impatients de vous accueillir en très grand nombre à Montréal pour une conférence hors du commun en juillet 2018.

Nathalie Loye Responsable de l’organisation du congrès

www.capstan.be

language engineering, training, source preparation, translatability assessment,

question per question adaptation notes

GUIDE

downstream, validate, linguistic quality control, translation verification, automated QA checks,

document compliance, update

CERTIFY

glossaries, style guides, translation memories, proofread, document

TRANSLATEpublications, workshops,

conferences, open source tools

SHARE

cApStAn Guide for upstream preparation work and support of the translation process

cApStAn Translate to produce translations that are fit for purpose

cApStAn Certify to verify, assess and validate translations and document the findings

cApStAn Share to promote best practice in survey localisation


Tabl

e of

con

tent

sITC Presidential Address � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 5Welcome message � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 6Message de bienvenue � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 7Programme overview � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 10Committees � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 12Things to Know � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 14Social Events, Meetings and Award Recipients � � � � � � � � � � � � � � � 16Workshops � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 18Keynote Speakers � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 30Sessions � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 34Poster Sessions � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 64Presentation Schedule at a Glance � � � � � � � � � � � � � � � � � � � � � � � � 68Venue Floorplan � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 78

We would like to thank our partners:

The complete lists for presenters, chairs and attendees are available on Whova, the official event app, or on the website. Modifications

made following the printing of the present document are updated in the electronic version of the programme.


Pre DayMonday, July 2nd, 2018

8:00

AM

~ 5

:00

PM :

Regi

stra

tion

/ Inf

orm

atio

n

9:00

~

10:3

0 AM

Workshops

Coffee break

10:4

5 ~

12

:15

PM

Workshops

12:1

5 ~

1:15

PM

Lunch

1:15

~

2:45

PM

Workshops

Coffee break

3:00

~

4:30

PM

Workshops

5:00

~

6:30

PM

Opening ceremony

Day 1Tuesday, July 3rd, 2018

7:30

AM ~

5:0

0 PM

: Re

gist

ratio

n / I

nfor

mat

ion

7:45

~

8:30

AM

Light breakfast

8:30

~

10:0

0 AM Concurrent sessions

Block A

Pause

10:1

5 ~

11

:15

AM

Irini Moustaki The Contributions of Women in

Psychometrics-Statistics: Past and Present

Coffee break

11:3

0AM

- 6:

00PM

: Pos

ter D

ispl

ay

11:4

5 AM

~

1:15

PM Concurrent sessions

Block B

1:15

~

2:30

PM

Lunch

Young Scholar and Mentors

Lunch Meeting

2:30

~

3:30

PM Alina

von DavierAndré de

Champlain

Coffee break

4:00

~

5:00

PM Thomas Oakland Lecture

Ronald K. Hambleton

5:00

~

6:00

PM Poster Session 1

& Networking

Prog

ram

me

over

view


Day 2Wednesday, July 4th, 2018

7:00

~

7:45

AM

Run or walk 3k

7:30

AM ~

4:0

0 PM

: Re

gist

ratio

n / I

nfor

mat

ion

7:45

~

8:30

AM

Light Breakfast

8:30

~

10:0


Bloc C

Pause

10:1

5 ~

11

:15

AM Sara Ruto

Bruno Zumbo

Coffee break

11:3

0AM

- 6:

30PM

: Pos

ter D

ispl

ay

11:4

5 AM

~

1:15


Block D

1:15

~

2:30

PM

Lunch

2:30

~

4:00


Block E

Coffee break

4:30

~

5:30

PM John

HattieDavid Magis

5:30

~

7:00

PM ITC General

Meeting

Poster Session 2 & Networking

7:45

~

11:0

0 PM

Conference “Jazz” Dinner

Day 3Thursday, July 5th, 2018

7:30

~10

AM :

Reg�

/ In

fo�

7:45

~

8:30

AM

Light Breakfast

8:30

~

10:0


Block F

Pause

10:1

5 ~

11

:15

AM Stephen Sireci

Leslie Rutowski

Coffee break

11:4

5 AM

~

1:15


Block G

1:15

~

2:30

PM

Lunch

2:30

~

3:30

PM Deon

de BruinMaryam Wagner

3:45

~

5:00

PM

Closing Ceremony


Com

mit

tees

Nathalie Loye (Chair), University of Montréal, Québec, Canada

Aletta Odendaal, University of Johannesbourg, South Africa

Ananda van Tonder, International Test Commission, UK

Dragos Iliescu, University of Bucharest, Romania

Justine Castonguay-Payant, University of Montréal, Québec, Canada

Guillaume Loignon, University of Montréal, Québec, Canada

Carla Barroso da Costa, Université du Québec à Montréal (UQÀM), Canada

Marcella Laureano Prottis, Université du Québec à Montréal (UQÀM), Canada

Sébastien Béland, University of Montréal, Québec, Canada

Dan thanh Duong Thi, University of Montréal, Québec, Canada

Iris Bourgault Bouthillier, University of Montréal, Québec, Canada

Pierre Gignac, University of Montréal, Québec, Canada

Patricia Vohl, University of Montréal, Québec, Canada

Valérie Dory (Chair), McGill University, Québec, Canada

Avi Allalouf, Nite, Israel

Jacques Grégoire, Université Catholique de Louvain, Belgium

Solange Wechsler, Pontificia Universidade Catolica de Campinas, Brazil

Fanny Cheung, The Chinese University of Hong Kong, HKSAR

Heungsun Hwang, McGill University, Québec, Québec, Canada

Éric Dionne, University of Ottawa, Ontario, Canada

Paula Elosua, University of the Basque Country, Spain

Chantale Jeanrie, Université Laval, Canada

Marcella Laureano Prottis, Université du Québec à Montréal (UQÀM), Canada

Conference Committee

Scientific Committee


April Zenisky, University of Massachusetts Amherst, USA

Dandan Chen, University of Delaware School of Education, USA

Agustin Tristan, Instituto de Evaluación e Ingeniería Avanzada, Mexico

Julie (Junli) Wei, University of British Columbia, Canada

Michelle Y� Chen, Paragon Testing Enterprises, Canada

Phonraphee Thummaphan, National Institute of Educational Testing Service, Thailand

Raman Grover, British Columbia Ministry of Education

Ruslan Suvorov, University of Hawaii at Manoa, USA

Yi-Chen Wu, University of Minnesota, USA

Xihaohong Gao, The ACT Test, USA

Xin Luo, UBER, USA

Youn-Jeng Choi, University of Alabama, USA

Yin Wu, University at Buffalo, USA

Ronny Scherer, Center of Educational Measurement, Norway

Ren Liu, University of Florida, USA

Carina Fiedeldey-Van Dijk, ePsy Consultancy, Canada

Mark Gierl, University of Alberta, Canada

Paula Elosua, University of the Basque Country, Spain

Anna Brown, Kent University, UK

Katharina Lochner, University of Applied Sciences Europe, Iserlohn, Germany

Kadryie Ercikan, Educational Testing Services, USA

Reviewers

International Advisory Committee


Thin

gs to

Kno

wAirport To Downtown TransportationThere are several ways to get to the conference hotel, Le Centre Sheraton Montréal� A typical taxi fair should cost about 45 $�

There is also a shuttle transit bus, linking the airport to most downtown hotels, including Le Centre Sheraton� This service, called “bus line 747”, is accessible just outside the International Terminal arrival exit� Just make sure to buy the ticket from the automatic vending machine located in the terminal before boarding the bus� The fare can also be paid in cash, provided that only coins are used� The fare is 10$ one way� When getting back to the airport from the hotel, tickets can be bought in advance at any metro vending booth or again, by paying cash (using coins only) when boarding�

Bus stops are located at the corner of René-Lévesque and Peel or René-Lévesque and De la Montagne�

ITC 2018 Information DeskTo register and for information about the conference, please visit the ITC Registration and Information desk, located in the level 2 foyer� This desk will also serve as the Lost & Found�

Money & Currency ExchangeMost purchases in Quebec are subject to a 9,975 % Quebec Sales Tax (QST) and a 5 % Goods and Services Tax (GST)�

Visitors can exchange U�S� currency at Canadian chartered banks, trust companies, credit unions. Other currencies may be exchanged at offices of foreign exchange brokers.

Public Transit, Taxi & Bike Sharing ServicesThe Montreal transit system includes buses and metro lines� For information, visit www�stm.info or use http://google.maps.ca to find transit, or walking details, to most Montreal locations�

Prefer a taxi? Taxis with their light on can be hailed from the roadside or call either Taxi Diamond at 514-273-6331 or Taxi Coop at 514-725-9885�

Montreal has also a bike sharing service, called BIXI� Information about this service is available at www�montreal�bixi�com� BIXI stations can be found throughout the downtown core and individual rental prices start at 2�75 $ for 30 minutes�

Internet AccessDelegates have access to free wifi on the Conference venue. Select the wireless network : Sheratonmeeting Password: itc2018

Hospitals & DoctorsEmergency Contact: call 911This is to be used for emergencies only (police, fire or medical) where an immediate response is required�

Non-emergency Contact: call 811 You can call the Quebec Info Santé line to speak with a nurse at any time of day or night� You may also visit one of the many walk-in medical clinics� Information about their location and hours of operation is also available by calling the Info Santé line�

Psychological Testing CentreThe British Psychological Society (BPS) is the leading organisation for setting standards in psychological testing in the UK.

The Society directs the work of its Psychological Testing Centre (PTC) through the Committee on Test Standards whose role is to set, promote and maintain standards in testing.

The PTC website provides information and services relating to standards in tests and testing for test takers, test users, test developers and members of the public, and includes a register of over 12,100 qualified test users.

The PTC website offers:n Information for test users, test publishers and members of the public worldwiden Guidelines and best practice statements on standards for the construction, use and availability of testsn Competence-based test user certification and registration in educational and occupational settings, including

the Euro Test User certificates (level 2): Work and Organisational Assessmentn Access to over 160 test reviews in summary or full – reviewed against the EFPA Review Model for the

Description and Evaluation of Psychological Testsn A list of tests which have met benchmark criteria for the award of a Test Registration Certificate

www.psychtesting.org.uk


Soci

al E

vent

s, M

eeti

ngs

and

Awar

d R

ecip

ient

sSocial Events

Opening CeremonyOpening Ceremony – Nathalie LoyeThomas Oakland Award presentation – Stephen SireciITC Scholarships presentation – Solange WechslerPresidential Address – Dragos Iliescu – The Impact of Tests in Practice and Policy: What Will the Future Bring?

Run or walk 3k Pick up your running shoes and discover Montreal. On July 4, a group will set out for a 3-km walk or run. Those interested in participating must be at the Sheraton Hotel’s main entrance at 6:55 a.m. for a departure at 7:00 a.m.

Closing ceremony The closing words and a few Conference highlights will be presented on July 5, at 3:45 p.m. Those who are curious will also find out the location of the 2020 ITC Conference.

ITC 2018 Meetings

ITC General MeetingThe General Meeting will be held on July 4, from 5:30 to 7:00 p.m. Members are welcome to attend.

Young Scholar and Mentors Lunch MeetingStudent awardees will meet their mentors on July 3 for a special lunch.

ITC 2018 Award Recipients Abiy AboretNariman DarvishovAnh NguyenFen RenAngela Lee MarsburgCarolina Rosa CamposSabrena G. Arosh


Conference “Jazz” Dinner

The conference dinner will be held on the site of the Montreal International Jazz Festival, which holds the Guinness record for the world’s largest jazz festival�

The hotel terrace offers an astounding view on the festival site, and a jazz band will keep you company during the evening� The participants are expected to arrive at the Hyatt Regency Montreal at 7:00 pm, on Wednesday, July 4�

Hyatt Regency Montreal 1255 Rue Jeanne-Mance • Montréal, QC H5B 1E5, Canada • (514)982-1234

A musical journey to New Orleans with Masson Stomp!

Masson Stomp plays their own compositions as well as timeless classics, drawing their inspiration from the Swing and New Orleans tradition.


Salon Jarry

FD1. Assessment of Collaborative Problem Solving Skills: An OverviewWorkshop Objectives The goal of the tutorial is for the participants to learn about the considerations for test development and the computational psychometrics methods for the collaborative problem solving (CPS) assessments� Summary Collaborative problem solving (CPS) skills are hard-to-measure competencies that are considered among the necessary 21st Century skills for academic and professional success� The challenges associated with the measurement of the CPS skills are multifaceted, and range from a lack of consensus around the construct definition to finding appropriate models for the interdependent data. Only in past seven years the measurement community took interest in developing assessments for the CPS skills� This evolution goes hand in hand with the technological advances that allowed the test development, administration, and data collection to be concerted in a computerized environment� Recently, the community welcomed several major publications on CPS assessments: PISA Technical Report (2017), von Davier (2017), von Davier, Zhu, and Kyllonen (2017), NCES White Paper (2017) and Griffin and Care (2015). In this tutorial, we present the process of building CPS assessments in a computational psychometrics framework (von Davier, 2017b)� The focus will be on the measurement challenges and several empirical examples will be used to exemplify the methodology. Specifically, we will first discuss the construct and introduce several frameworks that have been used for the CPS tests in the recent years (PISA, ATC21s, ACT Holistic Framework, ETS’ framework)� Next, we will present the design space for the CPS assessments in the light of Evidence Centered Design (Mislevy, et al�, 2003); we will also discuss the design of the data collection and of the log files associated with the CPS assessments. Next, we will present the computational psychometrics methodology that is promising for analyzing data from the CPS tests� We will discuss the use of stochastic processes to model the temporal structure of the dynamic interaction, the MIRT model for estimating the propensity of collaborative behaviors, and the use of machine learning approaches to investigate the relationship between the CPS subskills and the team performance� Empirical examples are provided from the ACT’s CPS game, The Circuit Runner (Stoeffler, et. al, 2017) and from ETS’ CPS Science Assessment Prototype�

Full day workshops - 9:00 AM ~ 4:30 PM

Alina Von Davier

Kristin Stoeffler

Wor

ksho

ps •

Mon

day,

Jul

y 2nd

, 201

8


Salon Kafka

FD2. Ethics, Test Standards, and Test Interpretation: Measurement MattersWorkshop Objectives Participants will learn ethical principles and test standards governing test interpretation and the necessary psychometric principles and procedures assessing viability of test scores and comparisons� Summary Weiner (1989) cogently noted, psychologists must “(a) know what their tests can do and (b) act accordingly� … Acting accordingly¬—that is, expressing only opinions that are consonant with the current status of validity data—is the measure of his or her ethicality” (p� 829)� To follow Weiner’s advice, psychologists must possess and apply fundamental competencies in psychological measurement and the importance of these competencies cannot be overstated for ethical assessment and clinical practice (Dawes, 2005; McFall, 2000)� Interpretation of tests and procedures must be informed by strong empirical evidence from different types of reliability, validity, and diagnostic utility studies; each of which addresses a different interpretation issue� Unfortunately, most test technical manuals and popular interpretation guides and textbooks neglect reporting and addressing some critically important psychometric research methods and results necessary to judge the adequacy of the different available test scores and comparisons used in interpretation� So that psychologists may ethically interpret test scores or procedures, this workshop delineates and highlights the varied psychometric research methods psychologists must consider to adequately assess the viability of the different scores and comparisons advocated. Specific research examples with popular tests and procedures are provided as exemplars� Internal consistency, short– and long–term temporal stability, interrater agreement, concurrent validity, predictive validity, incremental predictive validity, age/developmental changes, distinct group differences, theory consistent intervention effects, convergent & divergent validity, internal structure (EFA & CFA), and diagnostic efficiency/utility methods are among those presented and each answer different but relevant questions regarding interpretation of test scores and comparisons� Following this workshop participants will be better able to critically evaluate psychometric information provided in test manuals, textbooks, interpretation guidebooks, Mental Measurements Yearbook, and the extant literature�

Gary L. Canivez


Salon 1

FD3. Introduction to Automatic Item Generation using CAFA AIGWorkshop objectivesAims of this workshop will be introducing both a theoretical and practical introduction to Automatic Item Generation (AIG), which is an emerging research area and an innovative assessment approach for generating assessment items using state-of-the-art technology� This workshop is designed for those who wish to learn the background, benefits, innovations, and practical applications of the item template and test development process of AIG�

SummaryModern researchers, psychometricians, item writers, and assessment service providers increasingly find themselves facing a new paradigm where the assessment item production process is no longer manual, but rather can be a massive production automatized by technology, that is, Automatic Item Generation (AIG)� AIG is an emerging research area and an innovative assessment tool where cognitive and psychometric theories are integrated together into a comprehensive assessment development framework for the purpose of generating assessment items using state-of-the-art technology, especially in Information and Communication Technology (ICT) environments� The number of content areas and the number of applications of AIG are exploding� As such, this new reality raises important issues in effective item development�

This full day course is intended as both a theoretical and practical introduction to Automatic Item Generation (AIG), which is an emerging research area and an innovative assessment approach for generating assessment items using state-of-the-art technology� This course is designed for those who wish to learn the background, benefits, innovations, and practical applications of the item template and test development process of AIG. This workshop specifically integrates hands-on training on the AIG item template development to gain theoretical knowledge and practical experience on the process�


Jaehwa Choi

Wor

ksho

ps •

Mon

day,

Jul

y 2nd

, 201

8


Salon 2

FD4. Cognitive interviewing for interpreting DIF from a mixed methods perspectiveWorkshop ObjectivesThe main aim is attendees learn how to design and conduct a mixed-methods research using cognitive interviewing for interpreting DIF/bias in cross-lingual and cultural testing projects�

SummaryThe expansion of international testing projects in education, health, and quality of life fields make necessary to address how Differential Item Functioning (DIF) can undermine validity of comparative interpretations based on psychological assessments, tests and survey data� There is a wide consensus about how elusive to interpret and prevent DIF has become. New approaches to such a difficult problem like Cognitive Interviewing (CI) integrated with DIF techniques, can contribute to improve our understanding of DIF in international testing projects� CI is even mentioned in the most recent release of the ITC Guidelines for Adapting Test� The main aim of the workshop is to present a practical, comprehensive approach to conducting CI for interpreting DIF in multi-national tests and scales� Within a mixed-methods research framework, the course will address how to conduct a CI study in an international research context� Course attendees will learn how to plan an international CI study: designs, materials (multi-lingual interviews protocols, templates for analyses, etc�), interviewers training, cooperative data analysis, etc. We will also teach how to integrate and report qualitative findings from CI with quantitative results obtained by DIF techniques� Practical examples of mixed-methods DIF studies will be analyzed using data bases of international testing and surveys like the Programme for International Student Assessment (PISA), the European Social Survey (ESS), and so on� Finally, the general structure to build validity arguments of the equivalence level reached and its implications for comparative interpretations using DIF results will be taught�

Jose-Luis Padilla

Isabel Benítez


Salon Joyce

FD5. Generalizability theory: application and optimizationWorkshop objectivesThe goal of this workshop is to make Generalizability Theory more approachable with an overview of the fundamentals of G Theory and training in a free and easy-to-use new software application, G Wiz�

SummaryImportant steps in the development of any test include determining how well the test measures that which it purports to do and taking steps to reduce unwanted sources of variance (error) in the measurement� Generalizability (G) theory is a simple-but-powerful method for understanding and optimizing sources of variance within tests but is, perhaps, underutilized due to a lack of accessible tools� This workshop will provide training in the fundamentals of G Theory as a refresher for the experienced and as preparation for the less experienced, then provide hands-on training using the G Wiz software for conducting G studies to evaluate wanted and unwanted sources of variance and for conducting Decision (D) studies for optimizing measurement designs that maximize desired sources of variance and minimize error�


Lisa A. Keller

Robert J. Cook

Frank V. Padellaro

Wor

ksho

ps •

Mon

day,

Jul

y 2nd

, 201

8


Salon 5

FD6. Applying the Standards for Educational and Psychological Testing in International ContextsWorkshop ObjectivesParticipants will learn ethical principles and test standards governing test interpretation and the necessary psychometric principles and procedures assessing viability of test scores and comparisons�

SummaryIn 2014 the sixth edition of the Standards for Educational and Psychological Tests were published by AERA, APA and NCME� The Standards have been cited extensively in the United States, but also have served as a model by ITC and other professional organizations in assessment concerned with improving the quality of testing across educational and psychological contexts� The workshop will focus on the 2014 Standards, but also address other relevant standards and guidelines (e�g�, ITC Guidelines on Adapting tests, Test use, CBT and Internet testing, and Quality Control; SIOP Principles) in specific areas of practice including:

• Validity• Reliability and score precision• Fairness• Design and Development• Test Translation• Administration and Reporting• Test User Responsibilities

For each of the above topics the presenter will provide an overview of the relevant foundational issues involved, and then identify special issues that apply to the use of tests internationally� For example, in addressing validity the focus would be to review the general foundational issues and requirements which apply across contexts (schools, organizations, credentialing, psychological assessments) and identifying unique issues which arise in using assessments globally (across international environments – cultures, language, etc�)�

Linda Cook

Wayne Camara

Joan Herman

Kadriye Ercikan


Salon Lamartine

AM1. Tools for EquatingWorkshop ObjectivesThe goal of this workshop is to provide an opportunity for participants to acquire knowledge of equating and hands-on experience using equating programs for their operational and research purposes�

SummaryWhen there are multiple testing dates per year and maintaining test security becomes very crucial, alternate forms of a test are often required each year� Such alternate forms should be built to the same content and statistical specifications so that reported scores can be used interchangeably across forms� However, even under optimal circumstances, alternate forms almost always differ somewhat in difficulty, and a psychometric procedure called equating is used to adjust for such differences� This workshop will demonstrate how equating can be done using two computer programs, Equating Recipes (ER) and IRTEQ, which are freely available to the public�

A computer program ER is a set of open-source functions, written in C, to perform all equating methods discussed by Kolen and Brennan (2014), as well as some other methods� Furthermore, ER provides a way to estimate bootstrap standard errors for most equating methods� For this workshop, the R interface will be used to access the ER functions�

Another equating program IRTEQ employs a user-friendly interface to perform IRT scaling and equating. IRTEQ provides five options for scaling and supports various unidimensional models for dichotomously- and polytomously-scored items� IRTEQ also implements equating for scale scores if a raw-to-scale conversion table is provided�This workshop will provide an excellent opportunity for conference participants to acquire knowledge of equating as well as to learn about programs for conducting equating research studies� The workshop will include a brief introduction to equating and illustrate using ER and IRTEQ with real examples, followed by hands-on experience in using those programs� At the end of the workshop, attendees should have a deeper understanding of equating and be reasonably knowledgeable about using ER and IRTEQ�

Morning workshops - 9:00 AM ~ 12:15 PM

Won-Chan Lee

Kyung (Chris) T. Han

Hyung Jin Kim

Wor

ksho

ps •

Mon

day,

Jul

y 2nd

, 201

8


Salon 3

AM2. Quality Control Procedures for the Scoring and Rating of TestsSummaryAccuracy is essential in all stages of testing, beginning with test development and administration, through to scoring, test analysis, and score reporting� QC procedures are required in all these stages, especially in the short time-frame between test completion and score reporting� Failure to establish and implement such procedures can lead to inaccurate score calculation with potentially serious consequences, such as a qualified candidate not being accepted to a university or place of employment or a person lacking required qualifications being granted a professional license� It may also result in misguided educational intervention� According to ITC (2014), “Anyone involved in scoring, test analysis, and score reporting has a responsibility to maintain professional standards that can be justified to relevant stakeholders.” Quality control procedures are extensively used in other professions, such as engineering, aviation, medicine and software development. Learning from the experience of those working in other fields can help assessment professionals design QC procedures for their specific purposes.

The workshop will deal with theoretical aspects of QC, providing examples of errors from real-life contexts� The main topics include: (1) QC procedures for large-scale assessments with large and stable cohorts – usually in paper & pencil mode; (2) QC procedures for scores on tests administered to small population groups on multiple administration dates (Continuous Administration Mode) – usually computer- and Internet-based; (3) methods for monitoring the quality of performance of assessment raters who conduct offline and online scoring; and (4) procedures to prevent and detect various kinds of cheating� Finally, studies on several aspects of QC will be presented� The workshop is based on two NCME instructional modules (Allalouf, 2007; Allalouf, Gutentag & Baumer, 2017) and on ITC Guidelines published in International Journal of Testing (2014)�

Avi Allalouf


Salon Hémon

AM3. Test and Score Report Design Principles for Culturally and Linguistically Diverse PopulationsWorkshop ObjectivesParticipants will gain familiarity with innovative approaches to designing items, task sets, and score reports in support of the fair and valid assessment of culturally and linguistically diverse populations�

SummaryThe workshop will involve hands-on exercises, real-world examples, and the interactive use of templates and models to gain familiarity with the ITC guidelines Large-Scale Assessment of Linguistically Diverse Populations� The examples will be targeted to K-12, postsecondary, and workforce applications� Participants will be presented with examples of designs, design decisions, artifacts, and templates to consider when designing, developing, and interpreting scores for diverse test-taker populations�

The examples will target item types and task sets of 21st century skills such as collaborative problem solving, interactive communication, and intercultural competence� The focus on assessments of 21st century skills is highlighted because their administration to diverse populations presents added challenges to conceptualization and design choices related to fairly and meaningfully capturing and communicating information about test-takers dispositions and proficiencies, and all of these are issues that take on additional importance in cases when students are from diverse backgrounds�An overarching theoretical framework will be presented informed by both the ITC Guidelines and advances to the evidence-centered design approach (Mislevy, Steinberg, & Almond, 2003) that takes a sociocognitive perspective to assessment conceptualization, design, analysis, and interpretation (Mislevy, 2015; Oliveri, Lawless, & Misvely, under review)� Participants will be guided to consider ways to integrate templates for their own situations; thereby accomplishing the aim of the workshop, for participants to gain strategies for designing, developing, and interpreting data from tests and score reports purposed for diverse audiences�At a time when the assessed student populations are increasingly diverse (e�g�, speak a different home language, are immigrants, refugees, or do not speak the language of the test), issues of how to design assessments and score reports that fairly capture and communicate students’ proficiencies and dispositions in meaningful ways is an important area of investigation for researchers and practitioners alike�

Morning workshops - 9:00 AM ~ 12:15 PM

Maria Elena Oliveri

April Zenisky

Wor

ksho

ps •

Mon

day,

Jul

y 2nd

, 201

8


Salon Hémon

PM1. Applying Test Equating methods using RWorkshop ObjectivesThe main objective is to introduce equating and let the attendees get a conceptual and practical understanding of various equating methods by using different data sets within the R software�

SummaryThe aim of test equating is to adjust the test scores on different test forms so that they can be comparable and used interchangeably� Equating has a central role in large testing programs and it constitutes an important step in the process of collecting, analyzing, and reporting test scores� Equating is important as it ensures a fair assessment regardless which time, place or background different test takers might have� This workshop has two main goals. The first goal is to introduce equating. Through a number of examples and practical exercises, attendees will get both a conceptual and practical understanding of various equating methods conducted under different data collection designs� The R software will be used throughout the session with special focus on the packages; equate, kequate, and SNSequate� The second goal is to provide the necessary tools to be able to perform different equating methods in practice by using available R packages for equating� The training session follows some of the chapters in the book Applying test equating methods using R which has been written by the instructors and was released in 2017 by Springer� The workshop will start by introducing traditional equating methods and different data collection designs and the attendees will be acquainted on how to perform these methods using the R packages equate� Next, the attendees will be guided through the five steps of kernel equating; presmoothing, estimating score probabilities, continuization, equating and calculating the standard error of equating, using the R packages kequate and SNSequate� The attendees will then be introduced to item response theory equating and will receive practical guidance on how to perform these methods using R�

Afternoon workshops - 1:15 AM ~ 4:30 PM

Marie Wiberg

Jorge González


Salon Lamartine

PM2. Crafting adapted tests with a focus on a-priori methodsWorkshop ObjectivesUnderstand the principles behind test adaptation and interpret them in practical terms relevant to psychological practice and research;Understand how judgmental and empirical procedures contribute to test adaptation, and to be able to apply some of these techniques in their own practice;Appreciate the complexities of test adaptation in the widest sense and start formulating their own models for best practice�

SummaryThe workshop serves as an introduction to the latest standards in the cross-cultural adaptation of psychological and educational tests� The workshop focuses heavily on the a-priori (mainly qualitative) methods that are employed to develop appropriate adaptations, and discusses only in passing the various a-posteriori (mainly quantitative) methods, such as statistical approaches that may be employed to offer evidence for the equivalence of the adapted and the original forms of the test� Therefore, the “craft” of test adaptation is discussed in terms of adaptation designs, translation procedures (incl. decentering), piloting, identification of sources of non-equivalence in the preliminary data (e�g� statistical analyses which permit low-volume samples and qualitative approaches such as cognitive interviews)� The workshop uses a number of case studies with which participants are required to interact�

Afternoon workshops - 1:15 AM ~ 4:30 PM

Dragos Iliescu

Wor

ksho

ps •

Mon

day,

Jul

y 2nd

, 201

8


Not

es

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�


Key

note

Spe

aker

s

10:15 ~ 11:15 AM • Ballroom West

KS1. The Contributions of Women in Psychometrics-Statistics: Past and PresentIrini Moustaki, Professor of Social Statistics, London School of Economics and Political Science

Day 1

2:30 ~ 3:30 PM • Ballroom West

KS2. The Application of computational psychometrics to process data from performance assessments

Alina von Davier, Vice President, ACTNext

2:30 ~ 3:30 PM • Drummond Centre/West

KS3. Implementing Automated Item Generation in a Large-scaled Medical Licensing Exam Program - Lessons Learned.André De Champlain, Director of the Psychometrics and Assessment Services department, Medical Council of Canada (MCC)



KS4. The Reports of DIF’s Death are Greatly Exaggerated; It is Like a Phoenix Rising from the AshesBruno Zumbo, Professor of Psychometrics and Measurement, University of British Columbia

Day 2

10:15 ~ 11:15 AM • Drummond Centre/West

KS5. Including the Excluded through Rethinking National Assessments: The Example of Citizen Led AssessmentsSara Ruto, Head of the secretariat, People’s Action for Learning (PAL)


KS6. Adaptive testing: examples, simulations, and examples of simulationsDavid Magis, Research Associate of the Fonds de la Recherche Scientifique, University of Liège


KS7. Visible Learning and AssessmentJohn Hattie, Laureate Professor and Director of the Melbourne Education Research Institute, University of Melbourne


10:15 ~ 11:15 AM • Drummond Centre/West

KS8. Increased heterogeneity in international assessments and associated measurement challengesLeslie Rutowski, Professor of Educational Measurement, University of Oslo

Day 3


KS9. 21st-Century Validation Procedures for 21st-Century TestsStephen Sireci, Professor in the Psychometrics Program and Director of the Center for Educational Assessment, University of Massachusetts Amherst


KS10. Challenges of psychological testing in the multicultural South African contextDéon de Bruin, Professor of Industrial Psychology, University of Johannesburg


KS11. Examining the Potential and Uses Cognitive Diagnostic Assessment in Test Development and ValidationMaryam Wagner, Assistant Professor in the Department of Medicine, McGill University

Key

note

Spe

aker

s


Not

es

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�


Day 1 • Tuesday, July 3rd, 2018

Oral Presentations • Block A • 8:30 ~ 10:00 AM

Salon 3 ORAL A1. Measurement issues in psychological and clinical testing

Psychometric Evaluation of the National Core Indicators Adult Consumer Survey (NCI-ACS) for People with Intellectual and Developmental Disability: Item Response Theory Approach Youngsoon Kang

A comparison of measurement invariance techniques: Exploring social belonging and migrant-backgroundNathan D Roberson; Bruno D� Zumbo

Implicit way of measuring values hierarchyOlga Arestova; Olga Mitina; Boris Chukarin

Data Quality of Self-Report and Observer Report Forms in Crowdsourced and Vendor Data: Examination with a Clinical Behavioral Rating Scale Assessment Vivian Wing-Sheung Chan; Justin McNeil; Gill Sitarenios

Salon 5 ORAL A2. Validation of admission practices

The teacher capacity assessment tool: Who wants to be a teacher?Janet Clinton; Zhaoxia Guo; John Hattie

Selecting for Medical School: Comparing the Measurement Properties of Role-Play and Discussion-based Stations in Multiple Mini InterviewsJean-Sébastien Renaud; Julie Grondin

Effect of trial items on candidate performances in a large-scale postgraduate medical selection testLuc Le

Mapping the higher education admission policy in Ethiopia: Affirmative action as equity instrument?Melaku Tesfa Tesema; Johan Braeken

Preadmission schooling context helps to predict examination performance throughout medical schoolNeil Stringer; Michael Chan; Philip Chan

Sess

ions


Salon 2 ORAL A3. Testing of cognitive development around the world

Assessing child development through reports of mothers from Brazil: validity evidence and clinical application of the Dimensional Inventory for Child Development AssessmentEuclides José de Mendonça Filho; Monia Aprecida Silva; Denise Rurshel Bandeira

Transforming assessment practices in South Africa: A case for inclusive Raven’s CPM normsJustin August

Investigating the psychometric properties of the Matrigma in a South African sampleNicola Taylor; Ander Sjöberg; Cobi Hayes; Sofia Sjöber

Salon Musset ORAL A4. Innovations in computer adaptive testing and multistage testing

Identifying the quality of vertical scales used with adaptive tests G� Gage Kingsbury; Raymond Yeagley

Multi-stage Adaptive Testing for Small-Volume High-Stakes ExamsH� Jane Rogers; Hariharan Swaminathan

Effects of Ability Estimation Methods on the Amount of Adaptation for Computerized Adaptive TestsUnhee Ju; Youngjun Lee

A Multilevel Routing Model on Testlet Speededness in Multistage Testing Assembly Qinjun Wang; Jose Palma; Michael Rodriguez

The Vertical, Interval Scale Assumption of a Computerized Adaptive Test: Predictive Evidence from Additive Conjoint MeasurementYeow Meng Thum


Salon 4 ORAL A5. Testing language proficiency in context: from intentions, to design, to outcomes

Construct specification in the testing of pilot and air traffic controller communications: The contribution of domain experts Ana Lucia Tavares Monteiro; Janna Fox

The alignment between workplace communication and English language testing constructsChristine Doe; Liying Cheng

Did Test Preparation Practices for the College English Test (CET) Work? A Study from Chinese Students’ PerspectiveJia Ma; Liying Cheng

Whose English(es) Are We Assessing and by Whom?Liying Cheng; Gwan Hyeok Im; Rubaiyat Jabeen

The preparedness of the african home language speaking students for university: insights from the national benchmark testsNaziema Jappie; Darlington Mutakwa

Symposiums • Block A • 8:30 ~ 10:00 AM

Salon 1 • Chair: Lara Montefiori SYMPOSIUM A1. Game-Based Assessment: Best Practice, Test Development, and Evidence

Guidelines of Best Practice in Game-Based AssessmentLara Montefiori; Jasper Wolf

Development and Validation of a Game-Based Assessment Measure of NeuroticismEmily Boardman; Lara Montefiori

A Game-Based Measure of RIASEC Vocational InterestsHope Wear; Diana Sanchez

Games and Simulations used for Learning and Assessment: Results from a meta-analytic studyDiana Sanchez; Saar Van Lysebetten

Sess

ions


Salon Drummond East • Chairs: Kadriye Ercikan; John Hattie SYMPOSIUM A2. Use of Process Data in Advancing Measurement

Response Process Data in Advancing the Practice and Science of MeasurementKadriye Ercikan

GlassPy: A Data Analytics Framework for Response Process DataJiangang Hao; Robert Mislevy

An Overview of Using Process Data in a National Assessment: the case of National Assessment of Educational Progress (NAEP) Christopher R� Agard; Gary Feng; Eunice Greer

Exploring Skill Development Trajectories in Massive Open Online Courses Formative Adaptive AssessmentsYigal Rosen

Salon 6 • Chair: Dylan Molenaar SYMPOSIUM A3. The Value of Item Response Times in Psychometric Test Practice

Using Item Responses and Response Times for Classification into Levels of a Learning ProgressionPeter van Rijn; E� Aurora Graf

Multigroup Modeling for Responses and Response Times for Cognitive Diagnosis Hong Jiao; Manqian Liao; Peida Zhan

Investigating Within-Subject Differences in Responses and Response Times Dylan Molenaar

Incorporating Response Time into Population Modeling for Large-Scale AssessmentsHyo Jeong Shin; Lale Khorramdel; Frederic Robin; Kentaro Yamamoto; Matthias von Davier


Salon 7 • Chair: Christina S. Sison SYMPOSIUM A4. Approaches in Psychological and Educational Test Accommodations and Adaptation for Deaf People

Utilizing an Online Suite of Mental Health, Substance Abuse, and Career-related Assessments in American Sign LanguageDebra Guthmann, Ph�D�

The Importance of Test Accommodations for Deaf Filipino Students on an English Curriculum-based Test Christina S� Sison; Marcella Sintos; Theresa Christine De La Torre

Test Adaptation of Curriculum-based tests for Deaf Filipino StudentsCarlo P� Magno, Ph�D�; Christina S� Sison

Research and Development of Guidelines for ASL Translation of Math AssessmentsChristopher Kurz, Ph�D�

Salon Hémon • Chair: Solange Muglia Wechsler SYMPOSIUM A5. Creativity assessment: Challenges and possibilities in diverse cultural environments

Measuring creative potential in diverse cultural settingsTodd Lubbart

A new test for assessing mathematical creativityJacques GREGOIRE; Todd LUBART; Maud BESANÇON

Intelligence and creativity: the need for an integrated assessmentSolange Muglia Wechsler

Young Scholars from multicultural communities of The Andes, facing the challenges of the 21st CenturySheyla Blumen

Oral Presentations • Block B • 11:45 ~ 1:15 PM

Salon 6 ORAL B1. Validation studies of tests of quality of life and wellbeing

Single-item measures validity evidence based on correlation network analysis: motives for physical activity in the elderlyAriadna Angulo-Brunet; Carme Viladrich; Yago Ramis; Susana Pallares

Sess

ions


Development and Validation of Positive Effect of Being Antarctica Questionnaire: an Empirical StudyGonggu Yan

Ensuring Validity in Developing a Suitable Health Personnel Perceived Quality of Life InstrumentJoshua Chiroma Gandi

Social desirability and its influence on life satisfaction’s assessmentJoao Paulo Araujo Lessa; Cristian Zanon

Complex approach to well-being measurement in elementary school: validity studyTatjana Kanonire; Denis Federiakin; Irina Uglanova

Salon 2 ORAL B2. The Multiple Roles Of Testing In Fostering Student Engagement

Assessing Coping Strategies through the Brief Cope among Univeristy StudentsEnrique Merino-Tejedor

The Assessment of Academic Engagement through the Adaptation of the Utrecht Work Engagement ScaleEnrique Merino-Tejedor

Institutional Effectiveness in Fostering Student Retention and Success in 1st YearNaziema Jappie; Darlington Mutakwa

Salon 1 ORAL B3. Technology in assessment: insights from games

Are Game-Based Assessments More Motivating than Traditional Assessments? Blair Lehman; G� Tanner Jackson

A VR Game-based Approach for Cognitive Skills AssessmentKarthik K V; Jignesh Talasila; Dr� Vishal Sangale; Dr� Ruta Sawarkar; Ravi Theja Muthu; Sai Suraj Vanka; Nagesh Muppavaram

Two Heads Dialogue Based Intelligent Tutoring System for Learning Pythagoras TheoremHueyMin Wu


Salon 7 ORAL B4. The impact of accommodations on test validity

Providing Revision Opportunities in Alternate Assessments: An Application of Sequential IRTH� Cigdem YAVUZ; Okan BULUT; Munevver ILGUN DIBEK; Merve SAHIN KURSAD

Educator Perspectives on Using Assessment Accessibility Features and AccommodationsMartha Thurlow; Erik Larson

Should Students with Disabilities Have Multiple Opportunities in Answering Items?Munevver Ilgun Dibek; Okan Bulut; Merve Sahin Kursad; Hatice Cigdem Yavuz

Who is Benefiting from Increased Access to Large Scale Assessments?Yi-Chen Wu; Martha L� Thurlow

Salon 4 ORAL B5. Exploring bias

The Role of External Ability Grouping Criteria on Uniform and Non-Uniform DIFEren Suna; Hande Tanberkan Suna; Dilara Bakan Kalaycıoğlu; Emine Eroğlu

Testing for differential item functioning in performance assessmentsMichelle Y� Chen; Yan Liu; Bruno D� Zumbo

Assessing Parameter Invariance across Populations: A Bayesian Approach Hariharan Swaminathan; H� Jane Rogers; Dakota Cintron

Multilevel Model for Forced-Choice ItemsFelipe Valentini; Craig Wells

Symposiums • Block B • 11:45 ~ 1:15 PM

Salon 5 • Chairs: Anna Brown; Neal Schmitt SYMPOSIUM B1. Forcing choice in personality questionnaires: Advances and challenges

Improving Resistance to Response Biases in Personality Measurement: Advances in Forced-Choice ModelingStephen Stark; Philseok Lee; Seang-Hwane Joo

Detecting Aberrant Responding on Multidimensional Forced Choice MeasuresStephen Stark; Oleksandr S� Chernyshenko; Fritz Drasgow; Christopher D� Nye

Sess

ions


Is the multidimensional forced-choice format fake-proof? Comparing the susceptibility of the multidimensional forced-choice format and the rating scale format to fakingEunike Wetzel

The Structure of Maladaptive Personality under Instructed Faking: Comparing Single-Stimulus and Forced-Choice DesignsNigel Guenole; Anna Brown

Salon 3 • Chairs: Xiaohong Gao; Wayne Camara SYMPOSIUM B2. The Journey of Updating Career Readiness Assessments: Combining Content and Psychometrics Perspectives

Updating and Designing an Assessment Program: The Application of Principle Assessment DesignThomas Langenfeld; Xiaohong Gao

Assessment Design: Cognitive Labs Data and Construct ValidityJay Thomas; Thomas Langenfeld

Establishing Reported Score Scale and Linking to the Previous Version for the Updated WorkKeys AssessmentsMeichu Fan; Chunyan Liu; Xiaohong Gao; Hanwei Chen; Rongchun Zhu

Evaluating the Outcome of the Updated WorkKeys Assessments from Psychometric PerspectiveRongchun Zhu; Chunyan Liu; Xiaohong Gao; Meichu Fan

Expanding Career Readiness Personality Assessment Application to Real Job SettingsJohn Weiner

Salon Musset • Chair: Alex Casillas SYMPOSIUM B3. Shifting to a Principled Design Science Paradigm

Leveraging Design Science to Develop High-Quality TestsAlex Casillas

Principled vs. Traditional Approaches to Test Design: Greater Clarity for Development and Score UseEllen Forte

Putting it all together: Making a case based on evidence-centered tasksCharles DePascale

Use of ECD to design simulation-based assessments in scienceEmily Lai


Salon Drummond East • Chairs: Dr Carina Fiedeldey-Van Dijk; Dr Adrian Furnham SYMPOSIUM B4. Unifying Research and Practice: Validating High Potential in Leaders using the HPTI

HPTI Empirical Validity Evidence for Assessing High Potential in Workplace ContextIan MacRae

Validation of Optimal HPTI Trait Levels for Senior Leadership in North American versus UK ContextsJayson Darby

Instrument of Choice for providing the Beat of Testing: HPTI and the Unified Validation FrameworkDr Carina Fiedeldey-Van Dijk

HPTI Validation in a New Linguistic and Cultural ContextStephen Cuppello

Communicating from the Ground Up: Consequences of Valid HPTI AssessmentMerle Ballaigues

Salon Hémon • Chair: Fanny M. Cheung ROUND-TABLE B. Challenges of Assessment in Emerging Economies

The Application of Psychological Test in Non-academic Context in China: Current Situation and ChallengesMingJie Zhou

Challenges for developing indigenous measures: The Brazilian path Solange Muglia Wechsler

Challenges for Psychological Test Development and Use in China: The Needs for Promoting of Test Ethics and Test users’ CompetenceYiqun Gan

Sess

ions


Day 2 • Wednesday, July 4rd, 2018

Oral Presentations • Block C • 8:30 ~ 10:00 AM

Salon 2 ORAL C1. Testing to support transitions to higher education and the workplace

Validation of a Reasoning Test for study orientation of students in Flemish Higher Education (Belgium).Elisabeth Roels; Prof� Dr� Wouter Duyck

Development and Validation of the Short Version of the CAREERsense@HELP Interest Inventory using Rasch AnalysisMaria Felicitas M� Mamauag; Sabrena G� Arosh

Validation of the BIDR-16 in Personality and Employability Scales using a Malaysian PopulationMaria Felicitas M� Mamauag; Sabrena G� Arosh; Hannah Fong

Measuring individual differences in achievement motivation in high-stakes contexts using a Situational Judgment TestSander, Nicolas; Sengewald, Erik

Testing practices of Quebec psychologists and guidance counsellors: How often? Why? How?Sabruna Dorceus; Eric Yergeau; Yann Le Corff


Salon Drummond East ORAL C2. Assessing the teachers: validation studies

Construct Validity of the iCoach Rating Scales – Teacher and Coach FormsLinda A� Reddy

Predictive Validity of Classroom Observational Assessment onLinda A� Reddy; Christopher Dudek; Anh Hua

Construct Validity Evidence of the Design-based Professional Learning for Teacher Leaders SurveyDr� Man-Wai Chu; Dr� Barbara Brown; Dr� Sharon Friesen

Guide for the self-assessment of teaching practices in secondary schoolNancy Noemi Gutiérrez Anguiano; Alicia Alelí Chaparro Caso López

How fairly am I assessing my students? Equipping teachers with a tool to learn about their own assessment practices: Theory and development of the Fairness BarometerPhilipp Sonnleitner; Carrie Kovacs

Salon 5 ORAL C3. Leveraging technology to enhance feedback and learning

The potential of meta-analytic structural equation modeling for educational measurement—Learning about teachers’ technology acceptanceRonny Scherer

Blending Learning and Assessment: Introduction of a Mobile Platform that Integrates Test Data and Adaptive LearningAlina von Davier; Stephen T� Polyak; Pravin Chopade; Ada Woo

An Interactive Score Reporting System for Improving the Quality of Formative FeedbackOkan Bulut; Alexandra Aquilina; Deepak Singh

Guidelines for Generating Effective Feedback from Computer-Based AssessmentsOkan Bulut; Maria Cutumisu; Deepak Singh; Alexandra Aquilina

Comparing the effect on achievement, persistence and learners’ satisfaction of using technologies to give feedback instead of writingStéphanie Facchin

Sess

ions


Salon 6 ORAL C4. Validation of tests of mathematics and computational skills

Flipping the order: Impact of shifting expressions within equations and inequalities on item difficulty estimates of middle-school mathematics items Lindsey Perry; Leanne Ketterlin Geller; Cassandra Hatfield

Assessing Programming Knowledge and Skills: A Theory-based ApproachMatt Davidson; Dongsheng Dong; Benjamin Xie; Min Li; Andrew J� Ko; Nixi Wang

Assessment of mathematics learning potential: the mathematics comprehension testRobert Prince; Jurie Conradie; Darlington Mutakwa

Can language and cultural differences play an important role in TIMSS mathematics assessment results?Semirhan Gökçe; Giray Berberoğlu

Instructional Sensitivity: Analysis of a Large-scale Mathematics AssessmentSoo Lee; Jasmine B� Park; Thomas Sun

Salon 1 ORAL C5. Psychological testing in children and adolescents

Internal structure comparison of seven different CBCL-derived PTSD subscalesIris Bourgault Bouthillier; Michel Rousseau; Tristan Milot

Using the multi informant Strengths and Difficulties Questionnaire (SDQ) to predict adolescent psychiatric disordersJorien Vugteveen; Annelies de Bildt; Marieke Timmerman

Discordance between parent’s responses on internalizing and externalizing prob-lematic behaviors scale: DIF analysis of CBCL subscalesMichel Rousseau; Tristan Milot; Luc Touchette

Psychosemantic test of cognitive interpersonal perception for children 5 – 10 years oldOlga Mitina; Victor Petrenko

Cases studies of the Davido-CHaD: Empirical and Qualitative InsightsRoseline Davido Oral Presentations • Block C • 8:30 ~ 10:00 AM


Symposiums • Block C • 8:30 ~ 10:00 AM

Salon 3 • Chairs: Angie McAllister; Ruth Childs SYMPOSIUM C1. The Promise of Online Testing and Measurement and Technology Challenges Encountered in Global Efforts.

Technology Enhanced Items in Large Scale Assessment – Signal or Noise?Wayne Camara; Wei Tao

The Future of Online Assessment in IndiaShweta Lamba; Jon Twing, Ishitaa Sher Razdan; Simran Randhawa; Jayanti Prasad; Padma Julura

Moving NAPLAN Online: Advantages and Challenges Unique to AustraliaStanley Rabinowitz

Mobile Assessment in Developing Countries: Access vs AccuracyKimberly O’Malley; Carmen Strigel

Salon 7 • Chair: Daniel Danner SYMPOSIUM C3. Advances in assessing non-cognitive skills in large-scale surveys

Vocational interests: The incremental value of a 30-item short scale suitable for large-scale assessment in six languagesMelanie Partsch; Daniel Danner; Beatrice Rammstedt

Social skills: The value of applying theoretical models to identify their predictive value for real life outcomesSusanne Weis; Manfred Schmitt; Richard D� Roberts

Character Strengths: Towards a Shorter (and More Content-Valid) Measure of the IPIP-VIA ScalesClemens Lechner; Matthias Bluemke; Melanie Partsch; Gerard Saucier

Big Five: Developing short scales for personality domains and facets using traditional approaches and ant-colony algorithmsDaniel Danner; Gabriel Olaru; Melanie Partsch; Beatrice Rammstedt

Sess

ions


Salon Musset • Chairs: Richard P Phelps; Stephen Sireci SYMPOSIUM C4. University admission testing in Chile: Current controversies and Future Directions

College Admission Testing Programs: Refocusing from Examinations to CandidatesAlvaro J� Arce-Ferrer

Bringing about changes in national admission testsMaria Leonor Varas

Using item-level information to improve test performanceNancy Lecourly

From aptitude to achievement: How’s that going?Richard P Phelps

Learning from failure: Seven principles to ensure test quality in high-stakes testingMonica Silva

Salon Hémon • Chair: Lin Gu SYMPOSIUM C5. Assessing and Improving Student Learning Outcomes in an International Context

A Note on Linking Repurposed International AssessmentsJoseph Rios; Usama Ali; Zhen Wang

Validating the HEIghten Critical Thinking Assessment in Three Countries: Evidence from Cognitive Interviews in Chinese, English, and SpanishGuangming Ling

Examining Mode Effects for a Student Learning Outcomes Assessment Used in an International ContextLin Gu; Ou Lydia Liu; Zhitong Yang

The Lower the Socioeconomic Status is, the Lower the Critical Thinking is? An Empirical Study on a Student Learning Outcomes Assessment in an Elite Research University in ChinaLiping Ma; Hong Zhu


Oral Presentations • Block D • 11:45 AM ~ 1:15 PM

Salon Hémon ORAL D1. Improving score interpretation

Circle-Arc Test Pre-Equating: Does it Saves the Day for Licensure and Certification Testing?Alvaro J� Arce-Ferrer

The Framework of Hierarchical Rater ModelsJodi Casabianca

Confidence intervals around normed test scores that incorporate test unreliability and sampling variabilityLieke Voncken; Casper J� Albers; Marieke E� Timmerman

A method for developing performance descriptions corresponding to points on the reporting scales for surveys of achievementMark D Reckase

Embedded Standard Setting: Integrating Cut Score Estimation into Principled Assessment FrameworksDaniel Lewis; Robert J� Cook

Salon 3 ORAL D2. Design issues in test translation and adaptation

Proposing a collaborative platform for language and cultural adaptations of psychological measuresAdam Tapal; Stanislav Jezek; Hynek Cigler

Applying International Career Readiness Certification Tests in MexicoVerónica Díaz López; Elkin Arredondo; Alex Casillas; Changhua Rich

International Use of Screening Tests to Determine Minimum Skill Requirements for EmploymentAlex Casillas; Cindy Hill; Changhua Rich; Wayne Camara

Translatability Assessment: Incorporating translation needs in test designMarielle Lerner; Elica Krajčeva; Musab Hayatli

Embedding Test Adaptation in the Assessment Design by Controlling the Impact of Anglo-Saxon Item Writing PracticesSteve Dept

Sess

ions


Salon 6 ORAL D3. The affordances of computer-based and online testing

A New Measure of Adaptation Based on Test InformationG� Gage Kingsbury; Steven L� Wise

Affordances of item formats and their effects on test-taker cognitionMoon, Jung Aa; Katz, Irvin R; Keehner, Madeleine

Introducing MaFIN - a dynamic matrices finite state automata testThiemo Kunze; Florian Krieger; Matthias Stadler; Samuel Greiff

Evaluating Item Position Effects on Scrambled Form Pre-equatingTroy Chen; Wei Tao; Xiaohong Gao

Multistage Adaptive Testing for Heterogeneity in International SurveysYuan-Ling Liaw

Salon 2 ORAL D4. Methodological issues in testing language proficiency

Does everybody assess an ELL the same way?Rubaiyat Jabeen

Assessing language proficiency using a variety of item formats and integrated tasks: a challenge for measurement modelsDominique Casanova; Alhassane AW; Marc Demeuse

Using severity profiles to enhance reliability of rater-mediated assessments Dominique Casanova; Alhassane AW; Marc Demeuse

Evaluation of Vocabulary Acquisition in English Speakers and English LearnersHazel Wheldon; Gill Sitarenios

Test design and test use: Students’ perceptions of HSK for academic purposes Wei Yan; Yue Peng


Salon Musset • Chair: Hudson Golino SYMPOSIUM D1. Methodological issues in testing: wording effects, dimensionality assessment and acquiescence.

A Systematic Evaluation of Wording Effects Modeling under the ESEM FrameworkLuis Eduardo Garrido; Francisco José Abad; Hudson Golino; María Dolores Nieto; Kiero Guerra-Peña; Agustín Martínez-Molina

Acquiescence in multilevel variables: Fitting the random intercept modelFelipe Valentini; Érika Guimarães Soares de Azevedo Andrade

Comparing Exploratory Graph Analysis and traditional dimensionality assessment techniques: a simulation studyHudson Golino

Salon 5 • Chairs: Avi Allalouf; Joan Herman SYMPOSIUM D2. Testing and Society

Personality assessment in high-stake settingsDragos Iliescu

Impact of High-Stake vs Low-Stake Tests on Students’ BehaviorMichel Laurier

High-stakes exams legislation in Cyprus: Going back and forth?Michalis P� Michaelides; Elena Papanastasiou

National Assessment Capacity as a Factor that Shapes ValidityGuillermo Solano-Flores; Paula Elosua

Salon Drummond East • Chair: Neal Schmitt SYMPOSIUM D3. ITC Publication Efforts: Nature, Purpose, and Contributions

ITC Best Practice GuidelinesAnna Brown

International Journal of Testing: Submission Trends, Highlights, and Upcoming IssuesStephen Stark

An Introduction to Testing International: Your ITC Newsletter! April Zenisky

A Description of The ITC Handbook of Testing and AssessmentKurt Geisinger

ITC Book seriesNeal SchmittSe

ssio

ns


Salon 1 • Chair: Katharina Lochner SYMPOSIUM D4. The Changing Nature of Assessment in a Digital World

Game-Based Assessment – Constructs and MeasuresTim Warszta

Paradata – From Theory to Use in PracticeRichard Justenhoven; Alina Siemsen

Artificial Intelligence in Psychometric TestingAchim Preuss; Nicholas Martin

Do They Find the Right Words? Natural Language Processing in Psychometric AssessmentKatharina Lochner

Salon 4 • Chairs: Mengxiao Zhu; Stephen Sireci SYMPOSIUM D5. Beyond the test scores: some exemplar uses of response process data in informing test taker’s performance and behavior

Analysis of Keystroke Sequences in Writing LogsMengxiao Zhu; Mo Zhang

Validating Process Indicators of Accessing Source Information Constructed from an Assessment of Multiple Document ComprehensionCarolin Hahnel; Ulf Kröhne; Frank Goldhammer; Cornelia Schoor; Nina Mahlow; Cordula Artelt

Exploring relationship between sequence patterns in solving digital tasks and background variables: An empirical study using log data in PIAACQiwei Hea; Hok Kan Ling; Jingchen Liu; Zhiliang Ying

The best of the best: The use of log data to differentiate within ceiling effectsMatthias Stadler; Samuel Greiff


Oral Presentations • Block E • 2:30 ~ 4:00 PM

Salon 5 ORAL E1. Automated item generation and scoring

Applying a Holistic Framework and AI Scoring to Assessing Writing CreativityDonna Matovinovic; Brad Bolender; Changhua Rich

Applications of Automatic item generation in Large-scale student assessmentCitlalli Sanchez-Alvarez

AIG for International AssessmentDanielle Young; Dr� Jaehwa Choi

Automated Scoring of Responses to Open-Ended Mathematics ItemsSemirhan Gökçe; Stephen Sireci

Salon Hémon ORAL E2. Innovative modeling techniques

Maximum Likelihood (ML), Bayesian (BAYES), and Weighted Least Squares Means and Variance Adjusted (WLSMV) Estimation Procedures: A Comparison of Estimation Methods with Binary Data from a Language Proficiency Test.Angel Arias; Jean Guy Blais

A monotonic polynomial graded response modelCarl F� Falk

Testing longitudinal invariance of teachers’ interpersonal style: easier said than done Carme Viladrich; Ariadna Angulo-Brunet; Jaume Cruz

Examining Estimation Options in the MH-RM Algorithm for Multilevel Multidimensional Item Response Theory ModelsYoungjun Lee; Unhee Ju; Carl F� Falk

A new Hierarchical Mixture IRT approach for measuring response stylesMatthias von Davier; Lale Khorramdel; Hyo-Jeong Shin

Salon 1 ORAL E3. Implications of large-scale assessments

Keep the Testing Drum, but Deepen the Beat on the REPORTING of Assessment ResultsCarina Fiedeldey-Van Dijk

Sess

ions


Students’ mathematics and science achievements in TIMSS and in schoolsMarie Wiberg; Ewa Rolfsman

An Evaluation Framework in Support of Meaningful Country Participation in International Large-Scale AssessmentsMaria Elena Oliveri; David Rutkowski; Leslie Rutkowski

Differential topic functioning in TIMSS science as a function of patterns in content coverage across gradesStephan Daus; Dr Johan Braeken; Dr Trude Nilsen

Stakes raised by e-assessment: illustration based on a very-large-scale online assessment in FranceThierry Rocher

Salon Drummond East ORAL E4. Examining learner behaviour during tests

Cheating on examsFrenette, Eric; Fontaine, Sylvie; Hebert, Marie-Helene; Beland, Sebastien; Loye, Nathalie; Monney, Nicole; Peters, Martine

Are we measuring what we think we are measuring?John J Barnard

Reduce randomly guessing effects in a university generic skills testLuc Le

Answer-changing behavior in multiple-choice questions: Looking beyond the impact of the changesZhi Li; Michelle Y� Chen; Jayanti Banerjee

Understanding Test Characteristics and Examinee Performance Using Response Time AnalyticXiaohong Gao; Min Wang


Symposiums • Block E • 2:30 ~ 4:00 PM

Salon 3 • Chairs: Lara Montefiori; Liam Close SYMPOSIUM E1. Evidence from applied use of Game-Based Assessment. Class Quizzes, Virtual Reality, Faking, and Effect of Game Experience

Test-Faking in Game-Based AssessmenLara Montefiori; Maria Panagiotidi

The Effect of Game Experience on Game-Based Assessment (GBA) Performance, and on Perceptions of Procedural Justice, Fairness, and Predictive Validity of GBA as Selection MethodLiam Close; Ioannis Nikolau

Convergent Validity of Game Based Risk and Emotion Recognition Tasks across Mobile and Virtual Reality PlatformsLiam Close; Diana Sanchez

Game-Based Assessment: Lessons learned from using an Off-the-Shelf games for performance evaluationMarkus Langer; Diana Sanchez

Gamification in the Classroom: Examining the Impact of Gamified Quizzes on Student LearningDiana Sanchez; Markus Langer

Salon 6 • Chair: Gary L. Canivez SYMPOSIUM E2. Psychometric Evaluations of Wechsler Scales: Cross-Cultural Contexts

Construct Validity and Reliability of the WISC–V Canadian: CFA and Omega AnalysesMarley W� Watkins; Gary L� Canivez; Stefan C� Dombrowski

Structural Validity of the French WISC–V with the French Standardization Sample: EFA and CFA EvidenceGary L� Canivez

Structural Validity of the of the WISC–V UKRyan J� McGill; Gary L� Canivez, Marley W� Watkins

Construct Validity and Reliability of the WISC-V Spain: CFA and Omega AnalysesJavier Fenollar-Cortes; Marley W� Watkins; Gary L� Canivez

Construct Validity of the WISC–IV Italian Adaptation: Square Pegs Still Don’t Fit in Round HolesJoseph C� Kush; Gary L� CanivezSe

ssio

ns


Salon Musset • Chairs: MingJie Zhou; Jianxin Zhang SYMPOSIUM E3. The Antecedents and consequences of personality: evidence from Cross-cultural Personality Assessment Inventory

Interpersonal Relatedness and Temporal DiscountingYiqun Gan; Lei Zheng; Fanny M� Cheung

Universal and Cultural-Specific Personality Traits and Academic Performances among Chinese High School StudentsXiaolu Zhou; Weiqiao Fan; Jiaying Wang

Personality, Majors and Academic Performance of Chinese Undergraduate Students: A Latent Class Growth AnalysisChuchu Li; Mingjie Zhou; Jianxin Zhang

Chinese Personality and Emerging Adults’ Friend Selection on Social Networking Sites: A Social Network Analysis PerspectiveShuang Chen; Mingjie Zhou; Jianxin Zhang

The association between Gene and personality: evidence from Cross-cultural Personality Assessment InventoryLeilei Zhang; Mingjie Zhou; Jianxin Zhang

Salon 2 • Chair: John Hackston SYMPOSIUM E4. Assessment for employee development: alternative approaches to validation

Effectiveness of large scale, employee driven, developmental assessment and planning projectShawn Bakker; Tom Oliver

Observing Predicted Behavior in Others: A Validation StudyRichard Thomson; Michael Anderson; John Kulas

Personality assessment for development: taking validity out of the ivory towerJohn Hackston; Penny Moyle

Vocational interest congruence using polynomial regression across dependent variablesMichael L� Morris


Panel • Block E • 2:30 ~ 4:00 PM

Salon 4

The International Declaration on Core Competences in Professional PsychologyDragos Iliescu; Sverre Leonhard Nielsen; Fanny Cheung; Solange Wechsler; Oleg Burlachuk; Peter Macqueen

Day 3 • Thursday, July 5th, 2018

Oral Presentations • Block F • 8:30 ~ 10:00 AM

Salon 4 ORAL F1. The impact of culture on test validity

Assessing adverse impact and test validity of three personnel selection tests used in the Public administration, in Quebec.Chantale Jeanrie

Testing and understanding approximate invariance of the Indigenous Social Desirability Scale in Mexico, Colombia and Spanish samplesIsabel Benítez; Alejandra Dominguez; Catalina Estrada; Carolina Barrios; Pablo Doncel; Luis Manuel Lozano; Jose-Luis Padilla

Benefits of alignment for testing measurement invariance of cultural-bound constructs: Cross-cultural equivalence of the Attention-Related Driving Errors ScaleDr� Jose-Luis Padilla; Dr� Ruben Ledesma; Dr� Daniella Barragan; Dr� Alessandra Bianchi; Mrs� Nathalia da Rosa Krauer; Dr� Oscar Oviedo-Trespalacios; Mr� Pablo Doncel; Dr� Silvana Montes; Dr� Candida Castro

Adaptation and Validation of the Domain-Specific Risk-Taking Scale (DOSPERT) for Chinese PopulationRui Zheng

Salon 2 ORAL F2. Formative and diagnostic assessment

Developing and evaluating score reports for cognitive diagnostic analyses from PIRLS 2011Dan Thanh Duong Thi; Nathalie Loye

Is anyone using cognitive diagnostic models in test development?Guillaume Loignon; Nathalie LoyeSe

ssio

ns


Scaffolding simulation-based science inquiry to facilitate learningMoon, Jung Aa; Brockway, Debra; Katz, Irvin R

Diagnostic assessment and the transition to university: Fostering success in first-year engineeringTina Beynen; Dr� Janna Fox

Relationships among Students’ Perceived Teacher Feedback, Self-regulation, and Academic AchievementYongfei Wu

Salon 3 ORAL F3. Test design and validation

Using Eye Tracking and Pupillometry to Validate a Graphic Literacy AssessmentJay M Thomas; Thomas E Langenfeld

Development and validation of a Clinical Reasoning assessment as part of a medical simulated sessionThomas Pennaforte; Ahmed Moussa; Nathalie Loye

Salon 1 ORAL F4. The influence of engagement in the task on the validity of educational and psychological testing

The Effects of Cognitive Ability, Motivation and Perception of Interview on the Validity of Think Aloud Interview DataAlina Lutsyk; Dr� Jacqueline P� Leighton

Measuring Test-Taking Motivation via Moment-to-Moment Test-Taker EmotionsBlair Lehman

Response effects due to negative wording on the Rosenberg Self-Esteem Scale are moderated by self-regulationMichalis P� Michaelides; Chrystalla Koutsogiorgi; Markus Zenger; Elmar Brähler; Yve Stöbel-Richter; Hendrik Berth

The Impact of Test-Taking Disengagement on Item Content Representation and ValiditySteven L� Wise

Investigating the Disengagement Tendency in an Early Literacy Assessment: A Structural Equation Modeling ApproachQinjun Wang; Jose Palma; Michael Rodriguez


Salon 6 ORAL F5. Validation: examining the internal structure of measurement instruments

Disassembling erotic desire: Exploratory Factorial Analysis of the Sexual Desire Inventory-2Ariadna Benito del Arco

Sources of validity evidence for the French version of the Community of Inquiry questionnaireEric Frenette; Sawsen Lakhal

DEVELOPMENT AND VALIDATION OF PSYCHOSOCIAL PROBLEMS SCALE FOR LEFT BEHIND WIVES OF OVERSEAS MIGRANTS OF AJ&KRabia Mushtaq; Seema Gul; Muhammad Tahir Khalily

Measuring evidence-based practice related knowledge, attitudes and practices: Psychometrics from healthcare and educationKrista C� Ritchie; Erna Snelgrove-Clarke; Andrea Murphy; Joan Versnel; Ron George; Matt Ta; Scott Thieu; Sara King; Amira Noyes

Symposiums • Block F • 8:30 ~ 10:00 AM

Salon 5 • Chairs: Lale Khorramdel; Kadriye Ercikan; Leslie Rutkowski SYMPOSIUM F1. Timing and Process data for improving the quality of large-scale assessment (PISA, PIAAC, NAEP)

Using Timing and Process Data to examine Data Fabrication in International Large-Scale AssessmentsMatthias von Davier

Examining item specific response time thresholds for the coding of omitted responses in PISAFrederic Robin; Hyo Jeong Shin

Latent regression for speed-accuracy response modelsPeter van Rijn

Relating Response Times and Process Data to Response Styles using mixture IRTree modelsLale Khorramdel; Matthias von Davier

Using Timing Data to Investigate Test-taking Behaviors for Scenario-Based Tasks—A Case Study in the Context of National Assessment of Educational Progress (NAEP)Yue Jia; Yi-Hsuan LeeSe

ssio

ns


Salon Drummond East • Chairs: Ronny Scherer; Samuel Greiff SYMPOSIUM F2. Innovations in computer-based assessment

Elucidating 21st century threads and patterns in digital environmentsAlvin Vista; Esther Care; Nafisa Awwal

Experimental strategies for validating the construct interpretation of computer-based assessment itemsLena Engelhardt; Frank Goldhammer; Johannes Naumann; Andreas Frey;

Towards a multifaceted framework of CPSMatthias Stadler; Christoph Niepel; Samuel Greiff

Increasing measurement accuracy of collaborative problem solving by incorporating telemetry dataKristin Stoeffler; Yigal Rosen; Jason Way; Pravin Chopade; Alina von Davier

Salon Musset • Chair: Richard C. Thompson SYMPOSIUM F3. Using Personality Type to Improve Individual Wellness

Email: necessary, useful, but stressfulJohn Hackston

The relationship between personality types and burnoutNicola Taylor

The Role of Personality Type in Exercise ChoicesNancy A� Schaubhut

Global Well-being and Personality Type: Does personality influence how people experience and enhance their work place well-being?Richard C� Thompson

Round-table • Block F • 8:30 ~ 10:00 AM

Salon Hémon

ROUND-TABLE F. Language testing: Impact of technology and placement issuesFrançois Pichette; Angel Arias; Dominique Casanova; Carol Chapelle; Bruno Zumbo


Oral Presentations • Block G • 11:45 AM ~ 1:15 PM

Salon 2 ORAL G1. Measurement issues in educational assessment

Data mining applications for predicting students passing the North American Pharmacist Licensure Examination (NAPLEX) on first attemptJonathan Hernandez Agosto

Scoring with IRT: Issues and factsNancy Lacourly; Jaime San Martin; Monica Silva; Paula Uribe

MEASUREMENT INVARIANCE OF THE ACADEMIC PERFORMANCE FOR THE SIXTEEN NATIONS OF THE UNESCO ASSESSMENT PROGRAMPamela Woitschach; Muñíz, José; Zumbo, Bruno D�; Rubén Fernández-Alonso

Effects of gender and study background on item difficulty estimation in a university generic skills testDr� Van Nguyen; Joyce Hong

Salon 3 ORAL G2. Validation of large-scale assessments

Intelligence and Beliefs about Assessment: Swedish Grade 6 StudentsGavin T L Brown; Hanna Eklof

The dimensionality of the Swedish Scholastic Assessment Test (SweSAT)Jonathan Wedman; Miguel Inzunza

The Landscape of Standardized Tests in Canada – The Need for ChangeDr� Man-Wai Chu; Dr� Paolina Seitz

Validity Theory and Practice: A Longitudinal Examination of Validity Characterizations in Published Test ManualsNancy A� Anderson

Effect of Misfitting Item Responses on the Item Estimates of Large-Scale AssessmentsYing Cui, Xin Tao; Ping Chen; Guanyu Chen

Sess

ions


Salon Musset ORAL G3. Innovations in assessment design

The analysis and presentation of the results from a bilingual assessmentSerge Lacroix

Construction Cycle and Quality Controls for Training Transfer (CCQCTT) in Livelong Training Programs in Quebec and SwitzerlandJean-Luc GILLES; Yves CHOCHARD; Karl RUPP-NANTEL; Asmae Benamer; Nathalie Chartier; Alpha Djalo ;Myriam Garcia Perez; Anne-Louise Hellwig; Nicolas Prestat; Alexandre Vinet

Collaborative exams as summative assessment in a large group context: the case of an education theory classAndré-Sébastien Aubin; Diane Leduc; Mathilde Cambron-Goulet

Evaluation and assessment in a course on patient partnership: presentation of an online 360o frameworkLuigi Flora, PhD; Philippe Karazivan, MD, MA; Mathieu Jackson

Measurement methods in 360 degree feedback – a case for ‘less is more’Nigel Evans

Salon 6 ORAL G4. How assessment design and administration influences learning and the validity of assessment

Don’t know about that “Don’t Know” option: A Nominal Latent Class Analysis to Examine the “Don’t know” Option in Progress TestingAmanda Brijmohan; Dr� Ruth Childs; Dr� HsingChi von Bergmann

Playing chess with test resultsSilvester, J� L�; Leeuwen, van, A� E�; Geertsma, J�

The Washback of the Revised Secondary Education Certificate Examination of English in the Libyan EFL Classroom: A Mixed Method StudyNwara Abdulhamid

It’s a Myth: High Stakes Cause Test-Score InflationRichard P Phelps

Validities of True and False Keyed Social-emotional Skill items to Predict Educational AchievementRicardo Primi; Filip De Fruyt; Oliver P� John; Daniel Santos


Salon Drummond East ORAL G5. Testing in the workplace

Investigating the psychometric properties of the Career Values Scale in a South African sampleCobi Hayes; Dr� Nicola Taylor; Shawn Bakker

Test-retest reliability and validity of Situational Judgement Test of Potential (SJTP) : Evidences from field studiesGao Xile; Yan Gonggu

The role of fundamental motives in job satisfaction: An investigation of needs-supplies fitJan Dörendahl; Christoph Niepel; Samuel Greiff

Entrepreneurial Orientation, Entrepreneurial Self-Image, and Personality: How Can We Help Entrepreneurs?John Hackston

The impact of education and training on cognitive perspective taking among Swedish National Police recruits: Implementation of a longitudinal projectMiguel Inzunza; Christina Wikström; Tova Stenlund; Gavin T L Brown

Panel • Block G • 11:45 AM ~ 1:15 PM

Salon 1 • Chair: Dragos Iliescu PANEL G. New Trends in Measurement: The Examination of “Big Data”

IRT parameters and developmental cognitive capacity: A vignette in multi-source data and item analysis in RE� Manolo Romero Escobar; Juan-Pascual Leone

Big Data ApplicationsJames Parker

Methodological Considerations in Research with Big DataG� Sitarenios; G� Gunn

Symposiums • Block G • 11:45 AM ~ 1:15 PM

Salon Hémon • Chair: John Weiner SYMPOSIUM G1. Assessing 21st Century Skills: Methods, Research, and Applications

Noncognitive Alternative Assessments In K-12 Educational SettingsWayne Camara; Jeremy BurrusSe

ssio

ns


Competency-Based Measurement in the Assessment of “21st Century Skills”John Weiner

The Use of Structured Behavioral Interviews to Assess Noncogntive SkillsNeal Schmitt

Salon 5 • Chairs: Cathy Wendler; Kurt Geisinger SYMPOSIUM G2. International Perspectives in Higher Education Admissions

International Perspectives in Higher Education AdmissionsCathy Wendler

Cross-cultural and Global Competencies and their Role in AdmissionsStephanie McKeown; Cynthia Bourne; Leah Sanford; Kendra Mack; Adrienne Vedan

Changes in Higher Education Admissions Practices in IsraelNaomi Gafni; Avi Allalouf

A Holistic Framework of Education and Workplace SuccessKristin Stoeffler; Jeremy Burrus; Jason Way; Becky Bobek; Ryan O’Connor

New Horizons for Postsecondary Placement and Admission Practices in the United StatesMaria Elena Oliveri; Robert Mislevy

Salon 4 • Chair: Angela Verschoor SYMPOSIUM G3. Applications of Automated Test Assembly as part of Evidence Centered Design

Using task features to predict item difficulty of new items in an optimal test assembly contextErik Roelofs; Remco Feskens; Angela Verschoor; Elleke Hoogakker

Dealing with uncertainty in ATA problemsGiada Spaccapanico Proietti; Mariagiulia Matteucci; Stefania Mignani; Bernard Veldkamp

Automated test assembly in Large Scale Assessment test design: an experience from the national survey of the Italian National Institute for the Evaluation of the Education System.Marta Desimoni; Antonella Costanzo; Cristina Lasorsa; Alessia Mattei; Donatella Papa; Roberto Ricci; Angela Verschoor

Improving the Equality of Parallel High-Stakes TestsAngela Verschoor; Elleke Hoogakker


Day 1 • Tuesday, July 3rd, 2018 Posters scheduled for poster session 1 will be displayed from 11:30 AM to 6:00 PM on Day 1 in the Ballroom east. Presenters must show up at 11:30 AM to install their posters. The official poster session will be from 5:00 PM to 6:00 PM.

Poster session 1 • 5:00 ~ 6:00 PM

Ballroom East

A Corpus Analysis of Online Conversations about the Canadian and Global Conversations Surrounding Language AssessmentLucas J� Friesen; Edward Kroc; Bruno D� Zumbo

Sensibility and specificity of parent, teacher, and multi-respondents reports of behavioral problems in elementary school children Mélanie Lapalme

Empirical study of the Cognitive Scale of the Dimensional Inventory for Child Development AssessmentEuclides José de Mendonça Filho

A methodology to simulate script concordance’s scoresEric Dionne; Julie Grondin; Jean-Sébastien Renaud; Isabelle Raîche

Understanding the lexical constitution of the BC grade 12 provincial English examClaire Reynolds

The Impact of Music on the Academic Performance of Undergraduate StudentsPakeezah Rajab; Cobi Hayes; Nicola Taylor

Testing bi-factor models for obtaining validity evidence of the Spanish police officers’ attitudes toward intimate partner violence scaleCelia Serrano; Inmaculada Valor; Luis Manuel Lozano; Jose-Luis Padilla

Developing parallel tests: Using item templates and constraints to construct comparable progress monitoring formsLindsey Perry; Leanne Ketterlin Geller; Cassandra Hatfield

Graphical Language in EnemElaine Pavini Cintra; Emmanuella Gracina Florian Marques; Eduardo Carvalho Sousa -

Post

er S

essi

ons


The longitudinal predictive validity of learning potential and aptitude scores for academic results of secondary school learnersMarie de Beer

Documenting the Development of the Buros Center for Testing Standards for Accreditation of Testing Programs: How One Organization Created Actionable Testing Standards Consistent with the 2014 Joint Standards Carina McCormick; Kurt F� Geisinger; Weldon Z� Smith

Pedagogical and Statistic study about graphical languageEmmanuela Gracina Florian Marques; Elaine Pavini Cintra; Eduardo Carvalho

Development of the HELP CARES Personality Scale: Analysis of Items using Rasch ModellingMaria Felicitas Molina Mamauag; Sabrena G� Arosh

Development and Validation of Information Anxiety ScaleZheng Zhang; Kexin Wang; MingJie Zhou

The Relationship Between Intelligence and Creativity in Brazil Through Threshold HypothesisCarolina Rosa Campos; Tatiana de Cássia Nakano; Ricardo Primi

Standards Setting of a Large Scale Mathematic Test: A Practice Based on Bookmark MethodHua Wang; Ruilin Wu; Jingyuan Qiu

Do You See What I See: The Feasibility of Using Image-based Assessments Across CulturesLisa A� Keller

The Development and Empirical Testing of an Explanatory Psychological Ownership Structural ModelAngela Lee Marsburg

Development of a Visual-Spatial Scale for a Multiple Aptitude Test Using Rasch Analysis Sabrena G� Arosh, Maria Felicitas M� Mamauag

Performance in a Fluid Intelligence Test and Humor Induction: Evidence of Cognitive Strategies and Ocular Movement PatternsPaulo Guirro Laurence; Alexandre Luiz de Oliveira Serpa


Day 2 • Wednesday, July 4th, 2018 Posters scheduled for poster session 2 will be displayed from 11:30 AM to 6:30 PM on Day 2 in the Ballroom east. Presenters must show up at 11:30 AM to install their posters. The official poster session will be from 5:30 PM to 6:30 PM.

Poster session 2 • 5:30 ~ 6:30 PM

Ballroom East

Culture as a Determinant of Option Choice in a Situational Judgment Test: A New LookJoshua Prasad

Relationships between learning strategy for entrance examinations and subjects of the entrance examinationsSayaka Arai; Masayuki Suzuki; Rei Suetsugu; Shigeru Yamamura

Competence-based certification in test use: The British Psychological Society’s approach to ensuring standardsAngus McDonald

Validation Process of an Assessment Tool of Problematic Eating Behaviors in People with Diabetes: Validity Evidence into Practice Cynthia Gagnon; Claude Bélanger; Christina St-Onge; Annie Aimé

What Kind of People Commit Cyber-Related Counterproductive Work Behaviors?Fredrik Borg

Large-scale Assessment (LSA) Trends and Achievement in Mathematics: A Case StudyYan (Lizzie) Yan

Preliminary evidences of the Balanced Inventory of Desirable Responding for BraziliansJoao Paulo Araujo Lessa; Cristian Zanon

Multilevel Measurement of Educational DisparitiesJose Palma

Automated scoring of creativity divergent production tasks with deep learningRicardo Primi; Tatiana de Cássia Nakano

Post

er S

essi

ons


Consideration of the PISA Cognitive Activation Scale Invariance Using the Alignment Method: A Substantive and Methodological Inquiry Carina McCormick; Yage Guo; Leslie Hawley

The Parental Competences Test (Test Kompetencji Rodzicielskich – TKR) as an example of Situation Judgment TestJoanna Stanczak

A simple communication tool to visually capture the performance of multiple-choice testsDongyue Louis LIU

Data mining applications for predicting students passing the North American Pharmacist Licensure Examination (NAPLEX) on first attemptJonathan Hernandez Agosto

Teacher Instructional Variables and Early Reading Growth: A Growth Mixture Modeling ApproachBitnara Jasmine Park; Eva Yujia Li; Andrew Iverson; Xiaxing Zheng; Yuan Zhang

A Bayesian Random Block IRT Model for Forced Choice Formats HyeSun Lee; Weldon Z� Smith

Interactive Effects of Parameter Estimation and Latent Trait Scoring on Subscore Value in International Large-Scale Assessments Kondwani Kajera Mughogho

The Romanian adaptation of the Survey Work-Home Interaction - NijmeGenSimona Alexandra Ispas

Measuring executive functions safety and decision making skills of individuals with alcohol addictionNariman Darvishov

Validation of the Trait Emotional Intelligence Questionnaire – Adolescent Short Form (TEIQue-ASF) among Adolescents in VietnamAnh Nguyen, Jane Fisher, Thach Tran, Anh T� T� Tran

The measurement invariance of YPI-C in Chinese mainland sampleFen Ren, Mengcheng Wang, Mingjie Zhou


Pre Day • Monday, July 2nd, 2018

Room

Title

9:00 AM ~ 4:30 PM

Fullday Workshops

Jarry

FD1.

Ass

essm

ent o

f Col

labo

rativ

e Pr

oble

m S

olvi

ng S

kills

: An

Over

view

Kafk

aFD

2. E

thic

s, T

est S

tand

ards

, and

Tes

t In

terp

reta

tion:

Mea

sure

men

t Mat

ters

Salo

n 1

FD3.

Intro

duct

ion

to A

utom

atic

Item

Ge

nera

tion

usin

g CA

FA A

IG

Salo

n 2

FD4.

Cog

nitiv

e in

terv

iewi

ng fo

r in

terp

retin

g DI

F fro

m a

mix

ed m

etho

ds

pers

pect

ive

Joyc

eFD

5. G

ener

aliz

abili

ty th

eory

: app

licat

ion

and

optim

izat

ion

Salo

n 5

FD6.

App

lyin

g th

e St

anda

rds

for

Educ

atio

nal a

nd P

sych

olog

ical

Tes

ting

in

Inte

rnat

iona

l Con

text

s

Room

Title

9:00 AM ~ 12:15 PM

Morning Workshops

Lam

artin

eAM

1. To

ols

for E

quat

ing

10:30 ~ 10:45 AM Foyer A; Foyer 2 Coffee break

Salo

n 3

AM2.

Qua

lity

Cont

rol

Proc

edur

es fo

r the

Sco

ring

and

Ratin

g of

Tes

ts

Hém

on

AM3.

Tes

t and

Sco

re R

epor

t De

sign

Prin

cipl

es fo

r Cul

tura

lly

and

Ling

uist

ical

ly D

iver

se

Popu

latio

ns

12:15 ~ 1:15 PM

Ballr

oom

Ea

st/C

entre

Lunc

h

1:15 ~ 4:30 PM

Afternoon WorkshopsHé

mon

PM1.

App

lyin

g Te

st E

quat

ing

met

hods

usi

ng R

2:45 ~ 3:00 PMFoyer A; Foyer 2Coffee break

Lam

artin

ePM

2. C

rafti

ng a

dapt

ed te

sts

with

a fo

cus

on a

-prio

ri m

etho

ds

Pres

enta

tion

Sch

edul

e at

a G

lanc

e


Pre Day • Monday, July 2nd, 2018 (cont.)

Room Title

5:00

~ 6

:30

PM

Cere

mon

y

Ballroom West

Opening Ceremony • Nathalie Loye

Thomas Oakland Award Presentation • Stephen Sireci

ITC Scholarships Presentation • Solange Wechsler

Presidential Address • Dragos Iliescu : The Impact of Tests in Practice and Policy: What Will the Future Bring?

Day 1 • Tuesday, July 3rd, 2018

Room Title

7:45

~

8:30

AM Ballroom

East/Centre Light breakfast

8:30

~ 1

0:00

AM

• Bl

ock

A

Oral

Pre

sent

atio

ns

Salon 3 ORAL A1. Measurement issues in psychological and clinical testing

Salon 5 ORAL A2. Validation of admission practices

Salon 2 ORAL A3. Testing of cognitive development around the world

Musset ORAL A4. Innovations in computer adaptive testing and multistage testing

Salon 4 ORAL A5. Testing language proficiency in context: from intentions, to design, to outcomes

Sym

posi

ums

Salon 1 SYMPOSIUM A1. Game-Based Assessment: Best Practice, Test Development, and Evidence.

Drummond East

SYMPOSIUM A2. Use of Process Data in Advancing Measurement

Salon 6 SYMPOSIUM A3. The Value of Item Response Times in Psychometric Test Practice

Salon 7 SYMPOSIUM A4. Approaches in Psychological and Educa-tional Test Accommodations and Adaptation for Deaf People

Hémon SYMPOSIUM A5. Creativity assessment: Challenges and possibilities in diverse cultural environments


Day 1 • Tuesday, July 3rd, 2018 (cont.)

Room Title10

:15

~ 11

:15

AM

Keyn

ote

Ballroom West

KS1. The Contributions of Women in Psychometrics-Statistics: Past and Present Irini Moustaki, Professor of Social Statistics, London School of Economics and Political Science

11:1

5 ~

11:4

5 AM Ballroom

East/Centre Coffee break

11:4

5 AM

~ 6

:00

PM •

Ballr

oom

Wes

t • P

oste

r Dis

play

11:4

5 AM

~ 1

:15

PM •

Bloc

k B

Oral

Pre

sent

atio

ns

Salon 6 ORAL B1. Validation studies of tests of quality of life and wellbeing

Salon 2 ORAL B2. The multiple roles of testing in fostering student engagement

Salon 1 ORAL B3. Technology in assessment: insights from games

Salon 7 ORAL B4. The impact of accommodations on test validity

Salon 4 ORAL B5. Exploring bias

Sym

posi

ums

Salon 5 SYMPOSIUM B1. Forcing choice in personality questionnaires: Advances and challenges

Salon 3SYMPOSIUM B2. The Journey of Updating Career Readiness Assessments: Combining Content and Psychometrics Perspectives

Musset SYMPOSIUM B3. Shifting to a Principled Design Science Paradigm

Drummond East

SYMPOSIUM B4. Unifying Research and Practice: Validating High Potential in Leaders using the HPTI

Roun

d-ta

ble

Hémon ROUND-TABLE B. Challenges of Assessment in Emerging Economies

Pres

enta

tion

Sch

edul

e at

a G

lanc

e (c

ont.)


Day 1 • Tuesday, July 3rd, 2018 (cont.)

Room Title

1:15

~ 2

:30

PM

Ballroom East/Centre Lunch

11:4

5 AM

~ 6

:00

PM •

Ballr

oom

Wes

t • P

oste

r Dis

play

Mee

ting

Young Scholar and Mentors Lunch Meeting

2:30

~ 3

:30

PM

Keyn

ote

Sess

ion

Ballroom West

KS2. The Application of computational psychometrics to process data from performance assessments Alina von Davier, Vice President, ACTNext

Drummond Centre/West

KS3. Implementing Automated Item Generation in a Large-scaled Medical Licensing Exam Program - Lessons Learned. André De Champlain, Director of the Psychometrics and Assessment Services department, Medical Council of Canada (MCC)

3:30

~

4:00

PM Ballroom


4:00

~ 5

:00

PM

Lect

ure

Ballroom West

Thomas Oakland lecture: My Personal History of Item Response Theory Ronald K� Hambleton

5:00

~ 6

:00

PM

Post

er se

ssio

n

Ballroom East Poster session 1 and networking


Day 2 • Wednesday, July 4th, 2018

Room Title7:

00 ~

7:

45 A

M Sheraton’s main entrance

Run or walk 3k

7:45

~

8:30

AM Ballroom

East/Centre Light breakfast

8:30

~ 1

0:00

AM

• Bl

ock

C

Oral

Pre

sent

atio

ns

Salon 2 ORAL C1. Testing to support transitions to higher education and the workplace

Drummond East ORAL C2. Assessing the teachers: validation studies

Salon 5 ORAL C3. Leveraging technology to enhance feedback and learning

Salon 6 ORAL C4. Validation of tests of mathematics and computational skills

Salon 1 ORAL C5. Psychological testing in children and adolescents

Sym

posi

ums

Salon 3SYMPOSIUM C1. The Promise of Online Testing and Measurement and Technology Challenges Encountered in Global Efforts.

Salon 7 SYMPOSIUM C3. Advances in assessing non-cognitive skills in large-scale surveys

Musset SYMPOSIUM C4. University admission testing in Chile: Current controversies and Future Directions

Hémon SYMPOSIUM C5. Assessing and Improving Student Learning Outcomes in an International Context

Pane

l

Salon 4 PANEL C. The International Declaration on Core Competences in Professional Psychology

10:0

0 ~

10:1

5 AM

Pause

Pres

enta

tion

Sch

edul

e at

a G

lanc

e (c

ont.)


Day 2 • Wednesday, July 4th, 2018 (cont.)

Room Title

10:1

5 ~

11:1

5 AM

Keyn

ote

Sess

ion

Ballroom West

KS4. The Reports of DIF’s Death are Greatly Exaggerated; It is Like a Phoenix Rising from the Ashes Bruno Zumbo, Professor of Psychometrics and Measurement, University of British Columbia


KS5. Including the Excluded through Rethinking National Assessments: The Example of Citizen Led Assessments Sara Ruto, Head of the secretariat, People’s Action for Learning (PAL)

11:1

5 ~

11:4

5 AM

Ballroom East/Centre Coffee break

Post

er D

ispl

ay

Measure Executive Function

Provide a Comprehensive

Evaluationto

Develop Intervention Strategies

Conduct Treatment Monitoring

Strengths & Weaknesses

to

Student Success

Ensuring

The CEFI™ a comprehensive evaluation of executive function strengths and weaknesses in youth aged 5 to 18 years.

• Accurate Results: Normative samples are within 1% of U.S. Census targets for an accurate representation of the U.S. population.

• Easy to Understand Reports: Generate three types of dynamic reports including a Comparative Report by comparing results from multiple rater forms (Parent, Teacher, and Self). • Strategies for Intervention: Utilize the CEFI’s nine scales and full scale score to pinpoint targets for intervention. • Save Time: Assess, score, and report from anywhere with the safe and secure MHS Online Assessment Center.

A S S E S S M E N T S

Multi-Health Systems Inc. USA Tel: 1.800.456.3003 / CAN Tel: 1.800.268.6011

mhs.com • [email protected]

Goldstein & Naglieri

ExcellenceIn Assessments



®

Available

®


Room Title11

:45

AM ~

1:1

5 PM

• Bl

ock

D

Oral

Pre

sent

atio

nsHémon ORAL D1. Improving score interpretation

11:4

5 AM

~ 6

:30

PM •

Ballr

oom

Wes

t • P

oste

r Dis

play

Salon 3 ORAL D2. Design issues in test translation and adaptation

Salon 6 ORAL D3. The affordances of computer-based and online testing

Salon 2 ORAL D4. Methodological issues in testing language proficiency

Sym

posi

ums

Musset SYMPOSIUM D1. Methodological issues in testing: wording effects, dimensionality assessment and acquiescence.

Salon 5 SYMPOSIUM D2. Testing and Society

Drummond East

SYMPOSIUM D3. ITC Publication Efforts: Nature, Purpose, and Contributions

Salon 1 SYMPOSIUM D4. The Changing Nature of Assessment in a Digital World

Salon 4SYMPOSIUM D5. Beyond the test scores: some exemplar uses of response process data in informing test taker’s performance and behavior

1:15

~

2:30

PM Ballroom

East/Centre Lunch

2:30

~ 4

:00

PM •

Bloc

k E

Oral

Pre

sent

atio

ns Salon 5 ORAL E1. Automated item generation and scoring

Hémon ORAL E2. Innovative modeling techniques

Salon 1 ORAL E3. Implications of large-scale assessments

Drummond East ORAL E4. Examining learner behaviour during tests

Sym

posi

ums

Salon 3SYMPOSIUM E1. Evidence from applied use of Game-Based Assessment. Class Quizzes, Virtual Reality, Faking, and Effect of Game Experience.

Salon 6 SYMPOSIUM E2. Psychometric Evaluations of Wechsler Scales: Cross-Cultural Contexts

MussetSYMPOSIUM E3. The Antecedents and consequences of personality: evidence from Cross-cultural Personality Assessment Inventory

Salon 2 SYMPOSIUM E4. Assessment for employee development: alternative approaches to validation

Pane

l

Salon 4 PANEL E. The International Declaration on Core Competences in Professional Psychology

Day 2 • Wednesday, July 4th, 2018 (cont.)Pr

esen

tati

on S

ched

ule

at a

Gla

nce

(con

t.)


Day 2 • Wednesday, July 4th, 2018 (cont.)

Room Title

4:00

~

4:30

PM Ballroom


4:30

~ 5

:30

PM

Keyn

ote

Sess

ion Drummond

Centre/West

KS6. Adaptive testing: examples, simulations, and examples of simulations David Magis, Research Associate of the Fonds de la Recherche Scientifique, University of Liège

Post

er D

ispl

ay (c

ont.)

Ballroom West

KS7. Visible Learning and Assessment John Hattie, Laureate Professor and Director of the Melbourne Education Research Institute, University of Melbourne

5:30

~ 7

:00

PM

Post

er s

essi

on

Ballroom East

Poster session 2 and networking 5:30 ~ 6:30 PM

Mee

ting

Ballroom West

ITC general meeting 5:30 ~ 7:00 PM

7:00

~

7:45

PM

Pause

7:45

~ 1

1:00

PM

Soci

al Conference “Jazz” Dinner Hyatt Regency Montreal 1255 Rue Jeanne-Mance • Montréal, QC H5B 1E5 • Phone: (514) 982-1234


Day 3 • Thursday, July 5th, 2018

Room Title7:

45 ~

8:

30 A

M Ballroom East/Centre Light breakfast

8:30

~ 1

0:00

AM

• Bl

ock

F Oral

Pre

sent

atio

ns

Salon 4 ORAL F1. The impact of culture on test validity

Salon 2 ORAL F2. Formative and diagnostic assessment

Salon 3 ORAL F3. Test design and validation

Salon 1 ORAL F4. The influence of engagement in the task on the validity of educational and psychological testing

Salon 6 ORAL F5. Validation: examining the internal structure of measurement instruments

Sym

posi

ums Salon 5 SYMPOSIUM F1. Timing and Process data for improving the

quality of large-scale assessment (PISA, PIAAC, NAEP)

Drummond East SYMPOSIUM F2. Innovations in computer-based assessment

Musset SYMPOSIUM F3. Using Personality Type to Improve Individual Wellness

Roun

d-ta

ble

Hémon ROUND-TABLE F. Language testing: Impact of technology and placement issues

10:0

0 ~

10:1

5 PM

Pause

10:1

5 ~

11:1

50 A

M

Keyn

ote

Sess

ion Drummond

Centre/West

KS8. Increased heterogeneity in international assessments and associated measurement challenges Leslie Rutowski, Professor of Educational Measurement, University of Oslo

Ballroom West

KS9. 21st-Century Validation Procedures for 21st-Century Tests Stephen Sireci, Professor in the Psychometrics Program and Director of the Center for Educational Assessment, University of Massachusetts Amherst

11:1

5 ~

11:4

5 AM Ballroom


Pres

enta

tion

Sch

edul

e at

a G

lanc

e (c

ont.)


Day 3 • Thursday, July 5th, 2018 (cont.)

Room Title

11:4

5 AM

~ 1

:15

PM •

Bloc

k G

Oral

Pre

sent

atio

ns

Salon 2 ORAL G1. Measurement issues in educational assessment

Salon 3 ORAL G2. Validation of large-scale assessments

Musset ORAL G3. Innovations in assessment design

Salon 6 ORAL G4. How assessment design and administration influences learning and the validity of assessment

Drummond East ORAL G5. Testing in the workplace

Pane

l

Salon 1 PANEL G. New Trends in Measurement: The Examination of “Big Data”

Sym

posi

ums

Hémon SYMPOSIUM G1. Assessing 21st Century Skills: Methods, Research, and Applications

Salon 5 SYMPOSIUM G2. International Perspectives in Higher Education Admissions

Salon 4 SYMPOSIUM G3. Applications of Automated Test Assembly as part of Evidence Centered Design

1:15

~

2:30

PM Ballroom

East/Centre Lunch

2:30

~ 3

:30

PM

Keyn

ote

Sess

ion Ballroom

West

KS10. Challenges of psychological testing in the multicultural South African context Déon de Bruin, Professor of Industrial Psychology, University of Johannesburg


KS11. Examining the Potential and Uses Cognitive Diagnostic Assessment in Test Development and Validation Maryam Wagner, Assistant Professor in the Department of Medi-cine, McGill University

3:30

~

3:45

PM

Pause

3:45

~ 5

:00

PM

Soci

al Ballroom West Closing ceremony


Not

es

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�


Ven

ue F

loor

plan

Sheraton Montréal Hôtel


1201, boulevard René-Lévesque Ouest Montréal (Québec) H3B 2L7

Group desk : 514-878-4040 Group fax : 514-878-2305 sheraton.com/lecentre


Not

es

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

�

We are the world’s learning company, on a mission to help people make progress in their lives through learning. Having delivered over 100 million online assessments, learning outcomes are at the heart of everything we do. Our world-class assessment solutions are designed to develop new, personalized ways of learning. Because where learning flourishes, so do people.

For every learner, at every stage

Illustration by Lucy Vigrasswww.pearson.com

Get Whova for11th International Test Commission

Conference - Montréal 2018

Get Whova from the App Store or

Google Play.

Please sign up for the app with

your social media account or

email

Download Whova and take

your event mobile.

The event invitation code is:

ITC2018Montreal

You will be asked for an event invitation code after

installing Whova

Official Event App

Explore the professional profiles of event speakers and attendees

Send in-app messages and exchange contact info

Network and find attendees with common affiliations, educations,

shared networks, and social profiles

Receive update notifications from organizers

Access the event agenda, GPS guidance, maps, and parking directions

at your fingertips

SponsorsDiamond Sponsors

Platinum Sponsors

Gold Sponsors

Silver Sponsors

Phot

o: T

ouris

me M

ontré

al

griÉmÉtic – groupe de recherche interuniversitaire sur l...

Documents