abstract - research.ed.ac.uk€¦ · web viewtitle page. e. motion recognition training in autism...

44
Title page Emotion recognition training in Autism Spectrum Disorder: a systematic review of challenges related to generalizability Steve Berggren 1,2 , Sue Fletcher-Watson 3, Nina Milenkovic 1 , Peter B Marschik 1,4 Sven Bölte 1,2 and Ulf Jonsson 1,2,5 1 Center of Neurodevelopmental Disorders (KIND), Pediatric Neuropsychiatry Unit, Department of Women’s and Children’s Health, Karolinska Institutet, Stockholm, Sweden; 2 Child and Adolescent Psychiatry, Child and Adolescent Psychiatry, Center of Psychiatry Research, Stockholm County Council, Sweden; 3 Moray House School of Education, University of Edinburgh, Edinburgh, UK.; 4 Institute of Physiology, Research Unit iDN (interdisciplinary Developmental Neuroscience), Medical University of Graz, Austria; 5 Department of Neuroscience, Child and Adolescent Psychiatry, Uppsala University, Sweden. Conflict-of-interest notification All authors declare: no support from any organization for the submitted work; no financial relationships with any organizations that might have an interest in the submitted work in the previous three years; no other relationships, activities or financial interests that could appear to have influenced the submitted work. Sven Bölte has authored the Frankfurt Test and Training of Facial Affect Recognition (FEFA) mentioned in this review. The FEFA is distributed by the Center of Neurodevelopmental Disorders at Karolinska Institutet (KIND),

Upload: dodat

Post on 29-Jul-2018

217 views

Category:

Documents


0 download

TRANSCRIPT

Title page

Emotion recognition training in Autism Spectrum Disorder: a systematic review of

challenges related to generalizability

Steve Berggren1,2, Sue Fletcher-Watson3, Nina Milenkovic1, Peter B Marschik1,4 Sven Bölte1,2 and Ulf

Jonsson1,2,5

1Center of Neurodevelopmental Disorders (KIND), Pediatric Neuropsychiatry Unit, Department of

Women’s and Children’s Health, Karolinska Institutet, Stockholm, Sweden;2Child and Adolescent

Psychiatry, Child and Adolescent Psychiatry, Center of Psychiatry Research, Stockholm County Council,

Sweden; 3Moray House School of Education, University of Edinburgh, Edinburgh, UK.; 4Institute of

Physiology, Research Unit iDN (interdisciplinary Developmental Neuroscience), Medical University of

Graz, Austria; 5Department of Neuroscience, Child and Adolescent Psychiatry, Uppsala University,

Sweden.

Conflict-of-interest notification

All authors declare: no support from any organization for the submitted work; no financial relationships

with any organizations that might have an interest in the submitted work in the previous three years; no

other relationships, activities or financial interests that could appear to have influenced the submitted

work. Sven Bölte has authored the Frankfurt Test and Training of Facial Affect Recognition (FEFA)

mentioned in this review. The FEFA is distributed by the Center of Neurodevelopmental Disorders at

Karolinska Institutet (KIND), headed by Sven Bölte, against compensation, which is used for

maintenance and support of the instrument.

Corresponding Author:

Steve Berggren, Center of Neurodevelopmental Disorders at Karolinska Institutet (KIND), CAP Research

Center, Gävlegatan 22, 11330 Stockholm, Sweden; E-mail: [email protected]

Emotion recognition training in Autism Spectrum Disorder: a systematic review of

challenges related to generalizability

Abstract

Objective: To assess the generalizability of findings from randomized controlled trials (RCTs) evaluating

emotion recognition (ER) training for children and adolescents with Autism Spectrum Disorder (ASD).

Methods: We present a systematic review and narrative synthesis of the determinants of external validity

in RCTs on ER training. Generalizability of the findings across situations, populations, settings, treatment

delivery, and intervention formats was considered.

Results: We identified 13 eligible studies. Participants were predominantly boys with ASD in the

normative IQ range (IQ>70), with an age span from 4 to 18 years across studies. Interventions and

outcome measures were highly variable. Several studies indicated that training may improve ER, but it is

still largely unknown to what extent training effects are translated to daily social life.

Conclusion: The generalizability of findings from currently available RCTs remains unclear. This

underscores the importance of involving children with ASD and their caregivers in informed treatment

decisions.

Key words

Neurodevelopmental disorders, autism, emotion, training, technology, intervention, Asperger syndrome,

child psychiatry

Introduction

Autism Spectrum Disorder (ASD) is a neurodevelopmental condition with a heterogeneous phenotypical

presentation. ASD is defined by impairments in social communication and interaction alongside repetitive,

stereotypic activities and interests, as well sensory processing alterations [1]. Current international,

epidemiological research suggests that between 1 and 2% of the general population present with ASD

[2,3]. Psychiatric and somatic comorbidity is common in ASD, with intellectual disabilities, ADHD and

epilepsy being amongst the most frequent co-existing complications [4]. There are a number of therapeutic

approaches which aim to alleviate the challenges experienced by individuals with ASD and improve

outcomes [5].

Emotion recognition (ER) plays an important role in social communication. The ability to attend to socio-

emotional cues (e.g., facial expressions, tone of voice, and body language), interpret them correctly and

respond to them appropriately is vital for successful everyday social interaction. This ability, in turn,

depends on social orientation/attention, mentalizing/theory of mind (ToM, the ability to understand one’s

own and other’s thoughts, beliefs, and internal states) [6], empathy, and social awareness. Difficulties in

ER are related to various mental disorders, but are particularly prominent in ASD [6,7]. Varying degrees

of ER alterations have been demonstrated along the spectrum, although some problems might appear mild

or insignificant owing to compensatory strategies [8,9]. Difficulties include recognition of emotions from

facial expressions [10,11], vocal intonation patterns [12], gestures and body language [13], and the

integration of multimodal emotional information in context [14,15]. Attentional distractibility has been

reported to be associated with facial affect recognition [16]. ER difficulties among children with ASD

might decrease with age, but remain present to a certain extent [17]. Alterations of ER in ASD are a well-

recognized clinical difficulty and can be a significant risk factor for social exclusion, peer rejection,

bullying or isolation [18]. Deficits in ER may also contribute to adverse long-term outcomes such as low

occupational attainment, poor social relationships, and psychiatric comorbidity [19].

Training of ER skills towards the typical range on a behavioral and neurobiological level is a viable

intervention strategy [20]. A wide range of different interventions has been developed, aiming to improve

these abilities in people with ASD. Most, but not all, of the currently available ER training programs are

computer-based. Computerized environments are assumed to provide a favorable setting for users with

ASD, as they can be programmed to be predictable, consistent, and free from immediate social stressors.

Users can work at their own pace and level of understanding and lessons can be repeated over and over

again, until mastery is achieved. Interest and motivation are usually more easily maintained by

individually selected computerized rewards [21]. Computer-based ER training programs tend to be rather

specific (e.g., focusing only on recognition of facial expressions of photographs), and low budget [22].

Among the ER training programs that are used in current clinical practice are The Frankfurt Test and

Training of Facial Affect Recognition, FEFA (training of emotion recognition from photographs of facial

expressions and strips of the eye region) [23], the Emotion Trainer (teaches emotion recognition of

emotions from facial expressions) [24], Let’s Face It! (teaches emotion and identity recognition from

facial expressions) [25], and Mind Reading (an interactive guide to emotions that teaches recognition of

emotions and mental states) [11,22].

Attempts to train emotion processing, predominantly facial affect recognition [23, 26], have yielded mixed

results. A systematic review by Fletcher-Watson et al. [27] on ER and ToM programs evaluated the

effects of 22 randomized controlled trials (RCTs) including a total of 695 participants. Studies were highly

variable in sample size, age-range of participants, intervention delivery type, outcome measures, and

country of origin. A meta-analysis of a subset of four studies showed that interventions targeting ER

across age groups and within the average range of intellectual ability had a positive effect on the target

skill, measured by a test using photographs of faces (mean increase of 0.75 points, 95% confidence

interval (CI) 0.22 to 1.29 points, N = 105). These preliminary results are promising and indicate that

individuals with ASD could benefit from increased access to ER training. However, the authors note that

there was little evidence of generalization of training beyond the taught skill, or to real world settings.

We are currently at a point in time where scientific support for ER training is emerging and programs

gradually become available in routine clinical practice. However, successful implementation and judicious

use of the interventions requires reliable judgments about generalizability across different populations,

training programs, and settings. It is also of great importance to clarify to what extent the training effects

are translated into social skills in real-life situations, which presumably is the main objective for the

person undertaking the training. Generalizability is a major challenge when designing and using training

tools for individuals with ASD in general. In a recent review of cognitive training technologies in the

treatment of ASD, Wass and Porayska-Pomsta [28] reported several promising findings. However, they

concluded that observed improvements within the computerized training paradigm often fail to generalize

to altered behavior in more naturalistic settings, why the external validity of the accumulated research is

challenged.

While internal validity (i.e., the results are valid for the specific study population and setting) often has

high priority in primary research and systematic reviews [29], external validity (i.e., generalization across

populations and situations) is often neglected [30]. External validity is usually sensitive to factors such as

the setting of the study, selection of participants, characteristics of included participants, differences

between the protocol and routine practice, choice of outcome measures, follow-up timing, providers’

characteristics and training, treatment fidelity, number of participants, and trainer ratio. An overview of

these aspects could both inform clinical practice and help to identify future directions in this research

field.

The current review examined aspects related to the generalizability of RCTs on ER training in children

and adolescents with ASD. Close examination of these aspects was not within the scope of the recent

systematic review by Fletcher-Watson et al. [27]. We decided to focus exclusively on RCTs for two

reasons. First, the high demands on internal validity in RCTs can lead to less focus on external validity.

Second, results from RCTs are frequently generalized across populations and contexts even when the

external validity is limited. Our overarching aim was to draw clinical and scientific attention to the

importance of external validity in RCTs, at a time when several ER training programs already have been

evaluated in controlled efficacy studies. We did so in two ways:

1. We used a check-list [31] to fine-map determinants of external validity (treatment intervention,

treatment provider, population, context, and outcome) in available RCTs.

2. We investigated to what extent the study results indicated that improved ER generalized to daily social

skills.

Methods

Eligibility criteria

Types of study: RCTs published in English.

Participants: Children and adolescents up to 18 years of age with a diagnosis of ASD, including autism,

atypical autism, Asperger’s syndrome (AS), and pervasive developmental disorder not otherwise specified

(PDD-NOS), according to either International Classification of Diseases, tenth edition (ICD-10) [37],

Diagnostic and Statistical Manual of Mental Disorders, fourth (DSM-IV) [38] or fifth edition (DSM-5)

criteria [1].

Interventions: Any intervention or part of a broader intervention approach for which the authors explicitly

state at least one of the following: The study (1) was designed to teach emotion recognition, exclusively or

in combination with other skills; (2) was designed to teach precursor skills of emotion recognition; (3) was

based on common emotion recognition theories of autism; (4) aimed to test common emotion recognition

theories of autism.

Comparator: Any of the following comparators: (1) Treatment-as-usual/wait-list control; (2) ‘placebo’

interventions, for example a ‘contact control’ such as watching Thomas the Tank Engine DVDs; (3)

intervention with no therapeutic content, (e.g. group leisure activities); (4) any active treatment.

Outcome: Any behavioral outcome related to ER or social skills.

Information sources

Cochrane (Wiley); Medline (Ovid); Embase (Elsevier); Cinahl (Ebsco); Psychinfo (Ovid); Social Services

Abstracts (Proquest); ERIC (Ovid) were searched up to November 2015.

Search strategy

Electronic searches were conducted using Medical Subject Headings (MeSH) and relevant text word

terms. The search strategy used by Fletcher-Watson and colleagues [27] in their Cochrane review of

interventions based on ToM cognitive model for ASD was repeated. However, in order to limit the search

to the ER interventions the search was combined with a filter for emotion expression/recognition (see

Appendix 1 for the full search strategy in Medline).

Study selection

Two authors independently screened titles and abstracts of all the citations identified by the search

strategy. Potentially relevant articles were screened for eligibility in full text. Any disagreements were

resolved by discussions. Reference lists and systematic reviews were screened for additional relevant

studies.

Data collection process

From each included study data were extracted and inserted in an extraction sheet by two authors. Any

disagreements were resolved by discussion. If no agreement could be reached, it was planned a third

author would decide in case of a disagreement. The third author arbitration was never required.

Data items

1. A checklist of items relevant to external validity was used, compiled by a recent review of social skills

group interventions for children and adolescents with ASD [31]. Included items were clustered into

overarching themes related to external validity: treatment intervention, treatment provider, population,

context, and outcome. All items from this extensive checklist were extracted, and the items most relevant

for this specific review were included in Table 1 and 2.

2. In order to investigate the extent to which the study results indicated that the training generalized to

daily social skills, mean and standard deviation for each group at post-treatment were extracted on

outcome measures related to ER and social skills.

Planned methods of analysis

Two types of analyses were performed:

1. The extracted information on determinants of external validity was summarized in a narrative synthesis

for each separate theme. For each theme, we also briefly summarize our judgement about generalizability.

2. To evaluate how the ER training generalized to daily social skills, we examined for each separate study

to what extent improvements in ER was accompanied by an improvement in social skills. We looked at

interventions specifically targeting ER separate from interventions combining ER training and social skills

training. Thereby, it would be possible to examine if specific ER training resulted in improved social

skills, or if additional social skills training was required for this. For each separate study, the standardized

mean difference (Hedge’s g) and 95% confidence interval were calculated for all measures of ER and

social skills. The mean and standard deviation for each group at post-treatment (and at follow-up when

available) was used for these analyses, which were conducted with Review Manager (RevMan) Version

5.3.4.

Results

Study selection

The search provided 3521 unique citations. Of these, 3493 were discarded because they did not meet the

eligibility criteria. The large number of excluded citations does not reflect strict eligibility criteria, but

rather that we used an over-inclusive search strategy in order not to miss relevant studies. The remaining

28 articles were examined in full-text. A total of 13 studies presented in 14 publications were found to be

eligible [15,24,25,34-44] (see Figure 1). The 14 remaining were excluded, as they did not meet our

eligibility criteria for population (n=8), intervention (n=2), design (n=1) or publication type (n=3)

(Appendix 2).

Figure 1 about here

Treatment intervention

Narrative synthesis: The evaluated interventions were variable regarding treatment components and

format (Table 1). Four of the 13 eligible studies evaluated programs combining ER training with other

treatment components. Two of these studies [38,42] evaluated a comprehensive summer program, which

included a face-emotion recognition curriculum as an integral part of a 5-week social treatment program;

one study evaluated a computerized multi-component social skills intervention program, The Junior

Detective Computer Program, designed for children with AS [34]; and one study evaluated the Social

Adjustment Enhancement Curriculum, a group intervention targeting ER, ToM, executive functions, and

conversational skills [41].

The remaining nine studies evaluated programs primarily targeting ER. Two studies evaluated the “The

Transporters”, an animated three-dimensional series designed to enhance emotion comprehension in

children with ASD [15,44]. Two studies tested “FaceSayTM”, a computer-based social skills training

program with various games designed to teach specific face-processing skills for social cognition [37,39].

One study tested “Mind Reading (MR)”, an interactive software program designed to teach recognition of

simple and complex emotions [43]. “Emotion Trainer”, another computer program designed to help

people with autism learn to recognize and predict emotions in others, was tested in one study [24]. "Let's

Face It!”, an intervention comprised of seven interactive computer games, was evaluated in one study

[25]. Finally, two therapist-led interventions were evaluated: an ER training intervention consisting of four

sessions [40], and an intervention designed to teach emotion understanding [35,36].

The duration of the interventions varied from 8 days [35,36] to 20 weeks [41]. Four studies had fewer than

10 sessions [34-36,40], two studies used a high intensity training with daily treatment cycles 5 days a

week for several weeks [38,42], while the frequency of the intervention in the remaining studies ranged

from 10 [39] to 24 sessions [43]. Length of each session (intervention intensity) ranged from 10-25

minutes [37] to 2 hours per session [34]. None of the reports included information about costs associated

with the treatment.

Most studies used waitlist controls or no intervention as comparator. However, the two “FaceSayTM”

studies [37,39] and one of the studies testing “The Transporters” [44] used comparators designed to be

similar to the intervention but without the active components. One study used teaching of belief

understanding and play as comparators [36] (see Table 1 for more detailed information about the

interventions and the comparators in each included study).

Generalizability: Most interventions are well described, and several are standardized, favoring

implementation. The heterogeneity of the interventions regarding format, duration, and components

suggests that various interventions are feasible, but also make generalization of effects across

interventions uncertain. Each intervention had been tested in only one or a few RCTs. Thus, conclusions

about which specific intervention might be best suited for a specific individual or group of individuals are

not possible at this time.

Table 1 about here

Treatment provider

Information about the trainers was generally limited. The qualifications of the trainers included post-

graduate, graduate, or undergraduate students delivering the intervention, while some studies also used

clinical psychologists, psychiatrists, social workers, pediatricians and speech and language pathologists.

The experience of the trainers varied across studies. In total, five studies reported that providers received

specific training in delivering the intervention [38,39,42-44], while others did not provide such

information. Four studies reported that the trainers were supervised [39,41-43]. Treatment fidelity was

controlled in 10 studies [15,25,34,38-44].

Generalizability: The interventions were delivered by multiple professions with varying clinical

experience. It is likely that the trainer’s qualifications play a subordinate role in more standardized

training programs.

Populations

Narrative synthesis: An ASD diagnosis (AS, autism, or PDD-NOS) was a criterion for eligibility in all

included studies (Table 2). In most studies, the diagnosis was confirmed by standardized diagnostic tools

or rating scales, such as the Autism Diagnostic Observation Schedule (ADOS-2) [45], Autism Diagnostic

Interview–Revised (ADI-R) [46], and Social Responsiveness Scale (SRS) [47,48]. Although the studies

mainly included participants with ASD without intellectual disability, one study included separate

analyses of a subsample with autism and low IQ [37]. None of the studies included information about

psychiatric comorbidity among the included participants.

A minimum IQ or verbal IQ level (IQ > 70 or IQ > 85 respectively on the Wechsler Intelligence Scale for

Children) was an additional criterion for inclusion in six studies [24,34,38,41-43]. In two studies, also a

minimum score on the Comprehensive Assessment of Spoken Language was required for inclusion

[38,42]. In some studies, additional exclusion criteria were listed, such as vision problems [25], good

performance on emotion recognition tasks [40], and serious conduct problems [41].

The sample sizes were small to moderately large, ranging from 18 to 79 individuals. All studies except

two [37,42] provided some information about recruitment procedures. Three studies used public

announcements [34,38,43] whereas the remaining nine studies recruited from academic centers, clinics,

local or special schools and local organizations. Of the 13 studies, seven reported the number of screened

and randomized participants, as well as the number of participants who completed the study [24,37-

40,42,43], while some of this information was omitted in the remaining studies. No information about the

participants’ expectations and preferences was included in any of the studies.

Ten studies included children ranging from 4 to 13 years of age across studies. Two studies focused on

both children and adolescents up to 15 years of age [37,40], and one study focused mainly on adolescents

[24]. Eleven reports provided information about male/female ratio, one of which [41] reported an all-male

sample. Only a minority of females was included in the studies (0 to 23%), and no study presented gender-

specific results. Two studies [24,44] didn’t provide any information about gender ratio (see Table 2 for

detailed information about key variables related to the populations).

Generalizability: Females and individuals outside the typical IQ range (IQ < 70) were poorly represented

in the study populations, and information on comorbidity was missing in the reports. Future studies will

require large, well-characterized, and heterogeneous samples in order to determine potentially moderating

effects of characteristics such as gender, age, comorbidity, symptom severity, and IQ.

Table 2 about here

Context of included studies

Narrative synthesis: Seven studies were conducted in the United States [25,37-39,41-43], three in the UK

[15,24, 35, 36], two in Australia [34,44], and one in Ireland [40] (Table 2). Type of setting was described

briefly in the majority of studies: five studies were conducted at universities [34,38,41-43], three in

schools or after-school facilities [24,37,39], and three reported that the intervention took place in the

participant’s homes [15,25,44]. Three reports did not provide explicit information about setting

[35,36,40].

Incentives for participation were reported in six studies [15,25,48,42-44]. These included monetary

compensation for parents, reinforcers, points that led to rewards, or free copies of intervention DVDs for

children.

Generalizability: The included studies were conducted in a limited number of geographical and cultural

regions. The studies were not conducted in real-world clinical settings. It is possible, however, that

standardized training of basic skills such as ER is less sensitive to cultural differences and specific setting,

compared to more complex psychological interventions.

Outcome

Narrative synthesis: The effects were measured post-treatment, with the exception of two studies that also

included follow-up assessments after 5 weeks [43] and 6 months [35,36], respectively. Measures designed

to capture ER skills and changes in those skills were included in all studies. These measures generally

assessed the ability to recognize emotions from facial expression, voices or postures. Social skills were

measured in seven of the included studies. While questionnaires such as the SRS [47,48] were used in

most studies, also observations of social interaction were included in three studies [37,39,44] (Table 3).

Nine studies evaluated interventions specifically targeting ER (Table 3). These studies used a variety of

outcome measures intended to measure ER, including the affect recognition subtest of the NEPSY-II [49],

the Face Task [50], and photographs from Ekman’s Pictures of Facial Affect [51]. All nine studies

indicated a significant improvement on at least one ER measure, compared to the control group. The effect

sizes were generally large (see Table 3). Four of these studies also included measures of social skills

[47,39,43,44], enabeling examination of the extent to which improvement in ER was accompanied by

improvement in social skills. Three of the studies did not find a significant effect on social skills as

measured with parent ratings or observations [39,43,44]. The fourth study, which evaluated the program

“FaceSayTM”, reported the results separately for participants with low- and high-functioning ASD [37]. A

significant improvement as measured with Social Skills Rating System (SSRS) [52] was reported for the

low IQ<70 group, while blinded observations indicated improved social skills for the average to IQ>70

group. However, it should be noted that there was a substantial pre-treatment difference between the

intervention group and the control group on two of the outcome measures for the participants with high

functioning autism, indicating risk of bias.

The four remaining studies evaluated programs combining ER training with social skills training (Table

3). Three of these studies [38,41,42] measured the effects on ER with the Diagnostic Analysis of

Nonverbal Accuracy 2 (DANVA2) [53], which is designed to assess the ability to identify simple

emotions in faces displayed on a computer. The fourth study [34] used an outcome measure designed to

assess perception of emotions from photos of facial expressions [54] and postures [55]. The standardized

mean differences post-treatment did not indicate a significant effect on ER in any of these studies,

although a separate publication [56] with pooled analyses with data from two of these studies, both of

which evaluated a comprehensive summer program [38,42], suggested that the treatment group had better

encoding accuracy post treatment on one of the tested emotion. Three of the studies also included

measures of social skills. All suggesting a significant effect favouring the intervention, measured with the

Behavior Assessment System for Children, Second Edition (BASC-2) [57] in two studies and the Social

Skills Questionnaire (SSQ) [58] and Emotion Regulation and Social Skills Questionnaire (ERSSQ) [34] in

one study. (See Table 3 for detailed information about the outcome measures and effects.)

Generalizability: The lack of long-term follow-up assessments and sparse use of observations in real-life

situations limits the external validity of the findings. For interventions specifically targeting ER, there

were few indications that the training effects were generalized to daily social interaction. For

interventions combining ER training and social skills training, on the other hand, the results indicated

improvement in social skills. Although the available studies do not permit firm conclusions, these results

might indicate that combining ER training with applied training of skills is required for generalization of

the training effects.

Table 3 about here

Discussion

This review focused on the determinants of external validity in RCTs on ER training in ASD. A variety of

interventions – spanning from brief computerized ER training to comprehensive programs with multiple

components – have been developed and evaluated in RCTs. Each specific ER intervention has so far only

been evaluated in small to moderately large efficacy studies. Most of these studies suggest beneficial

effects. While these studies are important first steps, judgements about generalizability of findings from

these initial RCTs are compromised by samples with restricted coverage of the source population.

Insufficient information about the participants’ characteristics (e.g., psychiatric comorbidity) further

complicates such judgements. Moreover, it is unclear to what extent training effects are transferred to real-

life social interaction. The latter stands out as particularly important, given that people with ASD often

experience difficulty in generalizing across situations.

Meaningful change in the client’s daily life is arguably an essential goal for skills training in general.

When the training is remote from daily activities it seems particularly important to confirm that such a

change is accomplished. The overall pattern of results of the ER studies does not suggest a clear link

between increased ER and improved social skills. In fact, most studies evaluating specific training

programs for ER do not report significantly improved social skills, despite improvement in ER itself. The

only exception was a study evaluating the computerized program “FaceSayTM” [37], in which blinded

post-intervention observations indicated improved social interaction in children with ASD in the typical

IQ range. More rigorous studies with larger samples and longer follow-up time are needed before firm

conclusions can be drawn.

Limited or unknown generalizability of study results is far from unique for ER training. For instance, a

recent review suggests that the accumulated research on social skills group training in children with ASD

suffer from similar shortcomings [31]. Poor external validity is also evident for research on child mental

health treatments in general. A comparison of the characteristics of the participants in 437 RCTs on

evidence-based child mental health treatments and the characteristics of a sample of 1781 youths in the

mental health system suggest that the study participants did not represent the large majority of the clinical

sample, based on attempts to match for type of mental health difficulty, gender, age, ethnicity, and setting

[59]. This might not be surprising, giving the large variety of clinical characteristics and developmental

stages represented in this age group. Consequently, handling uncertainty related to heterogeneity within

the client groups is a major challenge for child and adolescent mental health care.

Clinical implications

There is a great demand for effective interventions for children with ASD, and given the heterogeneity of

ASD it is unlikely that one single format meets the needs and preferences of all children with ASD [60].

The clear structure and presumed (since data are rarely reported) low economic cost of many ER training

programs makes them suitable for implementation. As in the case of internet-delivered cognitive

behavioural therapy [61], the structure of ER training programs favours adherence to the protocol and

makes dissemination more straightforward. This is a major advantage compared to many other

psychological interventions that are often suboptimally delivered in clinical practice due to deviations

from the treatment manual [62]. Nevertheless, the threats to external validity observed here make clinical

decisions challenging. The relatively large number of other interventions that exist for children and

adolescents with ASD, with varying levels of evidence [63], adds further complexity to treatment

decisions. This should not be interpreted as an argument for withholding treatment or allowing all kinds of

treatment regardless of scientific evidence [64]. Rather, it is advised to maximize the involvement of

young patients and their caregivers in treatment decisions in order to facilitate informed choice. Shared

decision making (SDM) could be a viable approach for this purpose, in which the clinician and client

make decisions together using the best available evidence [65]. According to this approach, children and

adolescents with ASD and their parents would be encouraged to communicate their preferences and

expectations, and thereby increase their autonomy and engagement. The level of involvement is flexible

and depends on the client’s preferences. Emerging data indicates that SDM in the treatment of children

with ASD is associated with higher parent satisfaction and improved guidance regarding treatments [66],

although more research is needed to clarify the potential benefits of the approach. It should also be noted

that substantial barriers to SDM have been reported for children with ASD [67] and a particularly low

SMD receipt has been found for this group [68]. Thus, there seems to be plenty of room for improvement

in how treatment decisions are reached.

Future directions

The feasibility and efficacy of various interventions in this domain have now been tested in several initial

studies. It might be time to move on to larger effectiveness studies of both high internal and external

validity, and to comparisons of different ER training systems. In order to inform clinical practice, robust

randomized studies with clinical samples and moderator analyses are needed. In addition, it would be

worthwhile to explore how the interventions can be tailored and optimized for specific sub-groups. For

this purpose, systematically replicated single-subject studies [69] on individuals with varying clinical

(e.g., symptom severity, comorbidity, and IQ) and sociodemographic characteristics (e.g., gender and age)

could be an important complement to randomized studies.

Another major issue that remains to be settled is to what extent treatment gains may be generalized to real-

life situations. For this purpose, development of sensitive and psychometrically sound measures of the

quality of social interaction and its response to training are needed. We suggest that experience sampling

methodology (ESM) might be valuable as a complement to blinded observations. ESM requires that

the participants report their experiences at random points throughout the day,

which is likely to result in higher ecological validity than standardized interviews or questionnaires

that often seek to determine behavior over a longer period (weeks or months). The feasibility of ESM has

recently been demonstrated in children with ASD [70], and it has been reported to be helpful in

identifying the nature and quality of social experiences in this population [71]. However, it is important to

note that this methodology sometimes could require some level of assistance, and may not be a viable

option for all children and adolescents with ASD. Again, single-subject designs could be a valuable

method to explore both how measurement should be adapted to different subgroups and how training

effects are generalized to daily social skills.

We would also like to emphasize the usefulness of systematically collected data from clinical settings.

Large and representative clinical samples of the heterogeneous group of children and adolescents with

ASD have the potential to reveal predictors of treatment response, which in turn eventually can lead to a

better decision basis. This type of data can also be used to catch important signals indicating occurrences

of untoward events during treatment. Available studies give hardly any information about adverse events

or harms, which is a general shortcoming of studies of psychological treatment [72].

Limitations

Some limitations should be noted. First, the present review was restricted to RCTs. It is likely that also

other study designs can give valuable insight into how specific subgroups will respond to the treatment

[73,74]. Single-subject designs in particular have traditionally played an important role in autism research.

ER has, to the best of our knowledge, only been evaluated in a small number of non-randomized studies.

A few single-subject studies have been published [75-77], but must be replicated systematically in order to

contribute to our understanding of generalizability.

Second, our aim was to assess generalizability from the information available from the published reports.

Consequently, we did not contact the authors for missing information, nor did we review all possibly

available literature and information outside of scientific journals. We also did not investigate a number of

factors necessary for successful implementation, including availability and costs of the evaluated

programs, educational material, and training courses.

Finally, we focused exclusively on external validity. While assessment of risk of bias in the individual

studies was outside the scope of this review, we noted that only few studies used blinded assessments of

relevant outcomes. In addition, there was a substantial difference in key variables between the intervention

group and control group pre-treatment in several studies. The latter is presumably an unfortunate

consequence of small samples randomized, further underscoring the need for larger and more rigorous

studies. Proper assessment of risk of bias can be found in a recent systematic review by Fletcher-Watson

and colleagues [27]. Although several of the studies included in the present review were published after

the search for the review by Fletcher-Watson et al. was conducted, we did not find evidence that

methodological quality has improved dramatically in the interim.

Conclusion

Despite an increasing number of promising treatment studies on ER training, the clinical generalizability

is still largely unknown. In clinical practice, this uncertainty should be taken into consideration by

involving children and adolescent with ASD and their caregivers in SDM and carefully monitoring their

progress. High priorities for future research are to increase the knowledge about how improved ER

influences everyday social interaction, and to investigate for which subsets of individuals with ASD this

intervention might be beneficial or less beneficial/ineffective, respectively.

References

1. American Psychiatric Association. Diagnostic and statistical manual of mental disorders, ed 5th.

Arlington, VA, American Psychiatric Association, 2013.

2. Baron-Cohen S, Scott FJ, Allison C, Williams J, Bolton P, Matthews FE, Brayne C. Prevalence of

autism-spectrum conditions: UK school-based population study. British Journal of Psychiatry

2009;194:500-509.

3. Kim YS, Leventhal BL, Koh YJ, Fombonne E, Laska E, Lim EC, Cheon KA, Kim SJ, Kim YK, Lee H,

Song DH, Grinker RR. Prevalence of Autism Spectrum Disorders in a total population sample.

American Journal of Psychiatry 2011;168:904-912.

4. Ronald A, Simonoff E, Kuntsi J, Asherson P, Plomin R. Evidence for overlapping genetic influences on

autistic and ADHD behaviours in a community twin sample. Journal of Child Psychology and

Psychiatry 2008;49:535-542.

5. Bölte S. Is autism curable? Developmental Medicine & Child Neurology 2014;56:927-931.

6.Baron-Cohen S. Mindblindness: An essay on autism and theory of mind. Boston, MIT Press/Bradford

Books, 1995.

7. Bölte S, Feineis-Matthews S, Poustka F. Brief report: Emotional processing in high-functioning autism--

physiological reactivity and affective report. Journal of Autism and Developmental Disorders

2008;38:776-781.

8. Grossman JB, Klin A, Carter AS, Volkmar FR. Verbal bias in recognition of facial emotions in children

with Asperger’s syndrome. The Journal of Child Psychology and Psychiatry and Allied Disciplines

2000;41:369-379.

9. Teunisse J-P, de Gelder B. Impaired categorical perception of facial expressions in high-functioning

adolescents with autism. Child Neuropsychology 2001;7:1-14.

10. Harms MB, Martin A, Wallace GL. Facial emotion recognition in autism spectrum disorders: A review

of behavioral and neuroimaging studies. Neuropsychological Review 2010;20:290-322.

doi:10.1007/s11065-010-9138-6.

11. Itier RJ, Batty M. Neural bases of eye and gaze processing: the core of social cognition. Neuroscience

and Biobehavioural Reviews, 2009;33:843-863.

12. Golan O, Baron-Cohen S, Hill JJ, Rutherford MD. The 'reading the mind in the voice' test-revised: A

study of complex emotion recognition in adults with and without autism spectrum conditions.

Journal of Autism and Developmental Disorders 2007;37:1096-1106.

13. Philip RC, Whalley HC, Stanfield AC, Sprengelmeyer R, Santos IM, Young AW, Atkinson AP, Calder

AJ, Johnstone EC, Lawrie SM, Hall J. Deficits in facial, body movement and vocal emotional

processing in autism spectrum disorders. Psychological Medicine 2010;40:1919-1929.

14. Golan O, Baron-Cohen S, Golan Y. The 'reading the mind in films' task [child version]: Complex

emotion and mental state recognition in children with and without autism spectrum conditions.

Journal of Autism and Developmental Disorders 2008;38:1534-1541.

15. Golan O, Ashwin E, Granader Y, McClintock S, Day K, Leggett V, Baron-Cohen S. Enhancing emotion

recognition in children with autism spectrum conditions: An intervention using animated vehicles

with real emotional faces. Journal of Autism and Developmental Disorders 2010;40:269-279.

16. Berggren S, Engström A-C, Bölte S. Facial affect recognition in autism, ADHD and typical

development. Cognitive Neuropsychiatry 2016:1-15.

17. Kuusikko S, Haapsamo H, Jansson-Verkasalo E, Hurtig T, Mattila M-L, Ebeling H, Jussila K, Bölte S,

Moilanen I. Emotion recognition in children and adolescents with autism spectrum disorders.

Journal of Autism and Developmental Disorders 2009;39:938-945.

18. Hill EL, Frith U. Understanding autism: Insights from mind and brain. Philosophical Transactions of the

Royal Society of London Series B: Biological Sciences 2003;358:281-289.

19. Howlin P. Interventions and outcome in autism. Journal of Intellectual Disability Research

2004;48:283.

20. Bölte S, Ciaramidaro A, Schlitt S, Hainz D, Kliemann D, Beyer A, Poustka F, Freitag C, Walter H.

Training-induced plasticity of the social brain in autism spectrum disorder. British Journal of

Psychiatry 2015;207:149.

21. Moore D, McGrath P, Thorpe J. Computer-aided learning for people with autism - a framework for

research and development. Innovations in Education & Training International 2000;37:218-228.

22. Lacava PG, Golan O, Baron-Cohen S, Smith Myles B. Using assistive technology to teach emotion

recognition to students with Asperger syndrome: A pilot study. Remedial and Special Education

2007;28:174-181.

23. Bölte S, Hubl D, Feineis-Matthews S, Prvulovic D, Dierks T, Poustka F. Facial affect recognition

training in autism: Can we animate the fusiform gyrus? Behavioral Neuroscience 2006;120:211-216.

24. Silver M, Oakes P. Evaluation of a new computer intervention to teach people with Autism or

Asperger’s syndrome to recognize and predict emotions in others. Autism 2001;5:299-316.

25. Tanaka JW, Wolf JM, Klaiman C, Koenig K, Cockburn J, Herlihy L, Brown C, Stahl S, Kaiser MD,

Schultz RT. Using computerized games to teach face recognition skills to children with autism

spectrum disorder: The let's face it! Program. Journal of Child Psychology and Psychiatry

2010;51:944-952.

26. Bölte S. Computer-based intervention in autism spectrum disorders; in Ryaskin OT (ed) Focus on

autism research. New York, Nova Science, 2004, pp 247-260.

27. Fletcher-Watson S, McConnell F, Manola E, McConachie H. Interventions based on the theory of mind

cognitive model for autism spectrum disorder (asd). The Cochrane Database of Systematic Reviews

2014;3:CD008785.

28. Wass SV, Porayska-Pomsta K. The uses of cognitive training technologies in the treatment of autism

spectrum disorders. Autism 2014;18:851-871.

29. Higgins JPT, Green S, (editors). Cochrane handbook for systematic reviews of interventions, The

Cochrane Collaboration, 2011.

30. Rothwell PM. Factors that can affect the external validity of randomised controlled trials. PLoS Clinical

Trials 2006;1:e9.

31. Jonsson U, Choque Olsson N, Bölte S. Can findings from randomized controlled trials of social skills

training in autism spectrum disorder be generalized? The neglected dimension of external validity.

Autism 2016;20:295-305.

32. World Health Organization. ICD-10: International statistical classification of diseases and related health

problems, ed 10th. Geneva, 1992.

33. American Psychiatric Association. Diagnostic and statistical manual of mental disorders, ed 4th.

Washington, DC, 1994.

34. Beaumont R, Sofronoff K: A multi-component social skills intervention for children with Asperger’s

syndrome. The junior detective training program. Journal of Child Psychology and Psychiatry

2008;49:743-753.

35. Hadwin J, Baron-Cohen S, Howlin P, Hill K. Can we teach children with autism to understand

emotions, belief, or pretence? Developmental Psychopathology 1996;8:345-365.

36. Hadwin J, Baron-Cohen S, Howlin P, Hill K. Does teaching theory of mind have an effect on the ability

to develop conversation in children with autism? Journal of Autism and Developmental Disorders

1997;27:519-537.

37. Hopkins IM, Gower MW, Perez TA, Smith DS, Amthor FR, Wimsatt FC, Biasini FJ. Avatar assistant:

Improving social skills in students with an asd through a computer-based intervention. Journal of

Autism and Developmental Disorders 2011;41:1543-1555.

38. Lopata C, Thomeer ML, Volker MA, Toomey JA, Nida RE, Lee GK, Smerbeck AM, Rodgers JD. RCT

of a manualized social treatment for high-functioning autism spectrum disorders. Journal of Autism

and Developmental Disorders 2010;40:1297-1310.

39. Rice LM, Wall CA, Fogel A, Shic F. Computer-assisted face processing instruction improves emotion

recognition, mentalizing, and social skills in students with ASD. Journal of Autism and

Developmental Disorders 2015;45:2176-2186.

40. Ryan C, Charragain CN. Teaching emotion recognition skills to children with autism. Journal of Autism

and Developmental Disorders 2010;40:1505-1511.

41. Solomon M, Goodlin-Jones BL, Anders TF. A social adjustment enhancement intervention for high

functioning autism, Asperger’s syndrome, and pervasive developmental disorder NOS. Journal of

Autism and Developmental Disorders 2004;34:649-668.

42. Thomeer ML, Lopata C, Volker MA, Toomey JA, Lee GK, Smerbeck AM, Rodgers JD, McDonald CA,

Smith RA. Randomized clinical trial replication of a psychosocial treatment for children with high-

functioning autism spectrum disorders. Psychology in the Schools 2012;49:942–954.

43. Thomeer ML, Smith RA, Lopata C, Volker MA, Lipinski AM, Rodgers JD, McDonald CA, Lee GK.

Randomized controlled trial of mind reading and in vivo rehearsal for high-functioning children

with ASD. Journal of Autism and Developmental Disorders 2015;45:2115-2127.

44. Young RL, Posselt M. Using the transporters DVD as a learning tool for children with autism spectrum

disorders (ASD). Journal of Autism and Developmental Disorders 2012;42:984-991.

45. Jones RM, Lord C. Diagnosing autism in neurobiological research studies. Behavioural brain research

2013;251:113-124.

46. Rutter M, Le Couteur A, Lord C. Autism diagnostic interview-revised (ADI-R). Los Angeles, CA,

Western Psychological Services, 2003.

47. Constantino JN, Gruber CP. Social responsiveness scale. Los Angeles, CA, Western Psychological

Services, 2005.

48. Bölte S, Poustka F, Constantino JN. Assessing autistic traits: Cross‐cultural validation of the social

responsiveness scale (SRS). Autism Research 2008;1:354-363.

49. Korkman M, Kirk U, Kemp S. NEPSY-II. San Antonio, TX, Pearson, 2007.

50. Baron-Cohen S, Wheelwright S, Jolliffe aT. Is there a "language of the eyes"? Evidence from normal

adults, and adults with autism or Asperger’s syndrome. Visual Cognition 1997;4:311-331.

51. Ekman P, Friesen WV. Pictures of facial affect. Palo Alto, CA, Consulting Psychologist Press, 1976.

52. Gresham FM, Elliot SN. Social skills rating system manual. Circle Pines, MN, American Guidance

Service, 1990.

53. Nowicki S. Instructional manual for the receptive tests of the diagnostic analysis of nonverbal accuracy

2. Atlanta, GA, Peachtree, 1997.

54. Spence SH. Assessment of perception of emotion from facial expression. In social skills

training:Enhancing social competence with children and adolescents: Photocopiable resource book.

Windsor, NFER-Nelson, 1995.

55. Spence SH. Assessment of perception of emotion from posture cues. In social skills training: Enhancing

social competence with children and adolescents: Photocopiable resource book. . Windsor, NFER-

Nelson, 1995.

56. Rodgers JD, Thomeer ML, Lopata C, Volker MA, K. LG, A. MC, Smith RA, Biscotto AA. RCT of a

psychosocial treatment for children with high-functioning ASD: Supplemental analyses of treatment

effects on facial emotion encoding. Journal of Developmental and Physical Disabilities

2015;27:207-221.

57. Reynolds CR, Kamphaus RW. Behavior assessment system for children, ed 2nd. Circle Pines, MN,

AGS, 2004.

58. Spence SH. Social skills questionnaire; Social skills training: Enhancing social competence with

children and adolescents: Photocopiable resource book. Windsor, NFER-Nelson, 1995

59. Chorpita BF, Bernstein A, Daleiden EL. Empirically guided coordination of multiple evidence-based

treatments: An illustration of relevance mapping in children's mental health services. Journal of

Consulting and Clinical Psychology 2011;79:470-480.

60. Van der Paelt S, Warreyn P, Roeyers H. Effect of community interventions on social-communicative

abilities of preschoolers with autism spectrum disorder. Developmental Neurorehabilitation

2016;19:162-113.

61. Andersson G. The promise and pitfalls of the internet for cognitive behavioral therapy. BMC Medicine

2010;8:82.

62. Waller G. Evidence-based treatment and therapist drift. Behaviour Research and Therapy 2009;47:119-

127.

63. Hirvikoski T, Jonsson U, Halldner L, Lundequist A, de Schipper E, Nordin V, Bölte S. A systematic

review of social communication and interaction interventions for patients

with autism spectrum disorder. Scandinavian Journal of Child and Adolescent Psychiatry and

Psychology 2015;3:147-168.

64. Bölte S. The good, the bad and systematic reviews. Autism 2015;19:3-5.

65. Elwyn G, Laitner S, Coulter A, Walker E, Watson P, Thomson R. Implementing shared decision

making in the NHS. BMJ 2010;341.

66. Golnik A, Maccabee-Ryaboy N, Scal P, Wey A, Gaillard P. Shared decision making: Improving care

for children with autism. Intellectual and Developmental Disabilities 2012;50:322-331.

67. Levy SE, Frasso R, Colantonio S, Reed H, Stein G, Barg FK, Mandell DS, Fiks AG. Shared decision

making and treatment decisions for young children with autism spectrum disorder. Academic

Pediatrics 2016

68. Lipstein EA, Lindly OJ, Anixt JS, Britto MT, Zuckerman KE. Shared decision making in the care of

children with developmental and behavioral disorders. Maternal and Child Health Journal

2016;20:665-673.

69. Byiers BJ, Reichle J, Symons FJ. Single-subject experimental design for evidence-based practice.

American Journal of Speech-Language Pathology. 2012;21:397-414.

70. Chen Y-W, Cordier R, Brown N. A preliminary study on the reliability and validity of using experience

sampling method in children with autism spectrum disorders. Developmental Neurorehabilitation

2015;18:383-389.

71. Cordier R, Brown N, Chen Y-W, Wilkes-Gillan S, Falkmer T. Piloting the use of experience sampling

method to investigate the everyday social experiences of children with Asperger’s syndrome/high

functioning autism. Developmental Neurorehabilitation 2016;19:103-108.

72. Jonsson U, Alaie I, Parling T, Arnberg F. Reporting of harms in randomized controlled trials of

psychological interventions for mental and behavioral disorders: A review of current practice.

Contemporary Clinical Trials 2014;38:1-8.

73. Wells KB: Treatment research at the crossroads. The scientific interface of clinical trials and

effectiveness research. American Journal of Psychiatry 1999;156:5-10.

74. Benvenuto A, Battan B, Benassi F, Gialloreti LE, Curatolo P. Effectiveness of community-based

treatment on clinical outcome in children with autism spectrum disorders: An Italian prospective

study. Developmental Neurorehabilitation 2016;19:1-9.

75. LaCava P, Rankin A, Mahlios E, Cook K, Simpson R. A single case design evaluation of a software and

tutor intervention addressing emotion recognition and social interaction in four boys with ASD.

Autism 2010;14:161–178.

76. McHugh L, Bobarnac A, Reed P. Brief report: teaching situation-based emotions to children with

autistic spectrum disorder. Journal of Autism and Developmental Disorder 2011; 41:1423–1428.

77. Russo-Ponsaran NM, Evans-Smith B, Johnson JK, McKown C. A pilot study assessing the feasibility of

a facial emotion training paradigm for school-age children with autism spectrum disorders. Journal

of Mental Health Research in Intellectual Disabilities 2014;7:169–190.

Appendix 1: Documentation of literature search

Table of ContentsGeneral information......................................................................................................................... 1

Search strategy for Medline (Ovid)............................................................................................... 2

General information

Date: November 2015 (update of the search made in May 2015)

Search specialists: Klas Moberg, University Library, Karolinska Institutet

Total number of hits:

Before deduplication: 4884 After deduplication: 201 (Deduplication has been made against the prior search and among new articles)

Databases used:

Cochrane (Wiley) Medline (Ovid) Embase (Elsevier) Cinahl (Ebsco) Psychinfo (Ovid) Social Services Abstracts (Proquest) ERIC (Ovid)

o

Search strategy for Medline (Ovid)

Date: 2015-11-20

Number of hits: 1327 (1214 in 2015-05-05)

1. exp child development disorders, pervasive/

2. autis$.tw.

3. pervasive developmental disorder$.tw.

4. pdd.tw.

5. (language adj3 delay$).tw.

6. (speech adj3 disorder$).tw.

7. childhood schizophrenia.tw.

8. kanner$.tw.

9. asperger$.tw.

10. or/1-9

11. randomized controlled trial.pt.

12. controlled clinical trial.pt.

13. randomi#ed.ab.

14. placebo$.ab.

15. drug therapy.fs.

16. randomly.ab.

17. trial.ab.

18. groups.ab.

19. or/11-18

20. exp animals/ not humans.sh.

21. 19 not 20

22. 10 and 21

23. exp Nonverbal Communication/

24. exp Emotions/

25. "Recognition (Psychology)"/

26. Speech Perception/

27. Auditory Perception/

28. Social Perception/

29. Pattern Recognition, Visual/

30. Visual Perception/

31. Theory of Mind/

32. Voice/

33. Face/

34. ((Emotion* or face or facial or body or voice or gesture*) adj3 (recognition or expression or processing)).tw.

35. theory of mind.tw.

36. or/23-35

37. 22 and 36

Appendix 2: Excluded publications (with reasons)

Population1. Bölte S, Feineis-Matthews S, Leber S, Dierks T, Hubl D, Poustka F. The development and evaluation of a

computer-based program to test and to teach the recognition of facial affect. International Journal of Circumpolar Health 2002;61 Suppl 2:61-68.

2. Bölte S, Feineis-Matthews S, Poustka F. Brief report: Emotional processing in high-functioning autism--physiological reactivity and affective report. Journal of Autism and Developmental Disorders 2008;38:776-781.

3. Bölte S, Hubl D, Feineis-Matthews S, Prvulovic D, Dierks T, Poustka F. Facial affect recognition training in autism: can we animate the fusiform gyrus? Behavioral Neuroscience 2006;120:211-216.

4. Bölte S, Poustka F. The recognition of facial affect in autistic and schizophrenic subjects and their first-degree relatives. Psychological Medicine 2003;33:907-915.

5. Golan O, Baron-Cohen S. Systemizing empathy: teaching adults with Asperger syndrome or high-functioning autism to recognize complex emotions using interactive multimedia. Developmental Psychopathology 2006;18:591-617.

6. Golan O, Baron-Cohen S, Hill J. The Cambridge Mindreading (CAM) Face-Voice Battery: Testing complex emotion recognition in adults with and without Asperger syndrome. Journal of Autism and Developmental Disorders 2006;36:169-183.

7. Golan O, Baron-Cohen S, Hill JJ, Rutherford MD. The 'Reading the Mind in the Voice' test-revised: a study of complex emotion recognition in adults with and without autism spectrum conditions. Journal of Autism and Developmental Disorders 2007;37:1096-1106.

8. Philip RC, Whalley HC, Stanfield AC, Sprengelmeyer R, Santos IM, Young AW, Atkinson AP, Calder AJ, Johnstone EC, Lawrie SM, Hall J. Deficits in facial, body movement and vocal emotional processing in autism spectrum disorders. Psychological Medicine 2010;40:1919-1929.

Intervention1. Fortin M, Dionne J, Pinho G, Gignac J, Almirall J, Lapointe L. Randomized controlled trials: do they have

external validity for patients with multiple comorbidities? Annals Family Medicine 2006;4:104-108.

2. Tanaka JW, Wolf JM, Klaiman C, Koenig K, Cockburn J, Herlihy L, Brown C, Stahl SS, South M, McPartland JC, Kaiser MD, Schultz RT. The perception and identification of facial emotions in individuals with autism

spectrum disorders using the Let's Face It! Emotion Skills Battery. Journal of Child Psychology and Psychiatry 2012:53:1259-1267.

Design1. Ratcliffe B, Wong M, Dossetor D, Hayes S. The association between social skills and mental health in school-

aged children with autism apectrum disorder, with and without intellectual disability. Journal of Autism and Developmental Disorders 2015;45:2487-2496.

Publication type1. Fletcher-Watson S, McConnell F, Manola E, McConachie H. Interventions based on the Theory of Mind

cognitive model for autism spectrum disorder (ASD). Cochrane Database of Systematic Reviews 2014:CD008785.

2. Rodgers JD, Thomeer ML, Lopata C, Volker MA, Lee GK, McDonald CA, Smith RA, Biscotto AA. RCT of a psychosocial treatment for children with high-functioning asd: Supplemental analyses of treatment effects on facial emotion encoding. Journal of Developmental and Physical Disabilities 2015;27:207-221.

3. Wass SV, Porayska-Pomsta K (2014) The uses of cognitive training technologies in the treatment of autism spectrum disorders. Autism 2014;18:851-871.