Original Articles

A pilot study: a computer gamebased assessment of visual perspective taking of four children with autism with high support needs

Authors: {'first_name': 'Vesa', 'last_name': 'Korhonen'},{'first_name': 'Hannu', 'last_name': 'R\xc3\xa4ty'},{'first_name': 'Eija', 'last_name': 'K\xc3\xa4rn\xc3\xa4'}


High support need and minimally verbal individuals with autism have received less attention in research in comparison to so-called higher functioning individuals with autism. As computers motivate individuals with autism, a game with a positive user experience was altered into a level 1 perspective-taking task in which advancement was contingent on eye contact. A case-controls design was used to see whether participants had impaired perspective taking and would they benefit from additional cues. Four high support need and minimally verbal children with autism played the game in their school environment. It was found that only one child with autism made more errors than controls using the eye cues. No child with autism benefitted from the additional cues, whereas the control group did. The results suggest that positive contexts may reveal more about individuals and their skills, and that individual level analysis can provide insights about autism and about the individuals with autism.
Keywords: Visual perspective takingautismcomputer gamehigh support needcase-controls design 
DOI: http://doi.org/10.1080/15017419.2016.1178169
 Accepted on 29 Mar 2016            Submitted on 2 Dec 2015


One of the defining features of autism spectrum disorder (ASD) is the deficit in social interaction (American Psychiatric Association 2013; Wing and Gould 1979). To function in the social world, one needs to be able to take other people’s perspective into account (Flavell 1977). Perspective taking helps us to infer and predict the actions, desires, and beliefs of other people (e.g. Conson et al. 2015; David et al. 2010; LeBlanc et al. 2003; Pearson, Ropar, and de C Hamilton 2013; Schilbach et al. 2012). Perspective taking has visually two levels. Level 1 refers to being able to know if the other person sees an object; for example, line of sight and obstructions on the line of sight. These can be passed by typically developing two year olds. Level 2 refers to the ability to understand that the other person sees the object differently, dependent on the point of view, and even adults have been shown to have difficulties with Level 2 tasks in naturalistic contexts (Moll and Tomasello 2004, 2006; Pearson, Ropar, and de C Hamilton 2013).

Impairments in establishing and maintaining eye contact are part of the diagnostic criteria of autism (APA 2013), and perspective taking is dependent on the ability to follow the other person’s gaze and line of sight (Conson et al. 2015; Pearson, Ropar and de C Hamilton 2013; Warreyn et al. 2005). Although children with ASD have problems executing this skill (e.g. Hamilton, Brindley, and Frith 2009; Warreyn et al. 2005), mixed results have recently been found (Pearson, Ropar, and de C Hamilton 2013). Similarly, discrepancies have also been found in eye-tracking research looking at impaired eye contact, a vital part of perspective taking (Guillon et al. 2014; Papagiannopoulou et al. 2014). Recent evidence of an impaired gaze following in perspective taking can be found, for example, in studies by Falck-Ytter et al. (2012) and Riby et al. (2013), in which children needed to see where the other person was looking. Falck-Ytter et al. (2012) showed that children with ASD show less accurate gaze following (correct/incorrect gaze shifts) and made fewer correct gaze shifts than typically developing children when looking at gaze-at items. In addition, Riby et al. (2013) found that children with ASD were not as accurate at naming gaze-at items as controls, and even when cued, children with ASD did not spend more time looking at the gaze-at objects.

Attempts to train perspective-taking skills and eye contact have shown success by using video-modelling (Charlop-Christy and Daneshvar 2003; LeBlanc et al. 2003), visual table-top exercises (Gould et al. 2011), picture exchange communication systems with imitation (Miyazaki, Hisatoshi, and Masahiko 2014), and developmentally appropriate play activities (Ninci et al. 2013). In their straightforward training procedure, Gould et al. (2011) trained a single component of perspective taking to see what the other person was seeing (level 1). Due to the simplicity of this approach, it could also be used with minimally verbal children. The training consisted of pictures set on a table in which a person was looking at one of four locations: up, down, left, or right. The children needed to understand where the person was looking and name the object the person was seeing: ‘What does s/he see?’ The training cards had dotted arrows from the eyes to the object as additional cues, and a fading procedure was used to gradually shorten the length of the arrows. It was found that the children were able to learn to understand what the other person saw and even demonstrate a generalization of the skill. In the present study, we used this task for our task design.

In task designs, motivation should be considered. For instance, Dweck (1986) concluded that people perform better if they feel secure and motivated, which is particularly important to students with learning difficulties (Hart et al. 2004; Korhonen, Linnanmäki, and Aunio 2014; Silinskas et al. 2016) and in learning, the best outcomes are connected to motivation and curiosity (e.g. Gruber, Gelman, and Ranganath 2014). Computerized procedures, on the other hand, are found to be useful with individuals with ASD (e.g. Parsons, Leonard, and Mitchell 2006; Wass and Porayska-Pomsta 2014), and with minimal verbal skilled individuals with ASD (Colby 1973; McGonigle-Chalmers et al. 2013). Thus, as individuals with ASD enjoy and are motivated in computerized contexts due to the freedom to work at own speed with few distracting social factors (for recent reviews, see Grynszpan et al. 2013; Wass and Porayska-Pomsta 2013), we altered a computer game with a positive user experience for a perspective-taking task. To our knowledge this has not been explored before with perspective taking. To further increase motivation and engagement, we used changeable visual stimuli as an acknowledgement of children’s personal interests, as preferences have been found to enhance assessment, academic, and social skills performance (e.g. Baker 2000; Boyd et al. 2007; Charlop, Kurtz, and Casey 1990; Jacobsen 2000; Kryzak and Jones 2014; Mancil and Pearl 2008; McGonigle-Chalmers et al. 2013; Naoi et al. 2008; Vismara and Lyons 2007).

This pilot study reports results of four high support need and minimally verbal individuals with ASD playing a computer-based perspective-taking game. These are children for whom standardized testing might not be suitable, who often receive little attention in research and who can be considered to have very different skills and traits (Jacobsen 2000; McGonigle-Chalmers et al. 2013; Tager-Flusberg and Kasari 2013). In contrast to group-level analyses with conflicting results on impaired perspective taking and eye contact, we concentrated on individual-level analyses. This avenue was chosen in order to detect possible variations between individuals’ performance that may have resulted in those discrepancies, which have also been suggested to influence the results in attention research (Ames and Fletcher-Watson 2010; Bruinsma, Koegel, and Koegel 2004; Korhonen, Räty, and Kärnä 2014). The individual-level analyses can provide insights about the individuals with autism and about autism as a whole. We aimed to alter a computer game with a positive user experience to explore perspective-taking skills. First, we hypothesized the individuals with ASD to be able to play the game and, second, we hypothesized them to make more errors in comparison to typically developing children without the additional arrow cues. Our third hypothesis was that with the arrow cues there would be no differences between the individuals with ASD and the controls in the error rates.



Children with autism

A convenience sampling method was used. Four pupils from a school for individuals with special needs – which used an adjusted syllabus due to pupils’ academic performance – took part in the study. The study took place in their own school in a familiar setting. All children were previously diagnosed with ASD (based on ICD-9 criteria) and were assessed as high support need (e.g. Strnadová, Cumming, and Marquez 2014) and minimally verbal (e.g. Tager-Flusberg and Kasari 2013) by the school services (medical doctor and speech therapist). A teacher-rated Autism Spectrum Screening Questionnaire was used (ASSQ: Mattila et al. 2012): the teacher rated ASSQ scores were all above the cut-off score of ≥ 22, with sensitivity/specificity 0.73/0.74 for clinical populations (ASSQ scores for the four participants: 23, 36, 41, 30). The participants were all male, and their age levels were equivalent to those in Finnish primary and secondary school (ages in years: 9, 12, 14, and 11). We could not collect standardized test results (language or cognition) as tests were stopped due to the children’s systematic task-irrelevant behaviour, for example, by inventing their own play action, which was unrelated to the task. More subjectively, by the teachers and researchers, these children can be characterized by having very limited use of verbal language, mainly using single words, expressing echolalic speech, and most often communicate non-verbally.

At the time of the study Aaron was a 9-year-old boy, with an ASSQ score of 23, who has developmental delays and hence has extended schooling planned. He was still learning how to dress himself and needed aid using a toilet. Aaron had sensory sensitivities which made, for example, cutting hair or doing physical examinations difficult. He appeared happy in everyday life but had difficulties in concentrating on tasks, and if irritated he may have scratched or headbutted the person next to him. Aaron had good gross motoric skills but needed aid and training in fine motor skills, for example, using a pencil/pen, and in general was often restless in his motor actions. He also needed aid in outdoor activities, in public spaces he needed careful supervision, and inside he needed aid and guidance in eating. Aaron understood clear context-related instructions but had trouble with comprehending more abstract concepts. He was able to name individual everyday items but could not use plurals, and he was not able to produce L, K, R sounds, and J and N sounds could only be used as individual sounds. Aaron was able to produce some sentences by combining two words; however, the intelligibility was often inadequate and he felt irritated when asked for a clarification. As an aid he used a picture communication folder for communication with several pictures to form a sentence to ask for something.

Billy was a 12-year-old boy, with an ASSQ score of 36, who had developmental delays. Billy was a child that could not be left alone without supervision, and he needed aid in using a toilet, washing up, and in brushing his teeth. Although Billy was able to do puzzles up to 25 pieces in size, he was still training to use pens and pencils but was able to use scissors to cut paper into triangular shapes. He had a tendency to get easily frustrated if there was no planned activity. Billy was able to understand clear short instructions but he communicated with pictures and supportive sign language. The school found that Billy’s day was best organized by using a pictorial calendar.

Clark was a 14-year-old boy, with an ASSQ score of 41, who had developmental delays and therefore had extended schooling planned. Clark took very little contact with others and got distracted easily and fell to his own thoughts, but with verbal guidance he was easily brought back to the task. Sometimes Clark might have grabbed hair or pinched the person next to him from seconds to up to minutes without a specific reason and when disappointed the time was often longer. His motor skills were repetitive and his fine motor abilities needed training; using a pencil or scissors was difficult, but luckily he liked physiotherapy in which he needed verbal and manual aid and guidance. Clark’s activity level was very varied; sometimes he needed constant guidance but often tasks were done without any aid. Clark used words to communicate, and did not use signs or pictures, and moreover had frequent echolalic speech and often recited sentences from cartoons. Although limited in language use he was able to write his own name, recalled most numbers, and was able to name geometric shapes (square, circle, house, heart).

Derek was a 11-year-old boy with an ASSQ score of 30. Derek was almost always a cheerful child who had made progress in play and did not only do certain play activities, and was also more willing to be guided by an adult. When he was stuck, giving time and showing pictures helped him to move on. He was eager to play but only for a short while, and he needed adult supervision and guidance to plan and execute activities. In motor play activities Derek was hesitant and his fine motor skills, like holding a pen, were still in the process of learning. For Derek big social events at the school were a challenge but those could be addressed by encouragement and pictorial planning of the events. Derek communicated with words, gestures, and pointing. However, he used the same phrases frequently, with one two three words, and was able to name colours, numbers, and play-related items. He was able to ask for help by using words such as help or give and additionally used a picture communication file to communicate with adults.

All children participated on the basis of their own, parental, and school consent and the research was approved by the Research Ethics Committee of the University of [name of university].

Typically developing children

A convenience sampling method was used. Finnish universities have teacher training schools that are designed to work in collaboration with researchers. We involved all consenting and typically developing second grade primary school children from the university training school in our study, gaining their own consent as well as that of their parents and the schools. The second grade was selected to ensure that the youngest participants were age-matched to the youngest individual with ASD: the mental and language age in the control group was therefore on the same or higher level as for the youngest child with ASD. This was done since children with ASD had too much task-irrelevant behaviour during testing. The school reported that the participating children had no medical, psychological, and neurological diagnoses or other learning disabilities or difficulties. To exclude potential individuals with ASD, a teacher-rated ASSQ was used: for a whole population sample the sensitivity/specificity was 1.00/0.94 and the cut-off ≤ 7 (ASSQ: Mattila et al. 2012). The ASSQ scores in the TD group were all below the cut-off: all scores were < 3. Altogether, 17 typically developing children, between the ages of 8 and 9, participated in the study (9 males and 8 females). The study took place in their own school in a familiar setting. The researchers opted to use statistics appropriate for single-case studies. The sample size used for the control group in case-control studies can be modest: the sample size for the 98 single-case studies that directly compared a single case to controls was 11.69, SD = 10.66 (Crawford, Garthwaite, and Porter 2010)

Material and measures

In order to project the least amount of discomfort for the children, the game playing was designed on the basis of existing activities at the participants’ schools. We chose a game with a positive user experience (Mäkelä, Bednarik, and Tukiainen 2013).

The perspective-taking game ran on Visual Studio® software on a PC computer using the Microsoft Windows® operating system with a Kinect sensor, Microsoft Xbox 360® (version 1.8). The Kinect sensor’s operating range is from 0.8 to 4.0 m, a 640 × 480 resolution, with 30 frames per second rate. The game was played on a white screen with a VGA connection to a projector/smartboard (Xbox Kinect® uses body movement in its games. See Ilg et al. 2012; Munson and Pasqual 2012).

The Kinect sensor was placed in front of the player below the white screen (Figure 1(a). for an example of game playing on Kinect and Figure 1(b). for the layout of the game playing). No physical contact with the screen was needed. The player saw a silhouette of him-/herself and used his/her hand’s silhouette to select and catch items on the screen by placing either hand on top of the item. The software was programmed to only allow hands for selection. The distance to the screen was altered by the player by moving in the room; hence, the visual angle is not constant. The size of the screen was 2.6 (width) × 2.01 (height) in metres (m); the image projected was 2.1 m × 1.54 m. A cartoon character and images were used to maintain the game-like feature and since cartoons have been found to elicit similar gaze behaviour towards real images in individuals with ASD (Riby and Hancock 2009). The character’s height was 97 cm with eyes being 20 cm × 13.2 cm. We also kept the sclera of the virtual character white and the pupil colour dark so as not to reverse eye viewing behaviour (Frischen 2007).

Figure 1.  

(a) Example of the game playing using the Kinect technology in which the silhouette of the player is projected in the game via the Kinect sensor. Figure 1(b). The setting of the game room: the Kinect sensor and the white screen are in front of the player and an adult teacher can sit in the background during the game playing.

In the game, the player first chose an object of their preference, for example, a bird, a bee, a plane, etc. by placing either hand on top of the item. Then s/he needed to know the direction in which the virtual character was looking (there were three boxes on the screen: up, down, or middle) and open the box in that location with the help of eye gaze cues or with eye gaze and arrow cues (Figure 2; and for the order of the events see Figure 3). If the participants tried to open the incorrect box, it would not open; it would shake for a moment and made a sound to invite players to try again. There were three attempts before the new cue would appear. Once they chose the correct box, the participants needed to catch the flying object, which would emerge from the box.

Figure 2.  

The game view: top left (1) choosing preferred object (bumblebee); top right (2) both eye cue and arrow cue indicating the location (looking at the box on the top); bottom left (3) eye cue and arrow cue to the top box; bottom middle (4) eye cue only (looking at the box on the ground); bottom right (5) The topmost box is open and the participant is trying to catch the bee that flew from the box (can be seen on top of the middle box: bumblebee).

Figure 3.  

The order of the events in the game: (1) the player chooses an object, which he would like to look for; (2) the player locates the correct box using the eye gaze or arrow cues; (3) the player opens the correct box; (4) the player catches the object that emerges from the box. After the final trial with either a gaze cue or the double cues, the participant can choose a different object to play the game again.

We were interested in the two different kinds of trials to see if attending to eyes is impaired and whether the additional arrow cues would lessen the amount of errors made in the game: (1) there was only the eye gaze cue indicating which box to choose (hereafter eye cue) and (2) there were the eye gaze cue and an additional dotted arrow cue at the same time to make the task easier (hereafter double cue).

The data collection started with practise trials for both typically developing participants and for individuals with ASD. This was done because we did not know whether the target behaviour was part of their repertoire, and task failure could have evoked negative feelings in the children with ASD and result in refusal to play and participate in similar activities in the future. The practise trials had two eye cue trials and five double cue trials. The practise measurements involved only two attempts on the eye cue condition to avoid multiple failures as guided by Morgan and Morgan (2009). Similarly, the trial numbers were kept low (in the practise and real trials) due to keeping the playing time short and due to the pilot nature of the study. At the practise trials, the eye cue trials came before the double cue trials to ascertain whether the children were able to play the game when only eye gaze cues were given: two eye cue trials (length of the dotted arrow: 0–0). There was only one attempt for each eye cue trial. After the two eye cue trials, five prompted trials using the fading procedure (length of the dotted arrow: 5-4-3-2-1) with three attempts were used to aid the player with understanding the game and to impose a feeling of control. The typically developing children had one practise trial after which they were able to understand the game (with reference to their own comments).

After the practise trials, in the two playing sessions that were analysed, there were six double cue trials and three eye cue trials in order to have more positive than negative trials. In the double cue trials the game used a fading procedure in which each cue had shorter arrow cue and eventually no arrow cue. The order was according to the fading procedure: the length of the arrow: 5-4-3-2-1-0-0-0. All trials allowed three attempts before proceeding to the next trial. The game performance data, for the eye cue and the double cue, were collected onto log files: choosing the correct or incorrect location after the cue and the cue type.


A case-controls method was used; that is, a method in neuropsychology in which individual’s results can be statistically compared to that of a control sample’s. A statistical programme (DISSOCS_ES.EXE) was applied to test whether participants’ scores on eye cue and double cue trials are significantly lower than those of a control sample, and whether the scores in the eye cue and double cue trials differ from one another (Crawford, Garthwaite, and Porter 2010). The dependent measure is the errors made in the game, in the eye cue and double cue trials.


When the children arrived in the game playing room, at their own schools, they were welcomed and then given instructions that they first needed to choose a preferred item on the screen and they were then told to locate the hiding place of that item. They were then told that the man on the screen would help them find the correct box. Once finished playing the game they were thanked for playing.


The errors made in the game were counted and reported as percentages. Errors were divided into two categories based on the cue type: (1) eye cue; (2) double cues. No participant tried to choose a box before the cues appeared, indicating understanding the purpose of the cues. The time it took to play the game varied from 53 to 99 s (M = 68.1) for the TDI and between 57 and 116 s (M = 91.8) for the individuals with ASD.

Relative error rates: eye cue and double cue

Children with ASD: in the practise eye cue condition the error rate was 43.8% and 27.9% in the double cue condition. In the 1st trial in the eye cue condition the error rate was 32.5% and in the 2nd 42.9%. In the first double cue condition the error rate was 37.4% and in the second 43%.

Typically developing children: in the practise eye cue condition the error rate was 68.8% and 14.4% in the double cue condition. In the 1st trial in the eye cue condition the error rate was 19.3% and in the second 13.8%. In the first double cue condition the error rate was 14.4% and in the second 5.7%. Wilcoxon signed-rank test indicated that typically developing participants made more errors overall in the eye cue trials than in the double cue trials (Z = −2,415, p = .016).

Comparisons of individual participants to controls

For case-controls analyses the means of the first two play session’s relative error rates were used. We reversed the relative values to avoid zero values in the data set (e.g. an error value of 0 = a score of 100, and an error value of 20 = a score of 80). In the eye cue condition the error rates were: Aaron, 60; Billy, 60; Carl, 41.7 Derek, 87.5. In the double cue condition the error rates were: Aaron, 58.4; Billy, 56.1; Carl, 58.2; Derek, 66.6. The control group’s (N = 17) mean score on the eye cue condition was 85.2 (SD 14.5) and for the double cue condition the mean was 94.7 (SD 4.6).

The DISSOCS_ES.EXE programme was used and the results are presented in Table 1. (see Section 3.3. for task comparison for each individual) as suggested by Crawford, Garthwaite, and Porter (2010). All participants were significantly poorer in the double cue trials compared to controls. Apart from Carl the participants did not differ from controls in the eye cue condition.

Table 1.

The results of the case-controls analyses using the DISSOCS_ES.EXE (Crawford, Garthwaite & Porter, 2010). The asterisk (*) indicates significant difference between controls and the participant in a given task.

    Control sample   Significance test (* meets criteria for a deficit compared to controls) Estimated percentage of the control population obtaining a lower score than the case Estimated effect size (Zcc)
Participant Task N Mean SD Case’s score t p Point (95% CI) Point (95% CI)
Aaron Eye cue 17 85.2 14.5 60 −1.689 0.055 5.53 (0.64 to 16.74) −1.738 (−2.490 to −0.964)
  Double cue 17 94.7 4.6 58.4 −7.669 0.000* 0.00 (0.00 to 0.00) −7.891 (−10.634 to −5.140)
Billy Eye cue 17 85.2 14.5 60 −1.689 0.055 5.53 (0.64 to 16.74) −1.738 (−2.490 to −0.964)
  Double cue 17 94.7 4.6 56.1 −8.155 0.000* 0.00 (0.00 to 0.00) −8.391 (−11.303 to −5.471)
Carl Eye cue 17 85.2 14.5 41.7 −2.915 0.005* 0.506 (0.002 to 3.16) −3.00 (−4.125t o −1.858)
  Double cue 17 94.7 4.6 58.2 −7.711 0.000* 0.000 (0.000 to 0.000) −7.935 (−10.692 to −5.168)
Derek Eye cue 17 85.2 14.5 87.5 0.154 0.439 56.03 (37.36 to 73.72) 0.159 (−0.322 to 0.635)
  Double cue 17 94.7 4.6 66.7 −5.915 0.000* 0.001 (0.000 to 0.004) −6.087 (−8.222 to −3.941)

Note: Crawford and Howell’s (1998) test for a deficit in task X and Y.

Dissociations between eye cue and double cue

The dissociation of each participant’s error rates in the two different trials were measured (Crawford, Garthwaite, and Porter 2010):

Aaron: Eye cue condition z score = −1.738 and double cue z score = −7.891. The RSDT (Crawford and Garthwaite 2005) to test the difference between Aaron’s eye cue and double cue scores: two tailed p-value for t of 4.664, df 16, is 0.000, meaning that eye cue and double cue performances are different. An estimated 0.01% of control population would show more extreme difference in performance. The effect size for the difference between case and controls = 5.079 (Bayesian Credible Interval: 95% CI 2.715−7.894). The difference between Aaron’s standardized scores is statistically significant (RSDT). Overall, Aaron’s results fulfils the criteria for a dissociation. Errors in the double cue condition were higher for this participant than in the eye cue condition.

Billy: Eye cue condition z score = −1.738 and double cue z score = −8.391. The RSDT (Crawford and Garthwaite 2005) to test the difference between Billy’s eye cue and double cue scores: two tailed p-value for t of 5.031, df 16, is 0.000, meaning that eye cue and double cue performances are different. An estimated 0.01% of control population would show a more extreme difference in performance. The effect size for the difference between case and controls = 5.491 (Bayesian Credible Interval: 95% CI 2.980−8.487). The difference between Billy’s standardized scores is statistically significant (RSDT). Overall, Billy’s results fulfil the criteria for a dissociation. Errors in the double cue condition were higher for this participant than in the eye cue condition.

Carl: Eye cue condition z score = −3.000 and double cue z score = −7.935. The RSDT (Crawford and Garthwaite 2005) to test the difference between Carl’s eye cue and double cue scores: two tailed p-value for t of 3.761, df 16, is 0.002, meaning that eye cue and double cue performances are different. An estimated 0.1% of control population would show more extreme differences in performance. The effect size for the difference between case and controls = 4.073 (Bayesian Credible Interval: 95% CI 1.707−6.853). The difference between Carl’s standardized scores is statistically significant (RSDT). Overall, Carl’s results fulfil the criteria for a strong dissociation. Errors in the double cue condition were higher for this participant than in the eye cue condition.

Derek: Eye cue condition z score = 0.159 and double cue z score = −6.087. The RSDT (Crawford and Garthwaite 2005) to test the difference between Derek’s eye cue and double cue scores: two tailed p-value for t of 4.732, df 16, is 0.0002, meaning that eye cue and double cue performances are different. An estimated 0.01% of control population would show more extreme differences in performance. The effect size for the difference between case and controls = 5.155 (Bayesian Credible Interval: 95% CI 3.175−7.499). The difference between Derek’s standardized scores is statistically significant (RSDT). Overall, Derek’s results fulfil the criteria for a dissociation. Errors in the double cue condition were higher for this participant than in the eye cue condition.


The objective of this study was to pilot a potential method for skill assessment. We wanted to explore if a computer game with a positive user experience could be used in a school environment with high support need and minimally verbal children with ASD to assess whether these particular children had potential perspective-taking skills, can they use eye gaze information to play the game, and do they benefit from additional cues. We concentrated on individual-level analyses in order to detect possible variations between individuals’ performances, which have been suggested to influence attention research and could account for the discrepancies in previously found results. We hypothesized that the individuals with ASD were able to play the game, but made more errors in comparison to typically developing children without the additional arrow cues. We also expected that with the arrow cues there would be no differences between the individuals and the controls in the error rates.

Since no participant tried to choose a box before the eye cues or arrow cues appeared, and since the error rates were better than chance level, it can be assumed that the decisions made in the game were based on the cues, which confirms the first hypothesis that children with ASD are able to play the game.

The second hypothesis was not confirmed. Children with ASD did not make more errors without the additional error cues in comparison to the controls. The case-control analysis showed that in comparison to the controls only one child made more errors in the eye cue trials (Clark).

The third hypothesis was also not confirmed: all children with ASD made more errors with the additional arrow cues compared to the control group. There was a dissociation between the two conditions for each child meaning that the arrow cues made the performance worse. Hence, it seems that the children did not benefit from the additional arrow cues as we expected and as was found in the Gould et al. (2011) study. Overall, using eye cues for perspective taking seemed to be intact in three out of the four children with ASD and additional arrow cues only made them make more errors.

Comparing our results to those of Gould et al. (2011), it is possible that the children in the Gould et al. (2011) study found the task difficult without feedback. They may have had the skill before the game but did not know how to play the game. Therefore, development in the skill in their study was evident. Possibly for the same reason they found the arrow cues helpful. In our game, the feedback was visually presented as the box opened if correct and shook if incorrect; hence, the purpose of the game was known from the very beginning. A possible explanation why participants showed a difference to controls in the double cue condition with the additional arrow cues is the complexity of the scene. Stimuli that are too numerous or too complex for children with ASD was suggested by Guillon et al. (2014) to be one reason for seeing differing results in attention research. However, since in our study children with ASD performed better with the eye cues they may have only been distracted by the arrow cues that would relate to visual complexity. Similarly, the control group made fewer errors using the additional arrow cues as they may not have been distracted by them. There is also variation between the practise, first, and second trials which may reflect the variation within the individuals over time, and should be further explored, even though the error rates did stay below chance level. For now the numbers are too small to analyse. Overall, our results show that perspective taking was not an impossible task for these children contrary to what, for example, Falck-Ytter et al. (2012) and Riby et al. (2013) have found. It is, however, according to what Pearson, Ropar, and de C Hamilton (2013) discovered – some studies found intact perspective taking in individuals with ASD. Therefore, after our current study, it would be interesting to reanalyse the data from previous groups’ studies on an individual level using the case-controls method.

We suggest that we could learn more about children with ASD and how to organize their learning by using contexts with which they feel at ease, as suggested also in other studies on social and academic skills (e.g. Baker 2000; Boyd et al. 2007; Charlop, Kurtz, and Casey 1990; Jacobsen 2000; Kryzak and Jones 2014; Mancil and Pearl 2008; McGonigle-Chalmers et al. 2013; Naoi et al. 2008; Vismara and Lyons 2007). In addition, computer games and tasks could be used as a starting point for learning and assessing children’s capabilities as they have been found to be a viable source for education and entertainment (Grynszpan et al. 2013; Ilg et al. 2012; Munson and Pasqual 2012; Wass and Porayska-Pomsta 2013). Once the games and tasks have been found to be interesting by the children, the games could be revised for skill assessment. Furthermore, since research also indicates a lowered intellectual performance when presenting tasks to individuals who already believe they will perform poorly and who, as a result, inadvertently behave in a stereotypical manner (e.g. Croize et al. 2004; Spencer, Logel, and Davies 2015), we believe the steps we took for testing seem more than appropriate. In our study the lack of interest in the standardized tests and willingness to play the game can be taken to indicate that interesting games can be seen as an alternative assessment method. In fact, a review of joint attention, an ability closely related to perspective taking, found that no study reported taking children's interests into account in testing joint attention abilities, a step that could have made the children feel more at ease (Korhonen, Räty, and Kärnä 2014). Hence, the review also supports the importance of context in the research of individuals with ASD.

Our research has some limitations. The design did not control the influence of the teachers or assistants, as they did not remain constant for each child. However, this increases the ecological validity of our study as it represents the real-life situation of all school environments. Furthermore, the teachers very rarely advised or guided the children. The time taken to play the game was not analysed as there was too much intra- and inter-individual variation in each session. For example, at one point the player might be standing still or concentrating on their own interests even when the game was on. This makes the interpretation of the temporal duration data impossible. Also, for our purposes, time was not essential, as we recognize that these individuals may have different ways of performing in a testing situation and we do not expect a steady playing rate. The size of the eyes was exaggerated due to the cartoon nature of the character and since we wanted to have the possibility to use the game for mobile eye-tracking purposes, a larger eye size was required. This may have attracted the participants more to the eye area. However, they were able to use the eyes as cues, which is what we wanted to examine, and if the cue size or attractability would enhance performance we should have seen the arrow cues to enhance performance as well.

Further limitations in this study were the gender ratio that was skewed, as all children with ASD were boys. On the other hand the gender ratio in ASD is skewed towards boys (Fombonne 2009; Jensen, Steinhausen, and Lauritsen 2014; Rutherford et al. 2016). We also did not dwell on the technology (Kinect) per se, as our contention was not to change it as it was found to work in a previous study (Mäkelä, Bednarik, and Tukiainen 2013). This might be an element why the children fared well in this particular task but that is what is expected if the platform is enjoyable. Overall, and also in the case of perspective taking, more research is needed on task engagement of the children. Future studies should also explore systematically the subjective experience and feelings when having to take eye contact and using information from the eyes, as in our design this particular aspect was not addressed.

On the other hand, the limitations of this study have positive aspects: We were observing individuals who are often not studied, and we designed a task for individuals who are otherwise difficult to assess and educate. In fact, these children would most likely be excluded from most research as their matching becomes problematic due to their lack of interest in testing. Moreover, our research setting has a good ecological validity and the method’s applicability to real-life school or rehabilitation centre settings was tested as we collected the data in school environments.


The results indicate that applying small changes to a computer game with a positive user experience allowed us to conduct research to study the skills of four high support need and minimally verbal children with ASD, an avenue not explored before. The game let us infer that perspective taking was impaired in only one out of four children with ASD. It is likely that we are able to see more potential for high support need children to emerge when the context is supporting of the individual. The study also confirmed that the issue of individual variation in autism is still topical and showed that individual-level analysis can reveal insights about autism and about the individual with autism. Overall, we wish that high support need children with ASD receive more attention in research and in the design of research methodology, in order to include them in research more systematically rather than using methodologies that may exclude them as a group or as individuals.

Disclosure statement

No potential conflict of interest was reported by the authors.


  1. American Psychiatric Association. 2013. Diagnostic and Statistical Manual of Mental Disorders. 5th ed. [city: Washington], [state: DC]: American Psychiatric Association. 

  2. Ames, C., and S.Fletcher-Watson. 2010. “A Review of Methods in the Study of Attention in Autism.” Developmental Review30 (1): 52–73. doi:https://doi.org/10.1016/j.dr.2009.12.003. 

  3. Baker, M. J.2000. “Incorporating the Thematic Ritualistic Behaviors of Children with Autism into Games: Increasing Social Play Interactions with Siblings.” Journal of Positive Behavior Interventions2: 66–84. doi:https://doi.org/10.1177/109830070000200201. 

  4. Boyd, B. A., M. A.Conroy, G. R.Mancil, T.Nakao, and P. J.Alter. 2007. “Effects of Circumscribed Interests on the Social Behaviors of Children with Autism Spectrum Disorders.” Journal of Autism and Developmental Disorders37: 1550–1561. doi:https://doi.org/10.1007/s10803-006-0286-8. 

  5. Bruinsma, Y., R. L.Koegel, and L. K.Koegel. 2004. “Joint Attention and Children with Autism: A Review of the Literature.” Mental Retardation and Developmental Disabilities Research Reviews10 (3): 169–175. doi:https://doi.org/10.1002/mrdd.20036. 

  6. Charlop-Christy, M. H., and S.Daneshvar. 2003. “Using Video Modeling to Teach Perspective Taking to Children with Autism.” Journal of Positive Behavior Interventions5 (1): 12–21. doi:https://doi.org/10.1177/10983007030050010101. 

  7. Charlop, M. H., P. F.Kurtz, and F. G.Casey. 1990. “Using Aberrant Behaviors as Reinforcers for Autistic Children.” Journal of Applied Behavior Analysis23: 163–181. doi:https://doi.org/10.1901/jaba.1990.23-163. 

  8. Colby, K.1973. “The Rationale for Computer-Based Treatment of Language Difficulties in Non – Speaking Autistic Children.” Journal of Autism and Childhood Schizophrenia3: 254–260. doi:https://doi.org/10.1007/BF01538283. 

  9. Conson, M., E.Mazzarella, D.Esposito, D.Grossi, N.Marino, A.Massagli, and A.Frolli. 2015. ““Put Myself Into Your Place”: Embodied Simulation and Perspective Taking in Autism Spectrum Disorders.” Autism Research8 (4): 454–466. doi:https://doi.org/10.1002/aur.1460. 

  10. Crawford, J. R., and P. H.Garthwaite. 2005. “Testing for Suspected Impairments and Dissociations in Single-Case Studies in Neuropsychology: Evaluation of Alternatives Using Monte Carlo Simulations and Revised Tests for Dissociations.” Neuropsychology19 (3): 318–331. doi:https://doi.org/10.1037/0894-4105.19.3.318. 

  11. Crawford, J. R., P. H.Garthwaite, and S.Porter. 2010. “Point and Interval Estimates of Effect Sizes for the Case-Controls Design in Neuropsychology: Rationale, Methods, Implementations, and Proposed Reporting Standards.” Cognitive Neuropsychology27 (3): 245–260. doi:https://doi.org/10.1080/02643294.2010.513967. Accessed from http://homepages.abdn.ac.uk/j.crawford/pages/dept/SingleCaseMethodsComputerPrograms.HTM. 

  12. Crawford, J. R., and D. C.Howell. 1998. “Comparing an Individual’s Test Score Against Norms Derived from Small Samples.” The Clinical Neuropsychologist (Neuropsychology, Development and Cognition: Section D)12 (4): 482–486. doi:https://doi.org/10.1076/clin.12.4.482.7241. 

  13. Croize, J. C., G.Després, M. E.Gauzins, P.Huguet, J. P.Leyens, and A.Méot. 2004. “Stereotype Threat Undermines Intellectual Performance by Triggering a Disruptive Mental Load.” Personality and Social Psychology Bulletin30 (6): 721–731. doi:https://doi.org/10.1177/0146167204263961. 

  14. David, N., C.Aumann, B. H.Bewernick, N. S.Santos, F. G.Lehnhardt, and K.Vogeley. 2010. “Investigation of Mentalizing and Visuospatial Perspective Taking for Self and other in Asperger Syndrome.” Journal of Autism and Developmental Disorders40 (3): 290–299. doi:https://doi.org/10.1007/s10803-009-0867-4. 

  15. Dweck, C. S.1986. “Motivational Processes Affecting Learning.” American Psychologist41 (10): 1040–1048. doi:https://doi.org/10.1037/0003-066X.41.10.1040. 

  16. Falck-Ytter, T., E.Fernell, A. L.Hedvall, C.von Hofsten, and C.Gillberg. 2012. “Gaze Performance in Children with Autism Spectrum Disorder when Observing Communicative Actions.” Journal of Autism and Developmental Disorders42 (10): 2236–2245. doi:https://doi.org/10.1007/s10803-012-1471-6. 

  17. Flavell, J. H.1977. “The Development of Knowledge about Visual Perception.” Nebraska Symposium on Motivation25: 43–76. Accessed from http://www.ncbi.nlm.nih.gov/pubmed/753993. 

  18. Fombonne, E.2009. “Epidemiology of Pervasive Developmental Disorders.” Pediatric Research65 (6): 591–598. doi:https://doi.org/10.1203/PDR.0b013e31819e7203. 

  19. Frischen, A.2007. “Gaze Cueing of Attention: Visual Attention, Social Cognition, and Individual Differences.” Psychological Bulletin133 (4): 694–724. doi:https://doi.org/10.1037/0033-2909.133.4.694.Gaze. 

  20. Gould, E., J.Tarbox, D. O.Hora, S.Noone, and R.Bergstrom. 2011. “Teaching Children with Autism a Basic Component Skill of Perspective-Taking.” Behavioral Interventions26: 50–66. doi:https://doi.org/10.1002/bin. 

  21. Gruber, M. J., B. D.Gelman, and C.Ranganath. 2014. “States of Curiosity Modulate Hippocampus-Dependent Learning via the Dopaminergic Circuit.” Neuron84 (2): 486–496. doi:https://doi.org/10.1016/j.neuron.2014.08.060. 

  22. Grynszpan, O., P. L. T.Weiss, F.Perez-Diaz, and E.Gal. 2013. “Innovative Technology-Based Interventions for Autism Spectrum Disorders: A Meta-Analysis. Advance Online Publication.” Autism: The International Journal of Research and Practice, doi:https://doi.org/10.1177/1362361313476767. 

  23. Guillon, Q., N.Hadjikhani, S.Baduel, and B.Rogé. 2014. “Visual Social Attention in Autism Spectrum Disorder: Insights from Eye Tracking Studies.” Neuroscience and Biobehavioral Reviews42: 279–297. doi:https://doi.org/10.1016/j.neubiorev.2014.03.013. 

  24. Hamilton, A. F., R.Brindley, and U.Frith. 2009. “Visual Perspective Taking Impairment in Children with Autistic Spectrum Disorder.” Cognition113: 37–44. doi:https://doi.org/10.1016/j.cognition.2009.07.007. 

  25. Hart, S., A.Dixon, J.Drummond, and D.Macintyre. 2004. Learning Without Limits. [city: Maidenhead]: Open University Press. 

  26. Ilg, W., C.Schatton, J.Schicks, M. A.Giese, L.Schöls, and M.Synofzik. 2012. “Video Game-Based Coordinative Training Improves Ataxia in Children with Degenerative Ataxia.” Neurology79 (20): 2056–2060. doi:https://doi.org/10.1212/WNL.0b013e3182749e67. 

  27. Jacobsen, K.2000. “Difficulties in Understanding the Impact and Functions of Visual Attention Patterns of Persons with Autism.” Scandinavian Journal of Disability Research2 (2): 87–99. doi:https://doi.org/10.1080/15017410009510761. 

  28. Jensen, C. M., H. C.Steinhausen, and M. B.Lauritsen. 2014. “Time Trends Over 16 Years in Incidence-Rates of Autism Spectrum Disorders Across the Lifespan Based on Nationwide Danish Register Data.” Journal of Autism and Developmental Disorders44 (8): 1808–1818. doi:https://doi.org/10.1007/s10803-014-2053-6. 

  29. Korhonen, J., K.Linnanmäki, and P.Aunio. 2014. “Learning Difficulties, Academic Well-Being and Educational Dropout: A Person-Centred Approach.” Learning and Individual Differences31: 1–10. doi:https://doi.org/10.1016/j.lindif.2013.12.011. 

  30. Korhonen, V., H.Räty, and E.Kärnä. 2014. “Autism Spectrum Disorder and Impaired Joint Attention: A Review of Joint Attention Research from the Past Decade.” Nordic Psychology66 (2): 94–107. doi:https://doi.org/10.1080/19012276.2014.921577. 

  31. Kryzak, L. A., and E. A.Jones. 2014. “The Effect of Prompts within Embedded Circumscribed Interests to Teach Initiating Joint Attention in Children with Autism Spectrum Disorders.” Journal of Developmental and Physical Disabilities, doi:https://doi.org/10.1007/s10882-014-9414-0. 

  32. LeBlanc, L. A., A. M.Coates, S.Daneshvar, M. H.Charlop-Christy, C.Morris, and B. M.Lancaster. 2003. “Using Video Modelling and Reinforcement to Teach Perspective-Taking Skills to Children with Autism.” Journal of Applied Behavior analysis36 (2): 253–257. doi:https://doi.org/10.1901/jaba.2003.36-253. 

  33. Mäkelä, S., R.Bednarik, and M.Tukiainen. 2013. “Evaluating User Experience of Autistic Children through Video Observation.” CHI ‘13 Extended Abstracts on Human Factors in Computing Systems on – CHI EA ’13, 463. doi:https://doi.org/10.1145/2468356.2468438. 

  34. Mancil, G. R., and C. E.Pearl. 2008. “Restricted Interests as Motivators: Improving Academic Engagement and Outcomes of Children on the Autism Spectrum.” Teaching Exceptional Children Plus4: 2–15. Accessed from http://files.eric.ed.gov/fulltext/EJ967728.pdf. 

  35. Mattila, M.-L., K.Jussila, S.-L.Linna, M.Kielinen, R.Bloigu, S.Kuusikko-Gauffin, I.Moilanen, et al. 2012. “Validation of the Finnish Autism Spectrum Screening Questionnaire (ASSQ) for Clinical Settings and Total Population Screening.” Journal of Autism and Developmental Disorders42 (10): 2162–2180. doi:https://doi.org/10.1007/s10803-012-1464-5. 

  36. McGonigle-Chalmers, M., B.Alderson-Day, J.Fleming, and K.Monsen. 2013. “Profound Expressive Language Impairment in Low Functioning Children with Autism: An Investigation of Syntactic Awareness Using a Computerised Learning Task.” Journal of Autism and Developmental Disorders, doi:https://doi.org/10.1007/s10803-012-1753-z. 

  37. Miyazaki, M., K.Hisatoshi, and I.Masahiko. 2014. “Increase in Eye Contact and Vocalization: Combining the Picture Exchange Communication System (PECS) with Imitation Training for Children with Autism.” Japanese Journal of Behavior Analysis29 (1): 19–31. Accessed from http://ci.nii.ac.jp/naid/110009841521/en. 

  38. Moll, H., and M.Tomasello. 2004. “12- and 18-month-old Infants Follow Gaze to Spaces Behind Barriers.” Developmental Science7: F1–F9. doi:https://doi.org/10.1111/j.1467-7687.2004.00315.x. 

  39. Moll, H., and M.Tomasello. 2006. “Level 1 Perspective-Taking at 24 Months of Age.” British Journal of Developmental Psychology24: 603–613. doi:https://doi.org/10.1348/026151005X55370. 

  40. Morgan, D. L., and R. K.Morgan. 2009. Single-Case Research Methods for the Behavioral and Health Sciences. [city: London]: Sage. 

  41. Munson, J., and P.Pasqual. 2012. “Using Technology in Autism Research: The Promise and the Perils.” Computer45 (6): 89–91. doi:https://doi.org/10.1109/MC.2012.220. 

  42. Naoi, N., R.Tsuchiya, J.Yamamoto, and K.Nakamura. 2008. “Functional Training for Initiating Joint Attention in Children with Autism.” Research in Developmental Disabilities29: 595–609. doi:https://doi.org/10.1016/j.ridd.2007.10.001. 

  43. Ninci, J., R.Lang, K.Davenport, A.Lee, J.Garner, M.Moore, A.Boutot, M.Rispoli, and G.Lancioni. 2013. “An Analysis of the Generalization and Maintenance of Eye Contact Taught During Play.” Developmental Neurorehabilitation16: 301–307. doi:https://doi.org/10.3109/17518423.2012.730557. 

  44. Papagiannopoulou, E. A., K. M.Chitty, D. F.Hermens, I. B.Hickie, and J.Lagopoulos. 2014. “A Systematic Review and Meta-analysis of Eye-tracking Studies in Children with Autism Spectrum Disorders.” Social Neuroscience9 (6): 1–23. doi:https://doi.org/10.1080/17470919.2014.934966. 

  45. Parsons, S., A.Leonard, and P.Mitchell. 2006. “Virtual Environments for Social Skills Training: Comments from two Adolescents with Autistic Spectrum Disorder.” Computers and Education47: 186–206. doi:https://doi.org/10.1016/j.compedu.2004.10.003. 

  46. Pearson, A., D.Ropar, and A. F.de C Hamilton. 2013. “A Review of Visual Perspective Taking in Autism Spectrum Disorder.” Frontiers in Human Neuroscience, 652. doi:https://doi.org/10.3389/fnhum.2013.00652. 

  47. Riby, D., and P. J. B.Hancock. 2009. “Looking at Movies and Cartoons: Eye-Tracking Evidence from Williams Syndrome and Autism.” Journal of Intellectual Disability Research: JIDR53 (2): 169–181. doi:https://doi.org/10.1111/j.1365-2788.2008.01142.x. 

  48. Riby, D. M., P. J.Hancock, N.Jones, and M.Hanley. 2013. “Spontaneous and Cued Gaze-Following in Autism and Williams Syndrome.” Journal of Neurodevelopmental Disorders5 (1): 13. doi:https://doi.org/10.1186/1866-1955-5-13. 

  49. Rutherford, M., K.McKenzie, T.Johnson, C.Catchpole, A.O’Hare, I.McClure, K.Forsyth, D.McCartney, and A.Murray. 2016. “Gender Ratio in a Clinical Population Sample, Age of Diagnosis and Duration of Assessment in Children and Adults with Autism Spectrum Disorder.” Autism : The International Journal of Research and Practice epub ahead of publishing. doi:https://doi.org/10.1177/1362361315617879. 

  50. Schilbach, L., S. B.Eickhoff, E. C.Cieslik, B.Kuzmanovic, and K.Vogeley. 2012. “Shall we do this Together? Social Gaze Influences Action Control in a Comparison Group, but not in Individuals With High-Functioning Autism.” Autism16 (2): 151–162. doi:https://doi.org/10.1177/1362361311409258. 

  51. Silinskas, G., E.Pakarinen, P.Niemi, M. K.Lerkkanen, A. M.Poikkeus, and J. E.Nurmi. 2016. “The Effectiveness of Increased Support in Reading and its Relationship to Teachers’ Affect and Children’s Motivation.” Learning and Individual Differences45: 53–64. doi:https://doi.org/10.1016/j.lindif.2015.11.025. 

  52. Spencer, S. J., C.Logel, and P. G.Davies. 2015. “Stereotype Threat.” Annual Review of Psychology67: 415–37. doi:https://doi.org/10.1146/annurev-psych-073115-103235. 

  53. Strnadová, I., T.Cumming, and E.Marquez. 2014. “Parents’ and Teachers’ Experiences with Mobile Learning for Students with High Support Needs.” Special Education Perspectives23 (2): 43–55. 

  54. Tager-Flusberg, H., and C.Kasari. 2013. “Minimally Verbal School-Aged Children with Autism Spectrum Disorder: The Neglected End of the Spectrum.” Autism Research6: 468–478. doi:https://doi.org/10.1002/aur.1329. 

  55. Vismara, L. A., and G. L.Lyons. 2007. “Using Perseverative Interests to Elicit Joint Attention Behaviors in Young Children with Autism: Theoretical and Clinical Implications for Understanding Motivation.” Journal of Positive Behavior Interventions9: 214–228. doi: https://doi.org/10.1177/10983007070090040401. 

  56. Warreyn, P., H.Roeyers, T.Oelbandt, and I.De Groote. 2005. “What are you Looking at? Joint Attention and Visual Perspective Taking in Young Children with Autism Spectrum Disorder.” Journal of Developmental Physical Disabilities17: 55–73. doi:https://doi.org/10.1007/s10882-005-2201-1. 

  57. Wass, S. V., and K.Porayska-Pomsta. 2014. “The Uses of Cognitive Training Technologies in the Treatment of Autism Spectrum Disorders.” Autism: The International Journal of Research and Practice18 (8): 851–871. doi:https://doi.org/10.1177/136236131349982. 

  58. Wing, L., and J.Gould. 1979. “Severe Impairments of Social Interaction and Associated Abnormalities in Children: Epidemiology and Classification.” Journal of Autism and Developmental Disorders9 (1): 11–29. Accessed from http://link.springer.com/article/10.1007/BF01531288. doi: https://doi.org/10.1007/BF01531288