Next Article in Journal
Design Thinking in Higher Education Case Studies: Disciplinary Contrasts between Cultural Heritage and Language and Technology
Previous Article in Journal
Competences Expected and Gained during the Teaching Practicum: Analysis of Three Competence Areas Affected during the Pandemic
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Supporting Learning Differences: Effects of Cognitive Training on Cognitive Abilities in a School-Based Sample

1
Department of Child Development, California State University, San Bernardino, CA 92407, USA
2
Institute for Child Development and Family Relations, California State University, San Bernardino, CA 92407, USA
3
Wiest Neuropsychology Inc., Orange, CA 92866, USA
*
Author to whom correspondence should be addressed.
Educ. Sci. 2024, 14(1), 89; https://doi.org/10.3390/educsci14010089
Submission received: 9 October 2023 / Revised: 11 January 2024 / Accepted: 11 January 2024 / Published: 15 January 2024
(This article belongs to the Section Education and Psychology)

Abstract

:
A growing body of research demonstrates the effectiveness of computerized cognitive training (CCT) in building specific abilities (e.g., working memory) among school-age children. As a result, CCT is increasingly cited as a means to enhance and support students’ academic performance and school experience. However, many studies exploring CCT as an intervention have done so outside of the school setting, limiting its potential impact with regard to students who may benefit from it but cannot access such supports. This project examined the efficacy of a CCT program implemented within the academic day for all students attending a private school. The findings showed that two CCT programs resulted in improvements in working memory, cognitive flexibility, and/or processing speed among third graders through sixth graders (N = 95). Furthermore, this project demonstrates a model for the effective integration of CCT into a school day without interrupting the academic curriculum. The present results have important implications for the current ideological shift in education that focuses on how to more broadly address students’ learning differences.

1. Introduction

The field of education has experienced an increasing awareness of the complex factors affecting children’s academic success [1,2,3]. Attentiveness to children’s social–emotional growth, mental health, cultural backgrounds, and exposure to trauma have been at the forefront of discussions within educational spheres, acknowledging the increasing diversity of the student population [2,4,5]. A byproduct of the consideration given to variability in the student body is the greater amount of attention paid to aspects of neurodiversity [6,7]. More specifically, greater recognition has been given to the idea that some children experience learning differences (e.g., cognitive, behavioral, or emotional challenges that impact academic performance) [5,8,9], and research has highlighted where those differences might originate [10,11,12,13] as well as how to mitigate differences that might not align well with typical academic expectations [14,15,16,17,18].
An area of focus on work related to learning differences is cognitive ability, as certain cognitive skills are known to contribute to students’ academic functioning [3]. For instance, it is well documented in the literature that cognitive proficiencies related to working memory (WM) and executive function (EF) play an integral role in academic success [3,19,20,21,22,23]. Mentally holding, manipulating, and recalling information that is perceived (WM), as well as managing one’s attention, emotions, and behaviors (EF), allow a student to attend to and process academic information in a way that increases their understanding and learning and results in more positive academic outcomes [24,25,26]. However, deficits in WM and EF often result in poor performance and/or behavior in the classroom [8,22,23,24,25,27], as students who struggle with these cognitive functions might have trouble staying focused, remembering key elements of a task, and/or maintaining behavior that is productive to learning [24,25,28].
While the relationship between WM, EF, and school achievement has been documented in the literature for some time, acknowledgement of (and acceptance for) the variation in WM and EF abilities across the student population has gained traction more recently in comparison [29,30,31,32]. Specifically, rather than basic research simply documenting differences in WM and EF functionality among learners, more recent work is bridging the gap between neuropsychology and education, moving in the direction of highlighting educational interventions (e.g., teaching strategies, training cognitive abilities, and student supports) that can be successful in supporting students who struggle with academic success as a function of deficits in WM and EF capabilities [18,33,34]. In other words, given the important role that WM and EF play in academic performance, some researchers and educators have prioritized the need to examine how teaching and other strategies (e.g., motivational techniques and classroom management) can reach an increasingly diverse student population.
In short, an ideological shift can be seen in education—one in which learning differences are acknowledged, even when they do not translate into diagnosable learning disabilities [5]. Inherent in this shift is the increased attention given to supporting all learners—not just those that might qualify for special education [5]. Whether intentional or not, this body of work serves to (a) acknowledge the role of educators in accepting learning differences, and therefore, the diversity of their student population; (b) broaden the historically narrow focus of teaching to the average learner, highlighting that much success comes from meeting students where they are neurologically and academically; and (c) move the direction of cognitive research to an applied emphasis, allowing for educators to implement strategies to create meaningful change. Therefore, increasing the examination of supports and interventions that can help to ameliorate deficits in cognitive functioning takes on added importance.

1.1. Variability in Cognitive Functioning and Academic Success

Variability in academic success has been attributed to numerous factors. While some reasons are related to teacher quality [35,36,37], parental support [35,38], and classroom strategies [35,39], cognitive functioning skills are particularly significant, as the academic tasks that students encounter require the effective and fluid engagement of a variety of cognitive abilities. Skills such as attention, retention, planning, and the regulation of both emotion and behavior all contribute to the learning process [22,40,41]. Core academic subjects, such as reading, writing, and math, all involve intricate WM and EF abilities [11,42,43], as these subjects require students to derive meaning from letters and words [44,45,46,47] and mentally manipulate numbers in math problems [13,48,49]. Thus, speed and efficiency in processing information [28,44,50], attentive behavior [41,51], and effective emotional regulation [40] are fundamental to learning. When students can effectively process and manipulate the information they take in from the environment (WM skills) while simultaneously maintaining their goals, following rules and directions, persisting through obstacles, and planning how to start and complete tasks (EF skills), academic success is more likely to result [8,19,20,21,22,23,52].
While academic functioning requires WM and EF skills, there are clear individual differences in these capabilities, leading to classrooms made up of both children who excel and others who struggle [27,53]. When WM and EF deficits are experienced, students have difficulty acquiring new knowledge, and over time, this can create learning gaps [24]. Increased academic responsibilities and more difficult school tasks can be associated with greater demands on WM as children progress through each grade [8,50]; therefore, students that have less-developed WM struggle more over time, as they experience increasingly independent learning expectations [8,50]. Additionally, students who struggle with WM and EF abilities are often identified by teachers as having poor behavior in the academic setting [24,25], leading to the potential formation of negative student perceptions from teachers [17,25]—another strike against academic success.
For these reasons, the early identification and intervention of cognitive difficulties can play a pivotal role in ameliorating any negative academic outcomes [54,55,56,57]. While deficits in WM and EF are often associated with various mathematical and reading disabilities [11,42,58] and the diagnosis of attention deficit hyperactivity disorder (ADHD) [59,60], not all students who experience WM and EF difficulties meet the criteria for formal diagnosable outcomes that lead to routinized or state-funded supports. Thus, as education continues to shift toward recognizing and valuing student diversity and works to be more inclusive in supportive practices, finding interventions that can be available to all students who might experience learning differences becomes important.

1.2. Cognitive Training to Support Learning Differences

When it comes to children who learn differently and experience deficits in the important WM and EF skills that contribute to positive academic outcomes, one area of work that has shown promising results is the use of computerized cognitive training as an intervention tool [32,34,61]. Computerized cognitive training (CCT) involves the use of brain game programs that target a variety of cognitive skills with the goal of enhancing these abilities and, ultimately, helping to increase academic achievement in children with a broad range of academic difficulties [18,34,61,62]. Studies on CCT have successfully demonstrated improvements in reading [63,64] and math [63,65] following training, with variability in levels of effectiveness attributed to factors such as the length of training [66], the cognitive or academic skills being targeted [63,67], the type of game elements within the training [64], the amount of supervision during the training [66], and the level of motivation for the training task [68].
While CCT is often used to enhance WM, studies have shown that WM contributes to EF skills, as children who have higher WM abilities also demonstrate higher proficiency in their attentiveness, planning ability, cognitive flexibility, problem solving, and self-regulation of behavior [9,25]. Therefore, CCT can also play a pivotal role in supporting children who struggle with a variety of cognitive abilities (e.g., EF and WM); this is especially important as EF and WM do not necessarily operate in isolation in impacting academic performance [26]. Instead, both WM and EF exist as foundational components to educational success [3], and CCT has resulted in improvements in both [18,34,61,64].
Given the positive results seen in previous research, CCT shows potential as an intervention that can assist with learning differences. However, over the course of the past couple of decades, as CCT research has been conducted and as this work has moved into the educational realm, one criticism has been the setting in which CCT has taken place. More specifically, much of the work in CCT has resulted in methodologies in which pre- and post-test analyses of cognitive abilities are run within a clinical or school setting, while the intervention itself is run outside of the controlled setting (e.g., at home) [63]. As researchers and educators work to understand CCT as a viable educational intervention for deficits in cognitive abilities, more calls have surfaced for understanding CCT as a part of the school curriculum [18,63].

1.3. Cognitive Training and the School Environment

School systems are designed to support students who struggle academically. For instance, school psychologists engage in assessment practices that allow for the identification of a student’s existing abilities relative to their academic achievement, with the purpose of obtaining access to special education services for students who demonstrate a discrepancy between actual and expected learning outcomes [69]. However, not all students who struggle with academic success qualify for services, and not all have a diagnosable learning disability, leaving a segment of the student population still struggling to achieve their desired academic outcomes [55,69]. In these cases, there is a need for intervention; however, no formalized mechanism exists by which students who do not qualify can receive support. It is in these situations, in particular, that a school-day CCT program might prove to be especially effective.
The notion of CCT being implemented during school is consistent with the ideological shift that is presently being seen in education that broadens the scope of identification and emphasizes the need to meet the diverse academic needs of all children, including those that might experience processing deficits that do not result in formalized services [5]. As this shift has begun to take form, traditionally outsourced services that might serve as educational interventions (e.g., mental health services) are increasingly moved into the school setting and offered during the school day [5]. The recognition that services and support must be provided within a school space has resulted (in part) from educators and other professionals raising awareness that access to care outside of schools can vary largely based on students’ area of residence and socioeconomic status [5,55], leaving more marginalized groups with fewer services. Ultimately, the issue of where services (e.g., CCT) are accessible raises important system-level questions for the field of education.

1.4. The Current Study

In an effort to work toward finding support for students identified as having learning differences, as well as for the broader population of students that might experience learning challenges as a result of unidentified neurological weaknesses, the current study aimed to examine the effects of a computerized cognitive training (CCT) program on students enrolled in a school for children with learning differences. This study seeks to add to the existing literature by (1) examining the effectiveness of a CCT program in improving cognitive abilities and (2) evaluating the effectiveness of a CCT program that is incorporated into the school’s curriculum. With regard to the first objective (i.e., examining the effectiveness of CCT), it is hypothesized that cognitive training will improve WM, cognitive flexibility, and processing speed. The second and primary objective (i.e., effectively integrating CCT into the school day) represents an important step toward addressing (and possibly substantiating) the ideological shift in education that seeks to better serve and support students.

2. Methods

2.1. Participants

A total of 95 students (nfem = 35) participated in this study. Participants were school-age students in grades three through six (Mage = 11.66 years, SD = 1.69) attending a private school in the Southern California area that serves children with learning differences. Fifty-three percent of the students reported their ethnicity to be of European origin. In general, families with children attending the school tend to be of a higher socio-economic status; however, the school provides scholarships to some students to support their enrollment. All participants were treated in accordance with the APA principles code of conduct.

2.2. Measures

Wechsler Intelligence Scale for Children (WISC-V). The WISC-V is a normed reference measure of cognitive abilities. The Digit Span, Coding, and Symbol Search subtests were utilized in this project. The Digit Span task is a measure of working memory (and indirectly, it is a measure of short-term attention). Completion of the Digit Span task requires the individual to (1) recite a series of numbers in the same order as they are verbally presented, (2) recite a series of numbers in reverse order, and (3) recite a series of numbers in counting order. The Coding and Symbol Search tasks are measures of processing speed. The Coding task requires an individual to (as rapidly as possible) draw the associated symbol for a given number. On the other hand, the Symbol Search task requires an individual to encode two target symbols and then determine whether one of the two targets is present in a set of symbols presented adjacent to the targets. Performance on the WISC-V subtests are reported as scaled scores, ranging from 1 to 19, with a mean score of 10.
Delis-Kaplan Executive Function System (DKEFS). The DEFS is a norm-referenced measure of executive function. The Trail Making Task was used to measure cognitive flexibility (or cognitive switching). Trail Making contains five conditions. The first three conditions are measures of scanning abilities and short-term attention under timed conditions. Condition 4 is the measure of cognitive flexibility (and, indirectly, short-term attention). In this condition, an individual is asked to (as rapidly as possible) connect circles using numbers and letters in numerical and alphabetical order, respectively; however, the numbers and letters must be alternately connected. That is, the individual connects 1 to A, 2 to B, 3 to C, etc., until all of the circles are connected. The final condition is a measure of motor speed (and, indirectly, short-term attention). Performance on Condition 4 is described with a scaled score, ranging from 1 to 19 with a mean of 10.
Computerized Cognitive Training (CCT). Two iPad-based CCT programs were used in this study: Recollect the Study and Sightseeing. Both CCT programs were created and developed by the University of California, Riverside’s Brain Game Center and are adaptive in that they adjust according to a player’s performance in real-time. Specifically, each program becomes more or less challenging based upon a player’s current performance. Recollect the Study is primarily designed to train working memory by using a classic n-back and an Item Span task that have been gamified (made to look like and be experienced like a game). During the program, players travel through space, collecting “gems” based on a rule (e.g., they collect a gem if it matches a gem 1-back or collect a gem if it matches a gem 2-back, etc.). The n-back level increases as an individual’s performance improves; on the other hand, the CCT automatically adjusts the n-back level downward if the participant is making errors in their responses. Engaging in Recollect the Study effectively requires considerable attention and concentration; thus, both are trained as part of engaging in the program. Sightseeing is a visual processing program. During the task, players must select low-contrast targets that are displayed against a light grey background as quickly as possible. Targets change in appearance (shape and contrast) as the program proceeds; at times, the player is presented with a small number of targets to identify, while in other trials, they are presented with a large number of targets to select. Additionally, as the program progresses, decoys (or non-targets) are presented along with targets. Thus, Sightseeing requires sustained attention and inhibition capabilities (along with visual processing skills).

2.3. Procedure

Information flyers along with the informed consent form were sent home to all families with a student enrolled at the school. These flyers described the implementation of a CCT program into the students’ school day that would also include establishing baseline indicators of cognitive abilities and the measurement of the same abilities following the CCT. Participants were pulled out of class to complete pre-testing on all cognitive measures (i.e., the WISC-V and DKEFS subtests) in order to establish a baseline prior to the CCT; these measures were administered by research personnel. Following baseline testing, random assignment was used to assign each participant to either Recollect the Study or Sightseeing for a total of six hours of training across 18 sessions (delivered on Mondays through Thursdays); Fridays were used as a make-up day for any participant who missed training earlier in the week. All training sessions occurred in the participant’s classroom during the school day; thus, this CCT program was treated as a part of the school day, just as any other academic subject or experience is a part of the school day. The participant’s teacher administered the CCT daily and provided the necessary support to each participant (again, as would be the case if the teacher was teaching an academic subject). Upon the completion of the 18 sessions, each participant completed the WISC-V and DKEFS subtests again (using a pull-out approach identical to the baseline phase).
Because the teachers are integral to the effective implementation of CCT in their respective classrooms, all of them received 3 h and 40 min of training on both CCT programs prior to administering the CCT. The training was broken down into a 90 min introduction to the programs, and then the teachers engaged with each program for 10 min while being observed; feedback was provided (as needed) while they played (i.e., practiced) the program from the perspective of the student. Then, teachers were given an iPad and instructed to play for another 2 h and 20 min on their own over the course of a week. Following the week-long practice, iPads were returned, and any questions from the teachers were addressed. Research personnel provided all of the training for the teachers.

2.4. Design and Statistical Analysis

The current study implemented a pretest–posttest experimental design to test the effectiveness of CCT (implemented during the school day) on improving (1) WM, (2) cognitive flexibility, and (3) processing speed. One-way repeated measures ANOVAs were conducted for each training group, with pretest and posttest differences for WM, cognitive flexibility, and processing speed abilities serving as the dependent variables. Partial eta-squares were reported as measures of effect size [70]. Partial eta-squares ranging from 0.01 to 0.06 were considered to be small, those ranging from 0.07 to 0.13 were considered to be moderate, and any value above 0.14 was considered to be a large effect [70].

3. Results

In this study, data for 95 participants are presented. Descriptive statistics for each measure are presented below in Table 1 for the Recollect training group and in Table 2 for the Sightseeing training group. Normality was approximated for the dependent variables, and no outliers were detected. Homogeneity of variance was violated, so the Greenhouse–Geisser correction was applied. One-way repeated measures ANOVAs were conducted on working memory, cognitive flexibility, and processing speed. For each training group, the pre- to posttest differences were examined. The results are presented in the following order: working memory, cognitive flexibility, and processing speed.

3.1. Working Memory

A one-way repeated measures ANOVA with a Greenhouse–Geisser correction was conducted for the experimental training group who completed Recollect the Study (n = 50), with the dependent variable being Digit Span scores that represent WM capacity. The results indicated that there was no significant pre- (M = 7.38) to posttest (M = 7.64) difference in the Digit Span scores for the Recollect training group (F(1,49) = 0.91, p = 0.34, η2 = 0.02).
In addition, a one-way repeated measures ANOVA with a Greenhouse–Geisser correction was conducted for the Sightseeing training group (n = 45), with the dependent variable being Digit Span scores that represent WM capacity. In line with our predictions, the results show that there was a significant pre- to posttest difference in the Digit Span scores for the Sightseeing training group, such that the posttest scores (M = 7.13) were greater than the pretest scores (M = 6.40) (F(1,44) = 5.69, p < 0.05, η2 = 0.06). The partial eta-squared value indicates a small effect.

3.2. Cognitive Flexibility

A one-way repeated measures ANOVA with a Greenhouse–Geisser correction was conducted for the experimental training group who completed Recollect the Study (n = 50), with the dependent variable being Trail Making task scores that represent cognitive flexibility. As predicted, the results indicated that there was a significant pre- to posttest difference in the Trail Making task scores for the Recollect training group, such that the posttest scores (M = 5.68) were greater than the pretest (M = 4.52) scores (F(1,49) = 4.41, p < 0.05, η2 = 0.08). The eta-squared value indicates a moderate to large effect of the training intervention on the cognitive flexibility scores. Overall, for those engaging in Recollect the Study, there were significant improvements in cognitive flexibility.
Additionally, a one-way repeated measures ANOVA with a Greenhouse–Geisser correction was conducted for the Sightseeing group (n = 45) with the dependent variable being the Trail Making scores that represent cognitive flexibility. The results show that there was a significant pre- to posttest difference in the Trail Making scores for the Sightseeing training group, such that the posttest scores (M = 5.80) were greater than the pretest scores (M = 4.76) (F(1,44) = 5.69, p < 0.05, η2 = 0.08). The partial eta-squared value indicates a moderate to large effect.

3.3. Processing Speed

3.3.1. Coding

A one-way repeated measures ANOVA with a Greenhouse–Geisser correction was conducted for the training group who completed Recollect the Study (n = 50), with the dependent variable being the Coding scores that represent processing speed. As predicted, the results indicated that there was a significant pre- to posttest difference in the Coding scores for the Recollect training group, such that the posttest scores (M = 7.76) were greater than the pretest (M = 7.22) scores (F(1,49) = 4.57, p < 0.05, η2 = 0.09). The eta-squared value indicates a moderate to large effect of the training intervention on the processing speed scores. Overall, for those engaging in Recollect the Study, there were significant improvements in the processing speed.
Further, a one-way repeated measures ANOVA with a Greenhouse–Geisser correction was conducted for the Sightseeing training group (n = 45), with the dependent variable being Coding scores that represent processing speed. The results indicated that there was no significant pre- to posttest difference in the Coding scores for the Sightseeing training group, such that the posttest scores (M = 7.62) were not greater than the pretest (M = 7.24) scores (F(1,44) = 2.60, p = 0.11, η2 = 0.05).

3.3.2. Symbol Search

A one-way repeated measures ANOVA with a Greenhouse–Geisser correction was conducted for the experimental training group who completed Recollect the Study (n = 50), with the dependent variable being the Symbol Search scores, which also represent processing speed. Contrary to our predictions, the results indicated that there was no significant pre- to posttest difference in the Symbol Search scores for the Recollect training group, such that the posttest scores (M = 8.22) and pretest scores (M = 7.88) did not differ (F(1,49) = 0.69, p = 0.41, η2 = 0.01).
Moreover, a one-way repeated measures ANOVA with a Greenhouse–Geisser correction was also conducted for the Sightseeing training group (n = 45), with the dependent variable being the Symbol Search scores that represent processing speed. The results indicated that there was no significant pre- to posttest difference in the Symbol Search scores for the Sightseeing training group, such that the posttest scores (M = 8.11) and pretest scores (M = 7.82) did not differ (F(1,44) = 0.52, p = 0.47, η2 = 0.01).

4. Discussion

A major tenet of the ideological shift that currently characterizes the field of education focuses on how to best address the learning needs of children within the school setting. Notable shifts have occurred in the recognition of a neurodiverse student population [5], with educators and other professionals acknowledging that academic support services are needed to support both children who have diagnosable learning differences as well as those who experience academic challenges that do not result in qualification for formalized services [5]. Variability in cognitive abilities is one factor that contributes to diverse learning outcomes [22,27,40,41,53], and while cognitive interventions (e.g., CCT) have been associated with increases in cognitive skills [18,34,61,62], the implementation of these interventions within the school setting has been lacking, as has a larger body of research that examines the efficacy of CCT interventions during the school day. The primary purpose of this project was to examine the efficacy of cognitive training (CCT) as an educational intervention implemented during children’s time at school. This project employed two types of training, each focused on specific cognitive abilities that are significantly correlated with academic outcomes. Our results demonstrate that both training interventions produced significant improvements in working memory, cognitive flexibility, and/or processing speed among students at a school for children with learning differences. Beyond the importance of demonstrating treatment effects, this study also highlights the viability of implementing training during the school day without interrupting the academic curriculum.

4.1. Efficacy of Cognitive Training

A growing body of research has consistently demonstrated that various cognitive skills are positively correlated with successful learning outcomes [14,19,44,51]. Children who attend to the tasks given to them, retain information (e.g., reading material and assignment instructions), process class information efficiently, and plan strategies to monitor their learning and achievement tend to perform more successfully in the classroom when compared to children who do not employ these strategies [8,19,20,21,22,23,52]. Research has also shown that the ability to attend, retain, process, and plan has wide variability, with some students demonstrating strong skill, and others exhibiting lesser degrees of cognitive capacity, and that this variability can account for differing academic outcomes in the classroom [8,27,53]. Therefore, interventions that can be put into place to assist children who struggle with these cognitive abilities, with the goal of increasing the skills that relate to academic success, is one way to help reduce the achievement gap often seen in educational environments.
As the results of this study showed, positive changes were seen in the students’ working memory, processing speed, and cognitive flexibility as a function of participation in a CCT program. For the students in the Recollect training group, significant improvements were seen in the measures of cognitive flexibility and processing speed, while their working memory did not change. The students in the Sightseeing training group experienced positive significant changes in working memory and cognitive flexibility, but not in processing speed. Although there was variation in which cognitive skills improved across the two training programs, the positive results indicate that specific abilities can be enhanced. In general, the current results are consistent with previous work documenting the effectiveness of CCT (see [32,34,62]) in enhancing attributes such as WM and EF. Although not directly addressed in the present study, these treatment effects have important implications, as some published studies have shown that improvements in cognitive skills following CCT are associated with school achievement [63,64,65].
It should be noted that while both intervention tools (i.e., Recollect and Sightseeing) are designed to target specific cognitive capabilities, each tool resulted in different outcomes, even for the same cognitive skills. For instance, working memory was enhanced with Sightseeing, but not with Recollect; cognitive flexibility showed improvements for both the Recollect and Sightseeing groups; and variations in processing speed were demonstrated, with the Recollect group showing higher speeds, but not the Sightseeing group. While on the surface, these mixed results seem to call into question the validity of the training programs, it is important to point out that varied findings in intervention research are not uncommon, leading some cognitive scholars to attribute this inconsistency to the lack of process pure cognitive activities [71]. In other words, given the complexity of cognitive abilities, it is highly likely that even though a cognitive measure might be designed to measure processing speed (for example), other cognitive processes (e.g., attention, inhibition, planning, and working memory) might also be simultaneously assessed [71]. Similarly, a specific CCT program does not likely target only one cognitive ability with the expectation that only the targeted skill will be improved following training. In most cases (if not all), it is likely that a CCT program is exercising multiple cognitive abilities simultaneously. Thus, training one skill is associated with improvements in other skills. For example, a CCT program might be designed to train WM, but following training, children will demonstrate greater proficiency in their attentiveness, planning ability, problem solving, and self-regulation of behavior as well. Future research should continue to work on the conceptualization and measurement of cognitive functions (see [71] for a more thorough discussion) in order to enhance the applied nature of CCT.

4.2. Implementation of Intervention during the School Day

While the enhancement of cognitive skills used in the successful completion of academic tasks is an important implication of the current results, the significance of the applied nature of the findings arguably has a deeper implication. As the education field moves toward an increased recognition that academic supports should be put in place for all learners—even when they do not quality for services—accessible intervention programs that can be integrated into the school day curriculum are needed. The current results provide evidence for such a program. While tested in a private school for children with learning differences, the model implemented in this study is one that can be executed in many school settings that serve a broad range of students who have a variety of learning needs.
Because large amounts of work conducted in the area of CCT have found successful treatment results for increasing children’s cognitive abilities (see [32,34,72,73]), there is a pressing need to address how training might be meaningfully implemented within the educational setting. While successful intervention results are important, if the interventions are not accessible or easy to implement, the feasibility of the approach is questionable. Moreover, moving toward increasing the accessibility of intervention strategies within the school environment itself is critical to the applied nature of the work. This study contributes to this movement through the demonstration of an approach that bridges the gap between neuropsychology and education. That is, much of the CCT work has focused on how WM and EF deficits can be mitigated with this type of training [32,34,62]. At the same time, education scholars have highlighted the neurodiverse nature of the student population [7,74]. Further, researchers have demonstrated that cognitive skills trained by CCT can play a role in a student’s successful academic achievement [63,64,65]. This study makes an important contribution to the literature by bringing together each of these strands of research. Students in this study participated in one of two CCT programs while at school. Further, their participation during the school day was manageable, as the 20 min period per day in which training took place resulted in successful findings without heavily interfering with time needed for other aspects of the planned curriculum.

5. Conclusions

As educators and other professionals within educational settings move toward embracing the complexity of the diverse learners with whom they work, recognition for strategies and interventions that increase successful academic outcomes for a wider number of students becomes an important focus. Broadening conceptualizations of what it means to be neurodiverse, coupled with recognizing the value of meeting students where they are (both in cognitive capacity and academic aptitude), opens the door for creating educational environments where many can thrive. Providing intervention supports that can target segments of the student population for which formalized services are not available and are carried out within a school day (thereby increasing the accessibility of supports) is a step toward meaningful educational change. Beyond the importance of demonstrating treatment effects, this study highlights the viability of implementing a cognitive training program for children with learning differences during the school day without interrupting the academic curriculum. Overall, the current project represents a potential model for how evidence-based educational interventions may be integrated into the school day to increase equitable access to school performance-supporting experiences for all students.

Author Contributions

Conceptualization, L.L., E.H.W., K.P.R. and D.J.W.; methodology, L.L., E.H.W. and K.P.R.; formal analysis, L.L., E.H.W. and K.P.R.; writing—original draft preparation, L.L., E.H.W., K.P.R. and J.M.B.; writing—review and editing, L.L., E.H.W. and K.P.R.; supervision, L.L., E.H.W. and K.P.R.; project administration, L.L., E.H.W., K.P.R., J.M.B. and D.J.W. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by the Schlinger Family Foundation.

Institutional Review Board Statement

This project has been approved by the Institutional Review Board at California State University, San Bernardino (IRB-FY2021-198). Approval date: 9 February 2023.

Informed Consent Statement

Informed consent was obtained from all subjects involved in this study.

Data Availability Statement

The data presented in this study are available on request.

Conflicts of Interest

Wiest Neuropsychology Inc. had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results. All authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  1. Bronfenbrenner, U. The Ecology of Human Development; Harvard University Press: Cambridge, MA, USA, 1979. [Google Scholar]
  2. Higgens, S.; Mosko, M. Mental health and cultural and linguistic diversity as challenges in school? An interview study on the implications for students and teachers. PLoS ONE 2020, 15, e0236160. [Google Scholar] [CrossRef] [PubMed]
  3. Miller, D.C.; Maricle, D.E. Essentials of School Neuropsychological Assessment, 3rd ed.; John Wiley: Hoboken, NJ, USA, 2019. [Google Scholar]
  4. Fallon, L.M.; Defouw, E.R.; Berkman, T.S.; Cathcart, S.C.; O’Keefe, B.V.; Sugai, G. Supports to improve academic outcomes with racially and ethnically minoritized youth: A review of research. Remedial Spec. Educ. 2022, 43, 237–254. [Google Scholar] [CrossRef]
  5. Hughes, T.L.; Hess, R.; Jones, J.; Worrell, F.C. From traditional practice to tiered comprehensive services for all: Developing a responsive school culture for the future. Sch. Psychol. 2020, 35, 428–439. [Google Scholar] [CrossRef]
  6. Pellicano, E.; den Houting, J. Annual research review: Shifting from ‘normal science’ to neurodiversity in autism science. J. Child Psychol. Psychiatry 2022, 63, 381–396. [Google Scholar] [CrossRef]
  7. Rappolt-Schlichtmann, G.; Boucher, A.R.; Evans, M. From deficit remediation to capacity building: Learning to enable rather than disable students with dyslexia. Lang Speech Hear. Serv. Sch. 2018, 49, 864–874. [Google Scholar] [CrossRef] [PubMed]
  8. Alloway, T.P.; Carpenter, R.K. The relationship among children’s learning disabilities, working memory, and problem behaviours in a classroom setting: Three case studies. Educ. Dev. Psychol 2020, 37, 4–10. [Google Scholar] [CrossRef]
  9. Alloway, T.P.; Gathercole, S.E.; Elliott, J. Examining the link between working memory behaviour and academic attainment in children with ADHD. Dev. Med. Child. Neurol. 2010, 52, 632–636. [Google Scholar] [CrossRef] [PubMed]
  10. Brandenburg, J.; Klesczewski, J.; Fischbach, A.; Schuchardt, K.; Buttner, G.; Hasselhorn, M. Working memory in children with learning disabilities in reading versus spelling: Searching for overlapping and specific cognitive factors. J. Learn. Disabil. 2015, 48, 622–634. [Google Scholar] [CrossRef]
  11. Bull, R.; Scerif, G. Executive functioning as a predictor of children’s mathematics ability: Inhibition, switching, and working memory. Dev. Neuropsychol. 2001, 19, 273–293. [Google Scholar] [CrossRef]
  12. Peng, P.; Barnes, M.; Wang, C.; Wang, W.; Li, S.; Swanson, H.L.; Dardick, W.; Tao, S. A meta-analysis on the relation between reading and working memory. Psychol. Bull. 2018, 144, 48–76. [Google Scholar] [CrossRef]
  13. Ramirez, G.; Gunderson, E.A.; Levine, S.C.; Beilock, S.L. Math anxiety, working memory, and math achievement in early elementary school. J. Cogn. Dev. 2013, 14, 187–202. [Google Scholar] [CrossRef]
  14. Clair-Thompson, H.S.; Stevens, R.; Hunt, A.; Bolder, E. Improving children’s working memory and classroom performance. Educ. Psychol. 2010, 30, 203–219. [Google Scholar] [CrossRef]
  15. Diamond, A.; Ling, D.S. Review of evidence on, and fundamental questions about, efforts to improve executive functions, including working memory. In Cognitive and Working Memory Training: Perspectives from Psychology, Neuroscience, and Human Development; Novick, J.M., Bunting, M.F., Dougherty, M.R., Engle, R.W., Eds.; Oxford Scholarship Online: Oxford, UK, 2020. [Google Scholar] [CrossRef]
  16. Gathercole, S.E.; Lamont, E.; Alloway, T.P. Working memory in the classroom. In Working Memory and Education; Pickering, S., Ed.; Academic Press: London, UK, 2006; pp. 220–241. [Google Scholar] [CrossRef]
  17. Looney, L.; Wong, E.H.; Rosales, K.P.; Rosales, F.; Tirado, G. Teacher perceptions of working memory and executive function improvements following school-day cognitive training. Sch. Psychol. Int. 2023, 44, 48–67. [Google Scholar] [CrossRef]
  18. Wiest, D.J.; Wong, E.H.; Bacon, J.M.; Rosales, K.P.; Wiest, G.M. The effectiveness of computerized cognitive training on working memory in a school setting. Appl. Cogn. Psychol. 2020, 34, 465–471. [Google Scholar] [CrossRef]
  19. Alloway, T.P.; Alloway, R.G. Investigating the predictive roles of working memory and IQ in academic attainment. J. Exp. Child. Psychol. 2010, 106, 20–29. [Google Scholar] [CrossRef] [PubMed]
  20. Gathercole, S.E. Working memory in the classroom. Psychologist 2008, 21, 382–385. [Google Scholar]
  21. Maehler, C.; Schuchardt, K. Working memory in children with specific learning disorders and/or attention deficits. Learn. Individ Differ. 2016, 49, 341–347. [Google Scholar] [CrossRef]
  22. Spiegel, J.A.; Goodrich, J.M.; Morris, B.M.; Osborne, C.M.; Lonigan, C.J. Relations between executive functions and academic outcomes in elementary school children: A meta-analysis. Psychol. Bull. 2021, 147, 329–351. [Google Scholar] [CrossRef]
  23. Zelazo, P.D.; Carlson, S.M. The neurodevelopment of executive function skills: Implications for academic achievement gaps. Psychol. Neurosci. 2020, 13, 273–298. [Google Scholar] [CrossRef]
  24. Alloway, T.P.; Gathercole, S.E.; Kirkwood, H.; Elliott, J. The cognitive and behavioral characteristics of children with low working memory. Child Dev. 2009, 80, 606–621. [Google Scholar] [CrossRef]
  25. Gathercole, S.E.; Alloway, T.P.; Kirkwood, H.J.; Elliott, J.G.; Holmes, J.; Hilton, K.A. Attentional and executive function behaviours in children with poor working memory. Learn. Individ. Differ. 2008, 18, 214–223. [Google Scholar] [CrossRef]
  26. Miller, D.C. Essentials of School Neuropsychological Assessment, 2nd ed.; John Wiley: Hoboken, NJ, USA, 2013. [Google Scholar]
  27. Simone, A.N.; Marks, D.J.; Bedard, A.-C.; Halperin, J.M. Low working memory rather than ADHD symptoms predicts poor academic achievement in school-aged children. J. Abnorm. Child Psychol. 2018, 46, 277–290. [Google Scholar] [CrossRef]
  28. Tourva, A.; Spanoudis, G. Speed of processing, control of processing, working memory and crystallized and fluid intelligence: Evidence for a developmental cascade. Intelligence 2020, 83, 101503. [Google Scholar] [CrossRef]
  29. Buschkuehl, M.; Jaeggi, S. Improving intelligence: A literature review. Swiss. Med. Wkly. 2010, 140, 266–272. [Google Scholar] [CrossRef]
  30. Klingberg, T. Training and plasticity of working memory. Trends Cogn. Sci. 2010, 14, 317–324. [Google Scholar] [CrossRef]
  31. Morrison, A.B.; Chein, J.M. Does working memory training work? The promise and challenges of enhancing cognition by training working memory. Psychon. Bull. Rev. 2011, 18, 46–60. [Google Scholar] [CrossRef]
  32. Wiest, G.M.; Rosales, K.P.; Looney, L.; Wong, E.H.; Wiest, D.J. Utilizing cognitive training to improve working memory, attention, and impulsivity in school-aged children with ADHD and SLD. Brain Sci. 2022, 12, 141. [Google Scholar] [CrossRef]
  33. Gathercole, S.E.; Dunning, D.L.; Holmes, J.; Norris, D. Working memory training involves learning new skills. J. Mem. Lang. 2019, 105, 19–42. [Google Scholar] [CrossRef]
  34. Gray, S.; Chaban, P.; Martinussen, R.; Goldberg, R.; Gotlieb, H.; Kronitz, R.; Tannock, R. Effects of a computerized working memory training program on working memory, attention, and academics in adolescents with severe LD and comorbid ADHD: A randomized controlled trial. J. Child Psychol. Psychiatry 2012, 53, 1277–1284. [Google Scholar] [CrossRef]
  35. Bryce, C.I.; Bradley, R.H.; Abry, T.; Swanson, J.; Thompson, M.S. Parents’ and teachers’ academic influences, behavioral engagement, and first- and fifth-grade achievement. Sch. Psychol. 2019, 34, 492–502. [Google Scholar] [CrossRef]
  36. Jansen, T.; Meyer, J.; Wigfield, A.; Moller, J. Which student and instructional variables are most strongly related to academic motivation in K-12 education? A systematic review. Psychol. Bull. 2022, 148, 1–26. [Google Scholar] [CrossRef]
  37. Jimerson, S.R.; Haddock, A.D. Understanding the importance of teachers in facilitating student success: Contemporary science, practice, and policy. Sch. Psychol. Q. 2015, 30, 488–493. [Google Scholar] [CrossRef] [PubMed]
  38. Coyle-Eastwick, S.; Rueger, S.Y.; Chen, Z.J.; Case, S.P.; Chen, P.; Eveleigh, E. Support from mothers and fathers on academic functioning: More similarities than differences across socioeconomic groups. J. Child Fam. Stud. 2023, 32, 1946–1961. [Google Scholar] [CrossRef]
  39. Glover, T.A.; Reddy, L.A.; Crouse, K. Instructional coaching actions that predict teacher classroom practices and student achievement. J. Sch. Psychol. 2023, 96, 1–11. [Google Scholar] [CrossRef]
  40. Djambazova-Popordanoska, S. Implications of emotion regulation on young children’s emotional wellbeing and educational achievement. Educ. Rev. 2016, 68, 497–515. [Google Scholar] [CrossRef]
  41. Willner, C.J.; Gatke-Kopp, L.M.; Bierman, K.L.; Greenberg, M.T.; Segalowitz, S.J. Relevance of a neurophysiological marker of attention allocation for children’s learning-related behaviors and academic performance. Dev. Psychol. 2015, 51, 1148–1162. [Google Scholar] [CrossRef] [PubMed]
  42. Chiappe, P.; Siegel, L.S.; Hasher, L. Working memory, inhibitory control, and reading disability. Mem. Cogn. 2000, 28, 8–17. [Google Scholar] [CrossRef]
  43. Soto, E.F.; Irwin, L.N.; Chan, E.S.M.; Spiegel, J.A.; Kofler, M.J. Executive functions and writing skills in children with and without ADHD. Neuropsychology 2021, 35, 792–808. [Google Scholar] [CrossRef]
  44. Goring, S.A.; Schmank, C.J.; Kane, M.J.; Conway, A.R. Psychometric models of individual differences in reading comprehension: A reanalysis of Freed, Hamilton, and Long (2017). J. Mem. Lang. 2021, 119, 104221. [Google Scholar] [CrossRef]
  45. Morris, B.M.; Lonigan, C.J. What components of working memory are associated with children’s reading skills? Learn. Individ. Differ. 2022, 95, 102114. [Google Scholar] [CrossRef]
  46. Swanson, H.L. Reading comprehension and working memory in learning-disabled readers: Is the phonological loop more important than the executive system? J. Exp. Child. Psychol. 1999, 72, 1–31. [Google Scholar] [CrossRef] [PubMed]
  47. Swanson, H.L.; Kong, J.E. Working memory and reading: Is there evidence for an executive processing deficit? In Executive Function in Education: From Theory to Practice; Meltzer, L., Ed.; The Guilford Press: New York, NY, USA, 2018; pp. 218–239. [Google Scholar]
  48. Gunderson, E.A.; Ramirez, G.; Beilock, S.L.; Levine, S.C. The relation between spatial skill and early number knowledge: The role of the linear number line. Dev. Psychol. 2012, 48, 1229–1241. [Google Scholar] [CrossRef]
  49. Zheng, X.; Swanson, H.L.; Marcoulides, G.A. Working memory components as predictors of children’s mathematical word problem solving. J. Exp. Child Psychol. 2011, 110, 481–498. [Google Scholar] [CrossRef] [PubMed]
  50. Pickering, S.J. The development of visuo-spatial working memory. Memory 2001, 9, 423–432. [Google Scholar] [CrossRef] [PubMed]
  51. Razza, R.A.; Martin, A.; Brooks-Gunn, J. The implications of early attentional regulation for school success among low-income children. J. Appl. Dev. Psychol. 2012, 33, 311–319. [Google Scholar] [CrossRef]
  52. Kyttala, M.; Kanerva, K.; Munter, I.; Bjorn, P.M. Working memory resources in children: Stability and relation to subsequent academic skills. Educ. Psychol. 2019, 39, 709–728. [Google Scholar] [CrossRef]
  53. Alloway, T.P.; Gathercole, S.E. How does working memory work in the classroom? Educ. Res. Rev. 2006, 1, 134–139. [Google Scholar]
  54. Blankenship, T.L.; Slough, M.A.; Calkins, S.D.; Deater-Deckard, K.; Kim-Spoon, J.; Bell, M.A. Attention and executive functioning in infancy: Links to childhood executive function and reading achievement. Dev. Sci. 2018, 22, e12824. [Google Scholar] [CrossRef]
  55. Dombrowski, S.C.; Gischlar, K.L. Ethical and empirical considerations in the identification of learning disabilities. J. Appl. Sch. Psychol. 2014, 30, 68–82. [Google Scholar] [CrossRef]
  56. Praet, M.; Desoete, A. A pilot study about the effect and sustainability of early interventions for children with early mathematical difficulties in kindergarten. Learn. Disabil. Contemp. J. 2019, 17, 29–40. [Google Scholar]
  57. Wass, S.V. Applying cognitive training to target executive functions during early development. Child Neuropsychol. 2015, 21, 150–166. [Google Scholar] [CrossRef] [PubMed]
  58. Passolunghi, M.; Siegel, L. Working memory and access to numerical information in children with disability in mathematics. J. Exp. Child Psychol. 2004, 88, 348–367. [Google Scholar] [CrossRef]
  59. Mariani, M.; Barkley, R. Neuropsychological and academic functioning in preschool boys with attention deficit hyperactivity disorder. Dev. Neuropsychol. 1997, 13, 111–129. [Google Scholar] [CrossRef]
  60. Martinussen, R.; Hayden, J.; Hogg-Johnson, S.; Tannock, R. A meta-analysis of working memory impairments in children with attention-deficit/hyperactivity disorder. J. Am. Acad. Child Adolesc. Psychiatry 2005, 44, 377–384. [Google Scholar] [CrossRef] [PubMed]
  61. Rabiner, D.L.; Murray, D.W.; Skinner, A.T.; Malone, P.S. A randomized trial of two promising computer-based interventions for students with attention difficulties. J. Abnorm. Child Psychol. 2010, 38, 131–142. [Google Scholar] [CrossRef]
  62. Wiest, D.J.; Wong, E.H.; Minero, L.P.; Pumaccahua, T.T. Utilizing computerized cognitive training to improve working memory and encoding: Piloting a school-based intervention. Education 2014, 135, 264–270. [Google Scholar]
  63. Holmes, J.; Gathercole, S.E. Taking working memory training from the laboratory into schools. Educ. Psychol. 2014, 34, 440–450. [Google Scholar] [CrossRef]
  64. Johann, V.E.; Karbach, J. Effects of game-based and standard executive control training on cognitive and academic abilities in elementary school children. Dev. Sci. 2020, 23, e12866. [Google Scholar] [CrossRef]
  65. Dahlin, K.I.E. Working memory training and the effect on mathematical achievement in children with attention deficits and special needs. J. Educ. Learn. 2013, 2, 118–133. [Google Scholar] [CrossRef]
  66. Schwaighofer, M.; Fischer, F.; Buhner, M. Does working memory training transfer? A meta-analysis including training conditions as moderators. Educ. Psychol. 2015, 50, 138–166. [Google Scholar] [CrossRef]
  67. Holmes, J.; Gathercole, S.E.; Dunning, D.L. Adaptive training leads to sustained enhancement of poor working memory in children. Dev. Sci. 2009, 12, F9–F15. [Google Scholar] [CrossRef] [PubMed]
  68. Diamond, A. Want to optimize executive functions and academic outcomes? Simple, just nourish the human spirit. Minn. Symp. Child Psychol. Ser. 2014, 37, 205–232. [Google Scholar] [PubMed]
  69. Maki, K.E.; Floyd, R.G.; Roberson, T. State learning disability eligibility criteria: A comprehensive review. Sch. Psychol. Q. 2015, 30, 457–469. [Google Scholar] [CrossRef] [PubMed]
  70. Lakens, D. Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs. Front. Psychol. 2023, 4, 863. [Google Scholar] [CrossRef] [PubMed]
  71. Rosales, K.P.; Wong, E.H.; Looney, L. The psychometric structure of executive functions: A satisfactory measurement model? An examination using meta-analysis and network modeling. Behav. Sci. 2023, 13, 1003. [Google Scholar] [CrossRef]
  72. De Oliveira Rosa, V.; Franco, A.R.; Salum, G.A., Jr.; Moreira-Maia, C.R.; Wagner, F.; Simioni, A.; de Fraga Bassotto, C.; Moritz, G.R.; Aguzzoli, C.S.; Buchweitz, A.; et al. Effects of computerized cognitive training as add-on treatment to stimulants in ADHD: A pilot fMRI study. Brain Imaging Behav. 2020, 14, 1933–1944. [Google Scholar] [CrossRef]
  73. Jones, M.R.; Katz, B.; Buschkuehl, M.; Jaeggi, S.M.; Shah, P. Exploring n-back cognitive training for children with ADHD. J. Atten. Disord. 2020, 24, 704–719. [Google Scholar] [CrossRef]
  74. Sewell, A. Understanding and supporting learners with specific learning difficulties from a neurodiversity perspective: A narrative synthesis. Br. J. Spec. Educ. 2022, 49, 539–560. [Google Scholar] [CrossRef]
Table 1. Descriptive statistics for measures of working memory, cognitive flexibility, and processing speed for the Recollect training group condition.
Table 1. Descriptive statistics for measures of working memory, cognitive flexibility, and processing speed for the Recollect training group condition.
ConstructTaskPretest Mean (SD)Posttest Mean (SD)
Working Memory
Digit Span7.38 (2.23)7.64 (2.55)
Cognitive Flexibility
Trail Making4.52 (3.36)5.68 (4.20)
Processing Speed
Coding7.22 (2.38)7.76 (2.61)
Symbol Search7.88 (2.73)8.22 (3.26)
Note: n = 50. Standard deviations (SD) are provided in parentheses.
Table 2. Descriptive statistics for measures of working memory, cognitive flexibility, and processing speed for the Sightseeing training group condition.
Table 2. Descriptive statistics for measures of working memory, cognitive flexibility, and processing speed for the Sightseeing training group condition.
ConstructTaskPretest Mean (SD)Posttest Mean (SD)
Working Memory
Digit Span6.40 (1.90)7.13 (2.05)
Cognitive Flexibility
Trail Making4.76 (3.69)5.80 (4.22)
Processing Speed
Coding7.24 (3.06)7.62 (3.11)
Symbol Search7.82 (2.83)8.11 (3.26)
Note: n = 45. Standard deviations (SD) are provided in parentheses.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Looney, L.; Wong, E.H.; Rosales, K.P.; Bacon, J.M.; Wiest, D.J. Supporting Learning Differences: Effects of Cognitive Training on Cognitive Abilities in a School-Based Sample. Educ. Sci. 2024, 14, 89. https://doi.org/10.3390/educsci14010089

AMA Style

Looney L, Wong EH, Rosales KP, Bacon JM, Wiest DJ. Supporting Learning Differences: Effects of Cognitive Training on Cognitive Abilities in a School-Based Sample. Education Sciences. 2024; 14(1):89. https://doi.org/10.3390/educsci14010089

Chicago/Turabian Style

Looney, Lisa, Eugene H. Wong, Kevin P. Rosales, Jennifer M. Bacon, and Dudley J. Wiest. 2024. "Supporting Learning Differences: Effects of Cognitive Training on Cognitive Abilities in a School-Based Sample" Education Sciences 14, no. 1: 89. https://doi.org/10.3390/educsci14010089

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop