Cognitive flexibility assessment in youth with Down syndrome: Reliability, practice effects, and validity.
The three most common flexibility tasks are not yet trustworthy outcome tools for youth with Down syndrome.
01Research in Context
What this study did
Scior et al. (2023) tested three common flexibility tasks in youth with Down syndrome. They used the Rule-Shift cards, the Weigl sorting test, and the KiTAP computer game.
The team checked if each task was easy to give, gave steady scores, and truly measured flexibility.
What they found
None of the tasks passed every check. Some were too hard to finish. Others gave different scores on repeat testing.
Because no measure met all rules, the authors say none are ready to track progress in therapy trials.
How this fits with other research
Smit et al. (2019) already showed the BRIEF parent form works well in Down syndrome. That tool tracks wider executive skills, so flexibility data from parents can still guide you while direct tasks get fixed.
Dixon et al. (2008) saw behavioural flexibility in Down syndrome with simpler games. Their positive results do not clash with K et al.; the 2023 paper just set a higher bar for what counts as a sound test.
Albein-Urios et al. (2018) found self-report flexibility deficits in autistic adults but not in lab tasks. K et al. also found lab tasks shaky in Down syndrome youth. Together, these studies warn that direct flexibility tests can miss or mis-label problems across diagnoses.
Why it matters
If you need a flexibility outcome for an intervention study, skip the Rule-Shift, Weigl, and KiTAP for now. Use the BRIEF or caregiver interviews to capture real-world shifts. Keep sessions short and give extra practice trials if you try any direct task. Watch for fatigue and score only completed items so your data stay clean.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Switch to the BRIEF flexibility scale while you plan your next baseline.
02At a glance
03Original abstract
BACKGROUND: Cognitive flexibility refers to the ability to switch between different mental sets, tasks, or strategies and is challenging for some individuals with Down syndrome (DS). The lack of reliable and valid cognitive flexibility measures for individuals with DS is a major barrier to clinical trials and intervention studies designed to address cognitive challenges specific to DS. To avoid measurement limitations that could confound interpretations of performance in clinical trials in children with DS, it is critical to use phenotype-sensitive and psychometrically sound measures of cognitive flexibility. AIM: This study aimed to evaluate the psychometric properties of three measures of cognitive flexibility including Rule-Shift, Weigl Sorting, and KiTAP Flexibility in a sample of 97 youth with DS aged 6-17 years old. METHOD: Data were collected at two time points with a two-week interval. Parents also completed adaptive behavior and cognitive flexibility questionnaires. Child cognitive and language abilities were also assessed. RESULTS: The Weigl Sorting met the most psychometric criteria, with adequate feasibility (≥ 80 %) and significant correlations with most of the broader developmental domains; however, the levels of test-retest reliability, practice effects, and convergent validity did not meet a priori criteria. Rule-Shift and KiTAP Flexibility measures did not have acceptable feasibility; although sensitivity and specificity analyses revealed that Rule-Shift may be appropriate for a subgroup of the participants. CONCLUSION: No evaluated measures met all psychometric study criteria and, therefore, additional evaluation of cognitive flexibility measures is needed for use among individuals with DS.
Research in developmental disabilities, 2023 · doi:10.1016/j.neucli.2005.03.002