Pedi-Cat PC
Pedi-Cat PC
ORIGINAL RESEARCH
Abstract
Objective: The purpose of this study was to (1) investigate the construct validity and (2) test-retest reliability of the Pediatric Evaluation of
Disability Inventory-Computer Adaptive Test (PEDI-CAT) in children with cerebral palsy (CP).
Design: A prospective convenience cross-sectional sample.
Setting: Multidisciplinary CP clinic in a tertiary level pediatric children’s hospital.
Participants: English- and Spanish-speaking school-aged children (NZ101) with a diagnosis of CP, stratified by Gross Motor Function
Classification System level, who presented to our multidisciplinary clinic. Participants were excluded if they underwent recent surgery (<6mo) or
botulinum neurotoxin A injection (<3mo). A subset of 17 families participated in retest reliability.
Main Outcome Measures: Convergent and divergent validity were evaluated using Spearman correlation coefficient analysis; test-retest reliability
was assessed using intraclass correlation coefficients (ICCs).
Results: Mean age was 123.7 years. Convergent validity was established between Mobility (PEDI-CAT) and Functional Mobility Scale (FMS)
(5 m, rZ0.85; 50 m, rZ0.84; 500 m, rZ0.76; P<.001). In ambulant children, convergent validity was established between Daily Activities
(PEDI-CAT vs Pediatric Quality of Life CP [PedsQL-CP] [rZ0.85, P<.001]) and between Social/Cognitive (PEDI-CAT) and Speech and
Communication (PedsQL-CP) (rZ0.42, P<.001). In nonambulant children, convergent validity was established between Daily Activities (PEDI-
CAT) and Personal Care (Caregiver Priorities and Child Health Index of Life with Disabilities [CPCHILD]) (rZ0.44, P<.001) and between
social/cognitive (PEDI-CAT) and Communication (CPCHILD) (rZ0.64, P<.001). A lack of correlation between Daily Activities, Social/
Cognitive, and Responsibility (PEDI-CAT) and FMS and between the Mobility (PEDI-CAT) and Communication (PedsQL) domains confirmed
divergent validity. Test-retest reliability was excellent for all domains of the PEDI-CAT (ICCZ0.96-0.99).
Conclusions: The PEDI-CAT is an outcome measure that demonstrates strong construct validity and reliability in children with CP.
Archives of Physical Medicine and Rehabilitation 2018;-:-------
ª 2018 by the American Congress of Rehabilitation Medicine
0003-9993/18/$36 - see front matter ª 2018 by the American Congress of Rehabilitation Medicine
https://doi.org/10.1016/j.apmr.2018.07.427
2                                                                                                                           B.J. Shore et al
children and youth with CP.1-4 However, limitations with this           describes functional mobility over 3 distances representing
instrument exist: the length of application (>200 items) makes it       mobility in home, school, and community settings. Construct
challenging to administer in busy clinical settings; in older chil-     content and concurrent validity of the FMS have been demon-
dren with higher levels of functional ability, ceiling affects have     strated in children with CP.18 Because these 3 measures were
been recorded and normative scores exist only for children 6            developed specifically for children with CP, and they are parent
months to 7 years of age.5 The PEDI-Computer Adaptive Test              report measures, they were used to assess validity of the
(CAT) represents a novel clinical assessment for children and           PEDI-CAT.
youth from birth to 20 years of age which uses CAT and was                  The purpose of this study was to report the construct validity
developed on the basis of years of experience, feedback, and            (including convergent and divergent validity) of the PEDI-CAT
formal research with the original PEDI.5-8 CATs are built from a        against the FMS, PedsQL-CP, and CPCHILD and test-retest reli-
set of coordinated items (item banks) that define a common              ability in children and youth with CP.
dimension.9 The CAT uses a simple form of artificial intelligence,
which selects questions that are directly tailored to an individual,
thus shortening the test to achieve desired precision. CAT testing      Methods
is currently being used in pediatric and adult health services,10,11
demonstrating the potential to be the assessment platform of            This prospectively gathered cross-sectional cohort included a group
choice for future heath care appraisal programs.                        of 101 children and their parents or caregivers who presented to a
    The PEDI-CAT was developed at the Boston University Health          multidisciplinary CP clinic at a tertiary level pediatric children’s
and Disability Research Institute and released in October 2012.         hospital between June 2013 and May 2014. English- and Spanish-
Preliminary psychometrics studies on the PEDI-CAT have                  speaking parents and children (between 6 and 20y) with a confirmed
demonstrated good concurrent validity with the Alberta Infant           diagnosis of CP (GMFCS I-V) and with a consistent primary
Motor Scale for young children admitted to postacute care12 and         caregiver present during the clinic visit were recruited. Children
with the PEDI Functional Mobility Scale (FMS) for children with         were excluded if their neuromuscular diagnosis was unclear or if
neurodevelopmental disabilities.13 Excellent test-retest reliability    recent surgery (<6mo) or botulinum neurotoxin A administration
(intraclass correlation coefficient [ICC]Z0.96-0.99) has been           (<3mo) was performed. Informed consent was obtained prior to
reported for all 4 domains of the PEDI-CAT for a small sample of        study participation, and data collection and Institutional Review
children with and without disabilities (nZ23).14 With the devel-        Board approval occurred prior to commencement of this study.
opment of any new assessment tool, validity must be determined.         During the study period, a total of 525 patients were identified as
Recently, the discriminant validity of the PEDI-CAT was tested in       potential study candidates; however, on the day of the clinic, pa-
the same cohort of children with CP, demonstrating excellent            tients were often being seen concurrently, and thus 111 of these
discriminant validity between ambulant and nonambulant partic-          eligible patients were approached for participation, of which 101
ipants across Gross Motor Functional Classification System              consented to the study (fig 1).
(GMFCS) and Manual Ability Classification System levels.15                  Caregivers of children with CP completed the PEDI-CAT
However, the construct validity of the PEDI-CAT in children             (version 1.3.9) using iPad technology with the aid of a trained
with CP has yet to be studied.                                          research assistant, while our inclusion criteria included Spanish-
    The Pediatric Quality of Life CP (PedsQL-CP)16 and the              speaking families, in every consented case, the caregiver who
Caregiver Priorities and Child Health Index of Life with Dis-           completed the assessments spoke and read English. In addition,
abilities (CPCHILD) questionnaire17 were both developed to              for ambulant children (GMFCS I-III), the caregiver completed the
measure health-related quality of life or caregiver burden specif-      PedsQL-CP and for nonambulant children (GMFCS IV and V), the
ically for children with CP. Both these measures are completed by       caregiver completed the CPCHILD questionnaire. Demographic
parent report, and they have similar constructs related to self-care,   information was recorded for each participant including race,
mobility, communication, and social function as the PEDI-CAT.           language, sex, ethnicity, level of education (child and caregiver),
The PedsQL-CP has been shown to discriminate across most                socioeconomic status, and type of caregiver completing the form.
GMFCS levels for Daily Activities and Movement and Balance;             The treating physician assigned a GMFCS, Manual Ability
however, it is less discriminative across GMFCS levels III-V. Face      Classification System, and FMS score for each child with input
and content validity has been reported for the CP-CHILD which           from the caregiver about the child’s typical functioning. Test-retest
was designed specifically to measure health and caregiver burden        reliability was measured in a convenience sample of 17 partici-
for children with severe CP (GMFCS IV and V).17 The FMS                 pants between 10 and 44 days from their initial clinical visit.
                                                                            The PEDI-CAT uses a computer adaptive platform with an
                                                                        item bank of 276 items in the domains of (1) Daily Activities; (2)
    List of abbreviations:                                              Mobility; (3) Social/Cognitive; and (4) Responsibility.7,8 The 4
            CP cerebral palsy
                                                                        PEDI-CAT domains are self-contained and can be used separately
     CPCHILD Caregiver Priorities and Child Health Index                or in combination with the other domains. The PEDI-CAT is
               of Life with Disabilities                                completed by parent or caregiver report or professional judgment
          FMS Functional Mobility Scale                                 of clinicians who are familiar with the child’s typical
       GMFCS Gross Motor Functional Classification System               performance.
          ICC intraclass correlation coefficient                            There are 2 versions of the PEDI-CAT: Speedy and Content-
           ICF International Classification of Functioning,             balanced. The Speedy PEDI-CAT was used for this study. It is the
               Disability and Health                                    more efficient version because it provides precise score estimates
     PEDI-CAT Pediatric Evaluation of Disability Inventory-             while administering only 5-15 items per domain. The score report
               Computer Adaptive Test
                                                                        for the Speedy CAT includes a percentile score and a T score that
    PedsQL-CP Pediatric Quality of Life cerebral palsy
                                                                        can be used to describe a child’s performance compared to other
                                                                                                                     www.archives-pmr.org
Construct validity of PEDI-CAT in CP                                                                                                                                                                                                                                                                                                                                                     3
Correlation Threshold
                                                                                                                                                                                               <0.30
                                                                                                                                                                                               <0.30
                                                                                                                                                                                                                                   <0.30
                                                                                                                                                                                                                                   <0.30
                                                                                                                                                                                                                                                                                      <0.30
                                                                                                                                                                                                                                                                                      <0.30
                                                                                                                                                                                                                                                                                                                                      <0.30
                                                                                                                                                                                                                                                                                                                                      <0.30
                                                                                                                                      Divergent Validity Comparison Construct
                                                                                                                                                                                                  CPCHILD Communication
                                                                                                                                                                                                  PedsQL Communication
children of the same age. The score report also contains a scaled
score which is not age related. Scaled scores provide information
on a child’s status along a continuum of easy to difficult levels of                                                                  Correlation Threshold
function. The PEDI-CAT scaled scores are currently on a 20-80
metric, which allows for further development of the measure.
A higher score translates to higher function functional ability.
    To prevent floor and ceiling effects, further items can be
                                                                                                                                                                                  0.60
                                                                                                                                                                                  0.50
                                                                                                                                                                                  0.50
                                                                                                                                                                                                                                   0.60
                                                                                                                                                                                                                                   0.40
                                                                                                                                                                                                                                                                                      0.40
                                                                                                                                                                                                                                                                                      0.40
                                                                                                                                                                                                                                                                                                                                      0.40
                                                                                                                                                                                                                                                                                                                                      0.40
validated and added with future research to aid in the respon-
siveness of the measure. The total duration of this test is on
average 12 minutes.14
    The PEDI-CAT Mobility domain items range from basic
motor skills of turning head while in supine and sitting without
                                                                                                                                                                                                                                   CPCHILD Activities of Daily Living/Personal Care
watch band, using a knife to butter bread, and wiping self with
toilet paper after a bowel movement. The PEDI-CAT Social/
                                                                                                                                                                                                                                   PedsQL Daily Activities
Social/cognitive
Nonambulant
Nonambulant
                                                                                                                                                                                   Nonambulant
                                                                                                                                                                                 Daily Activities
Responsibility
Ambulant
Ambulant
Ambulant
www.archives-pmr.org
4                                                                                                                            B.J. Shore et al
                                                                                                                       www.archives-pmr.org
Construct validity of PEDI-CAT in CP                                                                                                           5
www.archives-pmr.org
6                                                                                                                               B.J. Shore et al
    Table 4    Correlation coefficients between PEDI-CAT domains and other outcome instrument domains
    Outcome Measure                                  Mobility              Daily Activities          Social/Cognitive            Responsibility
    FMS (nZ95)
      5m                                             0.85*                 0.18                      0.03                       0.05
      50 m                                           0.84*                 0.20                       0.02                       0.02
      500 m                                          0.76*                 0.20                       0.13                        0.17
    PedsQL (ambulant only, nZ58)
      Movement and Balance                           0.45*                 0.33y                       0.23                        0.25
      Daily Activities                               0.61*                 0.85*                       0.70*                       0.66*
      School Activities                              0.38*                 0.62*                       0.51*                       0.47*
      Communication                                  0.24                  0.49*                       0.42*                       0.24
      Pain and Hurt                                  0.14                  0.01                        0.15                        0.08
      Fatigue                                        0.43*                 0.28y                       0.19                        0.19
      Eating Activities                              0.41*                 0.76*                       0.57*                       0.49*
    CPCHILD (nonambulant only, nZ41)
      Total score                                    0.53*                 0.61*                       0.56*                      0.40y
        Positioning                                  0.61*                 0.58*                       0.46*                      0.36y
        Personal care                                0.43*                 0.44*                       0.38y                      0.29
        Communication                                0.38y                 0.54*                       0.64*                      0.37y
        Comfort                                      0.34y                 0.40y                       0.31                       0.16
        Health                                       0.40*                 0.60*                       0.60*                      0.53*
        Quality of life                              0.13                  0.12                        0.10                      0.07
     * Significant correlation at the 1% level.
     y
       Significant correlation at the 5% level.
   In the current study, we found that the PEDI-CAT performed                communication; however, after review of the literature, we found
equally well in comparison to legacy measures: PedsQL (ambu-                 evidence to confirm the relation between mobility and commu-
lant children) and CPCHILD (nonambulant children). For ambu-                 nication in children with CP.22
lant children with CP, we found the PEDI-CAT Mobility, Daily                    The PEDI-CAT Responsibility domain did not meet the
Activities, and Social/Cognitive domains demonstrated conver-                threshold for convergence with CPCHILD personal care (r<0.40)
gence across the 3 FMS settings and PedsQL-CP Daily Activities               as we originally hypothesized. We suspect these results are a
and Speech/Communication domains. For nonambulant children                   function of variable measurement: with the PEDI-CAT measuring
with CP, we found that the PEDI-CAT Mobility, Daily Activities,              child functional performance and the CPCHILD measuring care-
and Social/Cognitive domains were convergent with the                        giver burden and ease of care provision.
CPCHILD Positioning, Transferring and Mobility; Personal Care;
and Communication and Social Interaction domains. Initially we
did not anticipate a significant correlation between mobility and            Study limitations
                                                                             Test-retest reliability was high for all 4 domains in our 17 patient
                                                                             test-retest reliability convenience sample. Although this sample
    Table 5    Test-retest reliability of PEDI-CAT domains                   may appear small, we had appropriate power to demonstrate retest
                                                                             reliability and we believe that these results are accurate. Previous
    Domain                                           ICC 95% CI              work on the PEDI-CAT has demonstrated high test-retest reli-
    Mobility                                         0.98    (0.96-0.99)     ability when used to measure function in children with and
    Daily Activities                                 0.96    (0.90-0.99)     without developmental disabilities14 and in patients from other
    Social/Cognitive                                 0.99    (0.97-1.00)     countries (Brazil).23 Future research should be directed toward
    Responsibility                                   0.98    (0.95-0.99)     evaluating a larger sample of children to demonstrate test-retest
                     Test-retest Cohort Summary (nZ17)                       reliability of the PEDI-CAT at each of the GMFCS and MAC
                                                                             levels to determine if it is consistent across all levels.
    Characteristic                                           Freq. (%)           Only school-aged children were studied so we cannot gener-
    Mean age  SD (y)                                        13.24.72       alize these findings to children with CP younger than 6 years.
    Sex (% men)                                              10 (59)         There may have been unintentional selection bias with caregivers
    GMFCS level                                                              who chose to participate in this study. Most caregivers in this
      I                                                       4   (24)       study were white, middle-income parents so these findings may
      II                                                      1   (6)        not be representative of caregivers from other cultural and/or
      III                                                     2   (12)       socioeconomic backgrounds. For the purpose of this study, we
      IV                                                      4   (24)       excluded those children who had undergone recent surgical pro-
      V                                                       6   (35)       cedures or botulinum neurotoxin A injections, thus keeping the
    Abbreviation: 95% CI, 95% confidence interval.
                                                                             study population relatively homogeneous. One of the main
                                                                             features of any outcome tool is to demonstrate responsiveness to a
                                                                                                                          www.archives-pmr.org
Construct validity of PEDI-CAT in CP                                                                                                                    7
treatment intervention. With our small sample size, we felt that we            7. Dumas HM, Fragala-Pinkham MA, Feng T, Haley SM. A preliminary
would not be able to measure the convergent validity and                          evaluation of the PEDI-CAT Mobility item bank for children using
responsiveness concurrently and therefore excluded the patients                   walking aids and wheelchairs. J Pediatr Rehabil Med 2012;5:29-35.
above. Our next step in testing or validating the PEDI-CAT in                  8. Dumas H, Fragala-Pinkham M, Haley S, et al. Item bank development
                                                                                  for a revised pediatric evaluation of disability inventory (PEDI). Phys
children with CP will be to prospectively examine the respon-
                                                                                  Occup Ther Pediatr 2010;30:168-84.
siveness of the PEDI-CAT after single event orthopedic                         9. Haley SM, Chafetz RS, Tian F, et al. Validity and reliability of
surgerydto identify the minimal detectable change and minimal                     physical functioning computer-adaptive tests for children with cere-
clinically important difference. Preliminary evidence suggests that               bral palsy. J Pediatr Orthop 2010;30:71-5.
the PEDI-CAT should demonstrate sensitivity to change that is at              10. Jette AM, Haley SM. Contemporary measurement techniques for
least as good as the original PEDI.24                                             rehabilitation outcomes assessment. J Rehabil Med 2005;37:339-45.
                                                                              11. Cella D, Gershon R, Lai JS, Choi S. The future of outcomes mea-
                                                                                  surement: item banking, tailored short-forms, and computerized
Conclusions                                                                       adaptive assessment. Qual Life Res 2007;16(Suppl 1):133-41.
                                                                              12. Dumas HM, Fragala-Pinkham MA, Rosen EL, Lombard KA,
This study demonstrates the construct validity and test-retest                    Farrell C. Pediatric Evaluation of Disability Inventory Computer
reliability of the PEDI-CAT across a sample of children with CP.                  Adaptive Test (PEDI-CAT) and Alberta Infant Motor Scale (AIMS):
This study demonstrates that the PEDI-CAT is a valid outcome                      validity and responsiveness. Phys Ther 2015;95:1559-68.
                                                                              13. Dumas HM, Fragala-Pinkham MA. Concurrent validity and reliability
instrument across a population of children with CP with diverse
                                                                                  of the Pediatric Evaluation of Disability Inventory-Computer Adaptive
functional capabilities.
                                                                                  Test Mobility domain. Pediatr Phys Ther 2012;24:171-6.
                                                                              14. Dumas HM, Fragala-Pinkham MA, Haley SM, et al. Computer
Keywords                                                                          adaptive test performance in children with and without disabilities:
                                                                                  prospective field study of the PEDI-CAT. Disabil Rehabil 2012;34:
Cerebral palsy; Rehabilitation; Validation studies                                393-401.
                                                                              15. Shore BJ, Allar BG, Miller P, et al. Evaluating the discriminant val-
                                                                                  idity of the Pediatric Evaluation of Disability Inventory: computer
                                                                                  adaptive test (PEDI-CAT) in children with cerebral palsy. Phys Ther
Corresponding author                                                              2017;96:669-76.
                                                                              16. Sullivan E, Barnes D, Linton JL, et al. Relationships among functional
Benjamin J. Shore, MD, MPH, FRCSC, Department of                                  outcome measures used for assessing children with ambulatory CP.
Orthopedic Surgery, Boston Children’s Hospital, 300 Longwood                      Dev Med Child Neurol 2007;49:338-44.
Avenue, Boston, MA 02115. E-mail address: Benjamin.shore@                     17. Narayanan UG, Fehlings D, Weir S, Knights S, Kiran S, Campbell K.
childrens.harvard.edu.                                                            Initial development and validation of the Caregiver Priorities and
                                                                                  Child Health Index of Life with Disabilities (CPCHILD). Dev Med
                                                                                  Child Neurol 2006;48:804-12.
                                                                              18. Graham HK, Harvey A, Rodda J, Nattrass GR, Pirpiris M. The
References                                                                        Functional Mobility Scale (FMS). J Pediatr Orthop 2004;24:514-20.
                                                                              19. Kirshner B, Guyatt G. A methodological framework for assessing
 1. McCarthy ML, Silberstein CE, Atkins EA, Harryman SE,                          health indices. J Chronic Dis 1985;38:27-36.
    Sponseller PD, Hadley-Miller NA. Comparing reliability and validity       20. Abma IL, Rovers M, van der Wees PJ. Appraising convergent validity
    of pediatric instruments for measuring health and well-being of chil-         of patient-reported outcome measures in systematic reviews: con-
    dren with spastic cerebral palsy. Dev Med Child Neurol 2002;44:468-           structing hypotheses and interpreting outcomes. BMC Res Notes
    76.                                                                           2016;9:226.
 2. Harvey AR, Morris ME, Graham HK, Wolfe R, Baker R. Reliability of         21. Msall ME. Tools for measuring daily activities in children: promoting
    the functional mobility scale for children with cerebral palsy. Phys          independence and developing a language for child disability. Pediat-
    Occup Ther Pediatr 2010;30:139-49.                                            rics 2002;109:317-9.
 3. Wren TA, Sheng M, Hara R, et al. Agreement among three in-                22. Hidecker M, Ho N, Dodge N, et al. Inter-relationships of functional
    struments for measuring functional health status and quality of life in       status in cerebral palsy: analyzing gross motor function, manual
    pediatric orthopaedics. J Pediatr Orthop 2007;27:233-40.                      ability, and communication function classification systems in children.
 4. Oeffinger D, Gorton G, Bagley A, et al. Outcome assessments in                Dev Med Child Neurol 2012;54:737-42.
    children with cerebral palsy, part I: descriptive characteristics of      23. Mancini MC, Coster WJ, Amaral MF, Avelar BS, Freitas R, Sampaio RF.
    GMFCS Levels I to III. Dev Med Child Neurol 2007;49:172-80.                   New version of the Pediatric Evaluation of Disability Inventory (PEDI-
 5. Haley SM, Coster WI, Kao YC, et al. Lessons from use of the Pedi-             CAT): translation, cultural adaptation to Brazil and analyses of psy-
    atric Evaluation of Disability Inventory: where do we go from here?           chometric properties. Braz J Phys Ther 2016;20:561-70.
    Pediatr Phys Ther 2010;22:69-75.                                          24. Iyer LV, Haley SM, Watkins MP, Dumas HM. Establishing minimal
 6. World Health Organization. International Classification of Func-              clinically important differences for scores on the pediatric evaluation
    tioning, Disability and Health(ICF). Geneva, Switzerland: World               of disability inventory for inpatient rehabilitation. Phys Ther 2003;83:
    Health Organization; 2001.                                                    888-98.
www.archives-pmr.org