WST 0269215510367981
WST 0269215510367981
Received 8th June 2009; returned for revisions 27th February 2010; revised manuscript accepted 27th February 2010.
Introduction
of their lives.1 To function independently, manual        in the context of assessment. The current study,
wheelchair users must possess a variety of wheel-         however, focuses mainly on wheeled mobility in
chair skills to be able to deal with the physical         daily activities and social roles. Therefore, the
barriers they will encounter in various environ-          objectives, analysis and outcomes of the two
ments in daily life.2 Manual wheelchair skill             reviews are very much complementary.
performance of people with spinal cord injury                The main objective of this review is to system-
is positively associated with activities and              atically review, document, analyse and critically
participation.3                                           appraise the performance-based wheelchair
   In this context, ‘wheelchair skill performance’ is     skills tests for manual wheelchair users, especially
defined as: ‘The ability to move around and over-         those with a spinal cord injury, currently available
come obstacles encountered when carrying out              in the international literature. An added value of
daily activities or social roles in a self-propelled      this study will be that it facilitates selection of
wheelchair’.4                                             the most suitable components from the existing
   A ‘wheelchair skills test’ consists of various tasks   wheelchair skills tests, in order to develop a stan-
to be performed by the candidate under standard-          dardized test.
ized conditions. A validated and reliable wheelchair
skills test is necessary as a guiding instrument in the
rehabilitation process of people with spinal cord         Methods
injury and those with lower limb impairments.
Such a tool can assist in making the appropriate
choice of skills to be trained in rehabilitation as       A systematic review of the international literature
well as in the evaluation of training interventions.      was performed. The search aimed for actual
Furthermore, a standardized and accepted wheel-           performance-based hand-rim wheelchair skills
chair skills test could be used to develop standards      tests. The databases used for selection of peer-
of wheelchair skills performance for individuals          reviewed articles were PubMed, Web of Science
with different levels of impairment.                      and Cochrane Library (from 1970 to December
   A review by Kilkens et al.5 mainly focused on a        2009). The database search and study appraisal
broad description and comparison of manual                were conducted by the first and third author
wheelchair skills tests reported in the literature        together in a systematic way. Only studies
between 1966 and 2001. The main conclusion of             reported in English were selected.
that study was that there is no standard test to
measure wheelchair skills performance; most of
the tests have only been used in one or two studies,      Search strategy
‘a fact that makes it impossible to compare study            Peer-reviewed articles were selected using the
results’.5 The current study updates and completes        keywords wheelchair(s) and measurement com-
Kilkens’ review, focusing on self-propelled wheel-        bined with assessment. A second search using the
chair users with a spinal cord injury.                    keywords wheelchair(s) and rehabilitation, com-
   Another more recent review by Mortenson et al.6        bined with mobility was preformed. To assure
identified and evaluated wheelchair-specific out-         that all relevant literature was included, a final
come instruments, using the International Classifi-       search was performed, using the keywords mobility
cation of Functioning, Disability and Health              and wheelchair, while alternately adding the words
(ICF) definitions as a framework.7,8 This review          skill, task, measurement, test, ADL, functional,
focused mainly on statistical properties of the           instrument, performance, spinal cord injury, valid-
tests, which ranged from questionnaires to actual         ity, reliability, pathology, behavior, activity, disabil-
performance tests, and it incorporated powered            ity, assessment and quality of life. Initial study
wheelchairs as well.                                      selection was based on title and on abstract when
   A broad framework for mobility performance             the title was not sufficiently detailed. References
assessment of wheelchair users was presented by           given in relevant reviews and relevant publications
Routhier et al.4 According to Routhier et al.,4 the       were also checked and examined. The outcome of
review by Mortenson et al. focused on mobility            this search strategy is described in detail in Figure 1.
                                                            Wheelchair skills tests for manual wheelchair users                       869
           Search 1: Wheelchair AND             Search 2: Wheelchair AND              Search 3: Wheelchair AND Mobility
                 Measurement                          Rehabilitation                             595 studies
                 179 studies                          2006 studies
                                                                                    + skill (9 hits) OR, task (36), measurement
                                                                                               (28), test (224), ADL (15),
                                                                                          functional (122), instrument (19),
                                                                                     performance (91), SCI (52), validity (24),
      Wheelchair AND Measurement             Wheelchair AND Rehabilitation         reliability (22), pathology (21), behavior (45),
                  AND                                    AND                       activity (74), disability (99), assessment (98),
             Assessment                                 Mobility                                   quality of life (60)
               39 studies                            428 studies                               1039 studies (all together)
                                                1506 studies
                                                                        Checking based on abstract &
                                                                        Checking for double references
                                                                                                    45 studies
                                                  43 studies                               From reference list of selected
                                                                                                      studies
                                                  43 studies
                                                                                In-depth reading, including only
                                                                                studies testing wheelchair skills
                                                  40 studies
                                          Including wheelchair skills           Analysing including/excluding
                                                                                criteria: only actual
                                                                                performance-based WM skills
                                                                                test
                                      Included: 13 studies representing 11
                                         different wheelchair skills tests      Performing quality
                                                                                assessment analysis11
Figure 1 Search strategy and the result of the search process. (QAS - quality assurance system).
using powered wheelchairs; (b) tests were per-          were defined and assessed. For each aspect, the first
formed in a virtual environment; (c) assessment         author and the third author had to agree whether it
was based on questionnaires or interviews               was ‘strength’ or ‘weakness’. In case of disagreement,
(where subjective and retrospective characteristics     the other authors were consulted. A test was con-
might strongly influence the outcome9), (d) tests       sidered ‘stronger’ when it met more of the following
were focused on ‘body functions and structures’         aspects: (a) it tests necessary daily wheelchair skills
(measuring specific physiological and/or biome-         in real life settings, rather than ‘lab’-based settings
chanical variables which do not comply with the         (e.g. using own manual wheelchair rather than a
terms of ‘activity’ or ‘participation’ domains as       standardized wheelchair); (b) it tests wheelchair
defined in the ICF7,8).                                 skills performances of people with spinal cord
                                                        injury; (c) it assesses the differences in level of
                                                        wheelchair skills performances and/or tests the out-
                                                        come of an wheelchair skills intervention in a sensitive
Quality assessment                                      and precise manner; (d) it presents quantitative
  The quality of the selected papers (quality assur-    data which facilitate comparison with other tests
ance system, QAS) was evaluated independently by        results or previous trials; (e) it presents qualitative
the first and third authors according to a checklist    data analysis, generated by experts, enabling trai-
for statistical review of general papers adapted        ners to improve their teaching skills and can be also
by van Velzen et al.10 from Gardner and                 used to enhance test sensitivity; (f) it lasts a reason-
Altman.11 In case of disagreement of an item            able amount of time (preferably no longer than 60
score, consensus was achieved through discussion.       minutes); and (g) it presents a final test score.
  For each selected wheelchair skills test, the fol-
lowing aspects were identified, described and
analysed:
                                                        Results
 The assessed wheelchair skills: How clear were
  their specifications and the reason for their         In total, 1506 articles were screened on basis of the
  inclusion in the test?                                title (Figure 1). Checking for double references and
 The scaling and outcome parameters used to            abstract relevancy rejected 97% of the findings.
  assess the wheelchair skills performance              A total of 43 articles were identified for further
 The feasibility and complexity of the test (dura-     consideration. Forty studies involved different
  tion, number of skills included, environment and      forms of wheelchair skills examination, but not
  wheelchair type, availability of test protocols)      necessarily actual performance-based wheelchair
 The psychometric properties: the reliability as       skills tests. Of those 40 studies, only 13 met the
  well as validity information (if presented) was       inclusion criteria.13–25 Most of the excluded studies
  reviewed. Intra-class correlation coefficients        were found to be ‘a list of tasks’, aiming to evaluate
  (ICCs) 40.75 or k-values 40.75 are defined as         an intervention or to detect differences between
  very good reliability.12 Sensitivity to change,       groups, rather than actual performance-based
  ceiling and/or floor effects were also reviewed       wheelchair skills tests. Two tests, which were
  (if presented).                                       included in previous literature reviews, were also
                                                        excluded: ‘Functional Evaluation in a Wheelchair’
  Finally, a critical evaluation of strengths and       (versions 1 and 2) instrument26,27 was excluded
weaknesses of the wheelchair skills tests was con-      because it was designed as a questionnaire to be
ducted. Only studies with sufficient quality (QAS       administered over time to consumers of seating-
60%10,11) were included in this phase of our study.    mobility technology and not as an actual wheel-
The critical evaluation was based on the authors’       chair skills performance test. ‘Wheelchair Obstacle
opinion regarding the most suitable skills, scale,      Course’28 was excluded because it was developed
environment and equipment that should be                for people with a cerebral vascular accident only.
included in a standardized wheelchair skills test          The remaining 13 studies represented 11
for person with spinal cord injury. Different aspects   different wheelchair skills tests. In two cases,
                                                   Wheelchair skills tests for manual wheelchair users       871
Kilkens et al.17,20 and Routhier et al.,14,15 the two     Irregular surface was tested six times.14–16,18,19,22
studies of each author were considered as one since       Overall, the tasks under this category lack sufficient
they presented the same wheelchair skills test in         explanation.
both studies. Of these 11 tests, 9 were developed
in the last 10 years (1998–2007). Study designs
included cohort studies (8), cross-sectional studies      Wheelie
(2) and a descriptive study (1). Out of these               Only three tests measured wheelie skill16,19,22 as a
11 studies, 5 scored QAS above 6.5                        separate task. The wheelie tasks included station-
points,13,14,16,17,22 having sufficient methodologi-      ary, forward and backward and turn while wheelie.
cal quality following Gardner et al.11                    None of the wheelie tasks were clearly explained.
                                                          Feasibility
Obstacle-negotiating skills                                  The feasibility variables are presented in detail in
   The variety of tasks under this category is the        Table 2, only major aspects will be highlighted.
largest. Ramp was tested five times,13,17,18,23,24        Eight studies gave information regarding the dura-
but with different slopes and distances. For the          tion of administering the test. Most tests lasted
kerb/pavement (curb/sidewalk) test 10 different           between 30 minutes and 1 hour. The longest test
kerbs were tested (heights range 2.5–17.8 cm).            duration was 1–1.5 hours,18 while the shortest
Only four tests used two different kerb                   was 15 minutes.23 Total skills number for each
heights13–15,23 in order to differentiate functional      test varied from a minimum of five13 up to 61,22
abilities. Incline/slope was tested eight times,          and when focusing on wheeled mobility perfor-
using a variety of inclines, with no consistency.         mance, the number of skills varied from a minimum
Only two tests measured two different slopes              of three21 up to 30.16 All tests were conducted in a
within the same test to compare abilities13,17,20;        rehabilitation centre. Only 5 out of 11 tests sup-
two slope tasks were tested on a treadmill17,20;          plied information regarding the wheelchair type
only one test measured crossing a slope.16                that was used during the assessment.14–17,19,20,25
Doorstep was tested six times14–21; none of the           In three tests participants used their own wheel-
tasks used the same height of door threshold.             chair,14–16,19 while in two tests standardized
872      O Fliess-Douer et al.
wheelchairs were used.17,20,25 Description of                       using the wheelchair previous to the first test
quality of the wheelchair varied widely. Only                       trial.14,16,19 Only 5 out of 11 tests described the
three tests provided information regarding the                      test protocols sufficiently clearly (i.e. enabling
period of time that the participants had been                       reproduction of test procedures).13,15,20,21,23
Table 2            Test analysis wheelchair skills tests – general summary
Test               Objective                     Study design          QAS    Study                Test design                                                                  Outcomes                                                  Duration
                                                                              population
                                                                                                   Way of                  No. WC       Test              WC info               Parameters   Scale                     Express final
                                                                                                   choosing                skills/no.   environment                                                                    test score
                                                                                                   the skill               skills
Middleton, 200613
FIM – 5       To better delineate     Patients were                      7    SCI: 11 tetra, 28 Previous test by                4/5     SCI and rehabili- No info               Quality      1–7: 7 complete           Shown only         No info
   additional    important functional    tested within                          para ASIA A–C Harvey, were                                tation 2 units                                       independence, 6           graphically
  items              differences between           72 h of WM for               (D excluded)          modified to                         in Sydney,                                           modified indepen-
  5-AML              groups with different         the first time             N¼39                    ensure suit-                        Australia                                            dence, 5 supervi-
                     levels of neurological        since injury,              32M/7F                  ability for tetra                                                                        sion, 4 minimal
                     impairment                    1 month,                   Age: R 22–35,                                                                                                    assistance, 3 mod-
                                                   2 months,                     mean 28                                                                                                       erate assistance,
                                                   3 months and                                                                                                                                2 maximal assis-
                                                   6 months later.                                                                                                                             tance, 1 total assis-
                                                   COHORT                                                                                                                                      tance. Every skill
                                                                                                                                                                                               has its own speci-
                                                                                                                                                                                               fic remarks for
                                                                                                                                                                                               each point
Routhier, 2004, 200514,15
OCAWUP       To evaluate WC user                 17 experienced WC      7.5   SCI: 6; neuro-       Consulting                 10/10     The Institute de Their own WC           Time (s) þ   DE: 3 ¼ total             Global DE scores No info
                     performance in                users using 3                 muscular dis-        experts and                         Readaptation       that they have        quality     success;                   are added to
                     potentially difficult         different propul-             ease: 4; CVA:        scientific litera-                  en Deficience      for at least 6                    2 ¼ success with           give a GSE
                     environmental situa-          sion methods                  5; amp: 2 after      ture (based on                      Physique de        months. using                     difficulty;                from 0 to 30
                     tion, for all propulsion      were assessed                 rehab min 1.5        Routhier15)                         Quebec             3 different pro-                  1 ¼ partial failure;
                     methods and all cli-          twice on the 10              years                                                     (IRDPQ)            pulsion                            0 ¼ complete
                     ents group                    obstacle course.           N¼17                                                                           methods                           failure.
                                                   COHORT                     10M/7F
                                                                              Age: R 24–64,
                                                                                 mean
                                                                                 50.9  12
              16
Kirby, 2004
WST-2.4            To evaluate the effect Subjects were                  10   Amp: 62; CVAþ Pilot study þ17                   30/50     Rehab. centre     Conventional:         Quality      0 ¼ fail,                 Total WST          27  9.3 min
                      of WC skills training videotaped per-                     TBI: 52; MSK:   WC users sug-                                                119,                               1 ¼ pass,                 scores:
                     for WC users under-           forming 50 skills             20; SCI: 34;         gested the                                             lightweight:                      NA ¼ not                   GAS ¼ total
                     going initial rehabilita-     twice. The order              able-bodied          addition or                                         34 ultraligh: 15                     applicable,                goal
                     tion, to screen               of skills was                 volunteers:          modification of                                        WC was in                         NG ¼ not a goal.           attainment
                     subjects before               according to dif-            129                   obstacles                                              the patient’s
                     wheelie training, to          ficulty level and          N¼298                                                                          use for 2 days
                     compare the perfor-           the natural                M140/F158                                                                      prior the test
                     mance of manual               groupings. If the          Age: R 17–88,
                     WC and push-rim               first attempt                 mean 8  22.5
                     power-assisted WC,            failed a second
                     to evaluate the effect        try was allowed.
                     of WC skills training         Subjects were
                     for occupational              oriented to the
                     therapists student at         test expecta-
                     second year                   tions. COHORT
                                                                                                                                                                                                                                         (Continued )
Table 2      Continued
Test         Objective              Study design        QAS    Study             Test design                                                               Outcomes                                             Duration
                                                               population
                                                                                 Way of              No. WC       Test             WC info                 Parameters   Scale                 Express final
                                                                                 choosing            skills/no.   environment                                                                 test score
                                                                                 the skill           skills
                                                                                                                                                                                                              (Continued )
Table 2      Continued
Test            Objective        Study design          QAS    Study              Test design                                                   Outcomes                                                     Duration
                                                              population
                                                                                 Way of              No. WC       Test               WC info   Parameters           Scale                  Express final
                                                                                 choosing            skills/no.   environment                                                              test score
                                                                                 the skill           skills
Cress, 200221
WC-PFP test To measure the Tasks were per-               3    MS: 4; CVA: 2;     Adaptation of the       3/11     A rehabilitation   No info   Quantity scores Scores were trans-  Reported mean 40 min
               ability of     formed serially                    polio: 1;         CS-PFP                            facility                    (weight, dis-   formed to a scale   þ SD in a
               people using   and partici-                       arthritis: 1;                                                                   tance and       from 0 to 100       table, only
               manual WC to   pants were                        TBI: 2; SCI: 8                                                                   time) in 4      (¼highest perfor-   general score
               perform tasks  asked to work                   N¼18                                                                               domains:        mance in the test
               which are      at maximal                      M13/F5                                                                             Upper body      population)
               important for  exertion yet to                 Age: R 18–67                                                                       strength, flex-
                  living inde-      pace them-                                                                                                    ibility, endur-
                  pendently         selves to com-                                                                                                ance, balance
                                    plete as many                                                                                                 and
                                    tasks as possi-                                                                                               coordination
                                    ble. COHORT
Taricco, 200022
Measure-        To evaluate the Scoring is done         9.5   SCI: para: 67;Input from the              23/61     8 Italian SCI      No info   Quality              1–5 scale: from        Mean score for 30–50 min
  ment             impact of        according to                 tetra: 33. 81 literature                             units                                            inability to com-     each domain
  scale            rehabilitative   direct observa-             had a trau-    and specia-                                                                             plete the task to     at baseline
  VFM              interventions    tion of patient             matic          lists. (more                                                                            completing the        and follow-up
                   on the func-     performance,                aetiology      details were                                                                            task without
                   tional status of excluding 1               N¼100 M77/F23    reported in                                                                             difficulties
                   SCI patients     task that is              Age: R 14–76     previous
                                    simulated and                              articles)
                                    2 that are col-
                                    lected by inter-
                                    view (none of
                                    those are
                                    related to
                                    mobility). VFM
                                    was adminis-
                                    tered at the
                                    beginning and
                                    the end of the
                                    rehabilitation
                                    programme.
                                    COHORT
                                                                                                                                                                                                           (Continued )
Table 2     Continued
Test         Objective          Study design           QAS    Study                Test design                                                    Outcomes                                                   Duration
                                                              population
                                                                                   Way of               No. WC       Test              WC info    Parameters       Scale                    Express final
                                                                                   choosing             skills/no.   environment                                                            test score
                                                                                   the skill            skills
Harvey, 199823
Assessing     To quantify     Each subjects per-         4    SCI: para 20.        Skills typically          5/6     No info (most      No info   Quality (based   1–6 scale: Level of  Median and IQR 15 min
  mobility in    the mobility   formed the test                  No info on           learned in phy-                  likely rehabili-             on also on       independence,        levels of mobi-
  paraplegic     of WC-         twice at the same               numbers               siotherapy                       tation centre)               time to          time and task com-   lity attained on
                dependent         day, assessed by            Age: mean               programmes                                                    complete          plexity, according       each task
                paraplegics.      2 different asses-             45.6  16.8                                                                        the task)         to each task
                                  sors. COHORT
Gans, 198824
TAMP         Providing com- Test was adminis-           4.5   Orthopaedic sur- No info                      4/32     Rehab centre      No info    Quality          Four different scales Mean kappa          Less than
                prehensive    tered by PT/OT.                    gery 6; closed                                                                                      in 4 dimensions:                          1h
                clinical eva-     Instructions and               head injury 6;                                                                                    Assistance (5 scale
                luation of        demonstration                  muscle dis-                                                                                          points, from inde-
                physical          were given prior               ease/atrophy                                                                                         pendence to total
                function and      to each item.                  3; SCI 5; CP 6;                                                                                     dependence)
                motor per-        Breaks were pro-               other miscella-                                                                                   Approach (2 scale
                formance.         vided as needed.              neous 14                                                                                              points: general
                To examine        Order of tasks:             N¼40                                                                                                    technique used to
                motor per-        from fine to dres-          M14/F26                                                                                                 complete the task.)
                formance in       sing, transfer and          (20 adults, 20                                                                                       Pattern (2 scale
                sufficient        mat mobility and              children)                                                                                             points: clinically
                detail to         finally mobility.           Age: mean                                                                                               important move-
                assist with       Tests were video-              25.6  19.5                                                                                          ment patterns in
                treatment         taped and ana-                                                                                                                      selected fine
                planning and      lysed at a later                                                                                                                    motor activities
                to ade-           date. CROSS-
                                                                                                                                                                      and in gate)
                quately           SECTIONAL
                                                                                                                                                                   Proficiency (3 scale
                describe
                                                                                                                                                                      points: movement
                and identify
                                                                                                                                                                      control, accuracy
                meaningful
                                                                                                                                                                      of extremity place-
                clinical
                                                                                                                                                                      ment and aspects
                changes in
                                                                                                                                                                      of coordination)
                motor
                abilities.
                                                                                                                                                                                                            (Continued )
Table 2     Continued
Test        Objective           Study design         QAS    Study                Test design                                                    Outcomes                             Duration
                                                            population
                                                                                 Way of        No. WC       Test          WC info               Parameters   Scale   Express final
                                                                                 choosing      skills/no.   environment                                              test score
                                                                                 the skill     skills
Jebsen, 197025
Time mea- To measure            Subjects were         3.5   100 healthy          No info           6/31     No info       16 and 18 inch seat   Time (s)             Mean time of    30 min for
   surement   various             timed while per-          18 patients                                                      width, large                              each subtest,    healthy
   in a stan- aspects of          forming each              10 hemiparesis;                                                  wheels in rear                            no general    60 min for
   dardized   patient             task. They were              low limb amp:                                                 (standard WC)                             score            patients
   test       mobility by         advised to per-              4; peripheral
              measuring           form each task               neuropathy 1;
              the time            as quickly as                hip fracture 1;
                 necessary        possible.                   polio 1; SCI 1
                 for indepen-     Healthy sub-              N¼100
                 dent com-        jects: short              M50/F50
                 pletion of       practice session          Healthy: 20 from
                 each of the      was allowed                  each age
                 group            before testing              group
                 subsets.         started.                  Age: Patient:
                                  Subjects with                mean 49.7
                                  disabilities:
                                  were tested on
                                  2 occasions, 1–
                                  4 days apart.
                                  COHORT
WC, wheelchair; QAS, quality assurance system; WC-PFP, Wheelchair Physical Functional Performance; SCI, spinal cord injury; VFM, Valutazione Funzionale Mielolesi;
TAMP, Tufts Assessment of Motor Performance; WM, wheeled mobility; WST-2.4, Wheelchair Skills Test version 2.4; DE, degree of ease; GSE, global score of ease;
CVA, cerebrovascular accident; TBI, traumatic brain injury; MSK, musculoskeletal; GAS, Goal Attainment Score; CP cerebral palsy; MS, multiple sclerosis; PT, physiothera-
pist; OT, occupational therapist; FIM, Functional Independence Measure; WUFA, Wheelchair Users Functional Assessment; CS-PFP, Continuous Scale Physical Functional
Performance Measure; tetra, tetraplegic; para, paraplegic; comp, complete; inco, incomplete; Amp, amputation; M, male; F, female; R, range;
878   O Fliess-Douer et al.
One test added photos to the article.15 Some studies     their injury, and the rehabilitation process is now
addressed that a copy of the entire test and score       more likely to be in the community, in day hospital
sheets are available upon request.                       or the home environment.29 It is therefore recom-
                                                         mended that skills associated with the daily needs
                                                         of this population will be included in wheel chair
Psychometric properties                                  skills tests. Some of the reviewed skills do not
   An analysis and summary of the psychometric           comply with this recommendation. For example, in
properties of the 11 tests is presented in Table 3.      the level propulsion skill, the participant has to cover
   Seven out of 11 tests presented information on        the same distance when going forward and back-
validity.13–19,22 For most tests, content validity       ward, as if it has the same necessity in daily life. In
was based on the involvement of health profes-           the Wheelchair Circuit,17,20 three skills out of eight
sionals in the development of the test and on lit-       require the use of a treadmill. In contrast, the 10
erature studies. Three tests14,16,18 based the           wheelchair skills of the Obstacle Course
content validity on wheelchair users’ suggestions;       Assessment of Wheelchair User Performances
two tests15,17 based the content validity on related     (OCAWUP)14,15 are most relevant for daily needs
instruments. Construct validity was determined in        of wheelchair users. In addition, this test is the only
seven tests,13–17,19,25 correlating the new test with    one that associates skill selection with the average
the Functional Independence Measure (FIM)                height of pavements in Quebec City as well as corre-
instrument, and/or correlating the test result with      lating the level of inclines to the National Building
age, gender, lesion, type of wheelchair or time          Code of Canada. It is recommended that the skills to
using the wheelchair before the first test trial.        be included in a test are chosen according to a large
   Only tests with sufficient reliability were           survey among experienced wheelchair users, sorting
included in this review. Test–retest reliability was     out the most essential skills for daily life in a wheel-
assessed in five tests.14,16,19,21,25 Time between the   chair. It is also advised that slopes, heights and other
two trials varied from 1 day up to 28 days. Inter-       measurements selected for the test are associated
rater was evaluated in eight tests13–20,23,24 and        with norms, standards and architectural accessibility
intra-rater was examined in four tests.16–20             codes, regional as well as universal.
   Only three studies reported sensitivity to
change over time in wheelchair skills perfor-
mances.13,17,22 In these studies the tests were
administered at the beginning and the end of the         Scaling and outcome parameters
rehabilitation programme. The above three studies,          Scaling method is a crucial aspect and has a
which assessed changes in wheelchair skills perfor-      direct impact on the responsiveness of the test.
mances over time, were the only studies that indi-       Some of the reviewed tests use only qualitative
cated ceiling effect for the paraplegic group and        scales. Specifically, the ‘pass/fail’ ranking, used
higher responsiveness (detecting functional              in the Wheelchair Circuit,17,20 Valutazione Fun-
changes over time) in tetraplegic persons.13,17,20,22    zionale Mielolesi (VFM)22 and Wheelchair Skills
                                                         Test version 2.4 (WST-2,4)16 tests, cannot guaran-
                                                         tee a clear and sensitive distinction between levels
                                                         of performance in groups but especially in individ-
Strengths and weaknesses
  The results of this evaluation are presented in        uals. Some tests evaluate performance ability by
Table 4, and will be incorporated in the discussion      assessing only the ‘degree of independency’. This
part of this article.                                    may not reflect the actual performance level, since
                                                         a person may be able to perform a certain wheel-
                                                         chair skill independently, but if it requires an
                                                         unreasonable amount of time or high energy
Discussion                                               cost, the person might choose not to perform this
                                                         skill in daily life. The most sensitive quality scales
Today, individuals with spinal cord injury spend         were found to be the independency scale of the Five
less time in the hospital during the acute phase of      Additional Mobility and Locomotor (5-AML)13
Table 3   Psychometric properties of the wheelchair skills tests
Middleton, 200613
FIM 5 addi-     1             A                              No info                   No info       k range         Although written ‘high
  tional items;                                                                                         0.82–0.96       responsiveness to
  5-AML                                                                                                                 change over time’ it
                                                                                                                        refers to the tetra-
                                                                                                                        plegic group, while a
                                                                                                                        ceiling effect is men-
                                                                                                                        tioned in the paraple-
                                                                                                                        gic group
Routhier, 2004, 200514,15
OCAWUP           1,2,3        §A                              ICC range 0.74–0.99       No info       ICC 0.98       No info
                              B (FIM) r ¼ 0.84, P  0.05        (time)                                  (time)
                                                              k range 0.09–1.00 (GSE)                 k range 0.82-
                                                              ICC 96 (overall score)                   0.96 (GSE)
                                                                                                      ICC
                                                                                                        0.97(ove-
                                                                                                        rall score)
Kirby, 200416
WST-2.4          2            þA r ¼ –0.434, P50.001.         ICC ¼ 0.90                ICC ¼ 0.96    ICC ¼ 0.97      No info
                                A r. P ¼ 0.38. ^A
                                P ¼ 0.0112.*A
                              B (the global assessments of
                                WC users’ therapists and
                                admission and discharge
                                FIM scores) 0.394, 0.38,
                                0.31
Kilkens, 2002, 200417,20
WC circuit       3            Ability score (T1–T3):  A.     No info                   ICC ¼ 0.98    ICC ¼ 0.97      All 3 scores showed
                                þ A (only at T3); B (FIM                                                                 strong significant
                                mobility score, peak power                                                               improvement
                                output and Vo2 peak)                                                                     between T1 and T3.
                              Performance time score  A                                                                 The SRM was 0.6
                                (only at T3); þ B (FIM                                                                   for ability score, 0.9
                                mobility score, peak power                                                               for performance
                                output, and peak oxygen                                                                  time, and 0.8 for
                                uptake)                                                                                  physical strain score
                              Physical strain score:  A
                                (only at T3); B (peak
                                power output and peak
                                                                                                                                                  Wheelchair skills tests for manual wheelchair users
                                                                                                                                   (Continued )
Table 3   Continued
                                                                                                                                                                       880
Test                  Validity                                     Reliability                                                            Sensitivity to
                                                                                                                                          change over time
                      Content/     Construct/concurrent            Test–retest                    Intra-rater             Inter-rater
                      face
Stanley, 200318
WUFA                  1, 2         No info                         No info                        ICC ¼ 0.78              ICC ¼ 0.96      No info
            19
Kirby, 2002
WST-1                 1             þ A negative r P50.05;         r ¼ 0.65                       r ¼ 0.96                r ¼ 0.95        No info
                                     ^A P ¼ 0.0085; B
                                     P ¼ 0.008 (the OT global
                                                                                                                                                                       O Fliess-Douer et al.
                                     rating)
Cress, 200221
WC-PFP test           3            B (Sickness Impact Profile      ICC 0.96                       No info                 No info         No info
                                     scale) significant correla-
                                     tion (r ¼ –0.45) only for
                                     bathing and dressing
                                     (self-related health and
                                     upper body domain)
Taricco, 200022
Measurement           3            A *A                           No info                        No info                 Was evalu-      Scores had significantly
  scale VFM                        B (Barthel Index, QIF,                                                                  ated in          improved for tetra-
                                     FIM) range 0.67–0.88                                                                  previous         plegia and high-level
                                                                                                                           phase of         paraplegia between
                                                                                                                           this project     T1 and T3
                                                                                                                           (published
                                                                                                                           in Italian)
Harvey, 199823
Assessing mobil-      1            No info                         No info                        No info                 k range         No info
  ity in paraplegic                                                                                                         0.82–0.98
Gans, 198824
TAMP                  No info      No info                         No info                        No info                 k range         No info
                                                                                                                            0.65–0.83
Jebsen, 197025
Time measure-         No info      *A (healthy people vs WC        r 0.85–0.99 (time)             No info                 No info         No info
  ment in a stan-                    users)
  dardized test
FIM, Functional Independence Measure; 5-AML, Five Additional Mobility and Locomotor test; OCAWUP, Obstacle Course Assessment of Wheelchair User
Performances; SRM, standardized response mean; GSE, global score of ease; WC, wheelchair; ICC, intraclass correlation coefficient; WST, Wheelchair Skills
Test; WUFA, Wheelchair Users Functional Assessment; WC-PFP, Wheelchair Physical Functional Performance; SCI, spinal cord injury; VFM, Valutazione
Funzionale Mielolesi; TAMP, Tufts Assessment of Motor Performance.
Validity legend:
Content/face: 1, involvement of health professional in development; 2, involvement of WC users in development; 3, based on related instrument.
Construct: A – significant factor.
Concurrent: B – correlation with a related instrument/physiological parameters. T1 – first test trial; T3 – last test trial (mostly at the end of the rehabilitation
programme).
Variables signs: , lesion level (tetraplegia/paraplegia); *, diagnostic category (SVA, CP, Amp, SCI, etc.); þ, age; ^, experience of WC use; §, propulsion
methods.
Table 4   The critical evaluation (only tests with QAS above 6.5)
                                                                                            feasibility
                                                                                         (g) No expression of a total score
                                                                                                                                                              881
                                                                                                                                              (Continued )
                                                                                                                                                              882
Table 4 Continued
Taricco, 2000
VFM                    A direct observation of           (a) Test can be used in differ-         (a) 23 WM skills out of 61, not measuring only WC skill
                         patient performance,               ent settings (home,                     performances
                         excluding 1 task that              outpatient)                          (d) No quantity data
                         is simulated and 2              (b) Only SCI, male and female           (e) Quality scale based on level of independency
                         that are collected by              in a reasonable ratio, para-         (f) Between 30 and 50 min (not clearly described)
                         interview (none of                 plegic and quadriplegic, big         (g) No expression of a total score
                         those are related to               sample
                         mobility). VFM was              (e) 1–5 quality scale
                         administered at the
                         beginning and the
                         end of the rehabilita-
                         tion programme.
                         COHORT
5-AML, Five Additional Mobility and Locomotor; OCAWUP, Obstacle Course Assessment of Wheelchair User Performances; VFM, Valutazione Funzionale
Mielolesi; WM, wheeled mobility; WST, Wheelchair Skills Test; SCI, spinal cord injury; FIM, Functional Independence Measure; GSE, global score of ease
(a) Quantity data for comparison with other tests or previous trails.
(b) Quality analysis (on field and/or video-recorded performance, analysed by experts) enable trainers (PT, PE and peers models) to improve their teaching
skills and also for the enhancement of the sensitivity of the test.
(c) Feasibility – duration of the test: no longer than 30 minutes.
(d) Express final test score.
(e) Test everyday wheeled mobility skills rather than ‘lab’ examinations: using skills that are needed in everyday life, using their own manual wheelchair.
(f) WM test for person with SCI.
(g) Assessing the differences in level of wheelchair skills performances of SCI (optimal WM, good WM, moderate WM and poor WM) and testing the
outcome of an WM intervention (or learning phase during the rehabilitation process), sensitively and precisely.
                                                  Wheelchair skills tests for manual wheelchair users      883
test and the performance’s quality scale of the          instance, when performing slalom the participant
OCAWUP test.14,15 Some of the reviewed tests             has to drive forward, and in this case the need to
use quantitative scales (e.g. time score, heart          test level propulsion forward is questionable.
rate, etc.). Such scales allow simple and objective         The chosen environment for all the tests reviewed
comparison with other trials and tests. For              in the present study was a rehabilitation centre,
instance, in the Wheelchair Circuit test17,20 the        where it is easy to recruit participants, equipment
highest statistical significant score was the ‘perfor-   as well as examiners, but whether an accessible
mance time score’, providing evidence for                rehabilitation centre is the most suitable environ-
improvement in wheelchair skills performances            ment for evaluating wheelchair skills that are
over time. Nevertheless Routhier et al.14 men-           required for daily life is debatable. Furthermore,
tioned that one should be careful with the use of        patients in rehabilitation are rather immature in
time in short tasks (e.g. ‘gets over 2 cm threshold’).   their wheelchair skills performances. Nevertheless,
If a wheelchair user takes 15 seconds instead of 10      a distinction should be made between the location
(an extra 50%) to achieve a task, it does not nec-       in which the reviewed studies took place for their
essarily mean that the wheelchair user has difficul-     validation and the ability to administer them out-
ties. To conclude, in a future standardized test it is   side rehabilitation centres for clinical purposes.
suggested to combine both quantity measures and             The type of wheelchair has an important impact
sensitive quality scales.                                on carrying out a task, especially when testing
                                                         level of performance (e.g. type and wheelchair
                                                         quality, tyre pressure, maintenance status, etc.)
                                                         Using one’s own wheelchair during the test
Feasibility and complexity                               would probably better reflect performance level
   In general, the duration of a test is dictated by     but threatens the stability of the test. Aiming the
the number and complexity of the skills included,        wheelchair skills test for daily activities and social
but in some of the reviewed tests there is a contra-     roles, the use of the participants’ own wheelchairs
diction to this concept. On the one hand, some           is preferred, accompanied by a full description of
tests evaluate many skills in a relatively short         the wheelchair used.
time (the VFM22 test assessed 61 skills within              Accessibility to the test protocols is important in
30–50 minutes and the WST-2.416 assessed 50              order to understand the instructions and settings
skills within 27 minutes). An explanation to this        of the tasks. Some of the reviewed studies lack a
observation is that some tests do not assess all the     full description of the tasks, which may explain the
skills they contain, giving the observer the freedom     multiplicity of tests. It is advised that each skill
to choose which skill to evaluate from the pro-          should be well described in the article. It is also
posed list of skills. This involves a subjective         recommended that the reader is given easy access
judgement of the observer, eliminating skills that       to the full test protocols (e.g. through a website16).
are ‘not a goal’ for the specific participant, and       This will invite rehabilitation professionals and
that therefore might reduce test sensitivity.            other researchers to use the same test, and may
It also makes a comparison between different test-       promote the development of a universal wheel-
ing difficult, if not impossible. On the other hand,     chair skills test.
some tests contain fewer skills but last longer (the
Wheelchair Users Functional Assessment18 test
assessed 13 skills in 1–1.5 hours). Reducing the
number of selected skill shortens test duration          Psychometric properties
but may subject the test to ceiling effect (e.g.            When conducting research in a rehabilitation
5-AML21 test which has a ceiling effect on para-         domain, setting the goals according to precise def-
plegics). The number of skills included in the test is   inition of terms is critical as a guideline for devel-
a compromise between the need to cover many              oping the tool and choosing the most appropriate
aspects of wheelchair skill performances and min-        skills. A clear definition of terms, specifically of
imizing overlaps between the selected skills. More       the outcome expressions (e.g. wheelchair user’s
complex skills inherently include ‘subskills’; for       ‘function’ or ‘wheeled mobility’), is the foundation
884   O Fliess-Douer et al.
for ensuring a good content validity. Many of the          Despite this comment, the same skills were used
reviewed tests lack a clear terms’ definition; for      to evaluate paraplegic and tetraplegic clients.
instance, the Wheelchair Users Functional               Spinal cord-injured wheelchair users may demon-
Assessment study18 aimed to ‘develop a perfor-          strate the best wheelchair skill performance, and
mance-based functional measurement tool that            could be the benchmark to reach in term of wheel-
needed to incorporate home and community                chair skills. It is advisable to first develop sensitive
wheelchair skills’. One of the skills included in       wheelchair skills test specifically for the spinal
the Wheelchair Users Functional Assessment is           cord injury population, with adaptations for the
upper and lower dressing, but because of the            two subgroups (tetraplegic and paraplegic). Such
absence of definition of terms, it is unclear why       a test might reduce ceiling or floor effects, and
dressing is included as a wheelchair skill. In con-     could be generalized later on to the entire wheel-
trast, a good example where the objective of the        chair user population.
test as well as definition of terms are presented can      Most of the reviewed articles aim to assess the
be found at OCAWUP15: ‘the purpose of the               reliability and validity of the test, but do not derive
OCAWUP is to assess and document the mobility           norms and standards for wheelchair skill perfor-
performance of manual and motorized wheelchair          mances. Previous studies do not present data that
users in potentially difficult environmental situa-     can be compared with results from other studies.
tions. Environmental situations are obstacles when      As revealed from the current review, there is no
they limit the social participation of an individ-      broadly accepted wheelchair skills test. Such an
ual’.15 Another example of unclear term definition      ‘ideal’ instrument should measure the level of
                                                        selected aspects of wheelchair skill performance,
is a confusion between ‘ability’ (e.g. sprint task)
                                                        be methodologically strong and practically feasi-
and ‘motor skill’ (e.g. ‘transferring from the floor
                                                        ble. Once a standardized wheelchair skill test has
back into the wheelchair’), which is found in many
                                                        been developed, accepted worldwide and fre-
tests. It is important to understand the differences
                                                        quently used, it will enable norms and standards
between these two terms and to select tasks that
                                                        to be created for wheelchair skill performance.
clearly meet the definition of motor skill.
   In a population of people with spinal cord           Study limitations and strength
injury, an individual might function at minimal            This review was limited to actual performance-
(C3) or maximal (L3) levels. Ceiling and floor          based wheelchair skills tests published in peer-
effects are the result of lack of precision and the     reviewed articles that were available in English
ability of an instrument to detect meaningful           only. Since this review aimed to serve as a base
changes in level of performance at the upper or         for developing a standardized manual wheelchair
lower ends of the scale. If individuals have reached    skills test for those with spinal cord injury, assess-
the maximum rating in their first trial, more subtle    ment tools that were constructed exclusively for
improvement will not be reflected. The idea is to       other disabilities were not included, although
establish one test for all wheelchair users, similar    some lessons may be also drawn from those instru-
to the Functional Independence Measure30 that           ments and studies.
has been widely adopted by the rehabilitation              The detailed skill-specific review along with gen-
                                                        eral analysis is a particular strength of the study,
community as a tool for use with diverse patient
                                                        since it points out the important aspects of each
populations. Tools that generalize wheelchair user
                                                        test and facilitates a selection of the most suitable
populations, however, may fail to differentiate
                                                        components, enabling the development of a stan-
between levels of performance. In the WST-2.4,16
                                                        dardized wheelchair skills test, relying on the
although ceiling effect was not reported, the use of    strengths of existing measurement tools.
quality scale only could probably lead to ceiling
effects (e.g. assessing ‘50 meter level propulsion
forward’ with a pass/fail scale will definitely         Conclusion
produce a ceiling effect for all paraplegic clients).
The VFM22 was the only test that addressed the          As shown in this review, many wheelchair skills
need to subdivide the spinal cord injury group.         tests are applied to the measurement of wheelchair
                                               Wheelchair skills tests for manual wheelchair users        885
14 Routhier F, Desrosiers J, Vincent C, Nadeau S.              with spinal cord injury: a new standardized
   Reliability and construct validity of an obstacle           measurement scale. Gruppo Interdisciplinare
   course assessment of wheelchair user performance.           Valutazione Interventi Riabilitativi. Arch Phys
   Int J Rehabil Res 2005; 28: 49–56.                          Med Rehabil 2000; 81: 1173–80.
15 Routhier F, Vincent C, Desrosiers J, Nadeau S,         23   Harvey LA, Batty J, Fahey A. Reliability
   Guerette C. Development of an obstacle course               of a tool for assessing mobility in wheelchair-
   assessment of wheelchair user performances                  dependent paraplegics. Spinal Cord 1998;
   (OCAWUP): a content validity study. Technol                 36: 427–31.
   Disabil 2004; 16: 19–31.                               24   Gans BM, Haley SM, Hallenborg SC, Mann N,
16 Kirby RL, Dupuis DJ, MacPhee AH et al.                      Inacio CA, Faas RM. Description and interobser-
   The Wheelchair Skills Test (version 2.4): measure-          ver reliability of the Tufts Assessment of Motor
   ment properties. Arch Phys Med Rehabil 2004; 85:            Performance. Am J Phys Med Rehabil 1988; 67:
   794–804.                                                    202–10.
17 Kilkens O, Dallmeijer A, de Witte L, van der           25   Jebsen RH, Trieschmann RB, Mikulic MA,
   Woude L, Post M. The Wheelchair Circuit: con-               Hartley RB, McMillan JA, Snook ME.
   struct validity and responsiveness of a test to             Measurement of time in a standardized test of
   assess manual wheelchair mobility in persons with           patient mobility. Arch Phys Med Rehabil 1970;
   spinal cord injury. Arch Phys Med Rehabil 2004;             51: 170–75.
   85: 424–31.                                            26   Mills T, Holm MB, Trefler E, Schmeler M,
18 Stanley RK, Stafford DJ, Rasch E, Rodgers MM.               Fitzgerald S, Boninger M. Development and
   Development of a functional assessment measure              consumer validation of the functional evaluation
   for manual wheelchair users. J Rehabil Res Dev              in a wheelchair (FEW) instrument. Disabil
   2003; 40: 301–7.                                            Rehabil 2002; 24: 38–46.
19 Kirby RL, Swuste J, Dupuis DJ, MacLeod DA,             27   Mills TL, Holm MB, Schmeler M. Test-retest
   Monroe R. The Wheelchair Skills Test: a pilot               reliability and cross validation of the functioning
   study of a new outcome measure. Arch Phys Med               everyday with a wheelchair instrument. Assist
   Rehabil 2002; 83: 10–18.                                    Technol 2007; 19: 61–77.
20 Kilkens O, Post M, van der Woude L,                    28   Webster JS, Cottam G, Gouvier WD, Blanton P,
   Dallmeijer A, van den Hauvel W. The wheelchair              Beissel GF, Wofford J. Wheelchair obstacle
   circuit: reliability of a test to assess mobility in        course performance in right cerebral vascular
   persons with spinal cord injuries. Arch Phys Med            accident victims. J Clin Exp Neuropsychol 1989;
   Rehabil 2002; 83: 1783–8.                                   11: 295–310.
21 Cress ME, Kinne S, Patrick DL, Maher E.                29   Ditunno JF, Formal CS. Chronic spinal cord
   Physical functional performance in persons using            injury. N Engl J Med 1994; 330: 550–6.
   a manual wheelchair. J Orthop Phys Ther 2002;          30   Guide for the uniform data set for medical rehabili-
   32: 104–13.                                                 tation (including the FIM instrument), version 5.1.
22 Taricco M, Apolone G, Colombo C, Filardo G,                 Buffalo, NY: State University of New York at
   Telaro E, Liberati A. Functional status in patients         Buffalo, 1997.