Skip to main content
Download PDF

3-Dimensional printing in rehabilitation: feasibility of printing an upper extremity gross motor function assessment tool

BioMedical Engineering OnLine volume 20, Article number: 2 (2021) Cite this article

Abstract

Background

Use of standardized and scientifically sound outcome measures is encouraged in clinical practice and research. With the development of newer rehabilitation therapies, we need technology-supported upper extremity outcome measures that are easily accessible, reliable and valid. 3‐Dimensional printing (3D-printing) has recently seen a meteoric rise in interest within medicine including the field of Physical Medicine and Rehabilitation. The primary objective of this study was to evaluate the feasibility of designing and constructing a 3D printed version of the Toronto Rehabilitation Institute-Hand Function Test (TRI-HFT). The TRI-HFT is an upper extremity gross motor function assessment tool that measures function at the intersection of the International Classification of Function’s body structure and function, and activity domain. The secondary objective was to assess the preliminary psychometrics of this test in individuals with stroke.

Results

3D design files were created using the measurements of the original TRI-HFT objects. The 3D printed objects were then compared to the original test objects to ensure that the original dimensions were preserved. All objects were successfully printed except the sponge and paper which required some modification. The error margin for weight of the objects was within 10% of the original TRI-HFT for the rest of the objects. Nine participants underwent the following assessments: the Chedoke Arm and Hand Activity Inventory (CAHAI), Fugl Meyer Assessment-Hand (FMA-Hand), Chedoke McMaster stages of recovery of the arm (CMSA-Arm) and Chedoke McMaster stages of recovery of the hand (CMSA-Hand) and the 3D TRI-HFT for assessment of psychometric properties of the test. The video recorded assessment of the 3D TRI-HFT was used for reliability testing. Construct validity was assessed by comparing the scores on 3D TRI-HFT with the scores on CAHAI, CMSA-Arm, CMSA-Hand and FMA-Hand. The 3D TRI-HFT had high inter-rater reliability (Intra-Class Correlation Co-efficient (ICC) of 0.99; P < 0.000), high intra-rater reliability (ICC of 0.99; P < 0.000) and moderate-to-strong correlation with the CMSA-Arm, CMSA-Hand and FMA-Hand scores.

Conclusions

The TRI-HFT could be successfully 3D printed and initial testing indicates that the test is a reliable and valid measure of upper extremity motor function in individuals with stroke.

Background

Use of standardized and scientifically sound outcome measures is highly encouraged in clinical practice and research. A number of guidelines have been developed around use of upper extremity outcome measures in stroke [1, 2]. However, researchers have identified that with the development of newer rehabilitation therapies we need technology-supported upper extremity outcome measures that are easily accessible and can measure change consistently and reliably [3]. The most commonly used upper extremity measures in clinical and research settings for stroke in the International Classification of Function’s (ICF’s) body structure and function (WHO-Chapter 4) and activity level domains are the Fugl Meyer Assessment Upper Extremity (FMA-UE) [4] and the Action Research Arm Test (ARAT) [5], respectively. The ARAT is a time-based activity test and although widely used has several documented limitations [6]. Furthermore, Demers et al. reviewed 15 upper extremity outcome measures assessing arm/hand function at the ICF’s activity level recommended by neurological clinical practice guidelines [7]. These include the Box and Block test [8], Jebsen Hand function test [9], Nine hole peg test [10], ARAT [5], Chedoke Arm and Hand Activity Inventory (CAHAI) [11], Arm Motor ability test [12], Frenchay Arm Test [13], Motor Evaluation Scale for Upper Extremity in Stroke Patients [14], Reaching Performance Scale for Stroke [15], Test d’Évaluation des Membres supérieurs des Personnes Âgées [16], Wolf Motor Function Test [17], ABILHAND [18], Capabilities of the upper extremity [19] and Motor-Activity Log [7]. The review concluded that current activity measures may not distinguish recovery from compensation and do not adequately track changes in movement quality over time. Moreover, most of the above stated outcome measures either lack information about validity, reliability or responsiveness in the stroke population or require an administration time of > 20 min, may require equipment purchase or construction or copyright payment [2].

Thus, there is a need for a tool that can reliably and effectively measure change following rehabilitation interventions such as robot-assisted therapies [20], functional electrical stimulation (FES) therapy [21], mirror therapy [22], brain computer interface-controlled FES therapy [23] and many others. The tool needs to be (1) universally and easily accessible, (2) reliable, (3) valid, (4) feasible to be administered within both clinical and research settings, and (5) virtually requiring no training to be used by rehabilitation professionals and research personnel.

We developed the Toronto Rehabilitation Institute-Hand Function Test (TRI-HFT) [24] an upper extremity gross motor function assessment tool that measures function at the intersection of the ICF’s body structure and function and activity domain. The TRI-HFT evaluation requires participants to manipulate everyday objects using only the affected upper extremity and measures difficulty with manipulation of these objects using the paretic hand. The scoring differentiates between the use of a physiological grasp versus use of compensatory strategies during task execution and virtually no training is required to administer the test. The scoring system requires the participant to reach for the object, grasp it, lift off the supporting surface and finally manipulate it before replacing it back on the table. The original TRI-HFT test consists of two parts; (1) object manipulation and (2) strength measurement. The object manipulation part of the test consists of day-to-day objects that are manipulated using different types of grip. The test objects include: (1) mug, (2) paper, (3) book, (4) Ziploc bag filled with five golf balls, (5) pop can, (6) dice, (7) isosceles triangular sponge, (8) credit card, (9) wireless home telephone, (10) pencil and (11) nine rectangular blocks in sets of 3 × 100 g, 3 × 200 g and 3 × 300 g. Each of the three blocks in each weight category have surfaces with different levels of friction. This part of the test is graded on a 0–7 scale where higher scores indicate better performance. The strength measurement part of the test measures the strength of lateral grip and palmar grasp using three sub-tests, i.e. instrumented credit card, instrumented cylinder, and the wooden bar. It takes approximately 15 min to administer the original TRI-HFT, on bilateral upper extremities, in individuals with spinal cord injury [26]. Administration and scoring of the test do not require special training and can be administered by reviewing a two-page instruction sheet. Details on the original test object dimensions and administration are described in Kapadia et al. [24]. The original version of the test was validated in sub-acute spinal cord injury population, however, was not validated in stroke.

The test, however, failed to see a significant uptake primarily, because it was a challenge to make this test available to interested clinicians and researchers within and outside of Canada. The original TRI-HFT was fabricated by the researchers and while many of the test objects were “off the shelf objects” some were manufactured in our laboratory. Although the original test dimensions are published, we realized that it was challenging for clinicians to compile the test and besides if the test object dimensions changed than standardization of the test would become questionable. This limitation became the motivation for exploring the ability to 3D print the test to make it universally accessible. 3D-printing has recently seen a meteoric rise in interest within medicine, and the field of Physical Medicine and Rehabilitation is no exception [25]. Researchers are discovering many medical and dental applications including devices and implants, biosynthetic and hybrid human tissues including skin, cartilage, and bone and many more applications [26,27,28]. For the field of physical medicine and rehabilitation, 3D printing has the potential to provide unique solutions to common obstacles related to fabrication and delivery [25]. 3D printing within the rehabilitation world has mostly been explored for fabricating orthosis, prosthesis and for assistive technologies [29,30,31].

The primary objective of the current study was to assess the feasibility of designing and constructing a 3D printed version of TRI-HFT objects (3D TRI-HFT). It is important to note that the administration of the 3D TRI-HFT and the scoring system remains the same as the original TRI-HFT [26]. The secondary objective was to do a preliminary testing of the psychometric properties of the 3D printed test, specifically the inter and intra-rater reliability of the first part of the test and construct (convergent) validity of the first and second part of the test in individuals with spinal cord injury (under review in The Journal of Spinal Cord Medicine) and chronic stroke. The motivation for testing the 3D printed version of TRI-HFT in stroke was the lack of a stroke-specific measurement tool that is universally easily accessible, can detect change following newer rehabilitation interventions and is able to measure outcomes that are important to stroke survivors and their caregivers.

Results

The TRI-HFT objects were successfully 3D printed (Fig. 1). Physical dimensions of all objects were within 0.1 mm tolerance except for the sponge and paper, and all weight measurements were within a 10% error margin except for the sponge (Table 1).

Fig. 1:
figure 1

3D printed Toronto Rehabilitation Institute-Hand Function Test (3D TRI-HFT)

Full size image
Table 1 Dimensions of the original TRI-HFT objects and the 3D printed TRI-HFT objects
Full size table

The mean time taken to administer the 3D TRI-HFT on the affected upper extremity of the study participants was 10.5 min (Table 2).

Table 2 Time taken to complete the 3D TRI-HFT by individual study participant
Full size table

Nine participants were recruited for psychometric testing of the 3D TRI-HFT. Participants completed the 3D TRI-HFT, CAHAI, Chedoke McMaster Stroke assessment-Impairment Inventory-stage of arm (CMSA-Arm), Chedoke McMaster Stroke assessment-Impairment Inventory-stage of hand (CMSA-Hand) and Fugl Meyer Assessment-Hand (FMA-Hand) assessments. Participant demographics are listed in Table 3.

Table 3 Participant demographics
Full size table

Validity testing was performed using nine data sets, however, two of the nine participant videos (P34 and P36) were not available and hence reliability testing was performed on seven data sets. Individual participant raw scores as well as descriptive statistics including means, median, range and percentiles for the CMSA-Arm, CMSA-Hand, FMA-Hand and the 3D TRI-HFT components are summarized in Table 4. The inter and intra-rater reliability for the rectangular block’s component of the object manipulation task could not be assessed as the assessors had difficulty identifying the blocks on the videos based on their weight and texture.

Table 4 Participants raw scores on upper extremity outcome measures
Full size table

Intra-rater reliability

There was a high intra-rater reliability for the object manipulation component of the 3D TRI-HFT with an ICC score of 0.99 (95% CI 0.985–0.999; P < 0.000) (Fig. 2a).

Fig. 2
figure 2

a Scoring at two different time points by the same assessor (i.e. rating 1 and rating 2) and b scoring by three different assessors at a single time point

Full size image

Inter-rater reliability

The 3D TRI-HFT was found to have a strong inter-rater reliability for the object manipulation component of the test (Fig. 2b). Intra-class correlation co-efficient (ICC) across three assessors (NK, VZ, AY) was 0.998 (95% CI 0.992–1.0; P < 0.000).

Construct validity

The results showed that there was a statistically significant strong relationship between CMSA-Arm and the object manipulation part of the 3D TRI-HFT (r = 0.843, P = 0.01). A statistically significant moderate correlation was found between object manipulation of the 3D TRI-HFT and FMA-Hand (r = 0.698, P = 0.05) and CMSA-Hand (r = 0.667, P = 0.05). A moderate correlation was found between object manipulation of 3D TRI-HFT and CAHAI (r = 0.664, P = 0.051), however this correlation was not statistically significant.

For the strength measurement part of the 3D TRI-HFT test, including the rod, the instrumented cylinder and the instrumented credit card, no statistically significant relationship was found with any of the outcome measures, i.e. CAHAI, CMSA-Arm, CMSA-Hand or FMA-Hand. The relationship between the rod and the FMA-Hand approached statistical significance (r = 0.665, P = 0.051).

Discussion

3D printing technology has existed for more than 30 years, but has only recently garnered increased attention among scientists, engineers, and the public [32]. The rise of 3D technology is attributed to the availability of lower cost printers and breakthroughs in techniques and processing. In the current study, we established the feasibility of 3D printing the TRI-HFT. We found that all objects of the TRI-HFT could be easily printed except for the triangular sponge and the paper. The discrepancy in dimensions of the paper and sponge are limitations associated with 3D printing process. However, it is important to note that the “paper” and “sponge” created using the 3D technology have the look and design of the original objects and that the modifications are a trade-off that needed to be accepted to make the test universally accessible and reproducible. The sponge required a new design where it will have the properties of the “sponge” but is now shaped as a square instead of a triangle. Today, the TRI-HFT can be 3D printed for ~ CAD $ 500. This cost will decline as 3D printers become cheaper. For reference, the 3D printers costed ~ £175,000 (CAD $300,000)–£250,000 (CAD $ 400,000) in the 1990’s and currently that price has decreased tenfold with high end 3D printers costing ~ £10,000 (CAD $ 20,000)–£35,000 (CAD $ 60,000) [33].

In our convenience sample, of nine individuals with chronic stroke we found that the 3D printed TRI-HFT had high inter- and intra-rater reliability and moderately strong construct validity when compared to the CMSA and FMA. As seen from the results, however, it was not possible to rate the nine rectangular blocks with different weight and textures from the video assessments. These are now modified (numbered) to have a clear indication of which block is being manipulated and this indicator can be seen clearly on video recordings allowing for grading from a video assessment.

Construct validity of the test was assessed as there are no outcome measures identified as a gold standard for measurement of upper extremity function in the activity or body structure and function domain of the ICF [34]. The object manipulation component of the 3D TRI-HFT showed a strong correlation with the CMSA-Arm, whereas there was a moderately strong correlation between 3D TRI-HFT and CMSA-Hand and the 3D TRI-HFT and FMA-Hand. Although the scoring system was initially developed with the spinal cord population in mind, the granular scoring system allows one to capture function equally effectively in stroke population as well. Moreover, the test measures function from proximal to distal and allows the assessor to differentiate between use of physiological versus compensatory grasping patterns. Since most of the study participants had severe upper extremity impairment, distal function was severely compromised and subtle differences went undetected by both the CMSA- hand and the FMA-Hand. The 3D TRI-HFT, however, not only successfully captured arm function as seen by the strong relationship between 3D TRI-HFT and CMSA-Arm but also captured the subtle changes in hand function.

We found no statistically significant relationship between CAHAI and 3D TRI-HFT. This is not surprising given that CAHAI is designed to measure bilateral upper extremity function, whereas 3D TRI-HFT is designed to measure unilateral upper extremity function. In CAHAI, participants can score points by using the non-paretic hand to stabilize the object to assist the paretic hand in grasping an object. Participants can also hold objects with both hands to reduce the gravitational load and use the paretic hand as the supporting hand, while the non-paretic hand performs the accurate arm motions, supinations, and dextrous fine motor skills. Conversely, the 3D TRI-HFT isolates the portions of each task that can be performed unimanually.

We found no statistically significant relationship between the rod, instrumented cylinder and instrumented credit card of the 3D TRI-HFT with any of the other measures. The rod in the TRI-HFT is aimed at measuring the participant’s ability to withstand eccentric forces about the shoulder joint, the instrumented cylinder and the instrumented credit card are both objective measures and they measure torque and grip strength in Nm and N, respectively, using a dynamometer. The scores on these measures are influenced by the strength of the upper extremity muscles and neither the CMSA nor the FMA take into account strength of the muscles but are focused on synergies and movement isolation.

Existing upper extremity measures like the ARAT and the Fugl Meyer Scale commonly used in clinical and research settings fail to meet the demands of these environments, which experience shortages in time and personnel resources. The 3D TRI-HFT takes approximately ~ 11 min to be administered on the affected upper extremity and is cost effective. Another consideration is around importance of the findings of the current assessment tools to patients and their care givers. Stroke survivors identified the outcomes of ‘Independence, freedom and autonomy’, ‘Difficulty (with routine tasks)’ and ‘Everyday tasks’ as their three most important outcomes [35]. The objects used in the 3D TRI-HFT are objects commonly used in activities of daily living. Besides, the scoring system measures the ability to manipulate these objects as they would be manipulated during activities of daily living and hence the score on the TRI-HFT provides an objective measure of patient’s independence with these tasks. A recent review conducted by Miller et al., quoted that though there are a 144 upper extremity outcome measures being used in individuals with stroke [35] none of these assessments measure what is important to stroke survivors, their carers and clinicians [35].There are various other review articles in the literature that have looked at existing measures and most have concluded that there is no consensus amongst clinicians regarding best practices related to use of outcome measures or that existing tools are not sensitive to change in function and do not capture outcomes that are important to stroke survivors, carers and clinicians [3, 7, 35,36,37].

The 3D printed version of the TRI-HFT was pursued to fill this is gap in literature. 3D printing technology is becoming increasing accessible, affordable, it ensures standardization and reproducibility of the outcome assessment tool. As far as we know the TRI-HFT is the first upper extremity measure that can be 3D printed, and hence can be accessed from anywhere in the world. This is important for clinicians and researchers as it gives them easy access to a reliable and valid tool. Furthermore, the objects used in the test are day to day objects that can also be used as therapy tools by clinicians. From a researcher perspective, having an outcome assessment tool that is easy to manufacture in-house is important to reduce dependencies on high-cost manufacturing and out of country equipment orders. In a review conducted by Galeoto et al., the authors concluded that a universal, validated outcome measure is needed to allow comparisons across practice and recommended that future researchers use a common set of outcome assessments [38].

There are certain limitations to the study, like the small sample size, homogenous study sample with very limited upper extremity function and lack of gold standard outcome measures for this population which prevented a more critical comparison of the 3D TRI-HFT. Nonetheless, this test could be easily 3D printed and was found to be reliable and valid. Future studies will look at expanding the psychometric testing to the acute and sub-acute stroke population as well as those with higher levels of upper extremity function.

Conclusion

Our findings indicate that TRI-HFT is a 3D printable, simple, reliable, open source, and valid measure that can be accessed from virtually anywhere in the world. The 3D printing of the test guarantees high repeatability in object manufacturing and makes the test available to all users with a 3D printer, which are now becoming ubiquitous. The test can be administered with minimal to no training and produces outcomes that are meaningful not only to the professional community but also to the patients themselves and their care givers.

Methods

For the purpose of 3D printing the TRI-HFT, the dimensions of the original test objects were measured using calipers (precision level 0.01 mm) and the weight of the objects were measured using a kitchen scale (precision level 0.1 gm). These dimensions were used to create 3D printing design files. Objects were printed on the Stratasys Fortus 450mc in Acrylonitrile Butadiene Styrene (ABS) plastic with a resolution of 10 thou (~ 0.254 mm), with the exception of the golf balls, die, paper, and credit cards, which were printed at a resolution of 5 thou (~ 0.125 mm).The rectangular blocks of 200 g and 300 g were weighted with quarters once printed, in order to reach the mass of the original objects. The 200 g block was weighed with 28 CAD quarters and the 300 g block was weighed with 52 CAD quarters. All printing files for the 3D TRI-HFT will be made available at http://www.kite-uhn.com.

Psychometric testing of the 3D TRI-HFT was conducted in both spinal cord injury (under review in The Journal of Spinal Cord Medicine) and stroke population. A cross-sectional single-site trial was conducted to assess the reliability and validity of the 3D TRI-HFT in stroke. The study was conducted at an outpatient clinic in a rehabilitation hospital. The psychometric properties of the 3D TRI-HFT were tested within a pilot study aimed at creating a novel and usable robotic orthosis to improve performance on functional tasks in individuals with chronic stroke. Research Ethics Board approval for this study was obtained along with the approval for the pilot study. The inclusion criteria were: (a) stroke survivors greater than 7 days post-stroke (b) moderate-to-severe Stage of Hand 1–4 on the Chedoke McMaster Stroke Assessment (c) able to understand and speak English (d) able to give informed consent (e) able to attend at least one session at the TRI site where the study was conducted (f) passive range of motion of index finger proximal interphalangeal joint greater than 45° to allow for fitting the robotic glove. The exclusion criteria were: (a) participants with a severe risk for skin breakdown under applied loads (b) participants who are not able to verbally respond about their level of pain (c) participants with severe pain (above 4 on the Pain Rating Scale) in their more affected fingers during massage or active or passive extension (e.g. arthritis, fracture).

Consenting participants underwent a battery of upper extremity assessments including the CAHAI [11], FMA-Hand [4], CMSA-Arm, and CMSA-Hand [39] and the 3D TRI-HFT. The CAHAI is a validated upper limb measure that uses a seven -point quantitative scale to measure function. The scale assesses functional recovery of the arm and hand after a stroke and has demonstrated a high level of measurement quality and clinical utility [3]. The total score on the CAHAI ranges from 13 to 91. Similarly, the FMA-Hand has also demonstrated a high level of measurement quality and clinical utility and is recommended for assessment of upper extremity function in research and clinical practice [3]. The CMSA-Arm and CMSA-Hand is an assessment tool used to measure physical impairment and it assesses stages of recovery of arm and hand on a seven-point scale.

All participants completed all the above measures in one session with and without the robotic glove and were rated by the assessor (AY). To address, inter and intra-rater reliability, and construct validity, participant performance on the first component of the 3D TRI-HFT, i.e. object manipulation without the robotic glove, was video recorded. Prior to the start of the study the assessor (AY) was introduced to the 3D TRI-HFT and received a one-time 30 min training session on how to administer and score the test. The 3D TRI-HFT video recorded assessments were reviewed by two independent assessors (NK—Physiotherapist and VZ—Physician) for intra-rater reliability testing. Inter-rater reliability was assessed between all three assessors (NK, VZ, AY). Construct validity was assessed by comparing scores on the 3D TRI-HFT with the scores on CAHAI, FMA-Hand and CMSA.

Statistical analysis

All statistical procedures were conducted using SPSS version 16 (SPSS, Inc., USA). A P value of significance was set at < 0.05. The following statistical procedures were used for reliability and validity testing:

Inter-rater reliability

For the purpose of inter-rater reliability, scores by all three assessors (AY, NK, VZ) were compared using the ICC (n = 7). Two participant videos were not available for testing.

Intra-rater reliability

For the purpose of intra-rater reliability, assessors NK and VZ reviewed the participant videos 1 month apart and re-rated the performance on individual tasks (n = 14). The scores from the two time points were compared using the ICC. Two participant videos were not available for testing.

Construct (convergent) validity

The construct validity of the 3D TRI-HFT was established by computing Spearman’s correlation coefficient with the CAHAI, CMSA-Arm, CMSA-Hand and the FMA-Hand scores (n = 9). An r value of 0.0–0.4 was considered as weak correlation, 0.4–0.7 was considered as moderate correlation, and above 0.7 was considered as strong correlation [40].

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ICF:

International Classification of Function

FMA-UE:

Fugl Meyer Assessment Upper Extremity

ARAT:

Action Research Arm Test

CAHAI:

Chedoke Arm and Hand Activity Inventory

TRI-HFT:

Toronto Rehabilitation Institute-Hand Function Test

3 D printing:

3‐Dimensional printing

3D TRI-HFT:

3D printed version of Toronto Rehabilitation Institute-Hand Function Test

CMSA- Arm:

Chedoke McMaster Stroke assessment-Impairment Inventory-stage of arm

CMSA- Hand:

Chedoke McMaster Stroke assessment-Impairment Inventory-stage of hand

FMA-Hand:

Fugl Meyer Assessment-Hand

ICC:

Intraclass correlation coefficient

References

  1. Otterman N, Veerbeek J, Schiemanck S, van der Wees P, Nollet F, Kwakkel G. Selecting relevant and feasible measurement instruments for the revised Dutch clinical practice guideline for physical therapy in patients after stroke. DisabilRehabil. 2017;39(14):1449–57.

    Google Scholar 

  2. Sullivan JE, Crowner BE, Kluding PM, Nichols D, Rose DK, Yoshida R, et al. Outcome measures for individuals with stroke: process and recommendations from the American Physical Therapy Association neurology section task force. PhysTher. 2013;93(10):1383–96.

    Google Scholar 

  3. Alt Murphy M, Resteghini C, Feys P, Lamers I. An overview of systematic reviews on upper extremity outcome measures after stroke. BMC Neurol. 2015;15:29.

    Article  Google Scholar 

  4. Fugl-Meyer AR, Jaasko L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient. 1. A method for evaluation of physical performance. Scand J Rehabil Med. 1975;7(1):13–31.

    Google Scholar 

  5. Chen HF, Lin KC, Wu CY, Chen CL. Rasch validation and predictive validity of the action research arm test in patients receiving stroke rehabilitation. Arch Phys Med Rehabil. 2012;93(6):1039–45.

    Article  Google Scholar 

  6. Yozbatiran N, Der-Yeghiaian L, Cramer SC. A standardized approach to performing the action research arm test. Neurorehabil Neural Repair. 2008;22(1):78–90.

    Article  Google Scholar 

  7. Demers M, Levin MF. Do activity level outcome measures commonly used in neurological practice assess upper-limb movement quality? Neurorehabil Neural Repair. 2017;31(7):623–37.

    Article  Google Scholar 

  8. Platz T, Pinkowski C, van Wijck F, Kim IH, di Bella P, Johnson G. Reliability and validity of arm function assessment with standardized guidelines for the Fugl-Meyer Test, Action Research Arm Test and Box and Block Test: a multicentre study. ClinRehabil. 2005;19(4):404–11.

    Google Scholar 

  9. Sigirtmac IC, Oksuz C. Investigation of reliability, validity, and cutoff value of the Jebsen-Taylor Hand Function Test. J Hand Ther. 2020. https://doi.org/10.1016/j.jht.2020.01.004.

    Article  Google Scholar 

  10. Johansson GM, Hager CK. A modified standardized nine hole peg test for valid and reliable kinematic assessment of dexterity post-stroke. J NeuroengRehabil. 2019;16(1):8.

    Google Scholar 

  11. Barreca SR, Stratford PW, Lambert CL, Masters LM, Streiner DL. Test-retest reliability, validity, and sensitivity of the Chedoke arm and hand activity inventory: a new measure of upper-limb function for survivors of stroke. Arch Phys Med Rehabil. 2005;86(8):1616–22.

    Article  Google Scholar 

  12. Fulk G, Martin R, Page SJ. Clinically important difference of the arm motor ability test in stroke survivors. Neurorehabil Neural Repair. 2017;31(3):272–9.

    Article  Google Scholar 

  13. De Souza LH, Hewer RL, Miller S. Assessment of recovery of arm control in hemiplegic stroke patients. 1. Arm function tests. Int Rehabil Med. 1980;2(1):3–9.

    Google Scholar 

  14. Johansson GM, Hager CK. Measurement properties of the motor evaluation scale for upper extremity in stroke patients (MESUPES). DisabilRehabil. 2012;34(4):288–94.

    Google Scholar 

  15. Vianna de Andrade FPP, Padula RS, Binda AC, da Silva ML, Alouche SR. Measurement properties of the reaching performance scale for stroke. DisabilRehabil. 2019. https://doi.org/10.1080/09638288.2019.1650963.

    Article  Google Scholar 

  16. Desrosiers J, Hebert R, Bravo G, Dutil E. Upper extremity performance test for the elderly (TEMPA): normative data and correlates with sensorimotor parameters. Test d’Evaluation des MembresSuperieurs de PersonnesAgees. Arch Phys Med Rehabil. 1995;76(12):1125–9.

    Article  Google Scholar 

  17. Berardi A, Dhrami L, Tofani M, Valente D, Sansoni J, Galeoto G. Cross-cultural adaptation and validation in the Italian population of the wolf motor function test in patients with stroke. FunctNeurol. 2018;33(4):229–53.

    Google Scholar 

  18. Ekstrand E, Lindgren I, Lexell J, Brogardh C. Test–retest reliability of the ABILHAND questionnaire in persons with chronic stroke. PM & R J InjFunctRehabil. 2014;6(4):324–31.

    Article  Google Scholar 

  19. Marino RJ, Shea JA, Stineman MG. The capabilities of upper extremity instrument: reliability and validity of a measure of functional limitation in tetraplegia. Arch Phys Med Rehabil. 1998;79(12):1512–21.

    Article  Google Scholar 

  20. Kim G, Lim S, Kim H, Lee B, Seo S, Cho K, et al. Is robot-assisted therapy effective in upper extremity recovery in early stage stroke?—a systematic literature review. J PhysTher Sci. 2017;29(6):1108–12.

    Google Scholar 

  21. Thrasher TA, Zivanovic V, McIlroy W, Popovic MR. Rehabilitation of reaching and grasping function in severe hemiplegic patients using functional electrical stimulation therapy. Neurorehabil Neural Repair. 2008;22(6):706–14.

    Article  Google Scholar 

  22. Sathian K, Greenspan AI, Wolf SL. Doing it with mirrors: a case study of a novel approach to neurorehabilitation. Neurorehabil Neural Repair. 2000;14(1):73–6.

    Article  Google Scholar 

  23. Jovanovic LI, Kapadia N, Lo L, Zivanovic V, Popovic MR, Marquez-Chin C. Restoration of upper limb function after chronic severe hemiplegia: a case report on the feasibility of a brain-computer interface-triggered functional electrical stimulation therapy. Am J Phys Med Rehabil. 2020;99(3):e35–40.

    Article  Google Scholar 

  24. Kapadia N, Zivanovic V, Verrier M, Popovic MR. Toronto rehabilitation institute-hand function test: assessment of gross motor function in individuals with spinal cord injury. Top Spinal Cord InjRehabil. 2012;18(2):167–86.

    Article  Google Scholar 

  25. Lunsford C, Grindle G, Salatin B, Dicianno BE. Innovations with 3-dimensional printing in physical medicine and rehabilitation: a review of the literature. PM & R J InjFunctRehabil. 2016;8(12):1201–12.

    Article  Google Scholar 

  26. Banks J. Adding value in additive manufacturing: researchers in the United Kingdom and Europe look to 3D printing for customization. IEEE Pulse. 2013;4(6):22–6.

    Article  Google Scholar 

  27. Lee V, Singh G, Trasatti JP, Bjornsson C, Xu X, Tran TN, et al. Design and fabrication of human skin by three-dimensional bioprinting. Tissue Eng Part C Methods. 2014;20(6):473–84.

    Article  Google Scholar 

  28. Huotilainen E, Paloheimo M, Salmi M, Paloheimo KS, Björkstrand R, Tuomi J, et al. Imaging requirements for medical applications of additive manufacturing. Acta radiologica (Stockholm, Sweden: 1987). 2014;55(1):78–85.

    Article  Google Scholar 

  29. Telfer S, Munguia J, Pallari J, Dalgarno K, Steultjens M, Woodburn J. Personalized foot orthoses with embedded temperature sensing: proof of concept and relationship with activity. Med EngPhys. 2014;36(1):9–15.

    Article  Google Scholar 

  30. Gretsch KF, Lather HD, Peddada KV, Deeken CR, Wall LB, Goldfarb CA. Development of novel 3D-printed robotic prosthetic for transradial amputees. ProsthetOrthot Int. 2016;40(3):400–3.

    Google Scholar 

  31. Medola FO, Fortulan CA, PurquerioBde M, Elui VM. A new design for an old concept of wheelchair pushrim. DisabilRehabil Assist Technol. 2012;7(3):234–41.

    Article  Google Scholar 

  32. Hull C, Inventor; Uvp Inc, Assignee. Apparatus for production of three‐dimensional objects by stereolithography. 1984.

  33. Available from: https://3dprinthq.com/how-3d-printing-has-evolved-in-the-last-10-years/.

  34. Roach KEP. PT measurement of health outcomes: reliability, validity and responsiveness. JPO J ProsthetOrthot. 2006;18(6):8–12.

    Google Scholar 

  35. Duncan Millar J, van Wijck F, Pollock A, Ali M. Outcome measures in post-stroke arm rehabilitation trials: do existing measures capture outcomes that are important to stroke survivors, carers, and clinicians? ClinRehabil. 2019;33(4):737–49.

    Google Scholar 

  36. Pandian S, Arya KN. Stroke-related motor outcome measures: do they quantify the neurophysiological aspects of upper extremity recovery? J BodywMovTher. 2014;18(3):412–23.

    Google Scholar 

  37. Wang S, Hsu CJ, Trent L, Ryan T, Kearns NT, Civillico EF, et al. Evaluation of performance-based outcome measures for the upper limb: a comprehensive narrative review. PM & R J InjFunctRehabil. 2018;10(9):951-62.e3.

    Article  Google Scholar 

  38. Galeoto G, Iori F, De Santis R, Santilli V, Mollica R, Marquez MA, et al. The outcome measures for loss of functionality in the activities of daily living of adults after stroke: a systematic review. Top Stroke Rehabil. 2019;26(3):236–45.

    Article  Google Scholar 

  39. Gowland C, Stratford P, Ward M, Moreland J, Torresin W, Van Hullenaar S, et al. Measuring physical impairment and disability with the Chedoke-McMaster Stroke Assessment. Stroke. 1993;24(1):58–63.

    Article  Google Scholar 

  40. Dawson-Saunders BTR. Basic and clinical biostatistics. 2nd ed. East Norwalk: Appleton & Lange; 1994.

    Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Financial support for the study was obtained from Internal Departmental Research Funds. The funding body did not play a role in the design of the study, data collection, analysis, and interpretation of data or in writing the manuscript. The first author on the study is supported by the CIHR Frederick Banting Fellowship.

Author information

Authors and Affiliations

  1. Rehabilitation Sciences Institute, University of Toronto, Toronto, ON, Canada

    Naaz Kapadia & Rosalie H. Wang

  2. The KITE Research Institute, Toronto Rehabilitation Institute, University Health Network, 550 University Avenue, Toronto, ON, M5G 2A2, Canada

    Naaz Kapadia, Mathew Myers & Milos R. Popovic

  3. Rocket Family Upper Extremity Clinic, Toronto Rehabilitation Institute, University Health Network, 550 University Avenue, Toronto, ON, M5G 2A2, Canada

    Naaz Kapadia

  4. Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada

    Mathew Myers & Milos R. Popovic

  5. Department of Physical Therapy, Rehabilitation Sciences Institute, University of Toronto, Toronto, ON, Canada

    Kristin Musselman

  6. SCI Mobility Laboratory, Lyndhurst Centre, The KITE Research Institute, Toronto Rehabilitation Institute, University Health Network, Toronto, ON, Canada

    Kristin Musselman

  7. Department of Occupational Science and Occupational Therapy, University of Toronto, Toronto, ON, Canada

    Rosalie H. Wang

  8. Intelligent Assistive Technology and Systems Laboratory, The KITE Research Institute, Toronto Rehabilitation Institute, University Health Network, Toronto, ON, Canada

    Rosalie H. Wang

  9. Imperial College London, London, UK

    Aaron Yurkewich

Authors
  1. Naaz Kapadia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mathew Myers
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kristin Musselman
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rosalie H. Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Aaron Yurkewich
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Milos R. Popovic
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

NK is responsible for data analysis, data interpretation and writing of the manuscript, MM is responsible for the 3D designing of the TRI-HFT objects, AA is responsible for data collection, KM and RW are responsible for critical appraisal of the project and editing of the manuscript and MRP is responsible for conception and design of the work. All authors have reviewed and approve the content of the manuscript.

Corresponding author

Correspondence to Naaz Kapadia.

Ethics declarations

Ethics approval and consent to participate

Ethics board approval was obtained from Toronto Rehabilitation Institute- UHN Ethics Board.

Consent for publication

Not applicable.

Competing interests

Dr. Milos R. Popovic is the Chief Technology Officer and Director of Myndtec, Inc. a company that manufactures transcutaneous functional electrical stimulators.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kapadia, N., Myers, M., Musselman, K. et al. 3-Dimensional printing in rehabilitation: feasibility of printing an upper extremity gross motor function assessment tool. BioMed Eng OnLine 20, 2 (2021). https://doi.org/10.1186/s12938-020-00839-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12938-020-00839-3

Keywords

  • 3D printing
  • Rehabilitation
  • Upper extremity
  • Stroke
  • Outcome measure
  • Assessment
  • Psychometric properties

BioMedical Engineering OnLine

ISSN: 1475-925X

Contact us