Skip to main content

Methodological factors affecting joint moments estimation in clinical gait analysis: a systematic review

Abstract

Quantitative gait analysis can provide a description of joint kinematics and dynamics, and it is recognized as a clinically useful tool for functional assessment, diagnosis and intervention planning. Clinically interpretable parameters are estimated from quantitative measures (i.e. ground reaction forces, skin marker trajectories, etc.) through biomechanical modelling. In particular, the estimation of joint moments during motion is grounded on several modelling assumptions: (1) body segmental and joint kinematics is derived from the trajectories of markers and by modelling the human body as a kinematic chain; (2) joint resultant (net) loads are, usually, derived from force plate measurements through a model of segmental dynamics. Therefore, both measurement errors and modelling assumptions can affect the results, to an extent that also depends on the characteristics of the motor task analysed (i.e. gait speed). Errors affecting the trajectories of joint centres, the orientation of joint functional axes, the joint angular velocities, the accuracy of inertial parameters and force measurements (concurring to the definition of the dynamic model), can weigh differently in the estimation of clinically interpretable joint moments. Numerous studies addressed all these methodological aspects separately, but a critical analysis of how these aspects may affect the clinical interpretation of joint dynamics is still missing. This article aims at filling this gap through a systematic review of the literature, conducted on Web of Science, Scopus and PubMed. The final objective is hence to provide clear take-home messages to guide laboratories in the estimation of joint moments for the clinical practice.

Background

Quantitative motion analysis provides an objective description of joint kinematics and dynamics. It is recognised as a useful tool in clinics for functional assessment, diagnosis, planning of therapeutic and rehabilitative interventions, and outcome evaluation. In these applications, ensuring an accurate and reliable estimation of 3D joint moments is crucial. The most relevant sources of error affecting the estimation can be identified by reviewing how 3D joint dynamics is calculated. Two alternative methods are commonly applied (Fig. 1).

Fig. 1
figure 1

Schematic depiction of the workflow to estimate joint dynamics from measurements of kinematics and ground reaction forces (GRF), through kinematic and dynamic modelling of the body, and inertial parameters (inverse dynamics approach—IDA). The alternative estimation of external joint moments from kinematics and GRF is also reported

The first is the so-called inverse dynamics approach (IDA): the human body is represented as a multi-body chain of rigid segments, and Newton–Euler mechanics is applied iteratively to each segment to calculate net internal joint moments and forces [1,2,3,4]. Marker trajectories from stereophotogrammetry and ground reaction forces (GRF) from dynamometric platforms (“force platform” in short), are the input to the kinematic and dynamic models of the human body.

In general, the resultant joint moments acting at a joint are generated by a combination of muscle, ligament, and joint contact forces [5]. However, in almost all clinical gait analysis protocols, human joints are represented by either ideal spherical or hinge joint whose centre/axis approximates the joint centre/axis of rotation. Within this modelling assumption and in the hypothesis that friction is negligible, the resultant of the bone-to-bone contact forces passes very close to the geometrical centre/axis of the joint and therefore its contribution to the net moment is commonly neglected. Therefore, as first approximation, it can be assumed that the resultant moment of the intersegmental forces represents an estimate of the overall muscular moment plus the contribution of the ligaments. Following this description, the specificity of bi-articular muscles is disregarded [6].

IDA also requires the estimation of the body segment inertial parameters (BSIP) (i.e. mass, position of the centre of mass in the segment coordinate system, moments of inertia), usually obtained for a specific subject from generalised anthropometric tables.

A second simplified method requires only segmental/joint kinematics and GRF to estimate external moments. This approach neglects the contribution of the segment inertial and gravitational forces, assuming all the mass concentrated in the body centre of mass, and provides an estimate of joint moments only during the stance phase of gait (when GRF is measured) with minimal computational effort. Despite of its extreme simplicity, this approach has been applied in clinical gait analysis studies, and provided reasonable estimations of joint loadings during the stance phase, when the inertial contribution is minor [7], particularly for distal joints (ankle and knee) [1].

It follows that the sources of error can be summarized in four groups: (1) kinematic measures and processing, (2) measure of the GRF and processing, (3) determination of joint model parameters, and (4) estimation of the inertial parameters.

Kinematic errors include, for instance, the errors intrinsic in the measurement system, the soft tissue artefact and the inaccurate localization of anatomical landmarks, with the latter two recognized the most critical [8, 9].

GRF is measured by force platforms as the resultant mechanical interaction between the foot and the ground, described in the form of a 3D force vector applied in the centre of pressure (COP), represented in the platform coordinate system. Force platforms are prone to measurement errors per-se, but their calibration in the stereophotogrammetric coordinate system should also be regarded as a potential source of inaccuracy.

Errors comprised in joint parameters include the position of the joint centres, and the position and direction of the joint axes of rotations. The latter errors have an effect on both joint kinematics and dynamics [10, 11].

Finally, BSIPs can be estimated using several methods, namely predictive equations based on measurements of cadavers or living subjects [12,13,14,15,16,17], geometric approaches [18, 19], data of living subjects obtained through medical imaging technologies [20,21,22,23], or estimates provided by the solution of a non-linear optimization problem [24,25,26].

Numerous studies analysed, separately or in conjunction, the influence of these sources of error on the estimation of joint moments, but a systematic review of their impact on the clinical interpretability of results is missing. The present systematic review aims at filling this gap by investigating which of the aforementioned factors influence the estimation of joint moments to a greater extent. Whenever possible, implications on sensitivity, reliability and reproducibility of data for clinical use were also addressed.

Methods

Articles selection

Inclusion and exclusion criteria

We included studies published in English as full papers, using stereophotogrammetry and force platforms as measurement systems, analysing gait and activities of daily living (Table 1). Subsequently, we excluded articles not analysing the impact on joint dynamics of kinematics measurements and processing, GRF measurements and processing, joint kinematic and dynamic modelling, and body segment inertial parameters.

Table 1 Inclusion criteria considered for the current systematic review

Search strategy

Articles were searched in Web of Science, PubMed, and Scopus (until February 9, 2017). Keyword search was performed to match words in the title, abstract, or keywords fields. A first general search was performed selecting keywords to define subjects, general topics of interest and motor tasks. Four subsequent refinement searches were performed for kinematics (V.C. and G.V.) and force (R.S.) measurements and processing, joint parameters (A.Ce.), and body segment inertial parameters (S.F.). All Boolean researches are reported in Appendix.

Review process

Each reviewer first removed conference proceedings, theses, and duplicate journal references. Secondly, title and abstracts of the remaining papers were evaluated for inclusion based on the relevance to the four areas of search. A full text evaluation was performed if the title and abstract failed to provide adequate information. Finally, a manual screening of the reference lists of all included studies was undertaken to include further eligible studies not retrieved during the systematic database search.

Reliability, reproducibility and sensitivity analyses

In the following sections, the terms ‘‘agreement’’, ‘‘reliability’’, ‘‘reproducibility’’, and ‘‘repeatability’’ will be routinely used. As previously highlighted by Bartlett and Frost [27], these terms have been frequently abused in the literature. We therefore decided to strictly adhere to the definitions reported in [27], which are summarized here for convenience:

  • Repeatability refers to the variation in repeated measurements made on the same subject under identical conditions, e.g., same method and same rater;

  • Reproducibility refers to variation in measurements made on a subject under changing conditions, e.g., using different methods. When the changing condition refers to two different methods, this specific type of reproducibility study is commonly referred to as ‘‘method comparison study’’;

  • Reliability relates the ‘‘magnitude of the measurement error in observed measurements to the inherent variability in the underlying level of the quantity between subjects’’ [27]. Therefore, reliability depends upon the heterogeneity of the population in which the measurements are made. The typical parameters used in reliability analysis are the intra-class correlation coefficients (ICC) or the coefficient of multiple correlation (CMC) widely adopted in human movement analysis [28];

  • Agreement ‘‘quantifies how close two measurements made on the same subject are, and is measured on the same scale as the measurements themselves.’’ Agreement is an intrinsic characteristic of the method(s) and does not depend on the population in which measurements are made, unless bias or measurement precision varies with the true value being measured. Therefore, the measured agreement does not typically need to be recomputed when considering pathological groups, if the distribution of measurement errors is uniform across the range of true values.

To compare the results provided by the different studies, joint moment values were also expressed in % BW * H thus obtaining dimensionless quantities whenever possible. When no information about the subject/s height was reported in the original articles, a reference height of 1.7 m was considered. The results obtained after conversion were reported within brackets and were rounded to the nearest decimal place.

Results

Review selection and identification

The initial search yielded 8251 (Web of Science), 4535 (Scopus) and 7630 (PubMed) results (Fig. 2). Over the three search engines, subsequent refinement yielded to a total of 1039 results for kinematics and processing, 291 for GRF measurements and processing, 2786 for joint models, and 1000 for BSIP, respectively. Selection performed separately for each area and based on title and abstract or full text, lead to 38, 5, 22, and 20 journal papers. Despite considering studies conducted on healthy subjects only, the search reported 6 studies including patients [5, 29,30,31,32,33] whose conclusions were valid independently from the population of interest and were retained for further analysis. After excluding duplicates, 67 papers were finally listed.

Fig. 2
figure 2

Search strategy flow chart. After running the general search, the three researched databases listed 8251, 4535, 7630 papers, respectively (including duplicates). Subsequent refinement yielded to a total of 1039 results for kinematics and processing, 291 for GRF measurements and processing, 2786 for joint models, and 1000 for BSIP, respectively. After examining the title, abstract or full text, only 38, 5, 22, and 20 remained. The overall total, without counting articles included in more than one area of analysis and duplicates, was 67 papers

Of the 67 papers, 11 were included in more than one area and were analysed multiple times according to the focus of the analysis, but were included only once in Additional file 1: Appendix S1 (on-line material), where the studies identified for inclusion in the systematic review are listed.

Kinematics

The reviewed articles suggest that interactions exist between joint kinematics and the resultant joint moments, the measured/estimated kinematics being indeed one of the principal causes of uncertainty in dynamics estimations [34]. Kinematic errors typically include: apparent marker movements (due to errors in marker reconstruction performed by the optical systems), and real marker movements (due to the interposition of soft tissues between markers and the underlying bone, the so-named soft tissue artifact—STA) [9]. Another source of uncertainty is represented by the identification of anatomical landmarks which, being a subjective procedure, is prone to repeatability issues [8]. Overall, this source of error introduces uncertainties that can assume a considerable importance (6–232% of the estimated torque magnitude: 0.005–0.03% BW * H), these magnitudes being smaller for more distal joints [35].

In this section, we analyze the influence on IDA results of these three factors, as well as the role of the bone pose estimation and the definition of the coordinate systems, and of the gait protocol adopted.

Measure of marker trajectories

The literature remarks that noise affecting marker trajectories represents the first source of error to be compensated, due to its amplification/propagation during differentiation to calculate velocities and accelerations. This issue is particularly important when dynamics is estimated using kinematics only, without GRF measures [36]. Several methods were described for its compensation: digital filters, splines, spectrum analysis techniques [37], Kalman smoothing and multi-body kinematics optimization [38]. A sensitivity analysis was performed in [39] and it was found that filtering kinematic data with a cut-off value of 4.5 Hz improves gait dynamic estimates.

Soft-tissue artifact

Few studies quantified the effect of soft tissue artifacts of thigh and shank on the knee moments during walking [40, 41], stair ascent [42] and sit-to-stand [43] against gold standard measurements. Knee extensor and abduction moments were significantly underestimated in the middle of the stance phase of sit to stand, in correspondence to load increase [43]. This result was confirmed during the load transfer phase of stair ascent, but only for knee extension [42]. Similar trends in magnitude were measured for both moments during the single support phase of walking [40, 41]. Also, Buczek et al. [41] suggested a similar role for the artifact in underestimating the knee extension moment in the same phase, but only inferring it from the comparison of two marker protocols, including and not including a marker on the lateral epicondyle. It was concluded that the magnitude of the observed differences would not likely affect the clinical interpretation of the data [41]. It must be kept in mind, however, that the soft tissue artifact does not only affect pose estimation, but also the determination of the hip joint centre, when estimated through a functional approach [44, 45]. Errors in this determination, as mentioned in the Joint Model Parameter section, may well influence the clinical interpretation.

Identification of palpable anatomical features

Three studies focused on errors of palpable anatomical landmark positions and, consequently, of anatomical coordinate systems [38, 46, 47]. Silva and Ambrósio [46] reported that the sensitivity of IDA results to a perturbation in the digitized knee coordinates was associated to errors in the net knee moments of 200-1500 Nm/m on the three axes (corresponding to 0.2–1.2% BW * H). De Groote et al., proved that the uncertainty in locating anatomical landmarks affects joint moments to a larger extent than the uncertainty in BSIPs [38]. Finally, Langenderfer et al. applied a probabilistic method to quantify the effect of the uncertainty in locating anatomical landmarks and BSIPs on joint moments [47]. They concluded that awareness of this uncertainty is crucial in the evaluation of healthy normal and pathologic gait and can improve clinical diagnoses.

Bone-pose estimation and coordinate systems definitions

The articles reviewed highlight that the selection of the coordinate systems (CS), despite arbitrary and not an error per-se, influences IDA results and, possibly, their interpretation. This influence can arise both from the definition of the CS used to describe body segment anatomy and the choice of the CS in which joint moments are expressed. If a multi-body (or single-body) kinematics optimization is used, the segment accelerations are also modified. Moniz-Pereira et al. [48] proved that lower limb joint dynamics is sensitive to different pose estimation algorithms, although to a lesser extent than joint kinematics, especially for the frontal and transverse planes (max. RMS difference between algorithms: 0.12 Nm/kg corresponding to 0.07% BW * H (35.4%) vs 11.7° (64%), respectively).

The definition of the shank anatomical CS was proved to influence knee extension and abduction moments: knee extension moments had greater peaks when expressed about an anatomical axis following the line of the malleoli than when the moment was reported about the same axis rotated around the shank longitudinal axis to become parallel to the frontal plane of the subject; conversely, this last choice entails significantly greater first peak abduction moment [41]. Similarly, the choice of different anatomical landmarks (ALs) of the distal femur to define the femoral anatomical CS had an impact up to 25% on the knee flexion–extension moment [49].

For clinical gait analysis, the simple analysis of the sagittal plane moments (2D approach) was often considered appropriate, showing little differences in the overall joint moment patterns when compared to 3D models [50, 51]. Nevertheless, the sagittal view provides only part of the information, especially at the hip level, where abductor moment plays an important role in maintaining trunk balance in the frontal plane.

When a 3D analysis is performed (although all possible CSs for the expression of the net moment vector are mathematically valid), differences in joint moment profiles can be expected depending on the components of this vector being expressed in the global CS or in the proximal, distal or joint CSs [50, 52,53,54,55,56,57]. It can be argued that joint moments expressed in local CSs may allow interpreting the trajectories in terms of the moments that cause them [58]. Indeed, for able-bodied adult gait, joint moments represented in the global CS and in different anatomical CSs (being it either proximal or distal or a non-orthogonal joint CS), presented significant differences primarily for the transverse and frontal plane joint moments (resulting in about 5% BW * H variability due to CS for key peak moments of hip, knee, and ankle) [56, 57]. Further differences in the transverse and frontal plane joint moments may arise for simulated [55] or actual pathological gait (resulting in about 20% BW * H variability due to CS for key peak moments of hip, knee, and ankle) [56]. Similar results were obtained in [50]: based on a larger adult sample, differences arose also in the frontal plane, with global CSs generally underestimating adductor muscle moment. Frontal plane moments are also influenced at joint CS level by whether the adduction moment axis follows or does not follow the internal/external rotation of the lower limb [33]. At the ankle level, only for frontal plane the global CS proved to overestimate the invertor moment at midstance and underestimate the late stance evertor moment [54]. Using non-orthogonal CS, either based on the axes used to describe joint kinematics [52, 53], or on generalized coordinates [46, 59], may yield better anatomical insight on the joint structures involved with the joint dynamics. In both cases, the final results depend on whether an orthogonal and non-orthogonal projection of the joint moment on the axes of joint CS are used [13, 52, 53, 60].

Care should, therefore, be taken whenever comparisons between studies are made in which the anatomical CS axes used to define the bone pose or to represent the joint moments are not the same. These differences may influence the clinical interpretation according to the parameter under analysis [33], although statistical techniques, such as principal component analysis, may help in highlighting pathological features that are independent of the coordinate system selection [32].

Gait protocols

Several stereophotogrammetric protocols have been proposed for clinical gait analysis [61]; the effect of their differences on joint moment estimation was analyzed during level walking [62,63,64]. Specifically, excellent intra-session repeatability was obtained for the analyzed protocols, with an excellent reliability in the sagittal plane (CMC > 0.95) and a good reliability in the other two anatomical planes (CMC > 0.67). Kadaba et al. [64] also found a lower repeatability of knee moments with respect to hip and ankle moments. Similar considerations were also extended to stair climbing using the Kadaba’s protocol [65], with joint dynamics more reproducible than kinematics, especially for abduction–adduction and internal–external rotation at all joints. A comparison between the Kadaba’s protocol [64] and a six degrees of freedom model showed that most differences were subtle and unlikely to affect clinical interpretations for normal children, but few substantial differences may deserve further investigation, especially for pathological movements or morphology that may exacerbate model differences [66].

Inter-laboratory consistency of gait analysis measurements using the same protocol is also an investigated issue. Comparison of normative data, as collected using the same protocol in two clinical gait analysis services, highlighted only slight differences in hip and knee extensor moments and all powers, with RMS differences for the inter-laboratory means of less than 0.1 Nm/kg for joint moments (corresponding to 0.006% BW * H), and 0.21 W/kg for powers [67]. Inter-laboratory consistency was also assessed by testing one subject with five different protocols: higher differences were found for kinematics than for kinetics, the latter circumstance being noticeable due to inter-protocol differences, such as the use of standard IDA instead of using GRF for joint moments calculation [35, 68]. In general, differences of 0.5 Nm/kg were pointed out (corresponding to 0.03% BW * H), which are lower than the established minimum detectable change for gait kinematics and dynamics for healthy adults [68].

Changes in the protocols have been proposed to improve IDA calculations, either addressing anatomical calibration or soft tissue artifact. For instance, modified versions of the Davis protocol were proposed using additional markers [69, 70], improving the between-day repeatability [70] and reducing the errors in projecting the joint moment components in the sagittal and frontal planes [69]. Similarly, Petit and colleagues [71] added three proximal shank markers, improving the definition of the proximal shank which, in turn, reduced the knee moment lever arm and lowered the sagittal knee moment. The same reduction was not observed for the knee ab-adduction moment.

Further modifications to gait protocols were adopted for the foot, increasing the number of segments used for its modeling, with the effect of reducing overestimation of ankle joint powers, typical of single-segment models [72], or producing a better description of ankle kinematics in the frontal plane during stance. Improvements in kinematics significantly influenced joint dynamics at the upper levels, in particular the peak hip adductor moment [73]. In both [73] and [72], additional tracking markers for both forefoot and rearfoot were added to the typical cluster tracking calcaneal–tibial motion.

Optimized IDA estimates and their implications in clinical gait analysis

Discrepancies in joint dynamics due to different IDA computational approaches has been studied in [74] and knee moment profiles across methods were shown to be different, even though with comparable magnitudes. To overcome this issue, procedures to increase IDA quality were proposed, such as static optimization using a least-square approach, which provided a reduction of about 30% on joint torque errors with respect to the conventional Newton–Euler method [75]. Dynamic optimization models are also used to reconstruct the pose of the body segments under analysis, reducing the consequences of soft tissue artifacts (multi-body kinematics optimization) [38, 76]. This approach, adopting body segment chains with kinematic constraints to model the joints, may be considered adequate for the description of physiological gait. Its adoption is questionable for pathological gait because it alters the joint behavior, that does not follow anymore the kinematic model assumed in the multi-body kinematics optimization.

Ground reaction force

The number of published papers analysing the propagation of uncertainties in the measurement of GRF is small. Only four papers were found investigating this specific problem [34, 35, 77, 78], of which only two specifically addressed the effect of errors superimposed to GRF measurements [77, 78]. None of them took into account the potential additional measurement errors introduced by the calibration of the force platform in the stereophotogrammetric coordinate system.

When dealing with the estimation of joint dynamics, the majority of the literature considers GRF measurements virtually error-free. Little attention is paid to errors that intrinsically characterize any measurement procedure, and even less attention to the potential effect on the biomechanical variables analysed and the resulting clinical interpretation.

Just like any measurement device, force platforms are characterised by a certain measurement accuracy, declared by the producer in the device data-sheet. According to the data-sheet of common commercial force plates, the expected measurement errors can be bounded between 0.2 and 2% of their Full-Scale Output (FSO). Typical values of FSO in gait analysis are 500 N for force components in the platform plane and 2500 N for the orthogonal component. Although not constant throughout the acquisition, errors in the order of 1–10 N and 5–50 N can reasonably occur in the horizontal and vertical components, respectively, accompanied with errors up to 0.01 m in COP coordinates [34, 35, 77, 78].

When GRF is measured in a gait analysis session, other sources of errors can superimpose to those characteristics of a properly functioning device. Platform calibration errors or inaccuracies, inappropriate setting of the platform (e.g. low threshold, sampling frequency), modifications in the behaviour of the electronic components (e.g. cable interference, contacts, electrical inductance resulting from chances in temperature, humidity or simply aging of the device components) can significantly affect the performance of any force platform integrated in a gait analysis laboratory [79,80,81,82,83,84,85]: during in situ testing errors superimposed to COP coordinates were found double than the reference ones [82,83,84]; accuracy decreases as the point of application of the force moves to the platform peripheries [82], although distributed loads seem to be less affected by this phenomenon than concentrated ones [81]; the minimum vertical force threshold might be up to 113 N in order to estimate the COP within a distance with the declared SD of 0.003 m [84]. Moreover, the performance of the force platform can differ in dynamic compared to static conditions [79]. Due to the relevance of these measurement uncertainties, a number of methods for the in situ assessment of the performance of force platform have been proposed in the literature [79, 84, 85], as well as possible compensation methods [82, 86].

Therefore, the lack of attention paid to the likelihood of errors in force measurement is somewhat surprising [80], particularly in the field of gait analysis, where force measurement data are often proposed as a reference for the gait laboratory quality check [87, 88].

It could be argued that the impact of these measurement errors can be negligible when compared to other sources of error and in terms of their propagation to joint moments. This does not seem to be the case, despite the limited amount of available literature [89]. McCaw and DeVita [77] analysed the effect of errors up to 0.01 m superimposed to COP coordinates in a sagittal model of gait, observing average changes 14% in maximum angular torques (approximately 0.8% BW * H), and up to 13% in the estimation of the flexion–extension transitions time. In their comprehensive analysis of the uncertainties in inverse dynamics solutions, Riemer et al. [35], pointed out that the values of the maximum estimated uncertainties relative to peak joint torque for the ankle, knee and hip are 6–12% (approximately), 50–105% and 114–232%, respectively, depending on the set of perturbations; these uncertainties result from errors superimposed on kinematics, body inertial parameters and force plate measurements, but for the lower body model, the uncertainties in the distance from the COP to the ankle centre of rotation is one of the major contributors. Pàmies-Vilà et al. [34] implemented a similar comprehensive analysis on a 2D model of gait, taking into account uncertainties in the measured force components compatible with those declared in the device data-sheet; the error in the ground reaction torque highly affects the results, up to a normalised root mean square error of 52% in the hip torque; this analysis shows that GRF errors produce higher root mean square errors and normalised root mean square errors than those introduced by inaccuracies in BSIP, but similar to those produced by inadequate kinematic processing. Finally, Camargo et al. [78] analysed the influence of uncertainties in the COP localization on gait dynamics at different velocities, showing that resulting uncertainties on joint moments increase with increasing velocities.

Joint model parameters

Commonly, human joints are modelled either as spherical or hinge joints. Whereas for the hip joint, the functional consistency between the actual joint and the spherical joint model is almost perfect [90] and therefore a unique centre of rotation exists, this is not true for other human joints. For instance, it was demonstrated that in the knee joint during normal gait the tibiofemoral contact loads contribute substantially to both net extension and adduction moments [5].

Once a convenient joint model is chosen, this has to be tailored for the specific subject under analysis (joint model calibration). Joint calibration procedure is crucial since errors in the parameter determination (joint centre position and axis position and direction) heavily affect the estimated muscular moment arms and consequently the joint moments and their interpretation. Joint parameters are commonly defined by using regressive equations from palpated external anatomical landmarks [64, 91], functional approaches [92,93,94], multi-body kinematics optimization techniques [95] or bio-imaging techniques [96].

Studies classification

The literature introduced the potential benefits of using functional joint centres and axes instead of palpable anatomical landmarks or regressive joint centres to estimate joint dynamics, producing slightly more repeatable hip and knee joint moments [94]. Several studies have dealt with the effects of errors in the joint parameters identification on the estimation of the lower limb joint moments. Since joint moments cannot be directly measured unless implanting instrumented prostheses [5] or using force/moment sensors in prosthetic limb of amputees [97,98,99], a ground truth is rarely available for evaluation. Therefore, the most common solution is to assess changes in the joint moments patterns due to any changes in possible input data and parameter values. This was accomplished either by directly or indirectly perturbing the joint parameters through mathematical simulations or experimentally by determining the joint parameters using different methods.

In Table 2, a concise classification and description of the relevant literature is provided.

Table 2 Details of studies analyzed for the joint model parameters effect on the dynamics estimates

Results and findings of the relevant studies are critically reviewed following the scheme proposed in Table 2 according to their relevance to the specific joint.

Hip joint

The simulation carried out by Stagni and colleagues indicated that errors in the hip joint centre (HJC) location greatly affect hip joint moment [11]. They found that a 30 mm HJC anterior and lateral mislocation caused a mean error of about −22 and −15% in the flexion–extension and abduction–adduction moment components of the corresponding range, respectively (the corresponding values in units of per cent bodyweight (BW) times height (H) are −1.43 and −1.38% BW * H). These errors also produced a delay of about 25% of the stride duration in the flexion–extension moment timing [11]. Reinbolt and colleagues [100] found, based on the Monte Carlo analyses, errors on the hip flexion–extension and hip abduction–adduction moments consistent with those reported by Stagni and co-workers [11]. Similar conclusions, (i.e. overestimation of the peak hip flexion moment and altered timing of the transition from flexion–extension moment) were reached by Lenaerts and colleagues [30]. Following a similar computational approach, Bartels and colleagues found a systematic HJC location error of 30 mm in the inferior direction and consequently, significant and substantial underestimation of the peak hip extension and abduction moment with respect to the image-based models (up to 23.1 and 15.8%) [29]. Significant differences in knee extension moment were also observed, but these were limited (4.9%). For hip rotation and ankle plantar flexion, differences in joint moments were negligible. The contradictory results between [101] and [102] can be explained by the different errors direction affecting the HJC estimates. In fact, whereas Lenaerts and colleagues [30] found that the estimated HJC was located about 30 mm anteriorly and 21 mm proximally, in the work of Bartels and co-workers [29], the errors in the HJC location were found mainly inferiorly (median value 18.7 mm) and posteriorly (median value 5.6 mm) and evenly spread along the medio-lateral axis.

Kirkwood and colleagues [103] considered four regressive methods, and found average maximum errors between 0.02 and −0.21 Nm/kg in the sagittal plane (0.12 to −1.26% BW * H), −0.05 to 0.27 Nm/kg in the frontal plane (−0.30 to 1.62% BW * H) and −0.05 to −0.07 Nm/kg in the transverse plane (−0.30 to −0.42% BW * H). Unfortunately, since the HJC location errors associated to the four regressive methods were not explicitly reported, a direct comparison among regressive methods is difficult. Similarly, Kiernan and colleagues [104] found, among the regressive methods analysed, maximum differences of approximately 0.1 Nm/kg (0.7% BW * H) in the hip extensor moment and hip abduction moment and no differences in the hip rotation moments. However, clinical statistically significant differences were found when computing the Gait Deviation Index Kinetic (maximum differences equal to 4.36 points with a threshold of clinical significance equal to 3.6 points) [101]. Sinclair and colleagues [102] found, during a squat exercise, statistically significant differences in both peak hip adduction moment and peak of knee external moment by comparing the HJC estimate as provided by a functional approach with those obtained from regression methods. Unfortunately, HJC locations were not reported.

Knee and ankle joints

Holden and Stanhope [105] found that an anterior knee joint centre (KJC) errors of ±10 mm caused, at fast gait speed, a maximum variation of the knee flexion–extension moment up to 0.71% BW * H. Furthermore, since knee joint moment decreases by decreasing the gait speed, at low speed KJC error can change the sign of the moment and thus impede the interpretation as flexor or extensor. Similar results were found by Reinbolt and colleagues [100] (errors on the knee flexion–extension peak equal to 0.92% %BW * H). Similar percentage errors were found for the abduction–adduction knee moment. Ankle joint moment errors were slightly larger for abduction–adduction than for dorsiflexion–plantarflexion. Bartels and colleagues [29] found small knee extension moment percentage differences between models (<5%) for a median deviation of the knee axis of 2.3°. For the ankle plantar flexion, differences in joint moments were negligible. Silva and Ambrosio [46] found in simulation a sensitivity of the knee moment similar to that observed for the application point of the external forces.

Multi-joint

Langenderfer and colleagues [47] found that joint moments were also most sensitive to an uncertain localisation of ALs near the joint, because it translates into variability in the joint centres identification (i.e. ankle moments were sensitive to location of the lateral malleolus, knee moments to the femoral epicondyle location, etc.). Reinbolt and colleagues [100] showed that the variability in the magnitude of the moments increased when moving from the ankle to the knee and hip joints. Largest RMS errors were observed for the hip flexion–extension and abduction–adduction moments (4.14 and 1.06% BW * H), followed by the knee flexion–extension moment mean (RMS error about 0.92% BW * H). Interestingly, when high-resolution bio-imaging techniques were employed for the personalization of the kinematic model, uncertainty in the joint parameters identification were greatly reduced [106, 107].

Besier and co-workers [94] found, over the ten subjects analysed, highly repeatable joint moment patterns for hip, knee, and ankle in both sagittal and frontal plane (R2 > 0.75). When joint parameters are functionally determined, slight improvements in the hip and ankle joint moments were observed. The statistical significant differences observed in the magnitude of the moments were explained by differences in the joint centre location and joint axes used in 2D and 3D.

Inertial parameters

The motor tasks evaluated were: level walking (17 studies), walking on treadmill (2 study), and stair ascending/descending (2 studies). All studies except one [108] assessed the entire stride of the cycle (stance and swing phases).

Two types of investigation were performed (Table 3): in the 13 experimental studies, different set of BSIPs were used while in the 11 simulation studies the values of the BSIPs were varied applying deterministic or probabilistic approaches (for details see Table 3). Joint moment estimated with different values of BSIPs were compared and in same case the percentage variation was reported.

Table 3 Details of studies analyzed for the body segment inertial parameters (BSIPs) effect on the dynamics estimates

Statistically significant differences were observed in the estimated BSIPs not only using different approaches [23] but also using different data within the same approach [109]. In a comprehensive analysis of 24 regression equation studies, BSIPs were found to be significantly different between living subjects and cadaver studies, between Caucasian females and males, and between Caucasian and non-Caucasian subjects, with highest differences for the moment of inertia of the thigh [110]. Comparing BSIPs values obtained with regression equations and geometric models, the estimated mass and the moment of inertia of the leg and the thigh can vary up to more than 40% [109]. Comparing BSIPs values calculated with dual energy X-ray absorptiometry and regression equation, the maximum difference was found for the foot segment and specifically for the moment of inertia [20, 111].

Analysing how these differences affect the lower limb joint moment estimations during activities of daily life, all studies reported smaller differences in stance compared to the swing phase, both during walking and stair ascending/descending (Table 3). Furthermore, all studies reported smaller effect moving distally from the hip to the ankle joint (Table 3). During walking, the maximum root mean square difference reported at the hip joint moment in the sagittal plane was for self-selected speed and fast-cadence 4.3% [112] and 20.11% [113], respectively. During stair ascending/descending, a maximum of 21.8% in the transverse plane at the hip moment was reported [114].

When the effect of the variation of a specific BSIP was investigated, no common result was found: in two cases the foot mass was the only main contributor of the uncertainty in the joint torques [35, 115], in another study the shank centre of mass has the largest effect [116] and in a third study distal BSIPs showed little effect on proximal joint moment [110].

Comparing the results with respect to other sources of error, the effect of BSIPs to the joint moment estimation was lower than that of anatomical landmarks definition [47], not much greater than that of the inter-trial variability [110], smaller than that of marker placement and soft tissue artifact [117], lower than that caused by a 0.5 Hz adjustment in the cut-off frequency of the filter used to process the data [112], and produced no clinically meaningful difference in the GDI-kinetic scores [31].

Reliability, reproducibility and sensitivity analyses

A detailed report about reliability, reproducibility and sensitivity of joint moments is reported as additional material. While the single studies have been analysed in the previous sections, it is impossible at present to formulate a global or overall summary, because of a noticeable lack of standardisation in data analysis among Authors. This is unfortunate and calls for initiatives promoting recommended statistical indexes in the field.

Discussion and conclusions

Uncertainty in the measured/estimated kinematics, anatomical calibration, and selection of appropriate joint model parameters, were confirmed as the main causes of errors in IDA results, with a potential serious impact in the clinical context. In addition, according to the limited available literature, the uncertainties in GRF measurement can have a comparable influence on the estimation of joint dynamics during gait. Looking at the role of BSIPs, results showed that, even if the effect of different BSIPs on joint moments was significantly different, it was not clinically meaningful for motor tasks of daily living such as walking, stair ascending/descending in healthy subjects.

The influence of the different mathematical approaches that can be adopted for the implementation of IDA was not analysed in the present review and this is a possible limitation. However, this aspect was deliberately excluded considering that differences in the computational implementations are meant to represent the same underlying mechanical system and are likely to have minor impact on clinical implementation of IDA results. Differences in estimated joint moments during gait [118] can produce maximal errors up to 25% of the range in flexion extension moment at the hip (negligible on other components), and this error can be regarded as minor for clinical use, when compared to other sources error that can result one order of magnitude higher, and when analysed considering how gait analysis data are interpreted in the clinics, which is comparing curves with coherent (in terms of calculation) reference bands, including inter- and intra-subject dispersion of data. In addition, the majority of IDA implementation for the calculation of joint moments for clinical use is made using the same commercial software, thus nullifying implementation differences.

The systematic analysis of the literature highlighted 67 papers discussing the sources of error affecting joint moments. The quality of the revised papers was evaluated, but no table was reported in the present work because quality is similar among studies: in all papers, the hypotheses were properly outlined and the overall design of the study was appropriate. However, a limited number of subjects was generally included, with effects on the grounding of the final conclusions. Most of these studies were indeed preliminary and/or explorative. The general criterion, followed by the authors of the present review, was only to exclude the works whose quality was considered insufficient and which did not add novel evidence.

The analysis of repeatability, reproducibility and sensitivity of moments across studies was also initiated and a comprehensive list of papers addressing each topic can be found in Additional file 1: Appendix S1 (on-line materials). However, the variety of parameters adopted in the literature is outstanding and preclude the formulation of a consistent overview, other than the analyses reported in the previous sections for kinematics, GRF, inertial parameters and joint model parameters.

Finally, further research is clearly needed to fully evaluate the uncertainties in GRF measurement, eventually analysing the problem in 3D, considering realistic in situ GRF errors, and evaluating the effect on external joint moments.

The literature highlights the importance of taking due care of:

  1. 1.

    Compensating for noise affecting marker trajectories especially when dynamics is estimated using kinematics only;

  2. 2.

    Performing the anatomical calibration, especially for the HJC, since the related uncertainty affects joint moments to a larger extent than other concurring factors. Uncertainties on HJC location between 10 and 30 mm have a great impact on both hip flexion–extension and hip abduction–adduction moments (maximum moment variation between −1.43 and 1.62% BW * H).

  3. 3.

    Identifying in a consistent manner joint parameter when comparing joint moments;

  4. 4.

    Interpreting IDA results in the light of the protocol used to estimate them and of the coordinate system used for their expression;

  5. 5.

    Properly assessing in situ GRF measurement errors, and estimating their potential effect on the final clinical decision process;

  6. 6.

    not extending the results found for walking and stair ascending/descending motor tasks in case of activities involving higher accelerations and when no ground reaction force is available (e.g. sprinting, kicking…) due to the larger effect on swing phase and proximal joints.

Therefore, the reader shall consider the potential benefits of using:

  1. 1.

    Functional joint centres, when hip calibration movements are not too difficult to perform for the subject and sufficiently large hip joint ranges of motion can be acquired (>30°) [119]. Care should be taken in limiting soft tissue artefacts during the functional tasks required for their estimate. The use of predictive equations is suggested otherwise [120];

  2. 2.

    Modified protocols that include additional markers or, for the foot, additional body segments that were proved to improve repeatability and\or the accuracy of joint moments and powers;

  3. 3.

    High-resolution bioimaging techniques can be successfully employed to produce personalized musculoskeletal models thus improving joint moment estimation and loading, provided that an adequate model is created;

  4. 4.

    Customized BSIPs to better highlight the muscle role in decelerating lower limb during the swing phase only in special populations, such as amputee patients [121,122,123].

It may be hoped that the large body of knowledge revised in this review can constitute further momentum to the standardization of the procedures to obtain and report joint moments, as already done by the International Society of Biomechanics in 2002 for the reporting of the joint kinematics [124, 125].

References

  1. Fantozzi S, Garofalo P, Cuti AG, Stagni R. 3D joint moments in transfemoral and transtibial amputees: when is the “ground reaction vector technique” an alternative to inverse dynamics? J Mech Med Biol. 2012;12:1250061.

    Article  Google Scholar 

  2. Winter DA. Three dimensional kinematics and kinetics. Biomech. Mot. Control Hum. Mov. 2009. p. 176–99.

  3. Zatsiorsky VM. Joint torques and forces: the inverse problem of dynamics. Kinet Hum Motion. 2002;2:365–454.

    Google Scholar 

  4. Vaughan CL. Are joint torques the Holy Grail of human gait analysis? Hum Mov Sci. 1996;15:423–43.

    Article  Google Scholar 

  5. Walter JP, Korkmaz N, Fregly BJ, Pandy MG. Contribution of tibiofemoral joint contact to net loads at the knee in gait. J Orthop Res. 2015;33:1054–60.

    Article  Google Scholar 

  6. Zatsiorsky VM, Latash ML. What is a joint torque for joints spanned by multiarticular muscles? J Appl Biomech. 1993;9:333–6.

    Article  Google Scholar 

  7. Krabbe B, Farkas R, Baumann W. Influence of inertia on intersegment moments of the lower extremity joints. J Biomech. 1997;30:517–9.

    Article  Google Scholar 

  8. Della Croce U, Leardini A, Chiari L, Cappozzo A. Human movement analysis using stereophotogrammetry part 4: assessment of anatomical landmark misplacement and its effects on joint kinematics. Gait Posture. 2005;21:226–37.

    Article  Google Scholar 

  9. Leardini A, Chiari L, Della U, Cappozzo A. Human movement analysis using stereophotogrammetry part 3. Soft tissue artifact assessment and compensation. Gait Posture. 2005;21:212–25.

    Article  Google Scholar 

  10. Cereatti A, Camomilla V, Vannozzi G, Cappozzo A. Propagation of the hip joint centre location error to the estimate of femur vs pelvis orientation using a constrained or an unconstrained approach. J Biomech. 2007;40:1228–34.

    Article  Google Scholar 

  11. Stagni R, Leardini A, Cappozzo A, Benedetti MG, Cappello A. Effects of hip joint centre mislocation on gait analysis results. J Biomech. 2000;33:1479–87.

    Article  Google Scholar 

  12. de Leva P. Adjustments to Zatsiorsky–Seluyanov’s segment inertia parameters. J Biomech. 1996;29:1223–30.

    Article  Google Scholar 

  13. Dumas R, Chèze L, Verriest JP. Adjustments to McConville et al. and Young et al. body segment inertial parameters. J Biomech. 2007;40:543–53.

    Article  Google Scholar 

  14. Dempster WT. Space Requirements of the Seated Operator (Technical Report WADC-TR-55-159). Wright-Patterson Air Force Base, OH Aerosp. Med. Res. Lab. 1955.

  15. Clauser C, McConville J, Young J. Weight, volume and AMRL, center of mass of segments of the human body (Technical Report AMRL-TR-69-70). 1969.

  16. Winter DA. Antrhopometry. Biomechanics and motor control of human movement. 2nd ed. New York: Wiley; 1990. p. 51–74.

    Google Scholar 

  17. Zatsiorsky V, Seluyanov V. The mass and inertia characteristics of the main segments of the human body. In: Matsui H, Kobayashi K, editors. Biomechanics, VIII-B. Champaign: Human Kinetics; 1983. p. 1152–9.

    Google Scholar 

  18. Hatze H. A mathematical model for the computational determination of parameter values of anthropomorphic segments. J Biomech. 1980;13:833–43.

    Article  Google Scholar 

  19. Yeadon MR. The simulation of aerial movement—II. A mathematical inertia model of the human body. J Biomech. 1990;23:67–74.

    Article  Google Scholar 

  20. Ganley KJ, Powers CM. Determination of lower extremity anthropometric parameters using dual energy X-ray absorptiometry: the influence on net joint moments during gait. Clin Biomech. 2004;19:50–6.

    Article  Google Scholar 

  21. Ganley KJ, Powers CM. Anthropometric parameters in children: a comparison of values obtained from dual energy x-ray absorptiometry and cadaver-based estimates. Gait Posture. 2004;19:133–40.

    Article  Google Scholar 

  22. Cheng C-K, Chen H-H, Chen C-S, Lee C-L, Chen C-Y. Segment inertial properties of Chinese adults determined from magnetic resonance imaging. Clin Biomech. 2000;15:559–66.

    Article  Google Scholar 

  23. Mungiole M, Martin PE. Estimating segment inertial properties: comparison of magnetic resonance imaging with existing methods. J Biomech. 1990;23:1039–46.

    Article  Google Scholar 

  24. Vaughan CL, Andrews JG, Hay JG. Selection of body segment parameters by optimization methods. J Biomech Eng. 1982;104:38.

    Article  Google Scholar 

  25. Riemer R, Hsiao-Wecksler ET. Improving net joint torque calculations through a two-step optimization method for estimating body segment parameters. J Biomech Eng. 2009;131:11007.

    Google Scholar 

  26. Chen S-C, Hsieh H-J, Lu T-W, Tseng C-H. A method for estimating subject-specific body segment inertial parameters in human movement analysis. Gait Posture. 2011;33:695–700.

    Article  Google Scholar 

  27. Bartlett JW, Frost C. Reliability, repeatability and reproducibility: analysis of measurement errors in continuous variables. Ultrasound Obstet Gynecol. 2008;31:466–75.

    Article  Google Scholar 

  28. Ferrari A, Cutti AG, Cappello A. A new formulation of the coefficient of multiple correlation to assess the similarity of waveforms measured synchronously by different motion analysis protocols. Gait Posture. 2010;31:540–2.

    Article  Google Scholar 

  29. Bartels W, Demol J, Gelaude F, Jonkers I, Vander Sloten J. Computed tomography-based joint locations affect calculation of joint moments during gait when compared to scaling approaches. Comput Methods Biomech Biomed Eng. 2015;18:1238–51.

    Article  Google Scholar 

  30. Lenaerts G, Bartels W, Gelaude F, Mulier M, Spaepen A, Van der Perre G, et al. Subject-specific hip geometry and hip joint centre location affects calculated contact forces at the hip during gait. J Biomech. 2009;42:1246–51.

    Article  Google Scholar 

  31. Kiernan D, Walsh M, O’Sullivan R, O’Brien T, Simms CK. The influence of estimated body segment parameters on predicted joint kinetics during diplegic cerebral palsy gait. J Biomech. 2014;47:284–8.

    Article  Google Scholar 

  32. Brandon SCE, Deluzio KJ. Robust features of knee osteoarthritis in joint moments are independent of reference frame selection. Clin Biomech. 2011;26:65–70.

    Article  Google Scholar 

  33. Newell RS, Hubley-Kozey CL, Stanish WD, Deluzio KJ. Detecting differences between asymptomatic and osteoarthritic gait is influenced by changing the knee adduction moment model. Gait Posture. 2008;27:485–92.

    Article  Google Scholar 

  34. Pàmies-Vilà R, Font-Llagunes JM, Cuadrado J, Alonso FJ. Analysis of different uncertainties in the inverse dynamic analysis of human gait. Mech Mach Theory. 2012;58:153–64.

    Article  Google Scholar 

  35. Riemer R, Hsiao-Wecksler ET, Zhang X. Uncertainties in inverse dynamics solutions: a comprehensive analysis and an application to gait. Gait Posture. 2008;27:578–88.

    Article  Google Scholar 

  36. Lugrís U, Carlín J, Pàmies-Vilà R, Font-Llagunes JM, Cuadrado J. Solution methods for the double-support indeterminacy in human gait. Multibody Syst Dyn. 2013;30:247–63.

    Article  MathSciNet  Google Scholar 

  37. Alonso FJ, Del Castillo JM, Pintado P. Application of singular spectrum analysis to the smoothing of raw kinematic signals. J Biomech. 2005;38:1085–92.

    Article  Google Scholar 

  38. De Groote F, De Laet T, Jonkers I, De Schutter J. Kalman smoothing improves the estimation of joint kinematics and kinetics in marker-based human gait analysis. J Biomech. 2008;41:3390–8.

    Article  Google Scholar 

  39. Ren L, Jones RK, Howard D. Whole body inverse dynamics over a complete gait cycle based only on measured kinematics. J Biomech. 2008;41:2750–9.

    Article  Google Scholar 

  40. Holden JP, Orsini JA, Siegel KL, Kepple TM, Gerber LH, Stanhope SJ. Surface movement errors in shank kinematics and knee kinetics during gait. Gait Posture. 1997;5:217–27.

    Article  Google Scholar 

  41. Manal K, Mcclay I, Richards J, Galinat B, Stanhope S. Knee moment profiles during walking: errors due to soft tissue movement of the shank and the influence of the reference coordinate system. Gait Posture. 2002;15:10–7.

    Article  Google Scholar 

  42. Tsai T, Lu T, Kuo M, Lin C. Effects of soft tissue artifacts on the calculated kinematics and kinetics of the knee during stair-ascent. J Biomech. 2011;44:1182–8.

    Article  Google Scholar 

  43. Kuo MY, Tsai TY, Lin CC, Lu TW, Hsu HC, Shen WC. Influence of soft tissue artifacts on the calculated kinematics and kinetics of total knee replacements during sit-to-stand. Gait Posture. 2011;33:379–84.

    Article  Google Scholar 

  44. De Rosario H, Page Á, Besa A, Valera Á. Propagation of soft tissue artifacts to the center of rotation: a model for the correction of functional calibration techniques. J Biomech. 2013;46:2619–25.

    Article  Google Scholar 

  45. Kainz H, Carty CP, Modenese L, Boyd RN, Lloyd DG. Estimation of the hip joint centre in human motion analysis: a systematic review. Clin Biomech. 2015;30:319–29.

    Article  Google Scholar 

  46. Silva MPT, Ambrósio JAC. Sensitivity of the results produced by the inverse dynamic analysis of a human stride to perturbed input data. Gait Posture. 2004;19:35–49.

    Article  Google Scholar 

  47. Langenderfer JE, Laz PJ, Petrella AJ, Rullkoetter PJ. An efficient probabilistic methodology for incorporating uncertainty in body segment parameters and anatomical landmarks in joint loadings estimated from inverse dynamics. J Biomech Eng. 2008;130:014502/1–7.

    Article  Google Scholar 

  48. Moniz-Pereira V, Cabral S, Carnide F, Veloso AP. Sensitivity of joint kinematics and kinetics to different pose estimation algorithms and joint constraints in the elderly. J Appl Biomech. 2014;30:446–60.

    Article  Google Scholar 

  49. Thewlis D, Richards J, Bower J. Article discrepancies in knee joint moments using common anatomical frames defined by different palpable landmarks discrepancies in knee joint moments using common anatomical frames defined by different palpable landmarks. J Appl Biomech. 2008;24:185–90.

    Article  Google Scholar 

  50. Liu J, Lockhart TE. Comparison of 3D joint moments using local and global inverse dynamics approaches among three different age groups. Gait Posture. 2006;23:480–5.

    Article  Google Scholar 

  51. Alkjaer T, Simonsen EB, Dyhre P. Comparison of inverse dynamics calculated by two- and three-dimensional models during walking. Gait Posture. 2001;13:73–7.

    Article  Google Scholar 

  52. O’Reilly OM, Sena MP, Feeley BT, Lots JC. On representations for joint moments using a joint coordinate system. J Biomech Eng. 2013;135:114504.

    Article  Google Scholar 

  53. Desroches G, Chèze L, Dumas R. Expression of joint moment in the joint coordinate system. J Biomech Eng. 2010;132:1–4.

    Article  Google Scholar 

  54. Hunt AE, Smith RM. Interpretation of ankle joint moments during the stance phase of walking: a comparison of two orthogonal axes systems. J Appl Biomech. 2001;17:173–80.

    Article  Google Scholar 

  55. Schache AG, Fregly BJ, Crossley KM, Hinman RS, Pandy MG. The effect of gait modification on the external knee adduction moment is reference frame dependent. Clin Biomech. 2008;23:601–8.

    Article  Google Scholar 

  56. Schache AG, Baker R. On the expression of joint moments during gait. Gait Posture. 2007;25:440–52.

    Article  Google Scholar 

  57. Schache AG, Baker R, Vaughan CL. Differences in lower limb transverse plane joint moments during gait when expressed in two alternative reference frames. J Biomech. 2007;40:9–19.

    Article  Google Scholar 

  58. Winter DA, Eng JJ, Ishac MG. A review of kinematic parameters in human walking. In: Craik RLB, Otais CA, editors. Gait analysis: theory and application. St. Louis: Mosby Publisher; 1995. p. 252–70.

    Google Scholar 

  59. Dumas R, Chèze L. 3D inverse dynamics in non-orthonormal segment coordinate system. Med Biol Eng Comput. 2007;45:315–22.

    Article  Google Scholar 

  60. Dumas R, Chèze L. Letter to the editor: joint moments in the joint coordinate system, Euler or dual Euler basis. J Biomech Eng. 2014;136:4–5.

    Article  Google Scholar 

  61. Benedetti MG, Catani F, Leardini A, Pignotti E, Giannini S. Data management in gait analysis for clinical applications. Clin Biomech. 1998;13:204–15.

    Article  Google Scholar 

  62. Ferrari A, Benedetti MG, Pavan E, Frigo C, Bettinelli D, Rabuffetti M, et al. Quantitative comparison of five current protocols in gait analysis. Gait Posture. 2008;28:207–16.

    Article  Google Scholar 

  63. Duffell LD, Hope N, McGregor AH. Comparison of kinematic and kinetic parameters calculated using a cluster-based model and Vicon’s plug-in gait. Proc Inst Mech Eng H J Eng Med. 2014;228:206–10.

    Article  Google Scholar 

  64. Kadaba MP, Ramakrishnan HK, Wooten ME, Gainey J, Gorton G, Cochran GVB. Repeatability of kinematic, kinetic, and EMG data in normal adult gait. J Orthop Res. 1989;7:849–60.

    Article  Google Scholar 

  65. Yu B, Kienbacher T, Growney ES, Johnson ME, An KN. Reproducibility of the kinematics and kinetics of the lower extremity during normal stair-climbing. J Orthop Res. 1997;15:348–52.

    Article  Google Scholar 

  66. Buczek FL, Rainbow MJ, Cooney KM, Walker MR, Sanders JO. Implications of using hierarchical and six degree-of-freedom models for normal gait analyses. Gait Posture. 2010;31:57–63.

    Article  Google Scholar 

  67. Pinzone O, Schwartz MH, Thomason P, Baker R. The comparison of normative reference data from different gait analysis services. Gait Posture. 2014;40:286–90.

    Article  Google Scholar 

  68. Benedetti MG, Merlo A, Leardini A. Inter-laboratory consistency of gait analysis measurements. Gait Posture. 2013;38:934–9.

    Article  Google Scholar 

  69. Stief F, Böhm H, Michel K, Schwirtz A, Döderlein L. Reliability and accuracy in three dimensional gait analysis: a comparison of two lower body protocols. J Appl Biomech. 2013;29:105–11.

    Article  Google Scholar 

  70. Yu B, Queen RM, Schrodt LA. Effect of external marker sets on between-day reproducibility of knee kinematics and kinetics in stair climbing and level walking. Res Sport Med. 2003;11:209–18.

    Article  Google Scholar 

  71. Petit DJ, Willson JD, Barrios JA. Comparison of stance phase knee joint angles and moments using two different surface marker representations of the proximal shank in walkers and runners. J Appl Biomech. 2014;30:173–8.

    Article  Google Scholar 

  72. Bruening DA, Cooney KM, Buczek FL. Gait & posture analysis of a kinetic multi-segment foot model part II : kinetics and clinical implications. Gait Posture. 2012;35:535–40.

    Article  Google Scholar 

  73. Hashish R, Samarawickrame SD, Salem GJ. Short communication: a comparison of dorsal and heel plate foot tracking methods on lower extremity dynamics. J Biomech. 2014;47:1211–4.

    Article  Google Scholar 

  74. Whatling GM, Evans SL, Holt CA. Comparing different data collection and analysis techniques for quantifying healthy knee joint function during stair ascent and descent. Proc Inst Mech Eng Part H J Eng Med. 2009;223:981–90.

    Article  Google Scholar 

  75. Kuo AD. A least-squares estimation approach to improving the precision of inverse dynamics computations. J Biomech Eng. 1998;120:148–59.

    Article  Google Scholar 

  76. Silva MPT, Ambrósio JAC. Kinematic data consistency in the inverse dynamic analysis of biomechanical systems. Multibody Syst. Dyn. 2002;8:219–39.

    Article  MATH  Google Scholar 

  77. McCaw ST, DeVita P. Errors in alignment of center of pressure and foot coordinates affect predicted lower extremity torques. J Biomech. 1995;28:985–8.

    Article  Google Scholar 

  78. Camargo JF, Ackermann M, Loss JF, Sacco ICN. Influence of center of pressure estimation errors on 3D inverse dynamics solutions during gait at different velocities. J Appl Biomech. 2013;29:790–7.

    Article  Google Scholar 

  79. Fairburn PS, Palmer R, Whybrow J, Fielden S, Jones S. A prototype system for testing force platform dynamic performance. Gait Posture. 2000;12:25–33.

    Article  Google Scholar 

  80. Psycharakis SG, Miller S. Estimation of errors in force platform data. Res Q Exerc Sport. 2006;77:514–8.

    Article  Google Scholar 

  81. Middleton J, Sinclair P, Patton R. Accuracy of centre of pressure measurement using a piezoelectric force platform. Clin Biomech. 1999;14:357–60.

    Article  Google Scholar 

  82. Chockalingam N, Giakas G, Iossifidou A. Do strain gauge force platforms need in situ correction? Gait Posture. 2002;16:233–7.

    Article  Google Scholar 

  83. Bobbert MF, Schamhardt HC. Accuracy of determining the point of force application with piezoelectric force plates. J Biomech. 1990;23:705–10.

    Article  Google Scholar 

  84. Miyazaki S. A simple and practical method for evaluating overall measurement error of joint moments obtained by a force plate and a position sensing device. Front Med Biol Eng. 1992;4:257–70.

    Google Scholar 

  85. Browne J, O’Hare N. A quality control procedure for force platform. Physiol Meas. 2000;21:515–24.

    Article  Google Scholar 

  86. Cappello A, Bagalà F, Cedraro A, Chiari L. Non-linear re-calibration of force platforms. Gait Posture. 2011;33:724–6.

    Article  Google Scholar 

  87. Holden JP, Selbie WS, Stanhope J. A proposed test to support the clinical movement analysis laboratory accreditation process. Gait Posture. 2003;17:205–13.

    Article  Google Scholar 

  88. Lewis A, Stewart C, Postans N, Trevelyan J. Development of an instrumented pole test for use as a gait laboratory quality check. Gait Posture. 2007;26:317–22.

    Article  Google Scholar 

  89. Kim H, Sakurai S, Ahn J. Errors in the measurement of center of pressure (CoP) computed with force plate affect on 3D lower limb joint moment during gait. Int J Sport Heal Sci. 2007;5:71–82.

    Article  Google Scholar 

  90. Cereatti A, Margheritini F, Donati M, Cappozzo A. Is the human acetabulofemoral joint spherical? J Bone Joint Surg Br. 2010;92:311–4.

    Article  Google Scholar 

  91. Bell AL, Pedersen DR, Brand RA. A comparison of the accuracy of several hip center location prediction methods. J Biomech. 1990;23:617–21.

    Article  Google Scholar 

  92. Cappozzo A. Gait analysis methodology. Hum Mov Sci. 1984;3:27–50.

    Article  Google Scholar 

  93. Churchill DL, Incavo SJ, Johnson CC, Beynnon BD. The transepicondylar axis approximates the optimal flexion axis of the knee. Clin Orthop Relat Res. 1998;356:111–8.

    Article  Google Scholar 

  94. Besier TF, Sturnieks DL, Alderson JA, Lloyd DG. Repeatability of gait data using a functional hip joint centre and a mean helical knee axis. J Biomech. 2003;36:1159–68.

    Article  Google Scholar 

  95. Charlton IW, Tate P, Smyth P, Roren L. Repeatability of an optimised lower body model. Gait Posture. 2004;20:213–21.

    Article  Google Scholar 

  96. Taddei F, Ansaloni M, Testi D, Viceconti M. Virtual palpation of skeletal landmarks with multimodal display interfaces. Med Inform Internet Med. 2007;32:191–8.

    Article  Google Scholar 

  97. Dumas R, Cheze L, Frossard L. Loading applied on prosthetic knee of transfemoral amputee: comparison of inverse dynamics and direct measurements. Gait Posture. 2009;30:560–2.

    Article  Google Scholar 

  98. Schwarze M, Hurschler C, Seehaus F, Oehler S, Welke B. Loads on the prosthesis—socket interface of above-knee amputees during normal gait: validation of a multi-body simulation. J Biomech. 2013;46:1201–6.

    Article  Google Scholar 

  99. Fiedler G, Slavens B, Smith RO, Briggs D, Hafner BJ. Criterion and construct validity of prosthesis-integrated measurement of joint moment data in persons with transtibial amputation. J Appl Biomech. 2014;30:431–8.

    Article  Google Scholar 

  100. Reinbolt JA, Haftka RT, Chmielewski TL, Fregly BJ. Are patient-specific joint and inertial parameters necessary for accurate inverse dynamics analyses of gait? IEEE Trans Biomed Eng. 2007;54:782–93.

    Article  Google Scholar 

  101. Rozumalski A, Schwartz MH. The GDI-kinetic: a new index for quantifying kinetic deviations from normal gait. Gait Posture. 2011;33:730–2.

    Article  Google Scholar 

  102. Sinclair J, Atkins S, Vincent H. Influence of different hip joint centre locations on hip and knee joint kinetics and kinematics during the squat. J Hum Kinet. 2014;44:5–17.

    Article  Google Scholar 

  103. Kirkwood RN, Culham EG, Costigan PA. Radiographic and non-invasive determination of the hip joint center location: effect on hip joint moments. Clin Biomech. 1999;14:227–35.

    Article  Google Scholar 

  104. Kiernan D, Malone A, O’Brien T, Simms CK. The clinical impact of hip joint centre regression equation error on kinematics and kinetics during paediatric gait. Gait Posture. 2015;41:175–9.

    Article  Google Scholar 

  105. Holden JP, Stanhope SJ. The effect of variation in knee center location estimates on net knee joint moments. Gait Posture. 1998;7:1–6.

    Article  Google Scholar 

  106. Martelli S, Valente G, Viceconti M, Taddei F. Sensitivity of a subject-specific musculoskeletal model to the uncertainties on the joint axes location. Comput Methods Biomech Biomed Eng. 2015;18:1555–63.

    Article  Google Scholar 

  107. Valente G, Pitto L, Testi D, Seth A, Delp SL, Stagni R, et al. Are subject-specific musculoskeletal models robust to the uncertainties in parameter identification? PLoS ONE. 2014;9:1–10.

    Google Scholar 

  108. Bauer JJ, Pavol MJ, Snow CM, Hayes WC. MRI-derived body segment parameters of children differ from age-based estimates derived using photogrammetry. J Biomech. 2007;40:2904–10.

    Article  Google Scholar 

  109. Pearsall DJ, Costigan PA. The effect of segment parameter error on gait analysis results. Gait Posture. 1999;9:173–83.

    Article  Google Scholar 

  110. Nguyen TC, Reynolds KJ. The effect of variability in body segment parameters on joint moment using Monte Carlo simulations. Gait Posture. 2014;39:346–53.

    Article  Google Scholar 

  111. Lee MK, Le NS, Fang AC, Koh MTH. Measurement of body segment parameters using dual energy X-ray absorptiometry and three-dimensional geometry: an application in gait analysis. J Biomech. 2009;42:217–22.

    Article  Google Scholar 

  112. Muri J, Winter SL, Challis JH. Changes in segmental inertial properties with age. J Biomech. 2008;41:1809–12.

    Article  Google Scholar 

  113. Rao G, Amarantini D, Berton E, Favier D. Influence of body segments’ parameters estimation models on inverse dynamics solutions during gait. J Biomech. 2006;39:1531–6.

    Article  Google Scholar 

  114. Fantozzi S, Stagni R, Cappello A, Leardini A. Effect of different inertial parameter sets on joint moment calculation during stair ascending and descending. Med Eng Phys. 2005;27:537–41.

    Article  Google Scholar 

  115. Zuk M, Pezowicz C. The influence of uncertainty in body segment mass on calculated joint moments and muscle forces. Inf Technol Med. 2016;472:349–59.

    Google Scholar 

  116. Wesseling M, de Groote F, Jonkers I. The effect of perturbing body segment parameters on calculated joint moments and muscle forces during gait. J Biomech. 2014;47:596–601.

    Article  Google Scholar 

  117. Myers CA, Laz PJ, Shelburne KB, Davidson BS. A probabilistic approach to quantify the impact of uncertainty propagation in musculoskeletal simulations. Ann Biomed Eng. 2015;43:1098–111.

    Article  Google Scholar 

  118. Dumas R, Nicol E, Chèze L. Influence of the 3D inverse dynamic method on the joint forces and moments during gait. J Biomech Eng. 2007;129:786–90.

    Article  Google Scholar 

  119. Cereatti A, Donati M, Camomilla V, Margheritini F, Cappozzo A. Hip joint centre location: an ex vivo study. J Biomech. 2009;42:818–23.

    Article  Google Scholar 

  120. Sangeux M, Pillet H, Skalli W. Which method of hip joint centre localisation should be used in gait analysis? Gait Posture. 2014;40:20–5.

    Article  Google Scholar 

  121. Dillon MP, Barker TM, Pettet G. Effect of inaccuracies in anthropometric data and linked-segment inverse dynamic modeling on kinetics of gait in persons with partial foot amputation. J Rehabil Res Dev. 2008;45:1303–16.

    Article  Google Scholar 

  122. Goldberg EJ, Requejo PS, Fowler EG. The effect of direct measurement versus cadaver estimates of anthropometry in the calculation of joint moments during above-knee prosthetic gait in pediatrics. J Biomech. 2008;41:695–700.

    Article  Google Scholar 

  123. Dumas R, Branemark R, Frossard L. Gait analysis of transfemoral amputees: errors in inverse dynamics are substantial and depend on prosthetic design. IEEE Trans Neural Syst Rehabil Eng. 2016;4320:1.

    Google Scholar 

  124. Wu G, Siegler S, Allard P, Kirtley C, Leardini A, Rosenbaum D, et al. ISB recommendation on definitions of joint coordinate system of various joints for the reporting of human joint motion—part I: ankle, hip, and spine. J Biomech. 2002;35:543–8.

    Article  Google Scholar 

  125. Wu G, Van Der Helm FCT, Veeger HEJ, Makhsous M, Van Roy P, Anglin C, et al. ISB recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion—part II: shoulder, elbow, wrist and hand. J Biomech. 2005;38:981–92.

    Article  Google Scholar 

  126. Ojeda J, Martìnez-Reina J, Mayo J. The effect of kinematic constraints in the inverse dynamics problem in biomechanics. Multibody Syst Dyn. 2016;37:291–309.

    Article  Google Scholar 

  127. Davis RB, Õunpuu S, Tyburski D, Gage JR. A gait analysis data collection and reduction technique. Hum Mov Sci. 1991;10:575–87.

    Article  Google Scholar 

  128. Lu TW, O’Connor J. One position estimation from skin marker co-ordinates using global optimisation with joint constraints. J Biomech. 1999;32:129–34.

    Article  Google Scholar 

  129. Jensen RK. Body segment mass, radius and radius of gyration proportions of children. J Biomech. 1986;19:359–68.

    Article  Google Scholar 

  130. Challis JH. Accuracy of human limb moment of inertia estimations and their influence on resultant joint moments. J Appl Biomech. 1996;12:517–30.

    Article  Google Scholar 

  131. Chandler, RF, Clauser CE, McConville, JT, Reynolds, HM YJ. Investigation of inertial properties of the human body (Technical Report AMRL-TR-74-137). 1975.

  132. Davinelli M, Stagni R, Fantozzi S, Cappello A. Inverse dynamics modeling in gait analysis. J Mech Med Biol. 2005;5:531–7.

    Article  Google Scholar 

  133. Jensen RK. Changes in segment inertia proportions between 4 and 20 years. J Biomech. 1989;22:529–36.

    Article  Google Scholar 

  134. Zatsiorsky VM, Seluyanov VN, Chugunova LG. In vivo body segment inertial parameters determination using a gamma-scanner method. In: Berme N, Cappozzo A, editors. Biomech. Hum. Mov. Appl. Rehabil. Sport. Ergon. 1990. p. 86–202.

  135. Hanavan E. A Mathematical Model of the Human Body (Technical Report AMRL-64-102). 1964.

  136. Kingma I, Toussaint H, De Looze M, Van Dieen J. Segmental inertial parameter evaluation in two anthropometric models by application of a dynamic linked segment model. J Biomech. 1996;29:693–704.

    Article  Google Scholar 

  137. McConville JT, Churchill TD, Kaleps I, Clauser CE, Cuzzi J. Anthropometric relationships of body and body segments of inertia. 1980.

Download references

Authors’ contributions

VC, AC, SF and RS contributed in study design, articles review and writing the manuscript. AGC contributed in study design and writing the manuscript. All authors read and approved the final manuscript.

Acknowledgements

Submitted to Biomedical Engineering online invited Review in agreement with SIAMOC August 2nd, 2017.

Authors are listed in alphabetical order.

Competing interests

The authors declare that they have no competing interests.

Availability of data and materials

All data generated or analysed during this study are included in this published article and its additional information files.

Declaration

All the authors agree to both proceed with the submission and have Dr. Andrea Giovanni Cutti act as an agent on their behalf in matters pertaining to the publication of the manuscript.

Consent for publication

Not applicable.

Ethics approval and consent to participate

No ethical approval was needed for this study.

Funding

The authors gratefully acknowledge the contribution of SIAMOC, Italian Society of Motion Analysis in Clinics.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andrea Giovanni Cutti.

Additional file

12938_2017_396_MOESM1_ESM.xlsx

Additional file 1: Appendix S1 reports the details and summary of the studies selected for analysis. Moreover, a specific description of the studies discussing repeatability, reproducibility and sensitivity of moments is also provided.

Appendix

Appendix

The Boolean strategy search applied for the three databases (Web of Science, Pubmed, Scopus) is reported.

General search

Web of Science: (Humans)

AND (kinetic* OR inverse dynamics OR torque OR moment)

AND (gait OR walking OR stair OR chair OR squat)

Pubmed: “Humans”[mesh terms]

AND (“kinetics”[TIAB] OR “kinetic”[TIAB] OR “inverse dynamics”[TIAB] OR “torque”[TIAB] OR “torques”[TIAB] OR “moment”[TIAB] OR “moments”[TIAB])

AND (“gait”[TIAB] OR “walking”[TIAB] OR “stair”[TIAB] OR “stairs”[TIAB] OR “chair”[TIAB] OR “squat”[TIAB])

Scopus: TITLE-ABS-KEY (humans AND (kinetic* OR “inverse dynamics” OR torque OR moment) AND (gait OR walking OR stair OR chair OR squat))

REFINEMENT #1: KINEMATICS MEASUREMENTS AND PROCESSING

Web of Science: NOT (patholog* OR robot* OR exoskeleton OR wearable OR (upper limb) OR (upper body) OR (musculoskeletal model)) AND ((marker* movement) OR (marker* displacement) OR (marker* position) OR (skin motion) OR (skin movement) OR (soft tissue artifact) OR (soft tissue displacement) OR (anatomical calibration) OR (landmark) OR (anatomical point*) OR (marker placement) OR (joint angles) OR (kinematic errors) OR (kinematic consistency) OR (filter*) OR (protocol) OR (coordinate system*) OR (reference frame*) OR (anatomical frame*))

Pubmed: NOT ((“patholog*”[TIAB]) OR (“robot*”[TIAB]) OR (“exoskeleton” [TIAB]) OR (“wearable” [TIAB]) OR (“upper limb” [TIAB]) OR (“upper body” [TIAB]) OR (“musculoskeletal model” [TIAB])) AND ((“marker* movement” [TIAB]) OR (“marker* displacement” [TIAB]) OR (“marker* position” [TIAB]) OR (“skin motion” [TIAB]) OR (“skin movement” [TIAB]) OR (“soft tissue artefact” [TIAB]) OR (“soft tissue displacement” [TIAB]) OR (“anatomical calibration” [TIAB]) OR (“landmark” [TIAB]) OR (“anatomical point*”[TIAB]) OR (“marker placement” [TIAB]) OR (“joint angles” [TIAB]) OR (“kinematic errors” [TIAB]) OR (“kinematic consistency” [TIAB]) OR (“filter*”[TIAB]) OR (“protocol” [TIAB]) OR (“coordinate system*”[TIAB]) OR (“reference frame*”[TIAB]) OR (“anatomical frame*”[TIAB]))

Scopus: AND NOT (patholog* OR robot* OR exoskeleton OR wearable OR “upper limb” OR “upper body” OR “musculoskeletal model”)) AND (“marker* movement” OR “marker* displacement” OR “marker* position” OR “skin motion” OR “skin movement” OR “soft tissue artifact” OR “soft tissue displacement” OR “anatomical calibration” OR “landmark” OR “anatomical point*” OR “marker placement” OR “joint angles” OR “kinematic errors” OR “kinematic consistency” OR “filter*” OR “protocol” OR “coordinate system*” OR “reference frame*” OR “anatomical frame*”)

REFINEMENT #2: GROUND REACTION FORCES MEASUREMENTS AND PROCESSING

Web of Science: AND (ground reaction* OR force platform* OR centre of pressure OR dynamometric platform* OR contact force*) AND (error*)

Pubmed: AND (“ground reaction*”[TIAB] OR “force platform*”[TIAB] OR “centre of pressure” [TIAB] OR “dynamometric platform*”[TIAB] OR “contact force*”[TIAB]) AND ((“error*”[TIAB]) OR (“consistency”[TIAB]))

Scopus: AND (“ground reaction*” OR “force platform*” OR “centre of pressure” OR “dynamometric platform*” OR “contact force*”) AND error*

REFINEMENT #3: JOINT MODELS

Web of Science: AND (Joint Centre OR Hip Joint Centre OR Knee Joint Centre OR Ankle Joint Centre OR Joint Axis OR Knee Joint Axis OR Ankle Joint Axis OR dynamics model)

Pubmed: AND (“Center”[TIAB] OR “Centers”[TIAB] OR “Centre”[TIAB] OR “Centres”[TIAB] OR “axis”[TIAB] OR “axes”[TIAB] OR “dynamic model”[TIAB] OR “dynamic models”[TIAB])

Scopus: AND (“Joint Centre” OR “Joint Centres” OR “Hip Joint Centre” OR “Hip Joint Centres” OR “Knee Joint Centre” OR “Knee Joint Centres” OR “Ankle Joint Centre” OR “Ankle Joint Centres” OR “Joint Axis” OR “Joint Axes” OR “Knee Joint Axis” OR “Knee Joint Axes” OR “Ankle Joint Axis” OR “Ankle Joint Axes” OR “dynamics model” OR “dynamic model” OR “dynamic models”)

REFINEMENT #4: BODY SEGMENT INERTIAL PARAMETERS

Web of Science: AND (inertial parameter OR body segment parameter OR inertia OR moment of inertia OR center of mass)

Pubmed: AND (“inertial parameter” [TIAB] OR “body segment parameter”[TIAB] OR “inertia”[TIAB] OR “moment of inertia”[TIAB] OR “center of mass”[TIAB]))

Scopus: AND (“inertial parameter” OR “body segment parameter” OR inertia OR “moment of inertia” OR “center of mass”)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Camomilla, V., Cereatti, A., Cutti, A.G. et al. Methodological factors affecting joint moments estimation in clinical gait analysis: a systematic review. BioMed Eng OnLine 16, 106 (2017). https://doi.org/10.1186/s12938-017-0396-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12938-017-0396-x

Keywords