 Research
 Open access
 Published:
Modeling and classification of gait patterns between anterior cruciate ligament deficient and intact knees based on phase space reconstruction, Euclidean distance and neural networks
BioMedical Engineering OnLine volumeÂ 17, ArticleÂ number:Â 165 (2018)
Abstract
Background
The anterior cruciate ligament (ACL) plays an important role in stabilizing translation and rotation of the tibia relative to the femur. ACL injury alters knee kinematics and usually links to the alternation of gait patterns. The aim of this study is to develop a new method to distinguish between gait patterns of patients with anterior cruciate ligament deficient (ACLD) knees and healthy controls with ACLintact (ACLI) knees based on nonlinear features and neural networks. Therefore ACL injury will be automatically and objectively detected.
Methods
First knee rotation and translation parameters are extracted and phase space reconstruction (PSR) is employed. The properties associated with the gait system dynamics are preserved in the reconstructed phase space. For the purpose of classification of ACLD and ACLI knee gait patterns, threedimensional (3D) PSR together with Euclidean distance computation has been used. These measured parameters show significant difference in gait dynamics between the two groups and have been utilized to form a feature set. Neural networks are then constructed to identify gait dynamics and are utilized as the classifier to distinguish between ACLD and ACLI knee gait patterns based on the difference of gait dynamics between the two groups.
Results
Experiments are carried out on a database containing 18 patients with ACL injury and 28 healthy controls to assess the effectiveness of the proposed method. By using the twofold and leaveonesubjectout crossvalidation styles, the correct classification rates for ACLD and ACLI knees are reported to be 91.3\(\%\) and 95.65\(\%\), respectively.
Conclusion
Compared with other stateoftheart methods, the results demonstrate that gait alterations in the presence of ACL deficiency can be detected with superior performance. The proposed method is a potential candidate for the automatic and noninvasive classification between patients with ACL deficiency and healthy subjects.
Background
Knowledge of spatiotemporal knee motion is important for understanding normal functions as well as addressing clinical problems, including instability after anterior cruciate ligament (ACL) injury. ACL plays an important role in controlling knee joint stability, not only by limiting tibia anterior translation, but also by controlling knee axial rotation and varus movement [1]. Numerous studies have been carried to provide information on biomechanical changes in the ACLdeficient (ACLD) knees [2,3,4,5,6,7], which revealed that ACLD knees would exhibit altered joint kinematics. Currently, the most widely accepted method for assessing joint movement patterns is gait analysis, which offers a unique means of providing insight into mechanisms of ACLD progression by measuring the kinematic and kinetic parameters [8]. Gait analysis also provides important information concerning motion variability in ACLD and ACLintact (ACLI) knees [9].
Many studies have addressed gait pattern classification and there are several reviews on this subject [10,11,12,13,14]. However, the research work dealing specifically with ACLD knees is not sufficient [15,16,17,18]. Biomechanics plays an important role in the progression of ACLD knees and many studies have been carried out in gait laboratories to ascertain which parameters are affected by ACLD knees compared to healthy controls with bilateral ACLI knees [19,20,21,22,23,24,25,26,27,28,29,30,31]. These gait parameters may be adopted as gait features for the classification of gait patterns between ACLD and ACLI knees. In the study by Gao et al. [1], spatiotemporal gait and knee joint kinematic variables were calculated and further analyzed. The ACLD knees exhibited a significant extension deficit compared to the ACLI knees. A more varus and internally rotated tibial position was also identified in the ACLD knees during both stair ascent and descent. Knoll et al. [19] revealed a quadricepsavoidance gait pattern in acute ACLD patients. Chronic ACLD individuals demonstrated a significantly different gait pattern. Robinson et al. [32] investigated whether using a direct kinematic or inverse kinematic modeling approach could influence the estimation of knee joint kinematics and kinetics. The similarity between kinematic and kinetic waveforms was evaluated using the root mean square difference and the onedimensional statistical parametric mapping. Atarod et al. [33] investigated the interactions between different kinematic degree of freedom during normal gait and determined how these interactions would change over time following ACL transection in vivo. They claimed that ACL deficiency would significantly alter the kinematic and kinetic interactions during in vivo gait. Clinical imaging studies of ACLD individuals versus healthy controls have found greater medialâ€“lateral posterior tibial slope in injured population, with stronger evidence on the lateral plateau slope. To quantify these effects, Marouane et al. [34] used a lower extremity musculoskeletal model which included a detailed finite element model of the knee joint. It was used to compute the role of changes in medial and/or lateral posterior tibial slope on knee joint biomechanics.
The current study has two aims. First, to provide further evidence to support the claim that ACLD knees demonstrate altered gait patterns compared to ACLI knees. Second, to provide an automatic and objective method to distinguish between ACLD and ACLI knees. Based on the nonlinear and nonstationary nature of knee kinematic signals [35], a popular nonlinear method named phase space reconstruction (PSR), is a valuable tool for the studies of this kind of signals [36,37,38,39,40,41]. The principle of PSR is to transform the properties of a time series into topological properties of a geometrical object which is embedded in a space, wherein all possible states of the system are represented, each state corresponds to a unique point, and this reconstructed space sharing the same topological properties as the original space. The dynamics in the reconstructed state space is equivalent to the original dynamics. Hence reconstructed phase space is a very useful tool to extract nonlinear dynamics of the signal [36,37,38,39,40,41]. It is hypothesized that gait dynamics between ACLD and ACLI knee gait patterns is significantly different, which implies that PSR offers the potential to compute the difference and classify the two groups.
In this paper, we present a new method using gait analysis to distinguish between ACLD and ACLI knees. First knee rotation and translation parameters are extracted and phase space is reconstructed. The properties associated with the gait system dynamics are preserved in the reconstructed phase space. For the purpose of classification of ACLD and ACLI knee gait patterns, threedimensional (3D) PSR together with Euclidean distance (ED) computation has been used. These measured parameters show significant difference in gait dynamics between the two groups and have been utilized to form a feature set. Neural networks are then constructed to identify gait dynamics and are utilized as the classifier, in which the feature set is embedded, to distinguish between ACLD and ACLI knee gait patterns based on the difference of gait dynamics between the two groups.
Methods
In this section, we propose a method for the classification of ACLD knees using the information obtained from gait dynamics. Two groups of subjects (patients with ACLD knees and healthy controls with ACLI knees) are recruited and tested in this study. The method is divided into the training stage and the classification stage and follows the following steps. In the first step, knee kinematic signals are extracted by using a motion capture system. In the second step, PSR is applied to extract nonlinear dynamics of lower extremities signals. Euclidean distances are computed to extract gait features. Finally, feature vectors are fed into the neural networks for the modeling and identification of gait dynamics. The difference of gait dynamics will be derived from a set of estimators constructed by neural networks and be applied to distinguish between ACLD and ACLI knees. The outline of the proposed method is illustrated in Fig. 1.
Data measurement
Our database consists of 46 participants: 28 healthy controls with ACLI knees and 18 patients with ACLD knees. The mean value and the standard deviation (SD) of the age, height, weight and sex for the participants are depicted in Table 1. As the control group, healthy subjects who had bilateral ACLI knees and no history of musculoskeletal diseases on the lower extremities were included. The ACLD subjects documented via MRI and a clinical examination had no accompanying damage to the posterior cruciate and collateral ligaments, no more than \(30\%\) the meniscus removed, no injuries on the contralateral limb, and no difficulty or pain in performing activities of daily living including walking. A single experienced orthopaedic surgeon performed the physical examination and made the MRI diagnosis.
The kinematic data of the knees in sixdegreeoffreedom (6DOF) were captured using a portable markerbased motion analysis system (Opti_ Knee^{Â®}, Innomotion Inc., Shanghai, China), which has been utilized and validated before [42,43,44,45], as illustrated in Fig. 2. These tibiofemoral kinematics include varusâ€“valgus (VV), internalâ€“external (IE) rotation and flexionâ€“extension (FE); anteriorâ€“posterior (AP), proximalâ€“distal (PD) and medialâ€“lateral (ML) translations.
Each subject was required to undergo a 3min treadmill gait training. Then data were collected with the sampling frequency of 60Â Hz for 15Â s and all the participants were guided to walk at the speed of 3 km/h. The detailed procedure about data extraction can be seen in the study by Zhang et al. [42]. The study was approved by the ethical review board and a written informed consent was obtained from each participant before data collection began.
Data description
Here in Table 2 we give the measures of the range of motion (ROM) of knee rotations and translations in patients with ACLD knees and healthy controls with ACLI knees.
Kinematic variations during walking were observed in 3D rotations and translations between ACLD and ACLI knees, as shown in Fig. 3. For each of the rotational or translational kinematic component, 101 discrete points corresponding to 0â€“100\(\%\) gait cycle at \(1\%\) interval were extracted using onedimensional interpolation for statistical analysis. Measures of each spatiotemporal variable as well as each discrete kinematic point were compared between ACLD and ACLI knees using an independent ttest analysis of variance (SPSS Inc., IL, USA). A p value of \(<0.05\) was considered to indicate statistical significance.
It is observed from Table 2 that: (1) In the sagittal plane patients with ACLD knees showed less range of flexionâ€“extension than healthy controls with ACLI knees (59.18 (8.49) and 71.76 (6.93), respectively, \(p<0.001\)). (2) In the frontal plane, patients with ACLD knees showed less range of internalâ€“external rotation than healthy controls with ACLI knees (18.87 (5.77) and 22.45 (4.69), respectively, \(p=0.03\)). (3) The range of PD translation was lower in the ACLD knees group compared to ACLI knees group while the range of AP translation was higher in the ACLD knees group compared to ACLI knees group (Table 2). (4) Whereas statistical tests of significance tell us the likelihood that experimental results differ from chance expectations, effectsize measurements tell us the relative magnitude of the experimental treatment. In essence, an effect size is the difference between two means divided by the standard deviation of the two conditions [46]. Cohenâ€™s d from ttest [47] was used to describe the effect sizes of the ROM of knee kinematic data, which have been shown in Table 2. The effect sizes were traditionally considered small (\(d = 0.2\)), medium (\(d = 0.5\)), and large (\(d = 0.8\)) [48, 49]. It is seen from Table 2 that IE, FE, AP and PD are with nearly large effect sizes compared to VV and ML, which also means there exist significant differences in IE, FE, AP and PD between ACLdeficient patients and healthy controls. The results are in accordance with the pvalue analysis.
It is seen from the statistical analysis in Table 2 that IE rotation, FE, AP and PD translations between ACLD and ACLI knees are significantly different, which means gait dynamics of the two groups represented by the knee motion are significantly different. Hence these four signals are utilized as reference variables to carry out the following phase space reconstruction.
Phase space reconstruction (PSR)
It is sometimes necessary to search for patterns in a time series and in a higher dimensional transformation of the time series [50]. Phase space reconstruction (PSR) is a method used to reconstruct the socalled phase space. The concept of phase space is a useful tool for characterizing any lowdimensional or highdimensional dynamic system. A dynamic system can be described using a phase space diagram, which essentially provides a coordinate system where the coordinates are all the variables comprising mathematical formulation of the system. Mathematically, the states of an ddimensional dynamic system can only be characterized by d independent quantities. Such a set of d independent quantities represents the coordinates of the phase space. One of the most used methods of PSR is the timedelay embedding. Since this method does not require that the treated system could be mathematically defined, explicitly, it fits well with 1dimensional time series. A point in the phase space represents the state of the system at any given time [50, 51]. Knee kinematic signals can be written as the time series vector \(V=\{v_1,v_2,v_3,...,v_K\}\), where K is the total number of data points. A new sequence of phase space vectors based on delaycoordinate embedding method is expressed as follows [50]:
where \(j=1,2,...,K(d1)\tau\), d is the embedding dimension of the phase space and \(\tau\) is a time lag. \(Y_j\) means the jth reconstructed vector with embedding dimension d. Finally, we obtain a reconstructed phase space Y containing totally \(K(d1)\tau\) vector points as the following trajectory matrix:
where \(M=K(d1)\tau\). It is worthwhile to mention that the properties associated with the gait systemâ€™s dynamics are preserved in the reconstructed phase space. The ddimensional space of delay coordinates serves as a pseudo statespace which provides a natural setting to approximate the quantitative aspects of the dynamics.
The behavior of the signal over time can be visualized using PSR (especially when \(d=\) 2 or 3). In this work, we have confined our discussion to the value of embedding dimension \(d=3\), because of their visualization simplicity. For \(\tau\) setting, we either utilized the firstzero crossing of the autocorrelation function for each time series or the average \(\tau\) value obtained from all the time series in the training dataset by using the method depicted in [52]. In the present study we set the values of time lag \(\tau =1\) to test the classification performance. PSR for \(d=3\) has been referred as 3D PSR.
3D PSR is the plot of three delayed vectors \(V_j,V_{j+1}\) and \(V_{j+2}\) to visualize the dynamics of human gait system. Euclidian distance (ED) of a point \((V_j,V_{j+1},V_{j+2})\), which is the distance of the point from origin in 3D PSR and can be defined as [50]
ED measures can be used in features extraction and have been studied and applied in many fields, such as clustering algorithms and induced aggregation operators [53].
Feature extraction and selection
Reconstructed phase spaces have been proven to be topologically equivalent to the original system and therefore are capable of recovering the nonlinear dynamics of the generating system [36, 37]. This implies that the full dynamics of the gait system are accessible in this space, and for this reason, the features extracted from it can potentially contain more and/or different information than the common features extraction method [8]. In order to get a more efficient features set, this paper proposes the following features extraction scheme using ED computation.

(1)
Reconstruct the phase space for the above mentioned reference variables including knee IE rotation, FE, AP and PD translations with selected values of d and \(\tau\) for each gait trial;

(2)
Compute ED of 3D PSR of knee IE rotation, FE, AP and PD translations as gait features. Concatenate these features to form a feature vector \([ED_j^{IE},ED_j^{FE},ED_j^{AP},ED_j^{PD}]^T\) and the dimension of feature space would be four.
For our dataset, IE rotation, FE, AP and PD translations of two groups (ACLD and ACLI knees) are analyzed and signal dynamics are extracted by using 3D PSR. Samples of the 3D PSR of knee IE rotation, FE, AP and PD translations are exhibited in Fig. 4. After 3D PSR, features of \([ED_j^{IE},ED_j^{FE},ED_j^{AP},ED_j^{PD}]^T\) for ACLD and ACLI knee gait patterns are derived through ED computation, as shown in Fig. 5. As we have analyzed before, significant difference in knee gait dynamics have been reported between ACLD and ACLI knees, which can also be seen obviously from Fig. 4.
Training and modeling mechanism based on selected features
In this section, we present a scheme for modeling and identification of gait dynamics of ACLI and ACLD knees based on the above mentioned features.
Consider a general nonlinear human gait system dynamics in the following form:
where \(x=[x_1,\ldots ,x_n]^T\in R^n\) are the system states which represent the features \([ED_j^{IE},ED_j^{FE},ED_j^{AP},ED_j^{PD}]^T\), p is a constant vector of system parameters. \(F(x;p)=[f_1(x;p),\ldots ,f_n(x;p)]^T\) is a smooth but unknown nonlinear vector representing the gait system dynamics, v(x;Â p) is the modeling uncertainty. Since the modeling uncertainty v(x;Â p) and the gait system dynamics F(x;Â p) cannot be decoupled from each other, we consider the two terms together as an undivided term, and define \(\phi (x;p):=F(x;p)+v(x;p)\) as the general gait system dynamics. Then, the following steps are taken to model and derive the gait system dynamics via deterministic learning theory [54,55,56].
In the first step, standard RBF neural networks are constructed in the following form
where Z is the input vector, \(W=[w_1,...,w_N]^T\in R^N\) is the weight vector, N is the node number of the neural networks, and \(S(Z)=[s_1(\parallel Z\mu _1\parallel ),..., s_N(\parallel Z\mu _N\parallel )]^T\), with \(s_i(\parallel Z\mu _i\parallel )=\exp [\frac{(Z\mu _i)^T(Z\mu _i)}{\eta _i^2}]\) being a Gaussian function, \(\mu _i(i=1,...,N)\) being distinct points in state space, and \(\eta _i\) being the width of the receptive field.
In the second step, the following dynamical RBF neural networks are employed to model and derive the gait system dynamics \(\phi (x;p)\):
where \(\hat{x}=[\hat{x}_1,\ldots ,\hat{x}_n]\) is the state vector of the dynamical RBF neural networks, \(A=diag[a_1,\ldots ,a_n]\) is a diagonal matrix, with \(a_i>0\) being design constants, localized RBF neural networks \(\hat{W}^TS(x)=[\hat{W}_1^TS_1(x),\ldots ,\hat{W}_n^TS_n(x)]^T\) are used to approximate the unknown \(\phi (x;p)\).
The following law is used to update the neural weights
where \(\tilde{x}_i=\hat{x}_ix_i, \tilde{W}_i=\hat{W}_iW_i^*\), \(W_i^*\) is the ideal constant weight vector such that \(\phi _i(x;p)={W_i^*}^TS(x)+\epsilon _i(x)\), \(\epsilon _i(x)<\epsilon ^*\) represents the neural network modeling error, \(\Gamma _i=\Gamma _i^T>0\), and \(\sigma _i>0\) is a small value.
With Eqs. (4âˆ’6), the derivative of the state estimation error \(\tilde{x}_i\) satisfies
In the third step, by using the local approximation property of RBF neural networks, the overall system consisting of dynamical model (8) and the neural weight updating law (7) can be summarized into the following form in the region \(\Omega _\zeta\)
and
where \(\epsilon _{\zeta i}=\epsilon _i\tilde{W}_{\bar{\zeta }i}^TS_{\bar{\zeta }}(x)\). The subscripts \((\cdot )_\zeta\) and \((\cdot )_{\bar{\zeta }}\) are used to stand for terms related to the regions close to and far away from the trajectory \(\varphi _\zeta (x_0)\). The region close to the trajectory is defined as \(\Omega _\zeta :={Z\mathrm {dist}(Z,\varphi _\zeta )\le d_{\iota }}\), where \(Z=x, d_\iota >0\) is a constant satisfying \(s(d_\iota )>\iota\), \(s(\cdot )\) is the RBF used in the network, \(\iota\) is a small positive constant. The related subvectors are given as: \(S_\zeta (x)=[s_{j1}(x),\ldots ,s_{j\zeta }(x)]^T\in R^{N_\zeta }\), with the neurons centered in the local region \(\Omega _\zeta\), and \(W_\zeta ^*=[w_{j1}^*,\ldots ,w_{j\zeta }^*]^T\in R^{N_\zeta }\) is the corresponding weight subvector, with \(N_\zeta <N\). For localized RBF neural networks, \(\tilde{W}_{\bar{\zeta }i}^TS_{\bar{\zeta }}(x)\) is small, so \(\epsilon _{\zeta i}=O(\epsilon _i)\).
Finally, according to Theorem 1 in [57], the regression subvector \(S_{\zeta i}(x)\) satisfies the persistent excitation condition almost always. This will lead to exponential stability of \((\tilde{x}_i,\tilde{W}_{\zeta i})=0\) of the nominal part of system (9) [58]. Based on the analysis results given in [57], the neural network weight estimate error \(\tilde{W}_{\zeta i}\) converges to small neighborhoods of zero, with the sizes of the neighborhoods being determined by \(\epsilon _{\zeta i}\) and \(\Vert \sigma _i\Gamma _{\zeta i}W_{\zeta i}^*\Vert\), both of which are small values. This means that the entire RBF network \(\hat{W}_i^TS(x)\) can approximate the unknown \(\phi _i(x;p)\) along the trajectory \(\varphi _\zeta\), and
where \(\epsilon _{i1}=O(\epsilon _{\zeta i})\).
By the convergence result, we can obtain a constant vector of neural weights according to
where \(t_b>t_a>0\) represent a time segment after the transient process. Therefore, we conclude that accurate identification of the function \(\phi _i(x;p)\) is obtained along the trajectory \(\varphi _\zeta (x_0)\) by using \(\bar{W}_i^TS_i(x)\), i.e.,
where \(\epsilon _{i2}=O(\epsilon _{i1})\) and subsequently \(\epsilon _{i2}=O(\epsilon ^*)\).
Classification mechanism
In this section, we present a scheme to distinguish between ACLI and ACLD knees.
Consider a training dataset consisting of gait patterns \(\varphi _\zeta ^k\), \(k=1,\ldots ,M\), with the kth training pattern \(\varphi _\zeta ^k\) generated from
where \(F^k(x;p^k)\) denotes the gait system dynamics, \(v^k(x;p^k)\) denotes the modeling uncertainty, \(p^k\) is the system parameter vector.
As shown in the above subsection, the general gait system dynamics \(\phi ^k(x;p^k):=F^k(x;p^k)+v^k(x;p^k)\) can be accurately derived and preserved in constant RBF neural networks \(\bar{W}^{k^T}S(x)\). By utilizing the learned knowledge obtained in the training stage, a bank of M estimators is constructed for the training gait patterns as follows:
where \(k=1,\ldots ,M\) is used to stand for the kth estimator, \(\bar{\chi }^k=[\bar{\chi }_1^k,\ldots ,\bar{\chi }_n^k]^T\) is the state of the estimator, \(B=diag[b_1, \ldots , b_n]\) is a diagonal matrix which is kept the same for all estimators, x is the state of an input test gait pattern generated from Eq. (4).
In the classification phase, by comparing the test gait pattern (standing for an ACLD or an ACLI gait pattern) generated from gait system (4) with the set of M estimators (15), we obtain the following test error systems:
where \(\tilde{\chi }_i^k=\bar{\chi }_i^kx_i\) is the state estimation (or synchronization) error. We compute the average \(L_1\) norm of the error \(\tilde{\chi }_i^k(t)\)
where \(\mathrm {T}_c\) is the cycle of human gait.
The fundamental idea of the classification between ACLD and ACLI knees is that if a test gait pattern generated from a certain ACLD or ACLI knee is similar to the trained gait pattern \(s~(s\in \{1,\ldots ,k\})\), the constant RBF network \(\bar{W}_i^{s^T}S_i(x)\) embedded in the matched estimator s will quickly recall the learned knowledge by providing accurate approximation to gait system dynamics. Thus, the corresponding error \(\Vert \tilde{\chi }_i^s(t)\Vert _1\) will become the smallest among all the errors \(\Vert \tilde{\chi }_i^k(t)\Vert _1\). Based on the smallest error principle, the appearing test gait pattern can be classified. We have the following classification scheme.
Classification scheme: If there exists some finite time \(t^s,~s\in \{1,\ldots ,k\}\) and some \(i\in \{1,\ldots ,n\}\) such that \(\Vert \tilde{\chi }_i^s(t)\Vert _1<\Vert \tilde{\chi }_i^k(t)\Vert _1\) for all \(t>t^s\), then the appearing gait pattern can be classified.
Experimental results
The classification performance of ACLD knees against ACLI knees is evaluated on several experiments. Three measurements, including the Sensitivity, the Specificity and the Accuracy, are employed for the evaluation, which are defined as follows:
where TP is the number of true positives, FN is the number of false negatives, TN is the number of true negatives and FP is the number of false positives.
The classification results of ACLD knees will be evaluated in the twofold crossvalidation and leaveonesubjectout crossvalidation styles, respectively. In the experiment of twofold crossvalidation style, we randomly select half of the group of patients with ACLD knees and half of the group of the healthy controls with ACLI knees to constitute the training dataset, the rest of the subjects in the two groups are selected as the test dataset. That means there are 9 patients with ACLD knees and 14 healthy controls with ACLI knees in the training dataset. In the experiment of leaveonesubjectout crossvalidation, each time we select one subject for classification, the rest of the 45 subjects for training. This process is repeated 46 times and the leaveonesubjectout classification accuracy is calculated as the average of the classification accuracy of all of the individually leftout subjects.
In the training phase, the RBF network \(\hat{W}_i^TS_i(x)\) is constructed in a regular lattice, with nodes \(N=83521\), the centers \(\mu _i\) evenly spaced on \([1.2,1.2]\times [1.2,1.2]\times [1.2,1.2]\times [1.2,1.2]\) so as to cover all the trajectories of the input vectors, and the widths \(\eta =0.15\). The weights of the RBF neural networks are updated according to Eq. (7). The initial weights \(\hat{W}_i(0)=0\). The design parameters for (6) and (7) are \(a_i=0.5, \Gamma =diag\{1.5,1.5,1.5,1.5\}, \sigma _i=10, (i=1,\ldots ,4)\).
In the classification phase, by using the constant networks \(\bar{W}_i^{k^T}S_i(x)\), RBF network estimators are constructed based on Eq. (15). The parameters in Eqs. (15) and (17) are \(b_i=30~(i=1,\ldots ,4), T_c=1.08s\). Experimental results are illustrated in Tables 3 and 4, and Fig. 6. Tables 3 and 4 shows the confusion matrix of gait pattern classification between ACLD and ACLI knees by using twofold and leaveonesubjectout crossvalidation styles. Figure 6 shows the classification results. By using the twofold crossvalidation and leaveonesubjectout crossvalidation styles, the correct classification rates for ACLD knees are reported to be 91.3\(\%\) and 95.65\(\%\), respectively.
Discussion
The methodology described in this study is expected to provide the clinicians with an efficient tool for assisted diagnosis of ACLD knees. In comparison to other methods reported in [15, 16, 20, 24, 59,60,61], the proposed method focuses not only on providing evidence to support the claim that ACLD knees demonstrate altered gait patterns compared to ACLI knees, but also on providing an automatic and objective method to distinguish between patients with ACLD knees and healthy controls with ACLI knees. Almosnino et al. [15] aimed to identify, using Principal Component Analysis, strength curve features that explain the majority of variation between the injured and uninjured knee, and to assess the capabilities of these features to detect the presence of injury. 43 unilateral ACL deficient patients were included in the experiments to discern between the ACLD and contra lateral, healthy knees. The specificity, sensitivity and accuracy are reported to be 60.5\(\%\), 60.5\(\%\) and 62\(\%\), respectively. Christian et al. [16] showed the potential of a pattern recognition system for the diagnoses of kinematic gait patterns in patients due to a recently ruptured ACL. Principal component analysis and recursive feature elimination were used to extract features from 3D marker trajectories. Seven patients with acute ACL rupture were included in the experiment and cross validation yielded \(100\%\) accuracy. However, the database used is too small which may weaken the persuasion of the classification performance. Berruto et al. [17] used tibial accelerometers to quantify pivotshift differences between knees for subjects with unilateral ACL injuries. They considered only accelerationbased metrics, and discrimination of the side of ACL deficiency was accomplished by comparing the magnitudes of accelerations measured for the two legs. Accuracy of correctly identifying the injured knee was roughly \(90\%\). Kopf et al. [18] performed a study similar to [17], in which 20 subjects with unilateral ACL deficiency were graded with inertial sensor modules strapped to the tibia and femur. All 3 metrics based on accelerometer measurements were found to be significantly different between injured and uninjured knees of subjects with unilateral ACL deficiency. They did not explicitly state accuracies in determining the side of ACL injury, but examination of their results suggested an accuracy of 95\(\%\) (19 of 20) based on acceleration difference. Comparison of the classification performance to other stateoftheart methods between ACLI and ACLD groups is shown in Fig. 7.
Different from the methods in the abovementioned literature, our method focused on modeling the human gait and extracting the disparity of gait system dynamics between ACLD and ACLI knees for the discrimination task. It abandoned the traditional and direct comparison of lower extremity motion parameters between ACLD and ACLI knees and adopted instead the modeling, identification and classification of gait dynamics based on motion parameters. This may better explain and reveal the motion principle of pathological and healthy gaits hidden underneath the parameters extracted through PSR and ED. The proposed method serves not only as a measure of kinematic variability and discrimination between two groups of patients with ACL deficiency and healthy controls, but also as a noninvasive, objective and assistant technical means to other diagnostic approaches such as Xrays, MRI, arthroscopy, etc.
However, there are some limitations in the present study which need further improvement. Experiments were carried out on a small database and more participants need to be recruited to verify the effectiveness. At current stage, the proposed method is more suitable to be a tool applicable for gait reeducation on previously diagnosed patients. It is not easy for the clinicians to distinguish a deficiency of the ACL from a possible injury of another structure of the knee, such as posterior cruciate ligament or collateral ligaments, since these injuries may also lead to the same gait patterns. Only when the patients were highly suspected to have the ACL injury, can the proposed method be used to diagnose it as an assistant tool. In future work, injury of other structures of the knee, including posterior cruciate ligament or collateral ligaments injury and their related gait patterns, may also be included in our study to assist in diagnosing the knee injury more accurately. In addition, other parameters regarding different knee lessons can be adopted to improve the classification accuracy.
Conclusions
The results of this study indicate that the pattern classification of knee kinematic data can offer an objective and invasive method to assess the gait disparity between ACLD and ACLI knees. These results demonstrate the potential of the proposed technique for detecting pathological gait patterns caused by ACL deficiency by analysing and measuring the disparity of gait system dynamics using PSR, ED and neural networks. PSR is one of the most used methods which is the timedelay embedding and fits well with 1dimensional time series. The ddimensional space of delay coordinates serves as a pseudo statespace which provides a natural setting to approximate the quantitative aspects of the gait system dynamics. PSR plots gait system dynamics along the gait signal trajectory in a 3D phase space diagram and visualizes the gait system dynamics. ED measures and derives gait features, which are fed into RBF neural networks for the modeling, identification and classification of gait system dynamics between ACLD and ACLI knees. However, some limitations such as the small size of the database, the regulation principle of the embedding dimension and time lag, still need to be improved and overcome. Future work will include a clinical validation of the proposed technique with a larger number of patients with ACL deficiency and agematched healthy controls. In the present study, PSR parameters such as the time lag and embedding dimension are with fixed values. Assessments of the relationship between the embedding dimension, time lag and the classification accuracy can also be considered in future investigations.
References
Gao B, Cordova ML, Zheng NN. Threedimensional joint kinematics of ACLdeficient and ACLreconstructed knees during stair ascent and descent. Hum Mov Sci. 2012;31(1):222â€“35.
Ren S, Yu Y, Shi H, Miao X, Jiang Y, Liang Z, Ao Y. Three dimensional knee kinematics and kinetics in ACLdeficient patients with and without medial meniscus posterior horn tear during level walking. Gait Posture. 2018;66:26â€“31.
Musahl V, Getgood A, Neyret P, Claes S, Burnham JM, Batailler C, Karlsson J. Contributions of the anterolateral complex and the anterolateral ligament to rotatory knee stability in the setting of ACL injury: a roundtable discussion. Knee Surg Sports Traumatol Arthrosc. 2017;25(4):997â€“1008.
Adouni M, ShiraziAdl A, Marouane H. Role of gastrocnemius activation in knee joint biomechanics: gastrocnemius acts as an ACL antagonist. Comput Methods Biomech Biomed Eng. 2016;19(4):376â€“85.
Wellsandt E, Arundale A, Manal K, Buchanan TS, SnyderMackler L. Lower hop scores related to gait asymmetries after ACL injury: identifying associations related to the development of early onset knee OA. Osteoarthritis Cartilage. 2015;23:A279.
Kiapour AM, Kiapour A, Goel VK, Quatman CE, Wordeman SC, Hewett TE, Demetropoulos CK. Unidirectional coupling between tibiofemoral frontal and axial plane rotation supports valgus collapse mechanism of ACL injury. J Biomech. 2015;48(10):1745â€“51.
Weiss K, Whatman C. Biomechanics associated with patellofemoral pain and ACL injuries in sports. Sports Med. 2015;45(9):1325â€“37.
Chen HC, Wu CH, Wang CK, Lin CJ, Sun YN. A Jointconstraint modelbased system for reconstructing total knee motion. IEEE Trans Biomed Eng. 2014;61(1):171â€“81.
Lam MH, Fong DTP, Yung PSH, Ho EP, Chan WY, Chan KM. Knee stability assessment on anterior cruciate ligament injury: clinical and biomechanical approaches. Sports Med Arthrosc Rehab Therapy Technol. 2009;1(1):1.
Altilio R, Paoloni M, Panella M. Selection of clinical features for pattern recognition applied to gait analysis. Med Biol Eng Comput. 2017;55(4):685â€“95.
El Habachi A, Moissenet F, Duprey S, Cheze L, Dumas R. Global sensitivity analysis of the joint kinematics during gait to the parameters of a lower limb multibody model. Med Biol Eng Comput. 2015;53(7):655â€“67.
Wolf A, Degani A. Recognizing knee pathologies by classifying instantaneous screws of the six degreesoffreedom knee motion. Med Biol Eng Comput. 2007;45(5):475â€“82.
Padole C, Proenca H. An aperiodic feature representation for gait recognition in crossview scenarios for unconstrained biometrics. Patt Anal Appl. 2017;20(1):73â€“86.
Jensen U, Kugler P, Ring M, Eskofier BM. Approaching the accuracycost conflict in embedded classification system design. Patt Anal Appl. 2016;19(3):839â€“55.
Almosnino S, Brandon SC, Day AG, Stevenson JM, Dvir Z, Bardana DD. Principal component modeling of isokinetic moment curves for discriminating between the injured and healthy knees of unilateral ACL deficient patients. J Electromyog Kinesiol. 2014;24(1):134â€“43.
Christian J, Kroll J, Strutzenberger G, Alexander N, Ofner M, Schwameder H. Computer aided analysis of gait patterns in patients with acute anterior cruciate ligament injury. Clin Biomech. 2016;33:55â€“60.
Berruto M, Uboldi F, Gala L, Marelli B, Albisetti W. Is triaxial accelerometer reliable in the evaluation and grading of knee pivot shift phenomenon? Knee Surg Sports Traumatol Arthrosc. 2013;21(4):981â€“5.
Kopf S, Kauert R, Halfpaap J, Jung T, Becker R. A new quantitative method for pivot shift grading. Knee Surg Sports Traumatol Arthrosc. 2012;20(4):718â€“23.
Knoll Z, Kocsis L, Kiss RM. Gait patterns before and after anterior cruciate ligament reconstruction. Knee Surg Sports Traumatol Arthrosc. 2004;12(1):7â€“14.
Houck JR, Duncan A, Haven KED. Knee and hip angle and moment adaptations during cutting tasks in subjects with anterior cruciate ligament deficiency classified as noncopers. J Orthop Sports Phys Therapy. 2005;35(8):531â€“40.
Houck JR, De Haven KE, Maloney M. Influence of anticipation on movement patterns in subjects with ACL deficiency classified as noncopers. J Orthop Sports Phys Therapy. 2007;37(2):56â€“64.
Takeda K, Hasegawa T, Kiriyama Y, Matsumoto H, Otani T, Toyama Y, Nagura T. Kinematic motion of the anterior cruciate ligament deficient knee during functionally high and low demanding tasks. J Biomech. 2014;47(10):2526â€“30.
Ismail SA, Button K, Simic M, Van Deursen R, Pappas E. Threedimensional kinematic and kinetic gait deviations in individuals with chronic anterior cruciate ligament deficient knee: A systematic review and metaanalysis. Clin Biomech. 2016;35:68â€“80.
Andriacchi TP, Dyrby CO. Interactions between kinematics and loading during walking for the normal and ACL deficient knee. J Biomech. 2005;38(2):293â€“8.
Kvist J, Good L, Tagesson S. Changes in knee motion pattern after anterior cruciate ligament injuryâ€”a case report. Clin Biomech. 2007;22(5):551â€“6.
LindstrÃ¶m M, FellÃ¤nderTsai L, Wredmark T, Henriksson M. Adaptations of gait and muscle activation in chronic ACL deficiency. Knee Surg Sports Traumatol Arthrosc. 2010;18(1):106â€“14.
Fuentes A, Hagemeister N, Ranger P, Heron T, de Guise JA. Gait adaptation in chronic anterior cruciate ligamentdeficient patients: pivotshift avoidance gait. Clin Biomech. 2011;26(2):181â€“7.
Chen CH, Li JS, Hosseini A, Gadikota HR, Gill TJ, Li G. Anteroposterior stability of the knee during the stance phase of gait after anterior cruciate ligament deficiency. Gait Posture. 2012;35(3):467â€“71.
Gardinier ES, Manal K, Buchanan TS, SnyderMackler L. Clinicallyrelevant measures associated with altered contact forces in patients with anterior cruciate ligament deficiency. Clin Biomech. 2014;29(5):531â€“6.
Shabani B, Bytyqi D, Lustig S, Cheze L, Bytyqi C, Neyret P. Gait changes of the ACLdeficient knee 3D kinematic assessment. Knee Surg Sports Traumatol Arthrosc. 2015;23(11):3259â€“65.
Vairis A, Stefanoudakis G, Petousis M, Vidakis N, Tsainis AM, Kandyla B. Evaluation of an intact, an ACLdeficient, and a reconstructed human knee joint finite element model. Comput Methods Biomech Biomed Eng. 2016;19(3):263â€“70.
Robinson MA, Donnelly CJ, Tsao J. Impact of knee modeling approach on indicators and classification of anterior cruciate ligament injury risk. Med Sci Sports Exerc. 2014;46(7):1269â€“76.
Atarod M, Frank CB, Shrive NG. Kinematic and kinetic interactions during normal and ACLDeficient gait: a longitudinal in vivo study. Ann Biomed Eng. 2014;42(3):566â€“78.
Marouane H, ShiraziAdl A, Hashemi J. Quantification of the role of tibial posterior slope in knee joint mechanics and ACL force in simulated gait. J Biomech. 2015;48(10):1899â€“905.
McCarthy I, Hodgins D, Mor A, Elbaz A, Segal G. Analysis of knee flexion characteristics and how they alter with the onset of knee osteoarthritis: a case control study. BMC Musculoskelet Disord. 2013;14(1):169.
Takens F. Detecting strange attractors in turbulence, in: Dynamical Systems and Turbulence, Warwick 1980, Berlin: Springer; 1981. p. 366â€“81.
Xu B, Jacquir S, Laurent G, Bilbault JM, Binczak S. Phase space reconstruction of an experimental model of cardiac field potential in normal and arrhythmic conditions. In: 35th Annual international conference of the IEEE engineering in medicine and biology society. 2013. p. 3274â€“7.
Sharma R, Pachori RB. Classification of epileptic seizures in EEG signals based on phase space representation of intrinsic mode functions. Expert Syst Appl. 2015;42(3):1106â€“17.
Alkjaer T, Raffalt PC, Dalsgaard H, Simonsen EB, Petersen NC, Bliddal H, Henriksen M. Gait variability and motor control in people with knee osteoarthritis. Gait Posture. 2015;42(4):479â€“84.
PiÃ³rek M, JosiÃ³ski H, Michalczuk A, ÅšwitoÅ„ski A, Szczesna A. Quaternions and joint angles in an analysis of local stability of gait for different variants of walking speed and treadmill slope. Inf Sci. 2017;384:263â€“80.
Georgescu M, Petcu A, Tarnita D. Influences of speed and treadmill inclination on the local dynamic stability of human knee joint. In: Applied mechanics and materials (Vol. 880). Switzerland: Trans Tech Publications; 2018. p. 130â€“5.
Zhang Y, Yao Z, Wang S, Huang W, Ma L, Huang H, Xia H. Motion analysis of Chinese normal knees during gait based on a novel portable system. Gait Posture. 2015;41(3):763â€“8.
Fung P, Mok K, Leow R, Fu S, Yung P, Chan K. Knee kinematics of ACLdeficient patients: a development of a portable motion analysis system. J Hum Sport Exerc. 2018. https://doi.org/10.14198/jhse.2018.134.11.
Zeng X, Ma L, Lin Z, Huang W, Huang Z, Zhang Y, Mao C. Relationship between KellgrenLawrence score and 3D kinematic gait analysis of patients with medial knee osteoarthritis using a new gait system. Sci Rep. 2017;7(1):4080.
Yeung MY, Fu SC, Chua EN, Mok KM, Yung PSH, Chan KM. Use of portable motion analysis system for knee stability assessment in ACL deficiency during singleleghop. Asia Pac J Sports Med Arthrosc Rehabil Technol. 2016;6:24.
Thalheimer W, Cook S. How to calculate effect sizes from published research: a simplified methodology. Somerville: WorkLearning Research Inc; 2002.
Lakens D. Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for ttests and ANOVAs. Front Psychol. 2013;4:863.
Cohen J. The statistical power of abnormalsocial psychological research: a review. J Abnorm Soc Psychol. 1962;65:145â€“53.
Sedlmeier P, Gigerenzer G. Do studies of statistical power have an effect on the power of the studies? Psychol Bull. 1989;105:309â€“16.
Lee SH, Lim JS, Kim JK, Yang J, Lee Y. Classification of normal and epileptic seizure EEG signals using wavelet transform, phasespace reconstruction, and Euclidean distance. Comput Methods Programs Biomed. 2014;116(1):10â€“25.
Sivakumar B. A phasespace reconstruction approach to prediction of suspended sediment concentration in rivers. J Hydrol. 2002;258(1â€“4):149â€“62.
Michael S. Applied nonlinear time series analysis: applications in physics, physiology and finance (Vol. 52). World Scientific; 2005.
MerigÃ³ JM, Casanovas M. Induced aggregation operators in the Euclidean distance and its application in financial decision making. Expert Syst Appl. 2011;38:7603â€“8.
Wang C, Hill DJ. Learning from neural control. IEEE Trans Neural Netw. 2006;17(1):130â€“46.
Wang C, Hill DJ. Deterministic learning and rapid dynamical pattern recognition. IEEE Trans Neural Netw. 2007;18(3):617â€“30.
Wang C, Hill DJ. Deterministic learning theory for identification, recognition and control. Boca Raton: CRC Press; 2009.
Wang C, Chen T, Chen G, Hill DJ. Deterministic learning of nonlinear dynamical systems. Int J Bifurcation Chaos. 2009;19(4):1307â€“28.
Farrell J. Stability and approximator convergence in nonparametric nonlinear adaptive control. IEEE Trans Neural Netw. 1998;9(5):1008â€“20.
Tsepis E, Giakas G, Vagenas G, Georgoulis A. Frequency content asymmetry of the isokinetic curve between ACL deficient and healthy knee. J Biomech. 2004;37(6):857â€“64.
Kaplan Y. Identifying individuals with an anterior cruciate ligament deficient knee as copers and noncopers: a narrative literature review. J Sci Med Sport. 2015;19:e26.
Iliopoulos E, Galanis N, Iosifidis M, Zafeiridis A, Papadopoulos P, Potoupnis M, Kirkos J. Anterior cruciate ligament deficiency reduces walking economy in copers and noncopers. Knee Surg Sports Traumatol Arthrosc. 2017;25(5):1403â€“11.
Authors' contributions
Study concept and design (WZ); drafting of the manuscript (WZ and WW); critical revision of the manuscript for important intellectual content (WZ, WW and CY); obtained funding (WW, WZ and YZ); administrative, technical, and material support (LM); study supervision (WZ and YZ). WW, WZ and YZ contributed equally. All authors read and approved the final manuscript.
Acknowledgements
This work was supported by the National Natural Science Foundation of China (Grant Nos. 61773194, 61304084, 31700880), by the Natural Science Foundation of Fujian Province (Grant No. 2018J01542), by the Program for New Century Excellent Talents in Fujian Province University, by the Science and Technology Planning Project of Guangzhou city (Grant No. 201803010106) and by the Science and Technology Project of Longyan City (Grant No. 2017LY85).
Competing interests
The authors declare that they have no competing interests.
Availability of data and materials
The datasets used and/or analyzed during in current study are available from the corresponding author on reasonable requests.
Publisherâ€™s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Wu, W., Zeng, W., Ma, L. et al. Modeling and classification of gait patterns between anterior cruciate ligament deficient and intact knees based on phase space reconstruction, Euclidean distance and neural networks. BioMed Eng OnLine 17, 165 (2018). https://doi.org/10.1186/s1293801805941
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s1293801805941