A novel balance training system using multimodal biofeedback
© Afzal et al. 2016
Received: 10 February 2016
Accepted: 17 April 2016
Published: 22 April 2016
A biofeedback-based balance training system can be used to provide the compromised sensory information to subjects in order to retrain their sensorimotor function. In this study, the design and evaluation of the low-cost, intuitive biofeedback system developed at Gyeongsang National University is extended to provide multimodal biofeedback for balance training by utilization of visual and haptic modalities.
The system consists of a smartphone attached to the waist of the subject to provide information about tilt of the torso, a personal computer running a purpose built software to process the smartphone data and provide visual biofeedback to the subject by means of a dedicated monitor and a dedicated Phantom Omni® device for haptic biofeedback. For experimental verification of the system, eleven healthy young participants performed balance tasks assuming two distinct postures for 30 s each while acquiring torso tilt. The postures used were the one foot stance and the tandem Romberg stance. For both the postures, the subjects stood on a foam platform which provided a certain amount of ground instability.
Post-experiment data analysis was performed using MATLAB® to analyze reduction in body sway. Analysis parameters based on the projection of trunk tilt information were calculated in order to ascertain the reduction in body sway and improvements in postural control. Two-way analysis of variance (ANOVA) showed no statistically significant interactions between postures and biofeedback. Post-hoc analysis revealed statistically significant reduction in body sway on provision of biofeedback. Subjects exhibited maximum body sway during no biofeedback trial, followed by either haptic or visual biofeedback and in most of the trials the multimodal biofeedback of visual and haptic together resulted in minimization of body sway, thus indicating that the multimodal biofeedback system worked well to provide significant (p < 0.05) assistance in postural control.
A multimodal biofeedback system can offer more customized training methods and hence provide therapists with a comprehensive solution for a diverse array of patients. It is necessary to identify the long-term effects of this novel biofeedback system. In the future, the balance training schemes for individuals with upright balance issues will be studied.
KeywordsMultimodal biofeedback Visual biofeedback Haptic biofeedback Postural stability Balance training system
Balance and postural control are of vital importance for a person to walk and perform daily activities in a safe manner. These capabilities can be weakened as a consequence of the aging process, disease or trauma. The depletion of these capabilities is dangerous and can lead to falls , resulting in injury. Musculoskeletal and neurological factors including the vestibular system, vision, proprioception, muscle strength, and cognition are involved, in a complex manner, in postural and balance control . As a result of aging or trauma, the sensory information available for the performance of these tasks is reduced. In such cases, sensory augmentation through the use of biofeedback devices can be applied to compensate for this weakness. Various biofeedback systems have been developed to improve balance based on different modalities, such as visual biofeedback [3–6], auditory biofeedback [7–9], and haptic biofeedback [10–12].
In a healthy human being, visual cues are employed as anchors of the environment. Therefore in biofeedback systems visual modality is usually provided on a balance training system with a fixed environment, hence prohibiting the options of wear-ability and outdoor use. The auditory biofeedback and haptic (vibrotactile) biofeedback systems, however, have the advantage of being able to be employed as wearable balance assistance systems. In comparison to audio biofeedback, a kinesthetic haptic interaction based system can provide continuous assistance without the discomfort of getting noisy and becoming a source of irritation for the user. The term light touch refers to fingertip contact with another physical object. Light touch based haptic cues have been used to improve postural stability . Sensorimotor information of body displacement provided through contact of the index finger with a stationary bar can be used to stabilize body and reduce its sway [13, 14]. Light touch as a therapeutic mechanism can be a useful option in balance rehabilitation . Albertsen et al.  showed that a light handgrip on a stick aids postural stabilization; the light grip facilitates delivery of haptic cues under natural circumstances. Thus, recent studies have used light touch based haptic cues to improve postural stability and balance. When standing quietly, individuals can use visual information from a fixed visual environment to reduce postural sway. It is believed that by providing additional visual information, individuals can become more aware of their body’s displacements and orientation in space. Hence, visual biofeedback is found to be effective in reducing body sway among young healthy and older healthy subjects, stroke patients and multiple sclerosis patients [17–20]. Long-term training using multimodal head-mounted biofeedback system (visual, audio and vibrotactile) has been shown to improve balance metrics in healthy young and older subjects . Effects of multimodal biofeedback (visual and a waist-mounted vibrotactile belt) have also been investigated for subjects with defects in the vestibular system . In comparison with single biofeedback (visual), multimodal biofeedback (visual and tactile) has been recognized to provide better performance during multi-tasking . Recently, the use of light touch as kinesthetic haptic biofeedback has been verified as an effective method to provide balance cues to young healthy adults and stroke victims . Kinesthetic haptic interface may be utilized not only to deliver cues in order to reduce body sway during standing but also in balance training featuring virtual/augmented reality, affording the therapists more therapeutic options and improving development of cognition in the patients. Therefore, a prospect for the study of novel multimodal biofeedback that combines kinesthetic haptic and visual biofeedback is existent.
In this study, the design of a low cost kinesthetic haptic feedback based balance training system  is extended to make it a multimodal biofeedback balance trainer. The system is capable of assisting the user in reducing body sway by providing multimodal biofeedback (featuring both haptic and visual biofeedback) based on trunk tilt measured with the help of a smartphone attached to the subject’s body. The objective of this study is to observe the effects of this novel multimodal biofeedback system in reduction of body sway and to empirically test the hypothesis that multimodal biofeedback can provide better assistance in the performance of balancing tasks as compared to a single-mode biofeedback system.
Eleven healthy young subjects (9 males and 2 females, age 27.1 ± 3.1 years, weight 78.3 ± 6.6 kg, height 169.9 ± 9.2 cm) were recruited to check the effectiveness of biofeedback provided by our proposed system. None of the young healthy subjects had any history of sensorimotor or neurological disorders. These subjects did not suffer from any visual deficits other than adequately corrected loss of visual acuity. All of the subjects gave written informed consent in accordance with the rules of our local Ethics Committee.
Four conditions of biofeedback were applied for each subject during each posture. In the condition of no biofeedback (F1) subjects used their natural balancing capabilities to maintain upright stance, furthermore, in condition of haptic biofeedback (F2) subjects hold the phantom Omni device’s handle to get balance cues. The other three conditions consisted of different possibilities of biofeedback. In the condition of haptic biofeedback (F2) subjects held the phantom handle of the Omni device to obtain balance cues, likewise, in condition of visual biofeedback (F3) subjects utilized the visual cues provided through the display screen to balance themselves, and lastly in the condition of multimodal biofeedback (F4), the subjects utilized both haptic and visual biofeedback simultaneously to achieve their objective.
Appropriate utilization of the haptic and visual biofeedback for assistance in balance control was explained to all subjects. The surrounding environment was designed to lack any stimulus. Subjects were instructed to remain silent. 60 s of rest time was provided to all subjects between trials on each condition. Selection of posture and biofeedback was random for young healthy subjects.
Results of body sway among young healthy subjects. Provision of biofeedback reduced the body sway
Results post hoc analysis results in postural condition of one foot stance
Comparison of biofeedback (p value obtained from post hoc analysis)
F1 vs F2
F1 vs F3
F1 vs F4
F2 vs F3
F2 vs F4
F3 vs F4
Results post hoc analysis results in postural condition of tandem Romberg stance
Comparison of biofeedback (p value obtained from post hoc analysis)
F1 vs F2
F1 vs F3
F1 vs F4
F2 vs F3
F2 vs F4
F3 vs F4
Body sway is a meaningful indication, which can be used to recognize the balance of a human being during upright standing posture . Biofeedback based system provides the compromised sensory information to retrain sensorimotor function . In this paper a novel system was presented which can provide the customized training of balance based on either visual biofeedback or haptic biofeedback or combined haptic and visual multimodal biofeedback.
Experiments conducted on young healthy subjects supported the credibility of the system. Trial results show that when subjects utilized biofeedback a reduction in body sway was achieved. The no biofeedback condition (F1) was utilized as baseline to compare it with biofeedback conditions. Haptic biofeedback (F2) effectively contributed (P1: MVD [F(3, 40) = 3.36, p = 0.028], MLT [F(3, 40) = 4.03, p = 0.010] and P2: MVD [F(3, 40) = 4.97, p = 0.005], MLT [F(3, 40) = 5.19, p = 0.004], APT [F(3, 40) = 4.14, p = 0.012]) in assisting young healthy subjects, similar results were obtained in our previous study about effects of haptic biofeedback on standing stability . Visual biofeedback (F3) contributed in reduction of body sway during P1 and P2 but was statistically significant only in reducing MVD [F(3, 40) = 2.89, p = 0.047] and MLT [F(3, 40) = 2.85, p = 0.049] while assuming P1. Research study , demonstrated significant reduction of body sway among young healthy subjects with visual biofeedback application in a much comfortable upright standing posture than the one we used in our study. As hypothesized, significant reduction (p < 0.05) was observed amongst most of the analysis parameters on a provision of multimodal biofeedback (F4). All young healthy subjects reduced body sway significantly with the application of multimodal biofeedback (P1: MVD [F(3, 40) = 3.71, p = 0.019], MLT [F(3, 40) = 4.97, p = 0.005], and P2: MVD [F(3, 40) = 4.41, p = 0.009], PD [F(3, 40) = 3.67, p = 0.019], MLT [F(3, 40) = 5.88, p = 0.002], APT [F(3, 40) = 2.87, p = 0.048]). Theoretically, the positive effect of multimodal learning originates from a reduction of the cognitive load due to a distribution of information processing. Multiple resource theory suggests that the redundancy provided by multimodal feedback should improve performance in comparison to single-mode feedback [32, 33].
Trial results express that a multimodal biofeedback is found to be more effective in comparison with lone biofeedback of visual or haptic, this outcome commemorate the fact that our body balances with help of a multi-sensing input  and comprehensive augmented biofeedback could conjugate with missing capabilities . However, reduction of body sway compared between multimodal (F4), visual (F3) and haptic (F2) biofeedback was not significantly different. Similarly, a multimodal (visual and vibrotactile) biofeedback system  also shows no substantial improvements in performance of balancing tasks when multimodal biofeedback was compared with single-mode biofeedback (visual or vibrotactile). On contrary, multimodal (visual and vibrotactile) biofeedback has proven to be effective in long-term balance training program . Hence, the assessment of long-term balance training by using the novel multimodal biofeedback system presented in this research is mandatory.
Our study focused on comparing the effects of various biofeedback modalities and their comparison. We did not evaluate the long-term effects of training with the biofeedback system. The smartphone positioning on the trunk did not allow us to identify the body motions other than trunk tilt. Furthermore, no constraint was applied on the upper arm for application of biofeedback through haptic device. However, the pre-experimental instructions to the subjects overcame this limitation. Worthy conclusions can be drawn on the effectiveness of multimodal biofeedback based balance training system after further exploration and improvement.
Conclusion and future work
Our study shows importance of multimodal biofeedback in helping the young healthy subjects to regain balance. Our balance training system points towards an important addition to the rehabilitation procedures. From this current research, analyzing the effects of multimodal biofeedback on body sway reduction of young healthy subjects would be used as a norm. In the future, we will use our system to perform a long-term balance training protocol for individuals with upright balance issues such as elderly adult, Stroke and multiple sclerosis (MS).
mean velocity displacement
analysis of variance
projection of trunk tilt
MRA conducted the whole research, and drafted the complete manuscript, participated in the measurements of all subjects, the design and coordination of the study, assisted with software development and performed data analysis. MKO and HYC managed the trials and assisted with writing discussions in the manuscript. JY conceived the whole idea, supervised the research and helped in finalizing the manuscript. All authors read and approved the final manuscript.
This work was supported by the National Research Foundation Korea (NRF) (2014R1A2A1A11053989 and 2012-0009524) and Dual Use Technology Program of Civil and Military. Jungwon Yoon and Min-Kyun Oh contributed equally to this work as corresponding authors.
The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Sackley CM. Falls, sway, and symmetry of weight-bearing after stroke. Int Disabil Stud. 1991;13(1):1–4. doi:https://doi.org/10.3109/03790799109166267.View ArticleGoogle Scholar
- Hassan BS, Mockett S, Doherty M. Static postural sway, proprioception, and maximal voluntary quadriceps contraction in patients with knee osteoarthritis and normal control subjects. Ann Rheum Dis. 2001;60(6):612–8.View ArticleGoogle Scholar
- Bayouk JF, Boucher JP, Leroux A. Balance training following stroke: effects of task-oriented exercises with and without altered sensory input. Int J Rehabil Res. 2006;29(1):51–9.View ArticleGoogle Scholar
- Lange B, Flynn S, Proffitt R, Chang CY, “Skip”Rizzo A. Development of an interactive game-based rehabilitation tool for dynamic balance training. Top Stroke Rehabil. 2010;17:345–52.View ArticleGoogle Scholar
- Srivastava A, Taly AB, Gupta A, Kumar S, Murali T. Post-stroke balance training: role of force platform with visual feedback technique. J Neurol Sci. 2009;287(1):89–93.View ArticleGoogle Scholar
- Young W, Ferguson S, Brault S, Craig C. Assessing and training standing balance in older adults: a novel approach using the ‘Nintendo Wii’ Balance Board. Gait Posture. 2011;33(2):303–5.View ArticleGoogle Scholar
- Franco C, Fleury A, Gumery PY, Diot B, Demongeot J, Vuillerme N. iBalance-ABF: a smartphone-based audio-biofeedback balance system. IEEE Trans Biomed Eng. 2013;60(1):211–5.View ArticleGoogle Scholar
- Dozza M, Horak FB, Chiari L. Auditory biofeedback substitutes for loss of sensory information in maintaining stance. Exp Brain Res. 2007;178:37–48.View ArticleGoogle Scholar
- Chiari L, Dozza M, Cappello A, Horak FB, Macellari V, Giansanti D. Audio-biofeedback for balance improvement: an accelerometry-based system. IEEE Trans Biomed Eng. 2005;52:2108–11.View ArticleGoogle Scholar
- Afzal MR, Jan Y, Hassan S, Yoon J. Analysis of active haptic feedback effects on standing stability. In: Lee J, Lee MC, Liu H, Ryu JH, editors. Intelligent robotics and applications. Berlin: Springer; 2013. p. 154–64. doi:https://doi.org/10.1007/978-3-642-40852-6_18.View ArticleGoogle Scholar
- Sienko KH, Vichare VV, Balkwill MD, Wall C III. Assessment of vibrotactile feedback on postural stability during pseudorandom multidirectional platform motion. IEEE Trans Biomed Eng. 2010;57:944–52.View ArticleGoogle Scholar
- Lee BC, Kim J, Chen S, Sienko KH. Cell phone based balance trainer. J Neuroeng Rehabil. 2012;9:10.View ArticleGoogle Scholar
- Jeka JJ, Lackner JR. Fingertip contact influences human postural control. Exp Brain Res. 1994;100(3):495–502. doi:https://doi.org/10.1007/BF02738408.View ArticleGoogle Scholar
- Holden M, Ventura J, Lackner JR. Stabilization of posture by precision contact of the index finger. J Vestib Res. 1994;4(4):285–301.Google Scholar
- Jeka JJ. Light touch contact as a balance aid. Phys Ther. 1997;77(5):476–87.Google Scholar
- Albertsen IM, Temprado JJ, Berton E. Effect of haptic supplementation on postural stabilization: a comparison of fixed and mobile support conditions. Hum Mov Sci. 2010;29:999–1010.View ArticleGoogle Scholar
- Dault MC, de Haart M, Geurts AC, Arts IM, Nienhuis B. Effects of visual center of pressure feedback on postural control in young and elderly healthy adults and in stroke patients. Hum Mov Sci. 2003;22(3):221–36.View ArticleGoogle Scholar
- Sihvonen SE, Sipilä S, Era PA. Changes in postural balance in frail elderly women during a 4-week visual feedback training: a randomized controlled trial. Gerontology. 2004;50(2):87–95.View ArticleGoogle Scholar
- Walker C, Brouwer BJ, Culham EG. Use of visual feedback in retraining balance following acute stroke. Phys Ther. 2000;80(9):886–95.Google Scholar
- Brichetto G, Spallarossa P, de Carvalho ML, Battaglia MA. The effect of Nintendo® Wii® on balance in people with multiple sclerosis: a pilot randomized control study. Mult Scler J. 2013;19(9):1219–21. doi:https://doi.org/10.1177/1352458512472747.View ArticleGoogle Scholar
- Davis JR, Carpenter MG, Tschanz R, Meyes S, Debrunner D, Burger J, Allum JH. Trunk sway reductions in young and older adults using multi-modal biofeedback. Gait Posture. 2010;31(4):465–72. doi:https://doi.org/10.1016/j.gaitpost.2010.02.002.View ArticleGoogle Scholar
- Bechly KE, Carender WJ, Myles JD, Sienko KH. Determining the preferred modality for real-time biofeedback during balance training. Gait Posture. 2013;37(3):391–6. doi:https://doi.org/10.1016/j.gaitpost.2012.08.007.View ArticleGoogle Scholar
- Burke JL, Prewett MS, Gray AA, Yang L, Stilson FR, Coovert MD, Elliot LR, Redden E. Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis. In: Proceedings of the 8th international conference on Multimodal interfaces 2006, p. 108–117. ACM. doi: https://doi.org/10.1145/1180995.1181017.
- Afzal MR, Byun HY, Oh MK, Yoon J. Effects of kinesthetic haptic feedback on standing stability of young healthy subjects and stroke patients. J Neuroeng Rehabil. 2015;12(1):27. doi:https://doi.org/10.1186/s12984-015-0020-x.View ArticleGoogle Scholar
- Afzal MR, Oh MK, Lee CH, Park YS, Yoon J. A portable gait asymmetry rehabilitation system for individuals with stroke using a vibrotactile feedback. BioMed Res Int. 2015, Article ID 375638. Doi:https://doi.org/10.1155/2015/375638 (PMID: 26161398).
- Panetch Vega IM-A850L: http://www.ivega.co.kr/prt/productInfo.do?intprdseq=1350 (visited: January 2015).
- Phantom Omni: http://www.dentsable.com/haptic-phantom-omni.htm (visited: January 2015).
- Mataar D, Fournier R, Lachiri Z, Nait-Ali A. Discrete wavelet and modified PCA decompositions for postural stability analysis in biometric applications. J Biomed Sci Eng. 2011;4(08):543–51. doi:https://doi.org/10.4236/jbise.2011.48070.View ArticleGoogle Scholar
- Mataar D, Fournier R, Lachiri Z, Nait-Ali A. Biometric application and classification of individuals using postural parameters. Int J Comp Technol. 2013;7(2):580–93.Google Scholar
- Mataar D, Fournier R, Lachiri Z, Nait-Ali A. Stabilogram mPCA decomposition and effects analysis of several entries on the postural stability. Int J Image, Gr Signal Process. 2012;4(5):21–30. doi:https://doi.org/10.5815/ijigsp.2012.05.03.View ArticleGoogle Scholar
- Mataar D, Fournier R, Lachiri Z, Nait-Ali A. Human balance and stability behavior analysis using spatial and temporal stabilometric parameters. Int J Image, Gr Signal Process. 2013;5(6):33–42. doi:https://doi.org/10.5815/ijigsp.2013.06.05.View ArticleGoogle Scholar
- Wickens CD. Multiple resources and performance prediction. Theoretical issues in ergonomics science. 2002;3(2):159–77. doi:https://doi.org/10.1080/14639220210123806.View ArticleGoogle Scholar
- Wickens CD. Multiple resources and mental workload. Human Factors: J Human Factors Ergonom Soc. 2008;50(3):449–55. doi:https://doi.org/10.1518/001872008x288394.View ArticleGoogle Scholar
- Huang H, Wolf SL, He J. Recent developments in biofeedback for neuromotor rehabilitation. J Neuroeng Rehabil. 2006;3:11.View ArticleGoogle Scholar