Skip to main content

sEMG-based automatic characterization of swallowed materials

Abstract

Monitoring of ingestive activities is critically important for managing the health and wellness of individuals with various health conditions, including the elderly, diabetics, and individuals seeking better weight control. Monitoring swallowing events can be an ideal surrogate for developing streamlined methods for effective monitoring and quantification of eating or drinking events. Swallowing is an essential process for maintaining life. This seemingly simple process is the result of coordinated actions of several muscles and nerves in a complex fashion. In this study, we introduce automated methods for the detection and quantification of various eating and drinking activities. Wireless surface electromyography (sEMG) was used to detect chewing and swallowing from sEMG signals obtained from the sternocleidomastoid muscle, in addition to signals obtained from a wrist-mounted IMU sensor. A total of 4675 swallows were collected from 55 participants in the study. Multiple methods were employed to estimate bolus volumes in the case of fluid intake, including regression and classification models. Among the tested models, neural networks-based regression achieved an R2 of 0.88 and a root mean squared error of 0.2 (minimum bolus volume was 10 ml). Convolutional neural networks-based classification (when considering each bolus volume as a separate class) achieved an accuracy of over 99% using random cross-validation and around 66% using cross-subject validation. Multiple classification methods were also used for solid bolus type detection, including SVM and decision trees (DT), which achieved an accuracy above 99% with random validation and above 94% in cross-subject validation. Finally, regression models with both random and cross-subject validation were used for estimating the solid bolus volume with an R2 value that approached 1 and root mean squared error values as low as 0.00037 (minimum solid bolus weight was 3 gm). These reported results lay the foundation for a cost-effective and non-invasive method for monitoring swallowing activities which can be extremely beneficial in managing various chronic health conditions, such as diabetes and obesity.

Background

Swallowing is an essential function in which food and liquids are transferred from the oral cavity to the stomach to provide necessary nutrients vital for human survival. Therefore, monitoring swallowing activities can be considered an ideal surrogate for tracking the ingestive behavior of an individual for purposes of observation, measurement, and control. Swallowing is the result of a well-coordinated, yet complex set of neuromuscular activities that involves more than 30 nerves and muscles [1, 2]. The swallowing process is commonly divided into three phases: oral preparatory phase, pharyngeal phase and esophageal phase. The timing and duration of each of the three phases vary according to multiple factors that include material consistency, bolus volume, age and health condition of the subject [3, 4]. However, of the three phases, the pharyngeal phase is considered the most important as many of the swallowing physiological events such as airway protection and upper esophageal sphincter opening occur in this phase [5, 6].

Automatic tracking of swallowing activities is of special importance to identify and intervene in certain health situations that include eating patterns of the elderly, food consumption disorders in type 1 diabetes, and obesity. According to the United Nations, the world population included more than 700 million persons of age 65 or older in 2019 [7]. As people grow older, they become more vulnerable to a wide variety of diseases such as cognitive, cardiac and metabolic diseases. Studies indicate that a significant number of such diseases are linked to nutrition deficiencies, which include changes in the eating and drinking patterns [8]. Such pattern changes usually have a direct influence on people’s health, especially the elderly. Diabetes is the third most prevalent chronic childhood diseases and is considered a leading cause of retinopathy, nephropathy and cardiovascular diseases later in life [9]. Also, about 40% of the diabetic population are of age 65 or older [9]. Obesity is a complex disorder that involves abnormal body weight for the corresponding height due to excessive amounts of body fat resulting, mostly, from excess calorific intake. Obesity is one of the leading causes of a set of chronic diseases, such as cardiovascular diseases, diabetes, and hypertension [10]. Common management protocols for diabetes and obesity include weight loss through management of calorie intake, being more physically active, and making other changes to routine eating habits. Management of food intake relies mainly on monitoring the acts of swallowing to characterize the amount of food/drink consumed by the subject [3, 11]. While multiple methods have been explored for the automatic characterization of various physical activities, less has been done on developing accurate and inexpensive ways for day-to-day monitoring of ingestive activities [12, 13].

Known methods for the evaluation of the physiology of swallowing include X-ray videofluoroscopy, electromyography (EMG), and more recently cervical auscultation. Videofluoroscopy is a radiographic method that is not available outside custom clinical settings and exposes subjects to radiation [4, 6, 13]. Recent research explored the monitoring of food/drink intake activity through utilizing a variety of sensing modalities associated with sensing specific movements of the head and neck region as well as the hands. For instance, swallowing sounds collected from a throat microphone and conduction microphone placed on the mastoid bone along with a strain sensor have been used for monitoring chewing and swallowing activities and determining the bolus nature being composed of solids or liquids [13, 14]. Other studies have also utilized sensors like accelerometers and strain sensors for monitoring swallowing activities [6, 15,16,17]. Further, with a camera that can be triggered by a set of sensors when food intake is detected, the accuracy of monitoring could be improved by up to 82.7% [18]. Another study used a proximity sensor, IMU and throat microphone to differentiate between daily activities and food intake with accuracy of 97% [19]. Wrist motion tracking was utilized as well to detect periods of eating and drinking to improve accuracy [20, 21].

Monitoring fluid intake via the use of a throat microphone or mechanical sensors was reported but without estimating the fluid intake volume [22]. Another study reported the use of a throat microphone to estimate the fluid intake volume with a reported accuracy of 80% for volumes between 5 and 15 ml per subject [23]. Swallowing and chewing activities along with bolus volume and material consistency were also the subject of another study using a microphone and 2 sEMG channels [24]. The use of sEMG with microphone improved the accuracy from 73 to 84%.

This study introduces a non-invasive swallowing sensing technique that relies on a single-channel sEMG and a wrist-worn IMU sensor to monitor and evaluate the ingestive activities. This study also provides an sEMG-based algorithm to quantify food bolus through using three different food classes and drink sip volumes.

Results

A total of 4675 swallows (2200 water swallows and 2475 solid material swallows) were collected. 335 swallows (200 water swallows and 135 solid material swallows) were then excluded due to low signal quality and noise dominance that occurred during the data collection procedure.

Swallowing signals were collected via two wearable sensors, a mobile BITalino single electrode sEMG and a wrist-mounted IMU (WI) sensor. To guarantee the synchronization of collected signals, the WI and sEMG sensors were started at approximately the same time. Furthermore, the participants were also asked to move the WI sensor close to the sEMG to induce some electrical interference that appears as high-frequency (sudden) change in the sEMG signal. This sudden change was detected and used to perform end-to-end synchronization between the signals from the two sensors prior to analysis by using Memory Based Graph Theoretic technique (MB-GT). This technique is considered a fast adaptive algorithm for abrupt change detection [25]. After detecting and removing the noise window, both WI and sEMG signals were considered in alignment. The full processing chain is shown in Fig. 1. The sEMG signals before and after synchronization are shown in Fig. 2.

Fig. 1
figure 1

A block diagram that shows overview of pipeline for the proposed method. This pipeline includes the process of end-to-end synchronization and fusion between the data from the WI and sEMG sensors

Fig. 2
figure 2

a sEMG with electrical high-frequency interference “red line represents the MB-GT detection window”. b sEMG signal after removing electrical interference

Solids vs water swallows prediction

After signals from WI and sEMG were aligned temporally as described previously, these signals were fused to identify and remove no-activity periods (periods of “no ingestive intake”) as only periods of hand motion in WI signals indicate solid/water intake. We described the solid or liquid intake using the IMU’s X, Y, and Z rotation angles. Prior to the experiments, we verified the subjects’ angles for both eating and drinking. Then, we employed thresholding and decision trees to ascertain the angles for each. There are specific X, Y, and Z rotation angles for every subject in every activity. The majority of subjects use the same angles for each eating or drinking activities, with a difference between the X and Y angles in both activities. The X and Y angles for drinking were located between 300 and 350 and 1 and 60, respectively. Additionally, the X and Y angles for eating were located between 200 and 300 and 90 and 150, respectively. WI was able to use rotation angles to differentiate between solid and water input based on the prior angles. Following temporal alignment with sEMG, the activity times marked in the WI signals were converted to sEMG using the time stamp in WI and frequency in sEMG. An example of signal-fusion outcome is shown in Fig. 3. The red lines represent the onset of ingestive activities. Signal properties of sEMG differ in magnitude and duration according to the underlying activity performed by the subject.

Fig. 3
figure 3

a sEMG and b WI signals fusion to indicate the ingestive activities “the red lines represent the start of ingestive intake”

The muscle activity magnitude (MAM) can be divided into either high MAM or low MAM [26]. Low MAM segments of the sEMG represent swallow events only, which correspond to fluid and saliva swallowing. On the other hand, high MAM segments include biting, chewing, and swallowing events, which correspond to eating activities. The segments of sip–swallow and bite–chew–swallow events were further identified through applying the MB-GT algorithm on sEMG in the duration between each two successive eating/drinking events, as identified by WI. As mentioned previously, MB-GT is an efficient technique for detecting abrupt changes in biosignals [25, 27].

Bolus material type and volume estimation

In high MAM segments, to determine the solid material type and volume we divided the problem into two main steps: (1) classification for identifying the material type and (2) regression for volume quantification. We used two different approaches to implement both steps: starting with classification then doing regression and vice versa, as illustrated in Fig. 4.

Fig. 4
figure 4

A block diagram that shows the two approaches for bolus material type and volume estimation. a First Approach, b Second Approach.

For the classification task that determines the solid material type, our experiment included 3 classes representing different softness levels: Type A, carrot (hard texture); Type B, cheese (intermediate texture); and Type C, banana (soft texture).

Examples of sEMG signals for the three classes are shown in Fig. 5, while examples for signals from different bolus weights for “carrots” are shown in Fig. 6.

Fig. 5
figure 5

EMG signals for the different classes: a carrot, b cheese, and c banana

Fig. 6
figure 6

EMG signals for different carrot bolus sizes: a 9 gm, b 6 gm, and c 3 gm

Forty features calculated in time–frequency domains commonly used with EMG signals in the literature, were chosen for our study [28,29,30] and are shown in Table 1.

Table 1 EMG selected features

The bites data were split into two groups (80–20%): 1872 bites were used for training and 468 bites were used for testing. Since sEMG data usually suffer from inter-subject variability, we used two validation methods.

First, both training and testing data were sampled evenly from all subjects (among-subjects validation or AS) and, second, training and testing data were sampled from different subjects (cross-subject validation or CS). The data splitting process was repeated 5 times until all data points were included at least once in the training and testing process (fivefold cross-validation). K-Nearest Neighbor (KNN) classifier, support vector machine (SVM) and DT were tested as classifiers to determine the bolus class. KNN was configured to use K = 5 and Euclidian distance; while SVM was configured to use C = 1, a Radial Basis Function (RBF) kernel. For DT, entropy was employed as a metric to assess the efficacy of each split, with a stipulation that an internal node must have at least 2 samples to be eligible for splitting. Additionally, the expansion of nodes continued until all leaves became pure.

For the regression task that determines the bolus volume, the bites included three different weights: 3, 6, and 9 g for each type. The material type was known at this stage given that this regression task is performed after the classification task. DT, extra trees (ET), AdaBoost (AB), gradient boosting (GB), eXtreme gradient boosting (XGB), light gradient boosting (LGB), SVM, and Gaussian regressors (GPR) were used and validated in a fivefold cross-validation manner. Further, a two-layer feed-forward neural network was tested with both Levenberg–Marquardt (LM) and Bayesian regularization (BR). The neural network consisted of a hidden layer containing 50 neurons, an output layer with a single linear rectified neuron to represent the regression output, and it underwent 1000 epochs during training.

In this approach, KNN and DT showed the highest accuracies in the AS validation scheme, while SVM showed better performance in the CS validation scheme as shown in Table 2, with sensitivity and specificity values of 92.3 and 96.1%, respectively.

Table 2 Solid material type classification accuracies using different validation schemes

Table 3 depicts the root mean squared error (RMSE) for the regression task that determines the bolus volume. While ET showed the best overall performance for both AS and CS validation in the three material types, most of the tested regression models showed close performances. Table 4 shows the detailed performance measures for ET regression results including the mean absolute error and R2 for each material type. Also Fig. 7 shows the ET regression fitting model.

Table 3 RMSE for bolus volume estimation results in different validation schemes for each class
Table 4 Bolus volume estimation results for the lowest error regression schemes (ET) of each class
Fig. 7
figure 7

ET regression model for Class A

As a second approach, we performed the regression first followed by classification to test the effect of the pre-knowledge of bolus volume/weight on the classification results of the material type. For this purpose, we grouped the results of regression task into 3 groups small volume (< 4.5), intermediate volume (> 4.5 and < 7.5) and large volume (> 7.5). Then followed by bolus type classification for each regression group. Tables 5 and 6 show the results and the top performing models in the regression and classification tasks of the experiments performed in the second approach. We can clearly see the deterioration in the regression error and classification accuracy for this approach compared to the first approach which indicates that the pre-knowledge of the material type is a substantial factor that enhances the quality of bolus volume estimation. Other regression models tested in this approach showed poorer results, therefore they were removed from Table 5.

Table 5 RMSE for bolus volume estimation in different validation schemes for the second approach
Table 6 Bolus material type classification accuracies in different validation schemes for each class in the second approach

Water sip volume estimation

In this part of the study, the goal was to estimate the water sip volumes using low MAM signals via two methods. The first method employed regression approach for a direct estimate of the sip volume using the 40 features described before and the second method utilized a deep convolutional network that used raw sEMG signals to classify sip volume into one of four classes (10, 20, 30, and 40 ml). The deep network (Fig. 8) consisted of 5 1D convolutional layers, each with a kernel size of 5 and a number of output channels of 32, 32, 32, 64, and 64, respectively. Each convolutional layer was followed by batch normalization and 1D maxpooling (of size 1*2). The convolutional network was followed by two dense layers to combine the features and generate the classification output.

Fig. 8
figure 8

Architecture of the convolutional neural network used for water sip volume classification. 5 1D convolutional layers each followed by batch normalization and maxpooling (1*2 on time dimension). The output of the last convolutional layer is then flattened and fed into two dense layers and an output layer to generate the classification result

Table 7 shows the RMSE values for each of the tested regression models in the first approach task for AS and CS validation. We can see that neural networks-based regression with Bayesian regularization gives the best performance among the other regression models, with RMSE values of 0.57 and 4.1 for AS and CS validation scheme, respectively.

Table 7 RMSE for water volume estimation using different regression schemes

In the second approach, the deep network that used raw sEMG signals showed an accuracy of up to 99% while validating AS and 66% while validating CS.

Discussion

We presented a system and processing methods for the detection and quantification of swallowing activities of an individual in a manner that does not require manual logging. The approach used in this study employed a less-controlled environment compared to previous studies [31]. It also provided methods for quantification of ingested solid and fluid materials. These combined abilities bring this research one step closer to achieving an environment where many aspects of the ingestive behavior of an individual can be characterized in the least possible intrusive way. Such a goal can prove invaluable for many clinical and day-to-day living cases, enabling better care for the elderly, diabetics, and those seeking better weight control in a self-guided manner or via the help of medical professionals, to list a few.

To carry out this work, we relied on a single-channel surface electromyography sensor affixed on the sternocleidomastoid muscle in the neck area. We tested various machine learning techniques for binary classification of swallowing vs. non-swallowing and solid vs. fluid intake. The use of sEMG proved valuable in terms of minimum interference and reliability, despite lack of ideal signal-to-noise ratio conditions due to the small size of the target muscle and the limited capabilities of the used device. Nevertheless, the accuracy of swallowing vs. non-swallowing classification was above 99% and the accuracy of solid vs. fluid classification was 96% as shown in this and previous studies [31].

The two main goals of this research, however, were the quantification of solid bolus type and weight and the quantification of the liquid intake volume as one of four pre-selected values. The selection of three solid types was rather intuitive to cover different “softness” levels: soft, medium, and hard. The performance of the solid type classification was above 99.5%, while root mean squared error of quantity estimation of each type from the possible three weight values was 0.00037. This demonstrates that it is possible to use sEMG to estimate the type of ingested solid material and quantify its weight with high accuracy and low RMSE. The achieved accuracies of using classification then regression were low compared to regression then classification as shown in Tables 2 and 6.

For liquid volume estimation, we pre-selected four different volume sizes that lend themselves well to model the lowest and highest sip volume that the subject could swallow at once. The accuracy of this part ranged between 100 and 66% for among and cross-subject validation schemes. The drop in classification/regression performance in the different presented tasks can be accounted for by the widely known high inter-subject variability in sEMG. Therefore, a future direction to boost the cross-subject performance of this platform could be considering different pre-processing strategies of the sEMG signals and using a variety of features to reduce the variability.

The use of the wrist-mounted IMU sensor was another tool that helped reduce the complexity of the problem in terms of demarcation of onset of about-to-eat or about-to-drink moments as a facilitator for data segmentation. The performance of this type of sensors is expected to be moderate to good even in less-controlled environments.

The main limitations of this study are: the limited types and quantities of solids and liquids, short experiment duration and limited number of visits. Hence, future work should include: more types and quantities of solids and liquids, and moving to free-living environments.

Conclusions

The goal of this work was to detect and measure an individual's swallowing behaviors in a way that did not require human logging. Through the wrist angles, the WI was able to successfully identify ingestive intake, whether it was eating or drinking. With an R2 value approaching one and root mean squared error values as low as 0.00037, the system was able to quantify food intake. In the case of fluid consumption, multiple approaches, including regression and classification models, were used to estimate bolus volumes. Among the investigated models, neural networks-based regression had the highest R2 and the lowest root mean squared error (0.2). The employment of a simple EMG-based system and wrist-mounted IMU to monitor ingestive behavior with a simple classification algorithm that can be quickly constructed utilizing modest computing platforms makes practical implementation of this methodology in real life highly feasible.

Methods

Experiment protocol and signal acquisition

This study was approved by the institutional review board of Cairo University and all procedures were performed in accordance with the 1964 Helsinki Declaration and the Nuremberg code of ethics and their later amendments or comparable ethical standards [32]. All participants provided informed written consents prior to enrollment in the study including consent to publish. Fifty-five healthy individuals (25 males, 30 females, age: 23.7 ± 5.7 years, BMI: 26.7 ± 10.83 kg/m2) participated in the experiment.

Participants were deemed eligible based on the following inclusion criteria: no history of medical conditions that affect swallowing and/or food intake. Each participant performed the experiment in a one one-hour session where three activities were investigated: drinking, eating, and talking. Drinking activities included 40 water sips equally split among 4 fixed volumes (10, 20, 30, and 40 ml), for a total volume of one liter per participant. Eating activities included administering 45 boluses equally split among 3 materials: banana, cheese and carrot and 3 weights per each type: 3, 6, and 9 gm. Bolus volume and weight were controlled and verified through using graded cups and a digital kitchen scale prior to starting each experiment session. A total of 4675 swallows (2200 water swallows and 2475 solid material swallows) were collected. 335 swallows (200 water swallows and 135 solid material swallows) were then excluded due to low signal quality and noise dominance that occurred during the data collection procedure.

Swallowing signals were collected via two wearable sensors, a mobile BITalino single electrode sEMG and a wrist-mounted IMU (WI) sensor. The BITalino revolution kit is a Bluetooth compact biosignals platform designed for research purposes (range: up to ~10 m (in line of sight)) [33]. Sampling rate of BITalino was 1000 Hz with Battery 500 mA, 3.7 V, LiPo (rechargeable). The sEMG electrode (Fig. 9) was placed on the left sternocleidomastoid muscle and the signals were acquired using the BITalino open-source software. The left sternocleidomastoid muscle was chosen as it is considered least uncomfortable neck location to place the electrodes during swallowing plus it is proven in previous studies to produce swallowing signals of better quality. An MPU-6050 sensor was used as the IMU module on the wrist (Fig. 9) [34]. The IMU module was used to detect the angle of tilt or inclination along the X, Y, and Z axes of the wrist shown in Fig. 9a. Wrist angles data from the IMU sensor were transferred to an Arduino Nano kit through an I2C interface and then written into an SD card by the Arduino kit. The 3 axes of activities from the WI were sampled at 1 kHz and the periods of ingestive intake were identified through hard-thresholding and decision trees (as shown Fig. 3). At the beginning of each session, and as a calibration step, each subject was asked to eat and drink freely to determine the range of the wrist angles for both eating and drinking activities. A threshold was determined for each axis and a DT was later used to demarcate the periods of activity and the type of activity (eating or drinking) [27].

Fig. 9
figure 9

a Subject wearing system. b Sensors utilized in the study including the WI in a case (the red box on the left) which is attached to the wrist of the subject and sEMG BITalino (on the right)

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author upon reasonable request.

Abbreviations

sEMG:

Surface electromyogram

WI:

A wrist-mounted IMU

MB-GT:

Memory Based Graph Theoretic technique

DT:

Decision tree

ET:

Extra trees

AB:

AdaBoost

GB:

Gradient boosting

XGB:

EXtreme gradient boosting

LGB:

Light gradient boosting

SVM:

Support vector machine

GBR:

Gaussian regressors

NN-LM:

Neural network with Levenberg–Marquardt

NN-BR:

Neural network with Bayesian regularization

RMSE:

Root mean square error

R2 :

Coefficient of determination

References

  1. Miller AJ. The neurobiology of swallowing and dysphagia. Dev Disabil Res Rev. 2008;14:77–86. https://doi.org/10.1002/ddrr.12.

    Article  Google Scholar 

  2. Yu C, Khalifa Y, Sejdic E. 2019. Silent aspiration detection in high resolution cervical auscultations. In: IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), https://doi.org/10.1109/BHI.2019.8834576 (IEEE, 2019).

  3. Matsuo K, Palmer JB. Anatomy and physiology of feeding and swallowing: normal and abnormal. Phys Med Rehabil Clin North Am. 2008;19:691–707. https://doi.org/10.1016/j.pmr.2008.06.001.

    Article  Google Scholar 

  4. Khalifa Y, Donohue C, Coyle JL, Sejdic´ E. Upper esophageal sphincter opening segmentation with convolutional recurrent neural networks in high resolution cervical auscultation. IEEE J Biomed Health Inform. 2020. https://doi.org/10.1109/JBHI.2020.3000057.

    Article  Google Scholar 

  5. Panara K, Ramezanpour Ahangar E, Padalia D. Physiology, Swallowing. [Updated 2023 Jul 24]. In: StatPearls [Internet]. Treasure Island (FL): StatPearls Publishing; 2024. https://www.ncbi.nlm.nih.gov/books/NBK541071/

  6. Khalifa Y, Coyle JL, Sejdic E. Non-invasive identification of swallows via deep learning in high resolution cervical auscultation recordings. Sci Rep. 2020;10:1–13. https://doi.org/10.1038/s41598-020-65492-1.

    Article  Google Scholar 

  7. United Nations. 2019. World Population Ageing 2019 Highlights

  8. Morley JE, Silver AJ. Nutritional issues in nursing home care. Ann Intern Med. 1995;123:850–9. https://doi.org/10.7326/0003-4819-123-11-199512010-00008.

    Article  Google Scholar 

  9. Cowie C C Diabetes in America. National Institute of Diabetes and Digestive and Kidney Diseases (US), (2018).

  10. Powell-Wiley TM, Powell-Wiley TM, Poirier P, Burke LE, Després J-P, Gordon-Larsen P, Lavie CJ, Lear SA, Ndumele CE, Neeland IJ, Sanders P, St-Onge M-P. Obesity and cardiovascular disease: a scientific statement from the American heart association. Circulation. 2021;143:e984–1010. https://doi.org/10.1161/CIR.0000000000000973.

    Article  Google Scholar 

  11. Chang T, Ravi N, Plegue MA, Sonneville KR, Davis MM. Inadequate hydration, bmi, and obesity among us adults: Nhanes 2009–2012. Ann Fam Med. 2016;14:320–4. https://doi.org/10.1370/afm.1951.

    Article  Google Scholar 

  12. Water DL. Estimating human energy expenditure. Sports Med. 2003;33:683–98.

    Article  Google Scholar 

  13. Sazonov ES, Oleksandr M, Stephanie S, Paulo L-M, Edward LM, Michael RN. Automatic detection of swallowing events by acoustical means for applications of monitoring of ingestive behavior. IEEE Trans Biomed Eng. 2009;57:626–33. https://doi.org/10.1109/TBME.2009.2033037.

    Article  Google Scholar 

  14. Sazonov ES, Oleksandr M, Stephanie S, Paulo L-M, Edward LM, Michael RN. Toward objective monitoring of ingestive behavior in free-living population. Obesity. 2009;17:1971–5. https://doi.org/10.1038/oby.2009.153.

    Article  Google Scholar 

  15. Aboofazeli, M. & Moussavi, Z. Automated classification of swallowing and breadth sounds. In The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol. 2, 3816–3819, DOI: https://doi.org/10.1109/IEMBS.2004.1404069 (2004).

  16. Aboofazeli, M. & Moussavi, Z. Automated extraction of swallowing sounds using a wavelet-based filter. In 2006 International Conference of the IEEE Engineering in Medicine and Biology Society, 5607–5610, DOI: https://doi.org/10.1109/IEMBS. 2006.259353 (2006).

  17. Sejdic E, Malandraki GA, Coyle JL. Computational deglutition: using signal- and image-processing methods to understand swallowing and associated disorders [life sciences]. IEEE Signal Process Mag. 2019;36:138–46. https://doi.org/10.1109/MSP.2018.2875863.

    Article  Google Scholar 

  18. Doulah A, Ghosh T, Hossain D, Imtiaz MH, Sazonov E. Automatic ingestion monitor version 2—a novel wearable device for automatic food intake detection and passive capture of food images. IEEE J Biomed Heal Inform. 2020;25:568–76. https://doi.org/10.1109/JBHI.2020.2995473.

    Article  Google Scholar 

  19. Bedri A, Li R, Haynes M, Kosaraju RP, Grover I, Prioleau T, Beh MY, Goel M, Starner T, Abowd G. Earbit: using wearable sensors to detect eating episodes in unconstrained environments. Proc ACM Interact Mob Wearable Ubiquitous Technol. 2017;1:1–20. https://doi.org/10.1145/3130902.

    Article  Google Scholar 

  20. Sharma, S., Jasper, P., Muth, E. & Hoover, A. Automatic detection of periods of eating using wrist motion tracking. In 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE), 362–363, DOI: https://doi.org/10.1109/CHASE.2016.15 (IEEE, 2016).

  21. Dong Y, Hoover A, Scisco J, Muth E. A new method for measuring meal intake in humans via automated wrist motion tracking. Appl Psychophysiol Biofeedback. 2012;37:205–15. https://doi.org/10.1007/s10484-012-9194-1.

    Article  Google Scholar 

  22. Nakato H, Imura M, Yoshimoto S, Oshiro O. Estimation system of water intake by swallowing sound analysis. Biomed Eng. 2015;53:76–83. https://doi.org/10.11239/jsmbe.53.76.

    Article  Google Scholar 

  23. Kobayashi, Y. & Mineno, H. Fluid intake recognition for nursing care support by leveraging swallowing sound. In 2014 IEEE 3rd Global Conference on Consumer Electronics (GCCE), 620–621, DOI: https://doi.org/10.1109/GCCE.2014.7031280 (IEEE, 2014).

  24. Amft O, Troster G. Methods for detection and classification of normal swallowing from muscle activation and sound. In: Chachques JC, Varshney U, editors. 2006 Pervasive health conference and workshops. IEEE: Piscataway; 2006. p. 1–10.

    Google Scholar 

  25. Nikovski D, Jain A. Fast adaptive algorithms for abrupt change detection. Mach Learn. 2010;79:283–306. https://doi.org/10.1007/s10994-009-5122-x.

    Article  MathSciNet  Google Scholar 

  26. Hassan, E. A., Elbially, M. S. & Morsy, A. A. Monitoring and evaluation of ingestive activities. In 2018 IEEE EMBS International Conference on Biomedical Health Informatics (BHI), 21–24, DOI: https://doi.org/10.1109/BHI.2018.8333360 (2018).

  27. Zhang SM Jr, Xiao W, Tham CK. Detection of activities by wireless sensors for daily life surveillance: eating and drinking. Sensors. 2009;9:1499–517. https://doi.org/10.3390/s90301499.

    Article  Google Scholar 

  28. Too J, Rahim A, Mohd N. Classification of hand movements based on discrete wavelet transform and enhanced feature extraction. Int J Adv Comput Sci Appl. 2019. https://doi.org/10.1456/ijacsa.2019.0100612.

    Article  Google Scholar 

  29. Too J, Abdullah A, Saad NM, Tee W. EMG feature selection and classification using a pbest-guide binary particle swarm optimization. Computation. 2019;7:12. https://doi.org/10.3390/computation7010012.

    Article  Google Scholar 

  30. Spiewak C, Islam MR, Assad-Uz-Zaman M, Rahman M. A comprehensive study on emg feature extraction and classifiers. Open Access J Biomed Eng Appl. 2018. https://doi.org/10.3247/OAJBEB.2018.01.000104.

    Article  Google Scholar 

  31. Hassan, E. A. & Morsy, A. A. Automatic estimation of fluid volume intake. In Arai, K. (ed.) Intelligent Systems and Applications - Proceedings of the 2021 Intelligent Systems Conference, IntelliSys 2021, Amsterdam, The Netherlands, 2–3 September, 2021, Volume 3, vol. 296 of Lecture Notes in Networks and Systems, 536–548, DOI: https://doi.org/10.1007/978-3-030-82199-9_35 (Springer, 2021).

  32. The Nuremberg code. BMJ 313, 1448, DOI: https://doi.org/10.1136/bmj.313.7070.1448 (1996). https://www.bmj.com/content/313/7070/ 1448.1.

  33. Batista D, da Plácido Silva H, Fred A, Moreira C, Reis M, Ferreira HA. Benchmarking of the BITalino biomedical toolkit against an established gold standard. Healthc Technol Lett. 2019;6(2):32–6. https://doi.org/10.1049/htl.2018.5037.

    Article  Google Scholar 

  34. Jian, Huang. (2017). Design of Angle Detection System Based on MPU6050. doi: https://doi.org/10.2991/icemc-17.2017.2.

Download references

Acknowledgements

Not applicable.

Funding

Open access funding provided by The Science, Technology & Innovation Funding Authority (STDF) in cooperation with The Egyptian Knowledge Bank (EKB). The authors did not receive support from any organization for submitted work.

Author information

Authors and Affiliations

Authors

Contributions

AM proposed the topic. EH set the experiments. YK and EH established the models. EH prepared the data. YK and EH tested the machine learning models. AM, YK, and EH contributed to the writing of the manuscript. All authors have read and approved the manuscript.

Corresponding author

Correspondence to Eman A. Hassan.

Ethics declarations

Ethics approval and consent to participate

This study was reviewed and approved by the Institutional Review Board of Biomedical Engineering Department, Cairo University, date 1/9/2020. The participants provided written consent.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hassan, E.A., Khalifa, Y. & Morsy, A.A. sEMG-based automatic characterization of swallowed materials. BioMed Eng OnLine 23, 48 (2024). https://doi.org/10.1186/s12938-024-01241-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12938-024-01241-z

Keywords