Robust spectral analysis of videocapsule images acquired from celiac disease patients
© Ciaccio et al; licensee BioMed Central Ltd. 2011
Received: 24 May 2011
Accepted: 9 September 2011
Published: 9 September 2011
Dominant frequency (DF) analysis of videocapsule endoscopy images is a new method to detect small intestinal periodicities that may result from mechanical rhythms such as peristalsis. Longer periodicity is related to greater image texture at areas of villous atrophy in celiac disease. However, extraneous features and spatiotemporal phase shift may mask DF rhythms.
The robustness of Fourier and ensemble averaging spectral analysis to compute DF was tested. Videocapsule images from the distal duodenum of 11 celiac patients (frame rate 2/s and pixel resolution 576 × 576) were analyzed. For patients 1, 2, ... 11, respectively, a total of 10, 11, ..., 20 sequential images were extracted from a randomly selected time epoch. Each image sequence was artificially repeated to 200 frames, simulating periodicities of 0.2, 0.18, ..., 0.1Hz, respectively. Random white noise at four different levels, spatiotemporal phase shift, and frames with air bubbles were added. Power spectra were constructed pixel-wise over 200 frames, and an average spectrum was computed from the 576 × 576 individual spectra. The largest spectral peak in the average spectrum was the estimated DF. Error was defined as the absolute difference between actual DF and estimated DF.
For Fourier analysis, the mean absolute error between estimated and actual DF was 0.032 ± 0.052Hz. Error increased with greater degree of random noise imposed. In contrast, all ensemble average estimates precisely predicted the simulated DF.
The ensemble average DF estimate of videocapsule images with simulated periodicity is robust to noise and spatiotemporal phase shift as compared with Fourier analysis. Accurate estimation of DF eliminates the need to impose complex masking, extraction, and/or corrective preprocessing measures.
Celiac disease is an autoimmune disease which often manifests as villous atrophy in the small intestinal lining or mucosa [1–3]. The result can be fissuring and mosaic pattern of the mucosal surface and scalloped appearance of the small intestinal mucosal folds, which result in textural changes that are often visually evident in the acquired videocapsule images. During quantitative analysis, extraneous features including air bubbles and opaque fluids in the small intestinal lumen, as well as random imaging noise, are ubiquitous in videocapsule data [4–6]. These distorting factors can in part be remediated by their delineation followed by masking or extraction; however such systems can be complex, computationally unwieldy, and their sensitivity is somewhat modest . Gastrointestinal motility can be altered in untreated celiac disease [1–3], suggesting the possibility that the frequency content of frame-to-frame changes in videocapsule image texture might vary in these patients. Longer periodicity in the frequency spectra would possibly be indicative of slower motility, while shorter periodicity may suggest faster motility . To validate such measurements, it should be determined whether known, periodic changes in videocapsule image frames, in the presence of image degradation, can be detected using methods of spectral analysis.
The dominant frequency (DF) is useful to estimate the electrical activation rate of excitable media [9, 10]. It is defined as the fundamental frequency with greatest spectral power in the physiologic range of interest. The standard method for detecting the DF includes a preprocessing step in which the signal is bandpass filtered, followed by signal rectification, and finally by low pass filtering. However, this manipulation distorts the signal and can cause error in DF estimation [11–13]. Furthermore, it is not very robust to phase and random noise [14, 15]. Optimization of filter parameters can improve DF estimation by enabling more spectral power associated with periodic components to pass through the filter . Alternatively, a new method based on ensemble averaging can be utilized to estimate DF [14, 15]. This new method does not distort the signal prior to quantitation, because preprocessing measures are not imposed.
In this study, spectral analysis of videocapsule image series was used to determine whether synthesized periodicity could be accurately detected in the presence of phase and random noise, and when extraneous features are imposed. Validation would suggest that spectral analysis of videocapsule image series can be used to detect repetitive patterns in gastrointestinal motility that are potentially important to diagnosis and treatment of celiac disease and other gastrointestinal diseases associated with small intestinal lesions.
A. Clinical Procedure and Data Acquisition
All patients were evaluated at Columbia University Medical Center, New York, from May 1, 2008 to July 31, 2009. Retrospective videocapsule endoscopy data was obtained from 11 celiac patients on a regular diet or within a few weeks of starting a gluten-free diet. In these patients the diagnostic biopsy, taken while on a regular diet, showed Marsh grade II-IIIC lesions. Informed consent was obtained prior to videocapsule endoscopy. Indications for this procedure included suspected celiac disease or Crohn's disease, iron deficiency anemia, obscure bleeding, and chronic diarrhea. All patients had serology- proven and biopsy-proven celiac disease. These patients were subsequently evaluated by videocapsule endoscopy because they were considered to have complicated disease with symptoms such as abdominal pain unexplained by previous evaluation. Excluded were patients under 18 years of age, those with a history of or suspected small bowel obstruction, dysphagia, presence of pacemaker or other electromedical implants, previous gastric or bowel surgery, serum IgA deficiency, pregnancy, and nonsteroidal anti-inflammatory drug (NSAID) use during the previous month. Only complete videocapsule endoscopy studies, reaching the colon, were used for analysis. The retrospective analysis of videocapsule endoscopy data was approved by the Internal Review Board at Columbia University Medical Center.
The PillCamSB2 videocapsule (Given Imaging, Yoqneam, Israel) was utilized to obtain the small bowel images in the study groups . The system consists of a recorder unit with cradle and harness, battery pack and charger, antenna lead set, and real-time viewer. The capsule acquires two digital image frames per second and is a single-use pill-sized device . For each patient undergoing the procedure, abdominal leads were placed on the upper, mid, and lower abdomen, and a belt containing the data recorder and battery pack was strapped about the waist. All subjects swallowed the videocapsule with radio transmitter in the early morning with approximately 0.2 liters of water after a nighttime fast without bowel preparation. Subjects were allowed to drink water 2 hours after ingesting the capsule, and to eat a light meal after 4 hours. The recorder received the radioed images that were transmitted by the videocapsule as it passed through the gastrointestinal tract. The capsule reached the cecum in all participants from which retrospective data was used in this study. The belt data recorder was then removed, and the data was downloaded to a HIPAA-compliant PC-based computer console with proprietary software. Videos were reviewed and interpreted by three experienced gastroenterologists. Videoclips to be used for further quantitative analysis were then exported to external media without patient identifiers. The videoclips were 200 frames each and were acquired from the distal duodenum.
B. Creation of Synthetic Sequences for Analysis
Simulated Periodicity from Patient Data
# frames w
C. Synthetic Sequence Degradation
Each of the synthetic image sequences was corrupted using the following techniques:
where phase shifts of one or two images occurred during periods 1-3, 5-8, and 11-14 in Eq. 4.
where each matrix N is a random noise frame different from all other noise frames.
where frames B containing extraneous air bubbles are substituted at random into the 200 frame sequence.
Frequency spectra were calculated for each 200 frame sequence using the methods of sequence degradation as listed above. The four different levels of random white noise frames were added in separate trials.
D. Spectral Analysis
where 2./s is the frame rate, the units of DF are Hz, and the units of DP are seconds.
All calculations were done on a PC-type laptop computer using the Intel Visual Fortran Compiler 9.0 Build Environment for 32-bit applications (Intel Corporation, Santa Clara, California, 2005). For Fourier spectral calculation, the 200 point data array was first smoothed using a Hann window. The windowed data was then padded with zeros to form an array 1024 points to achieve a final resolution of 2./1024 = 0.002Hz. The Fast Fourier Transform (FFT) was computed using subroutine 'four1' provided by Numerical Recipes in Fortran 77 , and the power spectrum was generated from the magnitude of the real and imaginary parts of the FFT components, and plotted versus frequency. This radix-2 implementation, which is applicable to real data arrays of length 2N, is widely used in the literature, although it is not the most efficient FFT code . In a previous gastrointestinal study, the DP has been observed in the range 1-20 seconds . Thus for Fourier analysis, the spectral range to detect the DF/DP was selected as 0.05Hz (period = 20 seconds) to 0.67 Hz (period ~ 1 second). This implementation did not include preprocessing by bandpass filtering, lowpass filtering, and rectification.
The average power P(w) is then multiplied by √n and plotted versus frequency f, as given in Eq. 2. The √n term is a function of w and is computed using Eq. 1. It partially levels the spectral baseline by accounting for the falloff in random noise power as the number of summations n increases. Lastly, linear regression was used to further level the spectral baseline. The DF was selected as the tallest peak in the range 0.05 - 0.67Hz for both Fourier and ensemble power spectra.
A. Effect of Spatiotemporal Phase Shift and Random White Noise on Image Series
B. Summary Statistics
Summary Statistics of DF Measurement
X = 0
X = 50
X = 100
X = 150
0.178 ± 0.006
0.200 ± 0.0
0.176 ± 0.006
0.180 ± 0.0
0.173 ± 0.005
0.167 ± 0.0
0.172 ± 0.003
0.154 ± 0.0
0.266 ± 0.000
0.143 ± 0.0
0.259 ± 0.012
0.133 ± 0.0
0.128 ± 0.006
0.125 ± 0.0
0.122 ± 0.003
0.118 ± 0.0
0.113 ± 0.005
0.111 ± 0.0
0.145 ± 0.040
0.105 ± 0.0
0.101 ± 0.008
0.100 ± 0.0
In this study, pixel-by-pixel spectral analysis was introduced for videocapsule image quantification of the small intestine. It was shown that when spatiotemporal phase noise, random white noise, and air bubbles are imposed on videocapsule series acquired from the distal duodenum of celiac patients (Figures 1 and 4), spectral analysis using the ensemble averaging method was useful to detect the dominant frequency (Figures 3 and 6). In contrast, the Fourier method suffered from split peaks (Figures 2A, B, and 2C and 5A, B and 5C) as well as a diminishment of peak height to levels encroaching the noise floor (Figures 2D and 5D). These simulations suggest that the ensemble averaging approach can detect actual periodicities in videocapsule image series more robustly as compared with the Fourier method, thus reducing the need for complex masking, extraction, and/or corrective preprocessing measures. Since prior results suggest a relationship between long periodicity and regions of villous atrophy , accurate measurement of the dominant periodicity will be important in future efforts to correlate these parameters to location in the small intestine, and to determine their actual relationship to small intestinal motility.
B. Analysis of Videocapsule Endoscopy Images
Endoscopy of the small intestine is used for detecting villous atrophy, a common manifestation of untreated celiac disease, which is confirmed by analysis of biopsy specimens acquired during the procedure . Currently, the only treatment for celiac disease patients that can restore the intestinal villi to the healthy state and also eliminate systemic symptoms is a lifelong gluten-free diet [2, 20]. Yet, months on the diet are needed to completely restore the villi, and in some patients only partial restoration occurs, or there may be no restoration at all. In a prior quantitative study in which villous atrophy was detected, duodenal features were classified using Fourier filters and magnifying endoscopic images . The method is useful for quantitation except in regions lacking visible change where villous atrophy is still present. Our group has investigated textural properties of images from the small intestinal mucosa in celiac disease . The variation in grayscale brightness can be used as an estimate of texture. It was found over 200 image sequences that celiacs had significantly greater texture even in distal portions of the small intestine (jejunum and ileum) as compared with controls. This suggests the possibility that villous atrophy is widespread in the intestinal lumen in untreated celiac patients, but may be below threshold for visual detection. More recently, frequency analysis was proposed to detect periodic oscillations in frame-to-frame brightness variation that may be related to small intestinal motility . However ambient conditions such as camera angle and illumination may have affected the measurements, since average image brightness level, rather than a pixel-by-pixel analysis, was used to generate the frequency spectrum . By using pixel-level detail to generate spectra, as in the present study, robustness to extraneous influences is likely enhanced, because periodically occurring image features that are spatially related are not masked by the averaging process.
Although our studies thus far have been limited, for simplicity, to converting color videocapsule images to 256-level grayscale for quantitative analysis, abnormal patterns can also be detected in color space using nonlinear methods . It was shown that the green component of RGB color contains much of the detail for detection of small intestinal lesions of the mucosa. Use of a specific color (green, red, or blue) rather than grayscale may therefore be efficacious to improve detection of periodicities with our algorithm, the subject of future work. This study was a first step toward the ultimate goal of the development of computerized quantitative videocapsule analysis that will be used in real time. To meet this goal, any quantitative algorithm must be loaded to a dedicated computer console where videocapsule clips are displayed for analysis by the gastroenterologist. The output would be a frequency spectrum that would be updated in real time with the dominant frequency and period also shown numerically on the graph. A program such as Live Graph (Version 1.1, 2008), which is a real-time data graph plotter, should be useful for this purpose as subsequent versions of our algorithm are developed.
C. Motility Measurement in Videocapsule Endoscopy
Although videocapsule endoscopy has been commercially available for approximately 10 years, and devices are obtainable from different manufacturers [16, 24], the approach is currently used by gastroenterologists as a qualitative assist device when assessing the extent and severity of villous atrophy in celiac patients [25–27]. Gastrointestinal motility is likely altered in untreated celiac disease due to mucosal injury, but this is currently gauged by indirect means i.e., by measuring the transit time from proximal to distal small intestine [1, 2]. Other groups have detected specific patterns in videocapsule images and used supervised learning methods to assess intestinal motility and dysfunction in motility [28, 29]. In a prior study, correlation between transit time and DP has been shown . Yet, to show that these measurements are actually related to gastrointestinal motility will require external imaging of the small intestine during videocapsule transit, or alternatively, locational information can be provided by a transponder embedded in the videocapsule. Initial investigation of this relationship can be done using an animal model.
A limited number of videocapsule series was used to test the methods. Verification should be done in a larger cohort. The methodology supposes, to a first approximation, that camera angle and distance to the mucosal surface is uniform, and that coverage of the surface area of the small intestinal lumen is relatively constant during transit of the videocapsule. However, significant variation in these parameters during capsule transit will likely occur, a limitation of the study.
In this study it was shown that periodicity in the range 0.1 - 0.2 Hz in videocapsule image sequences can be identified by ensemble averaging spectral analysis even when high levels of random noise, spatiotemporal phase shift, and air bubbles are present. The data was analyzed by constructing a power spectrum for each pixel location over 200 image frames, and averaging, so that repeating spatiotemporal patterns could be identified. By comparison, Fourier power spectra of the same data contained split and missing frequency components, with inaccuracies in DF estimation averaging over 20%. Use of the ensemble method and pixel-level analysis can therefore potentially reduce or eliminate the need to impose complex masking, extraction, or corrective preprocessing measures prior to DF calculation. In future manifestations of the algorithm, we will test the hypothesis that abnormal dominant periodicity as measured from videocapsule image sequences is correlated to motility disorder and to the presence of villous atrophy in celiac patients.
The implementation of this study was made possible in part with a grant from the Celiac Sprue Association Peer Review Research Grant Program.
- Green PH: Mortality in celiac disease, intestinal inflammation, and gluten sensitivity. JAMA 2009, 302: 1225–1226. 10.1001/jama.2009.1366View ArticleGoogle Scholar
- Tennyson CA, Lewis SK, Green PH: New and developing therapies for celiac disease. Therap Adv Gastroenterol 2009, 2: 303–309. 10.1177/1756283X09342759View ArticleGoogle Scholar
- Ludvigsson JF, Green PH: Clinical management of coeliac disease. J Intern Med 2011, 269(6):560–571. 10.1111/j.1365-2796.2011.02379.xView ArticleGoogle Scholar
- Rey JF, Repici A, Kuznetsov K, Boyko V, Aabakken L: Optimal preparation for small bowel examinations with video capsule endoscopy. Dig Liver Dis 2009, 41: 486–493. 10.1016/j.dld.2008.09.016View ArticleGoogle Scholar
- Triantafyllou K: Can we improve the diagnostic yield of small bowel video-capsule endoscopy? World J Gastrointest Endosc 2010, 2: 143–146. 10.4240/wjgs.v2.i4.143View ArticleGoogle Scholar
- Vilarino F, Spyridonos P, Pujol O, Vitria J, Radeva P, DeIorio F: Automatic Detection of Intestinal Juices in Wireless Capsule Video Endoscopy. In Pattern Recognition 2006. Volume 4. 18th International Conference, Hong Kong; FCPR; 2006:719–722.Google Scholar
- Vilarino F, Spyridonos P, DeIorio F, Vitria J, Azpiroz F, Radeva P: Intestinal motility assessment with video capsule endoscopy: automatic annotation of phasic intestinal contractions. IEEE Trans Med Imaging 2010, (29):246–259.Google Scholar
- Ciaccio EJ, Tennyson CA, Lewis SK, Krishnareddy S, Bhagat G, Green PHR: Distinguishing patients with celiac disease by quantitative analysis of videocapsule endoscopy images. Comput Methods Programs Biomed 2010, 100(1):39–48. 10.1016/j.cmpb.2010.02.005View ArticleGoogle Scholar
- Botteron GW, Smith JM: A technique for measurement of the extent of spatial organization of atrial activation during atrial fibrillation in the intact human heart. IEEE Trans Biomed Eng 1995, 42: 579–586. 10.1109/10.387197View ArticleGoogle Scholar
- Botteron GW, Smith JM: Quantitative assessment of the spatial organization of atrial fibrillation in the intact human heart. Circulation 1996, 93: 513–518.View ArticleGoogle Scholar
- Fischer G, Stühlinger MC, Nowak CN, Wieser L, Tilg B, Hintringer F: On computing dominant frequency from bipolar intracardiac electrograms. IEEE Trans Biomed Eng 2007, 54: 165–169.View ArticleGoogle Scholar
- Ng J, Kadish AH, Goldberger JJ: Effect of electrogram characteristics on the relationship of dominant frequency to atrial activation rate in atrial fibrillation. Heart Rhythm 2006, 3: 1295–1305. 10.1016/j.hrthm.2006.07.027View ArticleGoogle Scholar
- Ng J, Kadish AH, Goldberger JJ: Technical considerations for dominant frequency analysis. J Cardiovasc Electrophysiol 2007, 18: 757–764. 10.1111/j.1540-8167.2007.00810.xView ArticleGoogle Scholar
- Ciaccio EJ, Biviano AB, Whang W, Wit AL, Garan H, Coromilas J: New methods for estimating local electrical activation rate during atrial fibrillation. Heart Rhythm 2009, 6: 21–32. 10.1016/j.hrthm.2008.10.016View ArticleGoogle Scholar
- Ciaccio EJ, Biviano AB, Whang W, Wit AL, Coromilas J, Garan H: Optimized measurement of activation rate at left atrial sites with complex fractionated electrograms during atrial fibrillation. J Cardiovasc Electrophysiol 2010, 21: 133–143. 10.1111/j.1540-8167.2009.01595.xView ArticleGoogle Scholar
- Metzger YC, Adler SN, Shitrit AB, Koslowsky B, Bjarnason I: Comparison of a new PillCam™ SB2 video capsule versus the standard PillCam™ SB for detection of small bowel disease. Reports in Medical Imaging 2009, 2: 7–11.Google Scholar
- Ciaccio EJ, Biviano AB, Whang W, Coromilas J, Garan H: A new transform for the analysis of complex fractionated atrial electrograms. Biomed Eng Online 2011, 10: 35. 10.1186/1475-925X-10-35View ArticleGoogle Scholar
- Press WH, Flannery BP, Teukolsky SA, Vetterling WT: Numerical Recipes in C: The Art of Scientific Computing. 2nd edition. New York, NY: Cambridge Univ. Press; 1992:501–502.Google Scholar
- Frigo M, Johnson SG: The design and implementation of FFTW3. Proc IEEE 2005, 93: 216–231.View ArticleGoogle Scholar
- Green PH: Celiac disease: how many biopsies for diagnosis? Gastrointest Endosc 2008, 67: 1088–1090. 10.1016/j.gie.2007.12.035View ArticleGoogle Scholar
- Vécsei A, Fuhrmann T, Liedlgruber M, Brunauer L, Payer H, Uhl A: Automated classification of duodenal imagery in celiac disease using evolved Fourier feature vectors. Comput Methods Programs Biomed 2009, 95(2 Suppl):S68-S78.View ArticleGoogle Scholar
- Ciaccio EJ, Tennyson CA, Bhagat G, Lewis SK, Green PH: Classification of videocapsule endoscopy image patterns: comparative analysis between patients with celiac disease and normal individuals. BioMed Eng OnLine 2010, 9: 44–55. 10.1186/1475-925X-9-44View ArticleGoogle Scholar
- Charisis V, Hadjileontiadis LJ, Liatsos CN, Mavrogiannis CC, Sergiadis GD: Abnormal pattern detection in wireless capsule endoscopy images using nonlinear analysis in RGB color space. In Conf Proc IEEE Eng Med Biol Soc. Volume 1. Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE Aug. 31 2010-Sept. 4 2010 Buenos Aires; 2010:3674–3677.Google Scholar
- Gheorghe C, Iacob R, Bancila I: Olympus capsule endoscopy for small bowel examination. J Gastrointestin Liver Dis 2007, 16: 309–313.Google Scholar
- Culliford A, Daly J, Diamond B, Rubin M, Green PH: The value of wireless capsule endoscopy in patients with complicated celiac disease. Gastrointest Endosc 2005, 62: 55–61. 10.1016/S0016-5107(05)01566-XView ArticleGoogle Scholar
- Green PH, Rubin M: Capsule endoscopy in celiac disease. Gastrointest Endosc 2005, 62: 797–799. 10.1016/j.gie.2005.07.034View ArticleGoogle Scholar
- Green PH, Rubin M: Capsule endoscopy in celiac disease: diagnosis and management (Review). Gastrointest Endosc Clin N Am 2006, 16: 307–316. 10.1016/j.giec.2006.03.003View ArticleGoogle Scholar
- Seguí S, Igual L, Radeva P, Malagelada C, Azpiroz F, Vitrià J: A semi-supervised learning method for motility disease diagnostic. Progress in Pattern Recognition, Image Analysis and Applications Lecture Notes in Computer Science 2007, 4756: 773–782.View ArticleGoogle Scholar
- Seguí S, Igual L, Vilariño F, Radeva P, Malagelada C, Azpiroz F, Vitrià J: Diagnostic system for intestinal motility disfunctions using video capsule endoscopy. Computer Vision Systems Lecture Notes in Computer Science 2008, 5008: 251–260. 10.1007/978-3-540-79547-6_24View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.