- Research
- Open Access
Classification of breast tissue in mammograms using efficient coding
- Daniel D Costa^{1}Email author,
- Lúcio F Campos^{1, 2} and
- Allan K Barros^{1}
https://doi.org/10.1186/1475-925X-10-55
© Costa et al; licensee BioMed Central Ltd. 2011
- Received: 27 March 2011
- Accepted: 24 June 2011
- Published: 24 June 2011
Abstract
Background
Female breast cancer is the major cause of death by cancer in western countries. Efforts in Computer Vision have been made in order to improve the diagnostic accuracy by radiologists. Some methods of lesion diagnosis in mammogram images were developed based in the technique of principal component analysis which has been used in efficient coding of signals and 2D Gabor wavelets used for computer vision applications and modeling biological vision.
Methods
In this work, we present a methodology that uses efficient coding along with linear discriminant analysis to distinguish between mass and non-mass from 5090 region of interest from mammograms.
Results
The results show that the best rates of success reached with Gabor wavelets and principal component analysis were 85.28% and 87.28%, respectively. In comparison, the model of efficient coding presented here reached up to 90.07%.
Conclusions
Altogether, the results presented demonstrate that independent component analysis performed successfully the efficient coding in order to discriminate mass from non-mass tissues. In addition, we have observed that LDA with ICA bases showed high predictive performance for some datasets and thus provide significant support for a more detailed clinical investigation.
Keywords
- Principal Component Analysis
- Support Vector Machine
- Linear Discriminant Analysis
- Independent Component Analysis
- Independent Component Analysis
Introduction
Breast cancer is the major cause of death by cancer in the female population [1]. Early detection of breast cancer by mammography may lead to a greater range of treatment options, including less-aggressive surgery and adjuvant therapy [2]. Therefore, a great effort has been made to improve those techniques. Among them, the most used is the mammogram, which is simple, low cost and non-invasive. The sensitivity of mammography ranges from 46% to 88% and depends on factors such as size and location of the lesion, breast tissue density, quality of technical resources and the radiologist's ability of interpretation. The specificity varies between 82% and 99% and it also dependent on the quality of the examination [3]. The low sensitivity means that there is a considerable number of positive cases undetected, preventing early diagnosis and effective treatment.
To decrease the high index of mammogram error, during the last decade the scientific community has come to use image processing and computer-aided diagnosis (CAD) techniques to produce digital mammographies. CAD systems can aid radiologists by providing a second opinion and may be used in the first stage of examination. For this to occur, it is important to develop techniques to detect and recognize suspicious lesions and also to analyze and discriminate them. Regarding this there are some mammogram images mass classification methods in the literature. A mass might be either a benign or malignant tumor, whereas non-masses are exclusively normal tissues. Zhang et al [4] have proposed a neural-genetic algorithm for feature selection in conjunction with neural network based classifier. This methodology reached 87.2% of correct classification for mass cases with different feature subsets.
Wei [5] investigated the feasibility of using multiresolution texture analysis for differentiation of masses from normal breast tissue on mammograms and use texture features based on the wavelet coefficients and variable distances. They reached 89% and 86% of accuracy for the training and test groups, respectively. Jr et al [6] applied semivariogram function to the characterization of breast tissue as malignant or benign in mammographic images with sensitivity in 92.8%, specificity of 83.3% and accuracy above 88.0%. Land et al [7] explored the use of different Support Vector Machines (SVM) kernels and combinations of kernels, to ascertain the diagnostic accuracy of a screen film mammogram data set and improved about 4% the average of sensitivity and 18% the average of specificity, reaching 100% of sensitivity and 98% of specificity. Campos et al [8, 9] used independent component analysis (ICA) and neural network multilayer perceptron to classify mammograms in 3 classes: normal, benign and malignant, obtaining a rate of 97.3% success. Braz et al [10] classified the regions of interest of screening mammogram in mass and non-mass using spatial statistics, and reached accuracy up to 98.36%.
The purpose of this work is to classify a specific region of interest (ROI) as mass or non-mass and compare different methods of efficient coding. This concept has successfully explained the properties of receptive fields in primary visual cortex by deriving efficient codes from the statistics of natural images [11–14]. Today this process can be modeled with ICA, which works with statistics of high order [15].
We organize this work as follows: in section II, we describe the used database, the feature extraction process with efficient coding and the classifier linear discriminant analysis. In section III we show the results obtained using the proposed methodology. Finally, section IV presents some discussions and conclusions.
Materials and methods
Next we used feature extraction techniques, principal components analysis (PCA), Gabor wavelet, and the efficient coding model based in independent component analysis (ICA). In the last step, we used linear discriminant analysis (LDA) to classify these tissues as mass or non-mass. Let us describe in details each step.
Image Acquisition
For the development and evaluation of the proposed methodology, we used a publicly available database of digitized screen- film mammograms: the Digital Database for Screening Mammography DDSM [16].
The DDSM database contains 2620 cases with two default views (medio-lateral oblique and cranio caudal) of both breasts, acquired from Massachusetts General Hospital, Wake Forest University School of Medicine, Sacred Heart Hospital and Washington University in St. Louis School of Medicine. The data comprise patients of different ethnic and racial backgrounds. The DDSM contains descriptions of mammographic lesions in terms of the American College of Radiology breast imaging lexicon called the Breast Imaging Reporting and Data System (BI-RADS). Mammograms in the DDSM database were digitized by different scanners depending on the institutional source of the data and have resolutions between 42 and 50 microns. A subset of DDSM cases was selected for this study. Cases with mass lesions were chosen by selecting reports that only included the BI-RADS descriptors for mass margin and mass shape [17].
Through the coordinates provided by the database, a ROI was selected for each image containing the tissue. In some mammogramms we found more than one mass; in these cases, we extracted more than one ROI. For the normal mammograms were selected ROIs of different sizes and texture randomly. Only the pectoral muscle was not considered as a possible ROI, although tissue and fatty tissue were. All non-mass regions were extracted from cases that did not have a mass region. After that, we applied a histogram equalization, and resized all ROIs to 32 × 32 pixels. For clarity of notation, we represent images as vectors created by concatenating rows of pixels called x.
We selected 5090 regions of interest out of 2620 cases, 3240 of which had a mass and 1850 were normal controls. For a better validation of the samples we used the technique of 10-fold cross validation, i.e., data were randomly divided into 10 subsets, each subset had 324 mass samples and 185 non-mass samples. Then we used 509 samples for testing and 4581 for training. From a set of ten groups created, we selected a group for the test and nine for training, repeating the process until we had used all groups as testing set, always using all other groups for training.
Principal Components Analysis
Principal components analysis (PCA) [18, 19] has long been used in efficient coding of various biological signals, like speech [20], ECG [21] and EEG [22]. PCA is a well-known optimal linear scheme for dimension reduction in data analysis. The central idea of PCA is to reduce the dimensionality of a data set while retaining as much as possible the variance of the data set.
Thus in many applications PCA is used as a pre-processing of data, serving as input for other numerical models. The advantage in this case is to reduce the number of parameters of the model immediately following the PCA, improving performance and saving processing time.
where V is the matrix with eigenvectors. An assumption made for feature extraction and dimensionality reduction by PCA is that most information of the observation vectors is contained in the subspace spanned by the first m principal axes, where m < p for a p-dimensional data space. Therefore, each original data vector can be represented by its principal component vector with dimensionality m.
Where in each column of X^{ T } is a training image of 1024 × 1 pixels and V is a orthogonal matriz 1024 × k, which columns represents a principal components and k is the number of the selected principal components.
Efficient Coding
or equivalently in terms of a basis matrix, x = W^{-1} s = As, where s is an estimation of independent components. Methods for deriving efficient code in the model of the equation 4 falls under the rubric of either sparse coding or independent component analysis (ICA) [25].
Independent Component Analysis
In 5, only the variables x are known, and from them we estimate the coefficients a and the mutually independent components s.
The variance of w _{ i } ^{ T } x must be here constrained to unity; for whitened data this is equivalent to constraining the norm of w _{ i } to be unity [27].
The FastICA was then performed in training set and we obtained 1024 basis functions. To select the most relevant of this basis function we use a similar technique to pursuit, described in the paper by Sousa et. al. [28]. This process consisted of the following steps:
Step 1: Define an empty subspace Ψ;
Step 2: Repeat next step for k = 1, 2, ⋯, n, where n is the dimension of Ψ;
Step 3: Using Eq. 12, classify image projecting into the subspace composed of [Ψ; A _{ k } ], where A _{ k } is the k^{ th } base function of A;
Step 4: Select the base functions according to the better result from classification on the training set;
Step 5: Move A _{ k } from A to Ψ so that n = n - 1;
Step 6: Return to step 2 until Ψ get the desired dimension;
Gabor Wavelet
The Gabor filters are band-pass filters with tuneable orientation and radial frequency bandwidths. The Fourier transform of the Gabor filters are Gaussian shifted in frequency. The Gabor representation is proved to be optimal in the sense of minimizing the joint 2-D uncertainty in space and frequency. The Gabor filter kernels have similar shapes as the receptive fields of simple cells in the primary visual cortex when stimulate by naturals image [11]. They are multi-scale and multiorientation kernels. These filters can be represented as the equation 8
Linear Discriminant Analysis
The problem then is reduce to find a suitable vector β. There are several popular variations of this idea, one of the most successful being the Fisher Linear Discriminant Rule.
where and , and n _{ i } is class i sample size, ∑ _{ i } is class i covariance matrix, x _{ i } is the class i mean sample value and x is the population mean. We use this technique to classify the news test sets . Then for each test set was used corresponding training set, ie, was used to with , with and was used with . Each training and testing group is composed of masses (benign and malignant) and non-masses samples.
We chose the LDA for simplicity of implementation and low computational consumption compared to other classifiers such as support vector machine (SVM). We can see in previous works [30] that the SVM has a rate of accuracy greater than the LDA, but the time taken to determine the best parameters in training is higher than the LDA.
Validation of the Classification Methods
In order to evaluate the classifier with respect to its differentiation ability, we have analyzed its sensitivity, specificity and accuracy. Sensitivity indicates how good the test is to identify the disease and is defined by TP /(TP + FN), specificity indicates how good the test is to identify patients without pathologies and is defined by TN/(TN + FP ), and accuracy is defined by (TP + TN)/(TP + TN + FP + FN), where TP is true-positive, TN is true-negative, FN is false-negative, and FP is false-positive. True-positive means mass samples correctly classified as mass. The meaning of the other ones is analogous.
To determine accuracy, sensitivity and specificity, we used the average of results obtained by 10-fold cross validation.
Results
Discussion and Conclusions
This paper has presented a computer aided diagnosis system based on feature extraction and inspired by the concept of efficient coding, applied to the problem of recognizing breast cancer in ROIs, classifying as mass or non-mass, and in the case of mass further classify as benign or malignant. To perform the classifications we used the Linear Discriminant Analysis.
The improvement using efficient coding is by a few percentage points in sucess rate. Although relatively small, the improvemente is likely to be very valuable, because the occurrence of false negatives (low sensitivity) can lead to human death.
LDA succeeded partially in separating the two classes, but there is still a margin of intersection between them, an area that characterizes the misclassification. In [30] we can see that the hyperplane generated by the Support Vector Machine (SVM) separates these classes better thus providing a better result in the classification. However, the computational cost of the LDA is lower than the SVM, saving time in the operation.
Furthermore this assumption of linearity leads to a limitation of our system, which does not allow us to consider nonlinear structures in feature extraction and classification. In future work we will use nonlinear methods of feature extraction, such as Kernel PCA [31], nonlinear Hidden Markov Models [32] and other statistical models [33, 34] in order to achieve a possible improvement in success rates.
An interesting factor in these results is the fact that the best accuracy is not ways achieved using all the components. We suspect that this happens when we use too much information to classify, creating redundancies and confusing the classifier, consequently decreasing the rate of success. We believe the ideal number of components is between 30 and 50, because tests conducted with more components did not achieve the best results, although still got results around average.
Altogether, the results presented demonstrate that independent component analysis performed successfully the efficient coding in order to discriminate mass from non-mass tissues. In addition, we have observed that LDA with ICA bases showed high predictive performance for some datasets and thus provide significant support for a more detailed clinical investigation.
Declarations
Authors’ Affiliations
References
- Cancer Facts and Figures 2010 [http://www.cancer.org/Research/CancerFactsFigures/CancerFactsFigures/cancer-facts-and-figures-2010]
- Breast cancer facts and figures 2009–2010 [http://www.cancer.org/research/cancerfactsfigures/breastcancerfactsfigures/breast-cancer-facts--figures-2009–2010]
- Institute National of Cancer [http://www.inca.gov.br/]
- Zhang P, Verma B, Kumar K: A neural-genetic algorithm for feature selection and breast abnormality classification in digital mammography. IEEE International Joint Conference on Neural Networks 2004, 3: 2303–2308.Google Scholar
- Wei D, Chan H, Helvie M, Sahiner B, Petrick N, Adler D, Goodsitt M: Classification of mass and normal breast tissue on digital mammograms: Multiresolution texture analysis. Medical Physics 22(9):Google Scholar
- Jr V, Paiva A, Silva A, Oliveira A: Semivariogram applied for classification of benign and malignant tissues in mammography. Lecture Notes in Computer Science 2006, 4142: 570–579. 10.1007/11867661_51View ArticleGoogle Scholar
- Land W Jr, Wong L, McKee D, Embrechts M, Salih R, Anderson F: Applying support vector machines to breast cancer diagnosis using screen film mammogram data. Computer-Based Medical Systems. CBMS 2004. Proceedings. 17th IEEE Symposium 2004, 224–228.View ArticleGoogle Scholar
- Campos LFA, Silva AC, Barros AK: Diagnosis of breast cancer in digital mammograms using independent component analysis and neural networks. Springer Berlin/Heidelberg. Lecture Notes in Computer Science 2005, 3773: 460–469. 10.1007/11578079_48View ArticleGoogle Scholar
- Campos LFA, Silva AC, Barros AK: Independent component analysis and neural networks applied for classification of malign, benign and normal tissue in digital mammography. Fifth International Workshop on Biosignal Interpretation 2005, 1: 85–88.Google Scholar
- Braz G Jr, Silva EC, Paiva AC, Silva AC: Breast tissues classification based on the application of geostatistical features and wavelet transform. International Special Topic Conference on Information Technology Applications in Biomedicine (ITAB'07) 2007, 6: 227–230.Google Scholar
- Olshausen BA, Field DJ: Emergence of simple-cell receptive-field properties by learning a sparse code for natural images. Nature 1996, 381: 607–609. 10.1038/381607a0View ArticleGoogle Scholar
- Bell AJ, Sejnowski TJ: The independent components of natural images are edge filters. Vision Res 1997, 37: 3327–3338. 10.1016/S0042-6989(97)00121-1View ArticleGoogle Scholar
- Van Hateren JH, Ruderman DL: Independent component analysis of natural images sequences yield spatiotemporal filters similar to simple cells in primary visual cortex. Proc R Soc Lond B 1998, 265: 2315–2320. 10.1098/rspb.1998.0577View ArticleGoogle Scholar
- Lewicki MS, Olshausen BA: A probabilistic framework for the adaptation and comparison of image codes. Journal of the Optical Society of America 1999, 16: 1587–1601.View ArticleGoogle Scholar
- Doi E, Inui T, Lee TW, Wachtler T, Sejnowski TJ: Spatio-chromatic receptive field properties derived from information-theoretic analyses of cone mosaic responses to natural scenes. Neural Computation 2003, 15(2):397–417. 10.1162/089976603762552960View ArticleGoogle Scholar
- Heath M, Bowyer K, Kopans D, Kegelmeyer WP, Moore R, Chang K, MunishKumaran S: Current status of the Digital Database for Screening Mammography. Proceedings of the Fourth International Workshop on Digital Mammography 1998, 457–460.View ArticleGoogle Scholar
- Heath M, Bowyer K, Kopans D, Moore R, Kegelmeyer WP: The Digital Database for Screening Mammography. Proceedings of the Fifth International Workshop on Digital Mammography 2001, 212–218.Google Scholar
- Hyvarinen A, Karhunen J, Oja E: Independent Component Analysis. New York: J Wiley; 2001.View ArticleGoogle Scholar
- Jain AK: Fundamentals of Digital Image Processing. New York: Prentice Hall; 1998.Google Scholar
- Zahorian AS, Rothenberg M: Principal-components analysis for low-redundancy encoding of speech spectra. The Journal of the Acoustical Society of America 1981, 69: 832–845. 10.1121/1.385539View ArticleGoogle Scholar
- Castells F, Laguna P, Sörnmo L, Bollmann A, Roig JM: Principal Component Analysis in ECG Signal Processing. EURASIP Journal on Advances in Signal Processing 2007, 21. [Article ID 74580]Google Scholar
- Jin J, Wang X, Wang B: Classification of Direction perception EEG Based on PCA-SVM. Third International Conference on Natural Computation (ICNC'07) 2007 2: 116–120.Google Scholar
- Barros AK, Chichocki A: Neural Coding by Redundancy Reduction and Correlation. Proceedings of the VII Brazilian Symposium on Neural Networks (SBRN 02) 2002.Google Scholar
- Simoncelli EP, Olshausen BA: Neural Coding by Redundancy Reduction and Correlation. Proceedings of the VII Brazilian Symposium on Neural Networks (SBRN 02) 2002.Google Scholar
- Lewicki MS: Efficient Coding of natural sounds. Nature Neuroscience 2002, 5(4):356–363. 10.1038/nn831View ArticleGoogle Scholar
- Hyvarinen A, Oja E: A Fast Fixed-Point Algorithm for Independent Component Analysis. Neural Computation 1999, 9(7):1483–1492.View ArticleGoogle Scholar
- Hyvärinen A, Oja E: Independent Component Analysis: Algorithms and Applications. Neural Networks 2000, 13(4–5):411–430. 10.1016/S0893-6080(00)00026-5View ArticleGoogle Scholar
- Sousa CM, Cavalcante AB, Guilhon D, Barros AK: Image Compression by Redundancy Reduction. Lecture Notes in Computer Science 2007, 4666: 422–429. 10.1007/978-3-540-74494-8_53View ArticleGoogle Scholar
- Lachenbruch PA: Discriminant Analysis. New York: Hafner Press; 1975.Google Scholar
- Costa DD, Campos LFA, Barros AK, Silva AC: Independent Component Analysis in Breast Tissues Mammograms Images Classification Using LDA and SVM. International Special Topic Conference on Information Technology Applications in Biomedicine (ITAB'07) 2007, 6: 231–234.Google Scholar
- Schölkopf B, Smola A, Müller KR: Kernel principal component analysis. Lecture Notes in Computer Science 1997, 1327: 583–588. 10.1007/BFb0020217View ArticleGoogle Scholar
- Wilson AD, Bobick AF: Nonlinear Parametric Hidden Markov Models. Tech rep, IEEE J Robotics and Automation 1997.Google Scholar
- Ghosh AK, Bose S: Feature Extraction for Nonlinear Classification. Lecture Notes in Computer Science 2005, 3776: 170–175. 10.1007/11590316_21View ArticleGoogle Scholar
- Seide F, Mertins A: Non-linear regression based feature extraction for connected-word recognition in noise. Acoustics, Speech, and Signal Processing (ICASSP'94) 1994, 2: 85–88.Google Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.