close
Skip to main content
Log in

Detection of Brain Tumor based on Features Fusion and Machine Learning

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Automated detection of brain tumor is a more challenging work due to the variability and complexity of shape, size, texture and location of lesions. The non-invasive MRI methods appear as a front line brain tumor detection tools (without ionization radiation). In this manuscript, an unsupervised clustering approach for tumor segmentation is proposed. Moreover, a fused feature vector is used which is a mixture of Gabor wavelet features (GWF), histograms of oriented gradient (HOG), local binary pattern (LBP) and segmentation based fractal texture analysis (SFTA) features. Random forest (RF) classifier is applied for classification between three sub tumoral regions such as complete, enhancing and non-enhancing tumor. To avoid over fitting problem, fivefold and 0.5 holdout cross-validation approaches are used. The promising detection efficiency depicts the dominance of proposed approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+
from $39.99 /Month
  • Starting from 10 chapters or articles per month
  • Access and download chapters and articles from more than 300k books and 2,500 journals
  • Cancel anytime
View plans

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  • Abbasi S, Tajeripour F (2017) Detection of brain tumor in 3D MRI images using local binary patterns and histogram orientation gradient. Neurocomputing 219:526–535

    Article  Google Scholar 

  • Akkus Z, Galimzianova A, Hoogi A, Rubin DL, Erickson BJ (2017) Deep learning for brain MRI segmentation: state of the art and future directions. J Digit Imaging 30(4):449–459

    Article  PubMed  PubMed Central  Google Scholar 

  • American BrainTumor Association (2018), http://www.abta.org (accessed last time, 7/04/2018)

  • Amin J, Sharif M, Yasmin M, Fernandes SL (2018) Big data analysis for brain tumor detection: Deep convolutional neural networks. Future Generat Comput Syst 5:1–20

    Google Scholar 

  • Anitha R, Raja SS (2018) Development of computer-aided approach for brain tumor detection using random forest classifier. Int J Imaging Syst Technol 28(1):48–53

    Article  Google Scholar 

  • Arunkumar N, Ramkumar K, Venkatraman V, Abdulhay E, Fernandes SL, Kadry S, Segal S (2017) Classification of focal and non focal EEG using entropies. Pattern Recogn Lett 94:112–117

    Article  ADS  Google Scholar 

  • Ayalapogu RR, Pabboju S, Ramisetty RR (2018) Analysis of dual tree M-band wavelet transform based features for brain image classification. Magnet Reson Med. https://doi.org/10.1002/mrm.27210

    Article  Google Scholar 

  • Bahadure NB, Ray AK, Thethi HP (2017) Image analysis for MRI based brain tumor detection and feature extraction using biologically inspired BWT and SVM. Int J Biomed Imaging

  • Bauer S, Fejes T, Slotboom J, Wiest R, Nolte L-P, Reyes M (2012) Segmentation of brain tumor images based on integrated hierarchical classification and regularization. Paper presented at the MICCAI BraTS Workshop. Nice: Miccai Society

  • Bertrand A, Oppenheim C, Lamy C, Rodrigo S, Naggara O, Mas J, Meder J (2008) Comparison of optimized and standard diffusion-weighted imaging at 1.5 T for the detection of acute lesions in patients with transient ischemic attack. Am J Neuroradiol 29(2):363–365

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Bokhari F, Syedia T, Sharif M, Yasmin M, Fernandes SL (2018) Fundus image segmentation and feature extraction for the detection of glaucoma: a new approach. Curr Med Imaging Rev 14(1):77–87

    Article  Google Scholar 

  • Breiman L (2001) Random forests. Machine Learning 45(1):5–32

    Article  Google Scholar 

  • Cabria I, Gondra I (2017) MRI segmentation fusion for brain tumor detection. Information Fusion 36:1–9

    Article  Google Scholar 

  • Chauhan R, Kaur H, Chang V (2017) Advancement and applicability of classifiers for variant exponential model to optimize the accuracy for deep learning. J Ambient Intell Human Comput, 1–10

  • Chen X, Konukoglu E (2018) Unsupervised Detection of Lesions in Brain MRI using constrained adversarial auto-encoders. arXiv preprint arXiv:1806.04972

  • Chen L, Bentley P, Rueckert D (2017) Fully Automatic Acute Ischemic Lesion Segmentation in DWI Using Convolutional Neural Networks. Clinical, NeuroImage

    Book  Google Scholar 

  • Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Paper presented at the computer vision and pattern recognition, 2005. CVPR 2005. IEEE Computer Society Conference on

  • Devkota B, Alsadoon A, Prasad P, Singh A, Elchouemi A (2018) Image Segmentation for Early Stage Brain Tumor Detection using Mathematical Morphological Reconstruction. Proc Comput Sci 125:115–123

    Article  Google Scholar 

  • Dey N, Ashour AS, Beagum S, Pistola DS, Gospodinov M, Gospodinova ЕP, Tavares JMR (2015) Parameter optimization for local polynomial approximation based intersection confidence interval filter using genetic algorithm: an application for brain MRI image de-noising. J Imaging 1(1):60–84

    Article  Google Scholar 

  • Ding Y, Dong R, Lan T, Li X, Shen G, Chen H, Qin Z (2018) Multi-modal brain tumor image segmentation based on SDAE. Int J Imaging Syst Technol 28(1):38–47

    Article  Google Scholar 

  • Dong H, Yang G, Liu F, Mo Y, Guo Y (2017a) Automatic brain tumor detection and segmentation using U-Net based fully convolutional networks. In: Paper presented at the annual conference on medical image understanding and analysis

  • Dong H, Yang G, Liu F, Mo Y, Guo Y (2017b) Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks. arXiv preprint arXiv:1705.03820

  • Dvorak P, Menze BH (2015) Local structure prediction with convolutional neural networks for multimodal brain tumor segmentation. Paper presented at the MCV@ MICCAI

  • El-Henawy I, Bakry E, El Hadad HM (2016) Cattle identification using segmentation-based fractal texture analysis and artificial neural networks. Int J Electron Inf Eng 4(2):82–93

    Google Scholar 

  • Fernandes SL, Gurupur VP, Lin H, Martis RJ (2017) A Novel fusion approach for early lung cancer detection using computer aided diagnosis techniques. J Med Imaging Health Inf 7(8):1841–1850

    Article  Google Scholar 

  • Fink JR, Muzi M, Peck M, Krohn KA (2015) Continuing education: multi-modality brain tumor imaging–MRI, PET, and PET/MRI. Journal of nuclear medicine: official publication. Soc Nucl Med 56(10):1554

    Article  CAS  Google Scholar 

  • Goetz M, Weber C, Bloecher J, Stieltjes B, Meinzer H-P, Maier-Hein K (2014) Extremely randomized trees based brain tumor segmentation. Proceeding of BRATS challenge-MICCAI, 006–011

  • Gondra I, Cabria I (2015) Automated segmentation of brain tumors in MRI using potential field clustering. In: Paper presented at the EUROCON 2015-International Conference on Computer as a Tool (EUROCON), IEEE

  • Haeck T, Maes F, Suetens P (2015) ISLES challenge 2015: Automated model-based segmentation of ischemic stroke in MR images. In: Paper presented at the International Workshop on Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries

  • Hagargi PA, Shubhangi D (2018) Brain tumor MR image fusion using most dominant features extraction from wavelet and curvelet transforms. Brain 5:5

    Google Scholar 

  • Haider W, Sharif M, Raza M (2011) Achieving accuracy in early stage tumor identification systems based on image segmentation and 3D structure analysis. Comput Eng Intell Syst 2(6):96–102

    Google Scholar 

  • Havaei M, Davy A, Warde-Farley D, Biard A, Courville A, Bengio Y, Larochelle H (2017) Brain tumor segmentation with deep neural networks. Med Image Anal 35:18–31

    Article  PubMed  Google Scholar 

  • Huang M, Yang W, Wu Y, Jiang J, Chen W, Feng Q (2014) Brain tumor segmentation based on local independent projection-based classification. IEEE Trans Biomed Eng 61(10):2633–2645

    Article  PubMed  Google Scholar 

  • Ilunga-Mbuyamba E, Avina–Cervantes JG, Garcia–Perez A, de J Romero–Troncoso, Aguirre–Ramos R, Cruz–Aceves H, Chalopin C (2017) Localized active contour model with background intensity compensation applied on automatic MR brain tumor segmentation. Neurocomputing 220:84–97

    Article  Google Scholar 

  • Iqbal S, Ghani MU, Saba T, Rehman A (2018) Brain tumor segmentation in multi-spectral MRI using convolutional neural networks (CNN). Microsc Res Tech 81(4):419–427

    Article  PubMed  Google Scholar 

  • Irum I, Sharif M, Yasmin M, Raza M, Azam F (2014a) A Noise Adaptive Approach to Impulse Noise Detection and Reduction. Nepal J Sci Technol 15(1):67–76

    Article  Google Scholar 

  • Irum I, Sharif M, Raza M, Yasmin M (2014b) Salt and Pepper Noise Removal Filter for 8-Bit Images Based on Local and Global Occurrences of Grey Levels as Selection Indicator. Nepal J Sci Technol 15(2):123–132

    Article  Google Scholar 

  • Irum I, Shahid M, Sharif M, Raza M (2015a) A Review of Image Denoising Methods. J Eng Sci Technol Rev 8:5

    Article  Google Scholar 

  • Irum I, Sharif M, Raza M, Mohsin S (2015b) A nonlinear hybrid filter for salt & pepper noise removal from color images. J Appl Res Technol 13(1):79–85

    Article  Google Scholar 

  • Jafarpour S, Sedghi Z, Amirani MC (2012) A robust brain MRI classification with GLCM features. Int J Comput Appl 37(12):1–5

    Google Scholar 

  • Jain VK, Kumar S, Fernandes SL (2017) Extraction of emotions from multilingual text using intelligent text processing and computational linguistics. J Comput Sci 21:316–326

    Article  Google Scholar 

  • Jothi G (2016) Hybrid tolerance rough set–firefly based supervised feature selection for MRI brain tumor image classification. Appl Soft Comput 46:639–651

    Article  Google Scholar 

  • Kamnitsas K, Ledig C, Newcombe VF, Simpson JP, Kane AD, Menon DK, Glocker B (2017) Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med Image Anal 36:61–78

    Article  PubMed  Google Scholar 

  • Khandani MK, Bajcsy R, Fallah YP (2009) Automated segmentation of brain tumors in MRI using force data clustering algorithm. In: Paper presented at the international symposium on visual computing

  • Kong W, Guo S, Long Y, Peng Y, Zeng H, Zhang X, Zhang J (2018) Weighted extreme learning machine for P300 detection with application to brain computer interface. J Ambient Intell Human Comput 2:1–11

    Google Scholar 

  • Lahmiri S (2017) Glioma detection based on multi-fractal features of segmented brain MRI by particle swarm optimization techniques. Biomed Signal Process Control 31:148–155

    Article  Google Scholar 

  • Larochelle H, Jodoin P-M (2016) A Convolutional Neural Network Approach to Brain Tumor Segmentation. In: Paper presented at the Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries: First International Workshop, Brainles 2015, Held in Conjunction with MICCAI 2015, Munich, Germany, October 5, 2015, Revised Selected Papers

  • Lasocki A, Gaillard F (2016) Ischaemic stroke in the setting of glioblastoma: A case series and review of the literature. Neuroradiol J 29(3):155–159

    Article  PubMed  PubMed Central  Google Scholar 

  • Liu Y-h, Muftah M, Das T, Bai L, Robson K, Auer D (2012) Classification of MR tumor images based on Gabor wavelet analysis. J Med Biol Eng 32(1):22–28

    Article  Google Scholar 

  • Mahmood Q, Basit A (2015) Automatic Ischemic Stroke Lesion Segmentation in Multi-spectral MRI Images Using Random Forests Classifier. In: Paper presented at the international workshop on Brainlesion: Glioma, multiple sclerosis, stroke and traumatic brain injuries

  • Maier O, Menze BH, von der Gablentz J, Häni L, Heinrich MP, Liebrand M,.. . Chen L (2017) ISLES 2015-A public evaluation benchmark for ischemic stroke lesion segmentation from multispectral MRI. Med Image Anal 35:250–269

    Article  PubMed  Google Scholar 

  • Masood S, Sharif M, Masood A, Yasmin M, Raza M (2015) A survey on medical image segmentation. Curr Med Imaging Rev 11(1):3–14

    Article  Google Scholar 

  • McKinley R, Häni L, Wiest R, Reyes M (2015) Segmenting the Ischemic Penumbra: A Decision Forest Approach with Automatic Threshold Finding. In: Paper presented at the international workshop on Brainlesion: Glioma, multiple sclerosis, stroke and traumatic brain injuries

  • Meier R, Bauer S, Slotboom J, Wiest R, Reyes M (2013) A hybrid model for multimodal brain tumor segmentation. Multimodal Brain Tumor Segment 5:31

    Google Scholar 

  • Menze BH, Jakab A, Bauer S, Kalpathy-Cramer J, Farahani K, Kirby J, Wiest R (2015) The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging 34(10):1993–2024

    Article  PubMed  Google Scholar 

  • Moraru L, Moldovanu S, Dimitrievici LT, Shi F, Ashour AS, Dey N (2017) Quantitative diffusion tensor magnetic resonance imaging signal characteristics in the human brain: a hemispheres analysis. IEEE Sens J 17(15):4886–4893

    Article  ADS  Google Scholar 

  • Naqi S, Sharif M, Yasmin M, Fernandes SL (2018) Lung nodule detection using polygon approximation and hybrid features from CT images. Curr Med Imaging Rev 14(1):108–117

    Article  Google Scholar 

  • Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Machine Intell 24(7):971–987

    Article  Google Scholar 

  • Pereira S, Pinto A, Alves V, Silva CA (2016) Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Trans Med Imaging 35(5):1240–1251

    Article  PubMed  Google Scholar 

  • Raja NSM, Fernandes S, Dey N, Satapathy SC, Rajinikanth V (2018) Contrast enhanced medical MRI evaluation using Tsallis entropy and region growing segmentation. J Ambient Intell Human Comput 3:1–12

    Google Scholar 

  • Rajinikanth V, Madhavaraja N, Satapathy SC, Fernandes SL (2017) Otsu’s multi-thresholding and active contour snake model to segment dermoscopy images. J Med Imaging Health Inf 7(8):1837–1840

    Article  Google Scholar 

  • Rewari R. Automatic tumor segmentation from MRI scans. In. Stanford University

  • Reza SM, Mays R, Iftekharuddin KM (2015) Multi-fractal detrended texture feature for brain tumor classification. In: Paper presented at the proceedings of SPIE–the international society for optical engineering

  • Rufus HA, N., & Selvathi D (2018) Performance analysis of brain tissues and tumor detection and grading system using ANFIS classifier. Int J Imaging Syst Technol 28(2):77–85

    Article  Google Scholar 

  • Serag A, Wilkinson AG, Telford EJ, Pataky R, Sparrow SA, Anblagan D, Boardman JP (2017) SEGMA: an automatic SEGMentation Approach for human brain MRI using sliding window and random forests. Front Neuroinform 2:11

    Google Scholar 

  • Shabbir B, Sharif M, Nisar W, Yasmin M, Fernandes SL (2016) Automatic cotton wool spots extraction in retinal images using texture segmentation and gabor wavelet. J Integrat Design Process Sci 20(1):65–76

    Article  Google Scholar 

  • Shah JH, Sharif M, Yasmin M, Fernandes SL (2017) Facial expressions classification and false label reduction using LDA and threefold SVM. Pat Recogn Lett

  • Sharif M, Khan MA, Faisal M, Yasmin M, Fernandes SL (2018) A framework for offline signature verification system: Best features selection approach. Pat Recogn Lett

  • Shboul ZA, Reza SM, Iftekharuddin KM (2017) Quantitative MR Image Analysis for Brain Tumor. In: Paper presented at the European Congress on Computational Methods in Applied Sciences and Engineering

  • Soltaninejad M, Yang G, Lambrou T, Allinson N, Jones TL, Barrick TR, Ye X (2017) Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI. Int J Computer Assis Radiol Surg 12(2):183–203

    Article  Google Scholar 

  • Sridhar K, Baskar S, Shakeel PM, Dhulipala VS (2018) Developing brain abnormality recognize system using multi-objective pattern producing neural network. J Ambient Intell Human Comput 6: 1–9

  • Wang D, Li Z, Cao L, Balas VE, Dey N, Ashour AS,.. . Shi F (2017) Image fusion incorporating parameter estimation optimized Gaussian mixture model and fuzzy weighted evaluation system: a case study in time-series plantar pressure data set. IEEE Sens J 17(5):1407–1420

    Article  ADS  Google Scholar 

  • Wu W, Chen AY, Zhao L, Corso JJ (2014) Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features. Int J Comput Assis Radiol Surg 9(2):241–253

    Article  Google Scholar 

  • Wu J, Zhang S, Xiao Z, Zhang F, Geng L, Lou S, Liu M (2018a) Hemorrhage detection in fundus image based on 2D Gaussian fitting and human visual characteristics. Optics and Laser Technol

  • Wu Y, Liu B, Wu W, Lin Y, Yang C, Wang M (2018b) Grading glioma by radiomics with feature selection based on mutual information. J Ambient Intell Human Comput 6:1–12

    Google Scholar 

  • Yasmin M, Mohsin S, Sharif M, Raza M, Masood S (2012a) Brain image analysis: a survey. World Appl Sci J 19(10):1484–1494

    Google Scholar 

  • Yasmin M, Sharif M, Masood S, Raza M, Mohsin S (2012b) Brain image enhancement-A survey. World Appl Sci J 17(9):1192–1204

    Google Scholar 

  • Yasmin M, Sharif M, Mohsin S, Azam F (2014) Pathological brain image segmentation and classification: a survey. Curr Med Imaging Rev 10(3):163–177

    Article  Google Scholar 

  • Zhang B, Chang K, Ramkissoon S, Tanguturi S, Bi WL, Reardon DA, Huang RY (2016) Multimodal MRI features predict isocitrate dehydrogenase genotype in high-grade gliomas. Neuro-oncology 19(1):109–117

    Article  PubMed  PubMed Central  Google Scholar 

  • Zhang Y, Yang J, Wang S, Dong Z, Phillips P (2017) Pathological brain detection in MRI scanning via Hu moment invariants and machine learning. J Exp Theor Artif Intell 29(2):299–312

    Article  Google Scholar 

  • Zhao X, Wu Y, Song G, Li Z, Zhang Y, Fan Y (2018) A deep learning model integrating FCNNs and CRFs for brain tumor segmentation. Medical image analysis 43:98–111

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mussarat Yasmin.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix A

Appendix A

Notation

Description

Notation

Description

\(\otimes\)

Multiplication

\({\text{p}}\left( {{\text{k}},{\text{l}}} \right)\)

Matrix element

F

Input image

\(\varphi ^{{\text{r}}}\)

Gray level

L

Maximum image intensity

(+)

Fusion

P

Minimum image intensity

fs

Sinusoidal frequency

\({\text{{M}}}\)

Mean

\(\theta\)

Similar band orientation of a Gabor activity

\({\text{{\rm A}}}\)

Min

Phase offset

\({\text{{\rm B}}}\)

Max

\(\Sigma\)

Standard deviation

\(R\)

Range

\(\Gamma\)

\({\text{Spatial~aspect~proportion}}\)

\(\partial\)

Interval

|G|

Gradient magnitude

\({x_i}\)

Foreground pixels

\(\theta _{{\text{G}}}\)

Gradient angle

N

Total number of pixels

\(\in\)

Small constant

\({\text{f}}_{{\mu i}}\)

Mean of the input image

V

non-normalized vector

\({\text{f}}_{\gamma }\)

The range of input image

\({{\text{g}}_{\text{p}}}\)

Gray level variance

\({{\text{f}}_\partial }\)

Interval of the input image

\({\text{S}}\)

Sum

\({{\text{f}}_{{\vartheta _{\partial {\text{i}}}}}}\)

Updated interval

\({\text{P}},{\text{R}}\)

Neighboring pixel

\({\text{f}}_{\omega }\)

Centroid of the input image

\({\text{}}{{\text{g}}_{\text{c}}}\)

Complementary contrast

\({\text{f}}_{{\omega _{{\text{j}}} }}\)

The difference of the centroid

\(\nabla \left( {{\text{x}},{\text{y}}} \right)\)

Tumor region boundaries

\({\text{f}}_{{\vartheta _{{\omega {\text{j}}}} }}\)

Updates centroid

N8[(x,y)]

8-connected pixel

\({{\text{f}}_{{\text{binary}}}}\)

Final segmented image

SE

Sensitivity

\({{\text{f}}_{{\text{seg}}}}\)

Color segmented image

SP

Specificity

\(\varphi ^{{\text{f}}}\)

Feature

ACC

Accuracy

\(\varphi ^{{\mu {\text{f}}}}\)

Mean feature

ROC

Receiver operating characteristic curve

\(\varphi ^{{\sigma ^{2} }}\)

Variance

DSC

Dice similarity coefficient

TPR

True positive rate

TP

True positive

FPR

False positive rate

FP

False positive

Q

Segmentation quality

  

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Amin, J., Sharif, M., Raza, M. et al. Detection of Brain Tumor based on Features Fusion and Machine Learning. J Ambient Intell Human Comput 15, 983–999 (2024). https://doi.org/10.1007/s12652-018-1092-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Version of record:

  • Issue date:

  • DOI: https://doi.org/10.1007/s12652-018-1092-9

Keywords

Profiles

  1. Mudassar Raza