A Machine Learning Approach for Real-Time Modelling of Tissue Deformation in Image-Guided Neurosurgery
File(s)machine-learning-approach.pdf (971.9 KB)
Published version
Author(s)
Tonutti, MT
Gras, G
Yang, GZY
Type
Journal Article
Abstract
Objectives
Accurate reconstruction and visualisation of soft tissue deformation in real time is crucial in image-guided surgery, particularly in augmented reality (AR) applications. Current deformation models are characterised by a trade-off between accuracy and computational speed. We propose an approach to derive a patient-specific deformation model for brain pathologies by combining the results of pre-computed finite element method (FEM) simulations with machine learning algorithms. The models can be computed instantaneously and offer an accuracy comparable to FEM models.
Method
A brain tumour is used as the subject of the deformation model. Load-driven FEM simulations are performed on a tetrahedral brain mesh afflicted by a tumour. Forces of varying magnitudes, positions, and inclination angles are applied onto the brain's surface. Two machine learning algorithms—artificial neural networks (ANNs) and support vector regression (SVR)—are employed to derive a model that can predict the resulting deformation for each node in the tumour's mesh.
Results
The tumour deformation can be predicted in real time given relevant information about the geometry of the anatomy and the load, all of which can be measured instantly during a surgical operation. The models can predict the position of the nodes with errors below 0.3 mm, beyond the general threshold of surgical accuracy and suitable for high fidelity AR systems. The SVR models perform better than the ANN's, with positional errors for SVR models reaching under 0.2 mm.
Conclusions
The results represent an improvement over existing deformation models for real time applications, providing smaller errors and high patient-specificity. The proposed approach addresses the current needs of image-guided surgical systems and has the potential to be employed to model the deformation of any type of soft tissue.
Accurate reconstruction and visualisation of soft tissue deformation in real time is crucial in image-guided surgery, particularly in augmented reality (AR) applications. Current deformation models are characterised by a trade-off between accuracy and computational speed. We propose an approach to derive a patient-specific deformation model for brain pathologies by combining the results of pre-computed finite element method (FEM) simulations with machine learning algorithms. The models can be computed instantaneously and offer an accuracy comparable to FEM models.
Method
A brain tumour is used as the subject of the deformation model. Load-driven FEM simulations are performed on a tetrahedral brain mesh afflicted by a tumour. Forces of varying magnitudes, positions, and inclination angles are applied onto the brain's surface. Two machine learning algorithms—artificial neural networks (ANNs) and support vector regression (SVR)—are employed to derive a model that can predict the resulting deformation for each node in the tumour's mesh.
Results
The tumour deformation can be predicted in real time given relevant information about the geometry of the anatomy and the load, all of which can be measured instantly during a surgical operation. The models can predict the position of the nodes with errors below 0.3 mm, beyond the general threshold of surgical accuracy and suitable for high fidelity AR systems. The SVR models perform better than the ANN's, with positional errors for SVR models reaching under 0.2 mm.
Conclusions
The results represent an improvement over existing deformation models for real time applications, providing smaller errors and high patient-specificity. The proposed approach addresses the current needs of image-guided surgical systems and has the potential to be employed to model the deformation of any type of soft tissue.
Date Issued
2017-07-24
Date Acceptance
2017-07-06
Citation
Artificial Intelligence in Medicine, 2017, 80, pp.39-47
ISSN
0933-3657
Publisher
Elsevier
Start Page
39
End Page
47
Journal / Book Title
Artificial Intelligence in Medicine
Volume
80
Copyright Statement
© 2017, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/
Sponsor
Engineering & Physical Science Research Council (EPSRC)
Wellcome Trust
Department of Health
Wellcome Trust
Wellcome Trust
Department of Health
Grant Number
N/A
088844/Z/09/Z
HICF-T4-299
HICF-T4-299
HICF-T4-299
HICF-T4-299
Subjects
Artificial neural networks
Biomechanics
Finite element method
Image-guided surgery
Machine learning
Soft tissue deformation
Support vector regression
08 Information And Computing Sciences
09 Engineering
Medical Informatics
Publication Status
Published