Attention-Based Neural Network for Cardiac MRI Segmentation: Application to Strain and Volume Computation - Institut de Recherche sur les Maladies Cardiovasculaires, du Métabolisme et de la Nutrition
Article Dans Une Revue Innovation and Research in BioMedical engineering Année : 2024

Attention-Based Neural Network for Cardiac MRI Segmentation: Application to Strain and Volume Computation

Résumé

Context Deep learning algorithms have been widely used for cardiac image segmentation. However, most of these architectures rely on convolutions that hardly model long-range dependencies, limiting their ability to extract contextual information. Moreover, the traditional U-net architecture suffers from the difference of semantic information between feature maps of the encoder and decoder (also known as the semantic gap). Material and method To address this issue, a new network architecture relying on attention mechanism was introduced. Swin Filtering Blocks (SFB), that use Swin Transformer blocks in a cross-attention manner, were added between the encoder and the decoder to filter information coming from the encoder based on the feature map from the decoder. Attention was also employed at the lowest resolution in the form of a transformer layer to increase the receptive field of the network. We conducted experiments to assess both generalization capability and to evaluate how training on all frames of the cardiac cycle rather than only the end-diastole and end-systole impacts strain and segmentation performances. Results and conclusion Visual inspection of feature maps suggested that Swin Filtering Blocks contribute to the reduction of the semantic gap. Performing attention between all patches using a transformer layer brought higher performance than convolutions. Training the model with all phases of the cardiac cycle resulted in slightly more accurate segmentations while leading to a more noticeable improvement for strain estimation. A limited decrease in performance was observed when testing on out-of-distribution data, but the gap widens for the most apical slices.
Fichier principal
Vignette du fichier
1-s2.0-S1959031824000319-main.pdf (2.66 Mo) Télécharger le fichier
Origine Publication financée par une institution
licence

Dates et versions

hal-04747092 , version 1 (21-10-2024)

Licence

Identifiants

Citer

Nicolas Portal, Catherine Achard, Saud Khan, Vincent Nguyen, Mikael Prigent, et al.. Attention-Based Neural Network for Cardiac MRI Segmentation: Application to Strain and Volume Computation. Innovation and Research in BioMedical engineering, 2024, 45 (4), pp.100850. ⟨10.1016/j.irbm.2024.100850⟩. ⟨hal-04747092⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More