Deep BI-RADS Network for Improved Cancer Detection from Mammograms

Gil Ben-Artzi, Feras Daragma, Shahar Mahpod

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    Abstract

    While state-of-the-art models for breast cancer detection leverage multi-view mammograms for enhanced diagnostic accuracy, they often focus solely on visual mammography data. However, radiologists document valuable lesion descriptors that contain additional information that can enhance mammography-based breast cancer screening. A key question is whether deep learning models can benefit from these expert-derived features. To address this question, we introduce a novel multi-modal approach that combines textual BI-RADS lesion descriptors with visual mammogram content. Our method employs iterative attention layers to effectively fuse these different modalities, significantly improving classification performance over image-only models. Experiments on the CBIS-DDSM dataset demonstrate substantial improvements across all metrics, demonstrating the contribution of handcrafted features to end-to-end.

    Original languageEnglish
    Title of host publicationPattern Recognition - 27th International Conference, ICPR 2024, Proceedings
    EditorsApostolos Antonacopoulos, Subhasis Chaudhuri, Rama Chellappa, Cheng-Lin Liu, Saumik Bhattacharya, Umapada Pal
    PublisherSpringer Science and Business Media Deutschland GmbH
    Pages17-30
    Number of pages14
    ISBN (Print)9783031781032
    DOIs
    StatePublished - 2025
    Event27th International Conference on Pattern Recognition, ICPR 2024 - Kolkata, India
    Duration: 1 Dec 20245 Dec 2024

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume15328 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference27th International Conference on Pattern Recognition, ICPR 2024
    Country/TerritoryIndia
    CityKolkata
    Period1/12/245/12/24

    Keywords

    • Attention
    • BI-RADS
    • Breast Cancer
    • Cancer Detection
    • Deep Learning
    • Mammograms
    • Multi-Modal
    • Transformer

    Fingerprint

    Dive into the research topics of 'Deep BI-RADS Network for Improved Cancer Detection from Mammograms'. Together they form a unique fingerprint.

    Cite this