Evaluation of Deformable Convolution: An Investigation in Image and Video Classification

Andrea Burgos Madrigal, Victor Romero Bautista, Raquel Díaz Hernández and Leopoldo Altamirano Robles ()
Additional contact information
Andrea Burgos Madrigal: Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla 72840, Mexico
Victor Romero Bautista: Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla 72840, Mexico
Raquel Díaz Hernández: Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla 72840, Mexico
Leopoldo Altamirano Robles: Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla 72840, Mexico

Mathematics, 2024, vol. 12, issue 16, 1-25

Abstract: Convolutional Neural Networks (CNNs) present drawbacks for modeling geometric transformations, caused by the convolution operation’s locality. Deformable convolution (DCON) is a mechanism that solves these drawbacks and improves the robustness. In this study, we clarify the optimal way to replace the standard convolution with its deformable counterpart in a CNN model. To this end, we conducted several experiments using DCONs applied in the layers that conform a small four-layer CNN model and on the four-layers of several ResNets with depths 18, 34, 50, and 101. The models were tested in binary balanced classes with 2D and 3D data. If DCON is used on the first layers of the proposal of model, the computational resources will tend to increase and produce bigger misclassification than the standard CNN. However, if the DCON is used at the end layers, the quantity of Flops will decrease, and the classification accuracy will improve by up to 20% about the base model. Moreover, it gains robustness because it can adapt to the object of interest. Also, the best kernel size of the DCON is three. With these results, we propose a guideline and contribute to understanding the impact of DCON on the robustness of CNNs.

Keywords: computer vision; image/video analysis; deformable neural networks (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/12/16/2448/pdf (application/pdf)
https://www.mdpi.com/2227-7390/12/16/2448/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:12:y:2024:i:16:p:2448-:d:1451435

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().