LDCNet: a lightweight multi-scale convolutional neural network using local dense connectivity for image recognition
Deep convolutional neural networks (DCNNs) have made great contributions to the development of computer vision. Since the trained DCNN models require a large amount of computing and storage resources to achieve high performance, it is usually difficult to deploy them on resource-limited systems. To address this problem, we propose a novel local dense connectivity (LDC) module to generate feature maps from cheap convolution operations. The LDC module constructs hierarchical and locally dense connections within a single layer. This construction promotes the reuse of features in network layers. As a result, it leads to the generation of multi-scale feature maps and increases the receptive fields for each network layer. A basic architecture block called LDCBlock was designed based on the LDC module. By stacking this kind of block, we propose a kind of lightweight and efficient multi-scale residual network named LDCNet. Moreover, to model the interdependencies between the channels of the LDC module and enhance the informativeness of diversified features, we also design a sparse Squeeze-Excitation (SE) module, which has fewer parameters and computations. Finally, the experiments based on CIFAR datasets, ImageNet dataset and a defect detection dataset demonstrate that our LDCNet achieves competitive performance compared with the state-of-the-art models focusing on model compression.
Funding
Young and Middle-aged Science and Technology Innovation Talent of Shenyang (RC220485)
Guangdong Basic and Applied Basic Research Foundation (2022A1515140126, 2023A1515011172)
Control and optimization of nonlinear dynamic systems
National Natural Science Foundation of China
Find out more...National Natural Science Foundation of China (U20A20197)
Chunhui Plan Cooperative Project of Ministry of Education HZKY20220424
History
School
- Science
Department
- Computer Science
Published in
IEEE Transactions on Cognitive and Developmental SystemsPublisher
Institute of Electrical and Electronics Engineers (IEEE)Version
- AM (Accepted Manuscript)
Rights holder
© IEEEPublisher statement
© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Acceptance date
2023-08-30Publication date
2023-09-01Copyright date
2023ISSN
2379-8920eISSN
2379-8939Publisher version
Language
- en