Probabilistic Models in Deep Learning and Computer Vision Tasks

A special issue of Mathematics (ISSN 2227-7390). This special issue belongs to the section "E1: Mathematics and Computer Science".

Deadline for manuscript submissions: 30 June 2025 | Viewed by 1044

Special Issue Editors


E-Mail Website
Guest Editor
Department of Computer Science, Shenzhen University, Shenzhen, China
Interests: machine learning; image restoration; computer vision

E-Mail Website
Guest Editor
1. National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University, Shenzhen 518060, China
2. Guangdong Provincial Key Laboratory of Intelligent Information Processing, Shenzhen 518060, China
Interests: anomaly detection; computer vision; machine learning

Special Issue Information

Dear Colleagues,

Deep learning has a wide range of applications in computer vision (such as image classification, object detection, semantic segmentation, medical image analysis, autonomous driving, etc.). By simulating the neural network structure of the human brain, it can automatically learn and extract the features of visual data, such as images and videos, and then perform complex visual tasks. Probabilistic models are an essential component of machine learning, which aims to learn patterns from data and make predictions on new, unseen data. To date, probabilistic models have been widely used in various applications like computer vision natural language processing tasks. Thus, developing probabilistic models can provide a powerful tool for machine learning tasks and help to solve complex problems.

Dr. Tao Dai
Dr. Jinbao Wang
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Mathematics is an international peer-reviewed open access semimonthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • deep learning
  • computer vision
  • optimization algorithm

Benefits of Publishing in a Special Issue

  • Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
  • Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
  • Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
  • External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
  • e-Book format: Special Issues with more than 10 articles can be published as dedicated e-books, ensuring wide and rapid dissemination.

Further information on MDPI's Special Issue policies can be found here.

Published Papers (1 paper)

Order results
Result details
Select all
Export citation of selected articles as:

Research

18 pages, 552 KiB  
Article
Probabilistic Automated Model Compression via Representation Mutual Information Optimization
by Wenjie Nie, Shengchuan Zhang and Xiawu Zheng
Mathematics 2025, 13(1), 108; https://doi.org/10.3390/math13010108 - 30 Dec 2024
Viewed by 724
Abstract
Deep neural networks, despite their remarkable success in computer vision tasks, often face deployment challenges due to high computational demands and memory usage. Addressing this, we introduce a probabilistic framework for automated model compression (Prob-AMC) that optimizes pruning, quantization, and knowledge distillation simultaneously [...] Read more.
Deep neural networks, despite their remarkable success in computer vision tasks, often face deployment challenges due to high computational demands and memory usage. Addressing this, we introduce a probabilistic framework for automated model compression (Prob-AMC) that optimizes pruning, quantization, and knowledge distillation simultaneously using information theory. Our approach is grounded in maximizing the mutual information between the original and compressed network representations, ensuring the preservation of essential features under resource constraints. Specifically, we employ layer-wise self-representation mutual information analysis, sampling-based pruning and quantization allocation, and progressive knowledge distillation using the optimal compressed model as a teacher assistant. Through extensive experiments on CIFAR-10 and ImageNet, we demonstrate that Prob-AMC achieves a superior compression ratio of 33.41× on ResNet-18 with only a 1.01% performance degradation, outperforming state-of-the-art methods in terms of both compression efficiency and accuracy. This optimization process is highly practical, requiring merely a few GPU hours, and bridges the gap between theoretical information measures and practical model compression, offering significant insights for efficient deep learning deployment. Full article
(This article belongs to the Special Issue Probabilistic Models in Deep Learning and Computer Vision Tasks)
Show Figures

Figure 1

Back to TopTop