entropy-logo

Journal Browser

Journal Browser

Physics-Based Machine and Deep Learning for PDE Models

A special issue of Entropy (ISSN 1099-4300). This special issue belongs to the section "Signal and Data Analysis".

Deadline for manuscript submissions: closed (31 October 2022) | Viewed by 5302

Special Issue Editors


E-Mail Website
Guest Editor
1. CNRS, LPSM, Sorbonne Université, 4 Place Jussieu, 75005 Paris, France
2. EDF R&D, Industrial AI Lab SINCLAIR, Paris, France
Interests: Bayesian modeling; treatment of uncertainties; machine/deep learning; industrial risk; simulation

E-Mail Website
Guest Editor
1. Laboratoire d’Informatique de Paris 6, Sorbonne University, CNRS, 75005 Paris, France
2. Criteo AI Lab, 75009 Paris, France
Interests: machine learning; deep learning; dynamical systems; natural language processing

Special Issue Information

Machine learning has been successfully used for over a decade for applications in engineering. It has recently started to attract attention for scientific computing in domains dominated up to now by the classical mechanistic modeling paradigm. It is particularly promising for domains involving complex processes, only partially known and understood or when existing solutions are computationally not feasible. This is the case for the modeling and simulation of complex dynamical physical systems. Classical modeling relies on PDEs, and simulation is central to engineering and physical science with applications in domains such as earth systems, biology, medicine, mechanics and robotics. Traditional simulation problems involve computational fluid dynamics and turbulence modeling, mechanistic design and many other domains. Such numerical models are also used intensively in industrial systems design, in simulation for decision support, or in safety studies. They are used for inversion, data assimilation and forecasting. Despite extensive developments and promising progress, this classical paradigm suffers from limitations. It is often impossible or too costly to carry out direct simulations at the scale required for natural or industrial problems. The physics may be too complex or unknown, leading to incomplete or inaccurate models.

The availability of increasingly large amounts of data, either from observations or from simulations, and the successes witnessed by ML methods on large size or large dimensional problems has opened the way for exploring the data driven modeling of complex dynamical physical phenomena. ML based techniques may accelerate simulations, acting, for example, as reduced models. More generally, a promising direction consists in integrating physics-based models with machine learning. This raises several challenges such as how to perform such decompositions, how to train such combined systems, how to handle discretization errors or guarantee numerical stability of the solutions, how to handle out-of-sample scenarios, and how to ensure physical consistency of the solutions.

An additional challenge is the shift from academic case studies to realistic problems representing complex phenomena. Current solutions are most often demonstrated on simulated problems and there is still a large gap between academic and real-world developments.

This Special Issue, therefore, aims to gather specialists from different disciplines and to enable the dissemination of their recent research at the crossroad of model based and data based dynamical physical system modeling and on “physically inspired” ML models for dynamic systems.

The topics of interest for publication include but are not limited to:

  • Deep learning;
  • Gaussian processes;
  • Uncertainty quantification;
  • Data-driven techniques;
  • PDE solving;
  • Spatio-temporal forecasting;
  • Simulation;
  • Computational fluid dynamics;
  • Graphics;
  • Robotics.

Dr. Nicolas Bousquet
Prof. Dr. Patrick Gallinari
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Entropy is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • deep learning
  • machine learning
  • PDE
  • neural networks
  • uncertainty quantification
  • physics-inspired meta-models
  • Gaussian processes

Published Papers (2 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

26 pages, 1066 KiB  
Article
Learning Interactions in Reaction Diffusion Equations by Neural Networks
by Sichen Chen, Nicolas J-B. Brunel, Xin Yang and Xinping Cui
Entropy 2023, 25(3), 489; https://doi.org/10.3390/e25030489 - 11 Mar 2023
Viewed by 2061
Abstract
Partial differential equations are common models in biology for predicting and explaining complex behaviors. Nevertheless, deriving the equations and estimating the corresponding parameters remains challenging from data. In particular, the fine description of the interactions between species requires care for taking into account [...] Read more.
Partial differential equations are common models in biology for predicting and explaining complex behaviors. Nevertheless, deriving the equations and estimating the corresponding parameters remains challenging from data. In particular, the fine description of the interactions between species requires care for taking into account various regimes such as saturation effects. We apply a method based on neural networks to discover the underlying PDE systems, which involve fractional terms and may also contain integration terms based on observed data. Our proposed framework, called Frac-PDE-Net, adapts the PDE-Net 2.0 by adding layers that are designed to learn fractional and integration terms. The key technical challenge of this task is the identifiability issue. More precisely, one needs to identify the main terms and combine similar terms among a huge number of candidates in fractional form generated by the neural network scheme due to the division operation. In order to overcome this barrier, we set up certain assumptions according to realistic biological behavior. Additionally, we use an L2-norm based term selection criterion and the sparse regression to obtain a parsimonious model. It turns out that the method of Frac-PDE-Net is capable of recovering the main terms with accurate coefficients, allowing for effective long term prediction. We demonstrate the interest of the method on a biological PDE model proposed to study the pollen tube growth problem. Full article
(This article belongs to the Special Issue Physics-Based Machine and Deep Learning for PDE Models)
Show Figures

Figure 1

40 pages, 15909 KiB  
Article
Learning PDE to Model Self-Organization of Matter
by Eduardo Brandao, Jean-Philippe Colombier, Stefan Duffner, Rémi Emonet, Florence Garrelie, Amaury Habrard, François Jacquenet, Anthony Nakhoul and Marc Sebban
Entropy 2022, 24(8), 1096; https://doi.org/10.3390/e24081096 - 9 Aug 2022
Cited by 3 | Viewed by 1632
Abstract
A self-organization hydrodynamic process has recently been proposed to partially explain the formation of femtosecond laser-induced nanopatterns on Nickel, which have important applications in optics, microbiology, medicine, etc. Exploring laser pattern space is difficult, however, which simultaneously (i) motivates using machine learning (ML) [...] Read more.
A self-organization hydrodynamic process has recently been proposed to partially explain the formation of femtosecond laser-induced nanopatterns on Nickel, which have important applications in optics, microbiology, medicine, etc. Exploring laser pattern space is difficult, however, which simultaneously (i) motivates using machine learning (ML) to search for novel patterns and (ii) hinders it, because of the few data available from costly and time-consuming experiments. In this paper, we use ML to predict novel patterns by integrating partial physical knowledge in the form of the Swift-Hohenberg (SH) partial differential equation (PDE). To do so, we propose a framework to learn with few data, in the absence of initial conditions, by benefiting from background knowledge in the form of a PDE solver. We show that in the case of a self-organization process, a feature mapping exists in which initial conditions can safely be ignored and patterns can be described in terms of PDE parameters alone, which drastically simplifies the problem. In order to apply this framework, we develop a second-order pseudospectral solver of the SH equation which offers a good compromise between accuracy and speed. Our method allows us to predict new nanopatterns in good agreement with experimental data. Moreover, we show that pattern features are related, which imposes constraints on novel pattern design, and suggest an efficient procedure of acquiring experimental data iteratively to improve the generalization of the learned model. It also allows us to identify the limitations of the SH equation as a partial model and suggests an improvement to the physical model itself. Full article
(This article belongs to the Special Issue Physics-Based Machine and Deep Learning for PDE Models)
Show Figures

Figure 1

Back to TopTop