Abstract
This paper is part of a line of research devoted to developing a compositional and geometric theory of Group Equivariant Non-Expansive Operators (GENEOs) for Geometric Deep Learning. It has two objectives. The first objective is to generalize the notions of permutants and permutant measures, originally defined for the identity of a single “perception pair”, to a map between two such pairs. The second and main objective is to extend the application domain of the whole theory, which arose in the set-theoretical and topological environments, to graphs. This is performed using classical methods of mathematical definitions and arguments. The theoretical outcome is that, both in the case of vertex-weighted and edge-weighted graphs, a coherent theory is developed. Several simple examples show what may be hoped from GENEOs and permutants in graph theory and how they can be built. Rather than being a competitor to other methods in Geometric Deep Learning, this theory is proposed as an approach that can be integrated with such methods.
1. Introduction
In recent years, the need for an extension of Deep Learning to non-Euclidean domains has led to the development of Geometric Deep Learning (Section 1.1). This line of research focuses on applying neural networks to manifolds and graphs, making available new geometric models for artificial intelligence. In doing this, Geometric Deep Learning uses techniques from differential geometry, combinatorics, and algebra. In particular, it largely uses the concepts of group action and the equivariant operator (Section 1.2), which allow for a strong reduction in the number of parameters involved in machine learning.
1.1. Geometric Deep Learning
The basic idea of Geometric Deep Learning (GDL) [,,] is to take into account the “geometric” nature of data to better focus the learning process and for parameter reduction. In fact, data may occur as sampled manifolds or as graphs, and the inherent structure may be essential for knowledge extraction. Moreover, functions defined from data may reveal essential features; this is, for example, the case with weighted graphs, the main object of the present study.
GDL should help to overcome the “black box syndrome” of deep learning, going towards “explainable AI” []. On this line of thought, one study [] suggested shifting the focus from rough data to operators on data because operators are seen as elementary components that could substitute neurons in a neural network. Above all, operators represent the protagonist of explainable AI: the observer.
A prominent geometric feature is a symmetry with respect to a group of transformations, and this makes equivariance a necessary requirement when dealing with such data. The relevance of equivariance in GDL has been stressed in two recent studies [,].
1.2. Equivariant Operators
Consider an operator F on data (e.g., a convolution by a blurring kernel on an image) and a group G of transformations on (e.g., translations). Roughly said, F is equivariant with respect to G if F commutes with the transformations in G (in the example, first translating and then blurring gives the same result as first blurring and then translating).
The presence of symmetry with respect to a certain group of transformations is the most common reason for embedding equivariance in Deep Learning. For example, this is the case with the Euclidean, Lorenz, and Poincaré groups in the physical environments considered in []. Equivariance with respect to translations, rotations, and scaling is incorporated in deep learning for image processing and computational imaging in []. An SE(3)-equivariant deep learning model is introduced in [] for protein binding prediction.
Group Equivariant Non-Expansive Operators (GENEOs, Definition 2) were introduced for building smart averages in the presence of such symmetries []; non-expansivity was required to express the information reduction and to grant convenient topological conditions. A way of producing GENEOs (preceding permutants) was first introduced in []. Permutants (Definition 3) and permutant measures (Definition 6) are general and flexible tools for building families of GENEOs. Bongard problems (typical intelligence tests) are faced through GENEOs in []. An application of GENEOs to protein pocket detection is mentioned in [].
GENEOs inspired the introduction of Set Equivariant Operators (SEOs) for comparing structures within the framework of Persistent Homology in [] and were a first step towards the comprehensive, formal description of artificial neural networks and their architectures [,].
1.3. Objectives
The present research had two objectives: giving a wider definition of permutant and extending the applicability of the whole theory to the domain of graphs.
The original definition of permutant concerned a single “perception pair” (Definition 1); here, it is defined for two perception pairs (Definition 4) and provides a construction method for GENEOs in this wider context (Theorem 1).
Since the beginning of GDL [], the application of deep learning to data in the form of graphs appeared as a very interesting and promising development, both from theoretical and applied viewpoints. Much research is being done in this direction [,,]. The main objective of the present paper is then to extend the application domain of the whole theory of GENEOs (generalized permutants included) to weighted graphs, where the weight function can be on vertices (Section 4.1) or edges (Section 4.2).
1.4. Outline
The rest of the paper is structured as follows. Section 2 recalls the mathematical setting, based on the concepts of perception pairs, GENEOs, and permutants. Section 3 introduces and describes the new concepts of generalized permutants and generalized permutant measures, proving that each of these can be used to build a GENEO (Theorems 1 and 3). In Section 4, the concepts of vertex-weighted-/edge-weighted-graph GENEOs are introduced, and the new mathematical model is illustrated with several examples. A section devoted to experiments (Section 5) shows how graph GENEOs may extract useful information from graphs, and how permutants can be built. Section 6 presents the final discussion.
2. The Set-Theoretical Setting
This section recalls the notions of perception pairs, GENEOs, and permutants as they were initially defined in the set-theoretical and topological environments [,], so that the generalizations defined in the following sections do not require consulting the references.
Let X be a non-empty set, be a subspace of
endowed with the topology induced by the distance
and G be a subgroup of
with respect to the composition of functions.
Definition 1.
We say that is a perception pair.
The elements of are often called measurements. The fact that X is the common domain of all maps in will be expressed as dom. The space of measurements endows X and (and, therefore, every subgroup G of ) with topologies induced, respectively, by the extended pseudometrics
and
It is known that each is an isometry of X [].
Definition 2.
Let and be perception pairs with and , and be a group homomorphism. An operator is said to be a group equivariant non-expansive operator (GENEO, for short) from to with respect to T if
and
For the sake of conciseness, we often write a GENEO as . An operator that satisfies the first condition in this definition is called a group equivariant operator (GEO, for short), while one satisfying the second condition is said to be non-expansive.
The set of all GENEOs , with respect to a fixed homomorphism T, is a metric space with the distance function given by
A method to build GENEOs employing the concept of a permutant is illustrated in []. If G is a subgroup of , then the conjugation map given by , , plays a key role in this technique.
Definition 3.
Let H be a finite subset of . We say that H is a permutant for G if or for every ; i.e., for every and .
Example 1.
Let Φ be the set of all functions that are non-expansive with respect to the Euclidean distances on and . Let us consider the group G of all isometries of , restricted to . If h is the clockwise rotation of ℓ radians for a fixed ℓ, then the set is a permutant for G.
Other examples of permutants will be given in Example 10, Example 11, and Proposition 4.
We recall the following result. As usual, in the following, we will denote the set of all functions from the set A to the set B by the symbol .
Proposition 1.
Let be a perception pair with . If H is a non-empty permutant for , then the restriction to Φ of the operator defined by
is a GENEO from to with respect to , provided that .
3. Generalized Permutants in the Set-Theoretical Setting
As revealed in Section 2, the notion of a permutant originally referred to a single perception pair. This section introduces a generalization of the concept of a permutant to the case of distinct perception pairs and , and shows how it can be used to populate the space of GENEOs. In particular, Section 3.1 defines an equivalence relation among maps and recognizes a generalized permutant as a union of equivalence classes; Section 3.2 connects this notion with the action of the group G; and Section 3.3 recalls (Definition 6) and generalizes (Definition 7) the notion of a permutant measure to this new context.
Definition 4.
Let , and , be perception pairs and be a group homomorphism. A finite set of functions is called a generalized permutant for T if or for every , and every .
In this case, we have the following commutative diagram:
We observe that the map is a bijection from H to H for any .
Definition 4 extends Definition 3 in two different directions. First, it does not require that the origin perception pair and the target perception pair coincide. Second, it does not require that the elements of the set H are bijections. In Section 5.2, we will see how the concept of generalized permutant can be applied.
Example 2.
Let be two non-empty finite sets, with . Let G be the group of all permutations of X that preserve Y, and K be the group of all permutations of Y. Set and . Assume that takes each permutation of X to its restriction to Y. Define H as the set of all functions such that the cardinality of is smaller than a fixed integer m. Then H is a generalized permutant for T.
In the following two subsections, we will express two other ways to look at generalized permutants, beyond their definition. To this end, we will assume that two perception pairs , and a group homomorphism are given, with and .
3.1. Generalized Permutants as Unions of Equivalence Classes
In view of Definition 4, we can define an equivalence relation ∼ on :
Definition 5.
Let . We say that h is equivalent to , and write , if there is a such that .
It is easy to see that ∼ is indeed an equivalence relation on .
Proposition 2.
A subset H of is a generalized permutant for T if and only if H is a (possibly empty) union of equivalence classes for ∼.
Proof.
Assume that H is a generalized permutant for T. If and , then the definition of the relation ∼ and the definition of generalized permutant imply that as well, and, therefore, H is a union of equivalence classes for ∼. Conversely, if H is a union of equivalence classes for the relation ∼, , and , then , since . As a consequence, H is a generalized permutant for T. □
3.2. Generalized Permutants as Unions of Orbits
The map taking to is a left group action, since and . For every , the set is called the orbit of f. By observing that is the equivalence class of f in for ∼, from Proposition 2 the following result immediately follows.
Proposition 3.
A subset H of is a generalized permutant for T if and only if H is a (possibly empty) union of orbits for the group action α.
The main use of the concept of generalized permutants is expressed by the following theorem, extending Proposition 1.
Theorem 1.
Let , and , be perception pairs, a group homomorphism, and H be a generalized permutant for T. Then the restriction to Φ of the operator defined by
is a GENEO from to with respect to T provided .
3.3. Generalized Permutant Measures
As shown in [], the concept of permutants can be extended to the that of permutant measures, provided that the set X is finite. This is done by the following definition, referring to a subgroup G of the group of all permutations of the set X, and to the perception pair .
Definition 6
([]). A finite signed measure μ on is called a permutant measure with respect to G if each subset H of is measurable and μ is invariant under the conjugation action of G (i.e., for every ).
With a slight abuse of notation, we will denote by the signed measure of the singleton for each . The next example shows how we can apply Definition 6.
Example 3.
Let us consider the set X of the vertices of a cube in , and the group G of the orientation-preserving isometries of that take X to X. Set . Let be the three planes that contain the center of mass of X and are parallel to a face of the cube. Let be the orthogonal symmetry with respect to , for . We have that the set is an orbit under the action expressed by the map α defined in Section 3.2. We can now define a permutant measure μ on by setting , where c is a positive real number, and for any with . We also observe that while the cardinality of G is 24, the cardinality of the support of the signed measure μ is 3.
The concept of permutant measures is important because it makes available the following representation result.
Theorem 2.
Assume that transitively acts on the finite set X and F is a map from to . The map F is a linear, group equivariant, non-expansive operator from to with respect to the homomorphism if and only if a permutant measure μ exists such that for every , and .
We now state a definition that extends the concept of permutant measures.
Definition 7.
Let X, Y be two finite non-empty sets. Let us choose a subgroup G of , a subgroup K of , and a homomorphism . A finite signed measure μ on is called a generalized permutant measure with respect to T if each subset H of is measurable and for every .
Definition 7 extends Definition 6 in two different directions. First, it does not require that the origin perception pair and the target perception pair coincide. Second, the measure is not defined on but on the set .
Example 4.
Let be two non-empty finite sets, with . Let G be the group of all permutations of X that preserve Y, and K be the group of all permutations of Y. Set and . Assume that takes each permutation of X to its restriction to Y. For any positive integer m, define as the set of all functions such that the cardinality of is equal to m. For each , let us set . Then μ is a generalized permutant measure with respect to T.
We can prove the following result, showing that every generalized permutant measure allows us to build a GENEO between perception pairs.
Theorem 3.
Let X, Y be two finite non-empty sets. Let us choose a subgroup G of , a subgroup K of , and a homomorphism . If μ is a generalized permutant measure with respect to T, then the map defined by setting is a linear GEO from to with respect to T. If , then F is a GENEO.
Proof.
It is immediate to check that is linear. Moreover, by applying the change of variable and the equality , for every and every we get
since the map is a bijection from to . This proves that is equivariant.
If ,
The condition is not rare in applications (cf., e.g., Example 3) and is the main reason to build GEOs utilizing (generalized) permutant measures, instead of using the representation of GEOs as G-convolutions and integrating on possibly large groups.
In the following, the aforementioned concepts will be applied to graphs. For the sake of simplicity, we will drop the word “generalized” and use the expression “graph permutant”.
4. GENEOs on Graphs
The definitions of perception pairs (Definition 1), (generalized) permutants (Definition 3, Definition 4), and GENEOs (Definition 2) can be easily applied in a graph-theoretic setting. In most applications where data occur as graphs, these are endowed with a real function (“weight”) defined either on vertices or on edges. Section 4.1 develops a model for graphs with weights assigned to their vertices (-graphs, for short), and Section 4.2 does the same for graphs with weights assigned to their edges (-graphs, for short), often called “weighted graphs” in the literature. The vertex model has implications for the rapidly growing field of graph convolutional neural networks, while the edge model owes its significance to the widely recognized importance of weighted graphs. For either model, several simple examples are provided.
As a graph [], we shall mean a triple , where assigns to each edge of the unordered pair of its end vertices in . Since we only consider simple graphs (i.e., with no loops and no multiple edges) we write to mean . Let us recall that an automorphism g of is a pair , where and are bijections respecting the incidence function . The group of all automorphisms of induces two particular subgroups, here denoted as and , of the groups of permutations of and of . We represent permutations as cycle products.
For any , put
Let a graph with n vertices and m edges be given. By fixing an indexing of the vertices (resp. edges), we can identify (resp. ) with some subgroup of (resp. ), for the sake of simplicity. Analogously, a real function defined on (resp. ) will be represented as an n-tuple (resp. m-tuple) of real numbers. Regardless, we shall denote vertices (resp. edges) by consecutive capital (resp. lowercase) letters and not by numerical indexes.
In this section, a space of real valued functions on will be considered as a subspace of endowed with the sup-norm ; i.e., the real valued functions on the vertex set are given by vectors of length n. Analogously, the symbol will refer to a subspace of endowed with the sup-norm; i.e., the real valued functions on the edge set are given by vectors of length m.
Let G be a subgroup of the group (resp. ) corresponding to the group of all graph automorphisms of . By the previous convention, the elements of G can be considered to be permutations of the set (resp. ).
4.1. GENEOs on Graphs Weighted on Vertices
The concepts of perception pairs, GEOs/GENEOs, and generalized permutants are applied to -graphs in Definitions 8, 9, and 10, respectively.
Definition 8.
Let be a set of functions from to and G be a subgroup of . If is a perception pair, we will call it a -graph perception pair for , and will write .
Definition 9.
Let and be two -graph perception pairs and be a group homomorphism. If is a GEO (resp. GENEO) from to with respect to T, we will say that F is a -graph GEO (resp. -graph GENEO).
Definition 10.
Let and be two -graph perception pairs and be a group homomorphism. We say that is a -graph permutant for T if for every ; that is, for every and .
Let us consider some examples of -graph perception pairs, -graph GENEOs, and -graph permutants.
Example 5.
Consider the graph with vertex set and edge set , (see Figure 1). Its automorphism group is given by
Figure 1.
The graph of Examples 5, 6, and 7. It has four axial symmetries. With different function sets and subgroups of the automorphism group, it gives rise to different vw-graph perception pairs (Examples 5 and 6); Example 7 discusses GENEOs.
Let , and be the subspace of given by
Clearly, for all ; so, is a -graph perception pair for Γ.
The next example shows that we can have different perception pairs with the same graph and the same group.
Example 6.
Let G be as in Example 5 and
Then is a -graph perception pair.
We can now define a simple class of GENEOs.
Example 7.
Let be as in Example 5 and a map F be defined by
If, for all and , we have , then
whence ; and the requirement that entails . Moreover, because of the nature of the norm,
for all , whence F is non-expansive. Therefore, the map F defined above is a -graph GENEO if and only if and .
We now prepare for the first instances of graph permutants in Examples 10 and 11.
Example 8.
Let be the cycle graph with . Its automorphism group is given by
and is a subgroup of .
If is the same as in Example 5, then is not a -graph perception pair. However, if we define
then , and, therefore, , are -graph perception pairs.
Example 9.
Let G be as in Example 8 and
Then is a -graph perception pair.
Example 10.
Let G be as in Example 8 and
Then H is a -graph permutant for .
Example 11.
Let Γ be as in Example 8 and
be the Klein 4-group contained in . If
then H is a -graph permutant for .
As usual, in the following, we will denote by the complete graph on n vertices.
Proposition 4.
Let and be the set of all transpositions of . Then H is a -graph permutant for .
Proof.
Let and ; we show that . Let us put for some , and . Then
Take , different from both C and D; since g is bijective, and . We thus have
whence , as required. □
As stated in Theorem 1—which holds also in the graph-theoretical context, having a purely set-theoretical proof—the concept of a -graph permutant can be used to define -graph GENEOs.
Example 12.
Let be the same as in Example 9 and H be the same as in Example 10. Set . Then ; therefore, by Theorem 1, F is a -graph GENEO.
4.2. GENEOs on Graphs Weighted on Edges
The concepts of perception pairs, GEOs/GENEOs, and generalized permutants can be applied to -graphs as well, as in Definitions 11, 12, and 13, respectively. Theorem 1 holds also in this case.
Definition 11.
Let be a set of functions from to and G be a subgroup of . If is a perception pair, we will call it an -graph perception pair for , and will write .
Definition 12.
Let and be two -graph perception pairs and be a group homomorphism. If is a GEO (resp. GENEO) from to with respect to T, we will say that F is an -graph GEO (resp. -graph GENEO).
Definition 13.
Let and be two -graph perception pairs and be a group homomorphism. We say that is an -graph permutant for T if for every ; that is, for every and .
The group of all graph automorphisms of a graph induces a particular subgroup of the group of all permutations of . The elements of can be considered to be those permutations of that directly correspond to the permutations of defining all graph automorphisms of .
If , the complete graph with n vertices, the group is isomorphic to , and we have
Therefore, we will consider and to be the same in this case.
Let us consider some examples of perception pairs and GENEOs in the context of -graphs. Complete graphs are of particular interest because every simple graph with n vertices is a subgraph of and so can be identified by a map from the edge set of to (Section 5.1).
Example 13.
Let with , and (see Figure 2), and consider the group together with the space of the functions with opposite values on the two edges fixed by the elements of G. Clearly, , and is an -graph perception pair.
Figure 2.
The complete graph . Each vertex permutation induces an automorphism of it. Example 13 endows it with a structure of an ew-graph perception pair and Example 14 discusses the possible GENEOs on it.
Example 14.
Let be as in Example 13 and consider the map F defined by
In order that , we should have , and the requirement that F be equivariant with respect to G entails and .
Moreover, a simple computation shows that
for all , whence F is non-expansive.
Therefore, the map F defined above is an -graph GENEO if and only if , , and .
5. Experiments
This section illustrates the model of Section 4.2 and shows how graph GENEOs allow one to extract useful information from graphs. This can be done by “smart forgetting” of differences, either by some sort of average, but keeping the same dimension of the space of functions (as in Section 5.1), or by dimension reduction (as in Section 5.2). It should be noted that these are not new findings or results comparable with competitors, but just suggestions, by toy examples, of the possible use of the new tools provided in this paper. In particular, Section 5.1 analyzes the information that is preserved by a certain permutant on isomorphism classes of graphs with four vertices. Section 5.2 counts all possible generalized permutants relative to a pair of cycle graphs.
5.1. Subgraphs of
The choice of a permutant determines how different functions are mapped to the same “signature” by the corresponding GENEO. In this subsection, we consider functions on the edge set of a complete graph , taking values that are either 0 or 1; this means that each such function identifies a subgraph of . A GENEO will, in general, produce functions that can have any real value, so no longer representing subgraphs. Intending to obtain equal results for “similar” subgraphs, we have chosen as a permutant the set of edge permutations produced by swapping two vertices in any possible way.
Let be the complete graph (Figure 2) with . We have
The subset of consisting of permutations of induced by all transpositions of is an -graph permutant for . Therefore, the operator defined by
is an -graph GENEO.
Subgraphs of can be represented by elements of
and the restriction of F to can be used to draw meaningful comparisons between them (see Figure 3). The following Definition 14 makes the discussion more fluid.
Figure 3.
The subgraphs of up to isomorphisms, the 6-tuples representing each of these (above), and their -codes (multiplied by 6, below). On each column there is a pair of complementary subgraphs, except the rightmost, which shows the only graph that is self-complementary (up to isomorphism).
Definition 14.
We say that the image is an -code for the subgraph of . An -code is said to be -equivalent to an -code (written ) if is the result of a permutation of . The -code is called the reversal of . Let ; we say that and are complementary if .
Clearly, is an equivalence relation.
A simple program enabled us to compute all -codes and to find that:
- Naturally enough, isomorphic subgraphs have -equivalent codes. Therefore, in some cases, it suffices to consider only the 11 non-isomorphic subgraphs of (see Remark 1);
- Complementary subgraphs (i.e., subgraphs having vertex sets coinciding with and edge sets forming a partition of ) have complementary codes;
- There is only one case, up to graph isomorphisms, in which non-isomorphic subgraphs of have -equivalent codes: and with and . In this case, the graphs are complementary as well, which explains why we have equivalent codes despite the graphs being non-isomorphic. Moreover, and are reversals of each other, and so are the corresponding codes;
- If is a reversal of , then is a reversal of .
Remark 1.
For example, the third graph of the upper row in Figure 3 consists of the two adjacent edges t and u and is represented by with . The isomorphic graph consisting of edges p and r (not shown) is represented by , with . Their -codes are -equivalent, and are not -equivalent to the -code of a graph consisting of two non-adjacent edges—like the fourth in the upper row of Figure 3—although the representing 6-tuples obviously are permutations of each other.
It was also possible to compute -codes for the 34 non-isomorphic subgraphs of , and to find that they were never -equivalent. A similar statement holds for the complete graph .
5.2. Graph GENEOs for and
All examples in Section 4.1, Section 4.2, and Section 5.1 were built on a single perception pair each. Still, the ground reason for using GENEOs is that of a “smart forgetting” of differences that are considered inessential. This can better be done by dimension reduction of the space of functions. This is where the use of two perception pairs comes into play. This subsection is meant to illustrate the application of the generalized notion of permutants (Section 3) by mapping the edges of a small, auxiliary graph (the cyclic graph ) to the edges of the graph of interest (the cyclic graph ; see Figure 4). Note that we have great freedom, in that we are not bound to stick to graph homomorphisms: permutants are built as equivalence classes of maps from to that do not necessarily respect adjacencies.
Figure 4.
The cycle graphs and . They have several axial and rotational symmetries. All possible maps from to give rise to generalized permutants.
Let be the cycle graph (see Figure 4) with , and be the cycle graph with ,
Their automorphisms groups, respectively, are the dihedral groups
where , and .
Let us put , and also put and , and consider the group homomorphism given by and .
There are 216 functions and the equivalence class of each (in the sense of Definition 5) is an -graph permutant (Section 3.1). For the sake of conciseness, we will denote the function simply by . For example, will be written as .
The -graph permutants with are of four possible sizes:
- There is only one -graph permutant with two elements. It corresponds to the function ;
- There is only one -graph permutant with four elements. It is induced by ;
- There are five -graph permutants with six elements each that correspond to the functions , and ;
- There are 15 -graph permutants with 12 elements each that correspond to the functions , , , , , , , , , , , , , , and .
Considering only the weights in , it was possible to compute the -graph GENEOs corresponding to the functions and . Similar computations can be made for the rest of the functions listed above. This detailed analysis of particular functions raised several questions and conjectures that we plan to study in the near future.
6. Discussion
This research aimed at extending the existing theory of Group Equivariant Non-Expansive Operators (GENEOs) in two directions:
- A general definition of permutant as a tool for producing GENEOs between two perception pairs (Theorem 1), while the original definition was limited to a single perception pair;
- The adaptation of the theory to graphs with a weight function defined either on vertices (Section 4.1) or on edges (Section 4.2).
Since every simple graph with n vertices can be identified with an edge-weighted subgraph of the complete graph , where the weight function has as a range, permutants and GENEOs were used to analyze the set of subgraphs of (Section 5.1). A simple example of the construction of generalized permutants on graphs was also produced (Section 5.2).
An evident limitation of the presented GENEOs and permutants is that they are not aimed at particular graph-theoretical problems; they are just first, simple examples.
Here is a list of open problems:
- Is every GENEO between two perception pairs realizable as a combination of GENEOs coming from (generalized) permutants or permutant measures?
- What are other interesting permutants on ?
- Are there permutants that can help determine subgraphs of a given graph, with specified properties (e.g., being connected, Eulerian, Hamiltonian, etc.)?
- Can permutants and GENEOs help in refining the search for isomorphic graphs?
Apart from tackling these problems, a natural goal is to apply GENEOs and permutants to concrete problems where data occur as weighted graphs.
The repository https://gitlab.com/patrizio.frosini/graph-geneos contains the C++ programs used here (accessed on 5 December 2023).
Author Contributions
Conceptualization, methodology, investigation, writing—original draft preparation, F.A., M.F. and P.F.; software, F.A.; writing—review and editing, M.F. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Data Availability Statement
The data presented in this study are openly available in https://gitlab.com/patrizio.frosini/graph-geneos (accessed on 5 December 2023).
Acknowledgments
This work was performed under the auspices of INdAM-GNSAGA and within a collaboration with Huawei through the CNIT Joint Innovation Center.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Bronstein, M.M.; Bruna, J.; LeCun, Y.; Szlam, A.; Vandergheynst, P. Geometric Deep Learning: Going beyond Euclidean data. IEEE Signal Process. Mag. 2017, 34, 18–42. [Google Scholar] [CrossRef]
- Bronstein, M. Geometric foundations of Deep Learning. 2022. Available online: https://towardsdatascience.com/geometric-foundations-of-deep-learning-94cdd45b451d (accessed on 5 December 2023).
- Kratsios, A.; Papon, L. Universal approximation theorems for differentiable geometric deep learning. J. Mach. Learn. Res. 2022, 23, 8896–8968. [Google Scholar]
- Holzinger, A.; Saranti, A.; Molnar, C.; Biecek, P.; Samek, W. Explainable AI methods-a brief overview. In International Workshop on Extending Explainable AI Beyond Deep Models and Classifiers; Springer: Berlin/Heidelberg, Germany, 2022; pp. 13–38. [Google Scholar]
- Bergomi, M.G.; Frosini, P.; Giorgi, D.; Quercioli, N. Towards a topological–geometrical theory of group equivariant non-expansive operators for data analysis and machine learning. Nat. Mach. Intell. 2019, 1, 423–433. [Google Scholar] [CrossRef]
- Sergeant-Perthuis, G.; Maier, J.; Bruna, J.; Oyallon, E. On Non-Linear operators for Geometric Deep Learning. Adv. Neural Inf. Process. Syst. 2022, 35, 10984–10995. [Google Scholar]
- Gerken, J.E.; Aronsson, J.; Carlsson, O.; Linander, H.; Ohlsson, F.; Petersson, C.; Persson, D. Geometric deep learning and equivariant neural networks. Artif. Intell. Rev. 2023, 56, 14605–14662. [Google Scholar] [CrossRef]
- Villar, S.; Hogg, D.W.; Storey-Fisher, K.; Yao, W.; Blum-Smith, B. Scalars are universal: Equivariant machine learning, structured like classical physics. Adv. Neural Inf. Process. Syst. 2021, 34, 28848–28863. [Google Scholar]
- Chen, D.; Davies, M.; Ehrhardt, M.J.; Schönlieb, C.B.; Sherry, F.; Tachella, J. Imaging With Equivariant Deep Learning: From unrolled network design to fully unsupervised learning. IEEE Signal Process. Mag. 2023, 40, 134–147. [Google Scholar] [CrossRef]
- Stärk, H.; Ganea, O.; Pattanaik, L.; Barzilay, R.; Jaakkola, T. Equibind: Geometric deep learning for drug binding structure prediction. In Proceedings of the International Conference on Machine Learning, PMLR, Baltimore, MD, USA, 17–23 July 2022; pp. 20503–20521. [Google Scholar]
- Quercioli, N. Some new methods to build group equivariant non-expansive operators in TDA. In International Conference on Topological Dynamics and Topological Data Analysis; Springer: Berlin/Heidelberg, Germany, 2018; pp. 229–238. [Google Scholar]
- Bouazzaoui, H.; Mamouni, M.I.; Elomary, M.A. Bongard Problems: A Topological Data Analysis Approach. WSEAS Trans. Syst. Control 2020, 15, 131–140. [Google Scholar] [CrossRef]
- Micheletti, A. A new paradigm for artificial intelligence based on group equivariant non-expansive operators. Eur. Math. Soc. Mag. 2023, 128, 4–12. [Google Scholar] [CrossRef]
- Chacholski, W.; De Gregorio, A.; Quercioli, N.; Tombari, F. Landscapes of data sets and functoriality of persistent homology. Theory Appl. Categ. 2020, 39, 667–686. [Google Scholar]
- Vertechi, P.; Bergomi, M.G. Parametric machines: A fresh approach to architecture search. arXiv 2020, arXiv:2007.02777. [Google Scholar]
- Vertechi, P.; Bergomi, M.G. Machines of finite depth: Towards a formalization of neural networks. In Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA, 7–14 February 2023; Volume 37, pp. 10061–10068. [Google Scholar]
- Zhang, Z.; Cui, P.; Zhu, W. Deep learning on graphs: A survey. IEEE Trans. Knowl. Data Eng. 2020, 34, 249–270. [Google Scholar] [CrossRef]
- Georgousis, S.; Kenning, M.P.; Xie, X. Graph deep learning: State of the art and challenges. IEEE Access 2021, 9, 22106–22140. [Google Scholar] [CrossRef]
- Wu, L.; Cui, P.; Pei, J.; Zhao, L. Graph Neural Networks: Foundations, Frontiers, and Applications; Springer Nature: Singapore, 2022. [Google Scholar]
- Conti, F.; Frosini, P.; Quercioli, N. On the construction of group equivariant non-expansive operators via permutants and symmetric functions. Front. Artif. Intell. 2022, 5, 786091. [Google Scholar] [CrossRef] [PubMed]
- Bocchi, G.; Botteghi, S.; Brasini, M.; Frosini, P.; Quercioli, N. On the finite representation of linear group equivariant operators via permutant measures. Ann. Math. Artif. Intell. 2023, 91, 465–487. [Google Scholar] [CrossRef]
- Bondy, J.A.; Murty, U.S.R. Graph Theory with Applications; Macmillan: London, UK, 1976; Volume 290. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).