Next Article in Journal
Quasi-Semilattices on Networks
Next Article in Special Issue
On the Noteworthy Properties of Tangentials in Cubic Structures
Previous Article in Journal
Common Fixed Point Results on a Double-Controlled Metric Space for Generalized Rational-Type Contractions with Application
Previous Article in Special Issue
The Recursive Structures of Manin Symbols over Q, Cusps and Elliptic Points on X0 (N)
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Robust Topological Denoising Method Based on Homotopy Theory for Virtual Colonoscopy

1
Department of Computer Science, Winona State University, Winona, MN 55906, USA
2
International School of Information Science & Engineering, Dalian University of Technology, Dalian 116620, China
3
Department of Computer Science, Stony Brook University, Stony Brook, NY 11794, USA
*
Author to whom correspondence should be addressed.
Axioms 2023, 12(10), 942; https://doi.org/10.3390/axioms12100942
Submission received: 4 August 2023 / Revised: 16 September 2023 / Accepted: 27 September 2023 / Published: 30 September 2023
(This article belongs to the Special Issue Discrete Curvatures and Laplacians)

Abstract

:
Virtual colonoscopy plays an important role in polyp detection of colorectal cancer. Noise in the colon data acquisition process can result in topological errors during surface reconstruction. Topological denoising can be employed to remove these errors on surfaces for subsequent geometry processing, such as surface simplification and parameterization. Many methods have been proposed for this task. However, many existing methods suffer from failure in computation of all the non-trivial loops, due to high genus or complex topological structures. In this paper, we propose a novel robust topological denoising method for surfaces based on homotopy theory. The proposed method was evaluated on two datasets of colon meshes. We compared our method with the State-of-the-Art persistent-homology-based method. Our method can successfully compute the loops on all colon data for topological denoising, whereas the persistent homology method fails on some colon data. Moreover, our method detects all loops with shorter lengths than those detected by the persistent homology method. Our experimental results show that the proposed method is effective and robust in topological denoising, and that it has the potential for practical application to virtual colonoscopy.

1. Introduction

In the medical imaging field, virtual colonoscopy (VC) plays an important role in detecting polyps for colorectal cancer. Studies use CT images and various computerized methods to assist in the detection of polyps. Methods based on topographical height map [1], polyp-specific volumetric feature [2], ensemble learning [3], morphological features [4], and integration with optical colonoscopy [5] have been explored in the field. Some other studies have focused on the improvement of VC by using an immersive analytics system [6] and a deep learning framework [7,8]. A recent study also investigated the feasibility of the automated detection of clinically significant polyps from photon-counting CT data [9]. One of the representative forms of colon data is based on colon surface mesh, which is reconstructed from computed tomography (CT) scans. Such surface-based colon data processing methods highly depend on the quality of the reconstructed colon surface, such that it is without topological noises or errors. With the rapid advances in data acquisition techniques in recent decades, high resolution of three-dimensional data has been produced for various applications, including real-time vision processing [10], industrial application [11], textured 3D mesh generation [12], blood flow simulation [13], cardiac structure reconstruction [14], robotic 3D reconstruction of an object [15], ceramics analysis and reconstruction [16], and unmanned-aerial-vehicles-based 3D reconstruction [17], etc. However, many existing surface reconstruction methods introduce topological noises or errors into the resulting reconstructed surfaces, which makes it intractable to perform subsequent computation tasks, such as surface simplification and parameterization.
As one important geometry processing technique, topological denoising aims to decrease or remove topological noises, usually in the form of small handle loops, so that a lower-genus or genus-zero resulting model can be generated. Success in the topological denoising process significantly rests on the efficient computation of those non-trivial loops, followed by robust genus reduction, such as cutting along the loops. In regard to computation of non-trivial loops on surfaces, we have witnessed a variety of methods in recent decades. Some of these methods are based on homotopy and homology [18,19,20], and some are based on graph structures, such as curve skeletons [21], core graph [22,23], and Reeb graph [24].
Chen et al. [19] proposed a method to compute loops using persistent homology. The method employed the greedy algorithm, to compute the optimal homology basis. Dey et al. [20] presented a geometry-aware method, to compute handle and tunnel loops, which aimed to balance computation between topological correct loops and geometrically relevant loops. They applied the proposed method to topology simplification and to handle and tunnels feature identification. In addition to these methods based on homology, researchers have proposed graph-based methods. Zhou et al. [21] introduced a loop detection algorithm, using skeletons based on the medial axis for topological denoising or repair. The advantages of this method are: (1) it will not introduce additional invalid handles; (2) it can process large surface models with high resolutions, efficiently. However, this method cannot be used in models whose medial axis forms closed surfaces. Dey et al. [22,23] designed a handle and tunnel loop computation method on graph retractable surfaces, which employed a linking condition with the core graphs. They demonstrated the effectiveness of their method by applying it to feature detection and topology simplification. Later, Dey et al. [24] utilized Reeb graphs to compute handle and tunnel loops. Their method is computationally efficient, without requiring any 3D tessellation. More recently, Weinrauch et al. [25] proposed a variational abstraction to the loop shrinking property for detection of handle and tunnel loops. Their method utilizes a succinct diffuse interface model for loop detection and a fully parallel algorithmic realization. However, some limitations exist in these methods, which lie in either non-guaranteed computation of non-trivial loops, in terms of some geometrically meaningful requirements, or even failure in the computation of all the non-trivial loops, due to very high genus or complex topological structures.
In recent decades, topological denoising has attracted wide attention from the medical community. In cardiac image analysis, where the trabeculae structure is naturally a topological handle, Gao et al. [26] used persistent homology to localize the trabeculae. Wu et al. [27] formulated the computation of the optimal cycles of persistent homology classes for trabeculae detection. These methods can be applied for better understanding the functionality of the human heart and for diagnosing cardiac diseases. In biotechnology, Brezovsky et al. [28] reviewed some tools for identification of the protein tunnels and channels, as it is important to understand the relationship between structure and function and to design potential proteins that have improved functional properties. A tool named CHUNNEL can be used to identify the loop running around the narrowest part of the protein channel. Topologically denoised 3D data can be flattened to a 2D domain for supplementary information or views [29,30,31,32,33,34,35,36,37,38]. In virtual colonoscopy, flattening the 3D colon wall surface into a 2D domain, via surface parameterization, not only benefits visualization—which assists in detection of abnormality, such as colorectal polyps—but also enables the computation of supplementary geometric and texture features in the 2D flattened colon wall, for improved computer-aided detection of polyps. One important pre-processing step is to perform topological denoising on the original 3D colon wall surface, so that the small handle loops on the surface are removed, to obtain a genus-zero surface for subsequent colon wall flattening. To this end, some existing works [35,37,39] have employed the homotopy-based topological denoising method for genus reduction, followed by surface flattening using conformal parameterization. Although the existing methods are capable of computing the small handle loops in the colon wall and performing topological denoising to reduce the genus of the surface, it is still challenging, but desirable, to obtain a robust topological denoising method.
In this work, we propose a novel robust topological denoising method for virtual colonoscopy. The algorithm is detailed in some steps involving computations of cut graph, shortest loops, and topological surgery. Experiments on two datasets were carried out, for evaluation of the proposed method. The main contributions in this paper are as follows:
(1)
Mathematical rigor. Our proposed method is based on rigorous mathematical theory in homotopy, which guarantees the computation of the non-trivial loops.
(2)
Novel framework. The proposed algorithm is novel and has been first applied to colon surface denoising in virtual colonoscopy.
(3)
Robust computation. Compared to the State-of-the-Art topological denoising method, our method is more robust, based on the experimental results.

2. Materials and Methods

2.1. Theoretic Background

This section briefly explains the basic concepts and theorems in algebraic topology. For more thorough treatments, we refer readers to a classical algebraic textbook [40].
Suppose S is a topological surface, and a path is a continuous map γ : [ 0 , 1 ] S ; if the starting point coincides with the ending point, γ ( 0 ) = γ ( 1 ) , then γ is a closed curve (loop).
Definition 1 (Homotopy).
Let γ 1 , γ 2 : [ 0 , 1 ] S be two curves. A homotopy connecting γ 1 and γ 2 is a continuous mapping F : [ 0 , 1 ] × [ 0 , 1 ] S , such that
F ( 0 , t ) = γ 1 ( t ) , F ( 1 , t ) = γ 2 ( t ) .
We say γ 1 is homotopic to γ 2 if there exists a homotopy between them, and we denote it as γ 1 γ 2 .
Homotopy relation is an equivalence relation. We fix a base point p on the surface. In the following, we consider all the loops through the base point, denoted as Γ . All the loops in Γ can be classified by the homotopy equivalence relation, and the homotopy class of γ Γ is denoted as [ γ ] .
Given two loops γ 1 , γ 2 Γ through the base point p, we can concatenate them to form a bigger loop, which is the product of the two loops, denoted as γ 1 · γ 2 . There is a special loop e for all t [ 0 , 1 ] , e ( t ) = p , which is called the trivial loop. It is evident that e · γ = γ · γ = γ for any loop γ . Suppose γ Γ is a loop on S, then its inverse is obtained by reversing the orientation γ 1 Γ , γ 1 ( t ) = γ ( 1 t ) . It is easy to verify that γ · γ 1 e and γ 1 · γ e . All the homotopy classes of Γ under the product operator form a group.
Definition 2 (Fundamental Group).
Given a topological space S, fix a base point p S ; the set of all the loops through p is Γ, and the set of all the homotopy classes is Γ / . The product is defined as
[ γ 1 ] · [ γ 2 ] : = [ γ 1 · γ 2 ] ,
the unit element is defined as [ e ] , and the inverse element is defined as
[ γ ] 1 : = [ γ 1 ] ;
then, Γ / forms a group, the fundamental group of S, and is denoted as π 1 ( S , p ) .
In the following, we show the generators and relators of the fundamental group π 1 ( S , p ) . Suppose S is an oriented closed surface, then the number of handles of S is called the genus of the surface. Suppose γ 1 ( t ) , γ 2 ( τ ) S intersect at q S , the tangent vectors satisfy
d γ 1 ( t ) d t × d γ 2 ( τ ) d τ · n ( q ) > 0 ;
then, the index of the intersection point q of γ 1 and γ 2 is + 1 , denoted as Ind ( γ 1 , γ 2 , q ) = + 1 . If the mixed product is zero or negative, then the index is 0 or 1 .
Definition 3 (Algebraic Intersection Number).
The algebraic intersection number of γ 1 ( t ) , γ 2 ( τ ) S is defined as
γ 1 γ 2 : = q i γ 1 γ 2 I n d ( γ 1 , γ 2 , q i ) .
Definition 4 (Canonical Basis).
Suppose S is a compact and oriented surface, then there exists a set of generators of the fundamental group π 1 ( S , p ) ,
G = { [ a 1 ] , [ b 1 ] , [ a 2 ] , [ b 2 ] , , [ a g ] , [ b g ] } ,
such that
a i b j = δ i j , a i a j = 0 , b i b j = 0 ,
where a i b j represents the algebraic intersection number of loops a i and b j , and where δ i j is the Kronecker symbol; then, G is called a set of the canonical basis of π 1 ( S , p ) .
Figure 1 shows a genus-2-oriented compact surface S, through the base point q S . On each handle, there are two loops, a i and b i , such that the algebraic intersection number of a i and b i is + 1 , that of a i and a j is 0, that of b i and b j is 0, and that of a i and b j on different handles is 0. By deforming each a i and b j , we can slice the surface to get a topological octagon, and its boundary is
a 1 b 1 a 1 1 b 1 1 a 2 b 2 a 2 1 b 2 1 .
The set of loops { a 1 , b 1 , a 2 , b 2 } is called a canonical basis of π 1 ( S , q ) . The number of handles of a surface is called the genus of the surface. The above observation can be directly generalized to high-genus surfaces.
Theorem 1 (Surface Fundamental Group Canonical Representation).
Suppose S is a compact and oriented surface with genus g, that q S is the base point, and that the fundamental group has a canonical representation,
π 1 ( S , p ) = a 1 , b 1 , a 2 , b 2 , , a g , b g | Π i = 1 g [ a i , b i ] ,
where the a i values and the b j values form a set of canonical basis through q; furthermore,
[ a i , b i ] = a i b i a i 1 b i 1 .
Suppose a compact surface S is embedded in the three-dimensional Euclidean space E 3 , and it has the induced Euclidean metric g . Suppose p and q are two points close enough to each other, then there is a unique shortest path γ connecting them, which is called the geodesic between them. Given a path γ , if for any point γ ( t ) there is a small neighborhood [ t ε , t + ε ] , the restriction of γ on it is geodesic, and then γ is called a (global) geodesic.
Definition 5 (Exponential Map).
Let v T p S be a tangent vector to the surface at p; there is a unique geodesic γ v satisfying γ v ( 0 ) = p with initial tangent vector γ v = v . The corresponding exponential map is defined by
exp p ( v ) = γ v ( 1 ) .
Definition 6 (Cut Locus).
Fix a point p in a complete Riemannian surface ( S , g ) , and consider the tangent plane T p S . The cut locus of p in the tangent space is defined to be the set of all vectors v in T p M , such that γ ( t ) = exp p ( t v ) is a minimizing geodesic for t [ 0 , 1 ] but fails to minimize for t = 1 + ε for any ε > 0 . The cut locus of p in S is defined to be the image of the cut locus of p in the tangent space under the exponential map at p.
Namely, the cut locus of p in S is the point in the surface where the geodesics starting at p stop being minimized.
Our proposed method is based on the following theorem:
Theorem 2 (Main).
Suppose a smooth surface ( S , g ) is oriented and compact, p S is an arbitrarily chosen base point, and the cut locus of p in S is denoted as C . Suppose γ : [ 0 , 1 ] S is a non-trivial loop on S, then γ intersects with the cut locus C .
Proof. 
Suppose the cut locus of p in the tangent plane is c, then c is a loop on T p S and the interior of c is a planar simply connected open set, denoted as Ω . The exponential map exp p : T p S S restricted on Ω maps Ω to S \ C . Because the exponential map is diffeomorphic in Ω , S \ C is also simply connected.
If a loop γ S has no intersection with the cut locus C , then γ S \ C . But π 1 ( S \ C , p ) = e , therefore γ is trivial, which contradicts the assumption that γ is non-trivial. Hence, γ must intersect the cut locus.    □

2.2. Overview

The pipeline of the proposed topological denoising method is illustrated in Figure 2. We use a simple genus-2 mesh model for illustration purpose, to show the detected loops using our iterative method in two iterations. For higher-genus colon mesh data where the number of genus n > 2 , the proposed method operates in a similar fashion for n iterations. The algorithm of each step is detailed in the following section.

2.3. Algorithms

In this section, we explain our computational algorithm for topological denoising. The volumetric CT images are segmented using the GraphCut method; then, the colon surface is reconstructed, using the MarchingCube algorithm. Hence, the input surface is represented as a simplicial complex (triangle mesh).
Definition 7 (Simplex).
An n-dimensional simplex σ = [ v 0 , v 1 , , v n ] is defined as the convex hull of its vertices, namely,
[ v 0 , v 1 , , v n ] = λ 0 v 0 + λ 1 v 1 + + λ n v n | i = 0 n λ i = 1 , λ i 0 .
The boundary of a simplex σ is a set of lower-dimensional simplices, σ = [ v 0 , v 1 , , v n ] = i = 0 n ( 1 ) i [ v 0 , , v i 1 , v i + 1 , , v n ] , where the sign represents the parity of the permutation of the vertices of the simplex, and each lower dimensional simplex is called a face of  σ .
Definition 8 (Simplicial Complex).
A simplicial complex K is a set of simplices that satisfies the following conditions:
1.
Every face of a simplex from K is also in K .
2.
The non-empty intersection of any two simplices σ 1 , σ 2 K is a face of both σ 1 and σ 2 .
The algorithm has three major stages: (1) compute the cut locus (cut graph); (2) compute the shortest non-trivial loop; (3) topological surgery, to remove a handle.

2.3.1. Cut Graph

The cut graph is the analogy of a cut locus on a smooth surface. The computation of the cut graph depends on the construction of the Poincaré dual of the input triangle mesh (as shown in Figure 3), which is the generalization of the duality between the Delaunay triangulation and the Voronoi diagram from plane to manifolds.
In a 2-dimensional (2D) plane setting, as shown in Figure 3, let T be a triangulation of the 2D surface S (i.e., a set of black triangles in the right subfigure), and let σ be a simplex of T. A 2D simplex of T containing σ is denoted by Δ (as shown in the left subfigure), and σ can be regarded as a subset of the vertices of Δ . The dual cell σ ¯ corresponding to σ is defined, such that Δ σ ¯ (i.e., the gray region in the left subfigure) is the convex hull in Δ of the barycentres of all subsets of the vertices of Δ that contain σ . It can be checked that if σ is k-dimensional, then σ ¯ is a ( 2 k ) -dimensional cell. Moreover, the dual cells to T (as indicated by the green cells in the right subfigure) form a CW-decomposition of S, and the only ( 2 k ) -dimensional dual cell that intersects a k-cell σ is σ ¯ .
Figure 4 shows an initial cut graph and a pruned cut graph on a genus-2 surface. In detail, given a triangle M, we first construct its Poincaré dual mesh M ¯ , such that each vertex v M is dual to a 2D cell v ¯ M ¯ , each edge e M is dual to an edge e ¯ M ¯ , and each face f M is dual to a vertex f ¯ M ¯ . Second, we take the dual mesh M ¯ as a graph, where each vertex f ¯ is a node and each edge e ¯ is a link, and we then compute a spanning tree T ¯ M ¯ , which links all the nodes without any loop. The dual of the tree T ¯ consists of all the original faces of M, glued along some edges. Because the Poincaré preserves topology and the spanning tree T ¯ is simply connected, the dual of T ¯ is also simply connected; therefore, it is a topological disk consisting of all the faces. Third, for each link e ¯ M ¯ , it may be in or not in the tree. We collect all the links outside the tree, and their dual form is the initial cut graph C , as shown in Figure 4a. Namely, the original mesh is sliced along C and becomes a topological disk. Finally, we simplify the cut graph C , by pruning all the leaves (nodes with only one link in C ) recursively, and we obtain the pruned cut graph, which is shown in Figure 4b. The algorithm pipeline can be found in Algorithm 1. The computational complexity is linear to the number of faces of the input mesh.
Algorithm 1 Algorithm for Cut Graph
Require: A closed triangle mesh M
Ensure:  C is a cut graph of M
  1: Compute the dual mesh M ¯ of the input mesh M;
  2: Compute a spanning tree T ¯ of M ¯ ;
  3: The cut graph is given by C : = { e M | e ¯ T ¯ } ;
  4: Prune all the leaves of C recursively.

2.3.2. Shortest Loop

According to our main Theorem 2, the shortest non-trivial geodesic loop γ must intersect the cut locus C . If we slice the surface along C , then the shortest loop γ becomes the shortest path connecting two boundary points. In discrete cases, we use the shortest path on the triangle mesh to approximate the shortest geodesic, and we use the cut graph to approximate the cut locus.
First, we slice the mesh along the cut graph C , to obtain a topological disk M ˜ , with its boundary denoted as M ˜ . For each vertex v C , we call the number of links in the graph C adjacent to v as the degree of v. After the pruning in Algorithm 1, all the vertex degrees are greater than or equal to 2. Suppose v i C with degree deg ( v i ) = k , then the slicing procedure along C will split v i to k boundary vertices of M ˜ , denoted as { v i 1 , v i 2 , , v i k } . Second, for each v i C for each pair of ( v i j , v i k ) , we can compute the shortest path on M ˜ , using the Dijkstra’s algorithm. Then, we sort the shortest paths according to their total lengths in ascending order. Figure 5 shows the top two shortest loops on the genus-2 surface. The algorithmic pipeline can be found in Algorithm 2.
Algorithm 2 Algorithm for Shortest Loop
Require: A closed triangle mesh M
Ensure: The shortest non-trivial loop γ of M
  1: Compute the cut graph C of M, using Algorithm 1;
  2: Slice M along C , to obtain a simply connected mesh M ˜ ;
  3: for all vertex v i C with deg ( v i ) = k  do
  4:     Find all { v i 1 , v i 2 , , v i k } M ˜ ;
  5:     for all pair ( v i j , v i k ) on the boundary M ˜  do
  6:         Compute the shortest path γ ˜ i j k , using Dijkstra’s algorithm;
  7:         Find the loop γ i j k M corresponding to γ ˜ i j k M ˜ ;
  8:     end for
  9: end for
10: Sort all the shortest loops γ i j k in ascending order by their total lengths;
11: Return the shortest loop γ .

2.3.3. Topological Surgery

Once we have found the shortest loop γ on the current mesh M, we can slice M along γ to produce a mesh M γ , where γ corresponds to two boundary components of M γ , namely, γ 0 and γ 1 . For the boundary component γ k , k = 0 , 1 , we compute the mass center of all its vertices, denoted as w k . For each edge e γ k , we connect e with w k , to form a triangle. All such triangles form a topological disk D k . In this way, we fill the boundary component γ k with the topological disk D k . After the hole filling, the genus of the resulting mesh M γ is reduced by one. The details are formulated in Algorithm 3.
Algorithm 3 Algorithm for Topological Surgery
Require: A closed triangle mesh M, a non-trivial loop γ
Ensure: A mesh N with one handle removed from M
  1: Slice M along γ to obtain a mesh M γ , M γ = γ 0 γ 1 ;
  2: for all boundary component γ k , k = 0 , 1  do
  3:      w k 0 ;
  4:     for all vertex v i γ k  do
  5:          w k w k + v i ;
  6:     end for
  7:      w k w k / | γ k | ;
  8:     for all edge e j γ k  do
  9:          e j and w k form a triangle face f j k ;
10:          M γ M γ f j k ;
11:     end for
12: end for
13: N M γ .
We combine the above algorithms, to form the topological denoising algorithm in Algorithm 4. First, we compute the Euler number of the mesh ( M ) = | V | + | F | | E | , and we find the genus of the surface by ( S ) = 2 2 g , where g is the genus of the surface. Second, we find the shortest loop γ on the current mesh. Third, we perform topological surgery along γ , to remove one handle. We repeat this procedure until the genus equals zero.
Algorithm 4 Topological Denoising Algorithm
Require: A high-genus closed triangle mesh M
Ensure: The mesh N with all handles removed from M
  1: Compute the Euler number ( M ) and the genus g of M;
  2: Set M 1 M ;
  3: for  k = 1 , 2 , , g  do
  4:     Compute the shortest loop γ k on M k , using Algorithm 2;
  5:     Perform topological surgery on M k along γ k , to obtain M k + 1 , using Algorithm 3;
  6: end for
  7: Set N M g + 1 .

3. Results

All the experiments in this work were carried out on a Ubuntu 20.04 operating system with an AMD Ryzen 7 2700X Eight-Core Processor at 3.7 GHz and 64 GB RAM. The mesh models used in the experiments included general test models for visual illustration and two datasets of colon meshes. The first colon dataset included 10 colon meshes with an average of 100K faces (or triangles). The second colon dataset had a total number of 20 colon meshes with an average of 1000K faces (or triangles). We compared our proposed method to the State-of-the-Art persistent-homology-based method in [24].

3.1. Visual Evaluation on General Test Models

To evaluate the proposed method, we first show the visual evaluation results of the general test models, as they have small numbers of genuses and are easy for visual recognition. Figure 6 shows the general test models, with detected loops highlighted in color. Their topological information is reported in Table 1. The number of faces (or triangles) varies from 2 K to 120 K, and the genuses span from 2 to 6. Given a genus n closed surface, there are n handle loops. As observed from the results in Figure 6, the number of the detected loops in the highlighted color is the same as the numbers of genuses reported in Table 1. Thus, our method can compute all loops correctly.
In the next subsection, we will show the capability of our proposed method for detecting the loops on medical colon datasets and for performing topological denoising for further colon wall flattening in virtual colonoscopy.

3.2. Topological Denoising for Two Colon Datasets

We further evaluated our method on two datasets of colon meshes, which had more complex shapes and high genuses. The colon meshes were reconstructed from CT images in virtual colonoscopy. Figure 7 (left) shows a colon wall mesh with topological noises denoted by green loops. Figure 7 (middle, right) shows the zoom-in views of two regions in the colon wall mesh marked with red boxes. It can be seen that various non-trivial loops in the colon wall surface in different locations can be detected correctly.
The experimental results for the two colon datasets are reported in Table 2 and Table 3, respectively. For the first colon dataset, as shown in Table 2, our method was successfully run on all 10 colon data, and it detected all the loops in the noisy colon data. By comparison, the persistent homology method could only be executed on 8 colon data, and it failed on 2 colon data. This demonstrates that our method is more robust than the persistent homology method. Moreover, the lengths (number of vertices) of detected loops in all 10 colon data were much shorter by our method than by the persistent homology method, indicating the advantage of our method for computing and obtaining shorter detected loops.
According to the experimental results shown in Table 3 for the second colon dataset, our method outperforms the persistent homology method, in terms of robustness and computation of shorter loops. It can be seen that among the 20 colon data, our method successfully computed the loops on all 20 colon data, whereas the persistent homology method failed on 2 colon data. Also, our method was able to detect all loops with shorter lengths than those of the persistent homology method. Therefore, the experimental results on both colon datasets demonstrate the effectiveness and robustness of our method.

3.3. Colon Flattening in Virtual Colonoscopy

To evaluate the full efficacy of the proposed method, we applied the method to the flattening of a 3D colon wall surface to a 2D plane in virtual colonoscopy. The top row in Figure 8 shows the original 3D colon surface without denoising and the corresponding colon surface after denoising, respectively. The 3D colon wall surface after topological denoising, using our method, was then flattened to the 2D plane via surface parameterization, which is shown in the bottom row in Figure 8. A 2D visualization of the flattened colon wall surface provides physicians with a good alternative for the detection of colorectal polyps, in comparison to a traditional 3D endoscopic view. Also, the supplementary geometric and texture features in the 2D flattened colon wall can be used in practice, to improve polyp detection rates.
We also applied our method to colon data containing a clinically detected polyp of size ≥ 10 mm. Figure 9a shows the result of the colon surface by our topological denoising method, where the blue curve indicates the curve along which the 3D colon surface is cut, for colon wall flattening to a 2D plane. Figure 9b gives a different view of a 3D colon surface, and the yellow arrow indicates the location of the polyp, which is highlighted by the red points. Endoscopic views of the polyp on the colon wall are shown in Figure 9c,d, where the red points are used to represent the polyp area. After the 3D colon wall surface was flattened to a 2D plane, we obtained a 2D visualization of the polyp on the flattened colon surface, as seen in Figure 9e. This alternative view of the polyp was conducive to detecting and locating the polyp.

4. Conclusions

In this work, we have proposed a novel topological denoising method based on homotopy theory. We applied the method to colon surface denoising in virtual colonoscopy. The method is, in essence, computed in an iterative fashion. In terms of computational steps, the algorithm mainly includes computations of cut graph and shortest loops, as well as performing topological surgery. The method is not only mathematically rigorous but also computationally robust. We evaluated the proposed method on two datasets of colon meshes, and we conducted comparative experiments, to validate the method. In comparison to the State-of-the-Art topological denoising method, our method outperforms the existing method, in terms of robustness and effectiveness.
From the perspective of applications, the proposed method has the potential to be applied in topological denoising tasks for other organs of interest in the medical imaging field. In future work, we will explore in this direction, and we will apply the proposed method to more medical imaging tasks.

Author Contributions

Conceptualization, M.M., W.C., N.L. and X.G.; methodology, M.M., W.C., N.L. and X.G.; formal analysis, M.M. and W.C.; statistical analysis, M.M. and W.C.; writing—original draft preparation, M.M. and X.G.; writing—review and editing, M.M., W.C., N.L. and X.G.; visualization, M.M. and W.C.; supervision, N.L. and X.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by National Key R&D Program of China 2021YFA1003003 and the National Natural Science Foundation of China 61936002, T2225012.

Data Availability Statement

The raw data are publicly available via the TCIA imaging cancer archive (https://www.cancerimagingarchive.net/, accessed on 4 August 2023).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Yao, J.; Li, J.; Summers, R. CT colonography computer-aided polyp detection using topographical height map. In Proceedings of the 2007 IEEE International Conference on Image Processing, San Antonio, TX, USA, 16–19 September 2007; Volume 5, pp. V-21–V-24. [Google Scholar]
  2. Lee, J.G.; Kim, J.H.; Kim, S.H.; Park, H.S.; Choi, B.I. A straightforward approach to computer-aided polyp detection using a polyp-specific volumetric feature in CT colonography. Comput. Biol. Med. 2011, 41, 790–801. [Google Scholar] [CrossRef]
  3. Umehara, K.; Näppi, J.J.; Hironaka, T.; Regge, D.; Ishida, T.; Yoshida, H. Deep ensemble learning of virtual endoluminal views for polyp detection in CT colonography. In Proceedings of the Medical Imaging 2017: Computer-Aided Diagnosis, SPIE, Orlando, FL, USA, 13–16 February 2017; Volume 10134, pp. 108–113. [Google Scholar]
  4. Ren, Y.; Ma, J.; Xiong, J.; Chen, Y.; Lu, L.; Zhao, J. Improved false positive reduction by novel morphological features for computer-aided polyp detection in CT colonography. IEEE J. Biomed. Health Inform. 2018, 23, 324–333. [Google Scholar] [CrossRef]
  5. Pomeroy, M.; Wang, Y.; Banerjee, A.; Abbasi, A.; Barish, M.; Sun, E.; Bucobo, J.C.; Pickhardt, P.J.; Liang, Z. Integration of optical and virtual colonoscopy images for enhanced classification of colorectal polyps. In Proceedings of the Medical Imaging 2020: Computer-Aided Diagnosis, SPIE, Houston, TX, USA, 16–19 February 2020; Volume 11314, pp. 139–144. [Google Scholar]
  6. Mirhosseini, S.; Gutenko, I.; Ojal, S.; Marino, J.; Kaufman, A. Immersive virtual colonoscopy. IEEE Trans. Vis. Comput. Graph. 2019, 25, 2011–2021. [Google Scholar] [CrossRef]
  7. Mathew, S.; Nadeem, S.; Kumari, S.; Kaufman, A. Augmenting colonoscopy using extended and directional cyclegan for lossy image translation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 13–19 June 2020; pp. 4696–4705. [Google Scholar]
  8. Kotecha, S.; Vasudevan, A.; Holla, V.K.; Kumar, S.; Pruthviraja, D.; Latte, M.V. 3D visualization cloud based model to detect and classify the polyps according to their sizes for CT colonography. J. King Saud Univ.-Comput. Inf. Sci. 2022, 34, 4943–4955. [Google Scholar] [CrossRef]
  9. Nappi, J.J.; Hironaka, T.; Wu, D.; Yoshida, S.R.; Gupta, R.; Tachibana, R.; Taguchi, K.; Yoshida, H. Automated detection of colorectal polyps in photon-counting CT colonography. In Proceedings of the Medical Imaging 2023: Imaging Informatics for Healthcare, Research, and Applications, SPIE, San Diego, CA, USA, 19–24 February 2023; Volume 12469, pp. 187–191. [Google Scholar]
  10. Chen, S.; Li, Y.F.; Zhang, J. Vision processing for realtime 3-D data acquisition based on coded structured light. IEEE Trans. Image Process. 2008, 17, 167–176. [Google Scholar] [CrossRef]
  11. Bi, Z.; Wang, L. Advances in 3D data acquisition and processing for industrial applications. Robot. Comput. Integr. Manuf. 2010, 26, 403–413. [Google Scholar] [CrossRef]
  12. Henderson, P.; Tsiminaki, V.; Lampert, C.H. Leveraging 2d data to learn textured 3d mesh generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 13–19 June 2020; pp. 7498–7507. [Google Scholar]
  13. Glaßer, S.; Berg, P.; Neugebauer, M.; Preim, B. Reconstruction of 3D surface meshes for blood flow simulations of intracranial aneurysms. In Proceedings of the Conference of the German Society for Computer and Robotic Assisted Surgery, London, UK, 10–11 September 2015; pp. 163–168. [Google Scholar]
  14. Kong, F.; Wilson, N.; Shadden, S. A deep-learning approach for direct whole-heart mesh reconstruction. Med. Image Anal. 2021, 74, 102222. [Google Scholar] [CrossRef]
  15. Lee, S.; Chen, L.; Wang, J.; Liniger, A.; Kumar, S.; Yu, F. Uncertainty guided policy for active robotic 3d reconstruction using neural radiance fields. IEEE Robot. Autom. Lett. 2022, 7, 12070–12077. [Google Scholar] [CrossRef]
  16. Di Angelo, L.; Di Stefano, P.; Guardiani, E. A review of computer-based methods for classification and reconstruction of 3D high-density scanned archaeological pottery. J. Cult. Herit. 2022, 56, 10–24. [Google Scholar] [CrossRef]
  17. Maboudi, M.; Homaei, M.; Song, S.; Malihi, S.; Saadatseresht, M.; Gerke, M. A Review on Viewpoints and Path Planning for UAV-Based 3D Reconstruction. IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens. 2023, 16, 5026–5048. [Google Scholar] [CrossRef]
  18. Erickson, J.; Whittlesey, K. Greedy optimal homotopy and homology generators. In Proceedings of the SODA, Vancouver, BC, Canada, 23–25 January 2005; Volume 5, pp. 1038–1046. [Google Scholar]
  19. Chen, C.; Freedman, D. Quantifying homology classes. arXiv 2008, arXiv:0802.2865. [Google Scholar]
  20. Dey, T.K.; Li, K.; Sun, J.; Cohen-Steiner, D. Computing geometry-aware handle and tunnel loops in 3d models. In ACM SIGGRAPH 2008 Papers; Association for Computing Machinery: New York, NY, USA, 2008; pp. 1–9. [Google Scholar]
  21. Zhou, Q.Y.; Ju, T.; Hu, S.M. Topology repair of solid models using skeletons. IEEE Trans. Vis. Comput. Graph. 2007, 13, 675–685. [Google Scholar] [CrossRef]
  22. Dey, T.K.; Li, K.; Sun, J. On computing handle and tunnel loops. In Proceedings of the 2007 International Conference on Cyberworlds (CW’07), Hannover, Germany, 24–26 October 2007; pp. 357–366. [Google Scholar]
  23. Dey, T.K.; Li, K.; Sun, J. Computing handle and tunnel loops with knot linking. Comput.-Aided Des. 2009, 41, 730–738. [Google Scholar] [CrossRef]
  24. Dey, T.K.; Fan, F.; Wang, Y. An efficient computation of handle and tunnel loops via Reeb graphs. ACM Trans. Graph. (TOG) 2013, 32, 1–10. [Google Scholar] [CrossRef]
  25. Weinrauch, A.; Seidel, H.P.; Mlakar, D.; Steinberger, M.; Zayer, R. A Variational Loop Shrinking Analogy for Handle and Tunnel Detection and Reeb Graph Construction on Surfaces. arXiv 2021, arXiv:2105.13168. [Google Scholar] [CrossRef]
  26. Gao, M.; Chen, C.; Zhang, S.; Qian, Z.; Metaxas, D.; Axel, L. Segmenting the papillary muscles and the trabeculae from high resolution cardiac CT through restoration of topological handles. In Proceedings of the 23rd International Conference on Information Processing in Medical Imaging, Asilomar, CA, USA, 28 June–3 July 2013; pp. 184–195. [Google Scholar]
  27. Wu, P.; Chen, C.; Wang, Y.; Zhang, S.; Yuan, C.; Qian, Z.; Metaxas, D.; Axel, L. Optimal topological cycles and their application in cardiac trabeculae restoration. In Proceedings of the 25th International Conference on Information Processing in Medical Imaging, Boone, NC, USA, 25–30 June 2017; pp. 80–92. [Google Scholar]
  28. Brezovsky, J.; Chovancova, E.; Gora, A.; Pavelka, A.; Biedermannova, L.; Damborsky, J. Software tools for identification, visualization and analysis of protein tunnels and channels. Biotechnol. Adv. 2013, 31, 38–49. [Google Scholar] [CrossRef]
  29. Paik, D.S.; Beaulieu, C.F.; Jeffrey Jr, R.B.; Karadi, C.A.; Napel, S. Visualization modes for CT colonography using cylindrical and planar map projections. J. Comput. Assist. Tomogr. 2000, 24, 179–188. [Google Scholar] [CrossRef]
  30. Vilanova Bartroli, A.; Wegenkittl, R.; König, A.; Gröller, E.; Sorantin, E. Virtual colon flattening. In Proceedings of the Data Visualization 2001: Proceedings of the Joint Eurographics—IEEE TCVG Symposium on Visualization in Ascona, Ascona, Switzerland, 28–30 May 2001; pp. 127–136. [Google Scholar]
  31. Balogh, E.; Sorantin, E.; Nyul, L.; Palagyi, K.; Kuba, A.; Werkgartner, G.; Spuller, E. Colon unraveling based on electronic field: Recent progress and future work. Proc. SPIE 2002, 4681, 713–721. [Google Scholar]
  32. Hong, W.; Gu, X.; Qiu, F.; Jin, M.; Kaufman, A. Conformal virtual colon flattening. In Proceedings of the 2006 ACM Symposium on Solid and Physical Modeling, Wales, UK, 6–8 June 2006; pp. 85–93. [Google Scholar]
  33. Hong, W.; Qiu, F. A pipeline for computer aided polyp detection. IEEE Trans. Vis. Comput. Graph. 2006, 12, 861–868. [Google Scholar] [CrossRef]
  34. Wang, Z.; Li, B.; Liang, Z. Feature-based texture display for detection of polyps on flattened colon volume. In Proceedings of the 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, Shanghai, China, 17–18 January 2006; pp. 3359–3362. [Google Scholar]
  35. Gurijala, K.C.; Shi, R.; Zeng, W.; Gu, X.; Kaufman, A. Colon flattening using heat diffusion riemannian metric. IEEE Trans. Vis. Comput. Graph. 2013, 19, 2848–2857. [Google Scholar] [CrossRef]
  36. Wang, H.; Chen, Y.; Li, L.; Pan, H.; Gu, X.; Liang, Z. A novel colon wall flattening model for computed tomographic colonography: Method and validation. Comput. Methods Biomech. Biomed. Eng. Imaging Vis. 2015, 3, 213–221. [Google Scholar] [CrossRef]
  37. Kreiser, J.; Meuschke, M.; Mistelbauer, G.; Preim, B.; Ropinski, T. A survey of flattening-based medical visualization techniques. Comput. Graph. Forum 2018, 37, 597–624. [Google Scholar] [CrossRef]
  38. Eulzer, P.; Richter, K.; Meuschke, M.; Hundertmark, A.; Lawonn, K. Automatic Cutting and Flattening of Carotid Artery Geometries. In Proceedings of the VCBM, Paris, France, 22–24 September 2021; pp. 79–89. [Google Scholar]
  39. Zeng, W.; Shi, R.; Su, Z.; Gu, D.X. Efficient Topological Cleaning for Visual Colon Surface Flattening. In Abdomen Thoracic Imaging; Springer: Berlin/Heidelberg, Germany, 2014; pp. 421–441. [Google Scholar]
  40. Armstrong, M.A. Basic Topology; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
Figure 1. Canonical fundamental group representation.
Figure 1. Canonical fundamental group representation.
Axioms 12 00942 g001
Figure 2. Overview of the proposed topological denoising method.
Figure 2. Overview of the proposed topological denoising method.
Axioms 12 00942 g002
Figure 3. Poincaré Duality: (right) a triangulated mesh M, indicated by the black triangles, corresponds to a dual mesh M ¯ , as shown in the green cells; (left) a 2D simplex Δ of M containing vertex σ .
Figure 3. Poincaré Duality: (right) a triangulated mesh M, indicated by the black triangles, corresponds to a dual mesh M ¯ , as shown in the green cells; (left) a 2D simplex Δ of M containing vertex σ .
Axioms 12 00942 g003
Figure 4. A cut graph of a genus-2 surface, using Algorithm 1: (a) the computed initial cut graph represented by the red tree structure; (b) the pruned cut graph is obtained by removing all leaf nodes with only one link in the initial cut graph in (a).
Figure 4. A cut graph of a genus-2 surface, using Algorithm 1: (a) the computed initial cut graph represented by the red tree structure; (b) the pruned cut graph is obtained by removing all leaf nodes with only one link in the initial cut graph in (a).
Axioms 12 00942 g004
Figure 5. The top two shortest loops of a genus-2 surface, computed using Algorithm 2.
Figure 5. The top two shortest loops of a genus-2 surface, computed using Algorithm 2.
Axioms 12 00942 g005
Figure 6. Results of our method for visual illustration on general test models: double torus, genus-3 model, amphora, genus-6 model, deco-cube, knotty, LoveMe model, and TwoKids model.
Figure 6. Results of our method for visual illustration on general test models: double torus, genus-3 model, amphora, genus-6 model, deco-cube, knotty, LoveMe model, and TwoKids model.
Axioms 12 00942 g006
Figure 7. Results of our method on a colon wall surface: (left) a colon wall mesh with topological noises denoted by the green loops; (middle, right) zoom-in views of the two regions marked with red boxes in the left figure.
Figure 7. Results of our method on a colon wall surface: (left) a colon wall mesh with topological noises denoted by the green loops; (middle, right) zoom-in views of the two regions marked with red boxes in the left figure.
Axioms 12 00942 g007
Figure 8. Result of flattening the 3D colon wall surface to a 2D plane after topological denoising using the proposed algorithm: (top) the original 3D colon surface before denoising, with green highlighted loops, and the corresponding colon surface after denoising; (bottom) the 2D flattened colon mesh.
Figure 8. Result of flattening the 3D colon wall surface to a 2D plane after topological denoising using the proposed algorithm: (top) the original 3D colon surface before denoising, with green highlighted loops, and the corresponding colon surface after denoising; (bottom) the 2D flattened colon mesh.
Axioms 12 00942 g008
Figure 9. Result of applying the proposed topological denoising method to colon data with a clinically detected polyp: (a,b) two different views of the 3D colon surface, with a yellow arrow pointing to the location of the polyp highlighted by the red points; (c,d) endoscopic views of the polyp on the colon wall; (e) a 2D visualization of the polyp on the flattened colon surface.
Figure 9. Result of applying the proposed topological denoising method to colon data with a clinically detected polyp: (a,b) two different views of the 3D colon surface, with a yellow arrow pointing to the location of the polyp highlighted by the red points; (c,d) endoscopic views of the polyp on the colon wall; (e) a 2D visualization of the polyp on the flattened colon surface.
Axioms 12 00942 g009
Table 1. Topological information of general test models, for visual illustration.
Table 1. Topological information of general test models, for visual illustration.
Mesh#Faces#Genus
Genus-6 model2 K6
Double torus7 K2
Knotty10 K2
Genus-3 model12 K3
Amphora20 K2
LoveMe50 K3
TwoKids80 K3
Deco-cube120 K5
Table 2. Comparison, on the first colon dataset with 10 colon meshes, of persistent homology method (denoted by PHM) to our method.
Table 2. Comparison, on the first colon dataset with 10 colon meshes, of persistent homology method (denoted by PHM) to our method.
Success?All Loops Found?#Vertices of All Loops
Mesh (#Faces, #Genus)PHMOurPHMOurPHMOur
Colon1 (127 K, 67)NoYesNoYesNA311
Colon2 (44 K, 13)YesYesYesYes6561
Colon3 (158 K, 31)NoYesNoYesNA141
Colon4 (152 K, 8)YesYesYesYes5628
Colon5 (140 K, 38)YesYesYesYes660170
Colon6 (133 K, 30)YesYesYesYes177141
Colon7 (167 K, 14)YesYesYesYes16166
Colon8 (176 K, 13)YesYesYesYes13167
Colon9 (236 K, 7)YesYesYesYes2423
Colon10 (147 K, 19)YesYesYesYes11874
Table 3. Comparison, on the second colon dataset with 20 colon meshes, of persistent homology method (denoted by PHM) to our method.
Table 3. Comparison, on the second colon dataset with 20 colon meshes, of persistent homology method (denoted by PHM) to our method.
Success?All Loops Found?#Vertices of All Loops
Mesh (#Faces, #Genus)PHMOurPHMOurPHMOur
Colon1 (1091 K, 4)YesYesYesYes7724
Colon2 (1679 K, 6)YesYesYesYes11565
Colon3 (1679 K, 6)YesYesYesYes11865
Colon4 (1528 K, 26)YesYesYesYes1104492
Colon5 (1181 K, 17)YesYesYesYes231119
Colon6 (1350 K, 12)YesYesYesYes321124
Colon7 (1185 K, 3)YesYesYesYes6036
Colon8 (1144 K, 9)YesYesYesYes158107
Colon9 (1389 K, 17)YesYesYesYes675436
Colon10 (1259 K, 2)YesYesYesYes1111
Colon11 (1204 K, 4)YesYesYesYes11658
Colon12 (1692 K, 2)YesYesYesYes12236
Colon13 (1236 K, 11)YesYesYesYes206129
Colon14 (1300 K, 11)YesYesYesYes298250
Colon15 (1428 K, 17)YesYesYesYes326213
Colon16 (1631 K, 22)NoYesNoYesNA410
Colon17 (1531 K, 8)YesYesYesYes409277
Colon18 (1774 K, 11)YesYesYesYes21083
Colon19 (1482 K, 18)YesYesYesYes483454
Colon20 (1202 K, 19)NoYesNoYesNA177
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ma, M.; Chen, W.; Lei, N.; Gu, X. A Novel Robust Topological Denoising Method Based on Homotopy Theory for Virtual Colonoscopy. Axioms 2023, 12, 942. https://doi.org/10.3390/axioms12100942

AMA Style

Ma M, Chen W, Lei N, Gu X. A Novel Robust Topological Denoising Method Based on Homotopy Theory for Virtual Colonoscopy. Axioms. 2023; 12(10):942. https://doi.org/10.3390/axioms12100942

Chicago/Turabian Style

Ma, Ming, Wei Chen, Na Lei, and Xianfeng Gu. 2023. "A Novel Robust Topological Denoising Method Based on Homotopy Theory for Virtual Colonoscopy" Axioms 12, no. 10: 942. https://doi.org/10.3390/axioms12100942

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop