Next Article in Journal
e4clim 1.0: The Energy for a Climate Integrated Model: Description and Application to Italy
Previous Article in Journal
Research on Optimal D-PMU Placement Technology to Improve the Observability of Smart Distribution Networks
Previous Article in Special Issue
Dynamic Duty-Cycle MAC Protocol for IoT Environments and Wireless Sensor Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Improving Energy Efficiency Fairness of Wireless Networks: A Deep Learning Approach

1
Department of Information and Communications Engineering, Pukyong National University, 45 Yongso-ro, Nam-gu, Busan 48513, Korea
2
School of Electrical, Electronic Communication, and Computer Engineering, Chonnam National University, 50, Daehak-ro, Yeosu 59626, Korea
3
Department of Electrical Engineering, Chungnam National University, 99 Daehak-ro, Yuseong-gu, Daejeon 34134, Korea
*
Authors to whom correspondence should be addressed.
Energies 2019, 12(22), 4300; https://doi.org/10.3390/en12224300
Submission received: 8 October 2019 / Revised: 1 November 2019 / Accepted: 5 November 2019 / Published: 11 November 2019

Abstract

:
Achieving energy efficiency (EE) fairness among heterogeneous mobile devices will become a crucial issue in future wireless networks. This paper investigates a deep learning (DL) approach for improving EE fairness performance in interference channels (IFCs) where multiple transmitters simultaneously convey data to their corresponding receivers. To improve the EE fairness, we aim to maximize the minimum EE among multiple transmitter–receiver pairs by optimizing the transmit power levels. Due to fractional and max-min formulation, the problem is shown to be non-convex, and, thus, it is difficult to identify the optimal power control policy. Although the EE fairness maximization problem has been recently addressed by the successive convex approximation framework, it requires intensive computations for iterative optimizations and suffers from the sub-optimality incurred by the non-convexity. To tackle these issues, we propose a deep neural network (DNN) where the procedure of optimal solution calculation, which is unknown in general, is accurately approximated by well-designed DNNs. The target of the DNN is to yield an efficient power control solution for the EE fairness maximization problem by accepting the channel state information as an input feature. An unsupervised training algorithm is presented where the DNN learns an effective mapping from the channel to the EE maximizing power control strategy by itself. Numerical results demonstrate that the proposed DNN-based power control method performs better than a conventional optimization approach with much-reduced execution time. This work opens a new possibility of using DL as an alternative optimization tool for the EE maximizing design of the next-generation wireless networks.

1. Introduction

For the last decade, energy efficiency (EE) of wireless communication systems, which measures the effectiveness of the power consumption utilized for the data transmission, has been emerging as an important performance metric for the next-generation networking scenarios including wireless sensor networks, device-to-device communications, and internet-of-things (IoT) systems [1,2,3,4,5,6,7,8,9,10]. The EE metric was introduced in [1], and it is defined as the ratio of achievable data rate to total power consumption. The fractional programming framework was employed in [1,2] to address the EE maximization problems in various configurations. Extending these works, the EE maximizing cooperative communication strategies were investigated in the multi-cell multi-user networks [3,4,5,6,7,8,9,10]. Weighted sum EE metrics was intensively studied in [4,5,6,7]. Zero forcing (ZF)-based coordinated beamforming schemes were proposed in [4], which maximize the sum EE of the multiple heterogeneous networks. To further increase the EE performance, the works in [5,6,7] relaxed the ZF assumption and presented optimization algorithms for identifying efficient precoding solution without the ZF condition. Due to the multi-cell and multi-user interference terms, the weighted sum EE maximization problems are no longer convex and cannot be tackled by the off-the-shelf convex optimization software. Hence, handling the non-convexity of the EE maximization tasks has been an important issue in the multi-cell environment. The authors of [5,6] employed the fractional programming framework for the weighted EE maximization problem in the multi-cell systems and provided alternating optimization algorithms where blocks of the optimization variables are determined in an iterative manner. However, such an alternating calculation loses the globally optimality of the weighted EE maximization problems. This issue was addressed in [7] by applying the branch-and-bound (BnB) method, which iteratively searches lower and upper bounds of the original problem and converges the globally optimal point. However, the iterative bound searches and solution calculations of the BnB algorithm would result in high computational complexity for the fast fading environment where the beamforming solution may not be timely obtained for the real-time communication services.
The sum EE maximization would not be an appropriate design approach since it cannot guarantee the quality of the EE for heterogeneous wireless devices. In particular, in the multi-cell systems, the EE of each cell was defined as the sum EE of all intra-cell users [4,5,6,7]. Obviously, such a design leads to highly unbalanced EE performance among multiple cells and mobile users, and cannot guarantee the EE performance of each wireless devices. To overcome this issue, the EE fairness has been suggested as an alternative performance measure of the sum EE metric [3,8,9,10]. The fairness of the EE can be examined by the minimum EE performance among multiple wireless devices. Thus, the EE fairness optimization has been typically expressed as the maximization task of the minimum EE performance, resulting in the max-min formulations. The max-min nature of the EE fairness formulation ensures that all the wireless devices achieve the same level of EE performance. However, the maximization of the EE fairness would be more difficult than that of the sum EE performance due to the non-smooth and non-convex objective functions. The Dinkelhach method was adopted in [8] along with the alternating optimization process for solving the EE fairness maximization problem in the multi-cell networks. To reduce the computational complexity of the alternating optimization, the successive convex approximation (SCA) framework was applied to maximize the minimum EE performance [3,9,10]. Among those, the conic approximation strategy provided in [3] has been revealed as the most effective solution in terms of both the performance and the computational complexity.
The previous works have mostly focused on the traditional optimization techniques, and thus they relied on the convex optimization software such as the CVX. The optimization approaches are powerful for identifying model-based calculation algorithms with guaranteed convergence. However, the convex optimization software generally requires iterative computations for each channel realization, implying that the algorithms in [3,8,9,10] would not be practical for the fast fading environment in which the channel statistics would change before computing the solution. Hence, the conventional optimization approaches might not be a good solution for handling the EE fairness maximization problems in real-time communication scenarios. In addition, due to the non-convexity of the EE formulation, the optimization algorithms in [3,8,9,10] cannot guarantee the globally optimality for their convergence point. It is thus not easy to identify the globally optimal performance based on the traditional optimization techniques.
To tackle these difficulties, deep learning (DL) techniques [11,12] have recently applied in the design of wireless communication systems [13,14,15,16,17] and resource management algorithms [18,19,20,21,22,23]. The data-driven optimization capability of the DL has been shown to be efficient for addressing model-free and non-convex formulations in the wireless communication networks. The possibility of the DL was investigated in [13,14,15,16,17] for a design of end-to-end physical layer communication modules. Meanwhile, there have been intensive studies on using deep neural networks (DNNs) to solve wireless resource allocation problems [18,19,20,21,22,23]. The authors of [18] proposed a supervised learning method which learns the input–output behavior of an existing power control scheme, the weighted minimum mean square error (WMMSE) algorithm, to maximize the sum rate performance in an interference channel (IFC) setup. The method in [18] achieves a similar performance of the WMMSE algorithm with much reduced time complexity. However, the supervised learning nature in [18] can only produce the DNN simply memorizing the locally optimal solution of the WMMSE algorithm. Hence, it is not easy to handle the non-convexity of the resource allocation problems and the supervised learning approach generally yields the degraded sum rate performance.
Unsupervised learning-based power control schemes have recently been investigated [19,20,21,22,23] to overcome the limitations of the supervised training strategy. The unsupervised learning does not need the training label data, i.e., the solution obtained by the WMMSE as in [18], and finds an effective resource management solution by itself. The DNNs are employed to approximate the unknown optimal solution directly, whose approximation accuracy is guaranteed by the universal approximation theorem. As a result, it is possible to identify the globally optimal resource allocation solution by utilizing well-designed DNNs. In [19], the sum rate and the sum EE maximization problems were tackled via the DNNs trained in an unsupervised manner. It was shown that the unsupervised learning techniques perform better than the WMMSE algorithm which achieves a locally optimal solution for the sum rate maximization problem. In addition, the computational complexity of the DNN-based power control scheme is much lower than that of the WMMSE method requiring the iterative calculations. Similar results have been observed in [20,21,22,23], where the possibilities of the DNN for solving the non-convex sum rate maximization problem in cognitive radio and device-to-device communication setups. However, since these methods are restricted to the sum performance optimization, it is still not clear whether the DL-based approach is valid for the EE fairness maximization task with the fractional and non-smooth objective function.
In this paper, we revisit the EE fairness maximization problem for the IFC, where the globally optimal solution is generally not available due to the non-convexity [3]. Our target is to apply the DL technique for improving the EE fairness performance of existing optimization approaches as well as reducing the computational complexity. We introduce a fully-connected DNN structure for approximating a mapping from the channel vector to the optimal power control solution. The original EE fairness maximization problem determining unknown solution computation strategy is reformulated into the training task of the DNN such that it can produce an effective power allocation solution. However, the state-of-the-art DL libraries, which are based on the gradient descent (GD) method, would not be feasible in our formulation due to the non-smooth max-min EE objective function. We thus derive a modification of the GD update rule for the EE fairness maximization problem. An unsupervised training algorithm is proposed which does not require any information regarding the optimal power control policy. The test performance of the trained DNN was examined through intensive numerical simulations. It was verified that the proposed DNN-based power control scheme performs better than the best known performance achieved by the SCA framework [3]. In addition, the numerical results prove that the DNN can significantly reduce the execution time of the conventional SCA method.
This paper is organized as follows. Section 2 describes the system model for the IFC and formulates the EE fairness maximization problem. The proposed DNN approach and the unsupervised training strategy are presented in Section 3. We provide numerical results of the trained DNNs in Section 4 and compare its performance with traditional optimization approaches. Finally, the paper is terminated with conclusions in Section 5.
Throughout this paper, we employ uppercase boldface letters, lowercase boldface letters, and normal letters for matrices, vectors, and scalar quantities, respectively. Sets of m-by-n complex-valued and real-valued matrices are denoted by C m × n and R m × n , respectively. The expectation operation over random variable X is represented as E X [ · ] .

2. System Model

We consider an IFC in Figure 1 in which multiple transmitters convey information to multiple receivers at the same time over the same frequency band. Without loss of the generality, it is assumed that there exist total K transmitter–receiver pairs. Let K { 1 , , K } be the set of indices of the transmitters and receivers, i.e., index k can refer to transmitter k or receiver k. Each receiver is supported by its corresponding transmitter, and the signals leaked from each transmitter to other receivers act as interference degrading the communication performance. Such a scenario prevails in practical wireless networks including multi-cell communication systems, IoT, and device-to-device networks.
Throughout the paper, quasi-static frequency-flat fading is assumed, but the channel coefficient would vary at each transmission time block. Denoting g i j C as the complex channel coefficient between transmitter i and receiver j ( i , j K ), the received signal y i C at receiver i is written by
y i = p i g i i x i + j K i p j g j i x j + n i ,
where x i CN ( 0 , 1 ) stands for the transmitted symbol at transmitter i, n i CN ( 0 , 1 ) equals the Gaussian noise, and  p i is the transmit power of transmitter i. From  Equation (1), the data rate achieved at receiver i is written by
R i ( H ) = log 1 + h i i p i ( H ) 1 + j K i h j i p j ( H ) .
where h i j | g i j | 2 is the channel gain between transmitter i and receiver j, H = { h i j , i , j K } C K × K indicates the channel matrix collecting all the channel gains. Here, the transmit power p i ( H ) , i K , is now represented as a function of the channel gain matrix H to be optimized for each channel realization  H .
The EE of transmitter i is defined as the ratio of the achievable rate R i ( H ) to its total power consumption Q i ( H ) which includes the overall power related to the signal transmission and circuit operations. The total power consumption Q i ( H ) at transmitter i can be characterized as [3,10]
Q i ( H ) = 1 ζ p i ( H ) + P C ,
where ζ ( 0 , 1 ] accounts for the efficiency of the power amplifier and P C denotes the static operation power of circuitry such as the mixer, the cooling systems, the power supply, the frequency synthesizer, the digital-to-analog converter, etc. [1]. Then, the EE η i ( H ) of transmitter i is expressed as
η i ( H ) = R i ( H ) Q i ( H ) = log 1 + h i i p i ( H ) 1 + j K i h j i p j ( H ) 1 ε p i ( H ) + P C .
In a practical IFC setup, due to the heterogeneous nature of wireless propagation, the EE performance of multiple transmitter–receiver pairs is highly asymmetric. Hence, we desire to balance the EE performance by maximizing the minimum EE averaged over an arbitrary given fading distribution H . The instantaneous minimum EE η min ( H ) for a given channel realization H can be represented as
η min ( H ) = min i K η i ( H ) = min i K log 1 + h i i p i ( H ) 1 + j K i h j i p j ( H ) 1 ε p i ( H ) + P C
Then, the problem for maximizing the average minimum EE E H [ η min ( H ) ] = E H [ min i K η i ( H ) ] is formulated as
max p ( H ) E H [ min i K η i ( H ) ]
subject to 0 p i ( H ) P i , i K ,
where p ( H ) { p i ( H ) , i K } R N × 1 is the concatenation of the transmit power of all the transmitters and the constraint in Equation (7) indicates the transmit power constraint with P i being the maximum allowable transmit power budget at transmitter i.
In general, Equation (6) is a non-convex problem [24], and it is highly difficult to identify the globally optimal solution p ( H ) . To address the non-convexity of Equation (6), theoretical optimization techniques have been applied in recent literature [3,10]. In particular, the SCA framework [25] is adapted in [3,10], which tackle a series of convex approximations of Equation (6) in an iterative manner. The monotonic convergence and the complexity analysis of these SCA-based algorithms have been intensively studied. However, the conventional methods [3,10] suffer from several implementation challenges. First, due to the coupled variables in the objective function of Equation (6), the SCA framework cannot guarantee the quality of the convergence points of the SCA algorithms. To be specific, the conventional methods can only satisfy the necessary optimality condition, and, obviously, this limits the performance of the solution since they generally converges to poor local optimum and saddle points. Next, the iterative nature of the SCA framework incurs expensive and repetitive calculations for the algorithms in [3,10], resulting in the expensive computation cost for the transmitters. This becomes severe in the fast fading scenario where the channel coefficients H changes before computing the solution of Equation (6) through the iterations.
To overcome such limitations of traditional optimization approaches, we propose a DL-based power control scheme for the minimum EE maximization problem in Equation (6). The DL-based resource management techniques have been recently investigated [18,19,20,21,22,23]. Existing studies have mostly focused on the sum rate maximization problem [18,20,21,22,23], which has been known to be simpler than our formulation in Equation (6). Although the sum EE maximization was considered in [19], it is not clear whether the max-min EE formulation can be indeed addressed by the DL algorithms. Therefore, the expression power of the DNNs for solving the EE fairness problem in Equation (6) has not been adequately examined in the literature. It is worth noting that, since the training of DNNs are typically based on the gradient descent method [12,26], it would not be straightforward to verify the feasibility of the state-of-the-art DL libraries for addressing the non-smooth optimization problem in Equation (6). Therefore, maximizing the EE fairness performance is a nontrivial task through the exiting sum metric training rules [18,19,20,21,22,23].

3. Proposed DL-Based Power Control Scheme

In this section, we present a DL approach to solve the non-convex EE fairness problem in Equation (6) efficiently. The basics of the DL are briefly introduced, followed by the proposed DL-based solution.

3.1. DL Basics

As illustrated in Figure 2, we consider a fully-connected DNN with an input layer, L hidden layers, and an output layer. The DNN computes an output vector x L + 1 R N L + 1 × 1 of length N L + 1 for a given input feature x 0 R N 0 × 1 of length N 0 . The input vector x 0 is regarded as the training data sampled from the training set X { x 0 } collected in advance. When the distribution of x 0 is available, e.g., the Rayleigh fading, the training data can be randomly generated from the known probability density function. The end-to-end operation of the DNN is characterized by a mapping ϕ : R N 0 × 1 R N L + 1 × 1 . For convenience, let us denote layer 0 and L + 1 as the input and output layers, respectively, whereas hidden layers are represented by layer l for l = 1 , , L . Each layer l for l = 1 , , L , L + 1 produces its output vector x l R N l × 1 of length N l from its input x l 1 R N l 1 × 1 of length N l 1 , which is obtained from the preceding layer l 1 . To be specific, the output x l of layer l is given by
x l = σ l ( W l x l 1 + b l ) ,
where σ l ( · ) stands for an activation function at layer l, and  W l R N l × N l 1 and b l R N l × 1 denote a weight matrix and a bias vector at layer l, respectively. From  Equation (8), it can be seen that the calculation of each layer is expressed as linear matrix multiplication and addition followed by the activation function. The activation function σ l ( · ) is an element-wise function which introduces the non-linearity to the DNN. Possible candidates for the activation functions are the sigmoid function, sig ( z ) 1 1 + e z , rectified linear unit (ReLU) function, ReLU ( z ) max { 0 , z } , etc. Since the choice of the activation functions is directly related to the expression capability of the DNN, we need to carefully determine efficient functions { σ l ( · ) , l } by examining the validation performance.
Finally, the output x L + 1 of the DNN is obtained through L + 1 successive computations in Equation (8). When Θ { W l , b l , l } includes the set of the weight matrices and the bias vectors of the DNN, the end-to-end calculation of the DNN can be written as
x L + 1 = σ L + 1 ( W L + 1 σ L ( W L σ 1 ( W 1 x 0 + b 1 ) + b L ) + b L + 1 ) ,
ϕ ( x 0 ; Θ ) ,
where the mapping x L + 1 = ϕ ( x 0 ; Θ ) characterizes the end-to-end operation of the DNN. The aim of the DL is to identify the parameter set Θ minimizing (or maximizing) a certain objective function C ( Θ ) specifying targets and applications of the DNN. The objective function includes the performance of the training samples x 0 by measuring the average performance over the training set X . In general, the objective function C ( Θ ) can be written by
C ( Θ ) = E X [ c ( x 0 , x L + 1 ; Θ ) ] ,
where the function c ( x 0 , x L + 1 ; Θ ) stands for the objective of each training sample x 0 X . The minimization of C ( Θ ) with respect to Θ is regarded as the training of the DNN. Due to non-convexity of the activation functions and serial calculations in Equation (8), the solution to minimize C ( Θ ) cannot be obtained in a closed-form expression. To this end, the state-of-the-art DL techniques employ the mini-batch stochastic gradient descent (SGD) method for determining an efficient DNN parameter Θ [12]. An iterative update rule of the mini-batch SGD at training iteration t is expressed as
Θ [ t ] = Θ [ t 1 ] α Θ C ( Θ [ t 1 ] ) , = Θ [ t 1 ] α E X [ Θ c ( x 0 , x L + 1 ; Θ [ t 1 ] ) ] , Θ [ t 1 ] α 1 S x 0 S Θ c ( x 0 , x L + 1 ; Θ [ t 1 ] ) ,
where Θ [ t ] is the DNN parameter obtained at iteration t, α > 0 denotes the learning rate, and  Θ C ( Θ [ t ] ) accounts for the gradient of C ( Θ ) evaluated at Θ = Θ [ t ] . In  Equation (12), the expected gradient E X [ Θ c ( x 0 , x L + 1 ; Θ ) ] is approximated by its empirical mean 1 S x 0 S Θ c ( x 0 , x L + 1 ; Θ ) measured over a mini-batch set S X with S | S | training samples. By using commercial graphics processing unit (GPUs), parallel and fast implementation of Equation (12) is possible. After the training, the generalization performance of the trained DNN Θ is examined by using a test set consisting of the unseen data during the training step.

3.2. DL Approach for EE Fairness Maximization

We provide the DL approach for solving the EE fairness problem in Equation (6). A key idea is to approximate unknown optimal solution p ( H ) of Equation (6) through a DNN. We construct a DNN-based optimization framework, as shown in Figure 3. We first sample numerous channel realizations { H } from the training set H for constructing a mini-batch set S at each iteration of the SGD algorithm in Equation (12). The training set H = { H } consists of real measurement channel values or can be considered as a known probability density function of the fading environment such as the Rayleigh distribution.
The channel gain matrix H C N × N is first vectorized into h C N 2 × 1 to be passed to the fully-connected DNN in Equation (9). The channel gain vector h is then processed by L-layer DNN ϕ ( H ; Θ ) by setting x 0 = H in Equation (9). Then, the output of the DNN x L + 1 is utilized as the transmit power solution, i.e.,  x L + 1 = p ( H ) . In other words, the solution computation rule p ( H ) is alternatively calculated using the DNN as
p ( H ) ϕ ( H ; Θ ) .
From Equation (13), we approximate the optimal transmit power p ( H ) , which is generally unknown and intractable, through the fully-connected DNN ϕ ( H ; Θ ) . However, the expression power of the DNN is still unclear for representing the optimal solution. The following theorem provides rigorous and mathematical basis for the DNN approximation in Equation (13).
Theorem 1.
For a compact set H = { H } , there exists a L-layer DNN ϕ ( H ; Θ ) , which is realized with sigmoid activation functions and sufficiently large L, can approximate any continuous-valued function p ( H ) over H H within an arbitrary small worst-case error ε > 0 . Mathematically, it is given as
sup H H p ( H ) ϕ ( H ; Θ ) ε .
The proof of Theorem 1 is given in [18,27]. The above theorem, which is well-known as the universal approximation theorem [27], verifies the existence of the structure and the parameter set of the DNN ϕ ( H ; Θ ) that can act as a universal approximator for any continuous function p ( H ) . A recent work [28] proved that the universal approximation theorem holds for any Lebesgue-integrable function p ( H ) with H | p ( H ) | d H < and a fully-connected DNN having the ReLU activation functions. More preciously, the result in [28] can be expressed as
H | p ( H ) ϕ ( H ; Θ ) | d H < ε .
The Lebesgue-integrable property of p ( H ) along with the universal approximation theorem in Equation (15) reveals that our DNN ϕ ( H ; Θ ) can successfully approximate non-continuous but Lebesgue-integrable mappings such as the indicator function. Since Equations (14) and (15) hold for any mapping p ( H ) defined over the compact set H , the universal approximation is also fulfilled for the optimal p ( H ) . Therefore, the DNN approximation approach in Equation (13) is accurate for the unknown optimal solution p ( H ) for the EE fairness maximization problem regardless of its continuity.
Although the universal approximation theorem guarantees the quality of the DNN approximation in Equation (13), it does not state how to determine the DNN parameter satisfying Equations (14) and (15). Hence, we need to derive an efficient training strategy determining Θ for the EE fairness maximization. To this end, by plugging Equation (13) into Equation (6), the original optimization problem in Equation (6) is first reformulated into
max Θ E H min i K η i DNN ( H ; Θ )
subject to 0 [ ϕ ( H ; Θ ) ] i P i , i K ,
where [ z ] i indicates the ith element of a vector z and η i DNN ( H ; Θ ) denotes the EE of transmitter i in Equation (4) evaluated via the DNN solution p ( H ) = ϕ ( H ; Θ ) , which is defined as
η i D N N ( H ; Θ ) = log 1 + h i i [ ϕ ( H ; Θ ) ] i 1 + j K i h j i [ ϕ ( H ; Θ ) ] j 1 ε [ ϕ ( H ; Θ ) ] i + P C .
Compared to the original formulation in Equation (6) whose optimization variable is the intractable function p ( H ) , we now optimize the DNN parameter set Θ in the DNN training problem in Equation (16), which can be handled by the state-of-the-art DL optimization tool, e.g., the mini-batch SGD algorithm. However, since the SGD method has been typically developed for unconstrained training applications, the transmit power constraint in Equation (17) cannot be straightforwardly tackled by existing DL libraries. To overcome this difficulty, we construct the DNN ϕ ( H ; Θ ) such that it always produces a feasible solution for Equation (17). We set the activation function of the output layer σ L + 1 ( z ) as a scaled sigmoid function as
σ L + 1 ( z ) = P sig ( z ) ,
where P = [ P 1 , , P K ] T R K × 1 denotes the stacked vector of the transmit power budget P i , i K , and ⊙ accounts for the element-wise multiplication operator. Thanks to the fact [ sig ( z ) ] i [ 0 , 1 ] , the output activation in Equation (19) is guaranteed to yield the feasible transmit power solution [ ϕ ( H ; Θ ) ] i [ 0 , P i ] .
Using the output activation in Equation (19), we can remove the transmit power constraint in Equation (17). Then, the problem in Equation (16) can be simplified into an unconstrained training task as
max Θ E H min i K η i DNN ( H ; Θ ) .
The unconstrained DL solvers can be applied to address the problem in Equation (20). At the tth iteration, the mini-batch SGD update rule in Equation (12) for Equation (20) is expressed as
Θ [ t ] = Θ [ t 1 ] + α 1 S H S Θ min i K η i DNN ( H ; Θ [ t 1 ] ) ,
where S = { H } with S | S | is the mini-batch set of the channel gain matrix H and the sign of the update direction of Equation (21) changes since our target is to maximize the minimum EE min i K η i ( H ) . In  Equation (21), the gradient Θ [ min i K η i DNN ( H ; Θ ) ] would not be available due to the non-smooth minimum operation. This issue can be handled via a simple modification of the update rule based on the sub-gradient method [24] developed for addressing non-differential functions. Let i ^ be the index of the transmitter having the smallest EE performance, i.e.,
i ^ arg min i K η i DNN ( H ; Θ ) .
Then, the sub-gradient Θ [ min i K η i DNN ( H ; Θ ) ] with respect to Θ is obtained as [29]
Θ min i K η i DNN ( H ; Θ ) = Θ η i ^ DNN ( H ; Θ ) .
Finally, the proposed training rule can be expressed as
Θ [ t ] = Θ [ t 1 ] + α 1 S H S Θ η i ^ DNN ( H ; Θ [ t 1 ] ) .

3.3. Training and Implementation

A training algorithm for solving Equation (20) is presented in Algorithm 1. Before the training, we need to construct the training set H = { H } which contains numerous channel gain matrices. It is worth noting that the training set can be the probability space since the distribution of the channel H has been well investigated and accurately modeled, e.g., the Rayleigh and the Rician fading. Hence, similar to [13], we can generate infinitely large number of training samples during the iterations of the SGD algorithm. An efficient initialization of the DNN parameter Θ can be found by the Xavier initialization strategy [30]. At each training iteration, we sample a random mini-batch set S from the known distribution of the channel. Then, the DNN parameter is updated based on the mini-batch sub-gradient method in Equation (24). We repeat these iterative updates during the predefined training iteration T. One may apply the early stopping technique [11] by observing validation performance of the DNN evaluated over validation samples which are independently generated with the training data.
Algorithm 1 Mini-batch SGD training algorithm.
Construct the training set H .
Initialize t = 0 , the DNN parameter Θ [ 0 ] , and the number of iterations T.  
for t = 1 : T do
 Sample a mini-batch channel set S H .
 Update Θ [ t ] Θ [ t 1 ] + α 1 S H S Θ η i ^ DNN ( H ; Θ [ t 1 ] ) .
end for
Obtain the trained DNN parameter Θ [ T ] .
The proposed DL method in Algorithm 1 does not require any knowledge of the optimal solution p ( H ) during the training step. Thus, the proposed DL training strategy is regarded as an unsupervised learning policy [19,20,21,22,23]. Notice that the supervised learning approach [18] needs to generate the labeled data, i.e., the solution obtained from existing optimization algorithm, for all the channel samples H in the training set H . Since the proposed unsupervised learning method does not depend on the solution of the original formulation in Equation (6), the training of the DNN can be done in a much simpler way compared to the supervised training algorithms [18].
The training process might require intensive computations for updating a large number of weights and biases with numerous training samples. However, since we can obtain the training data in advance, the DNN training task can be performed offline before the real-time communication. Once the DNN is trained, its real-time calculations are replaced with the linear matrix multiplications in Equation (8) whose computational complexity is much lower than that of the iterative optimization methods such as the SCA algorithm [3]. Thus, in terms of the real-time execution time, the proposed DNN-based power control scheme would be more efficient than the conventional algorithm. This is further discussed through numerical results in Section 4. The implementation of the proposed DL-based power control scheme can be achieved by means of memory units at the transmitters. Specifically, the trained DNN parameter Θ , which is a collection of trained weight matrices and bias vectors, is stored to memory units of each transmitter. Then, based on the channel matrix H each transmitter i can compute its transmit power p i ( H ) as p i ( H ) = [ ϕ ( H ; Θ ) ] i .
The DNN trained over a certain distribution of H might not be applied to other channel models. To this end, we train multiple DNNs for all possible analytical channel models in advance. For instance, two DNNs are individually trained with the Rayleigh and the Rican fading setups. In the real-time communication, the transmitters, e.g., the eNodeBs in the LTE systems, can determine the channel statistics based on the feedback information of the receivers. Hence, the transmitters can estimate the distribution of H and can select one DNN that matches with the real-time channel statistics. The transmitters can also check the change in the long-term channel statistics, and the dynamic switching of the DNN is possible in practice. Thanks to the high-speed memory units, the delay incurred by the DNN switching is negligible compared to the overall communication duration. As a result, the proposed DNN approach can be directly applied to a more realistic scenario when the long-term characteristics of the channels vary without retraining processes.

4. Numerical Results

In this section, we present numerical results evaluating the maximized minimum (max-min) EE performance of the proposed DNN scheme. Unless otherwise stated, a DNN with L = 6 hidden layers was considered. The dimension of the hidden layer was set to 50 K , whereas the output layer dimension was fixed to K to produce K-dimensional transmit power solution p ( H ) R K × 1 . The ReLU function ReLU ( z ) = max { 0 , z } , which is a popular choice for hidden activation functions [11,12,13,20], was adopted for all hidden layers. We applied the batch normalization technique [31] after each hidden and output layer to accelerate the training process. Unless otherwise stated, the learning rate α and the mini-batch size S were set to α = 0.0003 and S = 5000 , respectively. The early stopping [11] was employed with T = 25 , 000 training iterations and 10 6 validation samples.
We utilized the Adam method [26] for the SGD algorithm. At each iteration t, the update rules of the moving average of the gradient m [ t ] , the second moment v [ t ] , and the DNN parameter Θ [ t ] are given, respectively, by [26]
m [ t ] = β 1 m [ t 1 ] + ( 1 β 1 ) g [ t 1 ] , v [ t ] = β 2 v [ t 1 ] + ( 1 β 2 ) g [ t 1 ] g [ t 1 ] , Θ [ t ] = Θ [ t 1 ] η 1 β 2 t 1 β 1 t m [ t ] ( v [ t ] + ϱ ) ,
where g [ t ] is defined as the instantaneous gradient of the cost function, ⊘ denotes the element-wise division, and v [ t ] indicates the element-wise square root of the vector v [ t ] . Two hyper parameters β 1 [ 0 , 1 ) and β 2 [ 0 , 1 ) adjust the decaying rates of the moving average of the first and the second momentums of the gradient, respectively. Following [26], we fixed β 1 = 0.9 and β 2 = 0.999 . A positive parameter ϱ > 0 was introduced to avoid numerical errors. For the initialization, m [ 0 ] and v [ 0 ] were set to the zero vectors.
All the channel gains for the training, validation, and testing steps were generated with the Rayleigh fading. The transmit power constraint P i for each transmitter i was fixed as P 1 = = P K = P and the power amplifier efficiency ζ was given as ζ = 0.35 [3]. The training was implemented in Python with Tensorflow on a PC with Intel Core i7 CPU @ 3.60 GHz, 32 GB of RAM, and GeForce RTX 2080 GPU.

4.1. DNN Validation

In this subsection, we validate our hyper-parameter setting for the DNN training such as the number of hidden layers and the mini-batch size. In Figure 4, we first present the convergence of the training and the validation performance of the proposed DNN with K = 2 and P C = 33 dBm for P = 25 and 30 dBm. As reference, we consider the following three baselines.
  • SCA [3]: The SCA-based iterative optimization algorithm in [3] was implemented with the CVX and MOSEK solver.
  • Maximum power: The transmit power was set to it maximum value as p i ( H ) = P , i K .
  • Random power: A random transmission policy was employed where p i ( H ) is uniformly distributed over [ 0 , P ] .
It is shown that the performance of the DNN evaluated over the training and the validation sets converges well, implying that the proposed SGD update (Equation (24)) is effective for the max-min formulation in Equation (6). It is interesting to see that the proposed DNN method performs better than other baselines, especially the conventional SCA-based optimization approach [3]. Due to the non-convex nature of Equation (6), the SCA algorithm developed in [3] cannot guarantee the global optimality and converges to the KKT stationary point of Equation (6). On the contrary, the proposed DL approach is able to identify the global optimum for Equation (6) as discussed in the universal approximation theorem [27,28]. This infers that the DNN could handle the non-convexity of the EE fairness maximization problem with the data-driven SGD update rule in Equation (24).
Figure 5 illustrates the convergence behavior of the validation performance with K = 4 , P C = 33 dBm, and P = 30 dBm for various number of hidden layers L. The convergence performance of a DNN with a single hidden layer, i.e., L = 1 , is worse than other configurations, whereas the performance of DNNs with L = 3 , 5, and 7 hidden layers show similar performance. However, it is observed that the convergence speed of the case with L = 7 is slower than that of L = 3 and 5. This is because the DNN with such a large number of hidden layers overfits to its training data [11]. Hence, the validation performance of the DNN with L = 7 would not that be good compared to other cases. We thus fixed L = 5 for the rest of the simulation.
In Figure 6, we plot the convergence performance with different mini-batch size S. The DNN trained with a small mini-batch set ( S = 100 and 500) converges to a poor performance. We can see that increasing the mini-batch size is beneficial to improve the validation performance of the DNN since the empirical expectation of the sub-gradient in Equation (24) becomes more accurate as S grows. However, a large mini-batch size needs intensive SGD computation in the training step. Thus, we need to choose an appropriate S for achieving a good trade-off between the performance and the training complexity. In Figure 6, we can see that S = 5000 is an efficient choice for our scenario.

4.2. Performance Comparison

In this subsection, we focus on evaluating the test performance of the trained DNN and comparison with the baseline methods. Figure 7 depicts the average max-min EE performance with respect to the transmit power budget P with P C = 33 dBm for K = 2 and 4. It is clear that the proposed DNN-based power control scheme is superior to other baselines. In particular, the proposed DNN method performs better than the conventional optimization approach [3] regardless of K and P.
Table 1 shows the average CPU running time of the SCA method [3] and the proposed DNN scheme. Notice that the computations of the SCA method are online tasks which should be performed for each channel realization, whereas the training of the DNN can be performed offline with the aid of the training data collected in advance. Since the proposed DL approach does not require any retraining processes, the offline training complexity does not affect the online execution time of the trained DNN. Therefore, for fair comparison, the complexity of the DNN was evaluated only for the online testing step for producing the power control solution via successive linear operations in Equation (9). We implemented the test calculation of the trained DNN using Matlab and CPU and Matlab with CVX carried out the SCA algorithm. The CPU simulation was performed on a PC with Intel Core i5 CPU and 8 GB of RAM. We can see that the proposed DNN remarkably reduces the CPU running time compared to that of the SCA algorithm [3], which iteratively calculates the solution for each channel realization. This is because the real-time computation of the trained DNN is simply realized by the cascaded matrix multiplications and additions in Equation (9). Therefore, the power control solution of the proposed DNN method can be easily obtained compared to the iterative SCA algorithm [3]. It is also worth noting that the complexity of the proposed DL method only depends on the number of receivers K but not the transmit power constraint P since the proposed DNN structure relies only on K. The results in Table 1 infer that the proposed DNN not only improves the EE fairness performance but also reduces the energy required for the optimization tasks at the transmitters. Therefore, the proposed DL-based power control strategy could provide high EE performance in terms of both the communication and the computations.
Figure 8 presents the average max-min EE performance with respect to the number of receivers K. Both the proposed DNN scheme and the conventional SCA algorithm show a similar performance for a large K. However, as observed in Table 1, the computational complexity of the DNN is much lower than that of the conventional SCA approach. We thus conclude that the proposed DNN scheme still has advantages over the method in [3] even with a small performance gain.
Figure 9 provides the average max-min EE performance by changing P with various circuit power P C . It is revealed that the performance gain achieved by the proposed DNN scheme gets larger as P increases. We can also see that the DNN is still powerful for a large circuit power with P C = 30 dBm.
To further examine the impact of the circuit power, we present the average max-min EE performance in Figure 10 for K = 2 and 3. It is shown that the proposed DL method performs well regardless of the circuit power P C . We observe that the gain achieved by the proposed DL scheme over the conventional SCA algorithm gets larger as P C decreases. The DNN scheme becomes more powerful in the high regime of P = 30 dBm (Figure 10b). Such a performance gain obtained by the DL approach is significantly meaningful with much reduced computational complexity.

5. Conclusions

This paper studies a DL method for improving the EE fairness performance in the IFC systems where multiple transmitters simultaneously communicate with their corresponding receivers. In particular, the maximization task of the minimum EE is investigated to determine energy-efficient transmit power control strategy at the transmitters. This results in non-convex, fractional, and non-smooth max-min EE formulations. Although the EE fairness maximization has been recently addressed by using the SCA framework, such a traditional optimization approach suffers from high computational complexity for the iterations and the optimality loss. To tackle these issues, we present a DNN-based power control scheme where the unknown optimal solution is approximated by carefully designed DNNs. The universal approximation theorem guarantees the optimality of the proposed DNN approach; however, it is still unclear how to identify an efficient DNN parameter set for maximizing the EE fairness performance. We propose an unsupervised learning algorithm such that the DNN is trained to directly maximize the minimum EE performance by observing numerous channel samples during the training steps. A careful analysis on the SGD update rule for the non-smooth objective function is presented for the proposed training algorithm. Intensive numerical results verify the effectiveness of the proposed DL-based power control method over the conventional SCA algorithm. It was observed that the EE fairness performance can be improved by the proposed DL method. In addition, it is shown that the DNN can shift the online calculations of the SCA method to its offline training step. As a result, the real-time CPU execution time of the proposed DL scheme is much lower than that of the SCA algorithm.

Author Contributions

H.L., H.S.J., and B.C.J. conceived and designed the experiments; H.L. performed the numerical simulations; H.L. and H.S.J. analyzed the data; B.C.J. contributed analysis tools; B.C.J. took part in the validation and analysis of results; and H.L., H.S.J., and B.C.J. wrote the paper.

Funding

This research received no external funding.

Acknowledgments

This work was supported in part by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. 2019R1F1A1060648), in part by the NRF grant funded by the Korea government Ministry of Science and ICT (No. 2019R1F1A1061023), and in part by the MSIT(Ministry of Science and ICT), Korea, under the ITRC(Information Technology Research Center) support program(IITP-2019-2017-0-01635) supervised by the IITP(Institute for Information & communications Technology Promotion).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Isheden, C.; Chong, Z.; Jorswieck, E.; Fettweis, G. Framework for link-level energy efficiency optimization with informed transmitter. IEEE Trans. Wirel. Commun. 2012, 11, 2946–2957. [Google Scholar] [CrossRef]
  2. Zappone, A.; Jorswieck, E. Energy efficiency in wireless networks via fractional programming theory. Found. Trends Commun. Inf. Theory 2015, 11, 185–396. [Google Scholar] [CrossRef]
  3. Nguyen, K.-G.; Vu, Q.-D.; Juntti, M.; Tran, L.-N. Distributed solutions for energy efficiency fairness in multicell MISO downlink. IEEE Trans. Wirel. Commun. 2017, 16, 6232–6247. [Google Scholar] [CrossRef]
  4. Xu, Z.; Yang, C.; Li, G.Y.; Liu, Y.; Xu, S. Energy-efficient CoMP precoding in heterogeneous networks. IEEE Trans. Signal Process. 2014, 64, 1005–1017. [Google Scholar] [CrossRef]
  5. He, S.; Huang, Y.; Jin, S.; Yang, L. Coordinated beamforming for energy efficient transmission in multicell multiuser systems. IEEE Trans. Commun. 2013, 61, 4961–4971. [Google Scholar] [CrossRef]
  6. He, S.; Huang, Y.; Yang, L.; Ottersten, B. Coordinated multicell multiuser precoding for maximizing weighted sum energy efficiency. IEEE Trans. Signal Process. 2014, 62, 741–751. [Google Scholar] [CrossRef]
  7. Tervo, O.; Tran, L.-N.; Juntti, M. Optimal energy-efficient transmit beamforming for multi-user MISO downlink. IEEE Trans. Signal Process. 2015, 63, 5574–5588. [Google Scholar] [CrossRef]
  8. He, S.; Huang, Y.; Jin, S.; Yu, F.; Yang, L. Max-min energy efficient beamforming for multicell multiuser joint transmission systems. IEEE Commun. Lett. 2013, 17, 1956–1959. [Google Scholar] [CrossRef]
  9. Du, B.; Pan, C.; Zhang, W.; Chen, M. Distributed energy-efficient power optimization for CoMP systems with max-min fairness. IEEE Commun. Lett. 2014, 18, 999–1002. [Google Scholar] [CrossRef]
  10. Nguyen, K.-G.; Tran, L.-N.; Tervo, O.; Vu, Q.-D.; Juntti, M. Achieving energy efficiency fairness in multicell MISO downlink. IEEE Commun. Lett. 2015, 19, 1426–1429. [Google Scholar] [CrossRef]
  11. Goodfellow, I.; Bengio, Y.; Courville, A. Deep Learning; MIT Press: Cambridge, MA, USA, 2016. [Google Scholar]
  12. LeCun, Y.; Yoshua, B.; Hinton, G. Deep learning. Nature 2015, 521, 436–444. [Google Scholar] [CrossRef]
  13. O’Shea, T.; Hoydis, J. An introduction to deep learning for the physical layer. IEEE Trans. Cog. Commun. Netw. 2017, 3, 563–575. [Google Scholar] [CrossRef]
  14. Dörner, S.; Cammerer, S.; Hoydis, J.; Brink, S. Deep learning-based communication over the air. IEEE J. Sel. Top. Signal Process. 2018, 12, 132–143. [Google Scholar] [CrossRef]
  15. Lee, H.; Lee, I.; Lee, S.H. Deep learning based transceiver design for multi-colored VLC systems. Opt. Express 2018, 26, 6222–6238. [Google Scholar] [CrossRef] [PubMed]
  16. Lee, H.; Lee, I.; Quek, T.Q.S.; Lee, S.H. Binary signaling design for visible light communication: A deep learning framework. Opt. Express 2018, 26, 18131–18142. [Google Scholar] [CrossRef]
  17. Lee, H.; Lee, S.H.; Quek, T.Q.S.; Lee, I. Deep learning framework for wireless systems: Applications to optical wireless communications. IEEE Commun. Mag. 2019, 57, 35–41. [Google Scholar] [CrossRef]
  18. Sun, H.; Chen, X.; Shi, Q.; Hong, M.; Fu, X.; Sidiropoulos, N.D. Learning to optimize: Training deep neural networks for interference management. IEEE Trans. Signal Process. 2018, 66, 5438–5453. [Google Scholar] [CrossRef]
  19. Lee, W.; Cho, D.-H.; Kim, M. Deep power control: Transmit power control scheme based on convolutional neural network. IEEE Commun. Lett. 2018, 22, 1276–1279. [Google Scholar] [CrossRef]
  20. Lee, H.; Lee, S.H.; Quek, T.Q.S. Constrained deep learning for wireless resource management. In Proceedings of the ICC 2019—2019 IEEE International Conference on Communications (ICC), Shanghai, China, 20–24 May 2019; pp. 1–6. [Google Scholar]
  21. Lee, W. Resource allocation for multi-channel underlay cognitive radio network based on deep neural network. IEEE Commun. Lett. 2018, 22, 1942–1945. [Google Scholar] [CrossRef]
  22. Lee, W.; Kim, M.; Cho, D.-H. Transmit power control using deep neural network for underlay device-to-device communication. IEEE Wirel. Commun. Lett. 2019, 8, 141–144. [Google Scholar] [CrossRef]
  23. Lee, W.; Kim, M.; Cho, D.-H. Deep learning based transmit power control in underlaid device-to-device communication. IEEE Sys. J. 2019, 13, 2551–2554. [Google Scholar] [CrossRef]
  24. Boyd, S.; Vandenberghe, L. Convex Optimization; Cambridge University Press: Cambridge, UK, 2004. [Google Scholar]
  25. Hong, M.; Razaviyayn, M.; Luo, Z.-Q.; Pang, J.-S. A unifined algorithmic framework for block-structured optimization involving big data: With applications in machine learning and signal processing. IEEE Signal Process. Mag. 2016, 33, 57–77. [Google Scholar] [CrossRef]
  26. Kingma, D.; Ba, J. Adam: A method for stochastic optimization. In Proceedings of the the 3rd International Conference for Learning Representations. Represent. (ICLR), San Diego, CA, USA, 7–9 May 2015. [Google Scholar]
  27. Hornik, K.; Stinchcombe, M.; White, H. Multilayer feedforward networks are universal approximators. Neural Netw. 1989, 2, 359–366. [Google Scholar] [CrossRef]
  28. Lu, Z.; Pu, H.; Wang, F.; Hu, Z.; Wang, L. The expressive power of neural networks: A view from the width. In Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS), Long Beach, CA, USA, 4–9 December 2017; pp. 6231–6239. [Google Scholar]
  29. Boyd, S.; Xiao, L.; Mutapcic, A. Subgradient Methods; Technical Report EE364b; Stanford Univ: Stanford, CA, USA, 2014. [Google Scholar]
  30. Glorot, X.; Bengio, Y. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the International Conference on Artificial Intelligence and Statistics, Sardinia, Italy, 13–15 May 2010; pp. 249–256. [Google Scholar]
  31. Ioffe, S.; Szegedy, C. Batch normalization: Accelerating deep network training by reducing internal covariance shift. In Proceedings of the International Conference on Machine Learning, Lille, France, 6–11 July 2015; pp. 448–456. [Google Scholar]
Figure 1. Schematic diagram of interference channels with three ( K = 3 ) transmitter–receiver pairs.
Figure 1. Schematic diagram of interference channels with three ( K = 3 ) transmitter–receiver pairs.
Energies 12 04300 g001
Figure 2. Fully-connected DNN with two ( L = 2 ) hidden layers.
Figure 2. Fully-connected DNN with two ( L = 2 ) hidden layers.
Energies 12 04300 g002
Figure 3. Proposed DNN-based EE fairness maximization.
Figure 3. Proposed DNN-based EE fairness maximization.
Energies 12 04300 g003
Figure 4. Convergence of training and validation performance with K = 2 and P C = 33 dBm for different P.
Figure 4. Convergence of training and validation performance with K = 2 and P C = 33 dBm for different P.
Energies 12 04300 g004
Figure 5. Convergence of validation performance with K = 4 , P C = 33 dBm, and P = 30 dBm for different L.
Figure 5. Convergence of validation performance with K = 4 , P C = 33 dBm, and P = 30 dBm for different L.
Energies 12 04300 g005
Figure 6. Convergence of validation performance with K = 4 , P C = 33 dBm, and P = 30 dBm for different S.
Figure 6. Convergence of validation performance with K = 4 , P C = 33 dBm, and P = 30 dBm for different S.
Energies 12 04300 g006
Figure 7. Average max-min EE performance as a function of P with P C = 33 dBm for K = 2 and 4.
Figure 7. Average max-min EE performance as a function of P with P C = 33 dBm for K = 2 and 4.
Energies 12 04300 g007
Figure 8. Average max-min EE performance as a function of K for P = 30 dBm and P C = 33 dBm.
Figure 8. Average max-min EE performance as a function of K for P = 30 dBm and P C = 33 dBm.
Energies 12 04300 g008
Figure 9. Average max-min EE performance as a function of P with K = 2 for P C = 20 and 30 dBm.
Figure 9. Average max-min EE performance as a function of P with K = 2 for P C = 20 and 30 dBm.
Energies 12 04300 g009
Figure 10. Average max-min EE performance as a function of P C for K = 2 and 3.
Figure 10. Average max-min EE performance as a function of P C for K = 2 and 3.
Energies 12 04300 g010
Table 1. Average CPU Running Time [s].
Table 1. Average CPU Running Time [s].
SCA [3]DNN
P = 10 dBm P = 20 dBm
K = 2 0.791.676.00 × 10 4
K = 3 0.972.649.85 × 10 4
K = 4 1.103.131.24 × 10 3

Share and Cite

MDPI and ACS Style

Lee, H.; Jang, H.S.; Jung, B.C. Improving Energy Efficiency Fairness of Wireless Networks: A Deep Learning Approach. Energies 2019, 12, 4300. https://doi.org/10.3390/en12224300

AMA Style

Lee H, Jang HS, Jung BC. Improving Energy Efficiency Fairness of Wireless Networks: A Deep Learning Approach. Energies. 2019; 12(22):4300. https://doi.org/10.3390/en12224300

Chicago/Turabian Style

Lee, Hoon, Han Seung Jang, and Bang Chul Jung. 2019. "Improving Energy Efficiency Fairness of Wireless Networks: A Deep Learning Approach" Energies 12, no. 22: 4300. https://doi.org/10.3390/en12224300

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop