A Green Computing Business Aggregation Strategy for Low Earth Orbit Satellite Networks
Abstract
1. Introduction
2. System Model
2.1. Network Model
2.2. Communication Model
2.3. Computation Model
3. Problem Modeling
4. Problem Solution
- Sub-problem 1: Determining the set of sleeping satellites
- Sub-problem 2: aggregating businesses from sleeping satellites to working satellites
- Step 1: Initialization. The control satellite initializes the process by collecting information on service distribution and satellite parameters.
- Step 2: Determine the number of working satellites. Based on the current service volume, determine the number of satellites that will remain active.
- Step 3: Determine the set of active satellites and the set of dormant satellites. Classify satellites into active and dormant sets based on service demand.
- Step 4: Model the transfer problem using MDP. Use a Markov Decision Process (MDP) to model the transfer problem for .
- Step 5: Perform transfer analysis of using double DQN. Conduct transfer analysis for using a Double Deep Q-Network (Double DQN).
- Step 6: Analyze indicator values, record the number of working satellites and business aggregation plans. Analyze indicator values, and record the number of active satellites and the business aggregation scheme.
- Step 7: Check if all dormant satellite services are considered. Verify if all services for dormant satellites have been considered. If not, return to continue the process; if yes, end the process.
4.1. Determining the Set of Sleeping Satellites
- Sorting the satellites: First, sort the business satellites in ascending order based on their business volume to obtain the list .
- Calculating the number of working satellites: Determine the number of working satellites V using the relationship between the current business volume and the system’s maximum capacity as per Equation (22):
- Determining satellite sets: Based on the calculated number V and the sorted list , identify the set of working satellites and the set of sleeping satellites .
4.2. Aggregating Businesses
4.2.1. MDP Element Group
- We define the elements of the MDP as follows:
- State space (): , where represents the current business volume of satellite .
- Action space (): . Each action denotes assigning business to satellite .
- Transition probability (): The probability of assigning business to satellite is represented as follows: . This denotes the probability of satellite transitioning from state to state after action .
- Reward function (): The reward for assigning business to satellite is defined as .
- Discount factor (): is a discount factor between 0 and 1 that balances the importance of current and future rewards.
4.2.2. Double DQN
- Online network (): The primary network used for selecting actions.
- Target network (): A secondary network with parameters that are periodically updated to stabilize training.
- Action selection using -greedy strategy: Based on the -greedy policy, an action is selected in a given state as per the following:
- Calculating transition probabilities: The probability of transferring business to satellite is computed as:
- Reward calculation: The reward for taking action in state is calculated as:
- Updating the Q-values using the Bellman equation: We update the Q-value of the online network using the Bellman equation as shown:
- Convergence check: Perform a convergence check to determine if the Q-values have stabilized:
5. Simulation Analysis
5.1. Simulation Parameter Design
5.2. Simulation Scenario Analysis with STK
5.3. Strategy Simulation and Analysis
- Ant Colony Strategy (AC): This strategy generates aggregation decisions and resource aggregations by simulating ant colony behavior for global optimization.
- MDP-QL Strategy (MDP-QL): This strategy constructs a Q-table to generate aggregation decisions and resource aggregations, aiming to achieve global optimization.
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Data Availability Statement
Conflicts of Interest
References
- ITU. Framework and Overall Objectives of the Future Development of IMT for 2030 and Beyond. Available online: https://www.itu.int/en/publications/Pages/default.aspx (accessed on 10 September 2024).
- Zhu, X.; Jiang, C. Creating Efficient Integrated Satellite-Terrestrial Networks in the 6G Era. IEEE Wirel. Commun. 2022, 29, 154–160. [Google Scholar] [CrossRef]
- Yue, P.; An, J.; Zhang, J.; Ye, J.; Pan, G. Low Earth Orbit Satellite Security and Reliability: Issues, Solutions, and the Road Ahead. IEEE Commun. Surv. Tutor. 2023, 25, 1604–1652. [Google Scholar] [CrossRef]
- Angmo, D.; Yan, S.; Liang, D.; Scully, A.D.; Chesman, A.S.R.; Kellam, M. Toward Rollable Printed Perovskite Solar Cells for Deployment in Low-Earth Orbit Space Applications. ACS Appl. Energy Mater. 2024, 7, 1777–1791. [Google Scholar] [CrossRef]
- Song, Y.; Li, X.; Ji, H.; Zhang, H. Energy-Aware Task Offloading and Resource Allocation in the Intelligent LEO Satellite Network. In Proceedings of the IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Kyoto, Japan, 12–15 September 2022; pp. 481–486. [Google Scholar] [CrossRef]
- Al-Hraishawi, H.; Chatzinotas, S. Quantum Optimization Algorithm for LEO Satellite Communications Based on Cell-Free Massive MIMO. In Proceedings of the IEEE International Conference on Communications Workshops (ICC Workshops), Rome, Italy, 28 May–1 June 2023. [Google Scholar] [CrossRef]
- Bhattacharjee, D.; Madoery, P.G.; Chaudhry, A.U.; Yanikomeroglu, H.; Kurt, G.K.; Hu, P. On-Demand Routing in LEO Mega-Constellations with Dynamic Laser Inter-Satellite Links. IEEE Trans. Aerosp. Electron. Syst. 2024, 60, 7089–7105. [Google Scholar] [CrossRef]
- Wang, Y.; Gui, K.A. An Energy Consumption Minimization Resource Allocation Strategy in Satellite-Terrestrial Communication Networks. Electron. Lett. 2023, 59, e13025. [Google Scholar] [CrossRef]
- Raj, R.; Dharmaraja, S. Stochastic Modelling of Multi-Layer HAP-LEO Systems in 6G for Energy Saving: An Analytical Approach. Comput. Commun. 2023, 210, 22–34. [Google Scholar] [CrossRef]
- Gao, X.; Liu, R.; Kaushik, A. Virtual Network Function Placement in Satellite Edge Computing with a Potential Game Approach. IEEE Trans. Netw. Serv. Manag. 2022, 19, 1243–1259. [Google Scholar] [CrossRef]
- Zhang, Y.; Wu, Q.; Lai, Z.; Deng, Y.; Li, H.; Li, Y. Energy Drain Attack in Satellite Internet Constellations. In Proceedings of the IEEE/ACM International Symposium on Quality of Service (IWQoS), Orlando, FL, USA, 19–21 June 2023; pp. 1–10. [Google Scholar] [CrossRef]
- Lin, X.; Liu, A.; Han, C.; Liang, X.; Pan, K.; Gao, Z. LEO Satellite and UAVs Assisted Mobile Edge Computing for Tactical Ad-Hoc Network: A Game Theory Approach. IEEE Internet Things J. 2023, 10, 20560–20573. [Google Scholar] [CrossRef]
- Huang, Y.; Jiang, X.; Chen, S.; Yang, F.; Yang, J. Pheromone Incentivized Intelligent Multipath Traffic Scheduling Approach for LEO Satellite Networks. IEEE Trans. Wirel. Commun. 2022, 21, 5889–5902. [Google Scholar] [CrossRef]
Parameter | Value |
---|---|
Control satellite altitude | 2000 km |
Business satellite altitude | 500–1500 km |
Number of control satellites | 120 |
Number of business satellites | 720 |
Number of businesses | 1000–9000 |
Elevation angle | 15.2–51.9 |
10–50 W | |
5–25 W | |
60–415 W | |
5–8 W | |
3–6 W | |
45–55 W | |
3–5 W | |
1–3 W | |
20–40 MHz | |
20–40 MHz | |
bit/s | |
f | cycle/s |
−140.4 dBm | |
−110 dBm | |
300 cycle/bit | |
1 s | |
0.6 s | |
bit– bit |
Parameter | Value |
---|---|
Learning rate (lr) | 0.001 |
Epsilon decay | 0.995 |
Discount factor () | 0.99 |
Episodes | 500 |
Number of Businesses | Delay Increment (s) | Energy Reduction Ratio |
---|---|---|
1000 | 0.0161 | 47.87% |
3000 | 0.0227 | 22.01% |
5000 | 0.0203 | 11.34% |
7000 | 0.0304 | 7.83% |
9000 | 0.0299 | 4.36% |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Wang, B.; Lv, J.; Huang, D.; Lu, Z.; Fang, Y. A Green Computing Business Aggregation Strategy for Low Earth Orbit Satellite Networks. Sensors 2024, 24, 8184. https://doi.org/10.3390/s24248184
Wang B, Lv J, Huang D, Lu Z, Fang Y. A Green Computing Business Aggregation Strategy for Low Earth Orbit Satellite Networks. Sensors. 2024; 24(24):8184. https://doi.org/10.3390/s24248184
Chicago/Turabian StyleWang, Bo, Jiaqi Lv, Dongyan Huang, Zelin Lu, and Yuhang Fang. 2024. "A Green Computing Business Aggregation Strategy for Low Earth Orbit Satellite Networks" Sensors 24, no. 24: 8184. https://doi.org/10.3390/s24248184
APA StyleWang, B., Lv, J., Huang, D., Lu, Z., & Fang, Y. (2024). A Green Computing Business Aggregation Strategy for Low Earth Orbit Satellite Networks. Sensors, 24(24), 8184. https://doi.org/10.3390/s24248184