Search Results (2)

To improve the accuracy and reliability of precipitation estimation, numerous models based on machine learning technology have been developed for integrating data from multiple sources. However, little attention has been paid to extracting the spatiotemporal correlation patterns between satellite products and rain gauge observations during the merging process. This paper focuses on this issue by proposing an integrated framework to generate an accurate and reliable spatiotemporal estimation of precipitation. The proposed framework integrates Funk-Singular Value Decomposition (F-SVD) in the recommender system to achieve the accurate spatial distribution of precipitation based on the spatiotemporal interpolation of rain gauge observations and Convolutional Long Short-Term Memory (ConvLSTM) to merge precipitation data from interpolation results and satellite observation through exploiting the spatiotemporal correlation pattern between them. The framework (FS-ConvLSTM) is utilized to obtain hourly precipitation merging data with a resolution of 0.1° in Jianxi Basin, southeast of China, from both rain gauge data and Global Precipitation Measurement (GPM) from 2006 to 2018. The LSTM and Inverse Distance Weighting (IDW) are constructed for comparison purposes. The results demonstrate that the framework could not only provide more accurate precipitation distribution but also achieve better stability and reliability. Compared with other models, it performs better in variation process description and rainfall capture capability, and the root mean square error (RSME) and probability of detection (POD) are improved by 63.6% and 22.9% from the original GPM, respectively. In addition, the merged precipitation combines the strength of different data while mitigating their weaknesses and has good agreement with observed precipitation in terms of magnitude and spatial distribution. Consequently, the proposed framework provides a valuable tool to improve the accuracy of precipitation estimation, which can have important implications for water resource management and natural disaster preparedness. Full article

The most common problems that arise when working with big data for intelligent production are analyzed in the article. The work of recommendation systems for finding the most relevant user information was considered. The features of the singular-value decomposition (SVD) and Funk SVD algorithms for reducing the dimensionality of data and providing quick recommendations were determined. An improvement of the Funk SVD algorithm using a smaller required amount of user data for analysis was proposed. According to the results of the experiments, the proposed modification improves the speed of data processing on average by 50–70% depending on the number of users and allows spending fewer computing resources. As follows, recommendations to users are provided in a shorter period and are more relevant. The faster calculation of modified Funk SVD to exchange the optimal parameters between nodes was proposed. It was determined that execution time can be reduced on average by 75% for using ten nodes exchanging the optimal decomposition parameter compared to using one. Using Spark technology for faster calculation on average by 20% compared to Hadoop was proposed. The architecture of the IIoT system was proposed, which uses a modified Funk SVD algorithm to optimize data on edge devices and monitors the effectiveness of providing recommendations using control centers and cloud resources. Full article