Next Article in Journal
Energy Efficient Enhancement in a 5.8 GHz Batteryless Node Suitable for Backscattering Communications
Next Article in Special Issue
Optimizing Neural Networks for Imbalanced Data
Previous Article in Journal
Cuk PFC Converter Based on Variable Inductor
Previous Article in Special Issue
Barycentric Kernel for Bayesian Optimization of Chemical Mixture
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Spatio-Temporal Hybrid Neural Network for Crowd Flow Prediction in Key Urban Areas

1
Hubei Academy of Scientific and Technical Information, Hongshan Road, Wuhan 430071, China
2
School of Computer Science and Information Engineering, Hubei University, No. 368, Youyi Road, Wuhan 430064, China
*
Author to whom correspondence should be addressed.
Electronics 2023, 12(10), 2255; https://doi.org/10.3390/electronics12102255
Submission received: 26 April 2023 / Revised: 11 May 2023 / Accepted: 14 May 2023 / Published: 16 May 2023
(This article belongs to the Special Issue Machine Learning in Recommender Systems and Prediction Model)

Abstract

:
The prediction of crowd flow in key urban areas is an important basis for city informatization development and management. Timely understanding of crowd flow trends can provide cities with data support in epidemic prevention, public security management, and other aspects. In this paper, the model uses the Node2Vec graph embedding algorithm combined with LSTM (NDV-LSTM) to predict crowd flow. The model first analyzes the correspondence between key areas and grid centers, and the Node2Vec graph embedding algorithm was used to extract spatial features. At the same time, considering urban region type, weather, temperature, and other crowd flow data features, the long short-term memory (LSTM) network model was used for unified modeling. The model uses the crowd flow of the previous three days to predict the crowd flow of the next day. The model was evaluated on the 2020 CCF crowd density competition data set. The experimental results show that the NDV-LSTM model can capture the features of the region association digraph and various crowd flow correlation factors well, and the mean square error of the prediction of the crowd flow in key areas is reduced to 1.5194.

1. Introduction

Urban big data constitute an important information resource for urban economic development. With the continuous development and progress of cities, urban data such as crowd flow, street grid, crowd trajectory, regional information, and weather features are quietly emerging. Urban data collection is an integral activity [1]. By mining and analyzing various types of data, urban computing describes the internal model of urban development and provides decision support for subsequent management and development of the city. The movement track of people produced by activities within the city shows different features in different types of areas, and there are different crowd flow rules [1]. At the same time, urban population distribution and population activities display a regular spatio-temporal dynamic evolution [2]. Population prediction in key urban areas has gradually become a research hotspot for scholars [3,4,5,6,7], which is of great significance and utility for urban epidemic and public security prevention and other emergency needs. We believe that, in the future, applications based on trajectory data will become closely related to people’s daily lives [8].
For the problem of predicting crowd flow, the performance of mathematical formulas is not as good as that of neural network models. This is because the size of crowd flow is influenced by various factors, such as weather features and holiday features, which can cause significant fluctuations. The neural network model can capture these features well. In the early stage, most researchers in the field of crowd flow prediction used statistical learning algorithms or neural network models to solve the problem of crowd flow prediction with complex features [9,10]. Subsequently, many researchers attempted to explore the law of population flow from various aspects to understand the features of crowd activity in different time ranges, such as trend, cycle law, spatial flow law, and other features that can be adopted and modeled by existing models [11]. With the regular division of urban grid regions, a large number of grid-based population flow data are generated correspondingly, providing a new analytical idea for the study of population flow prediction in key urban areas. Some researchers also use the historical dynamic movement trajectory of a population to learn the law of population flow and predict the future movement trajectory of the population [12]. Population flow data often have complex nonlinear correlation features [13]. The generation and change of urban crowd flow data are directly related to human activities [14] and are also affected by complex factors such as weather, geographical location, and environment. However, the common time series model prediction method can only predict the time series of crowd flow, which lacks an exploration of regional spatial correlation, and the single model does not combine well with the spatial attributes of crowd flow. Conventional convolutional neural networks input regular grid partition when extracting spatial features, which does not take into account the flow relationship between grids well.
This paper proposes a spatio-temporal hybrid neural network for population prediction in key urban areas. In this model, the grid where the center of key areas (such as parks, hospitals, stadiums, and other public places) is located represents the crowd flow information of the core of the region [15], and the flow relationship between the grids is converted into the grid connection strength coefficient. The grid connection strength coefficient is used as the weight to construct the region association digraph. Then, the Node2vec graph embedding algorithm is used to extract spatial features. The factors affecting regional crowd flow, such as weather and region type, are mapped as influencing factors to optimize the model. The long short-term memory (LSTM) network model is used to combine spatial and other features to predict the future population flow in urban areas. Experiments on the 2020 CCF population density data set demonstrate the effectiveness of the proposed algorithm.

2. Related Work

Recently it was proved that computational techniques, specifically machine learning, have numerous applications in all engineering fields. Azimirad et al. [16] proposed a consecutive hybrid spiking-convolutional (CHSC) neural controller by integrating convolutional neural networks (CNNs) and spiking neural networks (SNNs). Roshani et al. [17] proposed a system to measure both density and velocity of fluids simultaneously. Mozaffari et al. [18] proposed an equal and equitable federated learning (E2FL) to produce fair federated learning models by preserving two main fairness properties, equity and equality, concurrently.
The existing crowd flow prediction methods mainly include: a method based on historical crowd flow statistics, a prediction method based on spatial clustering, a prediction method based on a time series model, and a prediction method based on the neural network combination model.
The method based on historical crowd flow statistics can predict the result of crowd flow in the future by collecting historical data. The autoregressive comprehensive moving average (ARIMA) model [19] is a classic model based on statistical analysis. This model needs to present the time series information as linear correlation features and is not suitable for trend prediction with complex changes, such as the prediction of regional crowd flow. Aiming at the problem that the ARIMA model is affected by the residual and the results are unstable, Shen [20] proposed an improved residual model for short-term crowd flow prediction. Gui [21] proposed a density-based spatial clustering (DBSCAN) method with noise to identify hot spots in different time periods.
In recent years, the neural network-based crowd flow prediction method has made effective progress [22]. Ma et al. [23] mapped the crowd flow data into images for learning through convolutional neural networks and predicted the crowd flow speed within the scope of large-scale networks with high-precision spatio-temporal correlation. Zhang et al. [24] proposed a Deep-ST model, which uses convolutional neural networks (CNN) to rasterize the spatio-temporal data and models the distance dependence, time proximity, cycle, and trend of space. It also adds features such as weather and holidays to predict the urban crowd flow. Xie et al. [25] adopted the multi-scale sequential convolutional network to realize the re-calibration of short dependence and multi-scale temporal pattern features in the temporal data of human crowd flow. On the basis of the previous model, Zhang et al. [26] added a residual module and proposed a spatio-temporal residual network (ST-ResNet), replacing CNN module in the Deep-ST model with ResNet, so that the model can carry out convolutional mining of distant spatial correlation features.
Recently, many scholars have begun to shift their research perspective from multi-level spatial distribution of population [27] to population mobility. Most of the existing studies use national census data, and there is a lack of research on the population flow of urban areas, the relationship between regions, and the discovery of popular areas from the trajectory database [28]. Guo [29] proposed a spatio-temporal cyclic convolutional network (ASTRCNs) model based on the attention mechanism, taking into account various factors affecting regional population flow and conducting unified modeling. Xiong [30] proposed a DCGRu-RF (diffusion convolutional recurrent unit-random forest) model for short-term crowd flow prediction. Xiong firstly used the DCGRU network to learn the spatial correlation features of crowd flow data. Then, the RF model was selected as the predictor, and the nonlinear prediction model was formed and combined with the flow data to learn the timing features. Qiao et al. [31] proposed an adaptive trajectory prediction of moving objects in the case of big data. The model processed position density through massive moving object data, automatically selected parameters according to moving objects, and then output trajectory prediction results. The most existing studies use a single model to predict urban population data, which has achieved good prediction effect. However, due to the poor combination effect with the spatial attributes of crowd flow, there is a lack of comprehensive exploration of the regular features of crowd activities [32]. When extracting spatial features, the traditional convolutional neural network ignores the flow relationship between grids and poorly captures the information features in regional crowd flow data, with some shortcomings in efficiency. In this paper, the region association digraph is built dynamically based on the crowd flow, and the flow relationship between the grids is considered. The spatial features of the graph and the time features of the crowd flow are extracted, and the Node2Vec algorithm is used to integrate various crowd flow data features such as urban area type, area area, weather, and holidays. The embedding of the region association digraph is more expressive, resulting in a higher quality sequence of graph nodes, so as to improve the accuracy of model prediction. Table 1 lists the main symbols and their meanings in this paper.

3. Spatio-Temporal Hybrid Neural Network Model

This paper aims to alleviate the problems identified in the related work above and uses the Node2Vec graph embedding algorithm to learn the spatial attribute features and predict the spatio-temporal features of crowd flow in key areas.

3.1. Problem Definition

The crowd flow sequence of key areas is a time series reflecting the change in regional crowd flow. Let x z d represent the crowd flow of area d in time period z. f 1 . . . T d = ( x 1 d , x 2 d ,..., x T d ) represents the crowd flow sequence of a certain key region d in T historical time periods. F = ( f 1 . . . T 1 , f 1 . . . T 2 ,..., f 1 . . . T D ) represents the sequence of all crowd flow in D key areas during the period from 1 to T.
Given the historical crowd flow F = ( f 1 . . . T 1 , f 1 . . . T 2 ,..., f 1 . . . T D ), we want to learn a model that can predict the crowd flow of D areas to be tested during the period T to T + h , Y = ( f T . . . T + h 1 , f T . . . T + h 2 ,..., f T . . . T + h D ), where h represents the delay between the current time period T and the target time period.

3.2. Overall Framework

NDV-LSTM first constructs the region association digraph and then extracts the spatial features using the Node2Vec graph embedding algorithm to study the flow relationship between different regions of the crowd flow. It then optimizes the model by mapping the weather, region type, and other factors affecting the regional crowd flow as influencing factors. The long short-term memory (LSTM) network model is used to predict the future population flow in urban areas by combining the spatial and other features. Figure 1 shows the model structure diagram of NDV-LSTM, whose core is mainly composed of three parts:
  • Node2Vec part: Input the spatial region association digraph with time information and extract the high-dimensional feature vector by using the Node2Vec graph embedding algorithm;
  • Feature extraction: The feature information of region type, weather, temperature, holiday, and other crowd flow data is mapped into vectors and introduced into the model to obtain the spatial vector matrix;
  • LSTM part: Input a spatial high-dimensional feature vector with time information and multi-dimensional features such as region type, weather, temperature, and holidays.
Figure 1. NDV-LSTM model frame diagram.
Figure 1. NDV-LSTM model frame diagram.
Electronics 12 02255 g001

3.3. Region Association Digraph Design

In this paper, the grid where the center of key areas (such as parks, hospitals, and other public places) is located represents the core crowd flow of the region, and the data of the regional center grid are used to construct the region association digraph. The crowd flow between the grids is used as the weight of the edges.
Taking F as the input sequence of historical crowd flow, the historical crowd flow F is used to construct a region association digraph, which is formalized as G. As shown in Figure 2, assuming that there is actually a connection between region A and region B at time t, it means that there is certain crowd mobility from place A to B at time t. After constructing the region association digraph, it is converted into the association representation of region A to region B in Figure 3.

3.4. Region Association Digraph Vectorization

Node2Vec is a random walk graph embedding algorithm that combines depth-first and breadth-first graph sampling [33]. The main idea of the Node2Vec algorithm is as follows: G indicates the association digraph of key areas at a certain time, including the association weight between nodes in the current key area and nodes in adjacent areas. Use the walk sequence generated by all the key region nodes to encode the nodes and obtain the vector representation of each region node. The first key area node is represented by u. The Node2Vec algorithm generates a random sequence walk from node u, selects the next area node s according to the transfer probability of its surrounding area nodes, adds s to the sequence, and so on. For each node in the region association digraph, this paper sets the probability of the node vector appearing in the adjacent region as the maximum (Equation (1)).
max f = u V log P r ( N s ( u ) | f ( u ) )
The probability that each regional node u is selected to join the random sequence is determined by its adjacent node N ( u ) (Equation (2)).
P r ( N s ( u ) | f ( u ) ) = n i N s ( u ) P r ( n i | f ( u ) )
The probability corresponding to each other region under the node vector of this region is represented by softmax (Equation (3)).
P r ( n i | f ( u ) ) = e x p ( f ( n i ) f ( u ) ) u V e x p ( f ( v ) f ( u ) )
After optimization, the objective function is Equations (4) and (5).
max f = u V [ l o g Z u + n i N s ( u ) f ( n i f ( u ) ) ]
Z u = u V e x p ( f ( u ) f ( v ) )
Given regional node u and its adjacent regional point N ( u ) , the algorithm maps the vector representation of each key regional node. The final output of Node2Vec is X 0 . . . . . . 23 - Y 1 . . . . . . 997 = [ p 0 , p 1 , . . . . . . , p 15 ] , where X 0 . . . . . . 23 is the total vector of the region from 0 to 23 h and Y 1 . . . . . . 997 is the vector under 997 common domains. Therefore, p represents the following Equation (6):
p = ( p 0 , p 1 , . . . . . . , p 15 )

3.5. Description of Features

3.5.1. Holiday Features

There are two forms of urban people’s work and rest features: workday and weekend. This paper mainly marks the date as workday and weekend. If day is less than or equal to 5, it is marked as 0 and stored in the workday list, marked as workday. If day is greater than 5, it is marked as 1 and stored in the weekend list, marked as weekend. The form of the holiday feature data is shown in Equation (7):
k = ( 0 , 1 , 1 , . . . . . . , 0 )

3.5.2. Weather Features

In this paper, weather is divided into three categories according to its severity (denoted by 0, 1, and 2 respectively, as shown in Table 1). Suppose e is the weather type and l is the minimum temperature. The form of weather feature data is shown in Equations (8) and (9):
e = ( 0 , 1 , 2 , . . . . . . , 2 )
l = ( 0 , 1 , 4 , . . . . . . , 7 )

3.5.3. Region Information Features

This paper divides 997 public areas into different types according to its region type (parks, zoos, cultural relics, aquariums, scenic spots, botanical gardens, amusement parks, colleges and universities, shopping centers, general hospitals, sports venues, railway stations, airports, long-distance bus stations). t represents the regional types, and m represents the area of the region. The form of the regional information feature is shown in Equations (10) and (11):
t = ( t 1 , t 2 , . . . . . . , t 14 )
m = ( m 1 , m 2 , . . . . . . , m 997 )

3.5.4. Feature Fusion

In LSTM, spatial features, holiday features, weather features, and region information features are cyclically combined according to region ID and integrated into multidimensional crowd flow data (Equation (12)) for time series prediction.
f l o w d a t a = ( p , d , k , e , l , t , m , f , f b 1 , f b 2 , e b , l b , k b )

3.6. Prediction of Crowd Flow

As shown in Figure 4, the algorithm adopts two-layer LSTM, and the output of the first layer is used as the input of the second one. The step size of the algorithm is 3, which means that x 0 produces the output x 1 at the first step, x 1 produces the output x 2 at the second step, and x 2 produces the final output at the third step. Two fully connected layers are used to increase the depth of the model and strengthen the fitting ability of the model. Finally, the dimension of the model is reduced, and the output is the predicted crowd flow.
The input of the LSTM input gate is expressed as Equation (13):
w = i = 1 n s i j x j n + j c s i j r c i 1
The input of the output gate is expressed as Equation (14):
w q n = i = 1 n s i j x j n + g = 1 G s i j a g i 1 + c = 1 C s c f a c i 1
The output of the output gate is expressed as Equation (15):
a q n = σ ( w n q )
where s i j represents the weight of neuron i to neuron j in the model, w represents the input, a represents the output, q indicates output gating, c represents neurons, n represents the number of neurons, g represents neuron output activation function, G represents the number of hidden layers of the LSTM, r represents the unit state of the model, and σ is the activation function.
The final NDV-LSTM prediction result is expressed as Equation (16):
f 0 . . . . . . 997 = ( f 0 , f 1 , f 2 , . . . . . . , f 24 )

4. Experiments

This paper uses the 2020 CCF crowd density competition data set. The data processing and model experiments are carried out in the environment of tensorflow1.14 and python3.7. The algorithm is run in 8G memory, i7-8565U CPU, and Windows 10, including experimental data preprocessing and late feature value processing. This paper mainly uses the software MATLAB to export the charts and diagrams.

4.1. Dataset and Pretreatment

4.1.1. Dataset Overview

The crowd flow index in the data set represents the volume of crowd flow in the key area during a certain hour of the day. For example, the larger the crowd flow index of an area R, the more people appear in the area R, and vice versa. The dataset overview is shown in Table 2.

4.1.2. Experimental Data Processing

(1)
Spatial feature data preprocessing: As can be seen from the previous section, the 24 files in the area-flow-graph folder all correspond to the region-to-region association in different hours. The region association digraph is obtained, and then the spatial features of the region information are extracted to obtain the vector representation.
(2)
Sequential feature data preprocessing: The algorithm sets a 24-h cycle, and there are 30 days’ worth of historical data in each cycle. The experimental date data is from the 17th to the 15th of the next month, and the 17th is marked as 0, while the 15th of the next month is marked as 29. Read the file area: Passenger—Regional crowd flow information for 30 days. The area-flow list stores (ID, day-hour, crowd flow index) information.
(3)
External influence feature data preprocessing: This includes region information, weather features, and holiday feature data preprocessing. The regional category is divided into tourist attractions, education training, shopping, medical treatment, sports fitness, and transportation facilities. Weather features are divided into moderate snow, cloudy, light rain, light snow, fine, blizzard, overcast, sleet, fog, and haze. Holiday feature data are mainly marked as workdays and weekends.
A variety of data features are fused into a fixed format and stored in the flow-data list, and then the regional crowd flow is normalized to the range [0, 1] by using the min-max method.
The model divides the data into 24 h blocks for cycle training. During each hour of training, the flow-data list contains the crowd flow data of 997 areas in the past 30 days during this period. There are 717,840 pieces of data in this experiment, with the training set accounting for 90% and verification set for 10%. The data from a certain hour in the previous three days are used to predict the result of an hour in the next day, and the final circulation output is 24 h in the next day.

4.2. Baseline and Evaluation Index

In this paper, the region association digraph is constructed to learn spatial features. In order to verify the effectiveness of the NDV-LSTM model in predicting crowd flow in key areas, existing model methods HA, ARIMA, and LSTM are selected for comparative experiments and ablation experiments. The comparison model is as follows:
(1)
Historical average (HA): The idea of this model is using the 24-h crowd flow index of the previous three days to predict the 24-h crowd flow index of the next day. Therefore, the HA method takes the average of a certain hour in the previous three days as the crowd flow of the area in the next hour.
(2)
Autoregressive integrated moving average (ARIMA) model: This is a classical method to predict time series in various regions. The paper adopts the round-robin prediction method to obtain the prediction results under 24 h and average them as the final ARIMA error results.
(3)
Long short-term memory (LSTM) network model: The model itself has great advantages in time series prediction.
(4)
NDV-LSTM-type: The model removes the spatial region type feature.
(5)
NDV-LSTM-day: The model removes the rest feature.
(6)
NDV-LSTM-weather: The model removes the weather type feature.
In order to assess the prediction effect of the NDV-LSTM model, the mean square error (MSE) of the model prediction results under 24 h was selected as the evaluation and comparison index of the model experiment. The MSE formula is as follows (Equation (17)):
M S E = 1 n i = 1 n ( y i y i ¯ ) 2
where y i represents the predicted result value of the model and y i ¯ represents the real label value of the source data [34].

4.3. Experimental Result

The final experimental results are shown in Table 3.

4.4. Experimental Analysis

4.4.1. Model Comparison Analysis

Through the above experimental comparison results, it can be seen that:
(1)
The mean square error of the HA method is relatively small. The algorithm uses the crowd flow of each hour on February 12, 13, and 14 to predict the crowd flow of this region on February 15. Among them, February 13, 14, and 15 fall on Tuesday, Wednesday, and Thursday, so the results of adjacent workdays are relatively stable.
(2)
The mean square error of the ARIMA method is relatively large because it needs to input a stable time series and cannot learn the features of complex factors. There are holidays from January 17 to February 25, and the sequential features of crowd flow in the early stage are not stable, resulting in poor performance.
(3)
The mean square error of the LSTM neural network model is large due to spatio-temporal data that are related to a variety of factors; there are many factors involved in the features of crowd flow. The time series data of the experiment is from the Spring Festival to workdays, and the weather in Beijing is cold. Therefore, it is difficult to capture normal and stable time sequence rules to predict the future crowd flow in key areas. The overall training results of the NDV-LSTM model proposed in this paper are stable, the prediction results are more accurate with the input of different features.
In this paper, the ablation experiment was conducted, and the influence of different types of feature data on the experimental results was analyzed. The mean square error decreases by 51% after removing the region type feature (NDV-LSTM-type), which proves the necessity of the actual region type feature for the prediction of the crowd flow in key areas. After removing the holiday feature (NDV-LSTM-day), the mean square error decreases by 57%, which proves that the work and rest type features have an impact on the prediction of crowd flow. After removing the weather type feature (NDV-LSTM-weather), the mean square error decreases significantly because the data set was collected in winter; therefore, the weather type feature has a great influence on the model prediction results.

4.4.2. Parameter Settings

The mean square error results of the NDV-LSTM obviously decrease with high training epochs and drop to the lowest when the epochs total 1000. As shown in Table 4, the epochs are set at 1000, and the MSE is 1.5677.
Under the same time period and epoch but different batch sizes, the model training error is not much different, as shown in Table 5. The MSE is decreased to 2.6433 when the batch size is 128.

4.4.3. Analysis of Crowd Flow in Key Areas

In order to more intuitively analyze the rationality of modeling and understand the actual law of crowd flow in key areas, this paper analyzes the prediction results of crowd flow in 3 adjacent days during the same hour in the same area type. For example, we can choose three tourist attractions—Beiwu Park, Guta Park, and Niantan Park—and obtain the crowd flow at 2:00 p.m. on February 13, 14, and 15. Figure 5 represents the real data, and Figure 6 represents the predicted result data of NDV-LSTM. The horizontal axis is the date, and the vertical axis is the region ID. The scale on the right means that the darker the color, the greater the amount of crowd flow in the thermodynamic diagram. It can be seen from the figure:
(1)
If the region type is the same, the crowd flow index is similar in the same hour on three adjacent days. This also verifies the validity of the modeling idea of using the same hour of the previous three days to predict the crowd flow of the next day.
(2)
It can be seen that the predicted results of the model are also consistent with the actual situation of the flow trend of the first three days in the same hour and the same area type, thus verifying the accuracy of the predicted results of the model.

5. Conclusions and Future Work

In view of the high spatio-temporal correlation of the crowd flow, and combining various factors affecting the prediction of urban crowd flow, this paper proposed a prediction model of urban crowd flow based on a multi-dimensional hybrid neural network model. Different from other models in regular European grid space, this paper constructed a region association digraph based on grid connection strength. The Node2Vec graph embedding algorithm was used to transform the region association digraph under different key regions into a multi-dimensional vector sequence. At the same time, multiple factors were mapped into the LSTM model to study and predict the crowd flow in key areas. The experimental results showed that the introduction of region type, holiday, weather, and other features can significantly reduce the error of prediction, which proves the validity of the NDV-LSTM model prediction.
In this paper, data analysis and reasonable application were carried out for the prediction of crowd flow in key urban areas. The accuracy of the model was improved to a certain extent, but there is still room for improvement as follows:
(1)
The normal flow of people has complex migration and other rules. How to consider the multiple features of the law of crowd flow more comprehensively will continue to be studied.
(2)
The crowd flow relationship and the features of the crowd flow in adjacent hours will also have an impact on the prediction. How to let the model learn the feature information of adjacent hours is also the focus of subsequent research. We will try using an attention mechanism with LSTM and encoder-decoder architecture to improve the performance for the future improvement.

Author Contributions

Conceptualization, methodology, funding acquisition, D.H.; Validation, formal analysis, J.J.; Writing—review and editing, experiment, Y.W. (Yaoqing Wang); Investigation, L.Y.; Original draft, Z.C.; Experimental analysis, conclusion, J.L.; Data collection, Q.W.; Resources, data curation, Y.W. (Yongsen Wang). All authors have read and agreed to the published version of the manuscript.

Funding

This work was partially supported by the Technology Innovation Special Program of Hubei Province (No. 2022BAA044, No. 2021BAA188), the Key Project of Science and Technology Research Program of Hubei Provincial Education Department (No. D20201006), and the National Natural Science Foundation of China (No. 61977021).

Institutional Review Board Statement

This study did not involve humans or animals.

Informed Consent Statement

This study did not involve humans.

Data Availability Statement

All the details of this work, including data and algorithm codes, are available from the corresponding author: [email protected].

Acknowledgments

The authors would like to thank the reviewers for their helpful suggestions, which have considerably improved the quality of the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zhai, Z.; Liu, P.; Zhao, L.; Qian, J.; Cheng, B. An efficiency-enhanced deep learning model for citywide crowd flows prediction. Int. J. Mach. Learn. Cybern. 2021, 12, 1879–1891. [Google Scholar] [CrossRef]
  2. Xing, J.; Kong, X.; Xing, W.; Wei, X.; Zhang, J.; Lu, W. STGs: Construct spatial and temporal graphs for citywide crowd flow prediction. Appl. Intell. 2022, 52, 12272–12281. [Google Scholar] [CrossRef]
  3. Vatsavai, R.R.; Ganguly, A.; Chandola, V.; Stefanidis, A.; Klasky, S.; Shekhar, S. Spatiotemporal data mining in the era of big spatial data: Algorithms and applications. In Proceedings of the 1st ACM SIGSPATIAL International Workshop on Analytics for Big Geospatial Data, Redondo Beach, CA, USA, 6 November 2012; ACM: New York, NY, USA; pp. 1–10. [Google Scholar]
  4. Li, S.; Dragicevic, S.; Castro, F.A.; Sester, M.; Winter, S.; Coltekin, A.; Cheng, T. Geospatial big data handling theory and methods: A review and research challenges. ISPRS J. Photogramm. Remote. Sens. 2016, 115, 119–133. [Google Scholar] [CrossRef]
  5. Qing, Z.; Xiao, F. The review of visual analysis methods of multi-modal spatio-temporal big data. Acta Geod. Cartogr. Sin. 2017, 46, 1672–1677. [Google Scholar]
  6. Lin, W.; Chen, H.; Xie, P.; Li, Y.; Chen, Q.; Li, D. Spatial-temporal Variation Evaluation and Prediction of Population in Chaoyang District of Beijing Based on Multisource Data. J. Geo-Inf. Sci. 2018, 20, 1467–1477. [Google Scholar]
  7. Liao, Y.; Wang, J.; Meng, B. A method of spatialization of statistical population. Acta Geogr. Sin. Chin. Ed. 2007, 62, 1110. [Google Scholar]
  8. Cao, H.; Tang, H.; Wang, F.; Xu, Y. Survey on Trajectory Representation Learning Techniques. J. Softw. 2021, 32, 1461–1479. [Google Scholar] [CrossRef]
  9. Mourad, L.; Qi, H.; Shen, Y.; Yin, B. ASTIR: Spatio-temporal data mining for crowd flow prediction. IEEE Access 2019, 7, 175159–175165. [Google Scholar] [CrossRef]
  10. Li, W.; Tao, W.; Qiu, J.; Liu, X.; Zhou, X.; Pan, Z. Densely connected convolutional networks with attention LSTM for crowd flows prediction. IEEE Access 2019, 7, 140488–140498. [Google Scholar] [CrossRef]
  11. Sun, B.; Wei, X. Spatial distribution and structure evolution of employment and population in Shanghai Metropolitan Area. Acta Geogr. Sin. 2014, 69, 747–758. [Google Scholar]
  12. Ali, A.; Zhu, Y.; Zakarya, M. A data aggregation based approach to exploit dynamic spatio-temporal correlations for citywide crowd flows prediction in fog computing. Multimed. Tools Appl. 2021, 80, 31401–31433. [Google Scholar] [CrossRef]
  13. Liu, Y.; Xiao, Y.; Gao, S.; Kang, C.G.; Wang, Y.L. A review of human mobility research based on location aware devices. Geogr. Geo-Inf. Sci. 2011, 27, 8–13. [Google Scholar]
  14. Mingxiao, L.; Jie, C.; Hengcai, Z.; Peiyuan, Q.; Kang, L.; Feng, L. Estimation and characteristics of population distribution in Shanghai at fine spatio-temporal scale. J. Geoinf. Sci. 2017, 19, 800–807. [Google Scholar]
  15. Wang, X.; Zhou, Z.; Zhao, Y.; Zhang, X.; Xing, K.; Xiao, F.; Liu, Y. Improving urban crowd flow prediction on flexible region partition. IEEE Trans. Mob. Comput. 2019, 19, 2804–2817. [Google Scholar] [CrossRef]
  16. Azimirad, V.; Ramezanlou, M.T.; Sotubadi, S.V.; Janabi-Sharifi, F. A consecutive hybrid spiking-convolutional(CHSC) neural controller for sequential decision making in robots. Neurocomputing 2022, 490, 319–336. [Google Scholar] [CrossRef]
  17. Roshani, G.H.; Hanus, R.; Khazaei, A.; Zych, M.; Nazemi, E.; Mosorov, V. Density and velocity determination for single-phase flow based on radiotracer technique and neural networks. Flow Meas. Instrum. 2018, 61, 9–14. [Google Scholar] [CrossRef]
  18. Mozaffari, H.; Houmansadr, A. E2FL: Equal and Equitable Federated Learning. arXiv 2022, arXiv:2205.10454. [Google Scholar]
  19. Zhang, J.; Wang, Y.; Long, M.; Wang, J.; Wang, H. Predictive recurrent networks for seasonal spatiotemporal data with applications to urban computing. Chin. J. Comput. 2020, 43, 286–302. [Google Scholar]
  20. Shen, X.; Zhang, J.; Han, D. Short-term traffic flow prediction model based on gradient boosting regression tree. J. Comput. Sci. 2018, 45, 222–227. [Google Scholar]
  21. Gui, Z. Research on Navigation Oriented Urban Traffic Data Integral Modeling Method. Ph.D. Thesis, Peking University, Beijing, China, 2005. [Google Scholar]
  22. Li, J.; Liu, H.; Guo, W.; Chen, X. A spatio-temporal network for human activity prediction based on deep learning. Acta Geod. Cartogr. Sin. 2021, 50, 522–531. [Google Scholar]
  23. Ma, X.; Dai, Z.; He, Z.; Ma, J.; Wang, Y.; Wang, Y. Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction. Sensors 2017, 17, 818. [Google Scholar] [CrossRef] [PubMed]
  24. Zhang, H.; Zhang, J.; Wang, Z.; Yin, H. An Adaptive Spatial Resolution Method Based on the ST-ResNet Model for Hourly Property Crime Prediction. ISPRS Int. J. Geo Inf. 2021, 10, 314. [Google Scholar] [CrossRef]
  25. Xie, G.C.; Duan, L.; Jiang, W.P.; Xiao, S.; Xu, Y.F. Pedestrian Volume Prediction for Campus Public Area Based on Multi-scale Temporal Dependency. J. Softw. 2021, 32, 831–844. [Google Scholar]
  26. Zhang, J.; Zheng, Y.; Qi, D.; Li, R.; Yi, X.; Li, T. Predicting citywide crowd flows using deep spatio-temporal residual networks. Artif. Intell. 2018, 259, 147–166. [Google Scholar] [CrossRef]
  27. Liu, Z.; Qian, J.; Du, Y.; Wang, N.; Yi, J.; Sun, Y.; Ma, T.; Pei, T.; Zhou, C. Multi-level spatial distribution estimation model of interregional migrant population based on multi-source spatio-temporal big data: A case study of people migrating from Wuhan during COVID-19. J. Geoinf. Sci. 2020, 22, 147–160. [Google Scholar]
  28. Liu, Q.; Xiao, J.; Ding, Z.; Li, M. Discovery of hot regions in trajectory database. J. Softw. 2013, 24, 1816–1835. [Google Scholar] [CrossRef]
  29. Guo, S.; Lin, Y.; Jin, W.; Wan, H. Urban population flow prediction based on spatio-temporal cyclic Convolutional networks. Comput. Sci. 2019, 46, 385–391. [Google Scholar]
  30. Xiong, T.; Qi, Y.; Zhang, W. Short-term Traffic flow prediction of road network based on DCGRU-RF model. J. Comput. Sci. 2020, 47, 84–89. [Google Scholar]
  31. Qiao, S.; Li, T.; Han, N.; Gao, Y.; Yuan, C.; Wang, X.; Tang, C. Self-Adaptive Trajectory Prediction Model for Moving Objects in Big Data Environment. J. Softw. 2015, 26, 2869–2883. [Google Scholar]
  32. Yu, G.; Zhang, C. Switching ARIMA model based forecasting for traffic flow. In Proceedings of the 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing, Montreal, QC, Canada, 17–21 May 2004; Volume 2, p. ii-429. [Google Scholar]
  33. Grover, A.; Leskovec, J. node2vec: Scalable feature learning for networks. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; ACM: New York, NY, USA; pp. 855–864. [Google Scholar]
  34. Qi, G.; Qiu, W. Kalman Filter Applied Algorithm Based on Mean Square Error Minimum. Bull. Surv. Mapp. 2009, 1224–1229. [Google Scholar]
Figure 2. Actual region association diagram.
Figure 2. Actual region association diagram.
Electronics 12 02255 g002
Figure 3. Region association diagram.
Figure 3. Region association diagram.
Electronics 12 02255 g003
Figure 4. LSTM neural network model design diagram.
Figure 4. LSTM neural network model design diagram.
Electronics 12 02255 g004
Figure 5. Thermodynamic diagram of actual crowd flow.
Figure 5. Thermodynamic diagram of actual crowd flow.
Electronics 12 02255 g005
Figure 6. Thermodynamic diagram of predicted crowd flow.
Figure 6. Thermodynamic diagram of predicted crowd flow.
Electronics 12 02255 g006
Table 1. The main symbols and their meanings.
Table 1. The main symbols and their meanings.
SymbolsMeanings
x z d The crowd flow of area d in time period z
f 1 . . . T d The crowd flow sequence of a certain region d in T historical time periods
pThe spatial connection of the day
dDate of the day
kThe holiday type of the day
eThe weather type of the day
lThe lowest temperature of the day
tArea type
mArea of region
fCrowd flow
f b 1 , f b 2 Crowd flow of the previous two days
e b The weather type of the day before yesterday
l b The lowest temperature of the day before yesterday
k b The holiday type of the day before yesterday
Table 2. Dataset overview.
Table 2. Dataset overview.
Field NameExample
Region ID1
Data-hour2020-02-05-10
Crowd flow index1.8
Area nameBeiwu Park
Area typeTourist attractions: park
Longitude of regional center point116.256586
Latitude of regional center point39.986913
Grid longitude of regional center116.256713
Grid latitude of regional center39.987525
Area of region395,925.609375
Hour0
Longitude of departure grid center115.99432
Latitude of departure grid center39.698475
Longitude of destination grid center115.99432
Latitude of destination grid center39.698475
Table 3. Baseline experimental results.
Table 3. Baseline experimental results.
ModelMSE
HA4.4879
ARIMA13.4669
LSTM9.2632
NDV-LSTM-type3.1141
NDV-LSTM-day2.6062
NDV-LSTM-weather3.6113
NDV-LSTM1.5194
Table 4. Comparison of the results under different epochs.
Table 4. Comparison of the results under different epochs.
ModelEpochsMSE
NDV-LSTM10054.4532
50014.6607
8002.7467
10001.5677
Table 5. Comparison of the results under different batch-sizes.
Table 5. Comparison of the results under different batch-sizes.
ModelBatch-SizeMSE
NDV-LSTM322.6450
642.6433
1282.6433
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

He, D.; Jia, J.; Wang, Y.; You, L.; Chen, Z.; Li, J.; Wu, Q.; Wang, Y. A Spatio-Temporal Hybrid Neural Network for Crowd Flow Prediction in Key Urban Areas. Electronics 2023, 12, 2255. https://doi.org/10.3390/electronics12102255

AMA Style

He D, Jia J, Wang Y, You L, Chen Z, Li J, Wu Q, Wang Y. A Spatio-Temporal Hybrid Neural Network for Crowd Flow Prediction in Key Urban Areas. Electronics. 2023; 12(10):2255. https://doi.org/10.3390/electronics12102255

Chicago/Turabian Style

He, Du, Jing Jia, Yaoqing Wang, Lan You, Zhijun Chen, Jiawen Li, Qiyao Wu, and Yongsen Wang. 2023. "A Spatio-Temporal Hybrid Neural Network for Crowd Flow Prediction in Key Urban Areas" Electronics 12, no. 10: 2255. https://doi.org/10.3390/electronics12102255

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop