CN110956807B

CN110956807B - Highway flow prediction method based on combination of multi-source data and sliding window

Info

Publication number: CN110956807B
Application number: CN201911233275.9A
Authority: CN
Inventors: 顾晓丹; 邵程立; 杨明; 师晓敏; 汪立鹤; 李玉萍
Original assignee: Southeast University; China Information Consulting and Designing Institute Co Ltd
Current assignee: Southeast University; China Information Consulting and Designing Institute Co Ltd
Priority date: 2019-12-05
Filing date: 2019-12-05
Publication date: 2021-04-09
Anticipated expiration: 2039-12-05
Also published as: CN110956807A

Abstract

The invention discloses a highway flow prediction method based on combination of multi-source data and a sliding window, which comprises the following steps: step 1, constructing multi-source data, and comprehensively considering the correlation of multi-dimensional traffic flow influence factors on time and space; step 2, constructing a regression model on the multi-source data set by respectively adopting a support vector regression, a BP neural network optimized by a genetic algorithm and a long-short term memory network LSTM; step 3, constructing a mixed model by combining the three models for prediction, and optimizing the weight occupied by the three models in the mixed model in real time through a third-party library under a sliding window mechanism; and 4, training the model again on the basis of the original data by adopting an incremental training mode to achieve the effect of timely utilizing new data and updating the model on line.

Description

Highway flow prediction method based on combination of multi-source data and sliding window

Technical Field

The invention relates to a highway flow prediction method based on combination of multi-source data and a sliding window.

Background

The traffic flow prediction means predicting the future traffic flow of the point to be measured by collecting the historical traffic flow and relevant attributes of the traffic point to be measured. As an important link of intelligent traffic, the method has very important practical significance in accurately predicting the traffic flow. For example, the change time interval of the signal lamps at the current crossroads is generally preset and cannot be dynamically adjusted, so that the efficiency is not high; if the traffic flow can be accurately predicted, the signal lamp can be dynamically adjusted according to the real-time flow, and the passing efficiency of the crossroad is further improved. In the traffic flow prediction, there is a temporal and spatial correlation between the historical traffic flow, and the temporal correlation means that the data of the current point in the past time has an influence on the current flow, for example, the previous 30 minutes of the current time point, and the data of the current day and the previous 15 minutes (one data every 5 minutes). And spatial correlation refers to the effect of traffic flow data of the point measured before and after the highway on its existence.

The conventional traffic flow prediction method mainly adopts a single traffic data source, performs prediction according to historical data of a target road section, does not consider the influence of emergencies and the like on short-time traffic flow, and needs to improve the prediction precision. The prediction model is mainly divided into statistical analysis, artificial intelligence, nonlinearity, traffic simulation, combined prediction and the like. For statistical analysis and nonlinear methods, the main focus is on traffic flow data, but neglects other non-traffic flow data affecting the traffic flow, and the traffic simulation model needs to simulate a real environment, so that the cost and the difficulty are high.

In summary, the current sample features for traffic flow prediction are single, and there is no consideration for traffic flow influence factors such as emergencies. In terms of predictive models, single methods are mainly taken or each type of method is simply combined, the combination between different variants in the same model is not considered, and global optimization is lacking.

Disclosure of Invention

The invention aims to provide a highway flow prediction method based on combination of multi-source data and a sliding window, which aims at solving the problems in the prior art, extracts characteristics such as upstream and downstream traffic flow data, upstream and downstream toll station entrance and exit charging information data, vehicle type proportion of each vehicle type in a section before and after a current measuring point and a section before and after a highway, holiday time sections, urban hot spot events connected with the measuring point, target section congestion data counted by third-party services, weather in the section and the like in a Markos Papageorgiou dynamic model by carrying out cross correlation analysis on the multi-source data, and comprehensively considers multidimensional volume influence factors; in the model building part, a support vector regression model, a BP neural network model and a recurrent neural network LSTM model superior in time sequence are respectively selected; the advantages of each model are exerted by combining the three models, and the weights of the three models are optimized on a sliding window; and finally, performing incremental training, performing model training according to the obtained new data, and dynamically enhancing the adaptability to the traffic flow of the expressway.

The above purpose is realized by the following technical scheme:

the expressway traffic flow prediction method based on the combination of multi-source data and a sliding window comprises the following steps:

step 1, comprehensively considering the correlation of multidimensional traffic flow influence factors on time and space, collecting various data to construct a multi-source data set;

step 2, extracting characteristics such as upstream and downstream traffic flow data, upstream and downstream toll station entrance and exit charging information data, vehicle type occupation ratios of sections before and after the current measuring point and the highway, holiday time sections, urban hot spot events connected with the measuring point, target section congestion data counted by a third party service, weather in the section and the like on a multi-source data set, and constructing a support vector regression model, a BP neural network model based on a genetic algorithm and a long-short term memory network model;

step 3, forming the three models constructed in the step 2 into a mixed model, setting weights of the three models in the mixed model, optimizing the weights of the three models in the mixed model, and predicting future traffic flow by using the optimized mixed model;

and 4, optimizing the parameters of the three models constructed in the step 2 by adopting an incremental training mode every time the newly acquired data reaches one week.

The step 1 comprises the following steps: collecting multi-source data including traffic flow of upstream and downstream measuring points in a macroscopic dynamic model based on Markos Papageorgiou (reference: MARKOS PAPAPAGERGOU; JEANMARC BLOSSSEVILLE; HABIB HAJSALEM modeling and temporal control of traffic flow on the southern part of boulevard peripherique in Paris: part I: modeling 1990(05)), and charging information of upstream and downstream toll stations, weather conditions (rainfall, visibility, wind direction, wind level) and time of day in the high-speed area; measuring the traffic flow of a period of time before the point, and measuring the traffic flow of a period of time before the point; the occupation ratios of various vehicle types in the section road section at the current measuring point are measured; whether the measuring point is on holidays or not at the moment; road condition information of the current measuring point; measuring hot events of cities upstream and downstream of the point; and taking the information as the final multi-source data characteristic. The upstream and downstream traffic flow data and the upstream and downstream toll station entrance and exit toll information include the instantaneous speed of a single vehicle and information of the vehicle, such as the vehicle type, the vehicle capacity and the like. The size of the vehicle capacity directly affects the vehicle density, the inter-vehicle distance and the like of the road section and the traffic flow directly related factors. For example, the rollover of a large vehicle has a great influence on surrounding trolleys, so that a driver of a small vehicle can select to enlarge the distance or change lanes when encountering the large vehicle. Therefore, the composition proportion of the vehicle type has certain influence on the current traffic flow, and the statistics of the specific gravity of various vehicle types at the same time also has practical significance. The holiday factor means that the national legal holidays can cause additional population migration, such as home return, travel, etc. The hot events (which can be obtained by automatically capturing and analyzing the hot events in the social network) of the cities at the two ends of the target highway section attract a great amount of people, such as a concert, a sporting event, a large conference and the like, and have a great influence on the traffic flow in a short time. In addition, the statistical result of the congestion condition of the target road section by the third-party service, such as a high-grade map, a Baidu map and the like, can also be referred to. Besides obtaining real-time data from the traffic management system, the third-party service also analyzes the moving track of the user of the third-party service (namely, the GPS positioning information of the user using the Gade map is continuously fed back to the server of the Gade), so that the real-time statistics of the congestion degree of the road section is realized. And the congestion condition has direct influence on the traffic flow, so that an open interface of a third-party navigation service can be called to obtain real-time road condition information of a target road section to assist the prediction of the traffic flow. In addition to the above factors, weather factors also have a great influence on traffic flow. Natural phenomena such as rain, snow, fog, glare, etc., can cause drivers to subjectively change driving speeds and distances. Corresponding short-term weather data including visibility, road dryness and wetness, wind power and the like can be crawled from a meteorological website according to the target road section positioning information. After the data is acquired, the data is correlated according to the time information, and if the single-point data has defects and abnormalities (particularly high or low), historical smoothing can be adopted for supplementing and correcting.

In step 1, the geographical position of a point to be measured is determined, and according to an actual highway route, relevant data of an upstream measurement point, a downstream measurement point and an upstream toll station and a downstream toll station are collected by combining a Marko Papagageorgiou dynamic model, such as traffic flow data a minutes before the upstream measurement point and the downstream measurement point, traffic volume data b minutes before the toll station, climate (rainfall, wind direction, wind power and visibility) of a section of the measurement point, and data (6 data, measured once every 5 minutes) 30 minutes before the current measurement point and 15 minutes (3) before the previous day (values of a and b are according to the distance between the upstream toll station and the measurement point). In addition, a high-grade map API is called to obtain the congestion state of the real-time road condition, a calendar is checked to obtain the information of legal festivals and holidays, a toll station and a magnetic induction coil are collected to count the quantity of all vehicle types, and the vehicle type ratio is calculated. And (3) acquiring the sudden hot spot activities and specific time of a city near the target road section within one week by utilizing an event discovery processing program (realized by performing data crawling analysis on social networks such as microblogs and the like), and evaluating the popularity level according to the discussion quantity. After a conventional data preprocessing means, historical smoothing is adopted for supplementing or replacing missing data and abnormal data to form multi-source data required by the method.

In step 1, history smoothing is adopted to supplement and correct the conditions of deficiency and abnormality (the value is too large or too small relative to the data of the previous and subsequent moments) in the multi-source data:unlike conventional history smoothing, which takes into account periodicity factors, the present invention uses a weighted average of traffic flow at a time before and after the time of day and the time of day before the week, mainly taking into account that work may be different every day during the week. Traffic flow for holidays and bursty hot events may require a reduction in the weight of data a week ago and an increase by a factor. Calculating the current missing data X according to the following formula_t：

X_t＝a×X_t-1+b×X_t+1+c×X_t-288×7，

a+b+c＝1，

Wherein, X_t-1For the previous data, X_t+1For the latter data, t-288 × 7 is the data one week ago, and a, b, c are the weights of the respective data.

The step 2 comprises the following steps:

step 2-1, constructing a support vector regression model (reference document: Yan Yuan Chan, Wuqi Sheng, white phosphorus, Mat Wei. short-time traffic flow prediction method [ J/OL ] adopting MPSO to optimize SVR, computer technology and development, 2019 (04): 1-6[2019-04-12 ]), and predicting the traffic flow in the future for 5 minutes by taking multi-source data as sample characteristics;

step 2-2, constructing a BP neural network model based on a genetic algorithm (reference document: Lingzhi. expressway traffic flow prediction research based on BP neural network [ D)]Wuhan university of sciences 2014.), using a multi-source data sample as a sample characteristic, optimizing an initial weight of a neural network by adopting a genetic algorithm, predicting the traffic flow in 15 minutes in the future, adopting a 23-32-16-3 hierarchical structure in the aspect of model construction, wherein the learning rate is 0.1, and adopting a mean square error

As a cost function, where N is the total number of samples, y_iIs the true value of the ith sample,

for the measured value of the ith sample, a random gradient algorithm is adopted as an optimization method, the training times are 1000 times, the training stopping condition is set to be that the loss difference of two epochs is less than 0.01, and 1347 parameters are provided in total, so the individual size of the genetic algorithm is 1347, the population size is 30, the genetic algebra is 50, the cross probability is 0.75, the variation probability is 0.05, and the loss of a neural network is used as an index for measuring the individual fitness;

and 2-3, constructing a long-short term memory network model (reference document: http:// colah. githu. io/posts/2015-08-evacuation-LSTMs), predicting the traffic flow of 15 minutes in the future by using upstream and downstream measuring point traffic flow data, 30 minutes before the current day and 15 minutes before the current day as sample characteristics, wherein the time step length is 24, namely, 120 minutes are counted by one measuring point every five minutes, setting a middle neuron to be 32 by using a basic LSTM module in a tenserflow frame, and finally predicting the traffic flow of 15 minutes in the future by full connection.

In step 2-1, a kernel function of the support vector regression model selects a Radial Basis Function (RBF), maps the RBF to a high-dimensional space for processing, and sets a certain tolerance C to 1.0 and a relaxation factor to 0.5 in order to increase generalization capability and robustness of the RBF.

And 3, forming a mixed model by the three models constructed in the step 2, predicting the traffic flow, optimizing the weights of the three models in the mixed model by using a Google Ceres-Solver library (reference: http:// Ceres-solvent. org /) in a sliding window, and determining the weights of the three models in the mixed model.

In step 3, before traffic flow prediction is performed, a certain time length k is selected, that is, if the size of the sliding window is k, there are k samples (feature x and label y). To optimize the weights of each model in the combined model, therefore, substituting k samples into the mixture model has:

A*SVR(X¹)+B*GABP(X¹)+C*LSTM(X¹)＝Y¹，

A*SVR(X²)+B*GABP(X²)+C*LSTM(X²)＝Y²，

A*SVR(X^k)+B*GABP(X^k)+C*LSTM(X^k)＝Y^k，

wherein, SVR, GABP and LSTM respectively represent a support vector regression model, a BP neural network model optimized by genetic algorithm and a long-short term memory neural network model. XⁱCharacteristic data representing the i-th record entered, YⁱIndicating the traffic flow of the input ith record. Where a + B + C is 1 where a, B, and C are the weights of the models in the mixture model, and in order to achieve the best effect, it is necessary to optimize A, B, C so that the sum of the final errors of each expression is the smallest. The google optimization library Ceres-Solver is used for optimization to obtain the optimal A, B, C, in order to reduce the time delay brought by the optimization, the step length of the sliding window is the size of the sliding window, and the optimization is performed only under the condition of moving once for a new time.

In step 4, after prediction is completed, because the data set is supplemented, training can be performed in an incremental training manner to solve the problem that the training data of the neural network is insufficient in the initial situation. Meanwhile, the parameters of the model can be adjusted in real time according to the change condition of the expressway. In each online learning step, the original weight value is used as an initial parameter for training. After selecting a few sliding steps, for each model, loading the original weight, and initializing the weight of the neural network needing incremental training by using the original weight. And then training on the collected data set.

Has the advantages that:

the multi-source data is used as input characteristics, various characteristic factors influencing traffic flow are comprehensively considered, the prediction accuracy of the model is higher, and traffic flow fluctuation caused by an emergency can be captured. The model with different advantages is adopted, so that the model can be well adapted to the environment at different stages (the change of the data volume). And (3) updating the prediction model on line, and adaptively adjusting the model parameters to adapt the model to a new environment without large change of the data characteristics.

Drawings

The foregoing and/or other advantages of the invention will become further apparent from the following detailed description of the invention when taken in conjunction with the accompanying drawings.

FIG. 1 is a Markos Papageorgiou dynamic model for reference by the present invention.

Fig. 2 is an overall flow chart of the present invention.

FIG. 3 shows the topology of the GA-BP neural network in step II of the present invention.

FIG. 4 is the topology of the LSTM neural network in step II of the present invention.

Detailed Description

As shown in fig. 1, fig. 2, fig. 3, and fig. 4, the method for predicting highway traffic flow based on multi-source data and sliding window combination provided in this embodiment can be divided into the construction of data samples, SVR, the construction of BP neural network and LSTM neural network models optimized by genetic algorithm, and the construction of combination and incremental training of hybrid models.

The highway flow prediction method based on the combination of the multi-source data and the sliding window comprises the following steps:

the method comprises the following steps: and finding out the vehicle access data of the upstream and downstream measuring points, the toll station and the surrounding climate according to the measuring points, the Markos Papageorgiou dynamic model and the actual road conditions of the expressway. For the former two data, the cooperation of related departments is needed, and for the surrounding climate, the example is directly crawled to a related climate website. 3 upstream and downstream measuring points are selected, data within 30 minutes of the vehicle amount of a toll station are counted, rainfall and wind speed are digitalized, and the data of the first 6 measuring points and the data of the 3 measuring points at the moment in the previous day are selected to be 15 data; real-time road condition information, namely inquiring real-time road conditions of a target road section through an application Baidu map and a Gaode map developer API, and discretizing the road conditions according to the information of the road conditions; the vehicle proportion is counted by collecting magnetic coils of traffic flow and the like; the holidays are directly consulted according to the current date; and measuring hot events of points, namely extracting corresponding events by using event extraction, filtering irrelevant events, and finally carrying out level evaluation by using events and discretizing the intensity of the events. And (3) selecting and abandoning data which is overlong in missing (more than one day), and processing the data in short time by adopting a history sliding method.

Step two: the SVR uses historical data of 9 measuring points and data of 3 upstream and downstream measuring points, as well as a time, a rainfall, wind intensity, wind direction, visibility, large vehicle proportion, medium vehicle proportion, small vehicle proportion, holiday signs, the level of hot events in nearby cities and the level of road condition congestion as characteristics, and data of the measuring points in the next five minutes are used as true values. The BP neural network, LSTM neural network, and SVR use the 23 features as inputs, the first two predict traffic flow 15 minutes into the future, and the SVR predicts traffic flow 5 minutes into the future.

Step three: in this example, the sliding window size is selected for one week. And combining the trained models together every time, and optimizing the weight of each model on a sliding window by adopting an optimization library Ceres-Solver of Google. And A, B, C, obtaining an optimal solution, and substituting the optimal solution into the real-time data of the measuring point to predict the data at the next moment. Meanwhile, the data is stored locally, when the data volume reaches the size of 4 windows, online learning is carried out, original model parameters are loaded to serve as initial values of the model to be trained, and then training is carried out on the data with the size of 4 windows.

The present invention provides a method for predicting highway traffic based on multi-source data and a sliding window combination, and a plurality of methods and ways for implementing the technical scheme, and the above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, a plurality of improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be regarded as the protection scope of the present invention. All the components not specified in the present embodiment can be realized by the prior art.

Claims

1. The highway flow prediction method based on the combination of multi-source data and a sliding window is characterized by comprising the following steps of:

step 2, constructing a support vector regression model, a BP neural network model based on a genetic algorithm and a long-term and short-term memory network model on a multi-source data set;

step 4, optimizing the parameters of the three models constructed in the step 2 by adopting an incremental training mode every time the newly acquired data reaches one week;

the step 1 comprises the following steps: collecting multi-source data, including traffic flow of upstream and downstream measuring points based on a Markos Papageorgiou macro dynamic model, charging information of the upstream and downstream toll stations, weather conditions of a high-speed area between the upstream and downstream measuring points and the current time; measuring the traffic flow of a period of time before the point, and measuring the traffic flow of a period of time before the point; the occupation ratios of various vehicle types in the section road between the upstream and downstream measuring points at that time; whether the measuring point is on holidays or not at the moment; road condition information of the current measuring point; measuring hot events of cities upstream and downstream of the point; taking the information as final multi-source data characteristics;

in step 1, history smoothing is adopted to supplement and correct the conditions of deficiency and abnormality in multi-source data: calculating the current missing data X according to the following formula_t：

X_t＝a×X_t-1+b×X_t+1+c×X_t-288×7，

a+b+c＝1，

Wherein, X_t-1For the previous data, X_t+1T-288 × 7 is the data before one week, and a, b, c are the weight of each data;

the step 2 comprises the following steps:

step 2-1, constructing a support vector regression model, using multi-source data as sample characteristics, and predicting the traffic flow in the future of 5 minutes;

step 2-2, constructing a BP neural network model based on a genetic algorithm, taking a multi-source data sample as a sample characteristic, optimizing an initial weight of the neural network by adopting the genetic algorithm, predicting the traffic flow in the future 15 minutes, adopting a 23-32-16-3 hierarchical structure in the aspect of model construction, setting the learning rate to be 0.1, and adopting the mean square error

step 2-3, constructing a long-term and short-term memory network model, predicting the traffic flow of 15 minutes in the future by using upstream and downstream measuring point traffic flow data, 30 minutes before the current day and 15 minutes before the current day as sample characteristics, wherein the time step is 24, namely, 120 minutes are spent on one measuring point every five minutes, setting a middle neuron to be 32 by using a basic LSTM module in a tensoflow frame, and finally predicting the traffic flow of 15 minutes in the future by full connection;

step 3, forming the three models constructed in the step 2 into a mixed model, carrying out traffic flow prediction, optimizing the weights of the three models in the mixed model by using Google's Ceres-Solver library in a sliding window, and determining the weights of the three models in the mixed model; before traffic flow prediction is carried out, a certain time length k needs to be selected, namely the size of a sliding window is k, k samples exist, and the k samples are substituted into a mixed model:

wherein, SVR, GABP and LSTM respectively represent a support vector regression model, a BP neural network model optimized by genetic algorithm and a long-short term memory neural network model; xⁱCharacteristic data representing the i-th record entered, YⁱIndicating the input traffic flow of the ith record; A. b, C is the weight of each model in the mixed model; optimizing by using an optimization library Ceres-Solver of Google to obtain the optimal A, B, C, wherein the step length of the sliding window is the size of the sliding window, and the optimization is carried out only under the condition of once new movement;

in step 4, after a certain amount of data is collected for three models in the mixed model, an incremental training method is adopted, firstly, the parameters of the trained models are loaded as initial values of the models, on the basis, the data collected in the near period of time is used for training each model, model parameters are optimized, and incremental updating of the mixed model is achieved.