CN113139495A - Tunnel side-mounted video traffic flow detection method and system based on deep learning - Google Patents

Tunnel side-mounted video traffic flow detection method and system based on deep learning Download PDF

Info

Publication number
CN113139495A
CN113139495A CN202110499376.1A CN202110499376A CN113139495A CN 113139495 A CN113139495 A CN 113139495A CN 202110499376 A CN202110499376 A CN 202110499376A CN 113139495 A CN113139495 A CN 113139495A
Authority
CN
China
Prior art keywords
deep learning
tunnel
training
detection model
vehicle detection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110499376.1A
Other languages
Chinese (zh)
Inventor
姜冬阳
张建阳
杨瑞建
张震
王先勇
袁彦各
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN202110499376.1A priority Critical patent/CN113139495A/en
Publication of CN113139495A publication Critical patent/CN113139495A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G06V20/54Surveillance or monitoring of activities, e.g. for recognising suspicious objects of traffic, e.g. cars on the road, trains or boats
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/017Detecting movement of traffic to be counted or controlled identifying vehicles

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Mathematical Physics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention discloses a tunnel side-mounted video traffic flow detection method and system based on deep learning, and relates to the field of road traffic. Acquiring tunnel side-mounted video data; detecting the tunnel traffic parameters of the video data in real time through a trained deep learning vehicle detection model; and obtaining the vehicle information passing through the camera and the tunnel traffic parameters. The deep learning vehicle detection model of the scheme is used for detecting traffic flow parameters of the tunnel side-mounted video in real time, can extract the tunnel traffic parameters including flow, vehicle speed and vehicle distance in real time, and has practical values for tunnel traffic operation monitoring, prediction, early warning, management and control and the like. Meanwhile, the vehicle type can be identified and a traffic monitoring image can be provided, and the composite performance of the method exceeds that of the traditional detection methods such as a loop coil and an ultrasonic detector.

Description

Tunnel side-mounted video traffic flow detection method and system based on deep learning
Technical Field
The invention relates to the field of road traffic, in particular to a method and a system for detecting tunnel side-mounted video traffic flow based on deep learning.
Background
The current road traffic parameter detection means mainly comprise radar, annular coils, ultrasonic waves, microwave detection, video bayonets and the like. At present, most of traffic parameter detection cameras are hung right above a road by using a portal frame, an F rod or an L rod, main parameters such as traffic flow, speed and the like are extracted by snapping a license plate or matching with an induction coil, and for a side-mounted camera in a tunnel, a technical method for acquiring traffic flow parameters by a better detection means is not provided.
Disclosure of Invention
The invention aims to solve the technical problem of the prior art and provides a method and a system for detecting the traffic flow of a tunnel side-mounted video based on deep learning.
The technical scheme for solving the technical problems is as follows:
a tunnel side-mounted video traffic flow detection method based on deep learning comprises the following steps:
acquiring tunnel side-mounted video data;
detecting the tunnel traffic parameters of the video data in real time through a trained deep learning vehicle detection model;
and obtaining the vehicle information passing through the camera and the tunnel traffic parameters.
The invention has the beneficial effects that: the deep learning vehicle detection model of the scheme is used for detecting traffic flow parameters of the tunnel side-mounted video in real time, can extract the tunnel traffic parameters including flow, vehicle speed and vehicle distance in real time, and has practical values for tunnel traffic operation monitoring, prediction, early warning, management and control and the like. Meanwhile, the vehicle type can be identified and a traffic monitoring image can be provided, and the composite performance of the method exceeds that of the traditional detection methods such as a loop coil and an ultrasonic detector. The method has the advantages that various traffic flow parameters are detected by combining high-definition cameras and standard-definition cameras in the tunnel with a deep learning vehicle detection model, the cost is low, the coverage is wide, and the safety is high.
Further, still include:
constructing a deep learning vehicle detection model based on YOLOv 4;
setting preset model parameters of the deep learning vehicle detection model, training the deep learning vehicle detection model by taking image data in a training library as input, testing the image data input into a testing library by the trained deep learning vehicle detection model, adjusting the preset model parameters if a test result does not meet a preset threshold condition, and continuing to train the deep learning vehicle detection model;
and if the test result meets the preset threshold condition, finishing training and obtaining a trained deep learning vehicle detection model.
The beneficial effect of adopting the further scheme is that: the deep learning vehicle detection model obtained by the scheme can keep accuracy, reduce calculation bottleneck and reduce memory cost while achieving light weight. The feature extraction capability can be improved, and the regression speed and the regression precision of the prediction frame can be improved.
Further, still include:
constructing a training library of the vehicle according to the image data of the vehicle running in the tunnel;
and selecting partial image data from the training library according to a preset proportion to serve as a test library.
The beneficial effect of adopting the further scheme is that: the scheme provides a data basis for training and testing the deep learning vehicle detection model.
Further, still include: and when the number of the images in the training library is not enough, performing data sample expansion on the training library by adopting a preset data sample expansion mode.
The beneficial effect of adopting the further scheme is that: according to the scheme, the number of the images in the training library is not enough, and the expansion of data volume is realized.
Further, the preset data sample expansion method includes: color dithering or rotation transformation.
Another technical solution of the present invention for solving the above technical problems is as follows:
a tunnel side-mounted video traffic flow detection system based on deep learning comprises: the system comprises a data acquisition module, a real-time detection module and a traffic information acquisition module;
the data acquisition module is used for acquiring tunnel side-mounted video data;
the real-time detection module is used for detecting the tunnel traffic parameters of the video data in real time through a trained deep learning vehicle detection model;
the traffic information acquisition module is used for acquiring vehicle information passing through the camera and tunnel traffic parameters.
The invention has the beneficial effects that: the deep learning vehicle detection model of the scheme is used for detecting traffic flow parameters of the tunnel side-mounted video in real time, can extract the tunnel traffic parameters including flow, vehicle speed and vehicle distance in real time, and has practical values for tunnel traffic operation monitoring, prediction, early warning, management and control and the like. Meanwhile, the vehicle type can be identified and a traffic monitoring image can be provided, and the composite performance of the method exceeds that of the traditional detection methods such as a loop coil and an ultrasonic detector. The method has the advantages that various traffic flow parameters are detected by combining high-definition cameras and standard-definition cameras in the tunnel with a deep learning vehicle detection model, the cost is low, the coverage is wide, and the safety is high.
Further, still include: the vehicle detection model acquisition module is used for constructing a deep learning vehicle detection model based on YOLOv 4;
setting preset model parameters of the deep learning vehicle detection model, training the deep learning vehicle detection model by taking image data in a training library as input, testing the image data input into a testing library by the trained deep learning vehicle detection model, adjusting the preset model parameters if a test result does not meet a preset threshold condition, and continuing to train the deep learning vehicle detection model;
and if the test result meets the preset threshold condition, finishing training and obtaining a trained deep learning vehicle detection model.
The beneficial effect of adopting the further scheme is that: the deep learning vehicle detection model obtained by the scheme can keep accuracy, reduce calculation bottleneck and reduce memory cost while achieving light weight. The feature extraction capability can be improved, and the regression speed and the regression precision of the prediction frame can be improved.
Further, still include: the training test library establishing module is used for establishing a training library of the vehicle according to the image data of the vehicle running in the tunnel; and selecting partial image data from the training library according to a preset proportion to serve as a test library.
The beneficial effect of adopting the further scheme is that: the scheme provides a data basis for training and testing the deep learning vehicle detection model.
Further, the training test library establishing module is specifically configured to, when the number of images in the training library is not enough, perform data sample expansion on the training library by using a preset data sample expansion manner.
The beneficial effect of adopting the further scheme is that: according to the scheme, the number of the images in the training library is not enough, and the expansion of data volume is realized.
Further, the preset data sample expansion method includes: color dithering or rotation transformation.
Advantages of additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
Fig. 1 is a schematic flowchart of a deep learning-based tunnel side-mounted video traffic flow detection method according to an embodiment of the present invention;
fig. 2 is a block diagram of a tunnel side-mounted video traffic flow detection system based on deep learning according to an embodiment of the present invention;
fig. 3 is a schematic flow chart of tunnel traffic flow parameter detection according to another embodiment of the present invention;
FIG. 4 is a sample "car" view provided by other embodiments of the present invention;
FIG. 5 is a "bus" like diagram provided by other embodiments of the present invention;
FIG. 6 is a diagram illustrating the results of the Yolov4 model training test provided by another embodiment of the present invention;
FIG. 7 is a schematic view of vehicle detection provided by other embodiments of the present invention;
fig. 8 is a schematic diagram of lane double virtual lines according to another embodiment of the present invention.
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth to illustrate, but are not to be construed to limit the scope of the invention.
As shown in fig. 1, a method for detecting a tunnel side-mounted video traffic flow based on deep learning according to an embodiment of the present invention includes:
acquiring tunnel side-mounted video data;
detecting the tunnel traffic parameters of the video data in real time through a trained deep learning vehicle detection model; the deep learning vehicle detection model can be constructed based on YOLOv4, and the YOLOv4 model is combined with tunnel side-mounted video data to be used for real-time detection of traffic parameters.
In one embodiment, constructing the data set may specifically include: the image reference library is divided into a "car" training library and a "bus" training library according to the state of the vehicle traveling in the tunnel, and the sample diagrams are a "car" sample diagram as shown in fig. 4 and a "bus" sample diagram as shown in fig. 5. If the number of images in the training library is not enough, the three training libraries can be subjected to data sample expansion respectively by self-developed programming, and the data sample expansion usually adopts modes of color dithering, Rotation transformation, Rotation and the like to achieve the number of images required by a training model; if the number reaches the training requirement, the data sample expanding step can be omitted. Partial images, such as 100%, 50%, 30% of the number of images in the training library, are selected from the two training libraries, and the percentage of partial images can be determined to form two test libraries, namely a "car" test library and a "bus" test library according to the proportion of the types of traffic flow vehicles. Wherein, various types of sample graph data are shown in table 1:
Figure BDA0003047285240000051
TABLE 1
In a certain embodiment, deep neural network model training and testing may include: the input picture size may be set to 640 × 480, which is the input size of a standard VGA image, using CIoU as a loss function, Batch may be set to 16, the maximum number of iterations may be set to 40000, the learning rate may be set to 0.001, and it is reduced to one tenth of the original at iterations 32000 and 36000, thereby completing the network training of YOLOv 4. The YOLOv4 model training test results are shown in figure 6,
in one embodiment, vehicle detection may include: in a deep learning vehicle detection model, a YOLO algorithm adopts a single CNN model to realize end-to-end target detection, firstly, images resize are input to 448x 448 and then sent into a CNN network, finally, a network prediction result is processed to obtain a detected target, and then the detected target is sent out after being selected through a boundary frame, so that a running vehicle is detected, wherein the deep neural network model and the CNN model are general convolutional neural network models and are both components used by the YOLOv4 model. In which the vehicle is detected as shown in figure 7.
And obtaining the vehicle information passing through the camera and the tunnel traffic parameters.
It should be noted that, in a certain embodiment, the traffic parameter detection may include: and setting double virtual lines on the lane, and extracting required information when detecting that the vehicle passes through the virtual lines. The double virtual line distribution is shown in fig. 8; wherein the content of the first and second substances,
the vehicle flow detection may be performed by detecting that the double virtual lines count when the vehicle center point passes through the main virtual line and the sub virtual line, and performing mutual correction using the double coils. The formula is as follows:
Figure BDA0003047285240000061
wherein: q is a detection flow rate, q1 is a main virtual line detection flow rate, and q2 is a sub virtual line detection flow rate.
The vehicle speed measuring method may include: the working process of the main virtual line is that when the vehicle enters the main virtual line, namely at the rising edge of the vehicle detection signal, a notification signal is sent to the corresponding auxiliary virtual line.
The secondary virtual line has two working states, namely an idle state and a timing state. When the secondary virtual line receives the notification sent by the primary virtual line, the secondary virtual line enters a timing state no matter which state the secondary virtual line is in, and the starting point t of the timer is set as the current time. When the auxiliary virtual line detects that the vehicle enters, if the auxiliary virtual line is in an idle state at present, no operation is performed; and if the secondary virtual line is originally in a timing state, the secondary virtual line is converted into an idle state, and the speed of the vehicle at the position is estimated as follows:
Figure BDA0003047285240000071
wherein: t1 is the current time; t2 is the vehicle passing through the main virtual line time.
The measuring method of the inter-vehicle distance is obtained by calculating the time difference of front and rear adjacent vehicles through a secondary virtual line, and the formula is as follows:
h=(tB-tA)*vA
wherein: h is the distance between the car heads; tA is the passing time of the front vehicle; tB is the passing time of the rear vehicle; vA is the forward vehicle speed.
It should be noted that, in an embodiment, as shown in fig. 3, the detecting of the tunnel-side mounted video traffic flow may include: and constructing a data set and a deep learning vehicle detection model, setting parameters of the deep network model, and training and testing the deep network model according to a training library and a testing library constructed by the data set. The method can also comprise detecting the traffic parameters on the basis of vehicle detection. Wherein the tunnel traffic parameters may include flow, vehicle speed, and inter-vehicle distance. The vehicle detection information, i.e., the vehicle information, may include: time of passing, speed, inter-vehicle distance.
The deep learning vehicle detection model of the scheme is used for detecting traffic flow parameters of the tunnel side-mounted video in real time, can extract the tunnel traffic parameters including flow, vehicle speed and vehicle distance in real time, and has practical values for tunnel traffic operation monitoring, prediction, early warning, management and control and the like. Meanwhile, the vehicle type can be identified and a traffic monitoring image can be provided, and the composite performance of the method exceeds that of the traditional detection methods such as a loop coil and an ultrasonic detector. The method has the advantages that various traffic flow parameters are detected by combining high-definition cameras and standard-definition cameras in the tunnel with a deep learning vehicle detection model, the cost is low, the coverage is wide, and the safety is high.
Preferably, in any of the above embodiments, further comprising:
constructing a deep learning vehicle detection model based on YOLOv 4;
setting preset model parameters of the deep learning vehicle detection model, training the deep learning vehicle detection model by taking image data in a training library as input, testing the image data input into a testing library by the trained deep learning vehicle detection model, adjusting the preset model parameters if a test result does not meet a preset threshold condition, and continuing to train the deep learning vehicle detection model; wherein the presetting of the model parameters may include: the number of images, the width of the images, the height of the images, a weight attenuation regular coefficient, the maximum iteration number, the learning rate variation step length, the learning rate variation factor and the like. And if the test result meets the preset threshold condition, finishing training and obtaining a trained deep learning vehicle detection model. The preset threshold condition can be the accuracy of the set traffic flow parameter detection, and the training is finished when the set accuracy standard is met.
The deep learning vehicle detection model obtained by the scheme can keep accuracy, reduce calculation bottleneck and reduce memory cost while achieving light weight. The feature extraction capability can be improved, and the regression speed and the regression precision of the prediction frame can be improved.
Preferably, in any of the above embodiments, further comprising:
constructing a training library of the vehicle according to the image data of the vehicle running in the tunnel;
and selecting partial image data from the training library according to a preset proportion to serve as a test library. Wherein, the preset proportion can include: 100%, 50% or 30%, can be selected according to the application requirements.
The scheme provides a data basis for training and testing the deep learning vehicle detection model.
Preferably, in any of the above embodiments, further comprising: and when the number of the images in the training library is not enough, performing data sample expansion on the training library by adopting a preset data sample expansion mode.
According to the scheme, the number of the images in the training library is not enough, and the expansion of data volume is realized.
Preferably, in any of the above embodiments, the preset data expansion method includes: color dithering or rotation transformation.
In one embodiment, as shown in fig. 2, a deep learning-based tunnel side-mounted video traffic flow detection system includes: the system comprises a data acquisition module 11, a real-time detection module 12 and a traffic information acquisition module 13;
the data acquisition module 11 is used for acquiring tunnel side-mounted video data;
the real-time detection module 12 is used for detecting the tunnel traffic parameters of the video data in real time through a trained deep learning vehicle detection model;
the traffic information obtaining module 13 is configured to obtain vehicle information passing through the camera and tunnel traffic parameters.
The deep learning vehicle detection model of the scheme is used for detecting traffic flow parameters of the tunnel side-mounted video in real time, can extract the tunnel traffic parameters including flow, vehicle speed and vehicle distance in real time, and has practical values for tunnel traffic operation monitoring, prediction, early warning, management and control and the like. Meanwhile, the vehicle type can be identified and a traffic monitoring image can be provided, and the composite performance of the method exceeds that of the traditional detection methods such as a loop coil and an ultrasonic detector. The method has the advantages that various traffic flow parameters are detected by combining high-definition cameras and standard-definition cameras in the tunnel with a deep learning vehicle detection model, the cost is low, the coverage is wide, and the safety is high.
Preferably, in any of the above embodiments, further comprising: the vehicle detection model acquisition module is used for constructing a deep learning vehicle detection model based on YOLOv 4;
setting preset model parameters of the deep learning vehicle detection model, training the deep learning vehicle detection model by taking image data in a training library as input, testing the image data input into a testing library by the trained deep learning vehicle detection model, adjusting the preset model parameters if a test result does not meet a preset threshold condition, and continuing to train the deep learning vehicle detection model;
and if the test result meets the preset threshold condition, finishing training and obtaining a trained deep learning vehicle detection model.
The deep learning vehicle detection model obtained by the scheme can keep accuracy, reduce calculation bottleneck and reduce memory cost while achieving light weight. The feature extraction capability can be improved, and the regression speed and the regression precision of the prediction frame can be improved.
Preferably, in any of the above embodiments, further comprising: the training test library establishing module is used for establishing a training library of the vehicle according to the image data of the vehicle running in the tunnel; and selecting partial image data from the training library according to a preset proportion to serve as a test library.
The scheme provides a data basis for training and testing the deep learning vehicle detection model.
Preferably, in any embodiment above, the training test library establishing module is specifically configured to, when the number of images in the training library is not enough, perform data sample expansion on the training library by using a preset data sample expansion method.
According to the scheme, the number of the images in the training library is not enough, and the expansion of data volume is realized.
Preferably, in any of the above embodiments, the preset data expansion method includes: color dithering or rotation transformation.
It is understood that some or all of the alternative embodiments described above may be included in some embodiments.
It should be noted that the above embodiments are product embodiments corresponding to the previous method embodiments, and for the description of each optional implementation in the product embodiments, reference may be made to corresponding descriptions in the above method embodiments, and details are not described here again.
The reader should understand that in the description of this specification, reference to the description of the terms "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a unit is merely a logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed.
Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention essentially or partially contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
While the invention has been described with reference to specific embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (10)

1. A tunnel side-mounted video traffic flow detection method based on deep learning is characterized by comprising the following steps:
acquiring tunnel side-mounted video data;
detecting the tunnel traffic parameters of the video data in real time through a trained deep learning vehicle detection model;
and obtaining the vehicle information passing through the camera and the tunnel traffic parameters.
2. The method for detecting the traffic flow of the tunnel side-mounted video based on the deep learning according to the claim 1, characterized by further comprising the following steps:
constructing a deep learning vehicle detection model based on YOLOv 4;
setting preset model parameters of the deep learning vehicle detection model, training the deep learning vehicle detection model by taking image data in a training library as input, testing the image data input into a testing library by the trained deep learning vehicle detection model, adjusting the preset model parameters if a test result does not meet a preset threshold condition, and continuing to train the deep learning vehicle detection model;
and if the test result meets the preset threshold condition, finishing training and obtaining a trained deep learning vehicle detection model.
3. The method for detecting the traffic flow of the tunnel side-mounted video based on the deep learning according to the claim 1 or 2, characterized by further comprising the following steps:
constructing a training library of the vehicle according to the image data of the vehicle running in the tunnel;
and selecting partial image data from the training library according to a preset proportion to serve as a test library.
4. The method for detecting the traffic flow of the tunnel side-mounted video based on the deep learning according to the claim 3, characterized by further comprising the following steps: and when the number of the images in the training library is not enough, performing data sample expansion on the training library by adopting a preset data sample expansion mode.
5. The method for detecting the traffic flow of the tunnel side-mounted video based on the deep learning according to claim 4, wherein the preset data sample expansion mode comprises: color dithering or rotation transformation.
6. The utility model provides a tunnel side dress video traffic flow detecting system based on deep learning which characterized in that includes: the system comprises a data acquisition module, a real-time detection module and a traffic information acquisition module;
the data acquisition module is used for acquiring tunnel side-mounted video data;
the real-time detection module is used for detecting the tunnel traffic parameters of the video data in real time through a trained deep learning vehicle detection model;
the traffic information acquisition module is used for acquiring vehicle information passing through the camera and tunnel traffic parameters.
7. The deep learning-based tunnel side-mounted video traffic flow detection system according to claim 6, further comprising: the vehicle detection model acquisition module is used for constructing a deep learning vehicle detection model based on YOLOv 4;
setting preset model parameters of the deep learning vehicle detection model, training the deep learning vehicle detection model by taking image data in a training library as input, testing the image data input into a testing library by the trained deep learning vehicle detection model, adjusting the preset model parameters if a test result does not meet a preset threshold condition, and continuing to train the deep learning vehicle detection model;
and if the test result meets the preset threshold condition, finishing training and obtaining a trained deep learning vehicle detection model.
8. The deep learning-based tunnel side-mounted video traffic flow detection system according to claim 6 or 7, characterized by further comprising: the training test library establishing module is used for establishing a training library of the vehicle according to the image data of the vehicle running in the tunnel; and selecting partial image data from the training library according to a preset proportion to serve as a test library.
9. The deep learning-based tunnel side-mounted video traffic flow detection system according to claim 8, wherein the training test library establishing module is specifically configured to perform data sample expansion on the training library by using a preset data sample expansion manner when the number of images in the training library is not enough.
10. The deep learning-based tunnel side-mounted video traffic flow detection system according to claim 9, wherein the preset data sample expansion manner comprises: color dithering or rotation transformation.
CN202110499376.1A 2021-04-29 2021-04-29 Tunnel side-mounted video traffic flow detection method and system based on deep learning Pending CN113139495A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110499376.1A CN113139495A (en) 2021-04-29 2021-04-29 Tunnel side-mounted video traffic flow detection method and system based on deep learning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110499376.1A CN113139495A (en) 2021-04-29 2021-04-29 Tunnel side-mounted video traffic flow detection method and system based on deep learning

Publications (1)

Publication Number Publication Date
CN113139495A true CN113139495A (en) 2021-07-20

Family

ID=76816618

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110499376.1A Pending CN113139495A (en) 2021-04-29 2021-04-29 Tunnel side-mounted video traffic flow detection method and system based on deep learning

Country Status (1)

Country Link
CN (1) CN113139495A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114973694A (en) * 2022-05-19 2022-08-30 杭州中威电子股份有限公司 Tunnel traffic flow monitoring system and method based on inspection robot
CN117077030A (en) * 2023-10-16 2023-11-17 易停车物联网科技(成都)有限公司 Few-sample video stream classification method and system for generating model
CN117690303A (en) * 2024-02-04 2024-03-12 四川三元环境治理股份有限公司 Noise early warning system, device and early warning method based on traffic data acquisition
CN114973694B (en) * 2022-05-19 2024-05-24 杭州中威电子股份有限公司 Tunnel traffic flow monitoring system and method based on inspection robot

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104200657A (en) * 2014-07-22 2014-12-10 杭州智诚惠通科技有限公司 Traffic flow parameter acquisition method based on video and sensor
CN106448180A (en) * 2016-10-24 2017-02-22 东南大学 Long-and-large-tunnel traffic-event real-time detection system and method thereof
CN107341957A (en) * 2017-08-17 2017-11-10 中山大学 A kind of comprehensive acquisition of road traffic information system
CN208985374U (en) * 2017-12-22 2019-06-14 武汉万集信息技术有限公司 Vehicle detecting system in a kind of tunnel
CN110033479A (en) * 2019-04-15 2019-07-19 四川九洲视讯科技有限责任公司 Traffic flow parameter real-time detection method based on Traffic Surveillance Video
CN111179601A (en) * 2020-02-25 2020-05-19 青岛国信城市信息科技有限公司 Tunnel traffic operation control method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104200657A (en) * 2014-07-22 2014-12-10 杭州智诚惠通科技有限公司 Traffic flow parameter acquisition method based on video and sensor
CN106448180A (en) * 2016-10-24 2017-02-22 东南大学 Long-and-large-tunnel traffic-event real-time detection system and method thereof
CN107341957A (en) * 2017-08-17 2017-11-10 中山大学 A kind of comprehensive acquisition of road traffic information system
CN208985374U (en) * 2017-12-22 2019-06-14 武汉万集信息技术有限公司 Vehicle detecting system in a kind of tunnel
CN110033479A (en) * 2019-04-15 2019-07-19 四川九洲视讯科技有限责任公司 Traffic flow parameter real-time detection method based on Traffic Surveillance Video
CN111179601A (en) * 2020-02-25 2020-05-19 青岛国信城市信息科技有限公司 Tunnel traffic operation control method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
徐子睿等: "基于YOLOv4的车辆检测与流量统计研究", 《现代信息科技》 *
王建强等: "基于机器视觉的隧道车辆检测系统设计与实现", 《自动化与仪器仪表》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114973694A (en) * 2022-05-19 2022-08-30 杭州中威电子股份有限公司 Tunnel traffic flow monitoring system and method based on inspection robot
CN114973694B (en) * 2022-05-19 2024-05-24 杭州中威电子股份有限公司 Tunnel traffic flow monitoring system and method based on inspection robot
CN117077030A (en) * 2023-10-16 2023-11-17 易停车物联网科技(成都)有限公司 Few-sample video stream classification method and system for generating model
CN117077030B (en) * 2023-10-16 2024-01-26 易停车物联网科技(成都)有限公司 Few-sample video stream classification method and system for generating model
CN117690303A (en) * 2024-02-04 2024-03-12 四川三元环境治理股份有限公司 Noise early warning system, device and early warning method based on traffic data acquisition
CN117690303B (en) * 2024-02-04 2024-04-26 四川三元环境治理股份有限公司 Noise early warning system, device and early warning method based on traffic data acquisition

Similar Documents

Publication Publication Date Title
CN109087510B (en) Traffic monitoring method and device
US11380104B2 (en) Method and device for detecting illegal parking, and electronic device
CN111368687A (en) Sidewalk vehicle illegal parking detection method based on target detection and semantic segmentation
CN109919008A (en) Moving target detecting method, device, computer equipment and storage medium
US20170032514A1 (en) Abandoned object detection apparatus and method and system
CN110298300B (en) Method for detecting vehicle illegal line pressing
CN113139495A (en) Tunnel side-mounted video traffic flow detection method and system based on deep learning
CN108399403B (en) Vehicle distance detection method based on license plate size calculation
CN111508269B (en) Open type parking space vehicle distinguishing method and device based on image recognition
CN100454355C (en) Video method for collecting information of vehicle flowrate on road in real time
CN105631418A (en) People counting method and device
CN110992693A (en) Deep learning-based traffic congestion degree multi-dimensional analysis method
CN111047874B (en) Intelligent traffic violation management method and related product
CN105336169A (en) Method and system for judging traffic jams based on videos
CN110309765B (en) High-efficiency detection method for video moving target
CN112766069A (en) Vehicle illegal parking detection method and device based on deep learning and electronic equipment
CN112733703A (en) Vehicle parking state detection method and system
CN110599453A (en) Panel defect detection method and device based on image fusion and equipment terminal
CN112861773A (en) Multi-level-based berthing state detection method and system
CN103337175A (en) Vehicle type recognition system based on real-time video steam
CN113378690A (en) In-road irregular parking identification method based on video data
CN108765463B (en) Moving target detection method combining region extraction and improved textural features
CN111105619A (en) Method and device for judging road side reverse parking
CN109063544A (en) A kind of method, system, computer equipment and the storage medium of dump truck detection
CN113076851A (en) Method and device for acquiring vehicle violation data and computer equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Jiang Dongyang

Inventor after: Zhang Jianyang

Inventor after: Yang Ruijian

Inventor after: Zhang Zhen

Inventor after: Wang Xianyong

Inventor after: Yuan Yange

Inventor after: Cai Xiaoyu

Inventor after: Peng Bo

Inventor before: Jiang Dongyang

Inventor before: Zhang Jianyang

Inventor before: Yang Ruijian

Inventor before: Zhang Zhen

Inventor before: Wang Xianyong

Inventor before: Yuan Yange

CB03 Change of inventor or designer information