CN106412508A - Intelligent monitoring method and system of illegal line press of vehicles - Google Patents
Intelligent monitoring method and system of illegal line press of vehicles Download PDFInfo
- Publication number
- CN106412508A CN106412508A CN201610873484.XA CN201610873484A CN106412508A CN 106412508 A CN106412508 A CN 106412508A CN 201610873484 A CN201610873484 A CN 201610873484A CN 106412508 A CN106412508 A CN 106412508A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- information
- roadmarking
- monitoring data
- traffic mark
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 112
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000004458 analytical method Methods 0.000 claims description 37
- 230000033228 biological regulation Effects 0.000 claims description 31
- 239000000284 extract Substances 0.000 claims description 26
- 238000000605 extraction Methods 0.000 claims description 20
- 238000012549 training Methods 0.000 claims description 18
- 230000008447 perception Effects 0.000 claims description 13
- 230000007613 environmental effect Effects 0.000 claims description 12
- 238000012546 transfer Methods 0.000 claims description 12
- 230000000873 masking effect Effects 0.000 claims description 3
- 230000002123 temporal effect Effects 0.000 claims description 3
- 238000004321 preservation Methods 0.000 claims 1
- 230000006399 behavior Effects 0.000 abstract description 23
- 241000283070 Equus zebra Species 0.000 description 4
- 239000002609 medium Substances 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- SAZUGELZHZOXHB-UHFFFAOYSA-N acecarbromal Chemical compound CCC(Br)(CC)C(=O)NC(=O)NC(C)=O SAZUGELZHZOXHB-UHFFFAOYSA-N 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 230000002730 additional effect Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000000686 essence Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000012120 mounting media Substances 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Traffic Control Systems (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the invention provides an intelligent monitoring method and system of illegal line press of vehicles, for solving the problem that illegal line press behaviors of vehicles in monitoring videos cannot be analyzed and judged in real time by the video monitoring mode in the prior art. The intelligent monitoring method of illegal line press of vehicles comprises the following steps: when a vehicle shields a road marking is identified in video monitoring data collected in real time is identified, interrupting current frame of monitoring data of the video monitoring data; extracting vehicle feature information of the vehicle that shields the road marking, the information of the road marking shielded by the vehicle and traffic sign information from the current frame of monitoring data in real time; and judging whether the vehicle generates the illegal line press behavior according to the extracted vehicle feature information, the e information of the road marking shielded by the vehicle and the traffic sign information.
Description
Technical field
The present invention relates to technical field of video monitoring is and in particular to a kind of vehicle peccancy line ball intelligent control method and be
System.
Background technology
With the raising of the popularization of broadband network, the development of computer technology and image processing techniques, video monitoring skill
Art, as assisting public safety department to fight crime, maintain the important means of social stability, penetrates into people more and more widely
The various fields of daily life.But under vehicle monitoring analysis scene, existing video monitoring analysis method can only be based on institute
The manual analysis that the monitor video of collection carries out afterwards, this and be unfavorable for vehicle peccancy line ball is travelled the timely discovery of behavior and
Process.Therefore, it is badly in need of a kind of intelligent monitoring mode that can analyze the vehicle peccancy line ball behavior judging in monitor video in real time.
Content of the invention
In view of this, embodiments provide a kind of vehicle peccancy line ball intelligent control method and system, solve
Video monitoring mode of the prior art cannot be analyzed judgement in real time to the vehicle peccancy line ball behavior in monitor video
Problem.
A kind of vehicle peccancy line ball intelligent control method that one embodiment of the invention provides includes：
When identifying that in the video monitoring data of Real-time Collection vehicle is blinded by roadmarking, intercept described video prison
The present frame monitoring data of control data；
It is blinded by vehicle characteristic information, the vehicle institute of the vehicle of roadmarking in present frame monitoring data described in extract real-time
The roadmarking information of masking and traffic mark information；And
The roadmarking information covered according to the vehicle characteristic information of described extraction, vehicle and traffic mark information judge
Described vehicle whether there is line ball behavior violating the regulations.
One embodiment of the invention also provides a kind of vehicle peccancy line ball intelligent monitor system, including：
Environmental perception device, is configured to work as and identifies that in the video monitoring data of Real-time Collection vehicle is blinded by road sign
During line, intercept the present frame monitoring data of described video monitoring data；
Characteristics of objects analytical equipment, is configured to the present frame monitoring data being gathered according to described environmental perception device, real
When extract and be blinded by the roadmarking information that the vehicle characteristic information of vehicle of roadmarking and vehicle are covered；
Geographical sign analytical equipment, is configured to the present frame monitoring data being gathered according to described environmental perception device, real
When extract traffic mark information；And
Decision making device, is configured to the vehicle characteristic information according to the extraction of described characteristics of objects analytical equipment and vehicle is covered
Roadmarking information, and described geographical sign analytical equipment extract traffic mark information judge that described vehicle whether there is
Line ball behavior violating the regulations.
A kind of vehicle peccancy line ball intelligent control method provided in an embodiment of the present invention and system, Real-time Collection video respectively
Roadmarking information and the traffic mark letter in the exercised track of vehicle that vehicle characteristic information in monitoring data, vehicle are covered
Breath, be can confirm that the feature of vehicle, can confirm that car based on the roadmarking information that this vehicle is covered based on this vehicle characteristic information
The roadmarking being covered, can confirm that, based on this traffic mark information, the traffic rules that this roadmarking is suitable for, works as vehicle
Feature do not correspond with the roadmarking that vehicle is covered, or the feature not phase of the roadmarking that covered of vehicle and traffic mark
Just can assert during symbol that vehicle has line ball behavior violating the regulations, it is achieved thereby that the reality to the vehicle peccancy line ball behavior in monitor video
When analysis judge.
Brief description
The flow process that Fig. 1 show a kind of vehicle peccancy line ball intelligent control method of one embodiment of the invention offer is illustrated
Figure.
The flow process that Fig. 2 show a kind of vehicle peccancy line ball intelligent control method of another embodiment of the present invention offer is illustrated
Figure.
The flow process that Fig. 2 ' show a kind of vehicle peccancy line ball intelligent control method of another embodiment of the present invention offer is shown
It is intended to.
Fig. 3 show a kind of structural representation of vehicle peccancy line ball intelligent monitor system of one embodiment of the invention offer
Figure.
Fig. 4 show a kind of structural representation of monitor video intelligent information model of one embodiment of the invention offer.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes it is clear that described embodiment is only a part of embodiment of the present invention, rather than whole embodiments.Based on this
Embodiment in invention, the every other reality that those of ordinary skill in the art are obtained under the premise of not making creative work
Apply example, broadly fall into the scope of protection of the invention.
The flow process that Fig. 1 show a kind of vehicle peccancy line ball intelligent control method of one embodiment of the invention offer is illustrated
Figure.As shown in figure 1, this vehicle peccancy line ball intelligent control method includes：
Step 101：When identifying that in the video monitoring data of Real-time Collection vehicle is blinded by roadmarking, intercepting should
The present frame monitoring data of video monitoring data.
Specifically, the identification process for vehicle defiladed route graticule behavior can be accomplished in several ways.For example, may be used
Vehicle Object and roadmarking object are first extracted from video monitoring data based on existing image object extractive technique, when this
When Vehicle Object and this roadmarking object cross, then illustrate that this vehicle is blinded by this roadmarking.But the present invention couple
The identification process of vehicle defiladed route graticule behavior is simultaneously not specifically limited.
In the prior art, the video monitoring data of Real-time Collection is usually stored, is needing to carry out video to divide
Again the video monitoring data of storage is recalled or by manually carrying out discriminatory analysis during analysis, thereby resulted in hysteresis effect it is impossible to
Analyze the timely process realized under scene to vehicle peccancy line ball behavior in vehicle monitoring.And in embodiments of the present invention, when
When identifying that vehicle is blinded by roadmarking in the video monitoring data of Real-time Collection, just intercept present frame monitoring data, deserve
Previous frame monitoring data is directly as the basic resources data subsequently carrying out further real-time intelligent analysis.
In an embodiment of the present invention, this present frame monitoring data may include in present frame monitoring image and following items
One or more：Video acquisition positional information and video acquisition temporal information.Wherein present frame monitoring image is subsequently to carry out
Roadmarking information and the resource data of traffic mark information extraction that vehicle characteristic information, vehicle are covered, video acquisition position
Confidence breath and video acquisition temporal information can as additional attribute information be used for that clear and definite vehicle peccancy line ball behavior occurs when
Between and place.
In an embodiment of the present invention, present frame monitoring data also can directly be issued the monitoring personnel of Surveillance center and check,
Enable automatically carrying out of monitoring personnel manual oversight whole vehicle peccancy line ball intelligent monitoring process.
Step 102：It is blinded by the vehicle characteristic information of vehicle, the car of roadmarking in extract real-time present frame monitoring data
The roadmarking information covered and traffic mark information.
In an embodiment of the present invention, vehicle characteristic information may include one or more of following items：Vehicle identification number,
The time span that vehicle heading, Vehicle Speed and vehicle line ball travel, for clear and definite vehicle further feature with
And the travelling characteristic of vehicle.The roadmarking information that vehicle is covered includes：The classification information of roadmarking, such as bus are special
With lane line, track solid line, channelizing line, stop line and zebra stripes etc..Traffic mark information may include traffic lights information, is used for joining
Close the traffic rules that roadmarking information is suitable for clear and definite roadmarking.
In an embodiment of the present invention, this vehicle characteristic information, vehicle are covered roadmarking information and traffic mark
Roadmarking information and the pre- instruction of traffic mark information that the extraction process of information can be covered based on vehicle characteristic information, vehicle
Practice model realization.For example, in advance pre-training is carried out to the corresponding relation of type of vehicle and the shape of vehicle, to roadmarking and road
The corresponding relation of the shape facility of marking lines carries out pre-training, when the build of the vehicle identifying in monitor video is less and without
When having wagon box, can determine whether that this vehicle is car based on pre-training model；There is " public transport is special " etc. when identifying in roadmarking
During printed words, can determine whether that this roadmarking is bus special-purpose vehicle diatom based on pre-training model.
Step 103：The roadmarking information covered according to the vehicle characteristic information extracting, vehicle and traffic mark information
Judge that this vehicle whether there is line ball behavior violating the regulations.
Can confirm that the feature of vehicle based on this vehicle characteristic information, can be true based on the roadmarking information that this vehicle is covered
Recognize the roadmarking that vehicle is covered, the traffic rules that this roadmarking is suitable for be can confirm that based on this traffic mark information, when
The roadmarking that the feature of vehicle and vehicle are covered does not correspond, or the feature of the roadmarking that covered of vehicle and traffic mark
Just can assert when not corresponding that vehicle has line ball behavior violating the regulations, it is achieved thereby that to the vehicle peccancy line ball behavior in monitor video
Real-time analysis judge.In an embodiment of the present invention, after judging that vehicle has line ball behavior violating the regulations, can be based further on
The roadmarking information that vehicle characteristic information, vehicle are covered and traffic mark information provide punishment on contravention of regulation result.Such as " vehicle
A there are the illegal activities of line ball traveling it is proposed that deduction XX divides, fine YY unit ... ".
In an embodiment of the present invention, can be pre-training model based on the machine description to clause violating the regulations, sentence in real time
Whether disconnected vehicle is illegal to be blinded by roadmarking.For example, by the limited traveling of the different roadmarking of pre-training procedural learning
Type of vehicle, such as only allow in bus special-purpose vehicle diatom bus travel.Vehicle included by when vehicle characteristic information
Type is car, and when the roadmarking type included by roadmarking information is bus special-purpose vehicle diatom, when this little vapour
Car just can determine whether when being pressed onto this bus special-purpose vehicle diatom that this car has line ball behavior violating the regulations.Again for example, can be instructed by pre-
Practice the traffic rules that procedural learning difference roadmarking is suitable for, such as the roadmarking type included by when roadmarking information
For zebra stripes, when the traffic lights information included by traffic mark information is green light, if the vehicle speed included by vehicle characteristic information
Degree is zero, then illustrate that this vehicle stops on zebra stripes, there is the behavior of masking zebra stripes violating the regulations.
In an embodiment of the present invention, the vehicle characteristic information of vehicle, vehicle are covered roadmarking information and friendship
Logical identification information can be conserved after being extracted, and reviewing and inquiring about in order to follow-up.For example, can receive with vehicle spy
After reference breath, the roadmarking information covered of vehicle or query statement that traffic mark information is querying condition, transfer and car
The corresponding all roadmarking information of characteristic information and traffic mark information, or transfer corresponding with roadmarking information all
Vehicle characteristic information and traffic mark information, or transfer all vehicle characteristic information corresponding with traffic mark information and road road sign
Line information, thus realize the line ball vehicle violating the regulations of the line ball record violating the regulations for a certain vehicle, a certain concrete roadmarking
The inquiry of the line ball record violating the regulations under record or a certain traffic mark.For example, if receiving with bus special lane graticule B for looking into
During the query statement of inquiry condition, just may bring up all cars covering this bus special lane graticule B in current video monitoring data
Characteristic information and this bus special lane graticule B near traffic mark information.
In an embodiment of the present invention, because the normally travel behavior of vehicle does not need to carry out process violating the regulations, if therefore
It is judged as that vehicle does not have line ball behavior violating the regulations, then can not preserve this vehicle characteristic information, roadmarking that vehicle is covered letter
Breath and traffic mark information, to improve the utilization ratio of storage hardware resource.
The flow process that Fig. 2 show a kind of vehicle peccancy line ball intelligent control method of another embodiment of the present invention offer is illustrated
Figure.As shown in Fig. 2 this vehicle peccancy line ball intelligent control method includes：
Step 201：When identifying that in the video monitoring data of Real-time Collection vehicle is blinded by roadmarking, intercepting should
The present frame monitoring data of video monitoring data.
Step 202：The area video monitoring data in region residing for vehicle is intercepted from present frame monitoring data.
By intercepting area video monitoring data from present frame monitoring data, eliminate unrelated with current monitor vehicle
The video monitoring data in region, decreases subsequent extracted vehicle characteristic information, roadmarking information that vehicle is covered and traffic
The amount of calculation of identification information, mitigates the computation burden of hardware analysis resource.
It should be appreciated that the area size of this area video monitoring data can be by developer according to actual scene demand
Fixed, the monitoring range of such as head end video collecting device includes two blocks, and monitoring personnel of interest be only therein one
The line ball situation violating the regulations of individual block, now just can intercept from video monitoring data and monitor number when the area video of previous block
According to.Or, depending on the size in this region also can be by the image size of the vehicle being monitored.However, the present invention is to this area video
The determination mode of the area size of monitoring data does not limit.
Step 203：The roadmarking information that extraction vehicle characteristic information, vehicle are covered from area video monitoring data
With traffic mark information.
Because original video monitoring data has been intercepted for area video monitoring data, therefore vehicle characteristics letter
The amount of calculation of the extraction process of breath, the roadmarking information that vehicle is covered and traffic mark information is reduced, and alleviates
The computation burden of hardware analysis resource.Roadmarking information that vehicle characteristic information, vehicle are covered and traffic mark information
Concrete extracting mode still can pass through pre-training model realization, will not be described here.
In an embodiment of the present invention it is contemplated that the extraction of roadmarking information covered of vehicle characteristic information and vehicle
It is concerned only with the vehicle in monitor video, the traffic mark in monitor video is paid close attention in the extraction of traffic mark information, and vehicle is in prison
In control video, shared region is less than the region shared by traffic mark, therefore can also only carry from area video monitoring data
Take the roadmarking information that vehicle characteristic information and vehicle are covered, and traffic mark information is still from the video monitoring of acquired original
Extracting data.However, present invention roadmarking information that vehicle characteristic information, vehicle are covered and traffic mark information
Extract basis and be not specifically limited.
Step 204：Roadmarking information and traffic mark that vehicle characteristic information based on extract real-time, vehicle are covered
Information generative semantics analysis result.
For example, the characteristic information of vehicle includes vehicle A is large truck, and travel speed is 100km/h, and vehicle is covered
Roadmarking information is runway graticule B, and traffic mark information is speed limit 80km/h, then the semantic analysis result being generated can table
It is shown as the runway graticule B that large truck A is blinded by speed limit 80km/h with the travel speed of 100km/h.
Step 205：Based on the pre-training model of semantic analysis result and the machine description of clause violating the regulations, real-time judge institute
State and be blinded by the vehicle of roadmarking and whether illegal be blinded by roadmarking.
It should be noted that while for purposes of simplicity of explanation method of the present invention is illustrated and described as a succession of dynamic
Make, it should be understood that and recognizing that the not execution sequence institute by these actions is limited by claimed subject content, because one
A little actions concurrently can be occurred according to being occurred with order different shown and described herein or with other actions, with
When some actions be also possible that some sub-steps, and between these sub-steps, be likely to occur the possibility that execution is intersected on sequential.
For example, in an embodiment of the present invention, as shown in Fig. 2 ', identify that vehicle hides in the video monitoring data of Real-time Collection working as
When having covered roadmarking, and after intercepting the present frame monitoring data of this video monitoring data (step 201 '), traffic mark information
Can directly extract from present frame monitoring data (step 202 '), then intercept area residing for vehicle again from present frame monitoring data
The area video monitoring data (step 203 ') in domain and extract vehicle characteristic information and vehicle from area video monitoring data
The roadmarking information (step 204 ') covered, afterwards based on the traffic mark information extracted, vehicle characteristic information and
Roadmarking information generative semantics analysis result that vehicle is covered (step 205 '), and be based ultimately upon this semantic analysis result with
And the pre-training model of the machine description of clause violating the regulations, whether real-time judge vehicle is illegal to be blinded by roadmarking (step
206’).Additionally, it is possible to simultaneously the action of not all diagram is necessary to the method implemented according to appended claims.
Furthermore, the description of abovementioned steps is not excluded for the method and can also include obtaining the additional step of additional effect.Also should manage
Solve, the method and step described in different embodiments or flow process can be mutually combined or replace.
Fig. 3 show a kind of structural representation of vehicle peccancy line ball intelligent monitor system of one embodiment of the invention offer
Figure.As shown in figure 3, this vehicle peccancy line ball intelligent monitor system 30 includes：
Environmental perception device 301, is configured to work as and identifies that in the video monitoring data of Real-time Collection vehicle is blinded by
During marking lines, intercept the present frame monitoring data of described video monitoring data；
Characteristics of objects analytical equipment 302, is configured to monitor number according to the present frame that described environmental perception device 301 is gathered
According to extract real-time is blinded by the roadmarking information that the vehicle characteristic information of the vehicle of roadmarking and vehicle are covered；
Geographical sign analytical equipment 303, is configured to the present frame monitoring data being gathered according to environmental perception device 301,
Extract real-time traffic mark information；And
Decision making device 304, is configured to the vehicle characteristic information according to characteristics of objects analytical equipment 302 extraction and vehicle is hidden
The roadmarking information covered, and geographical sign analytical equipment 303 extract traffic mark information judge whether described vehicle is deposited
In line ball behavior violating the regulations.
In an embodiment of the present invention, this vehicle peccancy line ball intelligent monitor system further includes：Semantic analysis device
305, it is configured to described characteristics of objects analytical equipment 302 and the distinguished extract real-time of described geographical sign analytical equipment 303
Vehicle characteristic information, the roadmarking information covered of vehicle and traffic mark information generative semantics analysis result；
Wherein decision making device 304 is further configured to：
The semantic analysis result being generated based on semantic analysis device 305 and the pre-training of the machine description of clause violating the regulations
Model, the vehicle being blinded by roadmarking described in real-time judge whether illegal is blinded by roadmarking.
In an embodiment of the present invention, this decision making device 304 is further configured to：
Receive the roadmarking information covered with vehicle characteristic information, vehicle or traffic mark information as querying condition
Query statement；And transfer all roadmarking information corresponding with vehicle characteristic information and traffic mark information, or transfer with
The corresponding all vehicle characteristic information of roadmarking information and traffic mark information, or transfer institute corresponding with traffic mark information
There are vehicle characteristic information and roadmarking information.
In an embodiment of the present invention, decision making device 304 is further configured to：
If vehicle does not have line ball behavior violating the regulations, do not preserve vehicle characteristic information corresponding with vehicle, vehicle is covered
Roadmarking information and traffic mark information.
In an embodiment of the present invention, this vehicle peccancy line ball intelligent monitor system further includes：
Subject area extraction element 306, is configured to be blinded by roadmarking described in intercepting from present frame monitoring data
The area video monitoring data in region residing for vehicle；
Wherein characteristics of objects analytical equipment 302 is further configured to：Vehicle characteristics are extracted from area video monitoring data
The roadmarking information that information and/or vehicle are covered.
In an alternative embodiment of the invention, geographical sign analytical equipment 303 also can be further configured to：From area video prison
Control extracting data traffic mark information.
In an embodiment of the present invention, characteristics of objects analytical equipment 302 is further configured to：Based on to vehicle characteristic information
With the pre-training model of roadmarking information, extract vehicle characteristic information and roadmarking information from present frame monitoring data；
And/or,
Geographical sign analytical equipment 303 is further configured to：Based on the pre-training model of traffic mark information, from present frame
Traffic mark information is extracted in monitoring data.
In an embodiment of the present invention, this decision making device 304 is further configured to：When judged result is to be, according to carrying
The roadmarking information that the vehicle characteristic information that takes, vehicle are covered and traffic mark information provide punishment on contravention of regulation result.
As can be seen here, the vehicle peccancy line ball intelligent monitor system that the embodiment of the present invention is provided is based on a kind of prison in fact
Control video intelligent information model is realized.Information flow in this monitor video intelligent information model can be divided into different aspects to carry
Take, and there is certain dependence between adjacent aspect, as shown in Figure 4.Intercept present frame in environmental perception device 301
During video monitoring data, by present frame video with live perception data (such as：Sound, the time, the geographical position of camera,
Temperature, meteorology, camera pose etc.) it is stored in environment sensing layer, these information are traditional video surveillance and intelligent video monitoring provides
The fundamental of monitoring scene, provides necessary support for top layer decision-making.During front-end processing, by present frame video monitoring
Data carries out preliminary treatment (include conventional pretreatment, and front end intellectual analysis based on statistical learning method etc.), and will be just
The result that step is processed is stored in characteristic layer, geographical sign layer and object layer, and corresponding objects feature analyzing apparatus 302 extract vehicle respectively
Vehicle characteristic information and vehicle covered the process of roadmarking information, geographical sign analytical equipment 303 extract traffic mark
The process of knowledge information and subject area extraction element 306 intercept area video monitoring data from present frame video monitoring data
Process.In back-end processing procedures, by according to different application needs, comprehensive aforesaid accordingly each layer, using machine learning
Technology is analyzed and processes, and related result is stored in semantic layer, corresponding semantic analysis device 305 generative semantics analysis
The process of result.For the semantic analysis result in semantic analysis device 305, using the judgment models of machine learning techniques training
Different decision recommendations can be given and supply monitoring personnel reference；Meanwhile, monitoring personnel can also send instruction to system, to inquire about
Corresponding content in monitoring data, these belong to decision-making/understand layer.Judgment models therein and by its judge to obtain certainly
Plan is advised, belongs to decision-making category.Monitoring personnel, during observing, sends certain instruction to inquire about a certain event to monitoring system
In, possess the target of certain category feature, system is instructed the describing mode being construed to meet this structural model, and it is grasped
Data enters line retrieval, belongs to and understands category.
It should be appreciated that when vehicle peccancy line ball intelligent monitor system includes head end video collecting device and rear end video analysis
During equipment, environmental perception device 301 may be provided in head end video collecting device, and geographical sign analytical equipment 303, target area
Domain extraction element 306, characteristics of objects analytical equipment 302, semantic analysis device 305, decision making device 304 can be separately positioned on front end
In video capture device or be arranged in the video analysis equipment of rear end.As long as all in vehicle peccancy line ball intelligent monitor system
Device is capable of the progressively extraction of respective analysis abstraction function and information flow, with the purpose being finally reached semantic decision-making is
Can.The present invention is specifically located at head end video collecting device or rear end to the device in vehicle peccancy line ball intelligent monitor system
Video analysis equipment does not limit.
The teachings of the present invention is also implemented as a kind of computer program of computer-readable recording medium, including meter
Calculation machine program code, when computer program code is by computing device, it enables a processor to according to embodiment party of the present invention
The method of formula is realizing vehicle peccancy line ball intelligent control method as the embodiment described herein.Computer-readable storage medium is permissible
For any tangible media, such as floppy disk, CD-ROM, DVD, hard disk drive, even network medium etc..
It should be understood that although a kind of way of realization the foregoing describing embodiment of the present invention can be computer program product
Product, but the method or apparatus of embodiments of the present invention can be come in fact by the combination according to software, hardware or software and hardware
Existing.Hardware components can be realized using special logic；Software section can store in memory, by suitable instruction execution
System, such as microprocessor or special designs hardware are executing.It will be understood by those skilled in the art that above-mentioned side
Method and equipment can be realized in processor control routine using computer executable instructions and/or be included in, such as such as
Disk, the mounting medium of CD or DVD-ROM, such as the programmable memory of read-only storage (firmware) or such as optics or
Such code is provided on the data medium of electrical signal carrier.Methods and apparatus of the present invention can be by such as ultra-large
The semiconductor of integrated circuit OR gate array, logic chip, transistor etc. or such as field programmable gate array, can compile
The hardware circuit of the programmable hardware device of journey logical device etc. is realized it is also possible to soft by various types of computing devices
Part is realized it is also possible to be realized by the combination such as firmware of above-mentioned hardware circuit and software.
It will be appreciated that though be referred to some modules or the unit of device in detailed descriptions above, but this stroke
Divide and be merely exemplary rather than enforceable.In fact, according to an illustrative embodiment of the invention, above-described two or
The more feature of multimode/unit and function can be realized in a module/unit, conversely, an above-described module/mono-
The feature of unit and function can be to be realized by multiple module/units with Further Division.Additionally, above-described certain module/
Unit can be omitted under some application scenarios.For example when the computing capability of hardware computing resource is unrestricted, also can not wrap
Include subject area extraction element.
It is also understood that in order to not obscure embodiments of the present invention, specification only to some are crucial, may not necessary skill
Art and feature are described, and the feature that may some those skilled in the art be capable of is explained.
The foregoing is only presently preferred embodiments of the present invention, not in order to limit the present invention, all essences in the present invention
Within god and principle, any modification of being made, equivalent etc., should be included within the scope of the present invention.
Claims (17)
1. a kind of vehicle peccancy line ball intelligent control method is it is characterised in that include：
When identifying that in the video monitoring data of Real-time Collection vehicle is blinded by roadmarking, intercept described video monitoring number
According to present frame monitoring data；
It is blinded by the vehicle characteristic information of the vehicle of roadmarking, vehicle is covered in present frame monitoring data described in extract real-time
Roadmarking information and traffic mark information；And
Described in the roadmarking information covered according to the vehicle characteristic information of described extraction, vehicle and traffic mark information judge
Vehicle whether there is line ball behavior violating the regulations.
2. method according to claim 1 is it is characterised in that further include：
Preserve described vehicle characteristic information, roadmarking information that vehicle is covered and traffic mark information.
3. method according to claim 1 is it is characterised in that the described vehicle characteristic information of described preservation, vehicle are covered
Roadmarking information and traffic mark information include：
The roadmarking information that vehicle characteristic information based on described extract real-time, vehicle are covered and traffic mark information generate
Semantic analysis result；
Roadmarking information and traffic mark that wherein said vehicle characteristic information according to described extract real-time, vehicle are covered
The vehicle being blinded by roadmarking described in information judgement includes with the presence or absence of line ball behavior violating the regulations：
Based on the pre-training model of described semantic analysis result and the machine description of clause violating the regulations, it is blinded by described in real-time judge
Whether the vehicle of roadmarking is illegal to be blinded by roadmarking.
4. method according to claim 2 is it is characterised in that further include：
Receive the roadmarking information covered with described vehicle characteristic information, vehicle or described traffic mark information for inquiring about bar
The query statement of part；And
Transfer all described roadmarking information corresponding with described vehicle characteristic information and traffic mark information, or transfer and institute
State the corresponding all described vehicle characteristic information of roadmarking information and traffic mark information, or transfer and described traffic mark letter
Cease corresponding all described vehicle characteristic information and roadmarking information.
5. method according to claim 2 is it is characterised in that further include：
If the vehicle being blinded by roadmarking described in being judged as does not have line ball behavior violating the regulations, do not preserve corresponding with described vehicle
Vehicle characteristic information, the roadmarking information covered of vehicle and traffic mark information.
6. method according to claim 1 is it is characterised in that be blinded by present frame monitoring data described in extract real-time
Before roadmarking information that the vehicle characteristic information of the vehicle of roadmarking, vehicle are covered and traffic mark information, enter
One step includes：
It is blinded by the area video monitoring in the region residing for vehicle of roadmarking described in intercepting from described present frame monitoring data
Data；
Wherein it is blinded by the vehicle characteristic information of vehicle, the vehicle institute of roadmarking in present frame monitoring data described in extract real-time
The roadmarking information of masking and traffic mark information include：
The roadmarking information that described vehicle characteristic information and/or vehicle are covered is extracted from described area video monitoring data
And/or described traffic mark information.
7. method according to claim 1 is it is characterised in that vehicle in present frame monitoring data described in described extract real-time
Vehicle characteristic information, the roadmarking information covered of vehicle and traffic mark information includes：
Based on the pre-training model to described vehicle characteristic information, roadmarking information and traffic mark information, from described current
Described vehicle characteristic information, roadmarking information and traffic mark information is extracted in frame monitoring data.
8. according to described method arbitrary in claim 1 to 7 it is characterised in that described present frame monitoring data includes currently
One or more of frame monitoring image and following items：Video acquisition positional information and video acquisition temporal information；With/
Or,
Described vehicle characteristic information includes one or more of following items：Vehicle identification number, vehicle heading, vehicle travel
Speed and the time span of vehicle line ball traveling；And/or,
The roadmarking information that described vehicle is covered includes：The classification information of roadmarking；And/or,
Described traffic mark information includes：Traffic lights information.
9. according to described method arbitrary in claim 1 to 7 it is characterised in that further including：
When judged result is to be, the roadmarking information covered according to the vehicle characteristic information of described extraction, vehicle and friendship
Logical identification information provides punishment on contravention of regulation result.
10. a kind of vehicle peccancy line ball intelligent monitor system is it is characterised in that include：
Environmental perception device, is configured to work as and identifies that in the video monitoring data of Real-time Collection vehicle is blinded by roadmarking
When, intercept the present frame monitoring data of described video monitoring data；
Characteristics of objects analytical equipment, is configured to the present frame monitoring data being gathered according to described environmental perception device, carries in real time
Take the roadmarking information that the vehicle characteristic information of the vehicle being blinded by roadmarking and vehicle are covered；
Geographical sign analytical equipment, is configured to the present frame monitoring data being gathered according to described environmental perception device, carries in real time
Take traffic mark information；
And
Decision making device, is configured to the road that the vehicle characteristic information according to the extraction of described characteristics of objects analytical equipment and vehicle are covered
Marking lines information, and described geographical sign analytical equipment extract traffic mark information judge described vehicle whether there is break rules and regulations
Line ball behavior.
11. systems according to claim 10 are it is characterised in that further include：
Semantic analysis device, is configured to described characteristics of objects analytical equipment and described geographical sign analytical equipment is distinguished in fact
When the roadmarking information covered of the vehicle characteristic information that extracts, vehicle and traffic mark information generative semantics analysis result；
Wherein said decision making device is further configured to：
The semantic analysis result being generated based on described semantic analysis device and the pre-training of the machine description to clause violating the regulations
Model, the vehicle being blinded by roadmarking described in real-time judge whether illegal is blinded by roadmarking.
12. systems according to claim 11 are it is characterised in that described decision making device is further configured to：
Receive the roadmarking information covered with described vehicle characteristic information, vehicle or described traffic mark information for inquiring about bar
The query statement of part；And
Transfer all described roadmarking information corresponding with described vehicle characteristic information and traffic mark information, or transfer and institute
State the corresponding all described vehicle characteristic information of roadmarking information and traffic mark information, or transfer and described traffic mark letter
Cease corresponding all described vehicle characteristic information and roadmarking information.
13. systems according to claim 11 are it is characterised in that described decision making device is further configured to：
If the vehicle being blinded by roadmarking described in being judged as does not have line ball behavior violating the regulations, do not preserve corresponding with described vehicle
Vehicle characteristic information, the roadmarking information covered of vehicle and traffic mark information.
14. systems according to claim 10 are it is characterised in that further include：
Subject area extraction element, is configured to be blinded by the vehicle of roadmarking described in intercepting from described present frame monitoring data
The area video monitoring data in residing region；
Wherein said characteristics of objects analytical equipment is further configured to：Extract described vehicle from described area video monitoring data
The roadmarking information that characteristic information and/or vehicle are covered；And/or,
Described geographical sign analytical equipment is further configured to：Extract described traffic mark from described area video monitoring data
Information.
15. systems according to claim 14 are it is characterised in that before described vehicle peccancy line ball intelligent monitor system includes
End video capture device and rear end video analysis equipment；
Wherein said environmental perception device is arranged in described head end video collecting device；
Described geographical sign analytical equipment, described subject area extraction element, described characteristics of objects analytical equipment, described semanteme point
Analysis apparatus, described decision making device are separately positioned in described head end video collecting device or are arranged on described rear end video analysis and set
In standby.
16. systems according to claim 10 are it is characterised in that described characteristics of objects analytical equipment is further configured to：
Based on the pre-training model to described vehicle characteristic information and roadmarking information, extract institute from described present frame monitoring data
State vehicle characteristic information and roadmarking information；And/or,
Described geographical sign analytical equipment is further configured to：Based on the pre-training model of described traffic mark information, from described
Described traffic mark information is extracted in present frame monitoring data.
17. according to described system arbitrary in claim 10 to 16 it is characterised in that described decision making device configures further
For：When judged result is to be, the roadmarking information covered according to the vehicle characteristic information of described extraction, vehicle and traffic
Identification information provides punishment on contravention of regulation result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610873484.XA CN106412508A (en) | 2016-09-30 | 2016-09-30 | Intelligent monitoring method and system of illegal line press of vehicles |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610873484.XA CN106412508A (en) | 2016-09-30 | 2016-09-30 | Intelligent monitoring method and system of illegal line press of vehicles |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106412508A true CN106412508A (en) | 2017-02-15 |
Family
ID=59228049
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610873484.XA Pending CN106412508A (en) | 2016-09-30 | 2016-09-30 | Intelligent monitoring method and system of illegal line press of vehicles |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106412508A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107358170A (en) * | 2017-06-21 | 2017-11-17 | 华南理工大学 | A kind of vehicle peccancy line ball recognition methods based on mobile machine vision |
| CN109063612A (en) * | 2018-07-19 | 2018-12-21 | 中智城信息技术有限公司 | City intelligent red line management method and machine readable storage medium |
| CN109598943A (en) * | 2018-12-30 | 2019-04-09 | 北京旷视科技有限公司 | The monitoring method of vehicle violation, apparatus and system |
| CN109740424A (en) * | 2018-11-23 | 2019-05-10 | 深圳市华尊科技股份有限公司 | Traffic violations recognition methods and Related product |
| CN110178167A (en) * | 2018-06-27 | 2019-08-27 | 潍坊学院 | Crossing video frequency identifying method violating the regulations based on video camera collaboration relay |
| CN110717433A (en) * | 2019-09-30 | 2020-01-21 | 华中科技大学 | Deep learning-based traffic violation analysis method and device |
| CN111439259A (en) * | 2020-03-23 | 2020-07-24 | 成都睿芯行科技有限公司 | Agricultural garden scene lane deviation early warning control method and system based on end-to-end convolutional neural network |
| CN112581776A (en) * | 2020-12-09 | 2021-03-30 | 张兴莉 | Intelligent traffic scheduling method and device and scheduling center |
| CN114170798A (en) * | 2021-12-03 | 2022-03-11 | 智道网联科技(北京)有限公司 | Message reminding system and method |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101123039A (en) * | 2007-09-14 | 2008-02-13 | 清华大学 | Red light overriding detection system and method based on digital video camera |
| CN101246644A (en) * | 2007-12-28 | 2008-08-20 | 北京航空航天大学 | Fixed intersection electric police grasp shoot device |
| US20080239076A1 (en) * | 2007-03-26 | 2008-10-02 | Trw Automotive U.S. Llc | Forward looking sensor system |
| US20090245582A1 (en) * | 2008-03-26 | 2009-10-01 | Honda Motor Co., Ltd. | Lane recognition apparatus for vehicle, vehicle thereof, and lane recognition program for vehicle |
| CN101847318A (en) * | 2009-03-24 | 2010-09-29 | 杨占昆 | Computer-aided video capture and identification system |
| CN101901548A (en) * | 2010-07-30 | 2010-12-01 | 深圳市中盟科技股份有限公司 | Road monitoring method, device and system |
| CN102368353A (en) * | 2011-10-10 | 2012-03-07 | 中盟智能科技（苏州）有限公司 | Traffic illegal line-cross evidence obtaining method and device |
| CN102880692A (en) * | 2012-09-19 | 2013-01-16 | 上海交通大学 | Retrieval-oriented monitoring video semantic description and inspection modeling method |
| CN103021186A (en) * | 2012-12-28 | 2013-04-03 | 中国科学技术大学 | Vehicle monitoring method and vehicle monitoring system |
| CN103208183A (en) * | 2013-04-03 | 2013-07-17 | 昆明联诚科技有限公司 | Vehicle video data mining method for traffic violation evidence obtaining |
| CN103366569A (en) * | 2013-06-26 | 2013-10-23 | 东南大学 | Method and system for snapshotting traffic violation vehicle in real time |
| CN103473926A (en) * | 2013-09-11 | 2013-12-25 | 无锡加视诚智能科技有限公司 | Gun-ball linkage road traffic parameter collection and rule breaking snapshooting system |
| CN104658261A (en) * | 2013-11-23 | 2015-05-27 | 安徽蓝盾光电子股份有限公司 | Detection and monitoring system of cart lane occupation on expressway |
| CN104680794A (en) * | 2015-02-13 | 2015-06-03 | 深圳市图敏实业有限公司 | Vehicle-mounted monitoring terminal as well as bus lane monitoring method and system based on terminal |
-
2016
- 2016-09-30 CN CN201610873484.XA patent/CN106412508A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080239076A1 (en) * | 2007-03-26 | 2008-10-02 | Trw Automotive U.S. Llc | Forward looking sensor system |
| CN101123039A (en) * | 2007-09-14 | 2008-02-13 | 清华大学 | Red light overriding detection system and method based on digital video camera |
| CN101246644A (en) * | 2007-12-28 | 2008-08-20 | 北京航空航天大学 | Fixed intersection electric police grasp shoot device |
| US20090245582A1 (en) * | 2008-03-26 | 2009-10-01 | Honda Motor Co., Ltd. | Lane recognition apparatus for vehicle, vehicle thereof, and lane recognition program for vehicle |
| CN101847318A (en) * | 2009-03-24 | 2010-09-29 | 杨占昆 | Computer-aided video capture and identification system |
| CN101901548A (en) * | 2010-07-30 | 2010-12-01 | 深圳市中盟科技股份有限公司 | Road monitoring method, device and system |
| CN102368353A (en) * | 2011-10-10 | 2012-03-07 | 中盟智能科技（苏州）有限公司 | Traffic illegal line-cross evidence obtaining method and device |
| CN102880692A (en) * | 2012-09-19 | 2013-01-16 | 上海交通大学 | Retrieval-oriented monitoring video semantic description and inspection modeling method |
| CN103021186A (en) * | 2012-12-28 | 2013-04-03 | 中国科学技术大学 | Vehicle monitoring method and vehicle monitoring system |
| CN103208183A (en) * | 2013-04-03 | 2013-07-17 | 昆明联诚科技有限公司 | Vehicle video data mining method for traffic violation evidence obtaining |
| CN103366569A (en) * | 2013-06-26 | 2013-10-23 | 东南大学 | Method and system for snapshotting traffic violation vehicle in real time |
| CN103473926A (en) * | 2013-09-11 | 2013-12-25 | 无锡加视诚智能科技有限公司 | Gun-ball linkage road traffic parameter collection and rule breaking snapshooting system |
| CN104658261A (en) * | 2013-11-23 | 2015-05-27 | 安徽蓝盾光电子股份有限公司 | Detection and monitoring system of cart lane occupation on expressway |
| CN104680794A (en) * | 2015-02-13 | 2015-06-03 | 深圳市图敏实业有限公司 | Vehicle-mounted monitoring terminal as well as bus lane monitoring method and system based on terminal |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107358170A (en) * | 2017-06-21 | 2017-11-17 | 华南理工大学 | A kind of vehicle peccancy line ball recognition methods based on mobile machine vision |
| CN107358170B (en) * | 2017-06-21 | 2021-01-19 | 华南理工大学 | Vehicle violation line pressing identification method based on mobile machine vision |
| CN110178167A (en) * | 2018-06-27 | 2019-08-27 | 潍坊学院 | Crossing video frequency identifying method violating the regulations based on video camera collaboration relay |
| CN110178167B (en) * | 2018-06-27 | 2022-06-21 | 潍坊学院 | Intersection violation video identification method based on cooperative relay of cameras |
| CN109063612A (en) * | 2018-07-19 | 2018-12-21 | 中智城信息技术有限公司 | City intelligent red line management method and machine readable storage medium |
| CN109740424A (en) * | 2018-11-23 | 2019-05-10 | 深圳市华尊科技股份有限公司 | Traffic violations recognition methods and Related product |
| CN109598943A (en) * | 2018-12-30 | 2019-04-09 | 北京旷视科技有限公司 | The monitoring method of vehicle violation, apparatus and system |
| CN110717433A (en) * | 2019-09-30 | 2020-01-21 | 华中科技大学 | Deep learning-based traffic violation analysis method and device |
| CN111439259A (en) * | 2020-03-23 | 2020-07-24 | 成都睿芯行科技有限公司 | Agricultural garden scene lane deviation early warning control method and system based on end-to-end convolutional neural network |
| CN112581776A (en) * | 2020-12-09 | 2021-03-30 | 张兴莉 | Intelligent traffic scheduling method and device and scheduling center |
| CN114170798A (en) * | 2021-12-03 | 2022-03-11 | 智道网联科技(北京)有限公司 | Message reminding system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106412508A (en) | Intelligent monitoring method and system of illegal line press of vehicles | |
| US20200160699A1 (en) | Multiple exposure event determination | |
| TWI430212B (en) | Abnormal behavior detection system and method using automatic classification of multiple features | |
| CN105574543B (en) | A kind of vehicle brand type identifier method and system based on deep learning | |
| Wu et al. | Automated safety diagnosis based on unmanned aerial vehicle video and deep learning algorithm | |
| Zyner et al. | ACFR five roundabouts dataset: Naturalistic driving at unsignalized intersections | |
| Wang et al. | Advanced driver‐assistance system (ADAS) for intelligent transportation based on the recognition of traffic cones | |
| CN105448105A (en) | Patrol police vehicle-based monitoring system | |
| CN106446856A (en) | Vehicle lane-occupation driving intelligent monitoring method and system | |
| CN109872541A (en) | A kind of information of vehicles analysis method and device | |
| CN106504542A (en) | Speed intelligent monitoring method and system | |
| Staino et al. | Real-time detection and recognition of railway traffic signals using deep learning | |
| Zheng | Developing a traffic safety diagnostics system for unmanned aerial vehicles usingdeep learning algorithms | |
| Zhang | Multi-object trajectory extraction based on YOLOv3-DeepSort for pedestrian-vehicle interaction behavior analysis at non-signalized intersections | |
| CN114693722B (en) | Vehicle driving behavior detection method, detection device and detection equipment | |
| CN116580551A (en) | Vehicle driving behavior evaluation method, device, equipment and storage medium | |
| Zaki et al. | Comprehensive safety diagnosis using automated video analysis: Applications to an urban intersection in Edmonton, Alberta, Canada | |
| CN113538968B (en) | Method and apparatus for outputting information | |
| CN106354883A (en) | Method and system for video information structure organization | |
| CN115394089A (en) | Vehicle information fusion display method, sensorless passing system and storage medium | |
| Khalid et al. | An Android Application for Unwanted Vehicle Detection and Counting | |
| CN110956072B (en) | Driving skill training method based on big data analysis | |
| Huang et al. | A novel method to perceive self-vehicle state based on vehicle video by image similarity calculation | |
| CN112861701A (en) | Illegal parking identification method and device, electronic equipment and computer readable medium | |
| Venkatesh et al. | An intelligent traffic management system based on the Internet of Things for detecting rule violations |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20171207 Address after: 519000 Guangdong city of Zhuhai province Hengqin Baohua Road No. 6, room 105, -23898 (central office) Applicant after: Zhongxing Technology Co., Ltd. Address before: 100083 Haidian District, Xueyuan Road, No. 35, the world building, the second floor of the building on the ground floor, No. 16 Applicant before: Beijing Vimicro Corporation |
|
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 519031 Guangdong city of Zhuhai province Hengqin Baohua Road No. 6, room 105, -23898 (central office) Applicant after: Mid Star Technology Limited by Share Ltd Address before: 519000 Guangdong city of Zhuhai province Hengqin Baohua Road No. 6, room 105, -23898 (central office) Applicant before: Zhongxing Technology Co., Ltd. |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170215 |