CN108765955B - Intelligent automobile state detection sharing method and system based on license plate recognition - Google Patents

Intelligent automobile state detection sharing method and system based on license plate recognition Download PDF

Info

Publication number
CN108765955B
CN108765955B CN201810605473.2A CN201810605473A CN108765955B CN 108765955 B CN108765955 B CN 108765955B CN 201810605473 A CN201810605473 A CN 201810605473A CN 108765955 B CN108765955 B CN 108765955B
Authority
CN
China
Prior art keywords
automobile
image
license plate
real time
keeping
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810605473.2A
Other languages
Chinese (zh)
Other versions
CN108765955A (en
Inventor
周柳佳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou ainager Information Technology Co.,Ltd.
Original Assignee
Suzhou Ainager Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Ainager Information Technology Co ltd filed Critical Suzhou Ainager Information Technology Co ltd
Priority to CN201810605473.2A priority Critical patent/CN108765955B/en
Publication of CN108765955A publication Critical patent/CN108765955A/en
Application granted granted Critical
Publication of CN108765955B publication Critical patent/CN108765955B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • G08G1/0108Measuring and analyzing of parameters relative to traffic conditions based on the source of data
    • G08G1/0112Measuring and analyzing of parameters relative to traffic conditions based on the source of data from the vehicle, e.g. floating car data [FCD]
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/017Detecting movement of traffic to be counted or controlled identifying vehicles
    • G08G1/0175Detecting movement of traffic to be counted or controlled identifying vehicles by photographing vehicles, e.g. when violating traffic rules
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Traffic Control Systems (AREA)

Abstract

An intelligent automobile state detection method and system based on license plate recognition comprises the following steps: the processing device acquires vehicle speed information detected by the vehicle speed sensor in real time and analyzes whether the vehicle runs or not according to the vehicle speed information, if so, the processing device controls the first camera and the second camera to shoot images, the processing device analyzes whether the vehicle in front of and behind the vehicle turns left or not according to the images, if not, the processing device analyzes whether the vehicle in front of the vehicle turns right or not according to the images, if so, the processing device analyzes whether a brake lamp of the braked vehicle is lightened or not according to the images, if not, the processing device controls the license plate recognition system to extract license plate information of the vehicle with the brake and the brake lamp not lightened contained in the images and send the extracted license plate information and vehicle images to the fault receiving device, and the fault receiving device receives vehicle owner information stored by the vehicle management center and sends the fault information to a mobile terminal of a vehicle owner.

Description

Intelligent automobile state detection sharing method and system based on license plate recognition
Technical Field
The invention relates to the field of license plate recognition, in particular to an intelligent automobile state detection sharing method and system based on license plate recognition.
Background
A License Plate Recognition system (VLPR) is a technology capable of detecting cars on a monitored road surface and automatically extracting car License Plate information (including chinese characters, english letters, arabic numbers, and License Plate colors) for processing. License plate identification is one of important components in modern intelligent traffic systems, and is very widely applied. The method is based on technologies such as digital image processing, mode recognition and computer vision, and analyzes the automobile images or video sequences shot by the camera to obtain the unique license plate number of each automobile, thereby completing the recognition process. The functions of parking lot charging management, traffic flow control index measurement, automobile positioning, automobile anti-theft, highway overspeed automatic supervision, red light running electronic police, highway toll stations and the like can be realized through some subsequent processing means. The license plate recognition technology requires that the license plate in motion can be extracted and recognized from a complex background, the information of license plate number, color and the like of the automobile can be recognized through the technologies of license plate extraction, image preprocessing, feature extraction, license plate character recognition and the like, and the latest technology level at present is that the recognition rate of letters and numbers can reach 99.7%, and the recognition rate of Chinese characters can reach 99%.
However, how to combine the license plate recognition technology with the automobile, the corresponding lamp states of the front automobile and the rear automobile when the front automobile and the rear automobile turn right, turn left, change right and brake are captured in real time by the camera of the automobile, if the lamp has a problem, the license plate information and the image of the lamp having the problem are obtained, then the information of the automobile owner when the automobile owner is on the license plate is searched through the license plate information, the lamp problem and the image of the automobile problem are sent to the mobile terminal of the automobile owner, and meanwhile, the violation information of the front automobile and the rear automobile is detected in real time when the automobile runs, which is a problem that needs to be solved at present.
Disclosure of Invention
The purpose of the invention is as follows: in order to overcome the defects in the background art, the embodiment of the invention provides an intelligent automobile state detection method and system based on license plate recognition, which can effectively solve the problems related to the background art.
The technical scheme is as follows:
an intelligent automobile state detection method based on license plate recognition comprises the following steps:
s1, acquiring vehicle speed information detected by a vehicle speed sensor arranged at the internal position of the vehicle in real time by a processing device arranged at the internal position of the vehicle, and analyzing whether the vehicle keeping the connection relationship is in a driving state or not according to the acquired vehicle speed information;
s2, if yes, the processing device controls a first camera arranged on the surface position in front of the automobile to shoot a first image in real time and controls a second camera arranged on the surface position behind the automobile to shoot a second image in real time;
s3, the processing device analyzes whether the automobile running in front of the automobile keeping the connection relation performs left-turn or not in real time according to the first image captured in real time and analyzes whether the automobile running behind the automobile keeping the connection relation performs left-turn or not in real time according to the second image captured in real time;
s4, if not, the processing device analyzes whether the automobile running in front of the automobile keeping the connection relation carries out right turn or not in real time according to the first image shot in real time and analyzes whether the automobile running behind the automobile keeping the connection relation carries out right turn or not in real time according to the second image shot in real time;
s5, if not, the processing device analyzes whether the automobile running in front of the automobile keeping the connection relation is braked or not in real time according to the first image shot in real time;
s6, if yes, the processing device analyzes whether the brake lamp of the automobile running in front of the automobile keeping the connection relation and braking is in a lighting state or not in real time according to the first image shot in real time;
s7, if the license plate information does not exist, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which is contained in the first image and is braked and the brake lamp of which is not in the lighting state, and sends the extracted license plate information and the automobile image which is contained in the first image and is braked and the brake lamp of which is not in the lighting state to fault receiving equipment arranged in an automobile management center;
s8, if the fault receiving equipment arranged in the automobile management center receives the license plate information and the automobile image which is braked and the brake lamp is not in the lighting state, acquiring owner information which is stored in the automobile management center and is bound with the received license plate information and keeps the connection relation according to the received license plate information, binding the received license plate information and the automobile image which is braked and the brake lamp is not in the lighting state with the owner information to generate fault information, storing the fault information into a fault database which keeps the connection relation, and sending the generated fault information to a mobile terminal of an owner by the fault receiving equipment arranged in the automobile management center according to the acquired owner information.
As a preferred mode of the present invention, after S2, the method further includes the steps of:
s20, the processing device analyzes whether the automobile running in front of the automobile keeping the connection relation carries out left lane changing or not in real time according to the first image shot in real time and analyzes whether the automobile running behind the automobile keeping the connection relation carries out left lane changing or not in real time according to the second image shot in real time;
s21, if the processing device analyzes that the automobile driving in front of the automobile keeping the connection relation has the left lane change according to the first image shot in real time, the processing device analyzes whether the rear left turn lamp of the automobile driving in front of the automobile keeping the connection relation and having the left lane change is in a lighting and flickering state or not according to the first image shot in real time;
s22, if the number plate information is not available, the processing device controls the number plate recognition system keeping the connection relationship to extract the number plate information of the automobile which is contained in the first image and carries out left lane changing and the rear left turn lamp is not in the lighting and flashing state, and sends the extracted number plate information and the automobile image which is contained in the first image and carries out left lane changing and the rear left turn lamp is not in the lighting and flashing state to a fault receiving device arranged in an automobile management center;
s23, if the processing device analyzes that the automobile driving behind the automobile keeping the connection relation has the left lane changing according to the second image shot in real time, the processing device analyzes whether the front left turn lamp of the automobile driving behind the automobile keeping the connection relation and having the left lane changing is in a lighting and flickering state or not according to the second image shot in real time;
and S24, if not, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which is contained in the second image and carries out the left lane changing and the front left turn lamp is not in the lighting and flashing state, and sends the extracted license plate information and the automobile image which is contained in the second image and carries out the left lane changing and the front left turn lamp is not in the lighting and flashing state to the fault receiving equipment arranged in the automobile management center.
As a preferred mode of the present invention, after S2, the method further includes the steps of:
s25, the processing device analyzes whether the automobile running in front of the automobile keeping the connection relation carries out right lane changing or not in real time according to the first image shot in real time and analyzes whether the automobile running behind the automobile keeping the connection relation carries out right lane changing or not in real time according to the second image shot in real time;
s26, if the processing device analyzes that the automobile driving in front of the automobile keeping the connection relation has the right lane change according to the first image shot in real time, the processing device analyzes whether the rear right turn lamp of the automobile driving in front of the automobile keeping the connection relation and having the right lane change is in a lighting and flickering state or not according to the first image shot in real time;
s27, if the number plate information is not available, the processing device controls the number plate recognition system keeping the connection relationship to extract the number plate information of the automobile which is contained in the first image and carries out right lane changing and the rear right turn lamp is not in the lighting and flashing state, and sends the extracted number plate information and the automobile image which is contained in the first image and carries out right lane changing and the rear right turn lamp is not in the lighting and flashing state to a fault receiving device arranged in an automobile management center;
s28, if the processing device analyzes that the automobile driving behind the automobile keeping the connection relation has the right lane change according to the second image shot in real time, the processing device analyzes whether the front right turn lamp of the automobile driving behind the automobile keeping the connection relation and having the right lane change is in a lighting and flickering state or not according to the second image shot in real time;
and S29, if not, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which is contained in the second image and carries out right lane changing and the front right turn lamp is not in the lighting and flashing state, and sends the extracted license plate information and the automobile image which is contained in the second image and carries out right lane changing and the front right turn lamp is not in the lighting and flashing state to the fault receiving equipment arranged in the automobile management center.
As a preferred mode of the present invention, after S3, the method further includes the steps of:
s30, if the processing device analyzes that the automobile driving in front of the automobile keeping the connection relation has a left turn according to the first image captured in real time, the processing device analyzes whether the rear left turn lamp of the automobile driving in front of the automobile keeping the connection relation and having the left turn is in a lighting and flickering state or not according to the first image captured in real time;
s31, if the license plate information does not exist, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which is contained in the first image and carries out left-turning and the rear left-turning lamp is not in the lighting and flashing state, and sends the extracted license plate information and the automobile image which is contained in the first image and carries out left-turning and the rear left-turning lamp is not in the lighting and flashing state to fault receiving equipment arranged in an automobile management center;
s32, if the processing device analyzes that the automobile driving behind the automobile keeping the connection relation has a left turn according to the second image captured in real time, the processing device analyzes whether the front left turn lamp of the automobile driving behind the automobile keeping the connection relation and having the left turn is in a lighting and flickering state or not according to the second image captured in real time;
and S33, if the license plate information does not exist, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which turns left and the front turn-left lamp is not in the lighting and flashing state and is contained in the second image captured in real time, and the extracted license plate information and the automobile image which turns left and the front turn-left lamp is not in the lighting and flashing state and contained in the second image are sent to fault receiving equipment arranged in an automobile management center.
As a preferred mode of the present invention, after S4, the method further includes the steps of:
s40, if the processing device analyzes that the automobile driving in front of the automobile keeping the connection relation turns right according to the first image captured in real time, the processing device analyzes whether the rear right turn lamp of the automobile driving in front of the automobile keeping the connection relation and turning right is in a lighting and flickering state or not according to the first image captured in real time;
s41, if the license plate information does not exist, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which carries out right turning and has the rear right turning lamp not in the lighting and flashing state and is contained in the first image captured in real time, and sends the extracted license plate information and the automobile image which carries out right turning and has the rear right turning lamp not in the lighting and flashing state and is contained in the first image to fault receiving equipment arranged in an automobile management center;
s42, if the processing device analyzes that the automobile driving behind the automobile keeping the connection relation turns right according to the second image captured in real time, the processing device analyzes whether the front right turn lamp of the automobile driving behind the automobile keeping the connection relation and turning right is in a lighting and flickering state or not according to the second image captured in real time;
and S43, if not, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which turns right and the front right turn lamp is not in the lighting and flashing state and is contained in the second image captured in real time, and sends the extracted license plate information and the automobile image which turns right and the front right turn lamp is not in the lighting and flashing state and is contained in the second image to the fault receiving equipment arranged in the automobile management center.
As a preferable mode of the present invention, in S8, the method further includes the steps of:
s80, the fault receiving equipment arranged in the automobile management center binds the received license plate information and the automobile images and extracts the personnel images contained in the received automobile images in real time, and the fault receiving equipment arranged in the automobile management center matches the extracted personnel images with wanted images of an alarm center keeping a connection relation;
and S81, if the extracted personnel images analyzed by the fault receiving equipment arranged in the automobile management center are matched with the wanted image of the alarm center keeping the connection relationship, the fault receiving equipment arranged in the automobile management center sends the automobile images matched with the wanted image, the personnel images and the license plate information bound with the automobile images to the alarm center keeping the connection relationship.
As a preferred mode of the present invention, after S81, the method further includes the steps of:
s82, matching the automobile image and the personnel image matched with the wanted image and the license plate information bound with the automobile image with the monitoring image of the city monitoring center keeping the connection relation in real time by the fault receiving equipment arranged in the automobile management center;
and S83, if the fault receiving equipment arranged in the automobile management center analyzes that the automobile image and the personnel image which are matched with the wanted image and the monitoring image which is matched with the license plate information bound with the automobile image exist, the fault receiving equipment arranged in the automobile management center extracts the running route of the matched monitoring image and sends the matched monitoring image and the extracted running route of the monitoring image to the alarm center which keeps the connection relation.
As a preferable mode of the present invention, in S2, the method further includes the steps of:
s200, the processing device analyzes whether the automobile running in front of the automobile keeping the connection relationship violates the traffic rules in real time according to the first image captured in real time and analyzes whether the automobile running behind the automobile keeping the connection relationship violates the traffic rules in real time according to the second image captured in real time;
s201, if the processing device analyzes that a vehicle running in front of the vehicle keeping the connection relationship violates a traffic rule according to the first image captured in real time, the processing device controls a license plate recognition system keeping the connection relationship to extract license plate information of the vehicle violating the traffic rule contained in the first image captured in real time and sends the extracted license plate information and the vehicle violating image violating the traffic rule contained in the first image to a fault receiving device arranged in a vehicle management center;
s202, if the processing device analyzes that the automobile running behind the automobile keeping the connection relationship violates the traffic rules according to the second image captured in real time, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile violating the traffic rules contained in the second image captured in real time and sends the extracted license plate information and the automobile violating the traffic rules contained in the second image to fault receiving equipment arranged in an automobile management center.
As a preferred mode of the present invention, after S27, the method further includes the steps of:
s203, the fault receiving equipment arranged in the automobile management center receives the license plate information and the illegal automobile image violating the traffic rules, acquires owner information bound with the received license plate information and stored in the automobile management center keeping the connection relation according to the received license plate information, and binds the received license plate information and the illegal automobile image violating the traffic rules with the extracted owner information to generate illegal automobile information to be stored in an illegal automobile database keeping the connection relation;
and S204, the fault receiving equipment arranged in the automobile management center sends the generated illegal automobile information to the automobile management center keeping the connection relation.
An intelligent automobile state detection system based on license plate recognition comprises an automobile, a camera device, a processing device and a fault receiving device, wherein a license plate recognition system and a speed sensor are arranged in the automobile, and the license plate recognition system is used for recognizing license plate information contained in images shot by a first camera and a second camera; the vehicle speed sensor is used for acquiring vehicle speed information of the vehicle in real time, the camera device comprises a first camera and a second camera, and the first camera is provided with a plurality of cameras, is arranged at the front surface position of the vehicle and is used for shooting an environment image in front of the vehicle; the second cameras are arranged at the rear surface of the automobile and used for shooting images of the environment behind the automobile; processing apparatus sets up in the inside position of car and respectively with car, license plate identification system, first camera, second camera, trouble receiving equipment, warning center, car management center, first aid center, city monitoring center and network connection, processing apparatus includes:
the wireless device is used for being respectively connected with the fault receiving equipment, the alarm center, the automobile management center, the emergency center, the city monitoring center and the network;
the vehicle speed acquisition module is used for acquiring vehicle speed information detected in real time by a vehicle speed sensor which is in connection with the processing device;
the first analysis module is used for analyzing specified information and/or instructions and/or images and/or requests and acquiring analysis results;
the first camera module is used for controlling a first camera which is kept in a connection relation with the processing device to shoot a specified image;
the second camera module is used for controlling a second camera which is kept in a connection relation with the processing device to shoot a specified image;
the license plate recognition module is used for controlling a license plate recognition system which keeps a connection relation with the processing device to recognize and extract license plate information contained in the appointed image;
the first sending module is used for sending the specified information and/or instructions and/or images and/or requests to the specified object;
the first receiving module is used for receiving information and/or instructions and/or images and/or requests;
the fault receiving equipment is respectively connected with a processing device, an automobile management center, an alarm center, an emergency center and a city monitoring center, and comprises:
the second receiving module is used for receiving information and/or instructions and/or images and/or requests;
the vehicle owner acquisition module is used for acquiring vehicle owner information stored by a vehicle management center keeping the connection relation according to the specified information and/or the image;
the information binding module is used for binding the specified information and/or the images and/or the objects with at least one piece of specified information and/or images and/or objects;
the fault database is used for storing fault information;
the information storage module is used for storing the specified information and/or the images and/or the objects to a specified database;
the second sending module is used for sending the specified information and/or instructions and/or images and/or requests to the specified object;
the image extraction module is used for extracting personnel images contained in the appointed automobile image;
the wanted matching module is used for matching the images of the designated personnel with wanted images of the alarm center and acquiring a matching result;
the second analysis module is used for analyzing specified information and/or instructions and/or images and/or requests and acquiring analysis results;
the monitoring matching module is used for matching the specified image with the monitoring image of the city monitoring center and acquiring a matching result;
the violation database is used for storing violation automobile information;
and the information extraction module is used for extracting the specified information and/or instructions and/or images and/or the specified information contained in the request.
The invention realizes the following beneficial effects:
1. when the automobile runs, the processing device of the automobile analyzes the lamp state information of the front automobile and the rear automobile during turning, lane changing and braking of the automobile in real time through real-time images shot by the first camera and the second camera of the automobile, if the condition that the lamps are not lightened when the automobile is turned or the lane changing or the braking is analyzed, the license plate information of the automobile is extracted through the license plate recognition system, then the license plate information is sent to the fault receiving equipment, the fault receiving equipment extracts the automobile owner information corresponding to the license plate and sends the extracted automobile owner information and the automobile lamp fault image to the mobile terminal of the automobile owner so as to remind a driver of the automobile that the automobile lamp has a problem.
2. When the fault receiving equipment receives the license plate information and the automobile image, the personnel image in the automobile image is extracted and the extracted personnel image is matched with the wanted personnel image, and if the extracted personnel image is matched with the wanted personnel image, the automobile image driven by the wanted personnel image and the position of the wanted personnel image appearing in the monitoring image of the city monitoring center are sent to the alarm center.
3. When the automobile runs, the processing device of the automobile analyzes information of violation of traffic rules of a front automobile and a rear automobile of the automobile in real time through real-time images shot by the first camera and the second camera of the automobile, if the fact that the automobile violates is analyzed, license plate information of the violated automobile and an automobile violation image are sent to the fault receiving equipment, the fault receiving equipment extracts owner information corresponding to the license plate and sends the extracted owner information and the extracted automobile violation image to the automobile management center, and therefore the detection efficiency of the illegal vehicles on the road is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
FIG. 1 is a flow chart of a method for detecting and processing brake lights during braking of a vehicle according to one embodiment of the present invention;
FIG. 2 is a flow chart of a left turn signal detection method during a left lane change of a vehicle according to an exemplary embodiment of the present invention;
FIG. 3 is a flow chart of a method for detecting a turn signal during a lane change on the right side of a vehicle according to an exemplary embodiment of the present invention;
FIG. 4 is a flowchart of a left turn light detection method for a left turn of a vehicle according to one embodiment of the present invention;
FIG. 5 is a flow chart of a method for detecting a turn signal when a vehicle turns right according to an exemplary embodiment of the present invention;
FIG. 6 is a flow chart of a wanted person and car detection method according to an example of the present invention;
FIG. 7 is a flow chart of a wanted person and car tracking method provided by one example of the present invention;
FIG. 8 is a flow chart of a vehicle violation detection method provided by one example of the present invention;
FIG. 9 is a flow chart of a vehicle violation handling method provided by one example of the present invention;
fig. 10 is a connection diagram of an intelligent vehicle state detection system according to an example of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
Example one
Referring to fig. 1-5 and 10, fig. 1 is a flow chart illustrating a method for detecting and processing a brake light during braking of a vehicle according to an exemplary embodiment of the present invention; FIG. 2 is a flow chart of a left turn signal detection method during a left lane change of a vehicle according to an exemplary embodiment of the present invention; FIG. 3 is a flow chart of a method for detecting a turn signal during a lane change on the right side of a vehicle according to an exemplary embodiment of the present invention; FIG. 4 is a flowchart of a left turn light detection method for a left turn of a vehicle according to one embodiment of the present invention; FIG. 5 is a flow chart of a method for detecting a turn signal when a vehicle turns right according to an exemplary embodiment of the present invention; fig. 10 is a connection diagram of an intelligent vehicle state detection system according to an example of the present invention.
Specifically, the embodiment provides an intelligent automobile state detection method based on license plate recognition, and the method comprises the following steps:
s1, the processing device 3 arranged at the internal position of the automobile 1 acquires the real-time detected speed information of the speed sensor 11 arranged at the internal position of the automobile 1 and analyzes whether the automobile 1 keeping the connection relation is in a running state or not according to the acquired speed information;
s2, if yes, the processing device 3 controls the first camera 20 arranged at the front surface position of the automobile 1 to capture the first image in real time and controls the second camera 21 arranged at the rear surface position of the automobile 1 to capture the second image in real time;
s3, the processing device 3 analyzes whether the automobile 1 running in front of the automobile 1 keeping the connection relation performs left-turn or not in real time according to the first image captured in real time and analyzes whether the automobile 1 running behind the automobile 1 keeping the connection relation performs left-turn or not in real time according to the second image captured in real time;
s4, if not, the processing device 3 analyzes in real time whether the automobile 1 running in front of the automobile 1 keeping the connection relation performs right turning according to the first image captured in real time and analyzes in real time whether the automobile 1 running behind the automobile 1 keeping the connection relation performs right turning according to the second image captured in real time;
s5, if not, the processing device 3 analyzes whether the automobile 1 running in front of the automobile 1 keeping the connection relation is braked or not in real time according to the first image shot in real time;
s6, if yes, the processing device 3 analyzes in real time whether the brake lights of the automobile 1 running ahead and braking in the connection relationship are on or not according to the first image captured in real time;
s7, if the license plate information does not exist, the processing device 3 controls the license plate recognition system 10 keeping the connection relationship to extract the license plate information of the automobile 1 which is contained in the first image and is braked and the brake lamp of which is not in the lighting state and shot in real time, and sends the extracted license plate information and the image of the automobile 1 which is contained in the first image and is braked and the brake lamp of which is not in the lighting state to the fault receiving equipment 4 arranged in the management center of the automobile 1;
s8, if the fault receiving equipment 4 arranged in the automobile 1 management center receives the license plate information and the automobile 1 image which is braked and the brake lamp is not in the lighting state, acquiring owner information which is stored in the automobile 1 management center and is in the connection relation with the received license plate information according to the received license plate information, binding the received license plate information and the automobile 1 image which is braked and the brake lamp is not in the lighting state with the owner information to generate fault information, storing the fault information into the fault database 43 in the connection relation, and sending the generated fault information to the mobile terminal of an owner by the fault receiving equipment 4 arranged in the automobile 1 management center according to the acquired owner information.
Specifically, in S1, the vehicle speed obtaining module 31 in the processing device 3 disposed in the internal position of the vehicle 1 obtains the vehicle speed information detected by the vehicle speed sensor 11 disposed in the internal position of the vehicle 1 in real time, and after the vehicle speed obtaining module 31 obtains the vehicle speed information, the first analyzing module 32 in the processing device 3 disposed in the internal position of the vehicle 1 analyzes whether the vehicle 1 maintaining the connection relationship is in the driving state according to the obtained vehicle speed information, that is, analyzes whether the obtained vehicle speed is greater than 0 km/h.
In S2, specifically, after the first analysis module 32 analyzes that the vehicle 1 connected to the processing device 3 is in a driving state, the first camera module 33 inside the processing device 3 controls the first camera 20 disposed on the front surface of the vehicle 1 to capture a first image in real time, and the second camera module 34 inside the processing device 3 controls the second camera 21 disposed on the rear surface of the vehicle 1 to capture a second image in real time, that is, the first camera 20 and the second camera 21 enter a real-time monitoring state while the vehicle 1 is driving.
At S3, specifically, after the first camera 20 and the second camera 21 are activated, the first analysis module 32 inside the processing device 3 analyzes in real time whether the automobile 1 running ahead of the automobile 1 maintaining the connection relationship turns left or not based on the first image captured in real time, and the first analysis module 32 inside the processing device 3 analyzes in real time whether the automobile 1 running behind the automobile 1 maintaining the connection relationship turns left or not based on the second image captured in real time, that is, whether the front and rear automobiles 1 currently located turn left or not is analyzed in real time.
At S4, specifically, after the first analysis module 32 analyzes that neither the front vehicle nor the rear vehicle of the current vehicle 1 makes a left turn, the first analysis module 32 inside the processing device 3 analyzes in real time whether the vehicle 1 running ahead of the vehicle 1 that maintains the connection relationship makes a right turn according to the first image captured in real time, and at the same time, the first analysis module 32 inside the processing device 3 analyzes in real time whether the vehicle 1 running behind the vehicle 1 that maintains the connection relationship makes a right turn according to the second image captured in real time, that is, whether the front vehicle and the rear vehicle of the current vehicle 1 make a right turn or not is analyzed in real time.
In S5, specifically, after the first analysis module 32 analyzes that neither the front vehicle nor the rear vehicle of the current vehicle 1 makes a right turn, the first analysis module 32 in the processing device 3 analyzes in real time whether the vehicle 1 running ahead of the vehicle 1 that maintains the connection relationship is braked, that is, whether the front vehicle of the current vehicle 1 decelerates and/or stops, according to the first image captured in real time.
In S6, specifically, after the first analysis module 32 analyzes that the vehicle ahead of the current vehicle 1 decelerates and/or stops, the first analysis module 32 in the processing device 3 analyzes in real time according to the first image captured in real time whether the brake lights of the vehicle 1 that runs ahead of the vehicle 1 and brakes while maintaining the connection relationship are turned on, that is, whether the brake lights of the vehicle ahead of the current vehicle 1 are turned on when the vehicle decelerates and/or stops.
In S7, specifically after the first analysis module 32 analyzes that the brake lamp is not turned on when the front vehicle of the currently located automobile 1 decelerates and/or stops, the license plate recognition module 35 in the processing device 3 controls the license plate recognition system 10 keeping the connection relationship to extract the license plate information of the automobile 1 which is in the real-time captured first image and is braked and the brake lamp of which is not in the lighting state, after the license plate information is extracted by the license plate recognition module 35, a first sending module 36 in the processing device 3 sends the extracted license plate information and the image of the vehicle 1 which is contained in the first image and is braked and the brake lamp of which is not in the lighting state to a fault receiving device 4 arranged in a management center of the vehicle 1, the license plate number of the automobile 1 with the lamp problem and the image of the automobile 1 during braking are sent to the fault receiving equipment 4.
In S8, specifically, after the second receiving module 40 in the fault receiving device 4 of the vehicle 1 management center receives the license plate information and the image of the vehicle 1 that is braked and the brake lamp is not in the lighting state, the vehicle owner obtaining module 41 in the fault receiving device 4 of the vehicle 1 management center obtains the vehicle owner information bound with the received license plate information, which is stored in the vehicle 1 management center maintaining the connection relationship according to the received license plate information (the vehicle owner information refers to the information contained in the registration information submitted when the license plate is registered), after the vehicle owner obtaining module 41 obtains the vehicle owner information, the information binding module 42 in the fault receiving device 4 of the vehicle 1 management center binds the received license plate information and the image of the vehicle 1 that is braked and the brake lamp is not in the lighting state with the vehicle owner information obtained by the vehicle owner obtaining module 41 to generate the fault information, after the information binding module 42 finishes binding and generates fault information, the information storage module 44 arranged inside the fault receiving device 4 of the management center of the automobile 1 stores the fault information generated by the information binding module 42 to the current date position in the fault database 43 maintaining the connection relation, and meanwhile, the second sending module 45 arranged inside the fault receiving device 4 of the management center of the automobile 1 sends the generated fault information to the mobile terminal of the automobile owner according to the acquired information of the automobile owner so as to remind the driver of the automobile 1 who has a problem with a brake lamp to cause the problem with the automobile 1.
As a preferred mode of the present invention, after S2, the method further includes the steps of:
s20, the processing device 3 analyzes in real time whether the automobile 1 running in front of the automobile 1 keeping the connection relation carries out left lane changing according to the first image shot in real time and analyzes in real time whether the automobile 1 running behind the automobile 1 keeping the connection relation carries out left lane changing according to the second image shot in real time;
s21, if the processing device 3 analyzes that the automobile 1 driving in front of the automobile 1 keeping the connection relation has the left lane change according to the first image captured in real time, the processing device 3 analyzes in real time whether the rear left turn light of the automobile 1 driving in front of the automobile 1 keeping the connection relation and having the left lane change is in the flashing state according to the first image captured in real time;
s22, if the image is not available, the processing device 3 controls the license plate recognition system 10 keeping the connection relationship to extract the license plate information of the automobile 1 which is contained in the first image and carries out left lane changing and the rear left turn lamp is not in the lighting and flashing state, and sends the extracted license plate information and the image of the automobile 1 which is contained in the first image and carries out left lane changing and the rear left turn lamp is not in the lighting and flashing state to the fault receiving device 4 arranged in the automobile 1 management center;
s23, if the processing device 3 analyzes that the automobile 1 running behind the automobile 1 keeping the connection relationship has the left lane change according to the second image captured in real time, the processing device 3 analyzes in real time whether the front left turn light of the automobile 1 running behind the automobile 1 keeping the connection relationship and having the left lane change is in the flashing state according to the second image captured in real time;
and S24, if the image is not available, the processing device 3 controls the license plate recognition system 10 keeping the connection relationship to extract the license plate information of the automobile 1 which is contained in the second image and carries out the left lane change and the front left turn lamp is not in the lighting and flashing state, and sends the extracted license plate information and the image of the automobile 1 which is contained in the second image and carries out the left lane change and the front left turn lamp is not in the lighting and flashing state to the fault receiving device 4 arranged in the automobile 1 management center.
As a preferred mode of the present invention, after S2, the method further includes the steps of:
s25, the processing device 3 analyzes in real time whether the automobile 1 running in front of the automobile 1 keeping the connection relation carries out right lane changing according to the first image shot in real time and analyzes in real time whether the automobile 1 running behind the automobile 1 keeping the connection relation carries out right lane changing according to the second image shot in real time;
s26, if the processing device 3 analyzes that the automobile 1 running ahead of the automobile 1 with the connection relationship performs right lane changing according to the first image captured in real time, the processing device 3 analyzes in real time whether the rear right turn light of the automobile 1 running ahead of the automobile 1 with the connection relationship and performing right lane changing is in a flashing state according to the first image captured in real time;
s27, if the image is not available, the processing device 3 controls the license plate recognition system 10 keeping the connection relationship to extract the license plate information of the automobile 1 which is contained in the first image and shot in real time, carries out right lane changing and is not in the lightening and flashing state of the rear right turn lamp, and sends the extracted license plate information and the image of the automobile 1 which is contained in the first image, carries out right lane changing and is not in the lightening and flashing state of the rear right turn lamp to the fault receiving equipment 4 arranged in the automobile 1 management center;
s28, if the processing device 3 analyzes that the automobile 1 running behind the automobile 1 keeping the connection relation has the right lane change according to the second image captured in real time, the processing device 3 analyzes in real time whether the front right turn light of the automobile 1 running behind the automobile 1 keeping the connection relation and having the right lane change is in the flashing state according to the second image captured in real time;
and S29, if the image is not available, the processing device 3 controls the license plate recognition system 10 keeping the connection relationship to extract the license plate information of the automobile 1 which is contained in the second image shot in real time and carries out right lane changing and the front right turn lamp is not in the lighting and flashing state, and sends the extracted license plate information and the image of the automobile 1 which is contained in the second image and carries out right lane changing and the front right turn lamp is not in the lighting and flashing state to the fault receiving equipment 4 arranged in the automobile 1 management center.
The first image shot in real time refers to a first image shot in real time according to a first camera 20 arranged at a front surface position of the automobile 1; the second image captured in real time is a second image captured in real time by the second camera 21 disposed at the rear surface of the automobile 1.
As a preferred mode of the present invention, after S3, the method further includes the steps of:
s30, if the processing device 3 analyzes that the automobile 1 running ahead of the automobile 1 with the connection relationship is left-turned according to the first image captured in real time, the processing device 3 analyzes in real time whether the rear left turn light of the automobile 1 running ahead of the automobile 1 with the connection relationship and left-turned according to the first image captured in real time is in a flashing state;
s31, if the license plate information does not exist, the processing device 3 controls the license plate recognition system 10 keeping the connection relationship to extract the license plate information of the automobile 1 which is included in the first image and is subjected to left-turning and the rear left-turning lamp is not in the lighting and flashing state, and sends the extracted license plate information and the image of the automobile 1 which is included in the first image and is subjected to left-turning and the rear left-turning lamp is not in the lighting and flashing state to the fault receiving equipment 4 arranged in the automobile 1 management center;
s32, if the processing device 3 analyzes that the automobile 1 running behind the automobile 1 keeping the connection relationship has a left turn according to the second image captured in real time, the processing device 3 analyzes in real time whether the front left turn light of the automobile 1 running behind the automobile 1 keeping the connection relationship and making a left turn is in a flashing state or not according to the second image captured in real time;
and S33, if the license plate information does not exist, the processing device 3 controls the license plate recognition system 10 keeping the connection relation to extract the license plate information of the automobile 1 which turns left and the front turn-left lamp of which is not in the lighting and flashing state and is contained in the second image shot in real time, and sends the extracted license plate information and the image of the automobile 1 which turns left and the front turn-left lamp of which is not in the lighting and flashing state and is contained in the second image to the fault receiving equipment 4 arranged in the automobile 1 management center.
As a preferred mode of the present invention, after S4, the method further includes the steps of:
s40, if the processing device 3 analyzes that the automobile 1 running ahead of the automobile 1 with the connection relationship is turned right according to the first image captured in real time, the processing device 3 analyzes in real time whether the rear right turn light of the automobile 1 running ahead of the automobile 1 with the connection relationship and turning right is in the flashing state according to the first image captured in real time;
s41, if the license plate information does not exist, the processing device 3 controls the license plate recognition system 10 keeping the connection relationship to extract the license plate information of the automobile 1 which is contained in the first image and is subjected to right-turning and the rear right-turning lamp is not in the lighting and flashing state, and sends the extracted license plate information and the image of the automobile 1 which is contained in the first image and is subjected to right-turning and the rear right-turning lamp is not in the lighting and flashing state to the fault receiving equipment 4 arranged in the automobile 1 management center;
s42, if the processing device 3 analyzes that the automobile 1 running behind the automobile 1 keeping the connection relation turns right according to the second image captured in real time, the processing device 3 analyzes whether the front right turn light of the automobile 1 running behind the automobile 1 keeping the connection relation and turning right is in the flashing state or not according to the second image captured in real time;
and S43, if the license plate information does not exist, the processing device 3 controls the license plate recognition system 10 keeping the connection relation to extract the license plate information of the automobile 1 which turns right and the front right turn lamp of which is not in the lighting and flashing state and is contained in the second image shot in real time, and sends the extracted license plate information and the image of the automobile 1 which turns right and the front right turn lamp of which is not in the lighting and flashing state and is contained in the second image to the fault receiving equipment 4 arranged in the automobile 1 management center.
Specifically, after the first camera 20 and the second camera 21 are started and the first analysis module 32 inside the processing device 3 analyzes in real time whether the automobile 1 running in front of the automobile 1 keeping the connection relationship performs left lane changing or left turning (or right lane changing or right turning) according to the first image captured in real time and the first analysis module 32 inside the processing device 3 analyzes in real time whether the automobile 1 running behind the automobile 1 keeping the connection relationship performs left lane changing or left turning (or right lane changing or right turning) according to the second image captured in real time, if the first analysis module 32 inside the processing device 3 analyzes that the automobile 1 running in front of the automobile 1 keeping the connection relationship performs left lane changing or left turning (or right lane changing or right turning) according to the first image captured in real time, the first analysis module 32 inside the processing device 3 analyzes in real time the automobile 1 keeping the connection relationship according to the first image captured in real time Whether a rear left turn light (or a rear right turn light) of an automobile 1 which runs ahead 1 and performs left lane change or left turn (or right lane change or right turn) is in a lighting flickering state or not, if the first analysis module 32 analyzes that the rear left turn light (or the rear right turn light) of the automobile 1 which runs ahead 1 and performs left lane change or left turn (or right lane change or right turn) is not in the lighting flickering state or not, the license plate recognition module 35 inside the processing device 3 controls the license plate recognition system 10 which maintains the connection relationship to extract the license plate information of the automobile 1 which performs left lane change or left turn (or right lane change or right turn) and does not perform lighting flickering state and is included in a first image captured in real time, after the license plate recognition module 35 extracts the license plate information, the first sending module 36 inside the processing device 3 extracts the license plate information and the license plate information included in the first image The image of the automobile 1 which is changed into a left lane or a left turn (or changed into a right lane or a right turn) on the left and the rear left turn lamp (or the rear right turn lamp) is not in a lighting and flickering state is sent to a fault receiving device 4 arranged in the management center of the automobile 1; if the first analysis module 32 analyzes that the car 1 running behind the car 1 maintaining the connection relationship has a left lane change or a left turn (or a right lane change or a right turn) according to the second image captured in real time, the first analysis module 32 in the processing device 3 analyzes whether the front left turn light (or the front right turn light) of the car 1 running behind the car 1 maintaining the connection relationship and having a left lane change or a left turn (or a right lane change or a right turn) is in an on-flashing state or not according to the second image captured in real time, and if the first analysis module 32 analyzes that the front left turn light (or the front right turn light) of the car 1 running behind the car 1 maintaining the connection relationship and having a left lane change or a left turn (or a right lane change or a right turn) is not in an on-flashing state, the license plate recognition module 35 in the processing device 3 controls the license plate recognition system 10 maintaining the connection relationship to extract the real-time captured second image including the license plate recognition system 10 maintaining the connection relationship Carry out the license plate information of car 1 that left lane change or left turn (or right lane change or right turn) and preceding turn left lamp (or preceding turn right lamp) are not in the scintillation state of lighting, after license plate recognition module 35 extracted the completion license plate information, the inside first sending module 36 of processing apparatus 3 with carry out left lane change (or left turn (or right lane change or right turn) and preceding turn left lamp (or preceding turn right lamp) and be not in the car 1 image of the scintillation state of lighting who carries out that contains in license plate information and the second image of extraction and set up in the trouble receiving equipment 4 of car 1 management center, avoid the driver of preceding car and/or back car when carrying out the lane change about the turn left lamp go wrong and not discover to cause the accident.
Example two
Referring to fig. 6-7, fig. 10 shows a flow chart of a wanted person and car detection method provided by an example of the present invention in fig. 6; fig. 7 is a flowchart of a wanted person and car tracking method according to an example of the present invention.
Specifically, this embodiment is substantially the same as the first embodiment, except that in S8, the method further includes the following steps:
s80, the fault receiving equipment 4 arranged in the automobile 1 management center binds the received license plate information and the automobile 1 image and extracts the personnel image contained in the received automobile 1 image in real time, and the fault receiving equipment 4 arranged in the automobile 1 management center matches the extracted personnel image with the wanted image of the alarm center keeping the connection relation;
and S81, if the extracted personnel images analyzed by the fault receiving equipment 4 arranged in the automobile 1 management center are matched with the wanted image of the alarm center keeping the connection relationship, the fault receiving equipment 4 arranged in the automobile 1 management center sends the automobile 1 images matched with the wanted image, the personnel images and the license plate information bound with the automobile 1 images to the alarm center keeping the connection relationship.
As a preferred mode of the present invention, after S81, the method further includes the steps of:
s82, matching the automobile 1 image matched with the wanted image, the personnel image and the license plate information bound with the automobile 1 image with the monitoring image of the city monitoring center keeping the connection relation in real time by the fault receiving equipment 4 arranged in the automobile 1 management center;
and S83, if the fault receiving equipment 4 arranged in the automobile 1 management center analyzes that the automobile 1 image matched with the wanted image, the personnel image and the monitoring automobile 1 image matched with the license plate information bound with the automobile 1 image exist, the fault receiving equipment 4 arranged in the automobile 1 management center extracts the running route of the matched monitoring automobile 1 image and sends the matched monitoring automobile 1 image and the extracted running route of the monitoring automobile 1 image to the alarm center keeping the connection relation.
Specifically, after the second receiving module 40 arranged inside the fault receiving device 4 of the automobile 1 management center receives the license plate information and the automobile 1 image, the information binding module 42 arranged inside the fault receiving device 4 of the automobile 1 management center binds the received license plate information and the automobile 1 image, the image extracting module 46 arranged inside the fault receiving device 4 of the automobile 1 management center extracts the personnel image contained in the received automobile 1 image in real time, after the image extracting module 46 extracts the personnel image, the wanted matching module 47 arranged inside the fault receiving device 4 of the automobile 1 management center matches the extracted personnel image with the wanted image of the alarm center keeping the connection relationship, that is, whether the personnel image contained in the received automobile 1 image is compared with the wanted image published by the alarm center to more than 90% is analyzed, if the second analysis module 48 arranged inside the fault receiving device 4 of the automobile 1 management center analyzes that the extracted personnel image has the wanted image identity degree of the alarm center keeping the connection relation to reach more than 90% according to the matching information, the second sending module 45 arranged inside the fault receiving device 4 of the automobile 1 management center sends the automobile 1 image, the personnel image and the license plate information bound with the automobile 1 image which are matched with the wanted image to the alarm center keeping the connection relation, after the second sending module 45 sends the automobile 1 image, the personnel image and the license plate information bound with the automobile 1 image which are matched with the wanted image to the alarm center keeping the connection relation, the monitoring matching module 49 arranged inside the fault receiving device 4 of the automobile 1 management center sends the automobile 1 image, which is matched with the wanted image, to the alarm center keeping the connection relation, The personnel images and the license plate information bound with the automobile 1 images are matched with the monitoring images of the city monitoring center keeping the connection relation in real time to obtain all the appearance points of the automobile 1 and the human body which are consistent with the automobile 1 images, the personnel images and the license plate information bound with the automobile 1 images in the monitoring range of the city monitoring center, if the second analysis module 48 arranged in the fault receiving equipment 4 of the automobile 1 management center analyzes the automobile 1 images and the personnel images which are matched with the wanted images and the monitoring automobile 1 images which are matched with the license plate information bound with the automobile 1 images and obtains all the appearance points, all the appearance points are connected to generate the driving route of the monitoring automobile 1 images, the information extraction module 51 arranged in the fault receiving equipment 4 of the automobile 1 management center extracts the generated driving route of the matched monitoring automobile 1 images, after the information extraction module 51 extracts the driving route, the second sending module 45 disposed inside the fault receiving device 4 of the automobile 1 management center sends the matched monitoring automobile 1 image and the extracted driving route of the monitoring automobile 1 image to the alarm center maintaining the connection relationship.
EXAMPLE III
Referring to fig. 8-10, fig. 8 is a flow chart of a vehicle violation detection method according to an example of the invention; fig. 9 is a flowchart of a vehicle violation processing method according to an example of the present invention.
Specifically, this embodiment is substantially the same as the first embodiment, except that in S2, the method further includes the following steps:
s200, the processing device 3 analyzes whether the automobile 1 running in front of the automobile 1 keeping the connection relation violates the traffic rules in real time according to the first image shot in real time and analyzes whether the automobile 1 running behind the automobile 1 keeping the connection relation violates the traffic rules in real time according to the second image shot in real time;
s201, if the processing device 3 analyzes that the automobile 1 running in front of the automobile 1 keeping the connection relationship violates the traffic rules according to the first image captured in real time, the processing device 3 controls the license plate recognition system 10 keeping the connection relationship to extract the license plate information of the automobile 1 violating the traffic rules contained in the first image captured in real time and sends the extracted license plate information and the illegal image of the automobile 1 violating the traffic rules contained in the first image to the fault receiving equipment 4 arranged in the management center of the automobile 1;
s202, if the processing device 3 analyzes that the automobile 1 running behind the automobile 1 keeping the connection relationship violates the traffic rules according to the second image captured in real time, the processing device 3 controls the license plate recognition system 10 keeping the connection relationship to extract the license plate information of the automobile 1 violating the traffic rules contained in the second image captured in real time and sends the extracted license plate information and the automobile 1 violating the traffic rules contained in the second image to the fault receiving device 4 arranged in the management center of the automobile 1.
As a preferred mode of the present invention, after S27, the method further includes the steps of:
s203, the fault receiving equipment 4 arranged in the automobile 1 management center receives the license plate information and the illegal image of the automobile 1 violating the traffic rules, acquires owner information which is stored in the automobile 1 management center and is bound with the received license plate information and keeps the connection relation according to the received license plate information, and binds the received license plate information and the illegal image of the automobile 1 violating the traffic rules with the extracted owner information to generate illegal automobile 1 information which is stored in the illegal database 50 keeping the connection relation;
and S204, the fault receiving equipment 4 arranged in the automobile 1 management center sends the generated illegal automobile 1 information to the automobile 1 management center keeping the connection relation.
Specifically, after the first camera 20 and the second camera 21 are started, the first analysis module 32 inside the processing device 3 analyzes in real time whether the automobile 1 running ahead of the automobile 1 keeping the connection relationship violates the traffic rules according to the first image captured in real time, meanwhile, the first analysis module 32 inside the processing device 3 analyzes in real time whether the automobile 1 running behind the automobile 1 keeping the connection relationship violates the traffic rules according to the second image captured in real time, if the first analysis module 32 analyzes that the automobile ahead of the automobile 1 keeping the connection relationship violates the traffic rules according to the first image, the license plate recognition module 35 inside the processing device 3 controls the license plate recognition system 10 keeping the connection relationship to extract the license plate information of the automobile 1 violating the traffic rules contained in the first image captured in real time, and after the license plate recognition system 10 extracts the license plate information of the automobile 1 violating the traffic rules, a first sending module 36 in the processing device 3 sends the extracted license plate information and the violation images of the traffic rules contained in the first images to a fault receiving device 4 arranged in a management center of the automobile 1; if the first analysis module 32 analyzes that the rear vehicle of the vehicle 1 maintaining the connection relationship violates the traffic rules according to the second image, the license plate recognition module 35 in the processing device 3 controls the license plate recognition system 10 maintaining the connection relationship to extract the license plate information of the vehicle 1 violating the traffic rules, which is included in the second image captured in real time, and after the license plate recognition system 10 extracts the license plate information of the vehicle 1 violating the traffic rules, the first sending module 36 in the processing device 3 sends the extracted license plate information and the vehicle 1 violating the traffic rules, which is included in the second image, to the fault receiving device 4 arranged in the management center of the vehicle 1; after the second receiving module 40 arranged in the fault receiving device 4 of the automobile 1 management center receives the license plate information and the illegal image of the automobile 1 violating the traffic rules, the owner obtaining module 41 arranged in the fault receiving device 4 of the automobile 1 management center obtains the owner information bound with the received license plate information and stored in the automobile 1 management center, which maintains the connection relationship, according to the received license plate information, after the owner obtaining module 41 obtains the owner information, the information binding module 42 arranged in the fault receiving device 4 of the automobile 1 management center binds the received license plate information and the illegal image of the automobile 1 violating the traffic rules with the extracted owner information to generate the illegal automobile 1 information, after the information binding module 42 generates the illegal automobile 1 information, the information storage module 44 arranged in the fault receiving device 4 of the automobile 1 management center stores the generated illegal automobile 1 information And storing the current date to the position of the current date in the violation database 50 maintaining the connection relationship, and after the information storage module 44 stores the generated violation automobile 1 information to the violation data, the second sending module 45 arranged at the door of the fault receiving device 4 of the automobile 1 management center sends the generated violation automobile 1 information to the automobile 1 management center maintaining the connection relationship, so that the automobile 1 management center performs corresponding penalty.
Example four
As shown with reference to fig. 10.
Specifically, the embodiment provides an intelligent vehicle state detection system based on license plate recognition, which includes a vehicle 1, a camera 2, a processing device 3 and a fault receiving device 4, wherein a license plate recognition system 10 and a vehicle speed sensor 11 are arranged inside the vehicle 1, and the license plate recognition system 10 is used for recognizing license plate information included in images captured by a first camera 20 and a second camera 21; the vehicle speed sensor 11 is used for acquiring vehicle speed information of the vehicle 1 in real time, the camera device 2 comprises a first camera 20 and a second camera 21, and the first cameras 20 are provided with a plurality of cameras and arranged on the front surface of the vehicle 1 and used for capturing images of the environment in front of the vehicle 1; the second cameras 21 are arranged at the rear surface of the automobile 1 and used for shooting the images of the environment behind the automobile 1; processing apparatus 3 sets up in 1 inside positions of car and respectively with car 1, license plate identification system 10, first camera 20, second camera 21, trouble receiving equipment 4, warning center, 1 management center of car, first aid center, city monitoring center and network connection, processing apparatus 3 includes:
the wireless device 30 is used for being respectively connected with the fault receiving equipment 4, the alarm center, the automobile 1 management center, the emergency center, the city monitoring center and the network;
the vehicle speed acquisition module 31 is used for acquiring vehicle speed information detected by the vehicle speed sensor 11 which is in a connection relation with the processing device 3 in real time;
a first analysis module 32, configured to analyze specified information and/or instructions and/or images and/or requests and obtain an analysis result;
a first camera module 33 for controlling the first camera 20 connected to the processing device 3 to take a designated image;
a second camera module 34, configured to control the second camera 21, which is kept in a connection relationship with the processing device 3, to capture a specified image;
the license plate recognition module 35 is used for controlling the license plate recognition system 10 which keeps a connection relationship with the processing device 3 to recognize and extract license plate information contained in the appointed image;
a first sending module 36, configured to send specified information and/or instructions and/or images and/or requests to a specified object;
a first receiving module 37, configured to receive information and/or instructions and/or images and/or requests;
the fault receiving equipment 4 is respectively connected with the processing device 3, the automobile 1 management center, the alarm center, the emergency center and the city monitoring center, and the fault receiving equipment 4 comprises:
a second receiving module 40, configured to receive information and/or instructions and/or images and/or requests;
the vehicle owner obtaining module 41 is used for obtaining vehicle owner information stored in the management center of the vehicle 1 keeping the connection relation according to the specified information and/or the image;
an information binding module 42, configured to bind the specific information and/or the image and/or the object with at least one specific information and/or image and/or object;
a failure database 43 for storing failure information;
an information storage module 44, configured to store the specified information and/or images and/or objects in a specified database;
a second sending module 45, configured to send specified information and/or instructions and/or images and/or requests to a specified object;
an image extracting module 46, configured to extract a person image included in the designated car 1 image;
the wanted matching module 47 is used for matching the images of the designated personnel with wanted images of the alarm center and acquiring a matching result;
a second analysis module 48, configured to analyze specified information and/or instructions and/or images and/or requests and obtain an analysis result;
the monitoring matching module 49 is used for matching the specified image with the monitoring image of the city monitoring center and acquiring a matching result;
the violation database 50 is used for storing the violation automobile 1 information;
the information extracting module 51 is configured to extract the specific information and/or instructions and/or images and/or requests contained in the specific information.
It should be understood that, in the fourth embodiment, the specific implementation process of each module described above may correspond to the description of the above method embodiments (the first to the third embodiments), and is not described in detail here.
The system provided in the fourth embodiment is only illustrated by dividing the functional modules, and in practical applications, the above-mentioned functions may be distributed by different functional modules according to needs, that is, the internal structure of the system is divided into different functional modules to complete all or part of the functions described above.
The above embodiments are merely illustrative of the technical ideas and features of the present invention, and are intended to enable those skilled in the art to understand the contents of the present invention and implement the present invention, and not to limit the scope of the present invention. All equivalent changes or modifications made according to the spirit of the present invention should be covered within the protection scope of the present invention.

Claims (5)

1. An intelligent automobile state detection method based on license plate recognition is characterized by comprising the following steps:
s1, acquiring vehicle speed information detected by a vehicle speed sensor arranged at the internal position of the vehicle in real time by a processing device arranged at the internal position of the vehicle, and analyzing whether the vehicle keeping the connection relationship is in a driving state or not according to the acquired vehicle speed information;
s2, if yes, the processing device controls a first camera arranged on the surface position in front of the automobile to shoot a first image in real time and controls a second camera arranged on the surface position behind the automobile to shoot a second image in real time;
s3, the processing device analyzes whether the automobile running in front of the automobile keeping the connection relation performs left-turn or not in real time according to the first image captured in real time and analyzes whether the automobile running behind the automobile keeping the connection relation performs left-turn or not in real time according to the second image captured in real time;
s4, if not, the processing device analyzes whether the automobile running in front of the automobile keeping the connection relation carries out right turn or not in real time according to the first image shot in real time and analyzes whether the automobile running behind the automobile keeping the connection relation carries out right turn or not in real time according to the second image shot in real time;
s5, if not, the processing device analyzes whether the automobile running in front of the automobile keeping the connection relation is braked or not in real time according to the first image shot in real time;
s6, if yes, the processing device analyzes whether the brake lamp of the automobile running in front of the automobile keeping the connection relation and braking is in a lighting state or not in real time according to the first image shot in real time;
s7, if the license plate information does not exist, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which is contained in the first image and is braked and the brake lamp of which is not in the lighting state, and sends the extracted license plate information and the automobile image which is contained in the first image and is braked and the brake lamp of which is not in the lighting state to fault receiving equipment arranged in an automobile management center;
s8, if the fault receiving equipment arranged in the automobile management center receives the license plate information and the automobile image which is braked and the brake lamp is not in the lighting state, acquiring owner information which is stored in the automobile management center and is in the connection relation with the received license plate information according to the received license plate information, binding the received license plate information and the automobile image which is braked and the brake lamp is not in the lighting state with the owner information to generate fault information, storing the fault information into a fault database in the connection relation, and sending the generated fault information to a mobile terminal of an owner by the fault receiving equipment arranged in the automobile management center according to the acquired owner information;
after S2, the processing device analyzes whether the automobile driving in front of and behind the automobile keeping the connection relation performs lane changing or turning in real time according to the first image and the second image which are captured in real time; if yes, the processing device analyzes whether a turn signal corresponding to the automobile which changes lanes or turns is in a lighting and flickering state or not according to the first image and the second image; if the number plate information does not exist, the processing device controls a number plate recognition system keeping the connection relation to extract the number plate information of the automobile which is subjected to lane changing or turning and is contained in the first image or the second image, and the extracted number plate information and the automobile image which corresponds to the situation that the steering lamp is not in the lighting flickering state when the automobile which is contained in the first image or the second image is subjected to lane changing or turning are sent to fault receiving equipment arranged in an automobile management center;
after S2, the method further includes the steps of:
s20, the processing device analyzes whether the automobile running in front of the automobile keeping the connection relation carries out left lane changing or not in real time according to the first image shot in real time and analyzes whether the automobile running behind the automobile keeping the connection relation carries out left lane changing or not in real time according to the second image shot in real time;
s21, if the processing device analyzes that the automobile driving in front of the automobile keeping the connection relation has the left lane change according to the first image shot in real time, the processing device analyzes whether the rear left turn lamp of the automobile driving in front of the automobile keeping the connection relation and having the left lane change is in a lighting and flickering state or not according to the first image shot in real time;
s22, if the number plate information is not available, the processing device controls the number plate recognition system keeping the connection relationship to extract the number plate information of the automobile which is contained in the first image and carries out left lane changing and the rear left turn lamp is not in the lighting and flashing state, and sends the extracted number plate information and the automobile image which is contained in the first image and carries out left lane changing and the rear left turn lamp is not in the lighting and flashing state to a fault receiving device arranged in an automobile management center;
s23, if the processing device analyzes that the automobile driving behind the automobile keeping the connection relation has the left lane changing according to the second image shot in real time, the processing device analyzes whether the front left turn lamp of the automobile driving behind the automobile keeping the connection relation and having the left lane changing is in a lighting and flickering state or not according to the second image shot in real time;
s24, if the license plate information does not exist, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which is contained in the second image and carries out the left lane changing and the front left turn lamp is not in the lighting and flashing state, and sends the extracted license plate information and the automobile image which is contained in the second image and carries out the left lane changing and the front left turn lamp is not in the lighting and flashing state to a fault receiving device arranged in an automobile management center;
after S2, the method further includes the steps of:
s25, the processing device analyzes whether the automobile running in front of the automobile keeping the connection relation carries out right lane changing or not in real time according to the first image shot in real time and analyzes whether the automobile running behind the automobile keeping the connection relation carries out right lane changing or not in real time according to the second image shot in real time;
s26, if the processing device analyzes that the automobile driving in front of the automobile keeping the connection relation has the right lane change according to the first image shot in real time, the processing device analyzes whether the rear right turn lamp of the automobile driving in front of the automobile keeping the connection relation and having the right lane change is in a lighting and flickering state or not according to the first image shot in real time;
s27, if the number plate information is not available, the processing device controls the number plate recognition system keeping the connection relationship to extract the number plate information of the automobile which is contained in the first image and carries out right lane changing and the rear right turn lamp is not in the lighting and flashing state, and sends the extracted number plate information and the automobile image which is contained in the first image and carries out right lane changing and the rear right turn lamp is not in the lighting and flashing state to a fault receiving device arranged in an automobile management center;
s28, if the processing device analyzes that the automobile driving behind the automobile keeping the connection relation has the right lane change according to the second image shot in real time, the processing device analyzes whether the front right turn lamp of the automobile driving behind the automobile keeping the connection relation and having the right lane change is in a lighting and flickering state or not according to the second image shot in real time;
s29, if the license plate information does not exist, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which is contained in the second image and carries out right lane changing and the front right turn lamp is not in the lighting and flashing state, and sends the extracted license plate information and the automobile image which is contained in the second image and carries out right lane changing and the front right turn lamp is not in the lighting and flashing state to fault receiving equipment arranged in an automobile management center;
after S3, the method further includes the steps of:
s30, if the processing device analyzes that the automobile driving in front of the automobile keeping the connection relation has a left turn according to the first image captured in real time, the processing device analyzes whether the rear left turn lamp of the automobile driving in front of the automobile keeping the connection relation and having the left turn is in a lighting and flickering state or not according to the first image captured in real time;
s31, if the license plate information does not exist, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which is contained in the first image and carries out left-turning and the rear left-turning lamp is not in the lighting and flashing state, and sends the extracted license plate information and the automobile image which is contained in the first image and carries out left-turning and the rear left-turning lamp is not in the lighting and flashing state to fault receiving equipment arranged in an automobile management center;
s32, if the processing device analyzes that the automobile driving behind the automobile keeping the connection relation has a left turn according to the second image captured in real time, the processing device analyzes whether the front left turn lamp of the automobile driving behind the automobile keeping the connection relation and having the left turn is in a lighting and flickering state or not according to the second image captured in real time;
s33, if the license plate information does not exist, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which makes a left turn and the front left turn lamp is not in the lighting and flashing state and is contained in the second image captured in real time, and the extracted license plate information and the automobile image which makes a left turn and the front left turn lamp is not in the lighting and flashing state and is contained in the second image are sent to fault receiving equipment arranged in an automobile management center;
after S4, the method further includes the steps of:
s40, if the processing device analyzes that the automobile driving in front of the automobile keeping the connection relation turns right according to the first image captured in real time, the processing device analyzes whether the rear right turn lamp of the automobile driving in front of the automobile keeping the connection relation and turning right is in a lighting and flickering state or not according to the first image captured in real time;
s41, if the license plate information does not exist, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which carries out right turning and has the rear right turning lamp not in the lighting and flashing state and is contained in the first image captured in real time, and sends the extracted license plate information and the automobile image which carries out right turning and has the rear right turning lamp not in the lighting and flashing state and is contained in the first image to fault receiving equipment arranged in an automobile management center;
s42, if the processing device analyzes that the automobile driving behind the automobile keeping the connection relation turns right according to the second image captured in real time, the processing device analyzes whether the front right turn lamp of the automobile driving behind the automobile keeping the connection relation and turning right is in a lighting and flickering state or not according to the second image captured in real time;
and S43, if not, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile which turns right and the front right turn lamp is not in the lighting and flashing state and is contained in the second image captured in real time, and sends the extracted license plate information and the automobile image which turns right and the front right turn lamp is not in the lighting and flashing state and is contained in the second image to the fault receiving equipment arranged in the automobile management center.
2. The intelligent vehicle state detection method based on license plate recognition of claim 1, wherein in S8, the method further comprises the following steps:
s80, the fault receiving equipment arranged in the automobile management center binds the received license plate information and the automobile images and extracts the personnel images contained in the received automobile images in real time, and the fault receiving equipment arranged in the automobile management center matches the extracted personnel images with wanted images of an alarm center keeping a connection relation;
and S81, if the extracted personnel images analyzed by the fault receiving equipment arranged in the automobile management center are matched with the wanted image of the alarm center keeping the connection relationship, the fault receiving equipment arranged in the automobile management center sends the automobile images matched with the wanted image, the personnel images and the license plate information bound with the automobile images to the alarm center keeping the connection relationship.
3. The intelligent vehicle state detection method based on license plate recognition of claim 1, wherein after S81, the method further comprises the following steps:
s82, matching the automobile image and the personnel image matched with the wanted image and the license plate information bound with the automobile image with the monitoring image of the city monitoring center keeping the connection relation in real time by the fault receiving equipment arranged in the automobile management center;
and S83, if the fault receiving equipment arranged in the automobile management center analyzes that the automobile image and the personnel image which are matched with the wanted image and the monitoring image which is matched with the license plate information bound with the automobile image exist, the fault receiving equipment arranged in the automobile management center extracts the running route of the matched monitoring image and sends the matched monitoring image and the extracted running route of the monitoring image to the alarm center which keeps the connection relation.
4. The intelligent vehicle state detection method based on license plate recognition of claim 1, wherein in S2, the method further comprises the following steps:
s200, the processing device analyzes whether the automobile running in front of the automobile keeping the connection relationship violates the traffic rules in real time according to the first image captured in real time and analyzes whether the automobile running behind the automobile keeping the connection relationship violates the traffic rules in real time according to the second image captured in real time;
s201, if the processing device analyzes that a vehicle running in front of the vehicle keeping the connection relationship violates a traffic rule according to the first image captured in real time, the processing device controls a license plate recognition system keeping the connection relationship to extract license plate information of the vehicle violating the traffic rule contained in the first image captured in real time and sends the extracted license plate information and the vehicle violating image violating the traffic rule contained in the first image to a fault receiving device arranged in a vehicle management center;
s202, if the processing device analyzes that the automobile running behind the automobile keeping the connection relationship violates the traffic rules according to the second image captured in real time, the processing device controls the license plate recognition system keeping the connection relationship to extract the license plate information of the automobile violating the traffic rules contained in the second image captured in real time and sends the extracted license plate information and the automobile violating the traffic rules contained in the second image to fault receiving equipment arranged in an automobile management center.
5. The intelligent automobile state detection method based on license plate recognition of claim 4, wherein after S27, the method further comprises the following steps:
s203, the fault receiving equipment arranged in the automobile management center receives the license plate information and the illegal automobile image violating the traffic rules, acquires owner information bound with the received license plate information and stored in the automobile management center keeping the connection relation according to the received license plate information, and binds the received license plate information and the illegal automobile image violating the traffic rules with the extracted owner information to generate illegal automobile information to be stored in an illegal automobile database keeping the connection relation;
and S204, the fault receiving equipment arranged in the automobile management center sends the generated illegal automobile information to the automobile management center keeping the connection relation.
CN201810605473.2A 2018-06-13 2018-06-13 Intelligent automobile state detection sharing method and system based on license plate recognition Active CN108765955B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810605473.2A CN108765955B (en) 2018-06-13 2018-06-13 Intelligent automobile state detection sharing method and system based on license plate recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810605473.2A CN108765955B (en) 2018-06-13 2018-06-13 Intelligent automobile state detection sharing method and system based on license plate recognition

Publications (2)

Publication Number Publication Date
CN108765955A CN108765955A (en) 2018-11-06
CN108765955B true CN108765955B (en) 2020-10-27

Family

ID=64021126

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810605473.2A Active CN108765955B (en) 2018-06-13 2018-06-13 Intelligent automobile state detection sharing method and system based on license plate recognition

Country Status (1)

Country Link
CN (1) CN108765955B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109572594A (en) * 2018-11-19 2019-04-05 福建工程学院 A method of it is abnormal based on vehicle net dynamic contrast detection vehicle driving
CN109784548B (en) * 2018-12-28 2021-01-05 汉海信息技术(上海)有限公司 Early warning method for vehicle parking, server and vehicle system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5059947A (en) * 1990-03-19 1991-10-22 Chen Shih Chiang Vehicle brake warning device
CN2763909Y (en) * 2004-10-09 2006-03-08 陈浩明 Faulse alarm for brake lamp of car
CN203805787U (en) * 2013-10-18 2014-09-03 皇家飞利浦有限公司 Safety system for motor vehicle
KR101795249B1 (en) * 2016-05-02 2017-11-07 현대자동차주식회사 Vehicle and supporting method for driving safety of vehicle
US20170365105A1 (en) * 2016-06-17 2017-12-21 Ford Global Technologies, Llc Method and apparatus for inter-vehicular safety awareness and alert

Also Published As

Publication number Publication date
CN108765955A (en) 2018-11-06

Similar Documents

Publication Publication Date Title
CN107608388B (en) Autonomous police vehicle
CN107967806B (en) Vehicle fake-license detection method, device, readable storage medium storing program for executing and electronic equipment
CN112069643B (en) Automatic driving simulation scene generation method and device
CN108883725A (en) A kind of driving vehicle warning system and method
CN111047870A (en) Traffic violation vehicle recognition system, server, and non-volatile storage medium storing vehicle control program
CN108737992A (en) Pass through the diagnosis for the vehicle car light that the video camera of inter-vehicular communication assists
CN107393311B (en) A kind of license plate tamper Detection device and method
US20100052944A1 (en) Vehicle and Method for Identifying Vehicles Located in the Surroundings of the Vehicle
CN104875681A (en) Dynamic vehicle-mounted camera control method based on application scenarios
CN110395252A (en) A kind of traffic light intersection automatic control vehicle pass-through system and method
CN102956045A (en) Event trigger based vehicle monitoring, recording and prompting device and method thereof
CN110171354B (en) Active warning method and system for roadside parking
CN102556021A (en) Control device for preventing cars from running red light
CN106985819A (en) The determination methods and device of vehicle driving intention
CN108538060A (en) A kind of intelligence based on vehicle-mounted back vision camera is broken rules and regulations monitoring method and system
CN108765955B (en) Intelligent automobile state detection sharing method and system based on license plate recognition
CN109544936A (en) Motor vehicle zebra stripes based on radar video camera do not give precedence to pedestrian's early warning capturing system
CN109935100A (en) To the vehicle monitoring of infrastructure illumination
CN112349101A (en) High-precision map generation method, and method and system for identifying traffic lights
CN102881185A (en) Side direction lane detection traffic indication system
US10930145B2 (en) Traffic system for predicting and providing traffic signal switching timing
CN113808418A (en) Road condition information display system, method, vehicle, computer device and storage medium
CN111785030A (en) Traffic monitoring terminal and traffic monitoring system
CN109887301A (en) A kind of high beam violation monitoring system and method
CN205121892U (en) Intelligence license plate recognition

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20200921

Address after: Room 11, 4 / F, building a, 88 Beijing East Road, Taicang Development Zone, Suzhou City, Jiangsu Province

Applicant after: Suzhou ainager Information Technology Co.,Ltd.

Address before: 215400 8 Suzhou Zhongxing Street, Shaxi Town, Taicang, Suzhou

Applicant before: SUZHOU CHUANGCUN DIGITAL TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant