KR102429312B1 - Enforcement device and method thereof - Google Patents

Abstract

The present invention relates to a vehicle enforcement device and method. Provided are the vehicle enforcement device and method capable of increasing enforcement performance against illegal vehicles by recognizing a license plate on the rear side of the vehicle. The vehicle enforcement device includes a first camera unit, a second camera unit, and a processor unit.

Description

Vehicle enforcement device and method

The present invention relates to a vehicle enforcement apparatus and method, and more particularly, to a vehicle enforcement apparatus and method capable of increasing enforcement performance against illegal vehicles by recognizing a license plate even from the rear of the vehicle.

While the demand for vehicles is rapidly increasing, the manpower who manages road conditions and traffic conditions to crack down on illegal vehicles does not reach this level.

In addition, as the number of delivery motorcycles rapidly increases due to the influence of the so-called 'Minshik Act' and the spread of the Corona virus, the risk of safety accidents caused by motorcycles in the children's protection zone is also increasing.

In recent decades, it has become common for speeding and signal violation enforcement cameras installed in Korea to crack down almost only on front license plates, so there is also a problem that cars or motorcycles have a knack for avoiding enforcement by changing their driving patterns.

(Patent Document 0001) Republic of Korea Patent Publication No. 10-2194890

(Patent Document 0002) Republic of Korea Patent No. 10-0991106

The present invention has been devised to solve the problems of the prior art, and the present invention is to provide a vehicle enforcement apparatus and method that can improve enforcement performance against illegal vehicles by recognizing a license plate even at the rear of the vehicle.

A vehicle enforcement apparatus according to an embodiment of the present invention includes: a first camera unit for photographing the vehicle from the front based on a first detection signal output from a first detector in response to a vehicle entering a first monitoring area of a road; a second camera unit for photographing the rear license plate of the vehicle based on a second detection signal output from the second detector after passing through the first detector of the vehicle; and determining whether the vehicle violates the law on the basis of the image taken by the first camera unit, and converts the rear license plate image photographed for the vehicle determined to have violated the law into text information to detect the vehicle number, It may include a processor for transmitting the detected vehicle number and the captured intermittent image to the control server.

In the vehicle enforcement method according to an embodiment of the present invention, based on a first detection signal output from a first detector in response to a vehicle entering a first monitoring area of a road, the first camera unit captures an image captured from the front of the vehicle. obtaining; determining whether the vehicle violates laws based on the image captured by the first camera unit; acquiring an image of the rear license plate of the vehicle from a second camera unit based on a second detection signal output from the second detector after passing through the first detector of the vehicle; detecting the vehicle number by converting the rear license plate image into text information when it is determined that the vehicle violates the law; and transmitting the detected vehicle number information and the captured crackdown image to a control server.

According to the vehicle enforcement apparatus and method according to an embodiment of the present invention as described above, it is possible to increase the performance of enforcement against illegal vehicles by recognizing the license plate even on the rear side of the vehicle.

In addition, according to the vehicle enforcement apparatus and method according to an embodiment of the present invention, it is possible to increase the probability of cracking down on an illegal vehicle in preparation for the failure to obtain the rear license plate.

1 is a block diagram illustrating a configuration of a vehicle enforcement system according to an embodiment of the present invention.
2 is an exemplary view illustrating an example in which the vehicle control device according to an embodiment of the present invention is mounted on a road.
3 is an exemplary view showing an example of photographing the rear license plate of the vehicle according to an embodiment of the present invention.
4 is an exemplary view illustrating an example in which the vehicle enforcement device according to an embodiment of the present invention is mounted on a road.
5 is a flowchart illustrating a vehicle control method according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to clarify the technical spirit of the present invention. In describing the present invention, if it is determined that a detailed description of a related well-known function or component may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Elements having substantially the same functional configuration in the drawings are given the same reference numbers and reference numerals as much as possible even though they are shown in different drawings. For convenience of explanation, if necessary, the device and method will be described together.

1 is a block diagram illustrating the configuration of a vehicle enforcement system according to an embodiment of the present invention, FIG. 2 is an exemplary view in which a vehicle enforcement device according to an embodiment of the present invention is mounted on a road, and FIG. It is an exemplary view showing an example of photographing the rear license plate of the vehicle according to an embodiment of the present invention, Figure 4 is an exemplary view showing an example in which the vehicle enforcement device according to an embodiment of the present invention is mounted on the road.

Referring to FIG. 1 , a vehicle control system according to an embodiment of the present invention includes a control server 10 and a vehicle control device 20 .

The vehicle enforcement device 20 includes a first camera unit 21 , a second camera unit 22 , and a processor unit 23 .

In the present invention, an area provided with a pair of the first camera unit 21 and the second camera unit 22 is divided into a first monitoring area, and there are a plurality of monitoring areas provided with a pair of camera units on the road. For example, a road may be divided into a first monitoring area, a second monitoring area, and a third to Nth monitoring area (N is a natural number excluding 0).

The control server 10 may manage and control the N processor units provided for each monitoring area.

2 and 4 , the first camera unit 21 controls the vehicle from the front on the basis of the first detection signal output from the first detector 24 in response to the vehicle entering the first monitoring area of the road. shoot

Referring to FIG. 3 , the second camera unit 22 photographs the rear license plate of the vehicle based on the second detection signal output from the second detector 25 after passing through the first detector of the vehicle.

The first and second camera units 21 and 22 may each include a support, a camera, a control unit, and a communication module.

The second camera unit 22 may be provided in front of the first camera unit 21 based on the driving direction of the road.

A vehicle entering is detected by a laser beam emitted from a conventional known roof coil buried in the road floor or a camera, and the camera may take an image at the moment of detection. Acquiring an image by detecting a vehicle may use a commercially available technique known to those skilled in the art.

The above-described first detection signal and second detection signal mean a signal indicating that the vehicle entering is detected by the laser beam transmitted from the loop coil or the camera.

The processor unit 23 determines whether the vehicle violates the law on the basis of the image photographed by the first camera unit 21, and converts the rear license plate image photographed for the vehicle determined to have violated the law into text information. to detect the vehicle number, and transmit the detected vehicle number and the captured control image to the control server 10 .

In one embodiment, the processor unit 23 calculates the average driving speed of the vehicle based on an image of the vehicle photographed at two points spaced apart from each other by a predetermined interval in the driving direction within the first monitoring area, time information, and distance information between the two points. By calculating, it is possible to determine whether or not the vehicle is over-speeded.

Alternatively, in order to measure the speed of the vehicle entering the first monitoring area, radar or lidar and equipment may be employed. In addition, any method or device capable of measuring the speed of the vehicle may be used.

In one embodiment, the processor unit 23 considers the road signal information within the first monitoring area, grasps the position of the vehicle in relation to the position of the lane and the position of the crosswalk, and whether the vehicle is in violation of the signal or the sidewalk. can be judged

For example, by specifying coordinate values in the image captured by the first camera unit 21, motion detection is performed on a vehicle crossing a line or moving according to a real-time road signal condition based on a lane or a crosswalk by an object extraction method. can Through motion detection by the object extraction technique, information for judging the fact that the vehicle is illegal based on the road signal condition can be provided to the control server.

In an embodiment, the processor unit 23 may determine at least one of a vehicle type, a vehicle type, and a color based on an external image of the vehicle in the video.

In an embodiment, when the vehicle is a two-wheeled vehicle, the processor unit 23 may determine whether to wear a hard hat using a deep learning model. In one embodiment, the driver's seat area corresponding to the driver's seat of the two-wheeled vehicle is detected by analyzing the image received from the first camera unit 21, and the image of the detected driver's seat area is analyzed based on deep learning (DEEP Learning) to determine the driver's It is possible to determine the wearing state of the helmet.

In addition, the processor unit 23 may extract characteristic information of the photographed vehicle based on vehicle information previously learned using the deep learning model. That is, through the analysis of areas other than the license plate, it is possible to extract the vehicle type, vehicle model, color, object loaded in the vehicle, and characteristic information of the driver.

For example, the processor unit 23 detects the vehicle from the image captured in the monitoring area, detects the license plate area for the detected vehicle, and when it is determined that the vehicle is a two-wheeled vehicle when the external appearance of the vehicle is analyzed, the detection of the license plate area It is possible to extract the image of the luggage compartment of the two-wheeled vehicle using the location and size, and deep-learning analysis of the luggage compartment image to detect the object loaded in the luggage compartment, the size, shape, color, and text engraved on the object.

On the other hand, the processor unit 23 according to the embodiment of the present invention basically recognizes the license plate of the vehicle that violates the law and transmits the recognized vehicle number to the control server 10, but the license plate is covered, contaminated, damaged. There may be cases where the acquisition of license plate information fails due to causes such as misrecognition, partial recognition, and recognition failure.

In order to prepare for this, the processor unit 23, which has failed to obtain license plate information, reports the failure to acquire license plate information of the illegal vehicle to the control server 10, and records illegal vehicle information other than license plate information and captured images together with the control server 10 ) can be transmitted.

To this end, when the processor unit 23 determines that the vehicle is a two-wheeled vehicle from the images captured by the first camera unit 21 and the second camera unit 22, the model, color, safety helmet, passenger seat and Illegal vehicle information is detected by analyzing at least one image among the loaded objects.

Alternatively, when the processor unit 23 determines that the vehicle is a vehicle from the images captured by the first camera unit 21 and the second camera unit 22 , the type, vehicle model, color, year, and type of the corresponding vehicle. The illegal vehicle information is detected by analyzing at least one image of the object.

Subsequently, the processor unit 23 transmits a tracking command signal together with the illegal vehicle information to the processor unit provided in the second monitoring area adjacent to the first monitoring area.

In this case, the processor unit 23 may predict the next moving direction of the vehicle, and set the closest location to the predicted direction as the second monitoring area.

For example, when the illegal vehicle is a two-wheeled vehicle, a movement path may be predicted based on the direction in which the front center of the steering wheel handle faces, and a monitoring area existing in the predicted movement path may be set as the second monitoring area.

Accordingly, the processor unit of the second monitoring area that has received the tracking command signal and the illegal vehicle information may detect a vehicle that matches the similarity analysis result with the illegal vehicle information in the image captured by the camera unit provided in the second monitoring area. . In addition, the vehicle image captured by the first camera unit and the license plate image captured by the second camera unit may be transmitted to the control server 10 .

Similarly, when the processor unit 23 of the second monitoring area fails to obtain license plate information, the processor unit 23 of the first monitoring area fails to obtain the license plate information in the same manner as in the case of the third monitoring area It is possible to transmit a tracking command signal together with the illegal vehicle information to the processor unit 23 of the .

In this case, the processor unit 23 may transmit to the control server 10 the fact about the license plate information acquisition failure, the acquired illegal vehicle information, and the information about which monitoring area the tracking command signal is transmitted.

In addition, if there is a text image in the area other than the license plate of the illegal vehicle, the processor unit 23 converts the text image into text information to detect a phone number or company name, and transmit the detected information to the control server 10 . have.

Accordingly, the control server 10 can detect a company or contract company belonging to, for example, a delivery motorcycle by inquiring a phone number or a company name and executing a search, and transmits a crackdown picture or a crackdown video to the detected company. fact can be reported.

The processor unit 23 may be communicatively connected to the first camera unit 21 and the second camera unit 22 , and may be individually installed in the monitoring area or constructed as an integrated system.

The processor unit 23 is an edge computer, and the edge computer may interact with a deep learning server in a cloud computing method.

The control server 10 may execute a predetermined task corresponding to the illegality, such as imposing a fine on the corresponding vehicle, based on the vehicle number of the illegal vehicle received from the processor unit 23 and the enforcement image information in which the illegality is captured.

In an embodiment, the control server 10 may manage standardized software updates and operate the overall vehicle enforcement system. As an example, the control server 10 may be a server of a national agency that executes speed violations, signal violations, non-wearing of helmets, and sidewalk traffic detection using the vehicle control device of the present invention.

5 is a flowchart illustrating a vehicle control method according to an embodiment of the present invention. For a detailed description of each step, reference will be made to the description of the vehicle control device described with reference to FIGS. 1 to 4 .

Referring to FIG. 5 , in the vehicle enforcement method according to the embodiment of the present invention, first, the vehicle enforcement apparatus is a vehicle based on a first detection signal output from a first detector in response to a vehicle entering the first monitoring area of the road. The image taken from the front is acquired from the first camera unit (S100).

Next, based on the image captured by the first camera unit, it is determined whether the vehicle violates the law (S110).

Next, after passing through the first detector of the vehicle, based on the second detection signal output from the second detector, the image obtained by photographing the rear license plate of the vehicle is obtained from the second camera unit (S120). Here, steps S110 and S120 may be simultaneously executed.

Next, when it is determined that the vehicle violates the law, the vehicle number is detected by converting the rear license plate image into text information (S130).

Next, the detected vehicle number information and the captured crackdown image are transmitted to the control server (S140).

On the other hand, if the vehicle number detection fails in step S130, the vehicle enforcement device acquires other information about the illegal vehicle except for the license plate information (S140).

For example, when it is determined that the corresponding vehicle is a two-wheeled vehicle, illegal vehicle information may be detected by analyzing at least one image of a model, a color, a hard hat, a passenger seat, and a loaded object of the corresponding two-wheeled vehicle. Alternatively, when the corresponding vehicle is determined to be a vehicle in the image, the illegal vehicle information may be detected by analyzing at least one image among the type, vehicle model, color, year, and loaded object of the corresponding vehicle.

Next, the illegal vehicle information and the tracking command signal are transmitted to the processor unit of the vehicle enforcement device provided in the next monitoring area (S150).

In this case, the next moving direction of the vehicle may be predicted, and a location closest to the predicted direction may be set as the second monitoring area (next monitoring area).

For example, when the illegal vehicle is a two-wheeled vehicle, a movement path may be predicted based on the direction in which the front center of the steering wheel handle faces, and a monitoring area existing in the predicted movement path may be set as the second monitoring area.

Next, the vehicle enforcement device that has received the tracking command signal detects the illegal vehicle through similarity analysis based on the illegal vehicle information ( S160 ).

Similarly, when the vehicle enforcement device in the second monitoring area fails to acquire license plate information, it is possible to transmit a tracking command signal together with the illegal vehicle information to the vehicle control device provided in the third monitoring area in the same manner as in the above-described method.

At this time, the vehicle enforcement device may transmit the fact about the license plate information acquisition failure, the acquired illegal vehicle information, and information about which monitoring area the tracking command signal is transmitted to the control server.

In addition, when there is a text image in an area other than the license plate of the illegal vehicle, the text image is converted into text information to detect a phone number or company name, and the detected information can be transmitted to the control server.

Accordingly, the control server can detect the company or contract company belonging to, for example, a delivery motorcycle by inquiring and executing a search for a phone number or company name, and sends a picture or video of the enforcement to the detected company and notifies the illegal fact. can do.

According to the vehicle enforcement apparatus and method according to an embodiment of the present invention as described above, it is possible to increase the performance of enforcement against illegal vehicles by recognizing the license plate even on the rear side of the vehicle.

In addition, according to the vehicle enforcement apparatus and method according to an embodiment of the present invention, it is possible to increase the probability of arrest for the illegal vehicle in case of failure to obtain the rear license plate.

The method and server according to the present invention may be driven by instructions to cause one or more processors to perform the functions and processors described above.

For example, such instructions may include interpreted instructions, such as script instructions, such as JavaScript or ECMAScript instructions, or executable code or other instructions stored on a computer-readable medium. Furthermore, the device according to the present invention may be implemented in a distributed manner over a network, such as a server farm, or may be implemented in a single computer device.

Although this specification and drawings describe exemplary device configurations, implementations of the functional operations and subject matter described herein may be implemented in other types of digital electronic circuitry, or may be implemented with structures disclosed herein and structural equivalents thereof. It may be implemented as computer software, firmware, or hardware including, or a combination of one or more of these. Implementations of the subject matter described herein relate to one or more computer program products, ie computer program instructions encoded on a tangible program storage medium for execution by or for controlling the operation of an apparatus according to the invention. It can be implemented as the above modules. The computer-readable medium may be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter that affects a machine-readable radio wave signal, or a combination of one or more thereof.

Implementations of the subject matter described herein may include, for example, backend components, such as data servers, or middleware components, such as application servers, such as web browsers or graphical users that allow users to interact with implementations of the subject matter described herein. It may be implemented in a front-end component, such as a client computer having an interface, or in a computing system including any combination of one or more of such back-end, middleware or front-end components. The components of the system may be interconnected by any form or medium of digital data communication, such as, for example, a communication network.

While this specification contains numerous specific implementation details, these are not to be construed as limitations on the scope of any invention or claim, but rather as descriptions of features that may be specific to particular embodiments of particular inventions. should be understood Certain features that are described herein in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may also be implemented in multiple embodiments, either individually or in any suitable subcombination. Furthermore, although features operate in a particular combination and may be initially depicted as claimed as such, one or more features from a claimed combination may in some cases be excluded from the combination, the claimed combination being a sub-combination. or a variant of a sub-combination.

Likewise, although acts are depicted in the figures in a particular order, it should not be construed that all acts shown must be performed or that such acts must be performed in the specific order or sequential order shown to achieve desirable results. In certain cases, multitasking and parallel processing may be advantageous. Further, the separation of the various system components of the above-described embodiments should not be construed as requiring such separation in all embodiments, and the program components and systems described may generally be integrated together into a single software product or packaged into multiple software products. You have to understand that you can.

Certain embodiments of the subject matter described herein have been described. Other embodiments are within the scope of the following claims. For example, acts recited in the claims may be performed in a different order and still achieve desirable results. As an example, the processes illustrated in the accompanying drawings do not necessarily require the specific illustrated order or sequential order to achieve desirable results. In certain implementations, multitasking and parallel processing may be advantageous.

The present description sets forth the best mode of the invention, and provides examples to illustrate the invention and to enable any person skilled in the art to make or use the invention. This written specification does not limit the present invention to the specific terms presented. Accordingly, although the present invention has been described in detail with reference to the above-described examples, those skilled in the art can make modifications, changes, and modifications to these examples without departing from the scope of the present invention.

Therefore, the scope of the present invention should not be defined by the described embodiments, but should be defined by the claims.

10: control server
20: vehicle enforcement device
21: first camera unit
22: second camera unit
23: processor unit
24: first detector
25: second detector

Claims (13)

a first camera unit for photographing the vehicle from the front based on a first detection signal output from the first detector in response to the vehicle entering the first monitoring area of the road;
a second camera unit for photographing the rear license plate of the vehicle based on a second detection signal output from the second detector after passing through the first detector of the vehicle; and
Based on the image taken by the first camera unit, it is determined whether the vehicle violates the law, and the rear license plate image photographed by the second camera unit for the vehicle determined to be in violation of the law is converted into text information. and a first processor unit that detects the vehicle number and transmits the detected vehicle number and the captured crackdown image to the control server,
When the detection of the license plate number of the illegal vehicle fails, the first processor unit detects illegal vehicle information by analyzing the images captured by the first and second camera units, and transmits a tracking command signal together with the illegal vehicle information. It is transmitted to the second processor unit provided in the second monitoring area adjacent to the first monitoring area, predicting the next moving direction of the vehicle, setting the closest location to the predicted direction as the second monitoring area, and setting the second monitoring area Transmitting the illegal vehicle information and the tracking command signal to the second processor unit of the area, the fact about the license plate information acquisition failure, the illegal vehicle information, and information about the processor unit of which monitoring area the tracking command signal is transmitted sent to the control server,
The second processor unit compares and determines whether there is the same vehicle as the illegal vehicle among the vehicles photographed by the first and second camera units provided in the second monitoring area based on the illegal vehicle information, and determines if there is the same vehicle. In this case, the vehicle number is detected by converting the rear license plate image of the vehicle into text information, and the detected vehicle number is transmitted to the control server,
If there is a text image in the area other than the license plate of the illegal vehicle in the images taken by the first and second camera units, the first processor unit converts the text image into text information to detect a phone number or company name, Vehicle enforcement device, characterized in that for transmitting the detected information to the control server. The method of claim 1,
The first processor unit,
Vehicle enforcement device, characterized in that it recognizes a vehicle to be cracked in the image, and detects whether at least one of a speed violation, a signal violation, not wearing a helmet, and sidewalk traffic of the recognized vehicle is violated. The method of claim 1,
The first processor unit,
When the vehicle is a two-wheeled vehicle in the images taken by the first and second camera units, the illegal vehicle information is detected by analyzing at least one image among the model, color, safety helmet, and passenger seat of the corresponding two-wheeled vehicle. vehicle control device. The method of claim 1,
The first processor unit,
When the vehicle is a vehicle in the images captured by the first camera unit and the second camera unit, the illegal vehicle information is detected by analyzing at least one image among the type, vehicle model, color, and year of the vehicle. vehicle control device. delete delete The method of claim 1,
The first processor unit,
When the illegal vehicle is a two-wheeled vehicle, the vehicle enforcement device, characterized in that the moving path is predicted based on the direction in which the front center of the steering wheel handle faces, and monitoring areas existing in the predicted moving path are selected as the second monitoring areas. . delete The method of claim 1,
The second camera unit,
Vehicle control device, characterized in that provided in front of the first camera unit based on the driving direction of the road. acquiring an image captured by the first camera unit from the front of the vehicle based on a first detection signal output from the first detector in response to the vehicle entering the first monitoring area of the road;
determining, by the first processor unit provided in the first monitoring area, whether the vehicle violates laws and regulations based on the image captured by the first camera unit;
After the first processor unit passes through the first detector of the vehicle, based on the second detection signal output from the second detector, the image obtained by photographing the rear license plate of the vehicle is obtained from the second camera unit provided in the first monitoring area to do;
detecting the vehicle number by converting the rear license plate image into text information when the first processor unit determines that the vehicle violates the law; and
and transmitting, by the first processor unit, the detected vehicle number information and the captured intermittent image to a control server,
If there is a text image in the area other than the license plate of the illegal vehicle in the images captured by the first and second camera units, the first processor unit converts the text image into text information to detect a phone number or a company name, and detects Further comprising the step of transmitting the information to the control server,
When the first processor unit fails to detect the vehicle number, it analyzes the images taken by the first and second camera units to obtain other information about the illegal vehicle except for the license plate information, and track it together with the obtained illegal vehicle information A command signal is transmitted to the second processor unit provided in the second monitoring area adjacent to the first monitoring area, predicting the next moving direction of the vehicle, and setting the closest location to the predicted direction as the second monitoring area, The illegal vehicle information and the tracking command signal are transmitted to the second processor unit of the set second monitoring area, and the fact about license plate information acquisition failure, the illegal vehicle information, and the tracking command signal is transmitted to the processor unit of the monitoring area transmits information on the control server,
The second processor compares and determines whether there is the same vehicle as the illegal vehicle among the vehicles photographed by the first and second camera units provided in the second monitoring area based on the illegal vehicle information, and determines if there is the same vehicle. In this case, the vehicle control method, characterized in that by converting the rear license plate image of the vehicle into text information to detect the vehicle number, and transmitting the detected vehicle number to the control server.
delete delete delete

Images