KR102017800B1 - Regulation vehicle for enhancing regulating accuracy and efficiency - Google Patents

Abstract

The present invention is configured to generate driver location information, which is whether the driver is placed in the driver's seat using a thermal imaging camera for the vehicle initially photographed in the illegal stop mode of the battery, thereby providing accurate evidence of illegal stop. When an error occurs in vehicle number recognition in illegal parking or illegal parking control mode, the vehicle number is detected by combining the rear vehicle number and the vehicle number detected from the rear image and the front image acquired by the first and second cameras. The present invention relates to an intermittent vehicle capable of accurately detecting a vehicle number even if the vehicle number is not detected because it is hidden by another parked vehicle.

Description

Regulated vehicle for enhancing regulating accuracy and efficiency

The present invention relates to a crackdown vehicle that has increased the accuracy and efficiency of crackdown, and more particularly, to a crackdown vehicle that can efficiently perform vehicle inquiry and crackdown using a photographing means mounted on a vehicle.

Recently, various studies have been conducted on the intermittent vehicles equipped with number recognition cameras on one side or the top of the vehicle in order to increase the rate of supply of vehicles, and to efficiently perform arrangements inquiry, theft vehicle inquiry, illegal parking and parking management. have.

These intermittent vehicles shoot adjacent neighboring vehicles as they move, and are automatically configured to perform vehicle number recognition and inquiry, so when using a fixed CCTV camera, not only the location is limited but also the shooting radius is limited and the enforcement rate is lowered. According to the installation angle and the parking position of the vehicle, there is a structural limitation that blind spots are not taken.

Accordingly, various researches on the intermittent vehicle having a camera have been conducted.

Korean Patent No. 10-0865511 (Invention: Vehicle-mounted Stop Line Violation Control System and Method thereof) (hereinafter referred to as the first conventional technology) includes a system and method for simultaneously controlling signal violations and stop line violations of a crosswalk. This is described.

In addition, Korean Patent No. 10-1255143 (name of the invention: a vehicle-mounted camera system having an area monitoring function and a method thereof) (hereinafter referred to as a second conventional technology) has a control system for controlling a user while driving a vehicle. According to the present invention, a system and a method for performing a surveillance function for performing a parking control function and performing a monitoring function of capturing and recording a predetermined shooting point when parking in a predetermined area are described.

In addition, Korean Patent No. 10-1678420 (name of the invention: the searchlight and the vehicle number recognition system using the same) (hereinafter referred to as the third conventional technology) shows the scene of a scene photographed in a low-light environment using the searchlight. Systems and methods are described that can easily identify and retrieve a particular vehicle number.

Hereinafter, the problems with the first, second, and third prior arts (hereinafter, referred to as prior arts) will be described.

1 is an exemplary view showing a prior art.

As shown in FIG. 1, the prior art 100 includes a battery 103 for supplying power, constituent means 105 for performing a preset operation, and data for managing and controlling the constituent means 105. It consists of the PC 101 for a process. At this time, the data processing PC 101, the battery 103, and each component 105 are connected to a communication cable and a power cable, respectively.

In addition, the constituent means 105 may include a touch screen 152, a GPS (not shown), a pan-tilt camera 151, a search light (not shown), an input means 154, an electronic display panel 153, and the like. Is done.

In the prior art 100 configured as described above, the constituent means 105 have different installation positions, and since the data processing PC 101 and the battery 103 are installed inside the vehicle, a communication cable and a power supply connecting them to each other. The installation is complicated by the cable, and has a structural limit in which the aesthetics fall. In particular, in the case of the touch monitor 152 and the pan tilt camera 151, since the capacity of the gigabyte (GB) is required, a thicker HDMI cable should be installed, which makes installation more cumbersome.

In addition, in the prior art 100, the inverter of the battery 103 converts 12V DC power into 220V AV power, and then supplies the converted 220V AV power to each component 105, and the SMPS of each component 105 is Since it is configured to convert the input 220V AV power supply to 12V DC power, the power loss is not only large, but also has a disadvantage in that failure and failure of the component 105 occur frequently due to unstable power supply.

On the other hand, the prior art 100 may be used for the purpose of cracking down illegal parking.

In this case, the stop is defined as a state in which a driver is standing on the shoulder of a road for waiting for someone, loading a cargo, or a vehicle breakdown, and such a stop may interrupt the flow of other vehicles while driving and cause a traffic accident. In Korea, if the stop exceeds 5 minutes, it is cracked down on illegal stops.

These illegal stops are not regulated and mandated, but when illegal stops are detected, a penalty is issued if illegal stops of the vehicle continue even after 5 minutes have elapsed after warning and notification to the driver of the vehicle. As a result, various complaints have been raised, such as not having stopped more than 5 minutes when a fine was charged due to illegal stop, or because the driver was not in the vehicle and could not hear the warning and notification broadcast.

That is, detecting whether the human body is located inside the vehicle during illegal parking control may be a solution to reduce civil complaints, but the prior art 100 may provide a technique and method for detecting whether a driver in a vehicle is located. Since it is not described, there is a disadvantage in that civil complaints frequently occur when applied to crackdown on illegal parking.

Figure 2 is an exemplary view for explaining the problem of the prior art.

Prior art 100, as shown in Figure 2, when the vehicle is parked at a narrow interval, even if the camera 151 photographs the vehicle, the license plate of one vehicle (C1) is adjacent to the other vehicle (C2) A phenomenon occurs in which the entire license plate 190 cannot be captured. Accordingly, even when photographing is performed, only a part of the license plate number is not recognized.

That is, 1) it can reduce the complaints by detecting whether the driver is located inside the crackdown vehicle, 2) make the operation of each component simple and convenient, and 3) even if the license plate is in the blind spot. There is an urgent need for research on crackdown vehicles that can recognize and increase crackdown rates.

The present invention is to solve such a problem, the problem of the present invention is to use the thermal imaging camera for the vehicle first photographed in the illegal stop control mode to determine whether the position of the human body in the interior of the vehicle; It is designed to provide a crackdown vehicle that can be configured to generate accurate evidence of illegal stop control.

delete

delete

In addition, another problem of the present invention is the rear vehicle number and the vehicle number detected from the rear image and the front image acquired by the first and second cameras when an error occurs in the vehicle number recognition in illegal parking or illegal stop control mode. By detecting the vehicle number in combination, it is to provide an intermittent vehicle that can accurately detect the vehicle number even if the vehicle number is not detected because it is hidden by other parked vehicles.

Solution to Problem The present invention for solving the above problems is provided with a camera unit installed on one side of the vehicle; An auxiliary control unit for detecting a vehicle number by analyzing the image photographed by the camera unit; A controller including a track inquiry management unit for generating track inquiry request data including a vehicle number, GPS information, an image, and photographing time information received from the auxiliary control unit in a track inquiry mode and transmitting the vehicle inquiry request data to an external control center server; First accessory devices configured to perform a preset operation according to the control of the controller; And a second accessory device that performs a preset operation according to the control of the auxiliary control unit, wherein the camera unit photographs the front of the vehicle and pan-tilt-controlled the first camera and the rear of the vehicle. The second camera may further include pan-tilt control, and if the vehicle control unit does not recognize the vehicle number, the auxiliary control unit may transmit error data to the controller, and the controller may further include an illegal parking control unit that is driven in an illegal parking control mode. The illegal parking control unit may determine that the number recognition is normally performed when the vehicle number is received from the auxiliary control unit. However, when the error data is received from the auxiliary control unit, the first number recognition determination module determines that a number recognition has occurred. It is driven when it is determined that there is a failure in number recognition by the first number recognition determination module, a rear image which is an image by the first camera and a front image which is an image by the second camera for a vehicle that has a number recognition disorder. A first front and rear image extraction module for extracting the image; A first number recognition module that detects the front license plate and the rear license plate by analyzing the front image and the rear image extracted by the first front and rear image extraction module, and then detects the front vehicle number and the rear vehicle number; A first vehicle number combination module for combining the front vehicle number and the rear vehicle number by the first number recognition module, and determining that the vehicle number combination is normally performed when the number of the combined vehicle numbers is equal to a preset threshold; And an illegal parking control information generation module for generating illegal parking control information including the vehicle number inputted from the first number recognition determination module or the first vehicle number combination module and the corresponding video frame, GPS information, and shooting time information. The illegal parking control unit may transmit illegal parking control information generated by the illegal parking control information generation module to the control center server, and the controller may further include an illegal parking control unit that is driven in an illegal parking control mode. The illegal stop control unit may determine that the number recognition is normally performed when the vehicle number is received from the auxiliary control unit, and the second number recognition determination module determines that a number recognition has occurred when the error data is received from the auxiliary control unit. It is driven when it is determined that there is a failure in number recognition by the second number recognition determining module, the second image front and rear by the first camera and the front image of the second camera for the vehicle number recognition failure occurs Image extraction module; A second number recognition module that detects the front vehicle license plate and the rear vehicle license plate and detects the front vehicle number and the rear vehicle number by analyzing the front image and the rear image extracted by the second front and rear image extraction module; A second vehicle number combination module which combines the front vehicle number and the rear vehicle number by the second number recognition module, and determines that the vehicle number combination is normally performed when the number of the combined vehicle numbers is equal to a preset threshold; It is driven when it is determined that the vehicle number recognition is normally performed by the second number recognition determination module or when the vehicle number combination is normally performed by the second vehicle number combination module. Generates and stores a list matching the shooting time information, searches for whether the input vehicle number has been input before a preset period T, and inputs the corresponding vehicle number between the period T and the present. If the difference between the initial input time of the vehicle number and the current input time is the elapsed time (t), and the calculated elapsed time (t) is equal to or greater than the preset enforcement time (T1), the vehicle is illegally stopped. Illegal stop crackdown determination module for determining the crackdown vehicle; And an illegal stop control information generation module for generating illegal stop control information including a vehicle number of the vehicle determined as the illegal stop control vehicle by the illegal stop control module and a corresponding video frame, GPS information, and shooting time information. The illegal stop control unit transmits illegal stop control information generated by the illegal stop control information generation module to the control center server, and the camera unit is integrally formed with the first camera and is the same pan-tilt as the first camera. The control unit further includes a thermal imager controlled at an angle and driven in an illegal stop control mode to obtain a thermal image, wherein the illegal stop control unit includes a vehicle number inputted by the illegal stop control module before a preset period (T). It is driven when there is no input between the current and the present, and the heat is determined using a preset thermal analysis algorithm. Thermal image analysis module for analyzing an infrared image obtained by the camera; A human body sensing module for determining whether a person is located in the vehicle through the thermal image analysis module, and generating driver position information indicating that the human body is located in the vehicle if it is determined that the human body is located in the vehicle; When the driver position information is generated by the human body detection module is driven, and further comprises a notification module for outputting a warning broadcast indicating that the illegal stop zone, the illegal stop enforcement information generation module is the driver's position in the illegal stop enforcement information To include more information.

delete

delete

delete

delete

According to the present invention having the above-mentioned problems and solving means, the illegally stopped vehicle is configured to generate the driver's position information, which is whether the human body is located inside the vehicle by using a thermal imaging camera, for the first photographed vehicle in the illegal stop control mode. Provide accurate evidence of crackdowns.

delete

delete

According to the present invention, when an error occurs in the vehicle number recognition in the illegal parking or illegal parking control mode, the vehicle number is obtained by combining the rear vehicle number and the vehicle number detected from the rear image and the front image acquired by the first and second cameras. By detecting, even if the vehicle number is not detected because it is hidden by another parked vehicle, the vehicle number can be detected accurately.

1 is an exemplary view showing a prior art.
Figure 2 is an exemplary view for explaining the problem of the prior art.
3 is a block diagram illustrating an interrupted vehicle according to an embodiment of the present invention.
4 is an exemplary view showing FIG. 3.
5 is a block diagram illustrating a camera unit of FIG. 3.
6 is an exemplary diagram for describing a first camera and a second camera of the camera unit of FIG. 4.
7 is a block diagram illustrating the controller of FIG. 3.
8 is a block diagram illustrating a vehicle tracking management unit of FIG. 7.
9 is a block diagram illustrating an interruption processor of FIG. 7.
10A is an exemplary view showing a rear license plate for the vehicle C1, and (b) is an exemplary view showing a front license plate for the vehicle C1.
FIG. 11 is an exemplary diagram for describing a first vehicle number combination module of FIG. 9.

Hereinafter, with reference to the accompanying drawings will be described an embodiment of the present invention.

3 is a block diagram illustrating an interrupted vehicle according to an embodiment of the present invention, and 4 is an exemplary diagram illustrating FIG. 3.

The intermittent vehicle 1 according to the embodiment of the present invention 1) improves the efficiency of installation and operation through a simple configuration change, and 2) the driver's position information which is information on whether the human body is located inside the vehicle when detecting the intermittent vehicle. Not only will it reduce unnecessary civil complaints but also increase the accuracy of the crackdown, and 3) increase the accuracy of the crackdown by allowing the vehicle number to be recognized even if the entire license plate is not obtained by the adjacent vehicle.

3 and 4, the intermittent vehicle 1 includes a controller 3, an auxiliary control unit 5, a battery 9, a touch screen 11, a speaker 12, a keyboard 13, The microphone 14, the camera unit 16, the lighting unit 17, and the electronic display panel 18 are provided.

At this time, the camera unit 16 includes first and second cameras and a thermal imaging camera.

The battery 9 is a stable power supply by the inverter supplies a DC 5V voltage to the controller 3 and the auxiliary control unit (5). At this time, the controller 3 and the auxiliary control unit 5 include a DC-DC SMPS for converting a 5V DC voltage into a 12V DC voltage, thereby supplying 12V DC voltage to each of the constituent means, thereby providing stable power supply and power conversion. Power loss caused by this can be minimized, and the aesthetics can be enhanced by minimizing the power cable.

The controller 3 is installed in front of the intermittent vehicle 1, and is connected to the touch screen 11, the speaker 12, the keyboard 13, and the microphone 14 by a communication cable to manage and control them. PC is preferably a personal computer (PC).

In addition, the controller 3 converts the 5V DC voltage supplied from the battery 9 to the 12V DC voltage, including the DC-DC SMPS, to each of the constituent means 11, 12, 13, and 14. Supply.

In addition, when the controller 3 receives the captured image and the detected vehicle number information obtained by capturing the first and second cameras from the auxiliary control unit 5, the controller 3 stores the received captured image and the vehicle number and simultaneously receives the transmitted vehicle number. The vehicle inquiry request data including information and GPS location information is transmitted to an external control center server (not shown).

At this time, the external control center server is defined as a server capable of providing a vehicle inquiry service, and in detail, it is preferable that the police station server.

That is, when the first and second cameras are photographed, the controller 3 receives the vehicle number and the photographed image detected by the auxiliary controller 5, processes and utilizes the vehicle number, and performs illegal vehicle parking enforcement.

At this time, the controller 3 is configured to display the crackdown request data through the touch screen 11 if the vehicle number inquired from the control center server is a crackdown vehicle such as an escape or theft. This can be recognized quickly.

In addition, the controller 3 detects vehicle numbers of vehicle objects in the captured image by analyzing the captured image when driving the intermittent mode.

When the controller 3 is applied to illegal parking control, the controller 3 generates illegal parking control information including the detected vehicle number, a corresponding video, GPS information, and shooting time information, and controls the generated illegal parking control information. To send.

At this time, the control center server stores the illegal parking control information received from the controller 3 and grants and charges a fine to the corresponding driver using the illegal parking control information received.

In addition, when the controller 3 is applied to illegal stop control, the controller 3 analyzes the thermal image of the thermal imaging camera received from the camera unit 16 to obtain driver location information which is information on whether the human body is located inside the detected vehicle. If the same vehicle number is detected at the same place even after the intermittent time T1 has elapsed after generating the list information including the detected driver position information, vehicle number, and GPS information, the vehicle number, driver position information, It generates illegal stop control information including GPS information, time information and video, and transmits the generated illegal stop control information to the control center server.

At this time, the control center server stores the illegal stop control information received from the controller (3) and at the same time grants and charges a fine to the driver using the received illegal stop control information.

5 is a block diagram illustrating a camera unit of FIG. 3.

The auxiliary control unit 5 manages and controls the camera unit 16, the lighting unit 17, and the electronic display panel 18. In detail, the auxiliary control unit 5 is preferably made of a camera and an embedded board.

In this case, as shown in FIG. 5, the camera unit 16 includes a first camera 161, a second camera 162, a thermal imaging camera 163, and a pan-tilt bent part 164. The camera 161 is a camera for photographing toward the front of the intermittent vehicle 1, the second camera 162 is a camera for photographing toward the rear of the intermittent vehicle 1, and the thermal imaging camera 163. Is a device for obtaining a thermal image by rotating at the same pan-tilt angle as the first camera 161.

The auxiliary control unit 5 may also include pan-tilt, zoom, focus, and iris of each of the first and second cameras 161 and 162 of the camera unit 16. And the like, and receive the captured image from the cameras 161 and 162, analyze the received captured image, detect the vehicle number, and transmit the detected vehicle number and image to the controller 3.

At this time, the auxiliary control unit 5 transmits the error data to the controller 3 if the vehicle number recognition is not performed normally.

In addition, the auxiliary control unit 5 controls the driving of the thermal imaging camera 163 of the camera unit 16, and transmits the thermal image received from the thermal imaging camera 163 to the controller 3.

In addition, the auxiliary control unit 5 controls the lighting unit 17 and the electric sign 18.

6 is an exemplary diagram for describing a first camera and a second camera of the camera unit of FIG. 4.

As illustrated in FIG. 6, the camera unit 16 includes a first camera 161 and a second camera 162.

The first camera 161 and the second camera 162 are installed at an upper end of the intermittent vehicle 1 to enable Pan-Tilt-Zoom (PTZ) control.

Also, the first camera 161 photographs the front of the intermittent vehicle 1.

In addition, the second camera 162 is installed adjacent to the first camera 161 to photograph the rear of the intermittent vehicle (1).

That is, the camera unit 16 transmits the images captured by the first camera 161 and the second camera 162 to the auxiliary control unit 5.

Looking at the first camera 161 and the second camera 162 with reference to Figure 6, the first camera 161 is photographed toward the front of the vehicle driving direction, but the front of the camera under the control of the pan angle It is possible to take a picture of the vehicle parked in the illegal parking area by performing the shooting with the predetermined angle rotated in the state.

That is, the first camera 161 performs shooting in a state in which the pan-angle is controlled to face the shoulder in the state of facing the front of the vehicle during the illegal parking control.

The second camera 162 photographs the vehicle toward the rear of the vehicle, but photographs the vehicle parked in the illegal parking area by performing the photographing by rotating the predetermined angle in the rearward direction under the control of the fan angle. Will be.

That is, the second camera 162 performs shooting in a state in which the pan-angle is controlled to face the shoulder in the state of facing the rear of the vehicle during the illegal parking control.

In other words, the camera unit 16 may not only acquire an image (hereinafter referred to as a rear image) of the rear portion of the vehicle C1 by the first camera 161, but also obtain the image of the vehicle by the second camera 162. Since an image of the front part (hereinafter referred to as a front image) can be obtained, two images (front image and rear image) of an illegally parked vehicle can be obtained.

The thermal imaging camera 163 is manufactured integrally with the first camera 161 and rotates at the same angle as the pan-tilt angle of the first camera 161 to photograph the thermal image.

In addition, the thermal imaging camera 163 is driven during illegal stop control, and the thermal imaging image obtained by photographing is input to the controller 3 through the auxiliary control unit 5. At this time, the controller 3 analyzes the thermal images received from the thermal camera 163 and detects driver position information indicating whether a human body is detected inside the illegally stopped vehicle.

The lighting unit 17 is driven when the illuminance falls below the threshold value under the control of the controller 3 so that the photographing may be easily performed even in a weather or time zone in which the illuminance falls.

The display panel 18 displays a warning phrase or a notification phrase under the control of the controller 3.

The speaker 12 outputs a warning phrase or a notification phrase under the control of the controller 3.

7 is a block diagram illustrating the controller of FIG. 3.

As shown in FIG. 7, the controller 3 includes a controller 31, a memory 32, a communication interface 33, a pan-tilt driver 34, a trigger signal generator 35, and an accessory device driver. (36), the track inquiry management unit 37, and the enforcement processing unit 38.

The control unit 31 is an operating system (OS) of the controller 3, and manages and controls the control targets 32, 33, 34, 35, 36, 37, and 38. do.

In addition, the controller 31 controls the communication interface 33 to input data received from the outside into a corresponding component.

In addition, the control unit 31 stores the captured image transmitted from the auxiliary control unit 5 in the memory 32 and inputs the received vehicle number information to the vehicle tracking management unit 37 or the control unit 38.

The memory 32 stores a preset image analysis algorithm, number recognition algorithm, and thermal image analysis algorithm. At this time, the image analysis algorithm is an algorithm for detecting the vehicle object and license plate in the image frame by analyzing the image, the number recognition algorithm is an algorithm for detecting the vehicle number from the detected license plate, and the thermal image analysis algorithm is a vehicle from the thermal image It is an algorithm that detects whether the human body is detected inside.

In addition, the memory 32 stores the recognized vehicle number information and the GPS information of the intermittent vehicle 1.

In addition, the memory 32 stores images captured by the first and second cameras 161 and 162 and a thermal image obtained by the thermal camera 163.

The communication interface 33 performs data communication with the auxiliary control unit 5, the touch screen 11, the keyboard 13, the microphone 14, and the speakers 12.

In addition, the communication interface 33 transmits and receives data with the external control center server. At this time, the external control center server is defined as a server capable of providing a vehicle inquiry service, and in detail, it is preferable that the police station server.

The pan-tilt driver 34 controls the pan-tilt angle of each of the first and second cameras 161 and 162 of the camera unit 16.

In addition, the pan-tilt control value generated by the pan-tilt driver 34 is transmitted to the auxiliary controller 5 through the communication interface 33.

The trigger signal generator 35 generates a trigger signal for driving the first and second cameras 161 and 162 of the camera unit 16.

The accessory driver 36 manages and controls the operations of the touch screen 11, the keyboard 13, the microphone 14, and the speaker 12.

The vehicle tracker manager 37 is driven when operating in the vehicle tracker mode according to the driver's selection. At this time, the vehicle tracking mode means when the vehicle is operated for the purpose of simply inquiring the vehicle track of the photographed vehicle, not for the purpose of control.

At this time, the control unit 31 inputs the vehicle number received from the auxiliary control unit 5 through the communication interface unit 33 to the vehicle tracking management unit 37 when the vehicle tracking management unit 37 is driven.

8 is a block diagram illustrating a vehicle tracking management unit of FIG. 7.

As shown in FIG. 8, the track inquiry management unit 37 includes a GPS information detection module 371, a track inquiry request data generation module 372, a determination module 373, a display module 374, and a track tracking module ( 375).

The GPS information detection module 371 detects GPS information of the intermittent vehicle 1.

The vehicle inquiry request data generation module 372 generates vehicle inquiry request data including vehicle number information input by the controller 31 and GPS information detected by the GPS information detection module 371.

At this time, the controller 31 controls the communication interface unit 33 to transmit the vehicle inquiry request data generated by the vehicle inquiry request data generation module 372 to an external control center server, and the vehicle inquiry request data from the external control center server. When receiving the inquiry result data corresponding to, the received inquiry result data is input to the vehicle inquiry management unit 37, and the vehicle inquiry management unit 37 inputs the input inquiry result data to the determination module 373.

The determination module 373 determines whether the enforcement of the vehicle requesting the vehicle inquiry is required based on the input inquiry result data.

In addition, if it is determined that the crackdown of the vehicle that has requested the vehicle inquiry is not necessary, the determination module 373 does not perform a separate operation. If it is determined that the crackdown of the vehicle that has requested the vehicle inquiry is necessary, the display module 374 and the trajectory are performed. The tracking module 375 is driven.

The display module 374 is driven when it is determined by the determination module 373 that the vehicle inquired by the vehicle is determined to be necessary. The display module 374 expresses a notification message through the touch screen 11 so that the driver of the enforcement vehicle 1 receives the notification message. To quickly recognize this.

The locus tracking module 375 generates locus information of the intermittent vehicle 1 using the GPS information detected by the GPS information detection module 371.

At this time, the control unit 31 controls the communication interface unit 33 so that the locus information generated by the locus tracking module 375 is transmitted to the control center server periodically.

9 is a block diagram illustrating an interruption processor of FIG. 7.

As illustrated in FIG. 9, the enforcement processing unit 38 includes an illegal parking control unit 381 driven when operated in an illegal parking control mode, and an illegal stop control unit 382 driven when operated in an illegal stop control mode. Is done.

In this case, the illegal parking control mode refers to when the vehicle is operated for the purpose of cracking down on illegally parked vehicles in the illegal parking area, and the illegal parking control mode refers to the operation of the illegally parked vehicle for the purpose of controlling the illegally parked vehicle.

The illegal parking control unit 381 includes a first number recognition module 3811, a first front and rear image extraction module 3812, a first number recognition module 3813, a first vehicle number combination module 3814, and illegal parking. It consists of an interruption information generation module 3815.

The first number recognition determining module 3811 determines whether the vehicle number of the illegally parked vehicle has been recognized. Specifically, if the vehicle number is received from the auxiliary control unit 5, the vehicle number recognition has been normally performed. In operation, the illegal parking control information generation module 3815 is driven.

In addition, if the first number recognition determination module 3811 receives error data indicating that an error has occurred in the vehicle number recognition from the auxiliary control unit 5, the first number recognition determination module 3811 determines that the vehicle number recognition has not been normally performed, and the first front and rear image extraction module is determined. 338 is driven.

For example, when the license plate of an illegally parked vehicle is covered by another vehicle, the auxiliary control unit 5 fails to recognize the vehicle number and transmits error data to the controller 3, and illegal parking of the auxiliary control unit 5 is performed. The first number recognition determination module 3811 of the enforcement unit 381 determines that the vehicle number recognition has not been normally performed when the error data is received from the auxiliary control unit 5, and responds to this.

The first front and rear image extraction module 3812 is driven when it is determined that the vehicle number recognition is not normally performed by the first number recognition determination module 3811, and extracts the front image and the rear image of the vehicle.

That is, the first front and rear image extraction module 3812 extracts the front image and the rear image of the vehicle in which the number recognition error has occurred, and inputs the extracted front image and the rear image to the first number recognition module 3813.

The first number recognition module 3813 detects the front license plate and the rear license plate by analyzing the front image and the rear image input from the first front and rear image extraction module 3812 using a preset image analysis algorithm.

In addition, the first number recognition module 3814 detects the front vehicle number and the rear vehicle number by analyzing the front license plate and the rear license plate detected using a preset number recognition algorithm.

10A is an exemplary view showing a rear license plate for the vehicle C1, and (b) is an exemplary view showing a front license plate for the vehicle C1.

As illustrated in (a) of FIG. 10, when the intermittent vehicle 1 is parked densely in front of and behind the illegally parked vehicle C1, the first camera 161 moves to the rear of the vehicle C1. The auxiliary control unit 5 recognizes only a partial vehicle number of the left region of the rear license plate 910 from the rear image of the vehicle C1 obtained by the first camera 161.

In this state, when the intermittent vehicle 1 moves, as shown in FIG. 10B, the second camera 162 photographs the front of the vehicle C1, and thus the auxiliary control unit 5 Only the partial vehicle number of the right area of the front license plate 920 is recognized from the front image of the vehicle C1 acquired by the second camera 162.

At this time, if the vehicle number is recognized in at least one of the front image and the rear image, the auxiliary control unit 5 transmits the recognized vehicle number to the controller 3, and if both the vehicle number of the front image and the rear image are recognized. If not, transmit the error data to the controller (3).

FIG. 11 is an exemplary diagram for describing a first vehicle number combination module of FIG. 9.

As illustrated in FIG. 11, the first license plate combination module 3814 combines a part of the rear license plate 910 and a part of the front license plate 920 detected by the first number recognition module 3814. .

In addition, the first vehicle number combination module 3814 determines that the vehicle number combination is normally performed when the number of the combined vehicle numbers is equal to the preset threshold, and drives the illegal parking control information generation module 3815.

In addition, the first vehicle number combination module 3814 determines that the vehicle number combination is not normally performed if the number of numbers of the combined vehicle numbers is not equal to the threshold, and does not perform a separate operation.

The illegal parking control information generation module 3815 determines that the vehicle number recognition is normally performed by the first number recognition determining module 3811 or when the vehicle number combination is normally performed by the first vehicle number combination module 3814. Driven.

In addition, the illegal parking control information generation module 3815 may include a vehicle number input from the first number recognition determination module 3811 or the first vehicle number combination module 3814, an image frame from which the license plate is detected, GPS information and a shooting time. Generate illegal parking control information including information.

The generated illegal parking control information is transmitted to the control center server under the control of the control unit 31, and the control center server processes the received illegal parking control information and charges the vehicle driver a fine for illegal parking.

Returning to FIG. 9 again, the illegal stop control unit 382 includes an illegal stop control unit 382 that includes a second number recognition determination module 3811, a second front and rear image extraction module 3822, and a second number recognition module 3831. ), The second vehicle number combination module 3824, illegal stop control determination module 3825, thermal image analysis module 3826, human body detection module 3827, notification module 3828, illegal stop control information generation module ( 3829).

The second number recognition determining module 3811 determines whether the vehicle number of the illegally stopped vehicle is normally recognized.

In addition, if the second number recognition determining module 3811 receives the vehicle number from the auxiliary control unit 5, it determines that the vehicle number recognition has been normally performed, and inputs the vehicle number to the illegal stop control determination module 3825.

In addition, if the second number recognition determining module 3811 receives error data indicating that an error has occurred in the vehicle number recognition from the auxiliary control unit 5, the second number recognition determining module 3811 determines that the vehicle number recognition has not been normally performed, and the second front and rear image extraction module is determined. (3822) is driven.

The second front and rear image extraction module 3822 is driven when it is determined that the vehicle number recognition is not normally performed by the second number recognition determination module 3811, and extracts the front image and the rear image of the vehicle.

That is, the second front and rear image extraction module 3822 extracts the front image and the rear image of the vehicle where the number recognition error has occurred, and inputs the extracted front image and the rear image to the second number recognition module 3831.

The second number recognition module 3823 detects the front license plate and the rear license plate by analyzing the front image and the rear image input from the second front and rear image extraction module 3822 using a preset image analysis algorithm.

In addition, the second number recognition module 3823 detects the front vehicle number and the rear vehicle number by analyzing the front license plate and the rear license plate detected using a preset number recognition algorithm.

The second license plate combination module 3824 has the same method and configuration as the first license plate combination module 3814 of FIG. 11 described above, and the rear license plate 910 detected by the second license plate 3827. And a part of the front license plate 920.

In addition, the second vehicle number combination module 3824 determines that the vehicle number combination is normally performed when the number of numbers of the combined vehicle number is equal to the preset threshold, and drives the illegal stop control determination module 3825.

In addition, the second vehicle number combination module 3824 determines that the vehicle number combination is not normally performed if the number of the combined vehicle numbers is not equal to the threshold, and does not perform a separate operation.

The illegal stop control determination module 3825 is driven when the vehicle number recognition is normally performed by the second number recognition determination module 3811 or when the vehicle number combination is normally performed by the second vehicle number combination module 3824. do.

The illegal stop control determination module 3825 determines whether the entered vehicle number is entered before the preset period T, and if the entered vehicle number is the vehicle number that was first input during the preset period T. The thermal image analysis module 3826 is driven.

That is, the illegal stop control module 3825 determines that the analysis of the thermal image is necessary when the illegally parked vehicle is first photographed in the illegal stop zone.

In addition, the illegal stop control module 3825 calculates an elapsed time t, which is a difference between an initial input time of the vehicle number and a current input time if the input vehicle number is input before a preset period T. After that, if the calculated elapsed time t is greater than or equal to the preset enforcement time T1, the vehicle is determined as an illegal vehicle enforcement vehicle, and the illegal vehicle regulation information generation module 3829 is driven.

The thermal image analysis module 3826 proceeds with the illegal stop control determination module 3825 when the vehicle number is first input.

In addition, the thermal image analysis module 3826 analyzes the thermal image acquired by the thermal camera 163 using a preset thermal analysis algorithm.

The human body detecting module 3827 determines whether the human body is located inside the vehicle through the thermal image analysis module 3826.

In addition, the human body detection module 3827 generates driver location information if a human body is detected inside the vehicle.

The notification module 3828 is driven when a human body is detected inside the vehicle by the human body detection module 3827, and outputs a warning broadcast informing the driver of the illegal stop zone.

The illegal stop control information generation module 3829 includes a vehicle number of a vehicle determined as an illegal stop control vehicle by the illegal stop control determination module 3825, an image frame in which a license plate is detected, a thermal image of the vehicle, and driver location information. And illegal stop control information including GPS information and shooting time information.

The generated illegal parking control information is transmitted to the control center server under the control of the control unit 31, and the control center server processes the received illegal parking control information and charges the vehicle driver a fine for illegal parking.

As such, the intermittent vehicle 1 according to the embodiment of the present invention uses the thermal imaging camera 163 for the vehicle first photographed in the illegal stop control mode to determine driver position information whether the human body is located inside the vehicle. It can be configured to generate accurate evidence of illegal stops.

delete

delete

In addition, the intermittent vehicle 1 of the present invention has a rear vehicle number and a vehicle number detected from the rear image and the front image obtained by the first and second cameras when an error occurs in the vehicle number recognition in the illegal parking or illegal stop control mode. By detecting the vehicle number in combination, the vehicle number can be accurately detected even if the vehicle number is not detected because it is hidden by other parked vehicles.

1: control vehicle 3: controller 5: auxiliary control unit
9: Battery 11: Touch screen 12: Speaker
13: Keyboard 14: Microphone 16: Camera unit
17: lighting unit 18: electric sign 31: control unit
32: memory 33: communication interface 34: pan-tilt drive
35: trigger signal generator 36: accessory drive unit
37: Vehicle inquiry management unit 38: Enforcement processing unit

Claims (5)

A camera unit installed at one side of the vehicle;
An auxiliary control unit for detecting a vehicle number by analyzing the image photographed by the camera unit;
A controller including a track inquiry management unit for generating track inquiry request data including a vehicle number, GPS information, an image, and photographing time information received from the auxiliary control unit in a track inquiry mode and transmitting the vehicle inquiry request data to an external control center server;
First accessory devices configured to perform a preset operation according to the control of the controller;
Second accessory equipments configured to perform a preset operation according to the control of the auxiliary controller;
The camera unit further includes a first camera pan-tilt controlled to photograph the front of the vehicle, and a second camera pan-tilt controlled to photograph the rear of the vehicle,
The auxiliary control unit transmits the error data to the controller if the vehicle number is not recognized,
The controller further includes an illegal parking control unit that is driven in an illegal parking control mode.
The illegal parking control unit
A first number recognition determining module determining that number recognition is normally performed when receiving the vehicle number from the auxiliary control unit, and determining that a number recognition has occurred when receiving error data from the auxiliary control unit;
It is driven when it is determined that there is a failure in number recognition by the first number recognition determination module, a rear image which is an image by the first camera and a front image which is an image by the second camera for a vehicle that has a number recognition disorder. A first front and rear image extraction module for extracting the image;
A first number recognition module that detects the front license plate and the rear license plate by analyzing the front image and the rear image extracted by the first front and rear image extraction module, and then detects the front vehicle number and the rear vehicle number;
A first vehicle number combination module for combining the front vehicle number and the rear vehicle number by the first number recognition module, and determining that the vehicle number combination is normally performed when the number of the combined vehicle numbers is equal to a preset threshold;
And an illegal parking control information generation module for generating illegal parking control information including the vehicle number inputted from the first number recognition determination module or the first vehicle number combination module and the corresponding video frame, GPS information, and shooting time information. and,
The illegal parking control unit transmits illegal parking control information generated by the illegal parking control information generation module to the control center server.
The controller further includes an illegal stop control unit that is driven in the illegal stop control mode.
The illegal stop control unit
A second number recognition determining module determining that number recognition is normally performed when receiving the vehicle number from the auxiliary control unit, and determining that a number recognition has occurred when receiving error data from the auxiliary control unit;
It is driven when it is determined that there is a failure in number recognition by the second number recognition determining module, the second image front and rear by the first camera and the front image of the second camera for the vehicle number recognition failure occurs Image extraction module;
A second number recognition module that detects the front vehicle license plate and the rear vehicle license plate and detects the front vehicle number and the rear vehicle number by analyzing the front image and the rear image extracted by the second front and rear image extraction module;
A second vehicle number combination module which combines the front vehicle number and the rear vehicle number by the second number recognition module, and determines that the vehicle number combination is normally performed when the number of the combined vehicle numbers is equal to a preset threshold;
It is driven when it is determined that the vehicle number recognition is normally performed by the second number recognition determination module or when the vehicle number combination is normally performed by the second vehicle number combination module. Generates and stores a list matching the shooting time information, searches for whether the input vehicle number has been input before a preset period T, and inputs the corresponding vehicle number between the period T and the present. If there is, the elapsed time (t), which is the difference between the initial input time of the vehicle number and the current input time, is calculated, and the vehicle is illegally stopped if the calculated elapsed time (t) is greater than or equal to the preset enforcement time (T1). Illegal stop crackdown determination module for determining the crackdown vehicle;
And an illegal stop control information generation module for generating illegal stop control information including a vehicle number of the vehicle determined as the illegal stop control vehicle by the illegal stop control module and a corresponding video frame, GPS information, and shooting time information.
The illegal stop control unit transmits illegal stop control information generated by the illegal stop control information generation module to the control center server,
The camera unit is manufactured integrally with the first camera and is controlled at the same pan-tilt angle as the first camera, and further includes a thermal imaging camera which is driven in an illegal stop control mode to obtain a thermal image.
The illegal stop control unit
When the vehicle number input by the illegal stop control module has not been input between the current period before the current period (T) and is driven, the heat obtained by the thermal imaging camera using a preset thermal analysis algorithm A thermal image analysis module for analyzing the image image;
A human body sensing module for determining whether a person is located in the vehicle through the thermal image analysis module, and generating driver position information indicating that the human body is located in the vehicle if it is determined that the human body is located in the vehicle;
When the driver location information is generated by the human body detection module is driven, and further comprises a notification module for outputting a warning broadcast indicating that the illegal stop zone,
The illegal stop control information generation module may further include the driver's location information in the illegal stop control information. delete delete delete delete

Images