KR102100904B1 - System and Method for monitoring Handicapped Parking Zone - Google Patents

Abstract

The present invention relates to a system for monitoring a disabled parking area and to a method thereof. According to the present invention, the system for monitoring a disabled parking area comprises: a camera for photographing an image of a vehicle parked in a disabled parking area; a vehicle number recognition device correcting distortion of the photographed image of the camera and recognizing a vehicle number; and a display device displaying the disabled parking area on a screen until the image of the vehicle is photographed by the camera, and displaying at least one of the vehicle and the vehicle number on the screen when the vehicle number recognition device recognizes the vehicle number. Non-disabled drivers parking in the disabled parking area can be warned of illegal parking.

Description

System and Method for monitoring Handicapped Parking Zone

The present invention relates to a system and method for monitoring a parking area for a disabled person, and to a system and method for monitoring a parking area for a disabled person capable of providing information on whether or not parking is available to a driver who wants to park in the parking area for the disabled.

The handicapped parking area is a partitioned area for disabled people with disabilities to use the parking lot safely and conveniently. The parking area for the disabled is marked with an identification mark such as a logo for the disabled on the floor, indicating that it is an area where only the disabled can park. On the other hand, parking spaces for the disabled are generally located near the entrance of the building so that the disabled can use them easily.

However, due to the lack of parking facilities, non-disabled drivers often park illegally in parking spaces for people with disabilities, and drivers with disabilities often experience difficulties in parking. In other words, contrary to the purpose of the parking area for the disabled, complaints have been raised due to illegal parking of non-disabled persons in the parking area for the disabled, but the crackdown is insignificant.

In order to solve this problem, the present applicant filed a patent for 'How to crack down on vehicles for parking areas for the disabled only' and was registered on May 11, 2018 as a registered patent No.1859342. However, this method does not provide any information on whether or not to crack down on the parking for drivers parking in the disabled parking area. On the other hand, there is a case where it is necessary to check whether a vehicle parked in a parking area using a camera is a vehicle that can be parked in the parking area. Things often happen.

In order to solve the above-described problems, the present invention aims to provide a system and method for monitoring a parking area for a disabled person who can provide information on whether or not parking is available to a driver who wants to park in the parking area for a disabled person.

In addition, the present invention is to provide a disabled parking zone monitoring system and method capable of accurately recognizing a vehicle number by correcting geometric distortion of a vehicle license plate photographed by a camera using a virtual reference line displayed in a space of a parking zone for the disabled. Is done.

In order to achieve the above object, a disabled parking zone monitoring system according to an embodiment of the present invention includes a camera for photographing an image of a vehicle parked in a disabled parking zone; A vehicle number recognition device that corrects distortion of a captured image of the camera and recognizes a vehicle number; And displaying a disabled parking area on a screen until the vehicle image is captured by the camera, and when the vehicle number recognition device recognizes the vehicle number, displays at least one of the vehicle and the vehicle number on the screen. Provided is a display device.

The parking area monitoring system for the disabled may further include a server storing vehicle information registered as a vehicle for the disabled, and the vehicle number recognition device transmits the recognized vehicle number to the server and confirms information transmitted from the server It is determined whether the parking is illegal, and in the case of illegal parking, an X may be displayed in red on the screen displaying at least one of the vehicle and the vehicle number.

The camera may further include a reference line together with the image of the vehicle, and the vehicle recognition device may obtain a reference line from the captured image of the camera and correct the three-dimensional geometrical distortion of the captured image using the reference line. A 3D correction processing unit for generating and outputting a 3D correction image, a license plate image processing unit for detecting a contour of a vehicle license plate from the 3D correction image output from the 3D correction processing unit, and obtaining a license plate image, and the license plate image It may be provided with a vehicle number recognition unit for recognizing the vehicle number from the vehicle license plate image obtained by the processing unit.

The 3D correction processing unit selects a predetermined rectangular area from the reference line, obtains an inclination angle of the rectangular area using coordinates of the rectangular area, and applies the affine transformation by the inclination angle to the rectangular area to apply the 3D Can correct geometric distortion.

The 3D correction processor designates LB (lower left) and RB (lower right) positions based on the coordinate values of the reference line, and LT (left) at a predetermined height from the size of the captured image based on the LB and RB positions The rectangular area may be selected by designating positions of the upper part) and the upper right part (RT).

The 3D correction processing unit may correct the geometrical distortion of the 3D by applying a shear transformation by the inclination angle to the rectangular region.

The license plate image processing unit detects the longest straight line of the vehicle license plate image, obtains a rotation angle using the coordinates of the longest straight line, and applies a rotational conversion by the rotation angle to the vehicle license plate image, thereby providing geometrical distortion in two dimensions. By correcting, a vehicle license plate correction image may be output.

According to another embodiment of the present invention, a method for monitoring a parking area for a disabled person performed by a parking area monitoring system for a disabled person having a camera, a vehicle number recognition device, and a display device is performed until an image of a vehicle is taken with the camera. Displaying information indicating that the vehicle number recognition device is a disabled parking area on a screen of the display device; Photographing an image of the vehicle parked in a disabled parking zone with the camera; Correcting distortion of the captured image of the camera and recognizing a vehicle number in the vehicle number recognition device; And when the vehicle number recognition device recognizes the vehicle number, providing the step of displaying at least one of the vehicle and the vehicle number on the screen, thereby achieving the above object.

By the above-described configuration, the present invention can warn the non-disabled driver parking in the disabled parking area that it is an audiovisual illegal parking.

In addition, the present invention can prevent non-disabled vehicles from being parked by accurately recognizing the vehicle number of the vehicle parked in the disabled parking zone.

1 is a block diagram of a parking zone monitoring system for a disabled person according to an embodiment of the present invention.
2 is a view showing a disabled parking zone and a rotating camera.
3A is a diagram illustrating an example of a screen indicating that the parking area is for the disabled on a display device.
3B is a diagram showing an example of a screen displaying a vehicle and a vehicle number on a display device.
FIG. 4 is a block diagram of the vehicle number recognition device illustrated in FIG. 1.
5A is a diagram showing an example of setting a rectangular area for correcting geometric distortion in 3D.
5B is a diagram showing an example of obtaining an inclination angle of a rectangular area.
5C is a diagram illustrating an example of a 3D corrected image in which 3D geometric distortion is corrected.
6A is a diagram showing an example of a vehicle license plate image obtained from a 3D corrected image.
6B is a diagram showing an example of a vehicle license plate correction image in which two-dimensional geometric distortion of a vehicle license plate image is corrected.
7 is a flowchart illustrating a method for monitoring a parking space for a disabled person according to another embodiment of the present invention.

Hereinafter, a preferred embodiment of a system and method for monitoring a parking space for a disabled person according to the present invention will be described with reference to the accompanying drawings. For reference, in the following description of the present invention, the terms referring to the components of the present invention are named in consideration of the function of each component, and should not be understood as a meaning limiting the technical components of the present invention. Will be.

1 is a block diagram of a parking area monitoring system for a disabled person according to an embodiment of the present invention, FIG. 2 is a view showing a parking area for a disabled person and a rotating camera, and FIG. 3A is a parking space for a disabled person on a display device FIG. 3B is a diagram showing an example of a screen indicating a zone, and FIG. 3B is a diagram showing an example of a screen displaying a vehicle and a vehicle number on a display device.

As shown in FIG. 1, a parking sign monitoring system for a disabled person may include a camera 110, a vehicle number recognition device 120, an audio output device 130, a display device 140, and a server 150. In FIG. 1, the camera 110, the vehicle number recognition device 120, the sound output device 130, and the display device 140 are illustrated separately, but since these distinctions are not physical distinctions, these configurations are integrally implemented. It can also be installed on a structure (not shown).

The camera 110 photographs an image of a vehicle. The camera 110 is preferably a fixed camera installed in the parking area for the disabled, but may be a rotating camera capable of taking a picture of each vehicle parked in the parking area for the disabled while rotating. In Fig. 2, a disabled parking zone and a rotating camera are shown.

 The rotatable camera 110 may photograph a vehicle in the parking zone on the leftmost side and rotate the vehicle to the right at a predetermined angle to photograph the vehicle in the parking zones. The rotating camera 110 may also photograph a vehicle in the parking zones while rotating only a predetermined parking zone, that is, three parking zones at a predetermined angle. In this case, the camera 110 photographs the vehicle and the parking line in front of the vehicle as one image. In the present invention, including the parking line, a predetermined line displayed in the parking area for the disabled can be used as a reference line.

The vehicle number recognition device 120 corrects distortion of a captured image of the camera 110 and recognizes a vehicle number. The vehicle number recognition device 120 transmits the recognized vehicle number to the server 150 when the vehicle number is recognized, and receives information from the server 150 that the vehicle parked in the disabled parking zone is not registered as a disabled vehicle. Decide on illegal parking. The vehicle number recognition device 120 may be configured with a computer, and a description related to the reference line will be described later.

The sound output device 130 is a device for warning a driver through sound such as broadcast when it is determined that the vehicle number recognition device 120 is illegally parking. The sound output device 130 may be a speaker, a buzzer, or a piezo sensor that can trigger an alarm.

The display device 140 is a device for warning a driver of a screen display when it is determined that the vehicle number recognition device 120 is illegally parking. The display device 140 may be a liquid crystal display device, an organic light emitting diode device, or a flexible display device. 3A shows an example of a screen indicating that the parking space is exclusively for the disabled on the display device 140, and FIG. 3B shows an example of a screen displaying a vehicle and a vehicle number on the display device 140. Although the vehicle and the vehicle number are displayed on the display device 140 in FIG. 3B, an X mark may be further added in red to the vehicle to be easily seen by the driver. In this case, the red X may flash to increase the intensity of the alarm.

The server 150 stores, for example, vehicle information registered as a disabled vehicle. The server 150 may notify the vehicle number recognition device 120 of the confirmation information after confirming whether the vehicle number transmitted from the vehicle number recognition device 120 is registered vehicle information. The server 150 stores the control information of the parking area for the disabled, and the control information can be transmitted to a manager's mobile phone (not shown) or the like.

FIG. 4 is a block diagram of the vehicle number recognition device illustrated in FIG. 1, FIG. 5A is a diagram showing an example of setting a rectangular area for correcting three-dimensional geometric distortion, and FIG. 5B is a rectangular area 5C is a diagram showing an example of obtaining an inclination angle of FIG. 5C is a diagram showing an example of a 3D correction image correcting 3D geometric distortion, and FIG. 6A is an example of a vehicle license plate image obtained from a 3D correction image 6B is a view showing an example of a vehicle license plate correction image in which two-dimensional geometric distortion of a vehicle license plate image is corrected.

As shown in FIG. 4, the vehicle number recognition device 120 includes a three-dimensional correction processing unit 402, a license plate image processing unit 404, a vehicle number recognition unit 406, a wired / wireless communication unit 408, and an illegal parking determination unit ( 410) and a display control unit 412.

The 3D correction processing unit 402 obtains a reference line from the captured image of the camera 110, corrects geometric distortion in 3D using the reference line, and outputs a 3D corrected image. The 3D correction processing unit 402 selects a predetermined rectangular area from a reference line to correct a geometrical distortion in 3D, obtains an inclination angle of the rectangular area using coordinates of the rectangular area, and is 3 by an inclination angle with respect to the rectangular area. Apply dimensional affine transformation.

5 shows an example of setting such a rectangular area to correct three-dimensional geometric distortion.

As shown in FIG. 5A, the 3D correction processing unit 402 sets the lower leftmost point of the captured image input from the camera 110 as coordinates (0, 0), and the left side of the drawn parking line in front of the vehicle. The coordinate value of the lower point is designated as LB (x1, y1), and the coordinate value of the lower right point is designated as RB (x1, y1). The 3D correction processing unit 402 LT coordinates the coordinate values of the upper left point of a predetermined height, for example, 1/3 height, from the size of the input image based on LB (x1, y1) and RB (x2, y2). x3, y3), and the coordinate values of the upper right point are designated as RT (x4, y4). The three-dimensional correction processing unit 402 connects these four points (LB, RB, LT, RT) to select a rectangular area.

5B is a diagram showing an example of obtaining an inclination angle of a rectangular area.

As shown in FIG. 5B, the 3D correction processing unit 402 is based on the coordinates (x1, y2) based on the coordinates LB (x1, y1) of the lower left point designated and the coordinates RB (x2, y2) of the lower right point. ). The 3D correction processing unit 402 assumes LB (x1, y1), RB (x1, y1) and coordinates (x1, y2) as triangles and applies the Pythagorean theorem of Equation 1 and the inclination angle (θ) To get

Here, A is the length of the longest hypotenuse among the three hypotenuses of the triangle, and B is the length of the other hypotenuse constituting the angle θ.

The 3D correction processing unit 402 generates a 3D correction image by applying an affine transformation by a tilt angle θ to the red rectangular region illustrated in FIG. 5B using the obtained tilt angle θ. Affine transformations include transformations such as scaling, rotation, or shearing. In FIG. 5B, since shear transformation is required, the transformation is performed using Equation (2).

Here, hx and hy are horizontal and vertical shear elements, respectively, Rect _image is a rectangular region indicated in red in FIG. 5B, and the result _image is a 3D correction image corrected for 3D geometric distortion illustrated in FIG. 5C.

In FIGS. 5A and 5B, the rectangular area was first obtained and then the inclination angle of the rectangular area was obtained, but the inclination angle was first obtained using the reference line, and the inclination angle was selected using the inclination angle to select the rectangular area at a predetermined height. You can. In this case, rotation transformation may be used as an affine transformation.

The license plate image processing unit 404 detects the outline of the vehicle license plate from the 3D correction image output from the 3D correction processing unit 402 to obtain a vehicle license plate image and corrects geometric distortion of 2D in the license plate image. After detecting the contour of the license plate, the license plate image processing unit 404 detects the longest straight line of the license plate image and uses the coordinates of the longest straight line to obtain the angle that needs to be corrected and applies affine transformation by the angle to the license plate image. By doing so, two-dimensional geometric distortion can be corrected.

The license plate image processing unit 404 may apply a sobel edge detector of Equation 3 to detect the outline of the vehicle license plate from the 3D correction image output from the 3D correction processing unit 402.

는 Gx로 x 방향 경사도이다.Here, the result _image is a 3D correction image in which the 3D geometric distortion shown in FIG. 5C is corrected, and the edge image is a vehicle license plate contour image detected from the 3D correction image,

Gx is the slope in the x direction.

The license plate image processing unit 404 obtains a vehicle license plate image from a 3D corrected image using a vehicle license plate contour image. 6A shows an example of a vehicle license plate image obtained from a 3D corrected image using a vehicle license plate contour image.

The license plate image processing unit 404 calculates the length by applying the Euclidean distance method to the start and end points of the vehicle license plate image. The license plate image processing unit 404 detects the longest straight line among the calculated lengths. The license plate image processing unit 404 sets the left point of the longest straight line as the coordinates (0, 0) and designates the coordinate value of the right point as the coordinates (x1, y1). The rotated angle is calculated by comparing it with a horizontal straight line that is 0 degrees from the starting point of the longest straight line. This calculation can be performed using Equation (1).

The license plate image processing unit 404 may obtain a corrected vehicle license plate correction image by rotating in a clockwise or counterclockwise direction by applying a two-dimensional affine transformation of Equation 4 to the detected angle with respect to the vehicle license plate image.

는 회전 변환 매트릭스이다.Here, the Carplate _image is the license plate image, and the Rotationimage is the vehicle license plate correction image.

Is a rotation transformation matrix.

6B shows an example of such a vehicle license plate correction image in which two-dimensional geometric distortion of the vehicle license plate image is corrected.

The vehicle number recognition unit 406 recognizes the vehicle number from the vehicle license plate image acquired by the license plate image processing unit 404.

When the vehicle number is recognized by the vehicle number recognition unit 406, the wired / wireless communication unit 408 transmits the recognized vehicle number to the server 150 and receives confirmation information from the server 150.

The illegal parking determination unit 410 determines whether illegal parking is performed from the verification information transmitted from the server 150, for example, information that a vehicle parked in a disabled parking zone is not registered as a disabled vehicle.

The display control unit 412 displays the disabled parking zone shown in FIG. 3A on the screen until the camera 110 shoots an image of the vehicle, and when the vehicle number recognition unit 406 recognizes the vehicle number, it is displayed on the screen. The vehicle and the vehicle number are displayed. If illegal parking, the display control unit 412 may display an X in red on a screen displaying a vehicle and a vehicle number.

7 is a flowchart illustrating a method for monitoring a parking space for a disabled person according to another embodiment of the present invention.

Until the vehicle 110 is photographed by the camera 110, the display control unit 412 displays the disabled parking area as shown in FIG. 3A on the screen of the display device 140 (S702).

The camera 110 checks whether a new vehicle is parked in the disabled parking area. For example, the rotatable camera 110 may photograph a vehicle in the leftmost parking area and photograph a vehicle in the parking areas while rotating to the right at a predetermined angle. In this case, the camera 110 photographs the vehicle and the parking line in front of the vehicle as one image (S704).

The 3D correction processing unit 402 obtains a reference line from the captured image of the camera 110 and corrects the 3D geometric distortion using the reference line of the captured image to generate and output a 3D corrected image (S706). The 3D correction processing unit 402 selects a predetermined rectangular area from a reference line to correct the geometric distortion in 3D and obtains an inclination angle of the rectangular area using coordinates of the rectangular area. The 3D correction processing unit 402 generates a 3D correction image by applying an affine transformation by a tilt angle θ to the rectangular area using the obtained tilt angle θ.

The license plate image processing unit 404 detects the contour of the vehicle license plate from the 3D correction image output from the 3D correction processing unit 402 to obtain a vehicle license plate image and corrects a geometrical distortion of 2D to the license plate image (S708). ). After detecting the outline of the vehicle license plate, the license plate image processing unit 404 detects the longest straight line of the vehicle license plate image and uses the coordinates of the longest straight line to obtain an angle that needs to be corrected. The license plate image processing unit 404 may obtain a corrected vehicle license plate correction image by rotating in a clockwise or counterclockwise direction by applying a two-dimensional affine transformation to an angle detected for the vehicle license plate image.

The vehicle number recognition unit 406 recognizes the vehicle number from the vehicle license plate correction image corrected by the license plate image processing unit 404 (S710). When the vehicle number recognition unit 406 recognizes the vehicle number, the display control unit 412 displays the vehicle and the vehicle number on the screen of the display device 140 (S712).

When the vehicle number is recognized by the vehicle number recognition unit 406, the wired / wireless communication unit 408 transmits the recognized vehicle number to the server 150 (S714). After confirming whether the vehicle number transmitted from the vehicle number recognition device 120 is registered vehicle information, the server 130 notifies the vehicle number recognition device 120 of the confirmation information (S716).

The illegal parking determining unit 410 determines whether illegal parking is performed from the verification information transmitted from the server 150, for example, information that a vehicle parked in a disabled parking zone is not registered as a disabled vehicle (S718). If illegal parking, the display control unit 412 displays an X in red on the screen displaying the vehicle and the vehicle number (S720).

The embodiments of the present invention described above are merely illustrative of the technical idea of the present invention, and the protection scope of the present invention should be interpreted by the claims below. In addition, those skilled in the art to which the present invention pertains will be able to make various modifications and variations without departing from the essential characteristics of the present invention, and all technical ideas within the scope equivalent to the present invention are the present invention. It should be interpreted as being included in the scope of the rights of.

110: camera 120: vehicle number recognition device
130: sound output device 140: display device
150: server 402: 3D correction processing unit
404: License plate image processing unit 406: Vehicle number recognition unit
408: wired and wireless communication unit 410: illegal parking decision unit
412: display control

Claims (10)

A camera for photographing an image of a vehicle parked in a disabled parking area;
A vehicle number recognition device that corrects distortion of a captured image of the camera and recognizes a vehicle number; And
A display that displays a parking space for a disabled person on a screen until the vehicle image is captured by the camera, and displays at least one of the vehicle and the vehicle number on the screen when the vehicle number recognition device recognizes the vehicle number. Device,
The camera is taken by further including a reference line with the image of the vehicle,
The vehicle number recognition apparatus obtains a reference line from a line outside the vehicle of the captured image of the camera, and corrects the three-dimensional geometrical distortion of the captured image using the reference line to generate and output a 3D corrected image. A license plate image processing unit for detecting a contour of a vehicle license plate from a 3D correction image output from the 3D correction processing unit, and a license plate image processing unit for obtaining a vehicle license plate image, and a vehicle number from the vehicle license plate image acquired by the license plate image processing unit. Parking area monitoring system for a disabled person, characterized in that it comprises a vehicle number recognition unit to recognize. According to claim 1,
Further comprising a server that stores vehicle information registered as a vehicle for the disabled,
The vehicle number recognition device transmits the recognized vehicle number to the server and determines whether it is illegal parking from the identification information transmitted from the server, and in the case of illegal parking, the screen displaying at least one of the vehicle and the vehicle number Parking area monitoring system for the disabled, characterized by displaying an X in red. delete The method according to claim 1 or 2,
The 3D correction processing unit selects a predetermined rectangular area from the reference line, obtains an inclination angle of the rectangular area using coordinates of the rectangular area, and applies the affine transformation by the inclination angle to the rectangular area to apply the 3D Parking zone monitoring system for the disabled, characterized in that to correct the geometric distortion of the. According to claim 4,
The 3D correction processor designates LB (lower left) and RB (lower right) positions based on the coordinate values of the reference line, and LT (left) at a predetermined height from the size of the captured image based on the LB and RB positions Parking area monitoring system for the disabled, characterized in that the rectangular area is selected by designating positions of the upper part) and RT (upper right). The method of claim 5,
The 3D correction processing unit applies a shear transformation by the inclination angle to the rectangular area to correct the geometric distortion of the 3D parking area. The method according to claim 1 or 2.
The license plate image processing unit detects the longest straight line of the vehicle license plate image, obtains a rotation angle using the coordinates of the longest straight line, and applies a rotational conversion by the rotation angle to the vehicle license plate image, thereby providing geometrical distortion in two dimensions. Parking area monitoring system for the disabled, characterized by outputting a vehicle license plate correction image by correcting. In the parking area monitoring method for a disabled person performed by a parking area monitoring system for a disabled person having a camera, a vehicle number recognition device and a display device
Displaying information indicating that the vehicle number recognition device is a parking space for a disabled person on the screen of the display device until the camera captures an image of the vehicle;
Photographing an image of the vehicle parked in a disabled parking zone with the camera;
Correcting distortion of the captured image of the camera and recognizing a vehicle number in the vehicle number recognition device; And
And when the vehicle number recognition device recognizes the vehicle number, displaying at least one of the vehicle and the vehicle number on the screen.
The photographing step further includes taking a reference line together with the image of the vehicle with the camera,
Recognizing the vehicle number,
Obtaining a reference line from a line outside the vehicle of the captured image of the camera of the camera, and generating and outputting a 3D corrected image by correcting 3D geometric distortion of the captured image using the reference line;
Obtaining a vehicle license plate image by detecting an outline of a vehicle license plate from the 3D calibration image output in the step of outputting the 3D correction image; And
And recognizing a vehicle number from the vehicle license plate image obtained in the step of obtaining the vehicle license plate image. delete The method of claim 8,
In the step of outputting the 3D corrected image, a predetermined rectangular area is selected from the reference line, the inclination angle of the rectangular area is obtained using coordinates of the rectangular area, and affine transformation is applied to the rectangular area by the inclination angle. The 3D geometric distortion correction method, characterized in that for correcting the parking area for the disabled.

Images