KR102297169B1 - Vehicel management system using vehicle license plate, vehicle model recognition and rfid sensor - Google Patents

Abstract

Disclosed is a vehicle management system using vehicle number plate/vehicle model recognition and an RFID sensor. The vehicle management system comprises: a database server in which vehicle information of an entering vehicle is pre-registered and stored; a vehicle front-side photographing camera photographing an image of the front side of the entering vehicle; and an image analysis server analyzing the front side image photographed by the vehicle front-side photographing camera to recognize the entering vehicle, and comparing the recognized entering vehicle with the vehicle information stored in the database server to determine whether the vehicle is a normally registered vehicle. In accordance with the present invention, the vehicle management system using vehicle number plate/vehicle model recognition and an RFID sensor is configured to determine whether a vehicle is a normally registered vehicle by recognizing a vehicle model, a vehicle color and a vehicle number using a vehicle image, and also, determine whether the vehicle is a normally registered vehicle using an RFID signal transmitted from the vehicle number plate, and, as a result, there can be an effect of increasing the reliability of parking entry management by accurately determining a vehicle with a false registration number attached on a vehicle number plate.

Description

Vehicle license plate and vehicle type recognition, vehicle management system using RFID sensor

The present invention relates to a vehicle management system, and more particularly, to a vehicle management system using a vehicle license plate, vehicle model recognition, and an RFID sensor.

In apartments or large buildings, a vehicle management system is established and used for the efficiency of parking management. Most vehicle management systems currently used use license plate recognition technology as a means of vehicle recognition. It is configured to recognize the license plate and text of the vehicle from the camera image using the image detection technique.

Such an image-based vehicle management system has few errors and a high recognition rate, so it is in the spotlight as a stable system.

However, there is a case where a fake license plate printed on paper is attached to the position of the license plate when entering a vehicle. The vehicle recognizer accurately recognizes the vehicle number of the fake license plate, but since it is not the vehicle number of the corresponding vehicle, the reliability of the system is inevitably reduced.

Accordingly, there is a need for a method that can fundamentally cope with such an act of artificially lowering the reliability of the vehicle recognizer.

Registered Patent Publication No. 10-1895374 Registered Patent Publication No. 10-1394381

SUMMARY OF THE INVENTION It is an object of the present invention to provide a vehicle management system using a vehicle license plate and vehicle type recognition, and an RFID sensor.

The vehicle management system using the vehicle license plate, vehicle type recognition, and RFID sensor according to the object of the present invention described above includes a database server in which vehicle information of the vehicle entering and leaving is registered and stored in advance; Vehicle front camera for taking a front image of the vehicle in and out; To include an image analysis server that analyzes the front image taken by the vehicle front photographing camera to recognize the entrance vehicle, and determines whether the vehicle is a normal registered vehicle in preparation for whether the recognized vehicle is matched with vehicle information stored in the database server can be configured.

Here, the vehicle rear photographing camera for photographing the rear image of the vehicle; It may be configured to further include an RFID receiving device for receiving an RFID signal from an RFID chip provided in advance in the vehicle license plate of the vehicle.

And the image analysis server, by analyzing the rear image taken by the vehicle rear photographing camera to recognize the vehicle in and out, and determine whether the vehicle is a normal registered vehicle by comparing whether the recognized vehicle is matched with the vehicle information stored in the database server can be configured to

In addition, the image analysis server may be configured to determine whether a vehicle is normally registered by comparing vehicle information corresponding to the RFID information of the RFID signal received from the RFID receiving device and vehicle information stored in the database server.

On the other hand, the breaker to block or allow the entrance of the vehicle; It may be configured to further include a circuit breaker control device for controlling whether to block the circuit breaker according to the determination result of whether the image analysis server is a normally registered vehicle.

On the other hand, the database server, the vehicle number storage unit in which the vehicle number of the registered vehicle is stored in advance; a vehicle model storage unit for storing the vehicle model of the registered vehicle in advance; a vehicle color storage unit in which the vehicle color of the registered vehicle is stored in advance; an RFID information storage unit storing the RFID information of the registered vehicle in advance; an entry/exit time storage unit for storing the entry/exit time of the registered vehicle; It may be configured to include a vehicle state storage unit in which the vehicle state of the registered vehicle is stored.

The image analysis server may include: a vehicle model confirmation module configured to analyze the front image and the rear image to determine the vehicle model of the vehicle; a vehicle color confirmation module for analyzing the image of the front image and the rear image to confirm the vehicle color of the vehicle; a front vehicle number verification module that analyzes the front image and the rear image to check the front vehicle number of the vehicle; a rear vehicle number confirmation module that analyzes the image of the front image and the rear image to confirm the rear vehicle number of the vehicle; The vehicle model confirmed by image analysis of the front image in the vehicle model confirmation module, the vehicle color confirmed by image analysis of the front image in the vehicle color confirmation module, and the front vehicle number confirmed by image analysis of the front image in the front vehicle number confirmation module Checks whether the vehicle model stored in the vehicle model storage unit of the database server, the vehicle color stored in the vehicle color storage unit of the database server, and the vehicle number stored in the vehicle number storage unit of the database server match the normal vehicle of the vehicle Front image-normal vehicle determination module to determine whether or not; The vehicle model confirmed by image analysis of the rear image in the vehicle model confirmation module, the vehicle color confirmed by image analysis of the rear image in the vehicle color confirmation module, and the rear vehicle number confirmed by image analysis of the rear image in the rear vehicle number confirmation module Checks whether the vehicle model stored in the vehicle model storage unit of the database server, the vehicle color stored in the vehicle color storage unit of the database server, and the vehicle number stored in the vehicle number storage unit of the database server match the normal vehicle of the vehicle a rear image to determine whether or not - a normal vehicle determination module; an RFID information comparison module for comparing whether the RFID information of the RFID signal received by the RFID receiving device and the RFID information stored in the RFID information storage unit match each other; It may be configured to include an RFID-normal vehicle determination module for judging whether the entering vehicle is a normal vehicle according to a comparison result of the RFID information comparison module.

According to the vehicle management system using the vehicle license plate and vehicle type recognition and RFID sensor described above, the vehicle model, vehicle color, and vehicle number are recognized by using the vehicle image to determine whether the vehicle is normally registered, and also the RFID signal transmitted from the vehicle license plate By using to determine whether a vehicle is normally registered, there is an effect that can increase the reliability of parking access management by accurately discriminating the vehicle entering and leaving by attaching a fake registration number to the license plate.

1 and 2 are schematic diagrams of a vehicle management system using a vehicle license plate, vehicle model recognition, and RFID sensor according to an embodiment of the present invention.
3 is a configuration diagram of a vehicle license plate according to an embodiment of the present invention.
4 is a block diagram of a vehicle management system using a vehicle license plate, vehicle type recognition, and RFID sensor according to an embodiment of the present invention.
5 is an exemplary diagram of an RGB cube according to an embodiment of the present invention.

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed content for carrying out the invention. However, this is not intended to limit the present invention to specific embodiments, and it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention. In describing each figure, like reference numerals have been used for like elements.

Terms such as first, second, A, and B may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being “connected” or “connected” to another component, it is understood that the other component may be directly connected or connected to the other component, but other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that no other element is present in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 and 2 are schematic diagrams of a vehicle management system using a vehicle license plate, vehicle type recognition, and RFID sensor according to an embodiment of the present invention, and FIG. 4 is a configuration diagram of a vehicle license plate according to an embodiment of the present invention.

Referring to FIGS. 1 and 2 , the vehicle management system 100 using a vehicle license plate, vehicle model recognition, and RFID sensor includes a vehicle front camera and a vehicle rear camera, as well as an RFID receiving device. The front camera of the vehicle and the rear camera of the vehicle generate an image of the vehicle in and out, and the image analysis server is configured to recognize the model, color, vehicle number, and the like. And the image analysis server is configured to compare the model, color, vehicle number, etc. to the model, color, vehicle number, etc. previously registered in the database server to determine whether it is a normally registered vehicle.

Here, the image analysis server may be installed in the situation room unit as shown in FIG. 1 or may be installed in the field unit as shown in FIG. 2 .

On the other hand, as shown in FIG. 3 , the RFID device may be embedded in the license plate of the vehicle entering or leaving the vehicle. The RFID device of the license plate may be configured to transmit an RFID signal containing RFID information unique to the vehicle and to receive the RFID signal. The image analysis server compares the RFID information with the RFID information of the database server to immediately determine whether the vehicle is a previously registered normal vehicle without recognizing the vehicle number.

4 is a block diagram of a vehicle management system using a license plate, vehicle type recognition, and RFID sensor according to an embodiment of the present invention, and FIG. 5 is an exemplary diagram of an RGB cube according to an embodiment of the present invention.

Referring to FIG. 4 , the vehicle management system 100 using the vehicle license plate and vehicle type recognition and RFID sensor according to an embodiment of the present invention includes a database server 110 , a vehicle front photographing camera 120 , and an image analysis server 130 . ), the vehicle rear photographing camera 140 , the RFID receiving device 150 , the circuit breaker 160 , and the circuit breaker control device 170 may be configured to include.

Hereinafter, a detailed configuration will be described.

The database server 110 may be configured so that vehicle information of the vehicle entering and leaving is registered and stored in advance. For example, in the database server 110 , as a vehicle that can be parked in a parking lot of an apartment or office building, corresponding vehicle information may be registered in advance.

The database server 110 includes a vehicle number storage unit 111 , a vehicle model storage unit 112 , a vehicle color storage unit 113 , an RFID information storage unit 114 , an entry/exit time storage unit 115 , and a vehicle state storage unit. (116).

Hereinafter, a detailed configuration will be described.

The vehicle number storage unit 111 may be configured to store the vehicle number of the registered vehicle in advance.

The vehicle model storage unit 112 may be configured to store the vehicle model of the registered vehicle in advance.

The vehicle color storage unit 113 may be configured to store the vehicle color of the registered vehicle in advance.

The RFID information storage unit 114 may be configured to store the RFID information of the registered vehicle in advance. The RFID information may be unique RFID information of the registered vehicle.

The entry/exit time storage unit 115 may be configured to store the entry/exit time of the registered vehicle.

The vehicle state storage unit 116 may be configured to store the vehicle state of the registered vehicle.

The vehicle front photographing camera 120 may be configured to photograph the front image of the vehicle in and out. Here, the vehicle front photographing camera 120 may be installed on the floor toward the vehicle's entry direction. You can take a more accurate picture of the license plate.

The image analysis server 130 analyzes the front image taken by the vehicle front photographing camera 120 to recognize the vehicle entering and exiting, and prepares whether the recognized vehicle matches the vehicle information stored in the database server 110 to be a normal registered vehicle. It may be configured to determine whether or not Here, the image analysis server 130 may determine whether the vehicle is normally registered using the model, color, vehicle number, and the like of the vehicle in and out.

Here, if the direction of the vehicle front photographing camera 120 is changed or does not match the vehicle's entry direction, the vehicle may be photographed by being twisted. Therefore, when setting up the initial system, check the vehicle and camera installation directions, and if it is determined that the installation direction is different from the vehicle entry direction, use image warping to align the image with the vehicle entry direction in the forward direction. can be configured.

The image analysis server 130 includes a vehicle model confirmation module 131, a vehicle color confirmation module 132, a front vehicle number confirmation module 133, a rear vehicle number confirmation module 134, a front image-normal vehicle determination module 135 , a rear image-normal vehicle determination module 136 , an RFID information comparison module 137 , and an RFID-normal vehicle determination module 138 .

Hereinafter, a detailed configuration will be described.

The vehicle model confirmation module 131 may be configured to analyze the front image and the rear image to confirm the vehicle model of the vehicle.

Specifically, it can be configured to select a vehicle's bounding box using deep learning detection technology from the front image and the rear image, and based on the information of the selected bounding box, CNN-based classification (classification) ), it is possible to estimate the model name of the vehicle entering and exiting. Here, the manufacturer of the entry/exit vehicle may also be estimated.

The vehicle color check module 132 may be configured to analyze the front image and the rear image to check the vehicle color of the vehicle in and out.

Specifically, the vehicle color check module 132 may determine the vehicle color based on distance information between pixels in the RGB cube of FIG. 5 . It may be configured to acquire pixel information of a predetermined area of the front of the vehicle, calculate distance information between each pixel and R, G, and B points, and accumulate results to select a final color.

The front vehicle number confirmation module 133 may be configured to analyze the front image and the rear image to confirm the front vehicle number of the vehicle in and out.

The rear vehicle number verification module 134 may be configured to analyze the front image and the rear image to confirm the rear vehicle number of the vehicle in and out.

Confirmation of the vehicle number may be made in the order of first recognizing the vehicle license plate in the upper bounding box, and recognizing the characters in the recognized vehicle license plate.

The front image-normal vehicle determination module 135 is the vehicle model confirmed by image analysis of the front image in the vehicle model confirmation module 131, the vehicle color confirmed by image analysis of the front image in the vehicle color confirmation module 132, the front vehicle number The vehicle model in which the front vehicle number confirmed by image analysis of the front image in the confirmation module 133 is stored in the vehicle model storage unit 112 of the database server 110, and the vehicle stored in the vehicle color storage unit 113 of the database server 110 It may be configured to determine whether the vehicle is a normal vehicle by checking whether it matches the vehicle number stored in the vehicle number storage unit 111 of the color and database server 110 .

Rear image-normal vehicle determination module 136 is the vehicle model confirmed by image analysis of the rear image in the vehicle model confirmation module 131, the vehicle color confirmed by image analysis of the rear image in the vehicle color confirmation module 132, the rear vehicle number The vehicle model in which the rear vehicle number confirmed by image analysis of the rear image in the confirmation module 136 is stored in the vehicle model storage unit 112 of the database server 110, the vehicle stored in the vehicle color storage unit 113 of the database server 110 It may be configured to determine whether the vehicle is a normal vehicle by checking whether it matches the vehicle number stored in the vehicle number storage unit 111 of the color and database server 110 .

The RFID information comparison module 137 may be configured to compare whether the RFID information of the RFID signal received by the RFID receiving device 150 and the RFID information stored in the RFID information storage unit 114 match each other.

The RFID-normal vehicle determination module 138 may be configured to determine whether the vehicle entering or leaving the vehicle is a normal vehicle according to the comparison result of the RFID information comparison module 137 .

The vehicle recognition method using RFID may be determined in combination with the above image-based vehicle recognition, or as a separate vehicle recognition method, RFID information may be recognized first before image-based vehicle recognition.

When RFID information is recognized first, if the RFID is not recognized normally in the RFID information recognition step, image-based vehicle recognition may be performed in the next step.

The vehicle rear photographing camera 140 may be configured to photograph the rear image of the vehicle in and out. Here, the vehicle rear imaging camera 140 may be installed on the floor on the vehicle entry path to match the vehicle entry path.

The RFID receiving device 150 may be configured to receive an RFID signal from the RFID chip 11 provided in advance in the license plate of the vehicle.

Here, the image analysis server 130 analyzes the rear image photographed by the vehicle rear camera 140 to recognize the vehicle entering and exiting, and prepares whether the recognized vehicle matches the vehicle information stored in the database server 110 and is normal. It may be configured to determine whether the vehicle is registered.

At this time, if the direction of the rear camera 140 of the vehicle is also changed or does not coincide with the direction of entry of the vehicle, the vehicle may be photographed by being twisted. Therefore, when setting the initial system, the vehicle and the camera installation direction are checked, and if it is determined that the installation direction is different from the vehicle entry direction, the image can be configured to match the vehicle entry direction and the forward direction using image warping. .

In addition, the image analysis server 130 is configured to determine whether the vehicle is normally registered by comparing whether the vehicle information corresponding to the RFID information of the RFID signal received from the RFID receiving device 150 matches the vehicle information stored in the database server 110 . can be

The circuit breaker 160 may be configured to block or allow entry and exit of vehicles.

The circuit breaker control device 170 may be configured to control whether the circuit breaker is blocked according to a result of determining whether the vehicle is normally registered by the image analysis server 130 .

Although described with reference to the above embodiments, those skilled in the art can understand that various modifications and changes can be made to the present invention without departing from the spirit and scope of the present invention as set forth in the following claims. There will be.

110: database server 111: vehicle number storage unit
112: vehicle model storage unit 113: vehicle color storage unit
114: RFID information storage unit 115: entry/exit time storage unit
116: vehicle state storage unit 120: vehicle front camera
130: video analysis server 131: vehicle model confirmation module
132: vehicle color confirmation module 133: front vehicle number confirmation module
134: rear vehicle number verification module
135: front image-normal vehicle determination module
136: rear image-normal vehicle determination module
137: RFID information comparison module 138: RFID-normal vehicle determination module
140: vehicle rear camera 150: RFID receiving device
160: circuit breaker 170: circuit breaker control device

Claims (5)

a database server 110 in which vehicle information of entering and exiting vehicles is pre-registered and stored;
a vehicle front photographing camera 120 for photographing the front image of the vehicle;
By analyzing the front image taken by the vehicle front photographing camera 120 to recognize the entrance vehicle, and to compare whether the recognized vehicle enters and exits the vehicle information stored in the database server 110, to determine whether the vehicle is a normal registered vehicle Including an image analysis server 130,
The vehicle rear camera 140 for photographing the rear image of the vehicle entering and exiting;
Further comprising an RFID receiving device 150 for receiving an RFID signal from the RFID chip 11 provided in advance in the vehicle license plate of the vehicle,
The image analysis server 130,
Configured to analyze the rear image taken by the vehicle rear photographing camera 140 to recognize the vehicle entering and exiting, and to determine whether the vehicle is normally registered in preparation for whether the recognized vehicle matches vehicle information stored in the database server 110 become,
The image analysis server 130,
It is configured to determine whether the vehicle is normally registered by comparing whether vehicle information corresponding to the RFID information of the RFID signal received by the RFID receiving device 150 matches the vehicle information stored in the database server 110,
The database server 110,
Vehicle number storage unit 111 in which the vehicle number of the registered vehicle is stored in advance,
a vehicle model storage unit 112 in which the vehicle model of the registered vehicle is stored in advance;
a vehicle color storage unit 113 in which the vehicle color of the registered vehicle is stored in advance;
RFID information storage unit 114 in which the RFID information of the registered vehicle is stored in advance;
an entry/exit time storage unit 115 for storing the entry/exit time of the registered vehicle;
a vehicle state storage unit 116 in which the vehicle state of the registered vehicle is stored;
The image analysis server 130,
A vehicle model confirmation module 131 that analyzes the image of the front image and the rear image to confirm the vehicle model of the vehicle in and out;
A vehicle color confirmation module 132 that analyzes the image of the front image and the rear image to confirm the vehicle color of the vehicle in and out;
A front vehicle number confirmation module 133 that analyzes the image of the front image and the rear image to confirm the front vehicle number of the vehicle in and out;
A rear vehicle number confirmation module 134 that analyzes the image of the front image and the rear image to confirm the rear vehicle number of the vehicle in and out;
The vehicle model confirmed by image analysis of the front image in the vehicle model confirmation module 131 Vehicle color confirmed by image analysis of the front image in the vehicle color confirmation module 132 The front image is imaged by the front vehicle number confirmation module 133 The vehicle color and vehicle color stored in the vehicle color storage unit 113 of the database server 110 and the database server 110 of the vehicle model stored in the vehicle model storage unit 112 of the database server 110 are identified by analysis. Front image-normal vehicle determination module 135 for determining whether the vehicle is a normal vehicle by checking whether it matches the vehicle number stored in the vehicle number storage unit 111,
The vehicle model confirmed by image analysis of the rear image in the vehicle model confirmation module 131 The vehicle color identified by image analysis of the rear image in the vehicle color confirmation module 132 The rear image is imaged by the rear vehicle number confirmation module 136 The vehicle color stored in the vehicle color storage unit 113 of the database server 110 and the database server 110 of the vehicle model in which the rear vehicle number identified by analysis is stored in the vehicle model storage unit 112 of the database server 110 Rear image-normal vehicle determination module 136, which determines whether the vehicle is a normal vehicle by checking whether it matches the vehicle number stored in the vehicle number storage unit 111,
An RFID information comparison module 137 for preparing whether the RFID information of the RFID signal received from the RFID receiving device 150 and the RFID information stored in the RFID information storage unit 114 match each other;
Vehicle license plate and vehicle model recognition, RFID sensor, characterized in that it comprises an RFID-normal vehicle determination module 138 for determining whether the entering vehicle is a normal vehicle according to the comparison result of the RFID information comparison module 137 used vehicle management system.
delete According to claim 1,
a circuit breaker 160 that blocks or permits the entry and exit of the vehicle;
Vehicle using a vehicle license plate and vehicle model recognition, RFID sensor, characterized in that it further comprises a circuit breaker control device 170 for controlling whether the circuit breaker is blocked according to the determination result of whether the vehicle is normally registered by the image analysis server 130 management system.
delete delete

Images