KR102408788B1 - Method for dual recognizing license plate - Google Patents

Abstract

A double license plate recognition method is disclosed. Dual license plate recognition method of the present invention comprises the steps of registering a vehicle number; storing identification information of the mobile terminal associated with the vehicle number; Recognizing the vehicle number of the vehicle from the number plate of the entering vehicle; Receiving information including identification information of the mobile terminal through short-range communication with the mobile terminal; determining whether the received identification information is identification information stored in association with a previously registered and recognized vehicle number; and determining the recognized vehicle number as a registered vehicle number when the received identification information is associated with a previously registered vehicle number.

Description

Method for dual recognizing license plate

The present invention relates to a double license plate recognition method.

License Plate Recongnition (LPR) device is a device used to limit access after recognizing the number of entering or leaving vehicles, or to obtain, store and manage information on entering and exiting vehicles.

The license plate recognition device has recently been applied to manage entry and exit of a large number of residents and visitors such as apartment complexes and commercial facilities. The vehicle number recognition device is installed at the entrance/exit gate of the vehicle and is used in a way that allows the vehicle to pass through the gate if the vehicle number recognized by the vehicle number plate recognition device matches the previously registered vehicle number.

However, recently, there have been reports of abuse of license plate recognition devices. License plate recognition technology is based on recognizing letters and numbers on license plates by analyzing images. Therefore, if the vehicle number printed on paper is pasted with tape in front of the license plate, there is a problem in that the printed vehicle number is recognized as the vehicle number of the entering vehicle as it is. This problem cannot be solved by LPR technology itself. This is because it is difficult to distinguish the actual license plate from the number printed on paper as it is an image technology.

Recently, studies have been conducted to solve the above-described problem of vehicle number recognition, and the present invention has also been developed to solve such a problem. As a prior art related to the present invention, Korean Patent Application Laid-Open No. 10-2021-0089032 exists.

The technical problem to be solved by the present invention is to provide a double license plate recognition method capable of accurately acquiring information on entering/exiting vehicles by supplementing the prior art license plate recognition technology.

registering a vehicle number to solve the above technical problem; storing identification information of the mobile terminal associated with the vehicle number; Recognizing the vehicle number of the vehicle from the number plate of the entering vehicle; Receiving information including identification information of the mobile terminal through short-range communication with the mobile terminal; determining whether the received identification information is identification information stored in association with a previously registered and recognized vehicle number; and determining the recognized vehicle number as a registered vehicle number when the received identification information is associated with a previously registered vehicle number.

In an embodiment of the present invention, the short-range communication may be achieved by Bluetooth communication.

In one embodiment of the present invention, identification information about the mobile terminal associated with the vehicle number may be stored for at least two or more mobile terminals.

In an embodiment of the present invention, the identification information may include at least one of a phone number of the mobile terminal, International Mobile Euquipment Identify (IMEI) information, a Mac address, and a Bluetooth address.

In an embodiment of the present invention, the method comprising: obtaining image information about a driver of an approaching vehicle and its surroundings; and analyzing the image information, generating suspicious information when a person is captured around an approaching vehicle.

In one embodiment of the present invention, outputting a request for input of a password; and when a password is input, determining the recognized vehicle number as a registered vehicle number when the password is associated with a previously registered vehicle number.

In an embodiment of the present invention, the method comprising: detecting a mobile terminal of a vehicle operator at a location adjacent to a path reaching an access road; and transmitting a Bluetooth mode execution request to the portable terminal.

In an embodiment of the present invention, the method comprising: detecting identification information of a mobile terminal of a vehicle driver at a location adjacent to a path reaching an access road; And it is determined whether a previously registered vehicle number associated with the identification information exists, and if the vehicle number is recognized within a preset time, the recognized vehicle number is registered even before processing the received identification information of claim 9 It may further include; determining the vehicle number.

The present invention has the effect that information about the illegally entered vehicle can be managed by accurately determining the information on the entering/exiting vehicle by supplementing the conventional vehicle number recognition technology.

1 shows a dual license plate recognition system according to an embodiment of the present invention.
Figure 2 shows a state in which a dual license plate recognition system according to an embodiment of the present invention is installed.
Figure 3 shows a double license plate recognition method according to an embodiment of the present invention.

Since the present invention can apply various transformations and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

In describing the present invention, if it is determined that a detailed description of a related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 shows a dual license plate recognition system according to an embodiment of the present invention.

Referring to FIG. 1 , the dual license plate recognition system according to an embodiment of the present invention may include an entrance/exit processing device 100 , a blocking unit 160 , a management server 200 and an entry detection unit 400 . .

The entrance/exit processing device 100 and the blocking unit 160 according to an embodiment of the present invention may be installed in a vehicle entry section of a building or apartment as shown in FIG. 2 . In general, in the vehicle entry section, the equipment equipped with an LPR (License Plate Recognition) module capable of recognizing a vehicle number and the blocking unit 160 operating the blocking bar 165 may be installed separately and are electrically connected. .

The entrance/exit processing apparatus 100 according to an embodiment of the present invention is installed on one side of the path through which the vehicle enters, and the blocking unit 160 may be installed side by side therewith.

The entrance/exit processing apparatus 100 may include a control unit 110 , a communication unit 120 , a short-range communication unit 130 , a vehicle recognition unit 140 , an image acquisition unit 150 , and a blocking unit 160 .

The control unit 110 is electrically connected to the communication unit 120 , the short-distance communication unit 130 , the vehicle recognition unit 140 , the image acquisition unit 150 , and the blocking unit 160 , and can control them.

The control unit 110 may transmit information generated and provided by the short-range communication unit 130 , the vehicle recognition unit 140 , and the image acquisition unit 150 to the management server 200 through the communication unit 120 .

The communication unit 120 may be connected to the management server 200 by a wired/wireless network and may transmit/receive information.

The short-distance communication unit 130 may include a short-distance communication means capable of exchanging information when the mobile terminal 300 is located within a preset range. For example, the short-range communication unit 130 may include a Bluetooth (bluetooth) or Wi-Fi (wi-fi) module. However, the present invention is not limited thereto and may be substituted with other communication means for short-distance communication.

Preferably, the short-range communication unit 130 may include a Bluetooth module in which a directional antenna is installed. The directional antenna can set a communication distance and an angular range by adjusting a gain and a beam width.

For example, the short-distance communication unit 130 may be set to enable Bluetooth communication with a communication target in an angle range of about 40 degrees to 60 degrees within a distance of about 10 m toward the approaching vehicle.

In an embodiment of the present invention, the short-distance communication unit 130 includes a Bluetooth module with a directional antenna installed therein, so even if there are a plurality of Bluetooth communication entry/exit processing devices 100 nearby, the mobile terminal 300 carried by the owner or passenger of the vehicle. ) with limited or selective communication. That is, the short-range communication unit 130 may communicate with the portable terminal 300 located within a predetermined spatial range. Specifically, there may be a plurality of portable terminals 300 sensed by the short-range communication unit 130, and by selecting one of them (for example, the nearest portable terminal 300 may be selected), the portable terminal ( 300) can be communicated with.

The short-distance communication unit 130 may acquire information about the portable terminal 300 by communicating with the portable terminal 300 of the operator (or the owner, or a passenger) of the vehicle entering the vehicle. The information on the mobile terminal 300 may include a unique mobile number recorded in a USIM.

The vehicle recognition unit 140 may read the number of the vehicle entering or leaving the vehicle to generate information about the vehicle number and provide it to the control unit. The vehicle recognition unit 140 may include a license plate recognition (LPR) module.

The image acquisition unit 150 may acquire information about an image or photo of a vehicle entering or leaving the vehicle. The image acquisition unit 150 may capture and acquire an image or picture of the vehicle entering or leaving the vehicle, its surroundings, the inside of the vehicle (when the driver opens a window), or the driver. Accordingly, the image acquisition unit 150 may include an image sensor.

The image acquisition unit 150 may also be said to acquire image information about the driver of the approaching vehicle and its surroundings.

The blocking unit 160 may include a blocking bar 165 .

The blocking unit 160 may control the blocking bar 165 to open or close the blocking bar 165 according to a command of the controller.

The management server 200 may include a control unit 210 , a communication unit 220 , and a storage unit 230 .

The control unit 210 may control the communication unit 220 and the storage unit 230 .

The communication unit 210 may transmit and receive information to and from the entrance/exit processing device 100 , the portable terminal 300 , and the entrance detection unit 400 , respectively.

The storage unit 230 may store necessary information to provide convenience of information processing. For example, the storage unit 230 may store an application that can be installed on the portable terminal 300 so that it can be provided to the portable terminal 300 through Internet communication. For example, the storage unit 230 may store information including a registered vehicle number, a phone number of the mobile terminal 300 registered as a member, and a phone number of the mobile terminal 300 linked to the vehicle number.

The management server 200 configured as described above may be, for example, any one of a server or a cloud server, and the management server 200 is physically or logically separated from a plurality of terminals for providing information processing. It may include, and may be provided in a form that is distributed and installed in various places or using a cloud service for storage and processing of information.

The mobile terminal 300 may include, for example, a mobile device such as a smartphone, a tablet PC, and a notebook computer, and is not necessarily limited to a smartphone, but one embodiment of the present invention As in the example, if it is necessary to determine based on a phone number, it may be preferable to be configured with a smartphone.

The mobile terminal 300 can install at least an application provided by the management server 200, and preferably includes a short-range communication module such as Bluetooth or Wi-Fi.

The entrance detection unit 400 may be installed near a path through which a vehicle moves before entering the entrance/exit gate, such as a parking lot or a building entrance.

The entry detection unit 400 may communicate with the mobile terminal 300 and the management server 200 .

The entry detection unit 400 may include a short-range communication module. For example, the entry detection unit 400 may serve as a beacon including a Bluetooth communication module and the like. The ingress detection unit 400 may be installed in at least two or more positions.

In addition to the short-distance communication module, the entry detection unit 400 may be configured to include any means for recognizing the mobile terminal 300 of an owner or operator of a moving vehicle.

The entrance detection unit 400 may detect a vehicle to move to the entrance/exit gate in advance and provide the information to the management server 200 to temporarily store the information. Detection of the vehicle may be replaced by communication with the mobile terminal 300 of the operator or owner of the vehicle even if the license plate is not directly recognized. For example, when the mobile terminal 300 is detected, the vehicle number associated with the phone number of the mobile terminal 300 can be inquired and recognized.

The management server 200 may determine that the vehicle is a registered vehicle only by simple license plate recognition without going through double license plate recognition with respect to the vehicle detected by the entrance detection unit 400 through the entrance/exit processing device 100 . This is for faster gate passage. That is, the management server 200 may determine the recognized vehicle number as the registered vehicle number even before the entry/exit processing device 100 processes the identification information of the portable terminal 300 .

For example, the management server 200 may determine to pass through the gate only by recognizing the license plate when the vehicle detected by the entry detection unit 400 enters or leaves the vehicle within a preset time (eg, 5 minutes). .

Hereinafter, the description of the operation of the dual license plate recognition system is replaced by a description of the double license plate recognition method based on the dual license plate recognition system.

Figure 3 shows a double license plate recognition method according to an embodiment of the present invention.

Referring to FIG. 3 , in step S301 , the management server 200 may register vehicle information. The vehicle information may include information about a vehicle number and an owner. The management server 200 may provide an entry/exit service for a registered vehicle differently from that for an unregistered vehicle.

The management server 200 may achieve registration of the vehicle number in various ways. For example, the management server 200 may receive vehicle information to be registered through a terminal (eg, a desktop computer) accessible to the management server 200 . For example, the management server 200 may receive vehicle information to be registered through a web page. For example, the management server 200 may receive vehicle information input through an application installed in the portable terminal 300 through Internet communication. A subject for inputting vehicle information may be a manager who manages the management server 200 , a manager of a collective building, or an owner of a vehicle for inputting vehicle information through the mobile terminal 300 .

In step S303, the management server 200 may register the information of the mobile terminal 300 associated with the vehicle information.

The mobile terminal 300 information may include a phone number of the owner of the mobile terminal 300 . Linking the vehicle information and the mobile terminal 300 information may mean, for example, that the owner or driver of a specific vehicle number is the same person as the holder of a registered phone number. The connection between the vehicle information and the information on the portable terminal 300 may be a 1:1 relationship or a 1:N relationship (eg, N=3 may be set). This is to link one vehicle number and multiple phone numbers because there may be multiple drivers in the case of a family or company vehicle.

The mobile terminal 300 information may include identification information unique to the mobile terminal 300 even if it is not a phone number. For example, the information on the mobile terminal 300 may include at least one of International Mobile Equipment Identify (IMEI) information, a Mac address, and a Bluetooth address, and this information is also stored in association with vehicle information to determine whether the vehicle owner or It can be used to identify the driver.

In step S305 , the entrance detection unit 400 may detect the vehicle's entrance.

The entrance detection unit 400 may provide detection information for detecting the vehicle's entrance to the management server 200 . The detection information may include information about the above-described portable terminal 300 .

There may be a difference between the time the entrance detecting unit 400 acquires the detection information and the time the vehicle approaches the vehicle entering/exiting processing device 100 . For example, the time for the approach detection unit 400 to obtain the detection information and the time for the vehicle to approach the vehicle may be between about 5 minutes and 10 minutes.

The management server 200 may receive the sensing information and specify the portable terminal 300 of the driver currently operating the vehicle.

In step S307, the management server 200 may request to execute an application for the specified portable terminal 300 in response to the detection information. Applications can be preset to run in the background. Running in the background is to automatically activate Bluetooth without setting (Bluetooth mode) to directly operate Bluetooth in the mobile terminal 300 . That is, the mobile terminal 300 automatically turns on Bluetooth to enable short-range communication without delay when passing through the gate.

According to an embodiment, in step S307 , the entry detecting unit 400 may send only a request signal to allow the portable terminal 300 to run an application executing Bluetooth in the background. In this case, the entry detecting unit 400 does not necessarily need to acquire information about the portable terminal 300 .

In some embodiments, step S307 may be omitted. In this case, the background application execution request and the recognition of the mobile terminal 300 information may be simultaneously performed in step S309.

In step S309 , the short-range communication unit 130 may recognize information about the portable terminal 300 through short-distance communication with the portable terminal 300 .

Information on the recognized portable terminal 300 may be provided to the management server 200 or provided to the control unit 110 to be processed by itself. The information about the mobile terminal 300 may include at least one of a phone number, International Mobile Equipment Identify (IMEI) information, a Mac address, and a Bluetooth address. It will be exemplified that the information includes a phone number.

As described above, the short-range communication unit 130 communicates with all the mobile terminals 300 existing in the vicinity by using the Bluetooth module in which the directional antenna is installed, thereby preventing the recognition from being delayed and a small number of mobile terminals existing in the desired spatial range. Only (300) (preferably only the operator's mobile terminal) is recognized.

In step S311 , the vehicle recognition unit 140 may recognize the vehicle number and provide it to the management server 200 or to the control unit 110 .

The recognition of the license plate can be based on image recognition technology that visually reads the license plate by analyzing the image of the license plate of the vehicle.

In step S313 , the image acquisition unit 150 may acquire information about an image or photo of a vehicle entering or leaving the vehicle. The image acquisition unit 150 may capture and obtain an image or photo of the vehicle entering or leaving the vehicle, the entrance/exit gate (or the entrance/exit processing device 100), inside the vehicle (when the driver opens the window), or the driver. .

Steps S309 to S313 may be performed simultaneously, sequentially or in a reverse order.

In step S315, the management server 200 or the control unit 110 determines whether the information is matched. If the information matching is made, the process may proceed to step S317, otherwise, the process may proceed to step S319.

In an embodiment of the present invention, information matching may mean a state in which all information on the mobile terminal 300 associated with the recognized vehicle number, for example, a phone number is registered and inquired in the management server 200 . Of course, it is also possible to configure the storage unit in the vehicle entry/exit processing apparatus 100 to determine this by itself.

In step S317, the management server 200 or the control unit 110 may determine the vehicle currently being determined (the vehicle waiting to pass through the gate) as a normally registered vehicle. Normal registration may mean a vehicle in which the above-described information matching is made.

If it is determined that the vehicle is normally registered, the entrance/exit processing device 100 may control the blocking unit 160 to immediately open the blocking bar 165 . As described above, in an embodiment of the present invention, the vehicle undergoes a process of matching the vehicle number with information about the mobile terminal 300 to receive a matching decision. In the present invention, the information of the mobile terminal 300 is named double license plate recognition in that it is linked to the vehicle number.

In step S319, the management server 200 or the control unit 110 may estimate the vehicle currently being determined as an unregistered vehicle. If it is estimated that the vehicle is unregistered, it proceeds to step S321.

In step S321, the management server 200 or the entrance/exit processing device 100 may receive request information. The input/exit processing apparatus 100 may be provided with an input unit (not shown) such as an input button and a touch screen to receive request information. The management server 200 or the entrance/exit processing device 100 may output request notification information to receive the request information. The request notification may relate to, for example, a password input request such as “Enter your password”, “Please press the number of the group you want to visit” and a request for entering the number of visits.

The request notification may be output by an output unit (not shown) such as a speaker and a display unit provided separately. The request notification may be provided as a push notification or the like by an application installed in the mobile terminal 300 . In this case, a response to the request notification may be made through the mobile terminal 300 .

The request information may be any one of a password and the number of visits, and in an embodiment of the present invention, the request information may be a password.

The password may be registered in the management server 200 in advance. The password may be stored in the management server 200 in association with vehicle information. The password may be assigned and set one by one for each vehicle, and may replace the role of information on the portable terminal 300 . This may be necessary when the operator does not carry the mobile terminal 300 or the mobile terminal 300 does not operate because the battery of the operator's mobile terminal 300 is discharged and being charged.

In step S323, the management server 200 or the control unit 110 determines whether the information is matched. If the information matching is made, the process may proceed to step S317, otherwise, the process may proceed to step S325.

The information matching determination in step S323 can be distinguished from the information matching determination in step S315 in that it is made with respect to the password associated with the vehicle number.

In step S325 , the management server 200 or the control unit 110 may determine the vehicle currently being determined as an unregistered vehicle. If it is determined that the vehicle is unregistered, it may be set to take necessary measures, such as requesting the issuance of a visit permit for the settlement of parking fees, and refusal to enter the vehicle.

For example, in step S327 , the entrance/exit processing apparatus 100 may output information guiding that the vehicle is an unregistered vehicle. The unregistered vehicle guide information may include information such as “Issue a visitor pass” and “parking fee is charged because it is an unregistered vehicle”. can be output through Of course, the entrance/exit processing apparatus 100 may accompany the control of opening or closing the blocking bar 165 in addition to guiding the unregistered vehicle. Under what conditions the blocking bar 165 is controlled may be set according to the parking policy of the corresponding building.

In step S329, the management server 200 may analyze the image information.

The analysis of the image information may be to extract an image corresponding to a set condition. The setting condition may be, for example, finding a case in which a person exists within the detection range of the vehicle recognition unit 140 . For example, it is a case in which a person stays around the vehicle in order to be recognized by Bluetooth rather than riding inside the vehicle.

In step S331, the management server 200 may generate suspicious information. In the present invention, the suspicious information may be used to detect a vehicle passing through a gate that deviates from the rules from the acquired image. The suspicious information may be an acquisition time of image information that satisfies the above-described setting condition or image information that satisfies the set condition.

For example, the image acquisition unit 150 may include a closed circuit monitoring device, and the manager may check the CCTV image near the acquisition time of the image information to detect the illegally used vehicle. For example, the act of passing an unregistered vehicle as if it were a registered vehicle because the owner of the vehicle is located near the gate at the time of passing the gate after attaching the paper with the registered vehicle number to the license plate may be an act of illegal use. Such illegal use can be detected by the administrator checking the CCTV and specifying the vehicle that passed at that time.

For example, the management server 200 may store image information that meets a set condition (eg, an image when a person is captured around an approaching vehicle). The manager can search for illegally used vehicles by directly checking the images (photos) corresponding to the suspicious information and going through the verification process, such as conducting a more detailed investigation of the vehicles corresponding to the illegal use.

In step S333, the management server 200 may generate illegal user information. Illegal user information may be generated by directly inputting the vehicle number after the administrator confirms it.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

100: entry/exit processing device
110: control unit
120: communication department
130: short-distance communication unit
140: vehicle recognition unit
150: image acquisition unit
160: blocking unit
165: blocking bar
200: management server
210: control unit
220: communication department
230: storage
300: mobile terminal
400: entry detection unit

Claims (8)

registering a vehicle number;
storing identification information of the mobile terminal associated with the vehicle number;
recognizing the vehicle number of the entering vehicle from the license plate of the vehicle entering the gate;
Receiving information including identification information of the mobile terminal through short-range communication with the mobile terminal;
determining whether the received identification information is identification information stored in association with a previously registered and recognized vehicle number;
determining the recognized vehicle number as a registered vehicle number when the received identification information is associated with a previously registered vehicle number;
obtaining image information about a driver of the approaching vehicle and its surroundings; and
Analyzing the image information, generating suspicious information when a person is caught near the gate at the time when the entering vehicle passes the gate;
The suspicious information includes an image acquired for the purpose of determining the act of passing an unregistered vehicle as if a registered vehicle by the owner of the recognized vehicle number being located near the gate within the short-distance communication range rather than inside the vehicle. How to recognize license plates.
According to claim 1,
The short-distance communication is a double license plate recognition method, characterized in that made by Bluetooth communication.
According to claim 1,
The identification information on the mobile terminal associated with the vehicle number is a double license plate recognition method, characterized in that stored with respect to at least two or more mobile terminals.
According to claim 1,
The identification information is a dual license plate recognition method, characterized in that it includes at least one of a phone number of the mobile terminal, International Mobile Euquipment Identify (IMEI) information, a Mac address, and a Bluetooth address.
delete According to claim 1,
outputting a password input request; and
When a password is input, if the password is associated with a previously registered vehicle number, determining the recognized vehicle number as a registered vehicle number; Dual license plate recognition method further comprising a.
registering a vehicle number;
storing identification information of the mobile terminal associated with the vehicle number;
detecting the mobile terminal of the vehicle operator at a location adjacent to the path to the gate; and
transmitting a Bluetooth mode execution request to the portable terminal so that the Bluetooth mode is activated in advance before the vehicle that is going to pass through the gate enters the gate;
recognizing the license plate number of the vehicle from the license plate when the vehicle enters the gate;
receiving information including identification information of the mobile terminal through short-range communication with the mobile terminal through Bluetooth;
determining whether the received identification information is identification information stored in association with a previously registered and recognized vehicle number; and
When the received identification information is associated with a previously registered vehicle number, determining the recognized vehicle number as a registered vehicle number; including,
The fact that the Bluetooth mode is activated in advance before the vehicle enters the gate is due to a difference between the time for detecting the mobile terminal and the time for recognizing the vehicle number.
registering a vehicle number;
storing identification information of the mobile terminal associated with the vehicle number;
detecting identification information of a mobile terminal of a vehicle driver at a location adjacent to a path moving to a gate; and
determining whether a previously registered vehicle number associated with the identification information detected in the detection step exists;
recognizing the license plate number of the vehicle from the license plate when the vehicle enters the gate;
If there is a previously registered vehicle number associated with the identification information detected in the detection step, and the identification of the vehicle number is made within a predetermined time from the time the identification information of the portable terminal is detected, the following steps are not performed determining the recognized vehicle number as a registered vehicle number to allow the vehicle to pass through the gate;
Receiving information including identification information of the portable terminal through short-distance communication with a portable terminal when a pre-registered vehicle number associated with the identification information detected in the detection step does not exist or the predetermined time is exceeded ;
determining whether the identification information received in the receiving step is identification information stored in association with a previously registered and recognized vehicle number; and
When the identification information received in the receiving step is associated with a previously registered vehicle number, determining the recognized vehicle number as a registered vehicle number; including,
A double license plate recognition method, characterized in that there is a difference between the time for detecting the identification information of the mobile terminal and the time for recognizing the vehicle number.

Images