KR102650518B1 - System for providing resident checking service using car number - Google Patents

Abstract

A system for providing a resident verification service using a license plate number is provided, and includes a manager terminal that photographs and uploads the license plate number and outputs whether the vehicle with the license plate number is the occupant's vehicle, at least one license plate number, at least one occupant information, and A storage unit that maps and stores at least one sticker number, an extraction unit that extracts the license plate number when the license plate number is photographed and uploaded from the manager terminal, and a unit that determines whether the license plate number is mapped to pre-stored occupant information. It includes a verification service providing server including a verification unit and an information unit that informs the manager terminal whether the vehicle with the license plate number is the occupant's vehicle.

Description

Resident verification service provision system using vehicle number {SYSTEM FOR PROVIDING RESIDENT CHECKING SERVICE USING CAR NUMBER}

The present invention relates to a system for providing a resident verification service using a license plate number, and provides a system that outputs whether the vehicle with the license plate number is the occupant's vehicle when the license plate number is photographed.

The problem of insufficient parking space in complex buildings has reached such a serious level that it must be addressed along with the problems of noise between floors and smoking. Although this is a problem caused by a variety of factors, the lack of parking in the complex is bound to be the most critical factor in causing the problem. The Anti-Corruption and Civil Rights Commission conducted a survey on ways to resolve parking conflicts in private properties such as apartment complexes, and as a result, recommended active administration to the Ministry of Land, Infrastructure and Transport to prepare the basis for measures such as towing and imposing fines on vehicles that violate parking in apartment complexes, but there is no basis to date. is not being prepared. While the government ignores illegal parking on private land as a problem between individuals or private autonomy, parking conflicts are emerging as a social problem, leading to vehicle damage, violence, and murder.

At this time, in order to manage vehicles in the apartment, a method of photographing the license plate number or allowing visiting vehicles to enter only after approval was researched and developed. In relation to this, the prior art, Korea Registered Patent No. 10-1743872 (June 16, 2017) Notice) and Korean Patent Publication No. 2018-0011599 (published on February 2, 2018), the manager terminal takes a picture of the license plate of the vehicle, recognizes the license plate number, and checks the license plate number in the database to determine whether it is the occupant's vehicle. It identifies and provides results to the administrator terminal, identifies vehicles entering the complex as resident vehicles or visiting vehicles, takes and records the face if it is a visiting vehicle, and collects parking fees when the visiting vehicle leaves. The structure of calculation and imposition on residents is disclosed.

However, in the former case, even if it is a resident's vehicle, if you need to separately look up the phone number or determine the building and number in order to contact the resident, you must go to the management office again to confirm. In the latter case, the face of the visiting vehicle is also recorded, but if this is registered arbitrarily without the resident's permission, it only results in the resident being charged an absurd parking fee. Accordingly, there is a need for research and development of a system that identifies occupants by vehicle number and provides an interface that allows contact.

In one embodiment of the present invention, when only the vehicle number is photographed and uploaded at the manager terminal to identify the occupant using the vehicle number, information such as whether the vehicle is the occupant's vehicle, building and number, and vehicle type is also output so that the manager can We make parking management easy, and if the vehicle number is unregistered, we check whether it is a visiting vehicle. If it is neither a resident vehicle nor a visiting vehicle, we add it to the unregistered vehicle list and manage it. We also manage the unregistered vehicle list. By starting to charge parking fees and recording evidence of parking fee charges in logs, it is possible to provide a system for providing tenant verification services using license plates that allows civil and criminal damages to be imposed. However, the technical challenge that this embodiment aims to achieve is not limited to the technical challenges described above, and other technical challenges may exist.

As a technical means for achieving the above-described technical problem, an embodiment of the present invention includes a manager terminal for photographing and uploading a license plate number and outputting whether the vehicle with the license plate number is the occupant's vehicle, and at least one license plate number. , a storage unit that maps and stores at least one occupant information and at least one sticker number, an extraction unit that extracts the license plate number when the license plate number is photographed and uploaded from the manager terminal, and a vehicle whose license plate number is mapped to pre-stored occupant information. It includes a confirmation service providing server including a confirmation unit that determines whether the license plate number is the same, and an information unit that informs the manager terminal whether the vehicle with the license plate number is the occupant's vehicle.

According to one of the means for solving the problem of the present invention described above, when only the vehicle number is photographed and uploaded to identify the occupant by the vehicle number at the manager terminal, information such as whether the vehicle is the occupant's vehicle, building and number, and vehicle type is provided. By printing it together, the manager can easily manage parking. If the vehicle number is unregistered as a result of the search, it is checked whether it is a visiting vehicle. If it is neither a resident's vehicle nor a visiting vehicle, it is managed by adding it to the list of unregistered vehicles. , start charging parking fees for a list of unregistered vehicles, and record evidence of parking fee charges in logs so that civil and criminal damages can be imposed.

Figure 1 is a diagram for explaining a system for providing an occupant confirmation service using a license plate number according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a verification service providing server included in the system of FIG. 1.
Figures 3 and 4 are diagrams for explaining an embodiment of an occupant confirmation service using a license plate number according to an embodiment of the present invention.
Figure 5 is an operation flowchart illustrating a method of providing an occupant verification service using a license plate number according to an embodiment of the present invention.

Below, with reference to the attached drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily implement the present invention. However, the present invention may be implemented in many different forms and is not limited to the embodiments described herein. In order to clearly explain the present invention in the drawings, parts that are not related to the description are omitted, and similar parts are given similar reference numerals throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected," but also the case where it is "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, this does not mean excluding other components unless specifically stated to the contrary, but may further include other components, and one or more other features. It should be understood that it does not exclude in advance the presence or addition of numbers, steps, operations, components, parts, or combinations thereof.

The terms "about", "substantially", etc. used throughout the specification are used to mean at or close to that value when manufacturing and material tolerances inherent in the stated meaning are presented, and are used to enhance the understanding of the present invention. Precise or absolute figures are used to assist in preventing unscrupulous infringers from taking unfair advantage of stated disclosures. The term “step of” or “step of” as used throughout the specification of the present invention does not mean “step for.”

In this specification, 'part' includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Additionally, one unit may be realized using two or more pieces of hardware, and two or more units may be realized using one piece of hardware. Meanwhile, '~ part' is not limited to software or hardware, and '~ part' may be configured to reside in an addressable storage medium or may be configured to reproduce one or more processors. Therefore, as an example, '~ part' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functions provided within the components and 'parts' may be combined into a smaller number of components and 'parts' or may be further separated into additional components and 'parts'. Additionally, components and 'parts' may be implemented to regenerate one or more CPUs within a device or a secure multimedia card.

In this specification, some of the operations or functions described as being performed by a terminal, apparatus, or device may instead be performed on a server connected to the terminal, apparatus, or device. Likewise, some of the operations or functions described as being performed by the server may also be performed in a terminal, apparatus, or device connected to the server.

In this specification, some of the operations or functions described as mapping or matching with the terminal mean mapping or matching the terminal's unique number or personal identification information, which is identifying data of the terminal. It can be interpreted as:

Hereinafter, the present invention will be described in detail with reference to the attached drawings.

Figure 1 is a diagram for explaining a system for providing an occupant confirmation service using a license plate number according to an embodiment of the present invention. Referring to FIG. 1, the occupant confirmation service providing system 1 using a license plate number may include at least one occupant terminal 100, a confirmation service providing server 300, and at least one manager terminal 400. . However, since the occupant confirmation service providing system 1 using the license plate number of FIG. 1 is only an embodiment of the present invention, the present invention is not limited to the interpretation of FIG. 1.

At this time, each component of FIG. 1 is generally connected through a network (Network, 200). For example, as shown in FIG. 1, at least one resident terminal 100 may be connected to the verification service providing server 300 through the network 200. In addition, the confirmation service providing server 300 may be connected to at least one resident terminal 100 and at least one manager terminal 400 through the network 200. Additionally, at least one manager terminal 400 may be connected to the verification service providing server 300 through the network 200.

Here, the network refers to a connection structure that allows information exchange between each node, such as a plurality of terminals and servers. Examples of such networks include a local area network (LAN) and a wide area network (WAN). Wide Area Network, Internet (WWW: World Wide Web), wired and wireless data communication network, telephone network, wired and wireless television communication network, etc. Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), 5th Generation Partnership Project (5GPP), 5G New Radio (NR), 6th Generation of Cellular Networks (6G), and Long Term Evolution (LTE). , WIMAX (World Interoperability for Microwave Access), Wi-Fi, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network) ), RF (Radio Frequency), Bluetooth (Bluetooth) network, NFC (Near-Field Communication) network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network, etc., but are not limited to these.

In the following, the term at least one is defined as a term including singular and plural, and even if the term at least one does not exist, each component may exist in singular or plural, and may mean singular or plural. This should be self-explanatory. In addition, whether each component is provided in singular or plural form may be changed depending on the embodiment.

At least one occupant terminal 100 may be an occupant terminal that registers or confirms a visiting vehicle using a web page, app page, program, or application related to the occupant confirmation service using a license plate number. At this time, the occupant terminal 100 may be an occupant terminal that uploads at least one document for registering a vehicle. Additionally, the resident terminal 100 may be a terminal that receives and outputs an entry or exit event of a registered resident's vehicle or a visiting vehicle.

Here, at least one resident terminal 100 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a laptop equipped with a navigation system and a web browser, a desktop, a laptop, etc. At this time, at least one resident terminal 100 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one resident terminal 100 is, for example, a wireless communication device that guarantees portability and mobility, and includes navigation, personal communication system (PCS), global system for mobile communications (GSM), personal digital cellular (PDC), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) ) It may include all types of handheld-based wireless communication devices such as terminals, smartphones, smartpads, and tablet PCs.

The verification service providing server 300 may be a server that provides a tenant verification service web page, app page, program, or application using a license plate number. And, the confirmation service providing server 300 may be a server that maps and stores occupant information, vehicle registration number, building and lake, phone number, sticker number, etc. In addition, the confirmation service providing server 300 may be a server that manages the visited vehicle when the visited vehicle is registered in the resident terminal 100, and may be a vehicle of the resident whose vehicle number taken by the manager terminal 400 is already registered. If it is not a number, it may be a server that checks whether it is a visiting vehicle, and if it is not a visiting vehicle, it may be a server that manages a list of unregistered vehicles. In addition, the verification service providing server 300 may be a server that collects evidence of parking of an unregistered vehicle the moment it is included in the unregistered vehicle list, stores the history as a log, and begins calculating parking fees.

Here, the verification service providing server 300 may be implemented as a computer that can connect to a remote server or terminal through a network. Here, the computer may include, for example, a laptop equipped with a navigation system and a web browser, a desktop, a laptop, etc.

At least one manager terminal 400 may be a manager terminal that manages the parking lot of a complex building using a web page, app page, program, or application related to an occupant confirmation service using a license plate number. At this time, the manager terminal 400 may be a terminal that photographs the vehicle license plate number and outputs the results, that is, whether the vehicle belongs to the occupant, and the vehicle type, unit, and number. Additionally, the manager terminal 400 may be a terminal that, if the vehicle with the photographed license plate number is neither the resident's vehicle nor a visiting vehicle, outputs the vehicle as an unregistered vehicle and requests the administrator to attach a warning notice.

Here, at least one manager terminal 400 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a laptop equipped with a navigation system and a web browser, a desktop, a laptop, etc. At this time, at least one manager terminal 400 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one manager terminal 400 is, for example, a wireless communication device that guarantees portability and mobility, and includes navigation, personal communication system (PCS), global system for mobile communications (GSM), personal digital cellular (PDC), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) ) It may include all types of handheld-based wireless communication devices such as terminals, smartphones, smartpads, and tablet PCs.

Figure 2 is a block diagram for explaining the verification service providing server included in the system of Figure 1, and Figures 3 and 4 are an embodiment of an occupant verification service using a license plate number according to an embodiment of the present invention. This is a drawing to explain.

Referring to FIG. 2, the confirmation service providing server 300 includes a storage unit 310, an extraction unit 320, a confirmation unit 330, an information unit 340, a display unit 350, a contact unit 360, It may include a neighborhood number output unit (370), a visiting vehicle notification unit (380), a management unit (390), an unregistered processing unit (391), an evidence securing unit (393), a billing unit (395), and a sharing unit (397). .

The verification service providing server 300 according to an embodiment of the present invention or another server (not shown) operating in conjunction with the occupant using the license plate number with at least one occupant terminal 100 and at least one administrator terminal 400 When transmitting a confirmation service application, program, app page, web page, etc., at least one occupant terminal 100 and at least one manager terminal 400 are configured to: You can install or open web pages, etc. Additionally, a service program may be run on at least one resident terminal 100 and at least one manager terminal 400 using a script executed in a web browser. Here, a web browser is a program that allows the use of web (WWW: World Wide Web) services and refers to a program that receives and displays hypertext written in HTML (Hyper Text Mark-up Language), for example, Chrome. , Microsoft Edge, Safari, FireFox, Whale, UC Browser, etc. Additionally, an application refers to an application on a terminal and includes, for example, an app running on a mobile terminal (smartphone).

Referring to FIG. 2, the storage unit 310 may map and store at least one license plate number, at least one occupant information, and at least one sticker number.

The extractor 320 can extract the license plate number when the license plate number is photographed and uploaded at the manager terminal 400. At this time, LPR (License Plate Recognition) is a technology that obtains license plate information from the license plates attached to the front and rear of the vehicle. General LPR technology extracts license plate information through OCR (Optical Chractor Recognition) algorithm, image processing algorithm, and artificial intelligence. Recently, when two or more vehicles are driven in one household, there are cases where only one license plate number is registered and all license plates registered on two or more vehicles are attached and falsified. Accordingly, in one embodiment of the present invention, not only the license plate number but also the type of vehicle, that is, the vehicle type, can be identified at once, and then guidance can be given as to whether or not it matches the vehicle being actually photographed. For example, assuming that the car model K5 and license plate number 1234 are registered in room 303 of building 101, [101-303-K5-1234] is registered. At this time, even if the manager terminal 400 photographs the vehicle number 1234 and confirms that it is the occupant's vehicle, if it is SM5 rather than K5, it is not a registered vehicle but an unregistered vehicle. Accordingly, it is possible to identify the vehicle type.

As a first step in extracting vehicle information, you can use a method to distinguish the vehicle manufacturer and model name. YOLOv5, an object recognition algorithm, can be used, and the latest large-scale learning dataset can be obtained from vehicle exterior image data provided by AI-Hub, a domestic artificial intelligence open data platform. The dataset used for learning is AI-Hub vehicle exterior image data. The dataset consists of approximately 1,100,000 pieces of image data by trim and color for 100 types of vehicles and JSON type labeling data. When expressing a Bounding Box for an image, the upper left and lower right coordinates are generally tagged with the box. On the other hand, YOLOv5 used in an embodiment of the present invention sets the coordinates of the center point of the image and tags the Box using the Width and Height values using the scale of the image. Therefore, the coordinate values of the label data can be converted to the coordinate value format of YOLOv5. Additionally, in order to distinguish a total of 100 car models from the label data processed as above, the class for each car model can be specified as a number from [0 to 99], and the name of each class can be set to [manufacturer_model]. . Since the video data included not only photos of the entire vehicle but also photos of each part, a dataset could be constructed by separating only photos of the entire vehicle. Of course, including photos of each part is not excluded. AI Hub recommended that the data ratio of [Learning-Verification-Test] be set at a ratio of 8:1:1, so data can be distributed at the above-mentioned ratio considering augmentation for the color of each car model, and the YOLOv5 model can be learned.

<License plate area detection and recognition license plate area detection>

At this time, detection and recognition can be performed using an image in which the license plate number is relatively distributed near the center. Edge detection can be performed on preprocessed images using Gaussian Blurring, Morphology calculation, and Adaptive Thresholding, and detection can be done by drawing a contour area and estimating the area that resembles a number array as a license plate. In addition, considering that the final detected license plate area may cause a decrease in OCR recognition accuracy if the inclination is not horizontal, the angle calculation formula below can be applied to obtain the angle, and the inclination can be corrected and then extracted.

Finally, to recognize the vehicle number of the license plate, Easy OCR among open source OCRs can be used to perform recognition on the test image along with the previously implemented vehicle model identification.

<Feature point matching>

If a household registers two vehicles as if they were one vehicle, for example, only the K5 vehicle 1234 is registered, but the SM5 vehicle 5678 is not registered and the number 1234 is registered, it can be detected. Of course, in this case, it is possible to distinguish whether it is a registered vehicle or not by distinguishing the vehicle type described above, but if the manufacturer and vehicle type cannot be distinguished in the artificial intelligence model, feature point matching described later, that is, the size of the vehicle, for example, , It can help to distinguish between car types by matching size and feature descriptors such as width, width, and height, or whether they are the same vehicle even if the car model is the same. For example, even if it is the same K5 vehicle, there may be characteristics such as different areas of damage to the vehicle depending on driving habits. Using these characteristics, it can be used as a tool to determine whether vehicles are identical even if they are the same model.

First, when a vehicle enters, the vehicle entry video is received through a camera and the vehicle image extraction process is performed. The extracted image is transformed so that it can be used for license plate recognition and feature point matching. The created image goes through the same license plate recognition process as a general parking control system. If the license plate is not registered in the database, entry of the vehicle is prohibited or a new process is performed to register the license plate in the database. If the license plate is registered, the image is processed through a license plate recognition process. Next, the feature point matching process is performed. In the feature point matching process, feature points and feature descriptors are extracted from the image returned through the vehicle image extraction process through the ORB (Oriented Fast and Rotated Brief) algorithm and compared with the feature information of the original image stored in the database, similar to the license plate recognition process. goes through In this process, feature point similarity is calculated based on how similar it is to the feature point of the original image. If the similarity exceeds the standard, it is judged to be the same vehicle model registered in the database and proceeds to the internal existence confirmation process.

At this time, in order to determine that the entering vehicle is a vehicle with a counterfeit license plate or another vehicle and to allow the same vehicle to pass, a reference point must be applied to determine how many characteristic points must be matched. At least how many characteristic points must be matched to store the entered vehicle. A neural network model can be used to determine the feature point matching standard For data to train the model, the number of feature point matches extracted from all vehicle entry image data collected can be set to X, and whether the vehicle actually passed can be set to Y accordingly. In other words, by learning the result Y according to X of the data with a neural network model, it is possible to predict whether Y will pass according to the number

At this time, the ORB algorithm is an algorithm created based on the FAST (Features from Accelerated Segment Test) algorithm, which detects feature points in images, and the BRIEF (Binary Robust Independent Elementary Features) algorithm, which quickly calculates and matches feature descriptors. ORB is capable of real-time operation while showing matching performance at the same level as SIFT and SURF through efficient calculation. In addition, it shows robust characteristics that are not affected by image rotation or size changes. Of course, it goes without saying that various algorithms can be used in addition to the feature point matching algorithm described above.

The confirmation unit 330 can determine whether the vehicle number is a vehicle number mapped to pre-stored occupant information.

The information unit 340 may inform the manager terminal 400 of whether the vehicle with the license plate number is the occupant's vehicle. The manager terminal 400 can photograph and upload a license plate number and output whether the vehicle with the license plate number is the occupant's vehicle.

When the camera is turned on in the manager terminal 400, the display unit 350 can display in real time as AR (Augment Reality) content whether the vehicle with the license plate number recognized by the camera is the occupant's vehicle. The manager can take photos one by one and upload them to determine whether the vehicle belongs to a resident, but if the number of households exceeds 1,000, the number of parking spaces also increases, which can result in significant manpower consumption. Accordingly, the manager can take appropriate action by determining whether the vehicle is a resident's vehicle on the screen captured in real time.

If the vehicle with the license plate number is determined to be the occupant's vehicle, the contact unit 360 presses the call button or send text button to make a call or send a message from the manager terminal 400 to the occupant's terminal 100. can be provided.

When the vehicle with the license plate number is output as the occupant's vehicle, the unit number output unit 370 may output the occupant's unit and unit number and the type of the occupant's vehicle.

The visiting vehicle notification unit 380 may receive registration of a visiting vehicle from the resident terminal 100 and guide the visiting vehicle to the resident terminal 100 when the license plate number of the visiting vehicle is recognized by the parking controller. For example, in cases where a tutor needs to visit or a repairman needs to visit, residents can register the date and vehicle number in advance. At this time, when the registered license plate number of the visiting vehicle is read from the parking controller, the visiting vehicle notification unit 380 can notify the occupant terminal 100 of the entry event.

If there is a visiting vehicle that has not been registered in the resident terminal 100, the management unit 390 requests confirmation of the visiting vehicle from the resident terminal 100, and if the visiting vehicle is reported by the resident terminal 100, a report is made. You can manage the license plate number of a visiting vehicle as a no-entry list. At this time, if the autonomous robot can read the phone number in the car window or if the drone can be called to the relevant location, the phone number in the car window is extracted and delivered to the manager terminal 400 or the management unit 390. You can upload it to make automatic calls or send messages like ARS. At this time, information on parking fee charges can be provided together with a message or voice requesting to leave the car, so that it can be used as a basis for charging parking fees in the future.

The non-registration processing unit 391 causes the autonomous robot to move a preset route at preset times and photograph the license plate number of a parked vehicle. If the vehicle with the license plate number is not the occupant's vehicle, the license plate number is converted to an unregistered vehicle. You can register. At this time, it must not be a vehicle belonging to a resident or a visitor. Such unregistered vehicles cannot use the apartment's parking lot, but they have entered without permission. There are cases where they are left unattended for several months after entering without permission. Therefore, if registered as an unregistered vehicle, take photos of your entry and stay every day. As evidence of this, you can claim parking fees and various civil and criminal damages.

In the case of self-driving robots, the driving space can be mapped in advance using sensors such as LIDAR and RGB-D to reach the destination in a highly complex space. After that, the optimal route can be created using Map. Here, if a nearby obstacle occurs while driving the route, a method of avoiding it is used by regenerating the map or creating a local path. However, the sensors mounted on the autonomous robot cannot determine the risk of collision with other obstacles hidden by the obstacle and are very close. Obstacles occurring on the street may be misrecognized. Accordingly, using global vision that can cover the entire driving space, the autonomous robot can recognize the location of hidden obstacles and avoid obstacles even in a mixed space.

<Global Vision System>

At this time, LifeCam HD-3000 can be used as the camera, and a separate frame can be created on the ceiling to cover all driving space with FOV (Field of View). Additionally, a separate jig can be designed to install and fix the camera in an appropriate location on the manufactured frame. You can fix the camera to the frame using a jig. At this time, the camera used in the Global Vision System can be connected to a PC, which calculates the location of the autonomous robot and hidden obstacles using a recognition algorithm based on the collected images. Afterwards, the calculated location can be transmitted to the Robot Control Board connected via Wi-Fi to change the route.

Since self-driving robots must move fluidly in narrow spaces, a Tri-Tracked Tank Robot based on tracked wheels can be used. The control board can use the Jetson Tx2, which is easy to mount on a mobile robot and is capable of image processing, and the camera can use the ZED Stereo Camera, which can measure depth. The top plate can be designed and manufactured for the purpose of loading products or containers and installing markers to calculate the position of the robot in the Global Vision System. The marker on the top plate can be a red circular marker on a black background. Find a circular marker using Template Matching on the frame obtained from the Global Vision System and calculate the coordinates of the circular marker based on the camera installation location. The coordinates of the marker are transmitted to the Robot Control Board. In self-driving robots, the SLAM algorithm can be used based on the Depth Data of the Stereo Camera. The Map can be updated by adding the coordinates of the marker on the space mapped through the SLAM algorithm.

The evidence securing unit 393 excludes previously registered visiting vehicles from among the unregistered vehicles, creates a list of unregistered vehicles, transmits the unregistered vehicle list to the manager terminal 400, and identifies the unregistered vehicles in the manager terminal 400. When a parking request message is delivered to the owner, the parking request message can be saved, the vehicle registration number and phone number of the unregistered vehicle can be mapped, stored and managed, and the transmission history of the parking request message can be managed as a log.

The billing unit 395 may calculate the parking fee for an unregistered vehicle based on the parking fee for the complex or apartment complex of the manager terminal 400 and transmit evidence to a preset expert terminal to request and notify the parking fee. At this time, if the unregistered vehicle is a resident's vehicle, the billing unit 395 can charge the parking fee by adding it to the management fee. In the case of vehicles managed as an unregistered vehicle list, entry is prohibited, and even when exiting, the parking fee and the basis for calculating the parking fee, i.e., evidence materials, are transmitted to the manager terminal 400, so that the car owner must settle the parking fee before leaving the car. .

The sharing unit 397 can store and share the list of unregistered vehicles in a database.

Hereinafter, the operation process according to the configuration of the confirmation service providing server of FIG. 2 described above will be described in detail using FIGS. 3 and 4 as an example. However, it will be apparent that the embodiment is only one of various embodiments of the present invention and is not limited thereto.

Referring to FIG. 3, (a) the verification service providing server 300 stores the vehicle number, occupant, building and number, phone number, sticker number, etc., and when recognizing the vehicle number as in (b), the vehicle number Check whether the vehicle is the resident's vehicle, and if it is not the resident's vehicle, (c) check whether it is a visiting vehicle, and if it is neither the resident's vehicle nor a visiting vehicle, add it to the unregistered vehicle list and manage it. In addition, the verification service providing server 300 can accumulate and manage evidence for various civil and criminal damage claims, such as complaints and accusations about trespassing, as shown in (d). The service according to FIGS. 4A and 4B according to an embodiment of the present invention restricts login so that only administrators can access the function of searching for buildings and lakes by vehicle number, as shown in FIG. 4C, and provides parking management as shown in FIG. 4D. It collects and provides only the necessary functions. By entering or photographing the vehicle number and entering or photographing the vehicle sticker number, it is possible to determine whether the vehicle is occupied, as shown in Figure 4e. In addition, when it is difficult to recognize the license plate number with a camera, it can be set to search by entering the license plate number in text or entering the vehicle sticker number as shown in Figure 4f.

Matters that are not explained regarding the method of providing the occupant confirmation service using the license plate number of FIGS. 2 to 4 are the same as or are derived from the content previously described regarding the method of providing the occupant verification service using the license plate number of FIG. 1. Since it can be easily inferred, the description below will be omitted.

FIG. 5 is a diagram illustrating a process in which data is transmitted and received between each component included in the system for providing an occupant confirmation service using the license plate number of FIG. 1 according to an embodiment of the present invention. Hereinafter, an example of the process of transmitting and receiving data between each component will be described with reference to FIG. 5, but the present application is not limited to this embodiment, and the process shown in FIG. 5 according to the various embodiments described above It is obvious to those skilled in the art that the process of transmitting and receiving data can be changed.

Referring to FIG. 5, the confirmation service providing server maps and stores at least one license plate number, at least one occupant information, and at least one sticker number (S5100).

In addition, the confirmation service providing server extracts the license plate number when the administrator terminal photographs and uploads the license plate number (S5200) and determines whether the license plate number is mapped to pre-stored occupant information (S5300).

Additionally, the confirmation service providing server informs the manager terminal whether the vehicle with the license plate number is the resident's vehicle (S5400).

The sequence between the above-described steps (S5100 to S5400) is only an example and is not limited thereto. That is, the order between the above-described steps (S5100 to S5400) may change, and some of the steps may be executed simultaneously or deleted.

Matters that are not explained regarding the method of providing the occupant confirmation service using the license plate number of FIG. 5 are the same as, or are derived from, the content previously described regarding the method of providing the occupant verification service using the license plate number of FIGS. 1 to 4. Since it can be easily inferred, the description below will be omitted.

The method of providing an occupant verification service using a license plate number according to an embodiment described in FIG. 5 may also be implemented in the form of a recording medium containing instructions executable by a computer, such as an application or program module executed by a computer. You can. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and non-volatile media, removable and non-removable media. Additionally, computer-readable media may include all computer storage media. Computer storage media includes both volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data.

The method of providing an occupant verification service using a vehicle license plate number according to an embodiment of the present invention described above is performed by using an application installed by default on the terminal (this may include programs included in the platform or operating system, etc., which are installed by default on the terminal). It may be executed by an application (i.e., a program) installed by the user directly on the master terminal through an application providing server such as an application store server, an application, or a web server related to the service. In this sense, the method of providing an occupant verification service using a vehicle license plate number according to an embodiment of the present invention described above is implemented as an application (i.e., a program) installed by default in the terminal or directly installed by the user, and is implemented by a computer such as the terminal. It can be recorded on a readable recording medium.

The description of the present invention described above is for illustrative purposes, and those skilled in the art will understand that the present invention can be easily modified into other specific forms without changing the technical idea or essential features of the present invention. will be. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive. For example, each component described as unitary may be implemented in a distributed manner, and similarly, components described as distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

Claims (10)

An administrator terminal that photographs and uploads a license plate number and outputs whether the vehicle with the license plate number is the occupant's vehicle; and
A storage unit that maps and stores at least one license plate number, at least one occupant information, and at least one sticker number, an extraction unit that extracts the license plate number when the license plate number is photographed and uploaded by the manager terminal, and the license plate number. A confirmation unit that determines whether the license plate number is mapped to the stored occupant information, an information unit that informs the manager terminal whether the vehicle with the license plate number is the resident's vehicle, and a confirmation unit that informs the manager terminal whether the vehicle with the license plate number is the resident's vehicle. If it is determined that the manager's terminal is a contact unit that provides a call button and a text message button to make a call or send a message to the resident's terminal, if the vehicle with the license plate number is output as the resident's vehicle, It includes a confirmation service providing server including a unit number output unit that outputs the unit and unit number of the occupant and the type of vehicle of the occupant to a preset manager;
The extraction unit,
When driving two or more vehicles in one household, register only one license plate number and attach all license plates registered to two or more vehicles to prevent forgery or falsification. After confirming the size of the vehicle through the width, width, and height of the vehicle, the model of the vehicle is identified through the confirmed size of the vehicle,
The information department said,
A system for providing an occupant verification service using a vehicle number, characterized in that it provides guidance on whether or not it matches the vehicle being actually photographed based on not only the vehicle number but also the type of vehicle.
According to claim 1,
The verification service providing server is,
When the camera is turned on in the manager terminal, a display unit that displays in real time whether the vehicle with the license plate number recognized by the camera is the occupant's vehicle through AR (Augment Reality) content;
A system for providing a tenant verification service using a license plate number, further comprising:
delete delete According to claim 1,
The verification service providing server is,
A visiting vehicle notification unit that receives a visiting vehicle from a resident's terminal and guides the visiting vehicle to the resident's terminal when the vehicle's license plate number is recognized by the parking controller;
A system for providing a tenant verification service using a license plate number, further comprising:
According to claim 5,
The verification service providing server is,
If there is a visited vehicle that has not been registered in the resident terminal, confirmation of the visited vehicle is requested through the resident terminal, and if the visited vehicle is reported in the resident terminal, the vehicle number of the reported visited vehicle is added to the no-entry list. management department to manage;
A system for providing a tenant verification service using a license plate number, further comprising:
According to claim 1,
The verification service providing server is,
An unregistration processing unit that causes the autonomous robot to travel a preset route at preset times and photograph the license plate number of a parked vehicle, and registers the license plate number as an unregistered vehicle if the vehicle with the license plate number is not the occupant's vehicle;
A system for providing a tenant verification service using a license plate number, further comprising:
According to claim 7,
The verification service providing server is,
After excluding previously registered visited vehicles from among the unregistered vehicles, a list of unregistered vehicles is created, the list of unregistered vehicles is delivered to the manager terminal, and the manager terminal delivers a departure request message to the owner of the unregistered vehicle. an evidence securing unit that stores a vehicle extraction request message, stores and manages the vehicle registration number and phone number of the unregistered vehicle by mapping them, and manages the transmission history of the vehicle extraction request message as a log;
A system for providing a tenant verification service using a license plate number, further comprising:
According to claim 8,
The verification service providing server is,
a billing unit that calculates a parking fee for the unregistered vehicle according to the parking fee of the complex or apartment complex of the manager terminal and transmits evidence to a preset expert terminal to claim and notify the parking fee;
A system for providing a tenant verification service using a license plate number, further comprising:
According to claim 8,
The verification service providing server is,
a sharing unit that stores and shares the unregistered vehicle list in a database;
A system for providing a tenant verification service using a license plate number, further comprising:

Images