KR102287051B1 - Parking space managing system by using image recognizing device - Google Patents

Abstract

The present disclosure is a parking lot management system using an image recognition device, and according to an embodiment, recognizes the entrance/exit of a vehicle in a specific area, recognizes a parking surface included in the specific area, and moves the vehicle in the specific area at least one imaging device configured to track; and at least one server for image processing, wherein the at least one photographing device is configured to photograph a first image of an approaching vehicle entering the specific area and transmit it to the at least one server, The photographing device is configured to photograph a second image for the specific area including the parking surface and transmit it to the at least one server, wherein the at least one server is based on the first image, the vehicle of the entering vehicle Reading vehicle information including a number, tracking the location of the vehicle entering by using the vehicle information and the second image, to determine whether the vehicle is parked in the parking surface included in the specific area can be configured. Various other embodiments are possible.

Description

Parking surface management system using image recognition device {PARKING SPACE MANAGING SYSTEM BY USING IMAGE RECOGNIZING DEVICE}

The present disclosure relates to a parking lot management system using an image recognition device. More specifically, the present disclosure relates to a parking lot management system in which a vehicle information recognition device and an image recognition device installed on an entrance and exit of an on-street parking lot are interlocked.

Unless otherwise stated herein, the material described in this section is not prior art to the claims in this application, and should not be admitted as prior art on the grounds that it is recited in this section.

The parking lot may be classified into an on-street parking lot, an off-street parking lot, and an attached parking lot. A curb parking area refers to a facility installed on the road surface of a road or a certain area of a traffic plaza for car parking, and is provided for general use. The road parking lot is difficult to manage because the entrance and exit are not restricted, so a fixed circuit breaker and a toll settlement station that control entry and exit cannot be installed.

Conventionally, a method for managing an on-street parking lot can be classified into a manned method and an unmanned method. The manned method is a method of having a resident resident to check parking status and settling the fee, but it is a method of ensuring the manager's working hours and working environment, taking responsibility for damage to the vehicle, and losing parking fees due to difficulties in calculating the exact parking time. There is a problem. The unmanned method is a typical method of installing a vehicle recognition device on a parking surface, but there is a problem that it costs a lot to build a vehicle information recognition device for each parking surface in order to recognize the license plate number of a parked vehicle.

An object of the present invention is to provide an unmanned parking surface management system using an image recognition device to solve the above problems occurring during parking lot operation. Specifically, an object of the present invention is to provide a management system for an on-street parking lot that can be managed without installing a vehicle recognition device on each of the parking surfaces.

The present disclosure is a parking lot management system using an image recognition device, and according to an embodiment, recognizes the entrance/exit of a vehicle in a specific area, recognizes a parking surface included in the specific area, and moves the vehicle in the specific area at least one imaging device configured to track; and at least one server for image processing, wherein the at least one photographing device is configured to photograph a first image of an approaching vehicle entering the specific area and transmit it to the at least one server, The photographing device is configured to photograph a second image for the specific area including the parking surface and transmit it to the at least one server, wherein the at least one server is based on the first image, the vehicle of the entering vehicle Reading vehicle information including a number, tracking the location of the vehicle entering by using the vehicle information and the second image, to determine whether the vehicle is parked in the parking surface included in the specific area can be configured.

In an embodiment of the present disclosure, the at least one server sets the entering vehicle as a parked vehicle when it is determined that the entering vehicle is parked, and confirms the parking date and time of the parked vehicle and the location in the parking surface. can be configured.

In an embodiment of the present disclosure, the at least one photographing device is configured to photograph a third image of an advancing vehicle advancing from the specific area and transmit it to the at least one server, wherein the at least one server is configured to transmit the third image Based on the image, the vehicle information including the vehicle number of the exiting vehicle is checked, and when the vehicle information of the exiting vehicle matches the vehicle information of the parked vehicle, the payment for the parking vehicle may be processed. .

In an embodiment of the present disclosure, the at least one server may further configure vehicle information to identify the entering vehicle from the second image using the entry date and time at which the first image was obtained.

In an embodiment of the present disclosure, the at least one server checks the vehicle information of the entering vehicle stored in the database using the vehicle number and identifies the entering vehicle from the second image using the vehicle information. can be further configured.

In an embodiment of the present disclosure, the at least one server checks whether the vehicle entering the specific area has paid a fee in advance, and if the vehicle exiting from the specific area has not paid a fee in advance, the parking lot Check the fare based on the date and time and the exit date, check the user information of the exit vehicle to determine whether the user of the exit vehicle is a registered member, and if the user of the exit vehicle is a registered member, user information It may be configured to request a payment to the user terminal based on the.

In an embodiment of the present disclosure, the at least one server is configured to include the vehicle information and the second 2 by using the image to track the vehicle and may be configured to determine whether the vehicle is parked.

In an embodiment of the present disclosure, when the at least one server identifies the parked vehicle from the second image, the parked vehicle is tracked using the second image, and the parked vehicle enters the specific area. It may be configured to check the date and time, read the vehicle information of the parked vehicle from the first image, and match the read vehicle information with the parked vehicle based on the entry date and time.

In an embodiment of the present disclosure, the at least one server may be further configured to provide a parking information guide service to the user of the parked vehicle using the vehicle information, the identified parking date and time, and a parking surface.

In an embodiment of the present disclosure, the at least one photographing device includes a plurality of vehicle information recognition devices for recognizing the entrance/exit of a vehicle in the specific area, and recognition of a parking surface included in the specific area and a specific area It may include a parking lot photographing device for recognizing the movement of the vehicle within.

As a method of managing a parking lot using image recognition according to an embodiment of the present disclosure, it recognizes the entrance/exit of a vehicle in a specific area, recognizes a parking surface included in the specific area, and moves the vehicle within the specific area. Receive a first image of an approaching vehicle entering the specific area, obtained by at least one photographing device configured to track , based on the first image, reading vehicle information including the vehicle number of the entering vehicle, tracking the location of the entering vehicle using the vehicle information and the second image, so that the entering vehicle is the specific It is possible to manage a parking lot using image recognition to determine whether or not to be parked in the parking surface included in the area.

In one embodiment, when it is determined that the entering vehicle is parked, the entering vehicle is set as a parked vehicle, and the parking date and time of the parking vehicle and the parking position in the parking surface are checked, and the parking lot using image recognition is managed. can do.

In an embodiment, receiving a third image of an advancing vehicle advancing from the specific area obtained by the at least one photographing device, and based on the third image, a vehicle including the vehicle number of the advancing vehicle After checking the information, if the vehicle information of the outgoing vehicle matches the vehicle information of the parked vehicle, the payment for the parked vehicle may be processed.

It is checked whether the vehicle entering the specific area has paid a fee in advance, and if the fee has not been paid to the vehicle exiting in advance, the fee is checked based on the parking date and time and the exit date and time, and the exit vehicle It is possible to check whether the user of the exit vehicle is a registered member by checking user information of , and when the user of the exit vehicle is a registered member, a payment may be requested from the user terminal based on the user information.

At least one photographing device configured to recognize entry and exit of a vehicle in a specific area, recognize a parking surface included in the specific area, and track the movement of the vehicle in the specific area, according to an embodiment of the present disclosure; And as a non-transitory computer-readable medium storing a program for functioning a system for managing a parking lot using image recognition comprising at least one server for image processing, the program is, the at least one photographing device acquired, the parking Receive a first image of an approaching vehicle entering the specific area including a surface, receive a second image for the specific area obtained by the at least one photographing device, and based on the first image, Reading vehicle information including the vehicle number of the entering vehicle, tracking the location of the entering vehicle using the vehicle information and the second image, and parking the entering vehicle in the parking surface included in the specific area It can be configured to determine whether or not

The present disclosure uses the parking surface management system using the image recognition device to effectively manage even a parking space (for example, a street parking lot) in which entrances and exits are not restricted with fewer facilities.

The parking lot management system according to an embodiment of the present disclosure recognizes only the parked vehicle without the need to analyze all the images (for example, images from all viewpoints) acquired by the parking lot shooting device, and analyzes only the image of the parking vehicle. It can reduce errors in vehicle recognition and tracking and enable efficient parking lot management.

The parking lot management system according to an embodiment of the present disclosure does not track all the vehicles in the parking lot, but only traces the movement before the parking date and time for the parked vehicle, so that the vehicle information of the parked vehicle can be confirmed, tracking the movement of the vehicle in the image. You can save resources. Also, according to an embodiment of the present disclosure, the transmission and/or reception operation of images for all vehicles entering the parking lot between the vehicle information recognition device and the server or the vehicle information recognition device or the server reads vehicle information for all vehicles Resources for processing operations can be saved.

The above brief summary and description of effects are merely exemplary and are not intended to limit the technical matters intended in the present disclosure. In addition to the above-described exemplary embodiments and technical features, additional embodiments and technical features may be understood by referring to the following detailed description and accompanying drawings.

The features of the present disclosure described above and other additional features will be described in detail below with reference to the accompanying drawings. These drawings illustrate only a few embodiments according to the present disclosure, and should not be construed as limiting the scope of the technical spirit of the present disclosure. The technical spirit of the present disclosure will be described more specifically and in detail using the accompanying drawings.
1 is a schematic diagram of a parking lot management system using an image recognition device according to an embodiment of the present disclosure.
2 is a functional block diagram of a parking surface management system using an image recognition device according to an embodiment of the present disclosure.
3 is a flowchart illustrating a process of a parking surface management system using an image recognition device according to an embodiment of the present disclosure.
4 shows a situation view from above of a parking lot including a parking surface according to an embodiment of the present disclosure;
5 is an exemplary flowchart of a process for payment processing in a parking lot management system using an image recognition device according to an embodiment of the present disclosure.
6 is a flowchart illustrating a process of a parking surface management system using an image recognition device according to another embodiment of the present disclosure.
7 is a flowchart illustrating a process of a parking surface management system using an image recognition device according to another embodiment of the present disclosure.

Hereinafter, embodiments and examples of the present application will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art to which the present disclosure pertains can easily carry out. However, the present application may be embodied in many different forms and is not limited to the embodiments and examples described herein.

The present disclosure relates to a parking lot management system using an image recognition device. More specifically, the present disclosure relates to a parking lot management system in which a vehicle information recognition device and an image recognition device installed on an entrance and exit of an on-street parking lot are interlocked.

1 is a schematic diagram of a parking lot management system using an image recognition device according to an embodiment of the present disclosure. The parking lot management system 100 according to an embodiment of the present disclosure may include a server 110 , a vehicle information recognition device 120 , and a parking lot photographing device 130 . According to an embodiment, the parking surface management system 100 may further include a payment means (eg, a payment device (or unmanned payment machine) 141 or a user terminal 142 ). The vehicle information recognition device 120 , the parking lot photographing device 130 , and the payment device may be provided in a specific area 150 including a road as well as the parking surface 151 . Hereinafter, the specific area 150 will be referred to as a parking lot 150 for convenience of description.

According to an embodiment, the vehicle information recognition device 120 may be configured to obtain vehicle information (eg, vehicle number) of a vehicle entering and exiting the parking lot 150 including the parking surface 151 . . For example, the vehicle information recognition device 120 may be configured to photograph the entrance and/or exit of the parking lot 150 . The server 110 may read vehicle information of a vehicle entering the parking lot 150 by using the image received from the vehicle information recognition device 120 . In the present disclosure, an 'image' may include a still image, a plurality of still images, or a video image (or video) at a specific time point.

According to an embodiment, the parking lot photographing device 130 may be configured to photograph substantially the entire area of the parking lot 150 . The server 110 may acquire a parking lot image obtained by photographing the parking lot 150 from the parking lot photographing device 130 . The server 110 can match and track the entering vehicle in the parking lot image received from the parking lot photographing device 130 by using the vehicle information, and check whether the entering vehicle is parked on the parking surface 151. . The server 110 may determine the parking time and determine the parking fee of the vehicle using at least one of the parking lot image obtained from the parking lot photographing device 130 and the vehicle information obtained from the vehicle information recognition device 120 . As described above, the parking lot photographing device 130 can recognize, track, and manage a vehicle in the parking lot using the parking lot image photographed, and the parking lot photographing device 130 may be referred to as an image recognition device.

The server 110 may check whether the user of the parked vehicle has paid the parking fee using the parking fee payment means. The user may pay the parking fee through the payment device 141 or an application installed on the user's terminal 142 . The server 110 checks whether the vehicle has advanced from the parking lot 150 using at least one of the image obtained from the parking lot photographing device 130 , the entry date and time, and the vehicle information acquired from the vehicle information recognition device 120 . can The server 110 may be configured to request a later payment from the user when the parking fee of the vehicle advancing from the parking lot 150 is not settled in advance.

According to an embodiment of the present disclosure, the server 110, the vehicle information recognition device 120, and the parking lot photographing device 130 can be easily managed without installing the vehicle information recognition device on each parking surface based on the above-described operations. An unmanned parking lot management system can be provided. In addition, the embodiment of the present disclosure can be used for other purposes (eg, a car) as well as a parking lot provided with an entrance and exit in a specific area substantially, so it is easy to manage a parking lot without an entrance and exit for a parking lot only. system can be provided.

2 is a functional block diagram of a parking surface management system using an image recognition device according to an embodiment of the present disclosure.

According to an embodiment, the parking surface management system 100 using the image recognition device may include a server 110 , a vehicle information recognition device 120 , a parking lot photographing device 130 , and a payment means 140 . Components of the parking surface management system 100 , that is, the server 110 , the vehicle information recognition device 120 , the parking lot photographing device 130 , and the payment means 140 may be connected by the network 101 . Network 101 may be comprised of any apparatus or device having a computer network, the Internet, a telephone network, a TCP/IP data network (including WAN, LAN, VPN, etc.) and other communication capabilities.

According to an embodiment, the server 110 may be an application server, a standalone server, a web server, and any other computing device having a data transmission/reception function, a data identification function, and a data processing function.

According to an embodiment, the server 110 includes an entry/exit management module 111 , a location tracking module 112 , and a fee management module 113 for processing any process related to the parking surface management system using the image recognition device. ), a member management module 114 , and/or a database (DB) 115 for storing and managing all data necessary for performing a process.

According to an embodiment, the entry/exit management module 111 may identify the vehicle 160 entering or exiting the parking lot 150 . For example, the entry/exit management module 111 selects a vehicle entering the parking lot 150 and a vehicle leaving the parking lot 150 using vehicle information read based on the image obtained from the vehicle information recognition device 120 . can be checked In another embodiment, the entry/exit management module 111 may request the vehicle information recognition device 120 for an image acquired at a desired date and time.

According to an embodiment, the location tracking module 112 may be configured to analyze the image of the area of the parking lot 150 to obtain vehicle information of the vehicle, whether the vehicle is parked, and information on the parking surface where the vehicle is parked. The location tracking module 112 may acquire an image of the area of the parking lot 150 from the parking lot photographing device 130 . The location tracking module 112 may request an image of the area of the parking lot 150 at a desired point in time from the parking lot photographing device 130 .

According to an embodiment, the fee management module 113 may process all processes that may be performed in relation to the calculation and settlement of the payment fee. For example, the fee management module 113 may determine charging information based on vehicle information of a parked vehicle. The billing information may include entry date and time, exit date and time, parking fee based on parking date and time, discount information, and other payment information. For example, the discount information may be a discount rate depending on the case when the vehicle is a hybrid vehicle, a vehicle for the disabled, or a multi-child family vehicle, and other payment information includes rate information for a car wash installed in the parking lot 150, Charge information for the installed electric vehicle charging facility, and payment information at a specific place to which the parking lot 150 belongs (eg, a repair shop, a shopping mall, etc.) may be included, but is not limited to the listed examples.

According to an embodiment, the member management module 114 may check whether the user of the vehicle parked in the parking lot 150 is a pre-subscriber of the present system. When the user of the parked vehicle is a pre-subscriber of the present system, the member management module 114 may check information necessary for the service to be provided to the user. For example, the member management module 114 may check a discount according to the user's qualification (eg, membership level), a discount coupon held by the user, and payment information owned by the user.

According to an embodiment, the server 110 may consist of one server or may include a plurality of servers. For example, the server 110 may be one or more central servers or may include one central server and one or more local servers. According to another embodiment, each or one or more of the modules included in the server 110 may be distributed to a central server and a local server. The modules may be separated into a plurality of modules or may be merged into one, and various embodiments are possible.

In other words, a subject performing specific processing may be determined according to a design selection of the integrated management system 100 . For example, processing performed by one module included in the server 110 may be considered to be performed by one integrated management server. In addition, some processing exemplified to be performed by one module in the server 110 may be performed in other components, for example, the vehicle information recognition device 120 , the parking lot photographing device 130 , and vice versa.

According to an embodiment, the vehicle information recognizing apparatus 120 may recognize the vehicle number of a vehicle passing through the parking lot 150 including the road. In other words, the vehicle information recognition device 120 may be configured to recognize the vehicle number of a vehicle entering and exiting the parking lot 150 . According to an embodiment, the vehicle information recognizing device 120 may include the entering vehicle information recognizing device 121 installed on the entrance of the parking lot 150 and the exiting vehicle information recognizing device 122 installed on the exit of the parking lot 150 . can According to another embodiment, a plurality of entering vehicle information recognition devices 121 may be included in the parking lot management system 100 according to the configuration (eg, the number of lanes) of the entrance and exit roads included in the parking lot 150 . .

According to an embodiment, the vehicle information recognition device 120 may be configured to acquire a front or rear image including a license plate of the vehicle and transmit it to the server 110 . The server 110 may recognize the vehicle number by using the image obtained from the vehicle information recognition device 120 . According to another embodiment, the vehicle information recognizing apparatus 120 may obtain an image including the vehicle number, and recognize the vehicle number using the acquired image. The vehicle information recognition device 120 may be configured to transmit the directly recognized vehicle number to the server 110 . In the above embodiments, the server 110 or the vehicle information recognizing device 120 may recognize the vehicle number from the image using OCR (Optical Character Recognition) technology. Accordingly, the vehicle information recognition device 120 may be referred to as a license plate recognition (LPR) device.

According to an embodiment, the parking lot photographing device 130 may be configured to acquire a parking lot image for the parking lot 150 including the parking surface 151 . The parking lot photographing device 130 may acquire a parking lot image including the parking surface 151 and the entrance road and the exit road from which the vehicle information recognition device 120 acquires the image. The parking lot image obtained by the parking lot photographing device 130 may be used by the server 110 (eg, the location tracking module 113 ) to track the movement of vehicles in the parking lot 150 .

According to an embodiment, the parking lot photographing device 130 may be configured with one or more depending on the size of the parking lot 150 and the angle of view of the camera included in the parking lot photographing device 130 . Also, according to another embodiment of the present disclosure, the vehicle information recognition device 120 and the parking lot photographing device 130 may be configured as at least one device. For example, one multi-capturing device may be configured to have an angle of view capable of photographing both the parking lot 150 including the parking surface 151 and the entrance and exit routes of the parking lot 150 . The multi-capturing device may be configured to acquire a (still) image including the license plate number of a vehicle entering or exiting the parking lot 150 and transmit it to at least one server 110, recognize the parking surface 151, and It may be configured to acquire a (video) image for tracking the movement of the vehicle in the parking lot 150 and transmit it to the at least one server 110 . A parking surface management system according to another embodiment, an image acquisition for recognizing the license plate number of a vehicle entering the parking lot 150, and one photographing device configured to acquire an image for tracking the vehicle in the parking lot 150, It may be configured as another photographing device for recognizing the license plate number of a vehicle advancing from the parking lot 150 . A parking surface management system according to another embodiment, recognizes the vehicle number of the vehicle exiting from the parking lot 150 and one photographing device for recognizing the vehicle number of the vehicle entering the parking lot 150, parking lot ( 150) may be configured with another imaging device configured to acquire an image for vehicle tracking. Various other combinations are possible.

Hereinafter, the processing performed by the parking lot management system 100 described with respect to FIGS. 1 and 2 according to the entry/exit and parking or passage of the vehicle 160 will be described in more detail with reference to FIGS. 3 to 7 . . Accordingly, components having the same or similar reference numerals as those of FIGS. 1 and 2 in FIGS. 3 to 7 may perform the same or similar functions as those of FIGS. 1 and 2 . In addition, some processing exemplified as being performed by the server 110 (eg, a central server installed in a remote location of the parking lot 150) in various embodiments of the present disclosure is performed by a local server installed in the parking lot 150 (not shown). not) may be performed.

According to another embodiment, the server 110 uses the vehicle information, the parking date and time, and the parking surface that can be acquired based on the image captured by the vehicle information recognition device 120 and/or the parking lot photographing device 130 . A parking information guide service for notifying the state of the parking lot 150 (eg, parking surface occupancy information, available parking surface information) may be provided to members of the parking lot 150 .

3 is a flowchart illustrating a process of a parking surface management system using an image recognition device according to an embodiment of the present disclosure. The flowchart of FIG. 3 basically assumes an algorithm implemented on the parking lot management system of the present disclosure, and the components described in FIGS. 1 and 2 below are used to explain each process step of FIG. 3, but the process must be It is not limited to the components described.

The process may start in block 310 in which the server 110 reads vehicle information of the vehicle entering from the image obtained by the vehicle information recognition device. According to one embodiment, when the vehicle 160 enters the parking lot 150 including the parking surface 151, the vehicle information recognizing device 120 (or the entering vehicle information recognizing device 121) at the time of entry An image including the license plate of the vehicle 160 may be acquired. The vehicle information recognition device 120 may transmit the acquired image to the server 110 . The server 110 (or the entry/exit management module 111 ) may read vehicle information of the vehicle 160 from the image received from the vehicle information recognition device 120 . The vehicle information may include the vehicle number of the vehicle 160, the entry position (eg, lane or absolute position) of the vehicle 160, vehicle specifications (eg, vehicle model, color or size of the vehicle), And/or user information (eg, whether a parking lot member) may be further included. Big data technology, cloud computing, distributed computing, client-server, or machine learning technology based thereon may be directly used to read vehicle information, or may be used indirectly to improve reliability of the read vehicle information. In another embodiment, the server 110 may directly receive vehicle information including a vehicle number from the vehicle information recognition device 120 . The process proceeds to block 320 once the vehicle information is read.

In block 320 , the server 110 (or the location tracking module 112 ) may track the vehicle 160 entering the specific area from the image acquired by the parking lot photographing device 130 . To identify the vehicle 160 to be tracked, the server 110 may match each vehicle information to the vehicle 160 based on the vehicle information read in block 310 . The process of matching each vehicle information to the vehicle of the image obtained by the parking lot photographing device 130 may be performed using the entry date and time of the vehicle 160, which will be described later in detail with reference to FIG. .

The process may continue to block 330 where it is determined from the image whether the tracked vehicle 160 is parked on the parking surface 151 . At block 330 , server 110 may end the process if it determines that vehicle 160 is not parked. For example, when it is confirmed that the tracked vehicle 160 leaves the specific area from the image acquired by the parking lot photographing device, or when it is confirmed that the vehicle 160 enters the exit road of the specific area, do not park can be judged as According to one embodiment, by reading the vehicle information of the vehicle 160 entering the vehicle from the image acquired by the vehicle information recognition device 120 (or the exit vehicle information recognition device 122), the vehicle 160 does not park can be judged as For example, the vehicle information recognition device 120 (or the advance vehicle information recognition device 122 ) may acquire an image to include license plates of all vehicles passing through the exit road of the parking lot 150 , and the acquired entry The vehicle image may be transmitted to the server 110 . The server 110 may read vehicle information of the advancing vehicle based on the received advancing vehicle image. The server 110 compares the vehicle information matched to the vehicle going out from the parking lot 150 and the vehicle information read based on the image acquired by the vehicle number recognition device 120 of the exit road, whether the vehicle 160 enters or not. can be checked.

When the server 110 determines that the vehicle 160 is parked, the server 110 may proceed to a block 340 to set the vehicle 160 as a parked vehicle. For example, when it is confirmed that the tracked vehicle 160 occupies the parking surface 151 from the image captured by the parking lot photographing device 130, the tracked vehicle 160 sets the parking surface 151 to a preset When it is confirmed that the vehicle is occupied for a period of time, the vehicle 160 may be set as a parking vehicle. In one embodiment, the server 110 may set the time when the tracked vehicle 160 is set as the parked vehicle as the parking date and time. The parking date and time may be used to determine a parking fee for a parked vehicle.

Block 350 In the following, the un-parking process of the parked vehicle will be described. When the user of the parked vehicle exits from the parking lot 150 , the exiting vehicle 160 may be identified by the vehicle information recognition device 120 . For example, the vehicle information recognition device 120 (or the exit vehicle information recognition device 122 ) may acquire an image to include license plates of all vehicles passing through the exit road of the specific area 150 , and An image of an exit vehicle may be transmitted to the server 110 . The server 110 may read vehicle information of the advancing vehicle based on the received advancing vehicle image. When the confirmed vehicle information is confirmed as vehicle information of a vehicle set as a parked vehicle, the server 110 may lead to a block 360 that processes payment of a parking fee for a parked vehicle.

In block 360 , the server 110 (or the fee management module 113 ) may process payment of a parking fee for a parked vehicle. For example, the server 110 may perform payment processing of at least one of a parking fee determination, pre-payment confirmation, a payment request through an application installed in the user terminal, or a later payment request. The payment processing 360 will be described later in detail with reference to FIG. 5 . The process may be terminated after performing payment processing for the parked vehicle.

Next, an operation in which the parking lot photographing device 130 of the wireless management system according to an embodiment of the present disclosure matches and tracks vehicles in the parking lot 150 with vehicle information will be described with reference to FIG. 4 .

4 shows a situation view from above of the parking lot 150 including the parking surface 151 according to an embodiment of the present disclosure. Referring to FIG. 4 , the parking lot 150 may be defined as a space between the entry area 401 and the exit area 402 . The entering vehicle information recognizing device 121 may acquire an image of a vehicle entering the parking lot 150 as the entry area 401 , and the exiting vehicle information recognizing apparatus 122 as the exit area 402 in the parking lot 150 . You can acquire an image of a vehicle advancing from The parking lot image capturing apparatus 130 may acquire an image of substantially the entire area of the parking lot 150 between the entry area 401 and the exit area 402 .

Referring to FIG. 4 , vehicle information of the vehicle of the vehicle 161 entering the entrance road 401 of the parking lot 150 may be read by the image obtained by the entering vehicle information recognition device 121 . Here, the vehicle information may include a vehicle number of the vehicle 161, an entry date and time, an entry lane, and vehicle specifications (vehicle model, color, size, etc.).

The vehicle 161 entering the parking lot 150 may be set and tracked as the entering vehicle 162 or the parking vehicle 163 based on the image obtained by the parking lot photographing device 130 . According to an embodiment, the server 110 (eg, the location tracking module 112 ) analyzes the parking lot image obtained from the parking lot photographing device 130 to detect the movement of one or more vehicles present in the parking lot 150 . can be tracked In the parking lot image acquired by the parking lot photographing device 130, vehicles are set as the entering vehicle 162 or the parking vehicle 163, and an object representing this may be tagged. For example, as shown in FIG. 4 , the tag may be displayed on the vehicle 162 with a solid line around the vehicle, or the tag on the parking vehicle 163 with a frame with a dotted line around the vehicle. The server 110 may match the entering vehicle 162 and/or the parking vehicle 163 with each vehicle information to track it in the image. In another example, the entering vehicle 162 and the parking vehicle 163 may be marked with a tag (not shown) indicating a vehicle number. The embodiment is not limited thereto, and the tag may include at least one piece of vehicle information.

Here, vehicle information matching the entering vehicle 162 or the parking vehicle 163 may be confirmed by the vehicle information read based on the entering vehicle information recognition device 121 . According to an embodiment, the entering vehicle information recognizing apparatus 121 may acquire an image including the vehicle number of the vehicle 161 entering at the date and time (time point) of entering the entry area 401, and the server 110 may obtain an image from the vehicle information recognition device 121 and read vehicle information including the entry date and time of the vehicle 161 and the vehicle number. The server 110 enters the vehicle recognized in the entry area 401 at the time the vehicle 161 enters in the image captured by the parking lot photographing device 130 at the same date and time (time point) when the vehicle information recognition device 121 enters the same. ) can be confirmed by the vehicle in the image acquired. That is, in the image acquired by the vehicle information recognizing device 121 and the image acquired by the parking lot photographing device 130, in a specific area (for example, the entry area 401 or the exit area 402) at the same time point The recognized vehicle may be recognized as the same vehicle. Accordingly, even if it is difficult to directly read the vehicle information of the vehicle from the image photographed by the parking lot photographing device, it is possible to track the vehicles by matching the vehicle information of each vehicle.

In another embodiment, the server 110 checks the vehicle information stored in the database 115 (or big data, cloud server) using the vehicle number, and the checked vehicle information is the vehicle information and the parking lot photographing device ( 130 may be further used to identify the vehicle 161 within the obtained parking lot image. That is, the server 110 may identify the vehicle in the parking lot image by using the entry date and time and/or vehicle information.

In another embodiment, even if the parking lot photographing device 130 fails to acquire an image for the entry area 401 that the entering vehicle information recognizing device 121 captures, the vehicle 161 entering the entry area 401 The vehicle may be tracked in the parking lot photographing apparatus 130 by predicting the time at which an entering vehicle appears in the image acquired by the parking lot photographing apparatus 130 based on the vehicle speed. In other words, the vehicle information matching of the vehicle recognized by the parking lot photographing apparatus 130 may be possible without the parking lot photographing device 130 necessarily acquiring an image for the entry area 401 or the exit area 402 .

In another embodiment, the entry zone 401 and the exit zone 402 may be the entry zone 402 and the exit zone 401 in opposite lanes. For example, if the parking lot 150 includes an on-street parking lot provided in a lane in the opposite direction as well as an on-street parking lot provided in a lane in one direction, the entry area 401 in the one-way lane is the entry area in the lane in the opposite direction. area can be The vehicle 164 in the opposite lane may enter the exit area 402 of the lane in one direction and may enter the entry area 401 . In this case, the vehicle information recognition device 121 may be configured to recognize the vehicle number of the vehicle entering the vehicle in one direction and at the same time recognize the vehicle number of the vehicle entering the lane of the opposite vehicle. It is self-evident that the operation of the parking lot management system in the lane in the opposite direction is substantially the same as the series of operations described in the present disclosure only in the opposite direction.

Also, in FIG. 4 , only the case where the entry area 401 and the exit area 402 is one area is exemplified. However, each of the entry area 401 and the exit area 402 may be one or more.

5 is an exemplary flowchart of a process for payment processing in a parking lot management system using an image recognition device according to an embodiment of the present disclosure.

The payment processing 360 may start at block 510 for determining whether to pay in advance. The server 110 (eg, the fee management module 113 ) may determine whether a parking fee has been paid in advance when the parked vehicle advances from the parking lot 150 .

When it is determined that the parking fee has been paid in advance, the process may be terminated. The advance payment of the parking fee may be made through the payment device 141 installed in the parking lot 150 and/or an application installed in the user terminal. For example, the user may pay a parking fee by using the payment device 141 before moving out of the parking lot 150, and the payment device 141 sends payment information and payment to the server 110 (eg, For example, the fee management module 113 may be notified. For another example, in response to a request from the user terminal, the server 110 may process pre-payment or automatic payment.

If it is determined that the parking fee has not been paid in advance, block 520 may be performed. In block 520, the server 110 confirms the entry date and time of the parked vehicle, the parking date and time, the departure date and time, the vehicle type (eg, electric vehicle or hybrid), and other discount conditions (eg, multi-child preference) based on the vehicle information of the parked vehicle. And based on this, the parking fee can be determined. In one embodiment, the parking lot 150 may have service facilities such as an electric vehicle charging device installed on the parking surface 151 or a separate car wash facility, and the usage fee of these service facilities or the specific parking lot 150 to which the parking lot 150 belongs. A fee for payment at the venue may be added to the parking fee.

After determining the parking fee, it may lead to block 540 where it is checked whether the user of the parked vehicle is a member of the parking lot management system. In block 540, the server 110 may determine whether the user of the parked vehicle corresponds to a member of the parking lot management system, based on information stored in the member management module 114 and/or the database 115. .

If it is determined in block 530 that the user of the parked vehicle is a member, block 550 may occur. In an embodiment, the server 110 may process an automatic payment for a payment fee based on pre-registered automatic payment information corresponding to the parking fee and vehicle information. In another embodiment, the server 110 may request payment of a parking fee to a user terminal (or an application installed in the user terminal) corresponding to vehicle information. That is, the user who is a member of the parking lot 150 can pay the parking fee using the user terminal without paying the parking fee with a separate payment device 141 .

If it is determined at block 530 that the user of the parked vehicle is not a member, then block 560 may proceed. In block 560, the server 110 may verify information such as contact information for the user of the parked vehicle to notify the user of the parked vehicle of unsettled parking fees. The user's contact information may be stored in the database 115 or verified through a related government agency or insurance company. The server 110 may provide the user with information on parking fees and payment methods through the confirmed user's contact information, information on penalties for non-payment within a set time limit, and information for encouraging membership in the parking lot. The notification method may include, for example, an SMS message E-MAIL, mail, and the like.

6 is a flowchart illustrating a process of a parking surface management system using an image recognition device according to another embodiment of the present disclosure.

The process may start at block 610 in which the server 110 reads the vehicle information of the vehicle entering from the image obtained by the vehicle information recognition device. According to one embodiment, when the vehicle 160 enters the parking lot 150 including the parking surface 151, the vehicle information recognizing device 120 (or the entering vehicle information recognizing device 121) at the time of entry An image including the license plate of the vehicle 160 may be acquired. The vehicle information recognition device 120 may transmit the acquired image to the server 110 . The server 110 (or the entry/exit management module 111 ) may read vehicle information of the vehicle 160 from the image received from the vehicle information recognition device 120 . The vehicle information may include the vehicle number and entry date and time of the vehicle 160, the entry position (eg, lane or absolute position) of the vehicle 160, vehicle specifications (eg, the color or size of the vehicle) , and/or user information (eg, whether a parking lot member) may be further included. Big data technology, cloud computing, distributed computing, client-server, or machine learning technology based thereon may be directly used to read vehicle information, or may be used indirectly to improve reliability of the read vehicle information. In another embodiment, the server 110 may directly receive vehicle information including a vehicle number from the vehicle information recognition device 120 . The process proceeds to block 620, where the vehicle information is read and the entered vehicle is set as the entering vehicle.

In block 620 , the server 110 (or the entry/exit management module 112 ) may check whether the vehicle set as the entry vehicle in block 610 exits from the parking lot 150 for a specified time. In one embodiment, when the entering vehicle advances from the parking lot 150 , the exiting vehicle 160 may be identified by the vehicle information recognition device 120 . For example, the vehicle information recognition device 120 (or the advance vehicle information recognition device 122 ) may acquire an image to include license plates of all vehicles passing through the exit road of the parking lot 150 , and the acquired entry The vehicle image may be transmitted to the server 110 . The server 110 may read the departure date and time of the exiting vehicle and vehicle information based on the received exit vehicle image. When the vehicle set as the entering vehicle is not identified as the entering vehicle for the specified time through comparison with the confirmed vehicle information, the server 110 may lead to a block 630 and set the entering vehicle as a parking vehicle. That is, a vehicle staying in the parking lot 150 for a specified time or longer may be regarded as a parking vehicle. The server 110 compares the vehicle information obtained from the vehicle information recognition device 120 of the exit route with the vehicle information of the entering vehicle, and when it is confirmed that the entering vehicle has advanced, the process may be terminated.

The process may continue with block 630 followed by block 640 of identification as a parked vehicle. In block 640 , the server 110 (eg, a location tracking module) may track a parked vehicle from an image acquired by the parking lot photographing device 130 . The tracking vehicle 160 may be identified based on the vehicle information read in block 610 as described above. The server 110 may check the entry date and time of the parking vehicle 160 . The server 110 may track the parking vehicle in the image acquired by the parking lot photographing device 130 based on the confirmed entry date and time. The server 110 may track the parking vehicle from the image acquired by the parking lot photographing device 130, and check information including the parking date and time of the parking vehicle and the parking surface. That is, in this embodiment, the server 110 does not need to analyze all the images (eg, images from all viewpoints) acquired by the parking lot photographing device 130, the vehicle information recognition device 120 (or entry/exit) Only when a parking vehicle is set by the management module 111), only the image of the corresponding parking vehicle is analyzed to reduce errors in vehicle recognition in the image and efficiently manage the parking lot.

Block 650 In the following, the un-parking process of the parked vehicle will be described. When the user of the parked vehicle exits from the parking lot 150 , the exiting vehicle 160 may be identified by the vehicle information recognition device 120 . When the confirmed vehicle information is confirmed as vehicle information of a vehicle set as a parked vehicle, the server 110 may lead to a block 360 that processes payment of a fee for a parked vehicle.

In block 660 , the server 110 (or the fee management module 113 ) may process payment of a fee for a parked vehicle. For example, the server 110 may perform payment processing of at least one of a payment fee determination, a pre-payment confirmation, a payment request through an application installed in the user terminal, or a later payment request. The process may be terminated after performing payment processing for the parked vehicle.

7 is a flowchart illustrating a process of a parking surface management system using an image recognition device according to another embodiment of the present disclosure.

The process can start at block 710 in which the server 110 (eg, the location tracking module 112) analyzes the parking lot image in the parking lot 150 obtained by the parking lot shooting device 130 to identify the parked vehicle. there is. The server 110 may identify a parking vehicle occupying the parking surface 151 through image recognition of the parking surface 151 . The server 110 may check information such as the parking date and time of the parked vehicle, the occupied parking surface, and the like. The process may then continue to block 720 .

In block 720 , the server 110 may analyze the parking lot image and confirm the entry date and time when the parked vehicle entered the parking lot 150 through the entrance road. In other words, the server 110 analyzes the parking lot image and traces the movement of the parked vehicle to confirm the entry date and time when the parked vehicle entered the parking lot 150 through the access road.

Next, in block 730 , the server 110 (eg, the entry/exit management module 112 ) reads the image obtained from the vehicle information recognition device 120 at the entry date and time confirmed in block 720 . You can check the vehicle information of the parked vehicle. In an embodiment, the image at the time of entry may be received in advance from the vehicle information recognition device 120 (eg, when acquiring the image) and stored in the database 115 of the server 110 . In another embodiment, the image at the time of entry may be obtained from the vehicle information recognition device 120 at the request of the server 110 when it is necessary to check the vehicle information. In another embodiment, the server 110 may directly request the vehicle information at the entry date and time to the vehicle information recognition device 120, and the vehicle information recognition device 120 directly reads the vehicle information in response to the request to the server. may be sent to 110 .

In a next block 740, the server 110 may match the read vehicle information with the parked vehicle. Therefore, according to this embodiment, the server 110 does not track all the vehicles in the parking lot 150, but only for the parking vehicle occupying the parking surface 151, by tracking back the movement before the parking date and time to provide the vehicle information of the parked vehicle. This can save resources for tracking vehicle movement within the image. Also, according to the present embodiment, between the vehicle information recognition device 120 and the server 110, the transmission and/or reception operation of images for all vehicles entering the parking lot 150 or the vehicle information recognition device 120 or the server It is possible to save resources for the processing operation in which 110 reads vehicle information for all vehicles.

Block 750 In the following, the un-parking process of the parked vehicle will be described. When the user of the parked vehicle exits from the parking lot 150 , the exiting vehicle 160 may be identified by the vehicle information recognition device 120 . For example, the vehicle information recognition device 120 (or the exit vehicle information recognition device 122 ) may acquire an image to include license plates of all vehicles passing through the exit road of the specific area 150 , and An image of an exit vehicle may be transmitted to the server 110 . The server 110 may read vehicle information of the advancing vehicle based on the received advancing vehicle image. When the confirmed vehicle information is confirmed as vehicle information of a vehicle set as a parked vehicle, the server 110 may lead to a block 760 that processes payment of a fee for a parked vehicle.

In block 760 , the server 110 (or the fee management module 113 ) may process payment of a fee for a parked vehicle. For example, the server 110 may perform payment processing of at least one of a payment fee determination, a pre-payment confirmation, a payment request through an application installed in the user terminal, or a later payment request. The process may be terminated after performing payment processing for the parked vehicle.

The processes 300, 600, and 700 of the parking lot management system shown in FIGS. 3, 6, and 7 of the present disclosure are described in terms of being performed by the integrated management server shown in FIG. 1 or FIG. 2, and the process block The technical spirit of the present disclosure is not limited to such descriptive examples due to the description. For example, those skilled in the art will understand that a process modified by variously changing or combining the order and function of each block of the process disclosed herein is also possible. On the other hand, the schematic operations illustrated in FIGS. 3, 6, and 7 are provided only as examples, and without departing from the essence of the embodiment, some of the operations may be selectively eliminated, combined into fewer operations, or , can be extended to include additional actions.

The foregoing description of the present application is for illustration, and those of ordinary skill in the art to which the present application pertains will understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present application. For example, in the above description of the present application, the specific area 150 has been described as an on-street parking lot, but the embodiment is not limited thereto, and the specific area 150 includes all types of parking lots (eg, the parking surface 151 ). for example, indoor parking, off-street parking, and street parking). In addition, in the above description of the present application, only the case where there is no vehicle blocking facility in the entrance and exit of the specific area 150 is assumed, but the embodiment of the present disclosure includes a case in which there is a vehicle blocking facility of course. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and likewise components described as distributed may also be implemented in a combined form.

Above, the subject to be claimed in the present disclosure has been specifically examined. The claimed subject matter in this disclosure is not limited in scope to the specific embodiments described above. For example, in some implementations it may be in the form of hardware used operably on a device or combination of devices, in other implementations it may be implemented in the form of software and/or firmware, and in still other implementations it may be in the form of a signal bearing medium; may include one or more articles, such as storage media. Here, a storage medium such as a CD-ROM, a computer disk, a flash memory, etc. is, for example, instructions that, when executed by a computing device such as a computing system, computing platform, or other system, may cause the processor to execute according to the embodiments described above. can be saved. Such computing devices may include one or more processing units or processors, one or more input/output devices such as a display, keyboard and/or mouse, and one or more memory such as static random access memory, dynamic random access memory, flash memory and/or hard drives. may include.

On the other hand, whether to implement a system as hardware or software is a design choice issue that typically represents a cost-effective trade-off. In the present disclosure, there are various means (eg, hardware, software and/or firmware) that may be affected by processes, systems, and other technologies, the preferred means being the processes and/or systems and/or other technologies used by the process and/or systems and/or other technologies. It will change depending on the context in which it is used. For example, if the implementer determines that speed and accuracy are paramount, the implementer may choose primarily hardware and/or firmware means; if flexibility is paramount, the implementer may select primarily a software implementation; Or, alternatively, the implementer may choose any combination of hardware, software and/or firmware.

In the foregoing detailed description, various embodiments of apparatus and/or processes have been described by way of block diagrams, flow diagrams, and/or other examples. Such block diagrams, flow diagrams, and/or other examples will include one or more functions and/or operations, and those skilled in the art will recognize that each function and/or operation within the block diagrams, flow diagrams, and/or other examples may be implemented in hardware, software, firmware, Or it will be understood that they may be implemented individually or collectively by any combination thereof. In one embodiment, some parts of the subject matter described in the present disclosure may be implemented through an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), or other form of integration. In contrast, some aspects of embodiments of the present disclosure include one or more computer programs running on one or more computers (eg, one or more programs running on one or more computer systems), one or more programs running on one or more processors ( may be implemented in whole or in part equivalently in an integrated circuit, e.g., as one or more programs running on one or more microprocessors), firmware, or substantially any combination thereof, and writing code for software and/or firmware and/or the design of the circuit is within the skill of those skilled in the art in light of the present disclosure. In addition, those skilled in the art will understand that the mechanisms of the subject matter of this disclosure may be distributed in various forms of program products, and the examples of the subject matter of this disclosure apply irrespective of the particular type of signal bearing medium used to actually perform the distribution. will understand

While specific exemplary techniques have been described and illustrated herein using various methods and systems, those skilled in the art will understand the possibility of various other modifications or equivalents permutations without departing from the claimed subject matter. Additionally, many modifications may be made to adapt a particular situation to the teachings of the claimed subject matter without departing from the central concepts described herein. Accordingly, it is intended that claimed subject matter not be limited to the specific examples disclosed, but that such claimed subject matter may also include all embodiments falling within the scope of the appended claims and their equivalents.

Throughout the present disclosure, when a part is "connected" with another part, this includes not only the case where it is "directly connected" but also the case where it is "electrically connected" with another element interposed therebetween. do. In addition, throughout the present disclosure, when a member is said to be located "on" another member, this includes not only a case in which a member is in contact with another member but also a case in which another member is present between the two members. Furthermore, throughout the present disclosure, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated. As used herein, the terms "about," "substantially," and the like are used in a sense at or close to the numerical value when the manufacturing and material tolerances inherent in the stated meaning are presented, and to aid in the understanding of the present application. It is used to prevent an unconscionable infringer from using the mentioned disclosure in an unreasonable manner.

The scope of the present disclosure is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims, and their equivalents should be construed as being included in the scope of the present application. do.

Claims (15)

As an on-street parking lot management system using image recognition,
a first photographing device configured to recognize entry and exit of a vehicle on a road;
a second photographing device configured to recognize a parking surface included in the road surface of the road and track the movement of the vehicle within the parking surface; and
At least one server for image processing,
The first photographing device is configured to photograph a first image of an approach vehicle entering the road and transmit it to the at least one server,
The second photographing device is configured to photograph a second image of the parking surface and transmit it to the at least one server,
The second photographing device is configured to photograph a third image of an advancing vehicle advancing from the road and transmit it to the at least one server,
the at least one server
Based on the first image, reading vehicle information including the vehicle number of the entering vehicle,
Based on the third image, reading vehicle information including the vehicle number of the outgoing vehicle,
when the entering vehicle is not identified as the exiting vehicle for a specified time based on the first image and the third image, setting the entering vehicle as a parking vehicle;
Only when the entry vehicle is not identified as the exit vehicle for the specified time and is set as the parked vehicle, the entry date and time of the parked vehicle is checked, and the confirmed entry date and time in the second image is the starting point. By tracking the parked vehicle using the vehicle information from
and process a payment for the parked vehicle when the parked vehicle is identified as the outgoing vehicle based on the third image. delete delete According to claim 1,
The at least one server is further configured to identify the entering vehicle from the second image using the entry date and time at which the first image was obtained, the on-street parking lot management system. 5. The method of claim 4,
The at least one server is further configured to check the vehicle information of the entering vehicle stored in the database using the vehicle number and identify the entering vehicle from the second image by using the vehicle information. According to claim 1,
The at least one server,
Checking whether the vehicle exiting from the road has paid a fee in advance,
If the fee has not been paid for the exit vehicle in advance, check the fee based on the parking date and time and check the user information of the exit vehicle to check whether the user of the exit vehicle is a registered member, When the user of the exit vehicle is a registered member, the on-street parking lot management system is configured to request payment to the user terminal based on user information. delete According to claim 1,
The at least one server,
When confirming the parking vehicle from the second image, tracking the parking vehicle using the second image and confirming the date and time the parking vehicle enters the road,
Based on the entry date and time, reading the vehicle information of the parked vehicle from the first image,
an on-street parking lot management system configured to match the read vehicle information and the parked vehicle. delete delete As a method of managing an on-street parking lot using image recognition,
Receives the first image of the vehicle entering the road obtained by the first photographing device configured to recognize the entrance and exit of the vehicle on the road,
Receiving a second image for the parking surface, obtained by a second photographing device configured to recognize a parking surface included in the road surface of the road and track the movement of the vehicle in the parking surface,
receiving a third image of an advancing vehicle advancing from the road, obtained by the first photographing device,
Based on the first image, reading vehicle information including the vehicle number of the entering vehicle,
Based on the third image, reading vehicle information including the vehicle number of the outgoing vehicle,
when the entering vehicle is not identified as the exiting vehicle for a specified time based on the first image and the third image, setting the entering vehicle as a parking vehicle;
Only when the entering vehicle is set as the parking vehicle, by tracking the parking vehicle using the vehicle information in the second image, the parking date and time of the parked vehicle and the parking position in the parking surface are confirmed,
On the basis of the third image, when the parking vehicle is identified as the exit vehicle, a method of managing a street parking lot using image recognition to process a payment for the parked vehicle. delete delete 12. The method of claim 11,
Checking whether the vehicle exiting from the road has paid a fee in advance,
If the fee has not been paid for the exit vehicle in advance, check the fee based on the parking date and time and check the user information of the exit vehicle to check whether the user of the exit vehicle is a registered member, When the user of the exit vehicle is a registered member, a method for managing an on-street parking lot using image recognition, requesting payment to a user terminal based on user information. A first photographing device configured to recognize the entrance and exit of a vehicle on a road, a second photographing device configured to recognize a parking surface included in the road surface of the road and track the movement of the vehicle in the parking surface, and image processing As a non-transitory computer-readable medium in which a program for functioning a system for managing an on-street parking lot using image recognition including at least one server for
The program is the at least one server,
Receiving the first image of the vehicle entering the road, obtained by the first photographing device,
Receiving the second image for the parking surface, obtained by the second photographing device,
receiving a third image of an advancing vehicle advancing from the road, obtained by the first photographing device,
Based on the first image, reading vehicle information including the vehicle number of the entering vehicle,
Based on the third image, reading vehicle information including the vehicle number of the outgoing vehicle,
when the entering vehicle is not identified as the exiting vehicle for a specified time based on the first image and the third image, setting the entering vehicle as a parking vehicle;
Only when the entry vehicle is not identified as the exit vehicle for the specified time and is set as the vehicle parking vehicle, the entry date and time of the parked vehicle is checked, and the confirmed entry date and time in the second image is a starting point By tracking the parked vehicle using the vehicle information from the image, the parking date and time of the parked vehicle and the parking position in the parking surface are confirmed,
A non-transitory computer-readable medium storing a program configured to process a payment for the parked vehicle when the parked vehicle is identified as the outgoing vehicle based on the third image.

Images