JP2020119423A - Information processor, information processing method and program - Google Patents

Abstract

To discriminate an unauthorized parking vehicle in a parking lot which unspecified number of vehicles use.SOLUTION: The information processor includes detection means of detecting an action of an occupant of a vehicle after being parked at a parking lot and discrimination means of discriminating whether or not the vehicle is an unauthorized one on the basis of the action of the occupant detected by the detection means. The detection means, when the detection means does not detect an occupant's action of moving from the vehicle to a predetermined discrimination area, can discriminate the vehicle as an unauthorized parking vehicle.SELECTED DRAWING: Figure 2

Description

The present invention relates to an information processing device, an information processing method, and a program.

BACKGROUND ART Conventionally, in order to prevent unauthorized parking in a parking lot, entrance/exit management is performed by opening/closing a stop bar at an entrance/exit and vertically moving a lock plate of a parking space. Further, instead of performing the physical storage/delivery management as described above, management using a monitoring camera may be performed.
In Patent Document 1, a vehicle having a parking qualification is registered in advance, and it is determined whether or not the parked vehicle detected by the monitoring camera is a vehicle having a parking qualification to determine whether or not the vehicle is an unauthorized parking vehicle. Is disclosed.

JP, 2004-110463, A

The technique described in Patent Document 1 determines only vehicles registered in advance as vehicles having parking qualification. Therefore, it is necessary to register the vehicle information in advance, and it cannot be applied to the determination of unauthorized parking vehicles in a parking lot used by an unspecified number of vehicles such as commercial facilities.
Therefore, an object of the present invention is to identify an unauthorized parking vehicle in a parking lot used by an unspecified number of vehicles.

In order to solve the above problems, one aspect of an information processing apparatus according to the present invention is a detection unit that detects an action of an occupant of a vehicle after the vehicle is parked in a parking lot, and the detection unit detects the action. Determination means for determining whether or not the vehicle is an unauthorized parking vehicle based on the behavior of the occupant.

According to the present invention, an unauthorized parking vehicle in a parking lot used by a large number of specific vehicles can be identified.

It is a network connection diagram of the surveillance camera system in the present embodiment. It is a surveillance image of unauthorized parking vehicles. It is a block diagram which shows the structural example of a management server. It is an example of a hardware configuration of a management server. It is a flow chart which shows operation of a management server. It is a flow chart which shows operation of an unauthorized parking discrimination thread. It is a flow chart which shows a procedure of unauthorized parking distinction processing. It is an example of a notice of an unauthorized parking discrimination result. It is a flow chart which shows the procedure of unauthorized parking re-determination processing. It is a flow chart which shows the procedure of unauthorized parking re-notification processing. It is an image figure of discrimination of an unauthorized parking vehicle. It is an image figure of discrimination of an unauthorized parking vehicle. It is a figure explaining the notification timing to a supervisor. It is an example of setting the discriminating area for discriminating without permission.

Hereinafter, a mode for carrying out the present invention will be described in detail with reference to the accompanying drawings.
The embodiment described below is an example as a means for realizing the present invention, and should be appropriately modified or changed according to the configuration of the device to which the present invention is applied and various conditions. However, the present invention is not limited to the embodiment.

(First embodiment)
In this embodiment, a network camera system using a network camera will be described as a monitoring system for discriminating unauthorized parking vehicles in a parking lot.
The monitoring system in the present embodiment detects the behavior of the occupant of the vehicle after the vehicle is parked in the parking lot, and based on the detected behavior of the occupant, determines whether the vehicle is an unauthorized parking vehicle. To determine. In addition, the monitoring system according to the present embodiment can also notify the supervisor of the determination result of the unauthorized parking vehicle.

FIG. 1 is a network connection diagram of a monitoring system 1000 according to this embodiment.
The monitoring system 1000 includes a first imaging device 100, a second imaging device 200, a management server 300, and a terminal device 400. The first imaging device 100, the second imaging device 200, the management server 300, and the terminal device 400 are communicably connected to each other by a network 500. The network 500 may have any communication standard, scale, and configuration as long as it can communicate with the first image capturing apparatus 100, the second image capturing apparatus 200, the management server 300, and the terminal device 400. The physical connection form to the network 500 may be wired or wireless.

The first imaging device 100 and the second imaging device 200 are network cameras. Hereinafter, the first imaging device 100 and the second imaging device 200 are simply referred to as “first camera” and “second camera”.
The first camera 100 is a surveillance camera that images a parking area. The first camera 100 can be a PTZ camera (Pan Tilt Zoom camera) configured to be able to change the imaging area. The first camera 100 transmits to the management server 300 a captured image of the parking area and PTZ information at the time of capturing. The second camera 200 is a monitoring camera that images a predetermined determination area set for unauthorized parking determination, and transmits a captured image to the management server 300.
The first camera 100 and the second camera 200 may support PoE (Power Over Ethernet (registered trademark)), or may be configured to be supplied with power via a LAN cable or the like. Further, in FIG. 1, the first camera 100 and the second camera 200 are connected to the network 500 one by one, but at least one of the first camera 100 and the second camera 200 is connected to the network 500. It may be connected.

The management server 300 acquires captured images from the first camera 100 and the second camera 200, respectively. The management server 300 also acquires input data from the terminal device 400. The input data includes an unauthorized parking monitoring instruction from an observer, an unauthorized parking determination condition setting instruction, and the like. Then, the management server 300 manages the parked vehicle parked in the parking lot and the occupant of the parked vehicle based on the acquired information, and determines whether the parked vehicle is an unauthorized parking vehicle. To do.
The terminal device 400 can be a device such as a personal computer (PC) that can be operated by an observer. The terminal device 400 provides the monitor with a user interface (UI) for inputting an unauthorized parking monitoring command, an unauthorized parking determination condition setting command, and notifying an unauthorized parking determination result. The terminal device 400 transmits the input data acquired from the monitor through the UI to the management server 300, receives the unauthorized parking determination result from the management server 300, and presents the result to the monitor through the UI.

FIG. 2 is a monitoring image of an unauthorized parking vehicle in this embodiment.
As shown in FIG. 2, the first camera 100 images the parking lot area 110, and the second camera 200 images a predetermined discrimination area 210 for unauthorized parking discrimination different from the parking lot area 110. .. Here, the determination area 210 is an area related to the facility that owns the parking lot captured by the first camera 100, and may be, for example, near the entrance of the store 621 that owns the parking lot.
The management server 300 determines that the parked vehicle is an unauthorized parking vehicle when the behavior of the occupant of the parked vehicle parked in the parking area 110 moving from the parked vehicle to the determination area 210 is not detected. Specifically, the management server 300 detects the parked vehicle 601 and the occupant 611 of the parked vehicle 601 from the captured image of the parking area 110 captured by the first camera 100, and parks the occupant information regarding the occupant 611. It is registered in association with the vehicle information regarding the vehicle 601. Then, the management server 300, based on the captured image of the parking area 110, the captured image of the determination area 210, and the registered vehicle information and occupant information, the occupant after the vehicle is parked in the parking area 110. The action of 611 is detected.

At this time, the management server 300 determines whether or not the occupant 611 appears in the determination area 210, based on the captured image of the determination area 210 captured by the second camera 200. Then, when the management server 300 detects that the occupant 611 appears in the determination area 210 within a certain time after the parked vehicle 601 is parked in the parking lot, the occupant 611 is a regular parking person who has a parking qualification. To determine. That is, the vehicle 601 on which the occupant 611 has been boarded is determined to be a regular parking vehicle that is not an unauthorized parking vehicle. On the other hand, when the management server 300 does not detect that the occupant 611 appears in the determination area 210, the occupant 611 is an unauthorized parking person who does not have a parking qualification, and the vehicle 601 on which the occupant 611 is a passenger is an unauthorized parking vehicle. Determine that there is.

FIG. 3 is a block diagram showing the configuration of the management server 300.
As shown in FIG. 3, the management server 300 includes a network interface unit (network I/F unit) 301, a monitoring command management unit 302, a determination condition management unit 303, a parked vehicle detection unit 304, and an occupant detection unit. A vehicle/occupant management unit 306 is provided. Further, the management server 300 includes a discrimination area monitoring unit 307, an unauthorized parking discrimination unit 308, and a discrimination result notification unit 309.
The network I/F unit 301 is a communication interface that transmits and receives data to and from an external device via the network 500 shown in FIG.
The monitoring command management unit 302 acquires a monitoring command from a monitoring person from the terminal device 400 via the network I/F unit 301. The management server 300 executes an unauthorized parking vehicle determination process in accordance with a monitoring instruction from a monitor.

The determination condition management unit 303 acquires the unauthorized parking determination condition input by the monitor from the terminal device 400 via the network I/F unit 301. The unauthorized parking determination condition includes an area corresponding to the parking lot area 110 in the captured image captured by the first camera 100 and an area corresponding to the determination area 210 in the captured image captured by the second camera 200. It may include area information to define.
The parked vehicle detection unit 304 acquires a captured image from the first camera 100 via the network I/F unit 301, and detects a parked vehicle parked in the parking lot area 110 from the acquired captured image.
The occupant detection unit 305 detects the occupant of the parked vehicle detected by the parked vehicle detection unit 304 from the captured image captured by the first camera 100.
The vehicle/occupant management unit 306 manages the vehicle information regarding the parked vehicle detected by the parked vehicle detection unit 304 and the occupant information regarding the occupant detected by the occupant detection unit 305 in association with each other.

The determination area monitoring unit 307 acquires a captured image from the second camera 200 via the network I/F unit 301, and detects a person existing in the determination area 210 from the acquired captured image.
The unauthorized parking determination unit 308 is based on the person information detected by the determination area monitoring unit 307, the vehicle information and occupant information managed by the vehicle/occupant management unit 306, and the unauthorized parking determination condition based on the unauthorized parking vehicle. To determine. Specifically, as described above, the occupant of the vehicle parked in the parking area 110 determines whether or not the occupant moves to the determination area 210 within a certain time after the vehicle is parked, and thus the unauthorized parking is performed. Determine the vehicle. Here, the unauthorized parking determination condition may include a time condition used in the unauthorized parking determination process.
The determination result notification unit 309 notifies the supervisor of the determination result of unauthorized parking by transmitting the determination result of unauthorized parking by the unauthorized parking determination unit 308 to the terminal device 400 via the network I/F unit 301.

FIG. 4 is a hardware configuration example of the management server 300.
The management server 300 includes a CPU 311, a ROM 312, a RAM 313, a secondary storage device 314, and a communication I/F 315. The CPU 311, the ROM 312, the RAM 313, the secondary storage device 314, and the communication I/F 315 are connected to the internal bus 316.
The CPU 311 centrally controls the operation of the management server 300. The ROM 312 is a non-volatile memory that stores programs and data necessary for the CPU 311 to execute processing. The RAM 313 functions as a main memory, a work area, etc. of the CPU 311. The CPU 311 loads various programs or the like from the ROM 312 into the RAM 313 when executing the processing, and executes the programs or the like to realize various functional operations.

The secondary storage device 314 is a non-volatile storage device represented by, for example, an HDD (hard disk drive), a flash memory, an SD card, or the like, and may have a removable structure. The secondary storage device 314 can be used not only as a permanent storage area for the OS, various programs and various data, but also as a short-term storage area for various data. The secondary storage device 314 can store the unauthorized parking determination condition acquired from the terminal device 400, for example. The secondary storage device 314 can also store, for example, vehicle information and occupant information detected from a captured image captured by the first camera 100 in association with each other. The communication I/F 315 corresponds to the network I/F unit 301 in FIG.
At least a part of the functions of each element of the management server 300 illustrated in FIG. 3 can be realized by the CPU 311 executing a program. However, at least a part of each element of the management server 300 illustrated in FIG. 3 may operate as dedicated hardware. In this case, the dedicated hardware operates under the control of the CPU 311.

It should be noted that the first camera 100 and the second camera 200 include an image pickup unit in addition to the configuration of FIG. 4 as the hardware configuration. Here, the image pickup unit includes a lens and an image pickup element such as a CMOS (Complementary Metal Oxide Semiconductor) and a CCD (Charge Coupled Device), and picks up an image of a subject. The imaging unit also performs a process of converting the optical image formed on the imaging surface into a digital electric signal by photoelectric conversion.
Further, in the case of the terminal device 400, the hardware configuration includes an input unit and a display unit in addition to the configuration of FIG. Here, the input unit may include a pointing device such as a keyboard or a mouse. Further, the display unit may include a monitor such as a liquid crystal display (LCD).
In the present embodiment, a case will be described in which the management server 300 operates as an information processing device that performs unauthorized parking determination processing. However, the terminal device 400 may operate as the information processing device described above, or a general PC or other device may operate as the information processing device described above.

Next, the operation of the management server 300 in this embodiment will be described.
FIG. 5 is a flowchart showing a parking lot monitoring processing procedure executed by the management server 300. The process of FIG. 5 is started, for example, at the timing when the management server 300 receives a monitoring command from the terminal device 400. However, the start timing of the processing of FIG. 5 is not limited to the above timing. The management server 300 can realize each processing illustrated in FIG. 5 by causing the CPU 311 to read and execute a necessary program. Hereinafter, the letter S means a step in the flowchart.

First, in S1, the management server 300 acquires a captured image from the first camera 100, and shifts to S2.
In S2, the management server 300 determines whether or not there is a newly parked vehicle newly parked in the captured image acquired in S1. Here, the newly parked vehicle can be detected based on the change in the signal value in the captured image. The method for detecting a new parked vehicle is not limited to the above, and other detection methods can be used. The management server 300 returns to S1 when determining that there is no new parked vehicle, and moves to S3 when determining that there is a new parked vehicle.
In S3, the management server 300 generates an unauthorized parking determination thread and moves to S1. Here, the management server 300 generates one thread for each parked vehicle. For example, when a plurality of newly parked vehicles are detected in S2, threads are generated for the detected number of newly parked vehicles.

FIG. 6 is a flowchart showing the detailed operation of the unauthorized parking determination thread in S3 of FIG. For each unauthorized parking determination thread, the unauthorized parking determination and notification of one parked vehicle are performed.
First, in S11, the management server 300 performs the unauthorized parking determination process shown in FIG.
In S111 of FIG. 7, the management server 300 acquires the unauthorized parking determination condition from the secondary storage device 314. Next, the vehicle information regarding the newly parked vehicle detected in S2 of FIG. 5 is registered in the vehicle database. Here, the vehicle database can be stored in the secondary storage device 314. The vehicle information of the parked vehicle can be image information of the parked vehicle. Here, the image information can also include PTZ information of the first camera 100 at the time of image capturing. Further, the vehicle information of the parked vehicle is associated with the occupant information regarding the occupant of the parked vehicle. The occupant information is registered in the vehicle database in S115 described later.
In addition to the image information of the parked vehicle, the vehicle database stores the position information of the parked vehicle for the purpose of notifying an observer of the parking position of the parked vehicle through the terminal device 400, as the vehicle information regarding the parked vehicle. You may register. Further, in the vehicle database, as vehicle information regarding the parked vehicle, in addition to the image information of the parked vehicle, the identification of the parked vehicle is performed for the purpose of notifying the monitor through the terminal device 400 of information that allows the unauthorized parking vehicle to be identified. Number information, which is information, may be registered.

In S113, the management server 300 determines whether or not the occupant has exited the vehicle newly registered in the vehicle database within a certain time after being parked. As the time condition used for the dismounting determination, the time condition included in the unauthorized parking determination condition acquired in S111 can be used. Then, when the management server 300 determines that the occupant of the vehicle does not get off within a certain time after the vehicle has been parked in the parking lot, the management server 300 proceeds to S114, and the newly parked vehicle parked in the parking lot is "unauthorized" It is determined to be a "parked vehicle". At this time, the management server 300 sets the type of the parked vehicle registered in the vehicle database to “unauthorized parking vehicle”, and ends the unauthorized parking determination process. The time condition used for the determination in S113 is set to the average time it takes for the occupant of the normally parked vehicle to park the vehicle and exit the vehicle.
On the other hand, when the management server 300 determines in S113 that the occupant has exited within a certain time, the management server 300 proceeds to S115 and registers the occupant information regarding the occupant who has exited the vehicle in association with the vehicle information registered in the vehicle database. The occupant information can be image information of the occupant. For the purpose of notifying the occupant of the characteristics of the occupant through the terminal device 400, attribute information including physical characteristics such as gender and height of the occupant, clothes, body type, and moving direction such as which direction the occupant is headed. It may be included in the information. Further, when a plurality of people get off the vehicle, all the passengers who got off may be registered.

Next, in S116, the management server 300 acquires the captured image from the second camera 200, and proceeds to S117.
In S117, the management server 300 determines whether the occupant registered in the vehicle database in S115 has appeared in the area corresponding to the determination area 210 in the captured image acquired in S116 within a certain time after parking the vehicle. Determine whether. As the time condition used for the occupant appearance determination, the time condition included in the unauthorized parking determination condition acquired in S111 can be used. When the management server 300 detects at least one person who matches the occupant information registered in the vehicle database from the area corresponding to the determination area 210 in the captured image acquired in S116, the vehicle parked in the parking lot. It is determined that the occupant has appeared in the determination area 210. To detect the occupant, pattern matching with the image information of the occupant registered in the vehicle database can be used. The method for detecting the occupant is not limited to the above, and any method can be used as long as it is a method for detecting the coincidence between the objects in the two images.

When the management server 300 determines in S117 that the occupant does not appear in the determination area 210 within a certain time, the management server 300 proceeds to S114 and determines that the newly parked vehicle parked in the parking lot is an unauthorized parking vehicle. On the other hand, when the management server 300 determines in S117 that the occupant has appeared in the determination area 210 within a certain period of time, the process proceeds to S118, and the occupant of the new parking vehicle parked in the parking lot is a regular parking person who is qualified to park. It is determined that At this time, the management server 300 determines that the newly parked vehicle parked in the parking lot is a “normally parked vehicle” that is not an unauthorized parking vehicle, and ends the unauthorized parking determination process.
In addition, in this embodiment, the management server 300 demonstrated the case where it was judged whether it appeared in the discrimination|determination area|region 210 within the fixed time after an occupant parked the vehicle in S117. However, the management server 300 may determine in S117 whether or not the occupant has appeared in the determination area 210 within a certain time after the vehicle exits the vehicle.

Returning to FIG. 6, in S12, the management server 300 notifies the supervisor of the determination result by transmitting the determination result of the unauthorized parking determination process shown in FIG. 7 to the terminal device 400. Upon receiving the notification from the management server 300, the terminal device 400 displays the determination result on the display unit using a GUI (Graphical User Interface). An example of the determination result notification is shown in FIG.
FIG. 8 shows an example of the notification screen 700 displayed on the display unit. The notice screen 700 can display image information 701 of the unauthorized parking vehicle, image information 702 of the occupant of the unauthorized parking vehicle, identification information 703 of the unauthorized parking vehicle, and position information 704 of the unauthorized parking vehicle. .. The information displayed on the notification screen 700 is created by the management server 300 and transmitted to the terminal device 400. The image information 701 of the unauthorized parking vehicle is the image information of the parked vehicle on the vehicle database registered in S112 of FIG. 7. The image information 702 of the occupant of the unauthorized vehicle is the image information of the occupant on the vehicle database registered in S115 of FIG. 7.

Moreover, as the identification information 703 of the unauthorized parking vehicle, the number information of the unauthorized parking vehicle can be used. The number information can be obtained by performing image analysis on the image information 701 of the unauthorized parking vehicle and detecting the characters written on the license plate. Note that the unauthorized parking vehicle identification information 703 may be information that can identify the unauthorized parking vehicle, and may be, for example, the color of the vehicle, the parking time, or the like.
The position information 704 of the unauthorized parking vehicle can be shown by using a star or the like on the parking lot schematic diagram. The management server 300 may previously register the parking lot schematic diagram in the secondary storage device 314 or the like. In order to associate the parking position of the unauthorized parking vehicle with the position on the parking lot schematic diagram, the image information of the vehicle and the parking lot coordinate table registered in the vehicle database are used. The parking lot coordinate table defines where the coordinates in the vehicle image information in each PTZ parameter correspond to on the parking lot schematic diagram. The management server 300 may previously register the parking lot coordinate table in the secondary storage device 314 or the like. Other means may be used for associating the position of the unauthorized parking vehicle on the parking lot schematic diagram. Further, the display method of the position information 704 of the unauthorized parking vehicle is not limited to the display method using the parking lot schematic diagram.

Returning to FIG. 6, in S13, the management server 300 performs the unauthorized parking re-determination process shown in FIG. This unauthorized parking re-determination process uses the conditions different from the unauthorized parking determination process of S11 for the parked vehicle determined to be the unauthorized parking vehicle in the unauthorized parking determination process of S11, and again determines the unauthorized parking. Is a process for performing.
First, in S131 of FIG. 9, the management server 300 determines whether the determination target vehicle is determined as an unauthorized parking vehicle in the unauthorized parking determination processing of S11 of FIG. When the management server 300 determines that the vehicle is determined to be an unauthorized parking vehicle, it is not necessary to perform the determination and the notification of the unauthorized parking again, and thus the unauthorized parking re-determination process ends. On the other hand, when the management server 300 determines that the vehicle is not the unauthorized parking vehicle, the management server 300 proceeds to S132.

In S132, the management server 300 acquires the captured image from the second camera 200, and proceeds to S133.
In S133, the management server 300 determines whether the occupant has reappeared in the area corresponding to the determination area 210 in the captured image of the second camera 200 acquired in S132. Specifically, the management server 300 is not detected because the occupant of the vehicle to be discriminated is detected in the discrimination area 210 in S117 of FIG. Within the time, it is again determined whether or not it is detected in the determination area 210. The occupant detection method may be the same detection method as S117 of FIG. 7 described above. As the time condition used for the occupant's reappearance determination, the time condition included in the unauthorized parking determination condition acquired in S111 of FIG. 7 can be used.

When the management server 300 determines in S133 that the occupant does not appear in the determination area 210 again within the fixed time, the management server 300 proceeds to S134 and notifies the terminal device 400 that the occupant does not appear in the determination area 210. At this time, the terminal device 400 displays information indicating that the occupant does not appear in the determination area 210 on the display unit. On the other hand, when the management server 300 determines in S133 that the occupant has again appeared in the determination area 210 within a certain time, the management server 300 proceeds to S135 and acquires a captured image from the first camera 100.
In S136, the management server 300 determines whether or not the parked vehicle to be discriminated has exited within a certain time after detecting that the occupant of the parked vehicle to be discriminated has moved outside the discrimination area. As the time condition used for the exit determination, the time condition included in the unauthorized parking determination condition acquired in S111 of FIG. 7 can be used.
The management server 300 detects the number of vehicles parked in the parking lot when the person corresponding to the occupant information registered in the vehicle database is no longer detected from the area corresponding to the determination area 210 in the captured image acquired in S132. It is determined that the occupant has moved out of the determination area. Further, when the vehicle that matches the vehicle information registered in the vehicle database is not detected from the captured image acquired in S135, the management server 300 determines that the vehicle has exited.

When the management server 300 determines in S136 that the parked vehicle does not leave within the fixed time, the management server 300 proceeds to S137. In S137, the management server 300 determines the determination target vehicle as an unauthorized parking vehicle, notifies the terminal device 400 that the determination target vehicle has changed from a regular parking vehicle to an unauthorized parking vehicle, and then ends the unauthorized parking redetermination processing. To do. At this time, the terminal device 400 displays the information regarding the unauthorized parking vehicle on the display unit, similarly to the notification in S12 of FIG.
On the other hand, when the management server 300 determines in S136 that the parked vehicle has exited within a certain period of time, it determines that the determination target vehicle is not the unauthorized parking vehicle, and there is no change in the determination result, so the notification is not issued and the unauthorized operation is continued. The parking re-determination process ends.
In addition, in this embodiment, the management server 300 demonstrated the case where it was judged in S136 whether the occupant has exited the parked vehicle within a certain time after moving out of the judgment area. However, the management server 300 may determine whether or not the parked vehicle has been evacuated within a fixed time after detecting that the occupant has reappeared in the determination area in S133.

Returning to FIG. 6, in S14, the management server 300 performs the unauthorized parking re-notification process shown in FIG. The unauthorized parking re-notification process is a process of notifying the supervisor again when the occupant of the parked vehicle determined to be the unauthorized parking vehicle in the unauthorized parking determination process of S11 returns to the parking lot.
First, in S141, the management server 300 determines whether or not the determination target vehicle is determined as an unauthorized parking vehicle in the unauthorized parking determination processing of S11 or the unauthorized parking redetermination processing of S13 of FIG. Then, when the management server 300 determines that the vehicle is not determined as an unauthorized parking vehicle, there is no need to notify the terminal device 400, and thus the unauthorized parking re-notification process ends. On the other hand, when the management server 300 determines that the vehicle is an unauthorized parking vehicle, the management server 300 proceeds to S142.

In S142, the management server 300 acquires the captured image from the first camera 100, and proceeds to S143.
In S143, the management server 300 determines whether or not the occupant of the determination target parked vehicle has returned to the parking lot within a fixed time after detecting that the occupant has moved to the outside of the parking lot. Specifically, the management server 300 is no longer detected from the imaged image of the first camera 100 by moving from the parking lot after the occupant of the determination target vehicle is determined to have exited in S113 of FIG. 7, From there, it is determined whether or not it appears again in the captured image within a fixed time. The occupant detection method is the same as the detection method in S117 of FIG. 7 described above. As the time condition used for the occupant's reappearance determination, the time condition included in the unauthorized parking determination condition acquired in S111 of FIG. 7 can be used.

When the management server 300 determines in S143 that the occupant has reappeared within the fixed time, the management server 300 moves to S144 and notifies the terminal device 400 that the occupant has returned to the parking lot. At this time, the terminal device 400 displays information indicating that the occupant has returned to the parking lot on the display unit. At this time, the terminal device 400 displays the information about the unauthorized parking vehicle on the display unit, similarly to the notification in S12 of FIG. On the other hand, when the management server 300 determines in S143 that the occupant has not appeared again within the fixed time, the management server 300 moves to S145 and notifies the terminal device 400 that the occupant does not appear. At this time, the terminal device 400 displays information indicating that the occupant does not appear on the display unit.

As described above, the management server 300 in the present embodiment detects the behavior of the occupant of the vehicle after the vehicle is parked in the parking lot, and the vehicle is parked without permission based on the detected behavior of the occupant. It is determined whether the vehicle is a vehicle. Accordingly, the management server 300 determines that the vehicle parked in the parking lot is an unauthorized parking vehicle when the occupant who parks the vehicle in the parking lot takes an action deviating from the action that the regular parking person should take. can do.
In this way, the unauthorized parking vehicle can be identified by monitoring the behavior of the occupant of the parked vehicle, and thus the work of previously registering the vehicle information having the parking qualification of the parking lot is unnecessary. Therefore, an unauthorized parking vehicle in a parking lot used by an unspecified number of vehicles such as a commercial facility can be appropriately discriminated.

Specifically, the management server 300 determines that the vehicle parked by the occupant is an unauthorized parking vehicle when the behavior of the occupant moving from the vehicle to the predetermined determination area is not detected after the vehicle is parked in the parking lot. Can be determined. Here, the predetermined determination area may be an area outside the vehicle. In this case, if the occupant who parks the vehicle in the parking lot does not get off within a certain time after the vehicle is parked, it can be determined that the vehicle is an unauthorized parking vehicle.
Further, the predetermined determination area may be an area associated with a facility that owns a parking lot. For example, the predetermined determination area can be an area near the entrance of the store that owns the parking lot. In this case, if the occupant who parks the vehicle in the parking lot does not enter the store that owns the parking lot within a certain time after the vehicle is parked, it can be determined that the vehicle is an unauthorized parking vehicle. ..

When detecting the behavior of the occupant, the management server 300 acquires an imaged image of the parking lot from the first camera 100, and an imaged image of a predetermined determination area different from the parking lot from the second camera 200. Get an image. Further, the management server 300 detects vehicle information regarding the vehicle parked in the parking lot and occupant information regarding an occupant of the vehicle from the captured image captured by the first camera 100, and associates the occupant information with the vehicle information. Register in the vehicle database. Then, the management server 300 detects the behavior of the occupant based on the captured image of the first camera 100, the captured image of the second camera 200, the vehicle information and the occupant information registered in the vehicle database.
As a result, the behavior of the occupant after the vehicle is parked in the parking lot can be appropriately detected, and whether the vehicle parked in the parking lot is an unauthorized parking vehicle or a properly parked vehicle is appropriately determined. be able to.

As shown in FIG. 11, when the vehicles 601 and 602 are parked in the parking area 110 owned by the store 621, the management server 300 detects the vehicle 601 and the vehicle 602 from the image captured by the first camera 100. .. When the passengers get off from the vehicles 601 and 602, respectively, the management server 300 detects the passenger 611 of the vehicle 601 and the passenger 612 of the vehicle 602 from the image captured by the first camera 100. Then, the management server 300 registers the image information of the vehicle 601 and the image information of the occupant 611, and the image information of the vehicle 602 and the image information of the occupant 612 in association with each other in the vehicle database.
After that, the management server 300 determines whether or not the occupants 611 and 612 appear in the determination area 210 within a fixed time. Specifically, when the management server 300 detects a person who matches the occupant information registered in the vehicle database from the area corresponding to the determination area 210 in the image captured by the second camera 200, the management server 300 parks in the parking lot. It is detected that an occupant of the vehicle has appeared in the discrimination area 210.

When the vehicle 601 is a regular parking vehicle and the occupant 611 is a regular parking person, the occupant 611 moves from the parking area 110 to the determination area 210 in order to enter the store 621. Therefore, the management server 300 can detect the occupant 611 in the determination area 210 within a fixed time after the vehicle 601 is parked in the parking lot, and determine that the vehicle 601 is not the unauthorized parking vehicle.
On the other hand, when the vehicle 602 is an unauthorized parking vehicle and the occupant 612 is an unauthorized parking person, the occupant 612 does not go to the store 621 but moves to another store 622. Therefore, the management server 300 cannot detect the occupant 612 in the determination area 210 within a fixed time after the vehicle 602 is parked in the parking lot, and can determine that the vehicle 602 is an unauthorized parking vehicle.

In addition, the management server 300 may again perform the unauthorized parking re-determination process of determining whether the vehicle is an unauthorized parking vehicle for a vehicle that is determined not to be an unauthorized parking vehicle in the unauthorized parking determination process. it can. Specifically, when the occupant of the vehicle that is not the unauthorized parking vehicle among the vehicles parked in the parking lot moves out of the determination area for the unauthorized parking determination and does not leave within a predetermined time, the management server 300 may: It is possible to determine that the vehicle of the occupant is an unauthorized parking vehicle.
Here, the management server 300 is parked in the parking lot when the person corresponding to the occupant information registered in the vehicle database is not detected from the area corresponding to the determination area 210 of the captured image of the second camera 200. It is detected that the occupant of the vehicle has moved outside the discrimination area. Further, when the vehicle that matches the vehicle information registered in the vehicle database is no longer detected from the captured image of the first camera 100, the management server 300 detects that the vehicle has exited.

As shown in FIG. 11, when the occupant 611 of the vehicle 601 parked in the parking area 110 owned by the store 621 enters the store 621, it is determined that the vehicle 601 is not the unauthorized parking vehicle. After that, the occupant 611 coming out of the store 621 usually returns to the parking area 110 and leaves the vehicle 601.
However, as shown in FIG. 12, after the occupant 611 of the vehicle 601 exits the store 621, the occupant 611 may head to another store 622 without returning to the parking lot area 110. In this case, the management server 300 detects that the vehicle 601 has been unloaded from the captured image of the first camera 100 even after a certain time has elapsed since the occupant 611 was not detected from the captured image of the second camera 200. Can not. Therefore, in this case, the management server 300 can determine that the vehicle 601 has changed to an unauthorized parking vehicle.

Furthermore, the management server 300 can notify the supervisor of the determination results of the unauthorized parking determination process and the unauthorized parking re-determination process. Specifically, when the vehicle parked in the parking lot is determined to be an unauthorized parking vehicle by the determination processes described above, the management server 300 can display information about the unauthorized parking vehicle on the display unit. .. Here, the information about the unauthorized parking vehicle may include at least one of image information of the unauthorized parking vehicle, image information of an occupant of the unauthorized parking vehicle, identification information of the unauthorized parking vehicle, and position information of the unauthorized parking vehicle. As a result, the supervisor can appropriately understand this at the time of parking without permission, and easily understand which of the vehicles parked in the parking lot is an unauthorized parking vehicle. You can

Further, the management server 300 can also notify the supervisor when the occupant of the vehicle determined to be the unauthorized parking vehicle by the unauthorized parking determination process and the unauthorized parking re-determination process returns to the parking lot.
The management server 300 monitors the captured image of the first camera 100 and determines whether or not the person who matches the occupant information registered in the vehicle database has returned to the parking lot. Then, as illustrated in FIG. 13, when the management server 300 detects that the occupant 612 of the unauthorized parking vehicle 602 has returned to the parking lot area 110, the monitoring person confirms that the occupant 612 who is the unauthorized parking person has returned. To notify.

As described above, the management server 300 according to the present embodiment can determine whether the parking lot used by an unspecified number of vehicles that cannot be registered in advance is unauthorized parking. Moreover, since an appropriate alert can be given to the supervisor, it becomes possible to properly crack down on unauthorized parking.

(Modification)
In the above embodiment, the case where the unauthorized parking is constantly monitored has been described, but the unauthorized parking may be monitored only in a specific time zone. For example, the monitoring may be stopped during a time period when monitoring of unauthorized parking is unnecessary, such as after business hours of a store that owns a parking lot.

Further, in the above-described embodiment, the case where there is only one determination area 210 for unauthorized parking determination has been described, but the determination areas 210 may be individually set according to the parking areas in the parking lot. ..
As shown in FIG. 14, when a parking area 110 includes a parking area 111 for employees and a parking area 112 for visitors, and the vehicle is parked in the parking area 112 for visitors, The discrimination area 212 set near the entrance is set as a discrimination area for unauthorized parking discrimination. That is, when the occupant who parks the vehicle in the visitor parking area 112 moves to the determination area 212 set near the entrance for the visitor, the vehicle is determined to be a regular parking vehicle. On the other hand, when the occupant who parks the vehicle in the parking area 112 for visitors moves to the determination area 211 set near the entrance for employees, the vehicle is determined to be an unauthorized parking vehicle.

On the other hand, when the vehicle is parked in the employee parking area 111, the discrimination area 211 set near the entrance for the employee is set as the discrimination area for unauthorized parking discrimination. That is, when an occupant who parks a vehicle in the employee parking area 111 moves to the determination area 211, the vehicle is determined to be a regular parking vehicle, and when the vehicle moves to the determination area 212, the vehicle is an unauthorized parking vehicle. Is determined.
In this way, by setting the determination areas for the unauthorized parking determination individually according to the parking areas in the parking lot, the unauthorized parking vehicle can be appropriately determined.
In addition, although the said embodiment demonstrated the case where the discrimination|determination area|region 210 for unauthorized parking discrimination|determination was set near the entrance of the store which owns a parking lot, after the person who has the parking qualification of the parking lot parks a vehicle Any area can be set as long as it is an area to go.

(Other embodiments)
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. It can also be realized by the processing. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100... 1st imaging device (1st camera), 200... 2nd imaging device (2nd camera), 300... Management server, 303... Judgment condition management part, 304... Parking person both detection part, 305... Occupant detection unit, 306... Vehicle/occupant management unit, 307... Discrimination area monitoring unit, 308... Unauthorized parking discrimination unit, 309... Discrimination result notification unit, 400... Terminal device, 500... Network, 1000... Monitoring system

Claims (13)

Detection means for detecting the behavior of the occupant of the vehicle after the vehicle is parked in the parking lot,
An information processing apparatus, comprising: a determination unit that determines whether or not the vehicle is an unauthorized parking vehicle based on the behavior of the occupant detected by the detection unit. The determination means is
The information processing apparatus according to claim 1, wherein when the detection unit does not detect the action of the occupant moving from the vehicle to a predetermined determination area, the vehicle is determined to be an unauthorized parking vehicle. A first acquisition means for acquiring a first captured image of the parking lot captured;
Second acquisition means for acquiring a second captured image in which the predetermined determination area different from the parking lot is captured;
The vehicle information regarding the vehicle parked in the parking lot and the occupant information regarding the occupant of the vehicle are detected from the first captured image acquired by the first acquisition unit, and the occupant information is registered in association with the vehicle information. Further comprising:
The detection means is
Based on the first captured image acquired by the first acquisition unit, the second captured image acquired by the second acquisition unit, and the vehicle information and occupant information registered by the registration unit. The information processing apparatus according to claim 2, wherein the behavior of the passenger is detected. The detection means is
When a person matching the occupant information registered by the registration unit is detected from the area corresponding to the determination area in the second captured image acquired by the second acquisition unit, the vehicle is parked in the parking lot. Detecting that a vehicle occupant has appeared in the discrimination area,
The determination means is
The vehicle is determined to be an unauthorized parking vehicle when the detection unit does not detect that an occupant of the vehicle appears in the determination area within a certain time after the vehicle is parked in the parking lot. The information processing device according to claim 3. The determination means is
The vehicle is determined to be an unauthorized parking vehicle when the detection means does not detect that the occupant of the vehicle has exited within a certain time after the vehicle has been parked in the parking lot. Alternatively, the information processing device according to item 4. The detection means is
When the person corresponding to the occupant information registered by the registration unit is no longer detected from the area corresponding to the determination area in the second captured image acquired by the second acquisition unit, the vehicle is parked in the parking lot. It is detected that the occupant of the vehicle has moved out of the discrimination area,
From the first captured image acquired by the first acquisition means, when a vehicle that matches the vehicle information registered by the registration means is no longer detected, it is detected that the vehicle has exited,
The determination means is
The vehicle of the occupant is detected by the detection unit within a certain time after it is detected that the occupant of the vehicle not parked without permission among the vehicles parked in the parking lot is detected by the detection unit. The information processing apparatus according to any one of claims 3 to 5, wherein, when it is not detected that the vehicle has been unloaded, the vehicle of the occupant is determined to be an unauthorized parking vehicle. The information processing apparatus according to claim 2, wherein the predetermined determination area is an area related to a facility that owns the parking lot. The information processing apparatus according to any one of claims 2 to 7, wherein the predetermined determination area is individually set according to a parking area in the parking lot. 9. The information processing apparatus according to claim 1, further comprising a notifying unit that notifies a monitoring person of a determination result of the determining unit. The notification means is
At least one of image information, identification information, position information of a vehicle determined to be an unauthorized parking vehicle by the determination means, and image information of an occupant of the vehicle determined to be an unauthorized parking vehicle is used as the determination result. The information processing apparatus according to claim 9, which notifies a supervisor. The notification means is
The information processing apparatus according to claim 9 or 10, wherein when an occupant of a vehicle determined to be an unauthorized parking vehicle by the determination unit returns to the parking lot, the occupant is notified of this. .. Detecting a behavior of an occupant of the vehicle after the vehicle is parked in the parking lot,
A step of determining whether or not the vehicle is an unauthorized parking vehicle based on the detected behavior of the occupant. A program for causing a computer to function as each unit of the information processing apparatus according to claim 1.

Images