JP2019106703A - Information processing apparatus, control method of the same, and program - Google Patents

Abstract

To provide a mechanism that can easily identify existence of a left-behind person in a car.SOLUTION: A number of passengers is identified from image data acquired from a first imaging device. The number of passengers getting off is identified from image data acquired from a second imaging device. Then, notification is made on the condition that the number of passengers getting off is smaller than the number of passengers.SELECTED DRAWING: Figure 9

Description

  The present invention relates to an information processing apparatus, a control method of the information processing apparatus, and a program, and more particularly to a mechanism capable of easily identifying the presence of a person left behind in a vehicle.

  In recent years, a catastrophe has occurred in which a child has died due to heat stroke due to having parents shopping for leaving a child in a car parked in a parking lot under the scorching sun.

JP, 2014-210477, A

  As a measure to prevent such an accident, it is thought that security personnel look around the parking lot or monitor the image of the surveillance camera installed in the parking lot to confirm whether the child is not left behind Be

  However, where parking lots are large, such as large shopping malls, it is expensive for security guards to look around the entire parking lot, and if you are monitoring the video of a surveillance camera, do children still remain in the car? Until the video was difficult to confirm.

  In addition, if a camera for capturing the inside of a car is installed in a car as in Patent Document 1, it is possible to detect leaving by acquiring an image of the camera, but a camera for capturing the inside of a car is installed. Since there are not many cars, there are many cases in which it can not detect a left-behind.

  An object of the present invention is to provide a mechanism capable of easily identifying the presence of a left-behind person in a car.

  The present invention determines whether or not a person remains in the vehicle using acquisition means for acquiring image data obtained by imaging a vehicle from outside the vehicle by an imaging device, and the image data acquired by the acquisition means. It is characterized by comprising: means, and notification means for performing notification including information that can specify the vehicle, on condition that it is determined that a person remains in the vehicle by the determination means.

  Further, according to the present invention, there is provided a passenger who specifies the number of passengers from image data acquired from the first imaging device by the first imaging device, acquisition means for acquiring image data from the second imaging device, and the acquisition means. According to the number of getting off people specifying means, the number of getting off people specifying means for specifying the number of getting off people from the image data acquired from the second imaging device by the obtaining means, and It is characterized by providing the notification means which notifies on condition that there is a small number of the alighting person who specified.

  Further, according to the present invention, it is determined whether a person remains in the vehicle using an acquisition step of acquiring image data obtained by imaging a vehicle from outside the vehicle by an imaging device, and the image data acquired in the acquisition step. And a notification step of performing notification including information that can specify the vehicle on condition that it is determined that a person remains in the vehicle by the determination step.

  Further, according to the present invention, the number of passengers is specified from the image data acquired from the first imaging device in the acquisition step of acquiring image data from the first imaging device, the second imaging device, and the acquisition step. The passenger number specification is performed based on the passenger number specification process, the getting-off people number specification process for specifying the getting-off people number from the image data acquired from the second imaging device in the acquisition process, and the boarding number specified in the passenger number specification process And a notification step of notifying on condition that the number of people getting off the vehicle specified in the step is small.

According to the present invention, the presence of a left-behind person can be easily identified.

FIG. 1 is a diagram showing an example of a system configuration of a leaving monitoring system (information processing system) in the present embodiment. FIG. 2 is a block diagram showing an example of the hardware arrangement of an information processing apparatus applicable to the client PC 101 and the server 102 according to the embodiment of the present invention. FIG. 2 is a diagram showing an example of a hardware configuration of the network cameras 103 and 104 in the embodiment of the present invention. The figure which shows the image which installed the network camera 103 in parking ticket issuing machine 401 vicinity in embodiment of this invention. The figure which shows the image which installed in the position which can image | photograph the vehicle which stopped the network camera 104 in the parking lot in embodiment of this invention. The figure which shows an example of the boarding number identification process in this embodiment. The figure which shows an example of the getting-off people identification process and the notification process in 1st Embodiment. The figure which shows an example of a data table. FIG. 6 is a view showing an example of a notification screen displayed on a display 210 of the PC 101 in the present embodiment. The figure which shows an example of the getting-off people identification process and the notification process in 2nd Embodiment. The figure which shows an example of the alerting | reporting reference | standard in this embodiment. The figure which shows an example of a cautions list screen in this embodiment. FIG. 2 is a functional configuration diagram showing an example of a functional configuration of the leaving monitoring system in the present embodiment. A figure showing an example of notice processing in a 3rd embodiment. FIG. 6 is a view showing an example of a notification screen displayed on a display 210 of the PC 101 in the present embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The embodiment described below shows an example when the present invention is specifically implemented, and is one of the specific embodiments of the configuration described in the claims.

  FIG. 1 is a diagram showing an example of a system configuration of a leaving monitoring system (information processing system) according to the present invention.

  The leaving surveillance system has a configuration in which the PC 101, the server 102, the network camera 103, and the network camera 104 are communicably connected.

  The network camera 103 is a camera for photographing the inside of a car entering a parking lot, for example, as shown in FIG. 4, in the vicinity of a parking ticket issue machine 401 installed at the entrance of the parking lot The driver's seat side is set to a position where the inside of the vehicle can be photographed. In addition, it is possible to photograph the number of the car stopped in front of the parking ticket issuing machine 401.

  The network camera 103 adjusts the pan, tilt and zoom so as to be able to capture the number of the car coming into the parking lot as a preset. Then, when the car stops in front of the parking ticket issuing machine 401, the network camera 103 adjusts pan / tilt / zoom so that the inside of the car can be photographed from the driver's seat side with the same preset. Whether the car has stopped in front of the parking ticket issuing machine 401 is to obtain information from the parking ticket issuing machine 401 when the ticketing button of the parking ticket of the parking ticket issuing machine 401 is pressed by the driver. In this case, it may be possible to determine that the car has stopped in front of the parking ticket issuing machine 401 by determining that the vehicle has stopped in front of the parking ticket issuing machine 401 or analyzing the video taken by the network camera 103 .

  The reason for providing the network camera 103 in the vicinity of the parking ticket issuing machine 401 is that the driver can always open the window of the car in order to take a parking ticket, so that it is possible to photograph the inside of the car at that time. In addition, it is conceivable to photograph the inside of the car from the side of the car with the network camera 103 without opening the window, but there are many cars that are processed so that the inside of the car can not be seen from the outside. Have difficulty.

  In the present embodiment, one network camera 103 is installed in the vicinity of the parking ticket issuing machine 401. However, as another embodiment, the inside of the vehicle is photographed by photographing the car from the front in the vicinity of the parking ticket issuing machine 401. Another network camera 103 may be installed, and two network cameras may be used to photograph the inside of the vehicle in order to identify the number of passengers.

  For example, as shown in FIG. 5, the network camera 104 is installed at a position where it is possible to shoot a car stopped at a parking lot, and shoots a person who got off the car and a car number.

  The server 102 acquires an image (image) captured by the network camera 103 and detects the face of a person from the image, thereby identifying the number of persons in the vehicle from the number of detected faces, and the number of the car. Identify the car number from the image taken

  In addition, the server 102 acquires a video (image) captured by the network camera 104, detects the face of a person from the video, and identifies the number of people alighted from the number of detected faces, and also from the video. Identify the car number.

  Known face recognition technology (for example, the technology described in Japanese Patent Application Laid-Open No. 2011-221906) is used to specify the number of people in the vehicle and to specify the number of people who got off the vehicle. For identification of the car number, known car number recognition technology (for example, the technology described in JP-A-2007-293492 or JP-A-2013-251005) is used.

  Then, the server 102 links and registers the car number, the number of passengers, and the number of people getting off in the data table shown in FIG.

  Then, the server 102 determines that there is a person left behind in the vehicle when the number of getting-off persons specified from the video taken by the network camera 104 is smaller than the number of passengers specified from the video taken by the network camera 103. In order to make the manager of the parking lot (for example, a security guard etc.) check the inside of the car, the notification is sent to the PC 101.

  The PC 101 is a terminal used by a manager of a parking lot, and receives a notification screen transmitted from the server 102 when there is a person left behind in the car, and displays it on the display (FIG. 9). A predetermined control program for displaying a notification screen is installed in the PC 101.

  This is the end of the description of FIG.

  Next, the hardware configuration of the information processing apparatus applicable to the PC 101 and the server 102 shown in FIG. 1 will be described with reference to FIG.

  In FIG. 2, reference numeral 201 denotes a CPU, which centrally controls devices and controllers connected to the system bus 204. Further, the ROM 202 or the external memory 211 may be a BIOS (Basic Input / Output System) which is a control program of the CPU 201, an operating system program (hereinafter referred to as an OS), and various kinds of functions described later. Programs and the like are stored.

  A RAM 203 functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 loads programs necessary for execution of processing from the ROM 202 or the external memory 211 to the RAM 203, and implements various operations by executing the loaded programs.

  An input controller 205 controls an input from a pointing device such as a keyboard (KB) 209 or the like. Reference numeral 206 denotes a video controller which controls display on a display such as a display 210 (whether liquid crystal or CRT).

  A memory controller 207 is an external storage device (hard disk (HD)) for storing a boot program, various applications, font data, user files, editing files, various data, etc., a flexible disk (FD), or a PCMCIA card slot. It controls access to external memory 211 such as Compact Flash (registered trademark) memory connected via an adapter.

  A communication I / F controller 208 connects and communicates with an external device via a network, and executes communication control processing in the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the display 210 by executing, for example, outline font rasterization processing on a display information area in the RAM 203. In addition, the CPU 201 enables user instruction with a mouse cursor (not shown) or the like on the display 210.

  Various programs to be described later for realizing the present invention are stored in the external memory 211, and are executed by the CPU 201 by being loaded into the RAM 203 as necessary. Furthermore, setting files and the like used at the time of execution of the program are also stored in the external memory 211, and a detailed description of these will be described later. This is the end of the description of FIG.

  Next, an example of the hardware configuration of the network camera 103 and the network camera 104 shown in FIG. 1 will be described using FIG.

  FIG. 3 is a diagram showing an example of a hardware configuration of the network camera 103 and the network camera 104 in the embodiment of the present invention.

  The CPU 301 centrally controls the devices and controllers connected to the system bus 304. Further, the ROM 302 or the external memory 305 is required to realize a function that is executed by the image processing server 108 such as a BIOS (Basic Input / Output System) which is a control program of the CPU 301, an operating system program (OS). Various programs to be described later are stored. The RAM 303 functions as a main memory, a work area, and the like of the CPU 301.

  The CPU 301 loads various programs and the like necessary for execution of processing into the RAM 303 and executes various programs to realize various operations.

  A memory controller (MC) 306 is a CF connected via an adapter to a hard disk (HD) that stores a boot program, various applications, font data, user files, editing files, various data, image data, etc. and a PCMCIA card slot. It controls access to the external memory 305 such as memory and smart media (registered trademark).

  The camera unit 307 is connected to the image processing unit 308, and photoelectrically converts light obtained by transmitting light through a lens directed to a monitoring target by a light receiving cell such as a CCD or CMOS, and then converts the light into an RGB signal. And a complementary color signal to the image processing unit 308.

  The image processing unit 308 performs white balance adjustment, gamma processing, and sharpness processing based on the RGB signal and the color capture signal, and further performs YC signal processing to generate a luminance signal Y and a chroma signal (hereinafter, YC signal). The YC signal is compressed in a predetermined compression format (for example, JPEG format or Motion JPEG format etc.), and this compressed data is temporarily stored in the external memory 305 as image data.

  A communication I / F controller (communication I / FC) 309 is for connecting and communicating with an external device via a network, executes communication control processing in the network, and stores the image stored in the external memory 305. The data is transmitted by the communication I / F controller 309 to an external device. This is the end of the description of FIG.

  Next, the processing executed in the present invention will be described using the flowcharts of FIGS. The process shown in each flowchart is executed by the CPU 201 of the server 102. Note that, as another embodiment, the CPU 201 of the PC 101 may execute it.

  First, FIG. 6 will be described.

  FIG. 6 is a diagram showing an example of the boarding number identification process in the present embodiment.

  In step S601, the server 102 sequentially acquires, from the network camera 103, images (also referred to as video and frame images) obtained by photographing the inside of the vehicle from the outside of the vehicle.

  Step S601, step S701 to be described later, and step S1001 to be described later are an example of an acquisition unit for acquiring image data from the first imaging device and the second imaging device in the present invention.

  In step S602, the server 102 sequentially acquires, from the network camera 103, images obtained by capturing a car number. The order of the processes in step S601 and step S602 may be reversed.

  In step S603, the server 102 specifies the number of passengers indicating the number of passengers from the image acquired in step S601, using a known face recognition technology (for example, the technology described in JP-A-2011-221906). Do.

  Step S603 is an example of the passenger number specifying means for specifying the number of passengers from the image data acquired from the first imaging device in the present invention.

  In step S604, the server 102 uses the known car number recognition technology (for example, the technology described in JP-A-2007-293492 or JP-A-2013-251005) to use the car acquired from the image acquired in step S602. Identify the number of The order of the processes in step S603 and step S604 may be reversed.

  In step S604, the server 102 associates the number of passengers identified in step S604 with the number of the car identified in step S605, and registers them in the number 803 of passengers in the data table (FIG. 8) and the number 802.

  As for the correspondence between the number of passengers identified in step S604 and the car number identified in step S605, for example, the time when the image specifying the number of passengers was photographed and the time when the image specifying the number of vehicles was photographed It is conceivable to associate the closest ones with one another. This is the end of the description of FIG. 6, and next, FIG. 7 will be described.

  FIG. 7 is a diagram showing an example of the getting-off people identification process and the notification process in the first embodiment.

  In step S701, the server 102 sequentially acquires, from the network camera 104, images obtained by photographing a car from outside the car.

  In step S702, the server 102 uses the known car number recognition technology (for example, the technology described in JP-A-2007-293492 or JP-A-2013-251005) from the image acquired in step S701. Identify the number of

  In step S703, the server 102 specifies the alighting number of people indicating the number of people who got off from the image acquired in step S701, using a known face recognition technology (for example, the technology described in JP 2011-221906A). . Note that the order of the processes in step S702 and step S703 may be reversed.

  Step S703 and step S1003 in FIG. 10 described later are an example of the getting-off people specifying means for specifying the getting-off number from the image data acquired from the second imaging device in the present invention.

  In step S704, of the numbers stored in the column of the number 802 in the data table (FIG. 8), the server 102 displays the number of people getting off in the row 804 that matches the car number identified in step S702 in step S703. Memorize the number of people who got off.

  In step S705, the server 102 determines whether or not the number of people a getting off identified in step S703 is smaller than the number of people identified in step S603. More specifically, referring to the values of the number of passengers 803 and the number of people disembarking 804 in the same row in the data table (FIG. 8), when the value of the number of people disembarking 804 is smaller than the value of the number of passengers 803, It is determined that the number of people getting off is smaller (step S 705: YES).

  If the server 102 determines in step S705 that the number of people getting off is smaller than the number of people in transit, the process proceeds to step S706, and if it is determined that the number of people in getting out agrees with the number of people in getting out or more. It is judged that all the members got off and this processing is ended.

  Note that the case where the number of getting-off people is larger than the number of getting-in people is, for example, the case where the number of getting-in people can not be identified accurately in step S603.

  In step S706, the server 102 determines that a person is left behind in the car and notifies (notifies) the PC 101 (administrator). The screen notified to the PC 101 in step S706 is, for example, the screen shown in FIG.

  Step S706 and step S1007 in FIG. 10, which will be described later, are notification means for notifying on the condition that the number of getting-off people identified by the getting-off people specifying means is smaller than the number of getting in people specified by the getting-in people specifying means. It is an example.

  Here, FIG. 9 will be described. FIG. 9 is a diagram showing an example of a notification screen notified from the server 102 to the PC 101 in step S706 and displayed on the display 210 of the PC 101 in the present embodiment.

  In 901, a message is displayed to make the administrator aware that there is a possibility of being left behind in the car.

  In 902, an image of a car to be notified (a car whose number of people getting off the board is smaller than the number of people on board) photographed by the network camera 104 is displayed.

  In 903, based on the information in the data table (FIG. 8), information on the vehicle to be notified is displayed. In the example of FIG. 9, the car number of the notification target, the entry date and time, the number of passengers, and the number of people getting off are displayed.

  By notifying the manager of the information of 902 and 903, the manager can rush to the relevant car immediately, and can perform the rescue work of the person left behind in the car.

  The no problem button 904 stores information indicating that there is no problem in the confirmation result 805 of the data table (FIG. 8) when the button is selected by the administrator. After seeing the notification screen in FIG. 9, the administrator actually confirms the car and confirms that there is no one left behind, or because the air conditioner is working, there is no concern such as heat stroke etc. When the determination is made, the no problem button 904 is selected.

  The caution button 905 stores information indicating the caution in the confirmation result 805 of the data table (FIG. 8) when the button is selected by the administrator. After the administrator looks at the notification screen of FIG. 9, the manager actually confirms the car, and selects the caution button 905 when it can be confirmed that there is a left behind person. When the cautions list button 906 is selected, a list screen (a cautions list screen) of cars for which the cautions button 905 shown in FIG. 12 is selected is displayed. By displaying the caution list screen shown in FIG. 12, the administrator can confirm at a glance the car that must be alert. In addition, for vehicles that have been determined to have no problems after being selected as a caution, by receiving an operation from the administrator to check the check box 1201 and select the delete button 1202 on the caution list screen of FIG. It is possible to change as a problem-free car.

  In 907, the in-vehicle image of the car of the notification target taken by the network camera 103 is displayed. By displaying the in-vehicle image of the notification target car photographed by the network camera 103, the manager can confirm the driver's face, and the driver's search and care for leaving can be easily performed.

  This is the end of the description of FIG. 9, and next, FIG. 10 will be described.

  FIG. 10 is a diagram showing an example of the getting-off people identification process and the notification process in the second embodiment.

  In the first embodiment of FIG. 7, when the number of people getting off is smaller than the number of people getting in, it is notified immediately, but in the second embodiment, the number of people getting out of people is less than the number of people getting in and Notify when satisfied.

  The process shown in FIG. 10 is executed by the CPU 201 of the server 102. Note that, as another embodiment, the CPU 201 of the PC 101 may execute it.

  Since each process to step S1001-step S1005 is the same process as each process of step S701-705 of FIG. 7, description is abbreviate | omitted.

  In step S1006, the server 102 determines whether the notification standard (notification condition) shown in FIG. 11 is satisfied (condition determination unit). If the PC 101 determines that the notification standard is satisfied, the process proceeds to step S1007. If the notification standard is not satisfied, the PC 101 does not notify until the notification standard is satisfied.

  Here, the notification standard shown in FIG. 11 will be described. The notification standard shown in FIG. 11 is stored in the external memory 211 of the server 102.

  Although two notification criteria 1101 and 1102 are shown in FIG. 11, it is assumed that the administrator sets in advance which notification criteria to use.

  The notification standard 1101 indicates that when the process of step S1006 is from July to September, the notification standard is satisfied, and when the process of step S1006 is from October to June, the information standard is satisfied. It shows that there is no. The standard of July to September is determined because this time is the time when there is a risk of heatstroke. Conversely, for October to June, even if a child is left behind in the car, the possibility of heatstroke etc. is low, so no notification is given.

  The notification standard 1101 may have a finer particle size. For example, the notification standard may be 3 minutes for 12:00 to 15:00 when the temperature is highest, and 10 minutes for others.

  The notification standard 1102 indicates that notification is performed when the temperature of the outside air is 23 degrees or more.

  The temperature of the outside air may be acquired from a thermometer installed in the parking lot, or information of the temperature may be acquired from the Meteorological Agency. The standard of 23 degrees is determined in order to be notified before the temperature exceeds 25 degrees, which is defined as the temperature that should be warned against heat stroke, in the "Guidelines on Daily Life" published by the Japan Society for Living Meteorology. ing.

  In addition, in this embodiment, since it considers regarding heat stroke, it is considered as the alerting | reporting reference | standard mentioned above, but in consideration of the hypothermia in the car in winter, the case of November-February and the open air are 10 degrees or less In some cases, it may be possible to meet the notification standard.

  In addition, in FIG. 11, the month and the temperature are used as the notification standard, but the notification standard may be satisfied when the engine is not running (it is considered that the air conditioner works if the engine is running If the driver remains in the car, the notification standard may not be satisfied as the driver is merely standing by and not left behind.

  Whether the engine is running is specified by installing the sound collecting microphone on the network camera 104 and executing the process of step S1005, and then acquiring the engine sound of the car with the sound collecting microphone, the engine is running, Do not report. If the driver does not meet the notification standard when the driver remains in the vehicle, the inside of the vehicle is photographed from the windshield side by the network camera 104, and if there is a person in the driver's seat, the notification standard is not satisfied. Do not do.

  This is the end of the description of FIG. 11 and returns to the description of FIG.

  In step S1007, the server 102 notifies (notifies) the PC 101 (administrator). The screen notified to the PC 101 in step S1007 is, for example, the screen shown in FIG.

  This is the end of the description of FIG. 10, and next, the data table of FIG. 8 will be described.

  FIG. 8 is a diagram showing an example of a data table stored in the external memory 211 of the server 102. As shown in FIG. The data table includes an ID 801 for identifying each data, step S 604 in FIG. 6, step S 702 in FIG. 7, number 802 identified in step S 1002 in FIG. 10, number 803 of passengers identified in step S 603 in FIG. 9, the number of getting off people 804 identified in step S1003 in FIG. 10, the no problem button 904 in FIG. 9, or the confirmation result 805 stored by selecting the caution button 905 by the administrator. In step S601, the server 102 is configured with an entrance date 806 indicating the time when the video acquired from the network camera 103 is captured. Although not shown in FIG. 8, the path of the image taken by the network camera 103 or the network camera 104 when the car number is specified, and the path of the image taken by the network camera 103 when the number of passengers is specified Also, the path of the image taken by the network camera 104 when the number of people getting off is specified is also stored.

  This is the end of the description of FIG. 8, and next, FIG. 13 will be described.

  FIG. 13 is a functional configuration diagram showing an example of a functional configuration of the leaving monitoring system in the present embodiment.

  The leaving monitoring system has the functions of an acquisition unit 1301, a passenger number identification unit 1302, a getting-off person identification unit 1303, and a notification unit 1304.

The acquiring unit 1301 acquires an image from the network camera 103 and the network camera 104. The boarding number specifying unit 1302 specifies the number of boarding persons from the image acquired from the network camera 103.

  The getting-off people specifying unit 1303 specifies the getting-off people from the image acquired from the network camera 104.

  The notification unit 1304 notifies the PC 101 on the condition that the number of getting-off people identified by the getting-off person identifying unit 1303 is smaller than the number of people identified by the entering person identifying unit 1302. This is the end of the description of FIG.

  Next, a third embodiment of the present invention will be described using FIG. FIG. 14 is a diagram showing an example of notification processing in the third embodiment of the present invention.

  In the first embodiment of FIG. 7 and the second embodiment of FIG. 10, the identification of the number of passengers and the identification of the number of alighting are performed, but in the present embodiment, the identification of the specific number of people is not performed. Anyway, I will explain the mechanism that can be notified by detecting the left behind in the car.

  The process shown in the flowchart of FIG. 14 is executed by the CPU 201 of the server 102. As another embodiment, the CPU 201 of the PC 101 or the CPU 301 of the network camera 104 may execute.

  In step S <b> 1401, the server 102 sequentially acquires, from the network camera 104, images obtained by photographing vehicles parked in a parking lot.

  In step S1402, the server 102 determines whether a person has dismounted from the vehicle from the image acquired in step S1401 using a known face recognition technology (for example, the technology described in JP-A-2011-221906). . More specifically, first, a car parked in a parking lot is detected to detect whether there is a person in the vicinity.

  In step S1402, it may be detected that the person has got off the car. Therefore, the invention is not limited to face recognition technology, and it is possible to detect a person's getting off by recognizing a person by deep learning, recognizing a person by using a background subtraction method, or detecting opening and closing of a car door. good.

  If the server 102 determines in step S1402 that the person has got off, the process proceeds to step S1403.

  In step S <b> 1403, the server 102 determines whether a predetermined time has elapsed since the determination of the getting-off of the person in step S <b> 1402. If the server 102 determines in step S1403 that the predetermined time has elapsed since the person got off, the process proceeds to step S1404.

  More specifically, first, in step S1402, the coordinates of the person specified to be dismounted (for example, the coordinates of the feature points of the person) and the coordinates of the car on which the person is dismounted (for example, the feature points of the car Coordinates) specify whether they are separated by a predetermined amount or more. Then, after it is specified that a predetermined distance or more (for example, 5 m) has been left, the process proceeds to step S1404 if a person is not detected in the vicinity of the car even after a predetermined time (for example, 3 minutes) elapses.

  In step S1404, the server 102 specifies whether leaving is occurring in the car. Specifically, for example, the left is identified by any of the following methods.

  The first method is to image the interior of the vehicle from the windshield side with the network camera 104, and if the face of a person is detected in the vehicle from the captured image, it is determined that leaving is occurring.

  The second is a method of identifying a person who radiates heat by photographing the inside of a car with an infrared thermography camera.

  The third is a method of specifying a person by the server 102 acquiring information of a weight sensor (a sensor that detects the weight when the person is sitting) installed in a seat of a car.

  The fourth method is a method of specifying a person by mounting a sound collection microphone on the network camera 104 and picking up a voice (for example, a cry) in the car with the sound collection microphone.

  In step S1405, the server 102 determines whether leaving has occurred as a result of executing the process of step S1404.

  If the server 102 determines that leaving has occurred in step S1405, the process proceeds to step S1406, and if it is determined that no leaving has occurred, the present process ends.

  In step S1406, the server 102 uses the known car number recognition technology (for example, the technology described in JP-A-2007-293492 or JP-A-2013-251005) to use the car from the image acquired in step S1401. Identify the number of

  In step S1407, the server 102 stores the car number identified in step S1406, information indicating that the car has been left behind, and the position of the car in the external memory 211 of the server 102. Registered in the data table.

  The position of the car may be specified using the installation position (coordinates) of the network camera 104 and the pan, tilt and zoom values of the network camera 104, or a number is painted on each parking space of the parking lot. If so, the number may be identified by recognizing it from an image taken by the network camera 104.

  In step S1408, the server 102 determines that a person is left behind in the car and notifies (reports) the PC 101 (administrator). The screen notified to the PC 101 in step S1408 is, for example, the screen shown in FIG. 9 or FIG. This is the end of the description of FIG.

  Next, an example of a screen notified to the PC 101 in step S1408 will be described using FIG.

  In the notification screen of FIG. 9, an example of displaying an image of a notification target car captured by the network camera 104 has been described. However, in the notification screen of FIG. 15, the position of the notification target car is identified It informs by displaying.

  Map 1500 is a map of a parking lot. The number 1501 is a number for identifying each parking space. The identification information 1502 is information indicating the position of a car to be notified. A message 1503 notifies the administrator that the car targeted for notification exists in the parking space identified by the identification information 1502.

  Since the manager can grasp at a glance where in the parking lot the car to be notified exists based on the identification information 1502 and the message 1503, it is possible to rush to the place of the car to be notified. This is the end of the description of FIG.

  In each embodiment of the present invention, notification of leaving of the person in the car has been described. However, not only the person but leaving of the animal in the car may be left alone. In that case, in the flowchart of FIG. 14, it is specified in the step S 1404 whether or not there is an animal in the car from a cry, an image, etc. acquired by the network camera 104. Then, when it is specified that there is an animal, in step S1408, the administrator is notified that there is an animal left behind in the car.

  As described above, according to the present invention, the presence of a person left behind in a car can be easily identified.

  The present invention is also applicable to, for example, an embodiment as a system, an apparatus, a method, a program, a storage medium, etc. Specifically, the present invention may be applied to a system composed of a plurality of devices. The present invention may be applied to an apparatus consisting of two devices.

  Note that the present invention includes one that directly or remotely supplies a program of software that implements the functions of the above-described embodiments to a system or an apparatus. The present invention is also included in the present invention if the computer of the system or apparatus reads out and executes the supplied program code.

  Therefore, the program code itself installed in the computer to realize the functional processing of the present invention by the computer also implements the present invention. That is, the present invention also includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of an object code, a program executed by an interpreter, script data supplied to an OS, or the like.

  Examples of recording media for supplying the program include a flexible disk, a hard disk, an optical disk, a magneto-optical disk, an MO, a CD-ROM, a CD-R, and a CD-RW. There are also magnetic tapes, non-volatile memory cards, ROMs, DVDs (DVD-ROMs, DVD-Rs) and the like.

  In addition, as a program supply method, a browser on a client computer is used to connect to an Internet home page. Then, the program can be supplied by downloading the computer program of the present invention itself or a compressed file including an automatic installation function from the home page to a recording medium such as a hard disk.

  The present invention can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from different home pages. That is, the present invention also includes a WWW server which allows a plurality of users to download program files for realizing the functional processing of the present invention by a computer.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, and distributed to users, and the user who has cleared predetermined conditions downloads key information that decrypts encryption from the homepage via the Internet. Let Then, it is possible to execute the program encrypted by using the downloaded key information and install it on a computer.

  Also, the functions of the above-described embodiments are realized by the computer executing the read program. In addition, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiment can be realized by the processing.

  Furthermore, the program read from the recording medium is written to a memory provided in a function expansion board inserted in the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program, a CPU or the like provided in the function expansion board or the function expansion unit performs part or all of the actual processing, and the function of the above-described embodiment is also realized by the processing.

  The embodiments described above merely show examples of implementation in practicing the present invention, and the technical scope of the present invention should not be interpreted in a limited manner by these. That is, the present invention can be implemented in various forms without departing from the technical concept or the main features thereof.

101 PC
102 Server 103 Network Camera 104 Network Camera

Claims (11)

Acquisition means for acquiring image data obtained by imaging a vehicle from outside the vehicle by an imaging device;
A determination unit that determines whether a person remains in the vehicle using the image data acquired by the acquisition unit;
An information processing apparatus comprising: notification means for performing notification including information that can specify the vehicle on condition that the determination means determines that a person remains in the vehicle. Number identification means for identifying the number of the vehicle from the image data acquired by the acquisition means;
A getting-off people specifying means for specifying the number of people getting off the vehicle from the image data obtained by the obtaining means;
A passenger number specifying means for specifying the number of people who are in the vehicle
A management means for managing the alighting number of people specified by the affiliation number specifying means and the passenger number specified by the boarding number specifying means in association with the number of the vehicle specified by the number specifying means; The information processing apparatus according to claim 1, wherein   The determination means compares, by the management means, the number of getting-off persons managed in association with the same vehicle number with the number of getting-in persons specified by the number-of-persons specifying means; The information processing apparatus according to claim 2, wherein it is determined that a person remains in the vehicle when the number is small. A condition determination unit that determines whether a predetermined notification condition is satisfied;
The notification means is notified on the condition that the condition determination means determines that a predetermined notification condition is satisfied, and the determination means determines that a person remains in the vehicle. The information processing apparatus according to any one of Items 1 to 3.   5. The information processing apparatus according to claim 4, wherein the condition determining unit determines that the notification condition is satisfied when a month in which the image data is acquired by the acquisition is a predetermined month.   6. The information processing apparatus according to claim 5, wherein the condition determining unit determines that the notification condition is satisfied when the temperature of the outside air at the time of acquiring the image data by the acquisition is a predetermined air temperature. The determination means further determines whether an animal remains in the vehicle;
The notification means further performs notification including information that can specify the vehicle, on the condition that it is determined that an animal remains in the vehicle. The information processing apparatus according to claim 1. A first imaging device, acquisition means for acquiring image data from the second imaging device,
A boarding number specifying means for specifying the number of boarding persons from the image data acquired from the first imaging device by the acquiring means;
A getting-off people specifying means for specifying the getting-off people from the image data obtained from the second imaging device by the obtaining means;
An information processing apparatus comprising: notification means for notifying on the condition that the number of getting-off people identified by the getting-off people specifying means is smaller than the number of people specified by the getting-in people specifying means. An acquisition step of acquiring image data obtained by imaging a vehicle from outside the vehicle by an imaging device;
A determination step of determining whether a person remains in the vehicle using the image data acquired in the acquisition step;
A control step of performing a notification including information capable of specifying the vehicle on condition that it is determined by the determination step that a person remains in the vehicle; . An acquisition step of acquiring image data from the first imaging device and the second imaging device;
A boarding number identification step of specifying the number of passengers from the image data acquired from the first imaging device in the acquiring step;
In the acquisition step, an alighting person number specifying step for specifying the alighting person number from the image data acquired from the second imaging device;
A control method of an information processing apparatus, comprising: a notification step of notifying on the condition that the number of getting-off persons identified in the getting-off person identification step is smaller than the number of people identified in the getting-in person identification step.   A program for causing a computer to function as each means of the information processing apparatus according to any one of claims 1 to 8.

Images