JP2014187645A - Monitoring system, imaging apparatus, server device, monitoring method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a monitoring system capable of facilitating the understanding of actions of a person to be searched.SOLUTION: A monitoring system 1000 includes intercoms 100-1 to 100-n, and a server device 400. The intercoms 100-1 to 100-n are arranged in each residence of a predetermined zone so as to image predetermined areas. The server device 400 discriminates whether or not a person to be searched is appearing in captured images captured by the respective intercoms 100-1 to 100-n, and identifies the movement route of the person to be searched on the basis of the arrangement positions of the imaging apparatuses that have captured the images with the person to be searched appearing therein when it is discriminated that the person to be searched has been appearing.

Description

  The present invention relates to a monitoring system, an imaging device, a server device, a monitoring method, and a program.

  With regard to this type of technology, for example, Patent Document 1 proposes a home surveillance camera system in which an image captured by an interphone (door phone) with a camera for a dwelling unit is appropriately concealed and stored in consideration of privacy. Has been.

  Further, in Patent Document 2, the entrance of a dwelling unit is photographed with two cameras on the near side and the far side at different distances from the entrance, a person coming out of the entrance is detected, and imaging by the two cameras is performed. A crime prevention system has been proposed that detects the direction in which a suspicious person has moved from the entrance using the size of the area.

JP 2010-118959 A JP 2011-128873 A

  However, Patent Document 1 is a system that simply captures an image in front of the house and analyzes and confirms the image by itself. Even if there is a suspicious person, if he / she gets out of the field of view of the surveillance camera at home, the subsequent action cannot be grasped.

  Further, Patent Document 2 can know which direction the suspicious person has moved from in front of the house entrance, but if the suspicious person disappears from the field of view of the camera far from the entrance, Patent Document 2 As in 1, it is impossible to grasp the subsequent actions.

  The present invention has been made in view of the above problems, and provides a monitoring system, an imaging device, a server device, a monitoring method, and a program capable of easily grasping the behavior of a person requiring a search.

  According to the present invention, a plurality of imaging devices that are installed in each house in a predetermined region and photograph the predetermined region, and whether or not a person requiring a search is reflected in the captured images captured by each of the plurality of imaging devices. And when it is determined that the search target person is captured, the travel path of the search target person is based on the installation position of the imaging device that captured the captured image in which the search target person is captured. And a server device that identifies the monitoring system.

  According to the above invention, the imaging apparatus is installed in a house in a predetermined area and images a predetermined area, and performs wide-angle imaging including imaging means, calling means operated by a visitor, and always on the road. There is provided an imaging apparatus comprising: control means for controlling the imaging means so that close-up photography is performed when the calling means is operated.

  In addition, according to the present invention, a captured image acquisition unit that acquires, via a network, captured images captured by a plurality of imaging devices that are installed in each house in a predetermined region and captures the predetermined region; Searching person determining means for determining whether or not the person to be searched is reflected in the captured image taken by each of the plurality of imaging devices received by the image acquiring means, and the person to be searched for is displayed by the searching person determining means. Moving path specifying means for specifying the moving path of the person to be searched for based on the installation position of the imaging device that has captured the captured image in which the person to be searched for is captured. A server device is provided.

  In addition, according to the present invention, there is provided a monitoring method for monitoring a person requiring a search by a server device that manages captured images captured by a plurality of imaging devices installed in each house in a predetermined area, the plurality of imaging devices A shooting step of shooting a predetermined area by the device, a search target person determination step of determining whether or not a search target person is reflected in a captured image shot by each of the plurality of imaging devices by the server device, and the above When it is determined that the person who needs to be searched is reflected, the movement path of the person who needs to be searched is determined based on the installation position of the imaging device that has captured the photographed image in which the person requiring the search is reflected by the server device. And a moving path specifying step for specifying the monitoring method.

  Further, according to the present invention, there is provided a program for performing search target person monitoring processing using a computer of a server device that manages captured images taken by a plurality of imaging devices installed in each house in a predetermined area. In addition, the person to be searched for is determined by the process for determining the person to be searched for to determine whether or not the person to be searched for is reflected in the captured images captured by each of the plurality of imaging devices, and the person to be searched for is determined by the process for determining the person to be searched for. If it is determined that the search target person is moving, the moving path specifying process for specifying the moving path of the search target person based on the installation position of the imaging device that captured the captured image in which the search required person is captured is stored in the computer. A program characterized by being executed is provided.

  ADVANTAGE OF THE INVENTION According to this invention, the monitoring system, imaging device, server apparatus, monitoring method, and program which can grasp | ascertain the action of a search required person easily are provided.

It is a block diagram which shows the structure of the monitoring system of this embodiment. It is a block diagram which shows the structure of the door phone by this embodiment. It is a schematic diagram which shows the external appearance of the door phone by this embodiment. It is a block diagram which shows the structure of the server apparatus by this embodiment, and the structure of a database. It is a flowchart for demonstrating operation | movement of the door phone of this embodiment. It is a flowchart for demonstrating operation | movement of the server apparatus of this embodiment. It is a flowchart for demonstrating operation | movement of the server apparatus of this embodiment. It is a figure which shows the example of tracking of the movement path | route of the search required person by the monitoring system of this embodiment. It is a conceptual diagram which shows the detection of the moving direction of the search required person by the monitoring system of this embodiment, and the wide-angle imaging | photography image which the search required person was reflected.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, similar components are denoted by the same reference numerals, and redundant description may be omitted.

First, an overview of the monitoring system of this embodiment will be described.
A monitoring system 1000 according to the present embodiment includes door phones (a plurality of imaging devices) 100-1 to 100-n and a server device 400. The door phone (a plurality of imaging devices) 100-1 to 100-n is installed in each house in a predetermined area, and images a predetermined area. The server device 400 determines whether or not a search target person is reflected in the captured images taken by the door phones (a plurality of imaging devices) 100-1 to 100-n, and determines that the search target person is included. In the case where the search person is searched, the movement path of the search person is specified based on the installation position of the imaging device that has taken the captured image in which the search person is reflected.

  Here, the search target person includes not only an unspecified person such as a suspicious person but also a specific person such as a lost person, a missing person, or a wanted criminal. In the present embodiment, search and search are not distinguished.

  The doorphones (plural imaging devices) 100-1 to 100-n always perform wide-angle shooting including on the road and the operation unit (calling unit) 13 and the operation unit (calling unit) 13 operated by a visitor. (Means) 13 is operated, the control unit 20 controls the imaging unit 14 so as to perform close-up photography. A call button is illustrated as an operation unit (calling means) of the present embodiment (described later).

  The door phone (a plurality of imaging devices) 100-1 to 100-n further includes a communication unit 10 that transmits a wide-angle shot image obtained by wide-angle shooting and a close-up shot image obtained by close-up shooting to the server device 400 at a predetermined timing.

  The server device 400 determines whether or not a person reflected in a close-up photographed image and a wide-angle photographed image is a person requiring a search based on a non-searcher image that is registered in advance. 41 is further provided.

  The search required person determination unit 41 further determines whether the person reflected in the close-up photographed image and the wide-angle photographed image is the search required person based on the search required person image registered in advance.

  The server device 400 includes a person-to-be-searched feature extraction unit 42 that extracts a person feature of a person requiring a search that is reflected in a close-up photographed image and a wide-angle photographed image, and a person to be searched for extracted by the person-to-be-searched feature extraction unit 42. And a moving direction detecting unit (searching person moving direction detecting unit 43) that detects the moving direction of the searching person reflected in the close-up photographed image and the wide-angle photographed image.

  The server device 400 is based on the movement direction of the search target person detected by the movement direction detection unit (search person movement direction detection unit 43) and the installation positions of the door phones (plural imaging devices) 100-1 to 100-n. In addition, a search target person tracking unit (estimation unit) 44 that estimates an imaging device that has captured the search target person is further provided.

  The server device 400 further includes a search-person tracking unit 44 that tracks the movement path of the search-target person based on the installation position of the imaging device estimated by the search-person tracking unit (estimation unit) 44.

Next, the monitoring system 1000 of this embodiment will be described in detail.
FIG. 1 is a block diagram illustrating a configuration of a monitoring system 1000 according to the present embodiment. In FIG. 1, a monitoring system 1000 includes door phones 100-1, 100-2,..., 100-n with IP cameras, a router 200, a server device 400, and a database 500. The IP camera-equipped door phones 100-1 to 100-n are connected to the router 200 via a wired or wireless LAN, and are connected to the server device 400 on the network 300 via the router 200. The IP camera doorphones 100-1 to 100-n are so-called doorphones with a camera. When a call button is pressed, a call chime is sounded in the house to notify the customer. However, in the present embodiment, the door phones 100-1 to 100-n with IP cameras are characterized in that they always shoot not only when the visitor presses the call button. The IP camera doorphones 100-1 to 100-n always zoom out to take a wide-angle image of the road, and when a call button is pressed by a visitor, zooms in and takes a close-up picture of a person. In the following, door phones 100-1 to 100-n with IP cameras may be collectively referred to as door phone 100.

  The door phone 100 normally captures an image (still image or moving image) at a wide angle (hereinafter referred to as a wide angle captured image), and the door phone for identifying the door phone 100 at each predetermined transmission timing. When the call button (described later) is pressed by a visitor, the ID is transmitted to the server device 400, and when the visitor presses a zoom-in (close-up) image (hereinafter referred to as a close-up image), the close-up image is referred to as a door phone ID and a visit. In order to determine whether or not the person is a searchable person, it is transmitted to the server apparatus 400 together with a person specifying request.

  In the present embodiment, it is assumed that the door phone 100 is intensively installed in a house in the area of a partitioned area (a new residential area or a luxury residential area). The door phone 100 is preferably installed at the boundary (gate pillar) between the site and the road. This is to make it possible to take a wide-angle image of the person who needs to search the road. In addition, when there are houses on both sides across the road, it is preferable to provide at least one door phone 100 across the road in order to eliminate blind spots. Moreover, in order to accurately detect the moving direction of the search target person, it is preferable to place the door phone 100 at the intersection (four doors) with emphasis.

  However, the effect of the invention can be obtained even if it is not installed in all households. Even if there are a few percent of ordinary doorphone homes, it doesn't mean that people who need to be searched will be missed immediately. In other words, the shooting angle of view that can be taken with the camera of the door phone 100 of one house and the shooting angle of view that can be taken with the camera of the door phone 100 of another adjacent house need not be separated from each other. Even if there is a non-photographing area, unless there is a branch point or vacant land there, if a suspicious person walks normally on the road, he must walk from one shooting angle to another. Because.

  The router 200 connects the door phone 100 arranged in a predetermined area to the server device 400 on the network 300 by wired or wireless LAN (or public wireless LAN is also possible). The network 300 includes a public line network, the Internet, and the like.

  Server device 400 is connected to network 300 and accepts access from door phone 100 or regional security service server 600 described below. The server apparatus 400 centrally manages images taken by the door phone 100 via the network 300.

  The server device 400 refers to the database 500 and specifies that the person reflected in the image photographed by the door phone 100 is a searchable person. There are the following methods for specifying that the person is a searchable person.

1) When it is detected that the person moves in the entrance direction without pressing the call button (operation unit 13) and is not registered in the family image (= suspicious person),
2) If a face image is registered as a searchable person, such as a wanted criminal or a missing person, and the face image of the person in the photographed image matches,
3) When the facial feature of the person who pressed the call button (operation unit 13) is recognized, does not match the family image, and matches the image of the person who needs to be searched.

  In the present embodiment, the method described in 3) above, that is, the facial features of a person appearing in a close-up photographed image taken with the door phone 100 are recognized, do not match the family image, and match the image of the person requiring search. In such a case, a method of identifying the photographed person as a searchable person is adopted.

  Further, the server device 400 uses the image captured by the door phone 100 to frame the positional relationship of the house where the door phone 100 is installed, the shooting time (time stamp) of the captured image, and the search target person from the image. The direction of movement of the person requiring a search is estimated from the direction to go out, and finally the movement path of the person requiring a search is traced.

  The database 500 stores a family image, an image of a person to be searched for, and the like for determining a person to be searched for from a photographed image.

  The regional security service server 600 is a server device for using an image taken by the door phone 100, which is managed by the server device 400, such as a local police or a security company. The image stored in the server device 400 can be accessed from the local security service server 600, but may be hidden from the user (resident) in order to ensure privacy.

  Thus, in this embodiment, the reason for using the door phone 100 is that a suspicious person is not wary if the camera is arranged in a natural manner in the city. In the case of a dedicated surveillance camera, the suspicious person tries to bypass it. In addition, in the case of an empty nest, it often enters after confirming the absence by ringing the door phone once, so by taking close-up and acquiring images at that time, it is possible to specify the person, Tracking accuracy can be improved.

Next, the outline | summary of the door phone 100 of this embodiment is demonstrated.
The door phone (imaging device) 100 is installed in a house in a predetermined area. The door phone (imaging device) 100 includes an imaging unit 14, an operation unit (calling unit) 13, and a control unit 20. The imaging unit 14 captures a predetermined area, and the operation unit (calling unit) 13 is operated by a visitor. The control unit 20 always performs wide-angle shooting including on the road, and controls the imaging unit 14 to perform close-up shooting when the operation unit (calling unit) 13 is operated.

  The door phone (imaging device) 100 further includes a communication unit 10. The communication unit 10 transmits a wide-angle photographed image obtained by wide-angle photography and a close-up photographed image obtained by close-up photography to the server device 400 via the network 300 at a predetermined timing.

Next, the door phone 100 of this embodiment will be described in detail.
FIG. 2 is a block diagram illustrating a configuration of the door phone 100 according to the present embodiment. In FIG. 2, a communication unit 10, a ROM 11, a RAM 12, an operation unit 13, an imaging unit 14, an audio control unit 15, a speaker 16, a microphone 17, a night light 18, an illuminometer 19, and a control unit 20 are provided. The communication unit 10 is connected to the router 200 via a wireless LAN or the like, and is connected to the server device 400 on the network 300 via the router 200. The ROM 11 stores a program executed by the control unit 20 described later, various parameters necessary for operations, and the like. The RAM 12 stores data such as temporary data when the control unit 20 executes the program, application programs, various parameters necessary for executing the application, captured images, and the like.

  The operation unit 13 corresponds to a call button of the door phone 100. When the call button is pressed by a visitor, the operation unit 13 sounds a call chime in the house. Under the control of the control unit 20, the imaging unit 14 normally zooms out to take a wide-angle image of the road, and when the call button is pressed, zooms in to close-up a person. An image captured by the imaging unit 14 is temporarily stored in the RAM 12 and then transferred to the server device 400 via the communication unit 10 as appropriate.

  The voice control unit 15 outputs the voice of a person in the house (a device inside the house: an interphone is not shown) from the speaker 16 according to the control of the control unit 20, while the environmental sound collected by the microphone 17 (at the time of the visitor) Audio) is digitized and captured. These sounds are recorded in an image taken by the imaging unit 14. The night light 18 is automatically turned on at night or the like when sufficient brightness cannot be obtained by photographing with the imaging unit 14. The illuminometer 19 measures ambient brightness. Based on the illuminance measured by the illuminometer 19, the control unit 20 controls exposure adjustment of the imaging unit 14 and lighting / extinguishing of the nighttime light 18.

  The control unit 20 controls the operation of each unit by executing the program stored in the ROM 11 described above. In the present embodiment, the control unit 20 performs wide-angle shooting with the imaging unit 14 at normal times, zoom-in (close-up) shooting when the call button is pressed, encoding processing of the shot image data, image processing, or shooting. The transfer of the transferred image to the server apparatus 400 is controlled. Note that image data encoding, image processing, and the like may be separately processed by a dedicated image processing unit or the like.

  FIG. 3 is a schematic view showing the appearance of the door phone 100 according to the present embodiment. It should be noted that parts corresponding to those in FIG. In FIG. 3, the door phone 100 includes an imaging unit (camera) 14 at an upper front portion of the housing. A night light (white LED) 18 and an illuminometer 19 are arranged below the imaging unit 14. A microphone 17 is disposed beside the imaging unit 14. Furthermore, a speaker 16 and a call button (operation unit 13) are arranged below the imaging unit 14. In appearance, it is no different from a normal door phone. This is because the suspicious person is not warned as described above.

Next, an overview of the server device 400 of this embodiment will be described.
The server device 400 includes a captured image acquisition unit 40, a searchable person determination unit 41, and a searchable person tracking unit (movement path specifying unit) 44. The captured image acquisition unit 40 is installed in each house in a predetermined region, and acquires captured images captured by a plurality of imaging devices that capture the predetermined region via a network. The search required person determination unit 41 determines whether or not the search required person is reflected in the captured image captured by each of the plurality of imaging devices. When it is determined that the search target person is captured, the search person tracking unit (movement path specifying unit) 44 is based on the installation position of the door phone 100 that captures the captured image including the search target person. Specify the travel route of the person who needs to be searched.

  The searching person determining unit 41 determines whether the person reflected in the close-up photographed image and the wide-angle photographed image is the searching person based on the non-searching person image registered in advance.

  The search required person determination unit 41 further determines whether the person reflected in the close-up photographed image and the wide-angle photographed image is the search required person based on the search required person image registered in advance.

  The server apparatus 400 further includes a search required person feature extraction unit 42 and a search required person moving direction detection unit 43. The search required person feature extraction unit 42 extracts the person characteristics of the search required person reflected in the close-up photographed image and the wide-angle photographed image. The searching person moving direction detection unit 43 detects the moving direction of the searching person in the wide-angle captured image based on the extracted person characteristics of the searching person.

  The server device 400 further includes a search required person tracking unit (estimating unit) 44. The searching person tracking unit (estimating unit) 44 is based on the moving direction of the searching person detected by the moving direction detecting unit (searching person moving direction detecting unit 43) and the installation positions of the plurality of doorphones 100. The door phone 100 which photographed the search person required is estimated.

  The server device 400 further includes a search target person tracking unit 44. The searching person tracking unit 44 tracks the movement path of the searching person based on the estimated installation position of the door phone 100.

  FIG. 4 is a block diagram showing the configuration of the server device 400 and the configuration of the database 500 according to the present embodiment. First, the database 500 will be described. The database 500 includes an image DB (database) 500-1, a family image DB 500-2, and a search required person DB 500-3. The image DB (database) 500-1 stores the captured images transferred from the door phones 100-1 to 100-n with IP cameras in association with the door phone ID for identifying the captured door phone 100. The family image DB 500-2 stores, for each door phone ID, a face image (or a facial feature point) of a family member (or a person who frequently goes in and out) in a house where the door phone 100 corresponding to the door phone ID is installed. . The search required person DB 500-3 is a face image of a search required person such as a suspicious person, a wanted criminal, a person who has been struck, lost or kidnapped, provided by the police in charge or registered as a suspicious person in the past. (Or facial feature points) and human face images are stored.

  In this embodiment, the server apparatus 400 is a general computer apparatus, and implement | achieves various functions by running a program. FIG. 4 shows a functional configuration of the server device 400. The server device 400 includes a captured image acquisition unit 40, a searchable person determination unit 41, a searchable person feature extraction unit 42, a searchable person movement direction detection unit 43, and a searchable person tracking unit 44.

  The captured image acquisition unit 40 acquires a captured image transferred from the door phone 100 via the network 300 and stores it in an image DB (database) 500-1. The captured image acquisition unit 40 may request the door phone 100 to acquire a captured image at a predetermined timing (time interval). The captured image acquisition unit 40 accepts a person identification request from the door phone 100 whose call button has been pressed, and sends it to the search target person determination unit 41 together with the image at that time. The image transferred from the door phone 100 is given a door phone ID for identifying the photographed door phone 100. The house in which the door phone 100 is installed can be identified from the door phone ID.

  When receiving the person specifying request from the photographed image acquisition unit 40, the search-required person determination unit 41 refers to the family image DB 500-2 and the search-required person DB 500-3 for the person reflected in the image at that time. Identify. First, the search-required person determination unit 41 reads, from the family image DB 500-2, the family face image of the house where the door phone 100 corresponding to the door phone ID is installed, and reflects the family face image and the image on the family face image. Pattern matching is performed with a person (a close-up face image) to determine whether the person is a family member. Further, when the search-required person determination unit 41 determines that the person is not a family member, the face-required person's face image is read from the search-required person DB 500-3, and is reflected in the face-required person's face image and image. Pattern matching is performed with a person (a close-up face image), and it is determined whether the person is a person who needs to be searched.

  When it is determined that the person who needs to be searched is a person who needs to be searched, the person-of-search feature extraction unit 42 extracts the person feature based on the close-up image. As person characteristics, clothes such as a person who needs to be searched, color information of belongings, body shape information such as back appearance, and the like are extracted by image analysis. Using a known face recognition system, the position information of the facial feature points may be acquired as one piece of personal feature information.

  The searching person moving direction detecting unit 43 detects the searching person from the close-up image obtained by photographing the person requiring the search and the wide-angle photographed image taken by another door phone 100 installed in the same area. The direction in which to search is determined, and the moving direction of the search target person is detected.

  The search target person tracking unit 44 estimates that the search target person has been shot based on the movement direction and shooting time (time stamp) of the search target person detected by the search person movement direction detection unit 43. The next doorphone 100 and the wide-angle photographed image photographed by the doorphone 100 are specified. In addition, the search target person tracking unit 44 performs pattern matching (using a well-known recognition technique) on the estimated wide-angle photographed image of the estimated door phone 100 based on the person characteristics of the search target person, and performs the estimation. When a search target person is photographed in the wide-angle shot image of the door phone 100, the wide-angle shot image in which the search person is reflected is separately stored in the image DB 500-1.

  Further, the search target person tracking unit 44 detects the search target person by repeating the process of detecting the moving direction of the search target person from the wide angle photographed image and saving the wide angle photographed image in which the search person is photographed. A wide-angle captured image is acquired in time series. As a result, it is possible to track the movement path of the person who needs to be searched in the area.

  Hereinafter, a monitoring method for monitoring a search target person using the monitoring system of the present embodiment (hereinafter sometimes referred to as the present method) will be described. This method is a monitoring method in which a search target person is monitored by a server device 400 that manages a shot image taken by a plurality of doorphones 100 installed in each house in a predetermined area. A step and a movement path specifying step.

  In the photographing step, a predetermined area is photographed by the plurality of doorphones 100. In the search-required person determination step, the server apparatus 400 determines whether the search-required person is reflected in the captured image captured by each of the plurality of doorphones 100. In the movement path specifying step, when it is determined that the person who needs to be searched is reflected, the server device 400 uses the server device 400 based on the installation position of the door phone 100 where the photographed image including the person who needs to be searched is captured. Specify the movement path of the person.

  The program of this embodiment is for performing information management processing using a computer (processing device of a portable terminal). The program of this embodiment is a program for performing a search required person monitoring process using the computer of the server apparatus 400 which manages the picked-up image image | photographed with the several door phone 100 installed in each house of a predetermined area. Then, the computer is caused to execute search target person discrimination processing and movement route identification processing.

  The search-required person determination process determines whether a search-required person is reflected in the captured image captured by each of the plurality of doorphones 100. In the movement route specifying process, when it is determined that the person to be searched for is included in the person-to-be-searched determination process, the search is required based on the installation position of the door phone 100 that has captured the photographed image in which the person to be searched is included. Specify the movement path of the person.

  The program of this embodiment may be stored in a computer-readable storage medium.

This method will be described in more detail.
First, operation | movement of the door phone 100 of this embodiment is demonstrated.
FIG. 5 is a flowchart for explaining the operation of the door phone 100 of the present embodiment.

  In step S10, the control unit 20 sets the imaging unit 14 to wide-angle shooting.

  In step S <b> 12, the control unit 20 starts wide-angle shooting by the imaging unit 14.

  In step S14, the control unit 20 determines whether or not the call button (the operation unit 13) has been pressed. If the call button (operation unit 13) has not been pressed (NO in step S14), the process proceeds to step S16. On the other hand, when the call button (operation unit 13) is pressed (YES in step S14), the process proceeds to step S20.

  In step S <b> 16, the control unit 20 determines whether it is the transmission timing of the captured image to the server device 400. If it is not the transmission timing (NO in step S16), the process proceeds to step S26. On the other hand, if it is the transmission timing (YES in step S16), the process proceeds to step S18.

  In step S <b> 18, the control unit 20 transmits the wide-angle captured image captured so far from the previous transmission timing to the server device 400 via the communication unit 10 together with the door phone ID.

  In step S20, the control unit 20 performs shooting by switching the imaging unit 14 to zoom-in (close-up) shooting. That is, when the call button (operation unit 13) of the door phone 100 is pressed, a visitor in the vicinity of the door phone 100 is zoomed in (close-up). As a result, the face of the visitor can be photographed more clearly, and it can be easily determined whether or not the person is a person requiring a search. However, at this point, the visitor may be a member of the family, may be a resident of the neighborhood, or may be a searchable person such as a suspicious person or an intruder.

  In step S <b> 22, the control unit 20 transmits the door phone ID, the detection time, and the close-up photographed image together with the person specifying request to the server device 400 via the communication unit 10.

  In step S24, the imaging unit 14 is returned to wide-angle shooting, and the process proceeds to step S26.

  In step S26, the control unit 20 determines whether or not a shooting stop operation has been performed. If there is no photographing stop operation (NO in step S26), the process returns to step S12 and the above-described processing is continued. On the other hand, if there has been a shooting stop operation (YES in step S26), the process ends. Usually, there is no shooting stop operation, and shooting is always continued.

  As described above, the door phone 100 normally repeatedly captures a wide-angle captured image and transmits the captured wide-angle captured image to the server device 400 at every predetermined transmission timing. In this process, when a call button (operation unit 13) is pressed by a visitor, the door phone 100 zooms in to take a close-up photograph in order to photograph the visitor's face more clearly. The ID, the detection time, and the close-up photographed image are transmitted to the server apparatus 400. Thereafter, the door phone 100 returns to the wide-angle shooting again, and continues shooting the wide-angle shot image.

Next, the operation of the server apparatus 400 of this embodiment will be described.
6 and 7 are flowcharts for explaining the operation of the server apparatus 400 of this embodiment. Note that the flowcharts shown in FIGS. 6 and 7 are repeatedly executed at predetermined time intervals.

  In step S40, in the server device 400, the captured image acquisition unit 40 determines whether a captured image (a wide-angle captured image and a close-up captured image) has been received from the door phone 100 installed in each house or the like. And when the picked-up image is not received (NO of step S40), the said process is complete | finished. On the other hand, when the captured image is received (YES in step S40), the process proceeds to step S42.

  In step S <b> 42, the captured image acquisition unit 40 stores the received captured image in the image DB 500-1 in association with the door phone ID for identifying the captured door phone 100.

  In step S44, the captured image acquisition unit 40 determines whether a person specifying request has been received. The person identification request is transmitted from the door phone 100 when the call button (the operation unit 13) of the door phone 100 is pressed and zoom-in (close-up) shooting is performed. If a person identification request is received (YES in step S44), the process proceeds to step S46. On the other hand, if the person identification request has not been received (NO in step S44), the process ends.

  In step S46, the search-required person determining unit 41, when receiving the person specifying request from the captured image acquisition unit 40, refers to the family DB 500-2 and is reflected in the close-up captured image at that time stored in the image DB 500-1. Pattern matching between busy visitors and family images.

  In step S <b> 48, the search-required person determination unit 41 determines whether or not a visitor reflected in the close-up shot image has been identified. Specifically, the search-required person determination unit 41 matches the result of pattern matching (using a well-known face recognition technique) between the face image of the visitor and the face image of the family that are reflected in the close-up photographed image. It is determined whether there is a family image to be used. If the image matches the family image, that is, if the visitor can be identified (YES in step S48), the person ends with no problem, and the process ends. On the other hand, if it does not match the family image, that is, if the visitor cannot be specified (NO in step S48), the process proceeds to step S50.

  In step S50, if it is determined that the person who needs to be searched for is not a family, the person who needs to be searched for refers to the DB 500-3 to be searched for, and patterns a visitor and a person to be searched for in the close-up shot image at that time. Match.

  In step S <b> 52, the search-required person determination unit 41 determines whether the visitor reflected in the close-up photographed image can be specified. More specifically, the search-required person determination unit 41 performs pattern matching (using a well-known face recognition technique) between the face image of the visitor and the face image of the search-required person reflected in the close-up photographed image. Then, it is determined whether or not there is a matching face image of the search target person. If the face image of the person requiring search does not match, that is, if the visitor cannot be identified (NO in step S52), it cannot be said that there is a problem, and thus the process ends. However, since this person may not cause any problems in the future, the close-up photographed image (the face image of the visitor reflected in the person) may be stored for a predetermined period. From the next time, the close-up shot image (a visitor's face image reflected in the image) may also be a person-specific comparison target. On the other hand, if the face image of the person requiring search matches, that is, if the visitor can be identified as one of the persons requiring search (YES in step S52), the process proceeds to step S54.

  In step S54, the search-required person feature extraction unit 42 extracts the person features of the search-required person reflected in the close-up photographed image. Specifically, the search target person feature extraction unit 42 uses the well-known face recognition technology to detect the position information of the facial feature points, the well-known image analysis technique, and the clothes of the person who needs the search, Color information, body shape information such as back appearance, etc. are extracted as person features.

  Moving to FIG. 7, in step S56, the search-person movement direction detection unit 43 takes a close-up image obtained by photographing the person who needs to be searched (a wide-angle image taken by another door phone 100 installed in the same area from the second time on). From this, the direction in which the search target person enters the frame in and the frame out is determined, and the moving direction of the search target person is detected. Specifically, it is determined whether the search target person has moved from right to left or left to right in the shooting angle of view.

  In step S58, the search target person tracking unit 44 estimates that the search target person is being shot based on the moving direction of the search target person and the shooting time (time stamp), and the next door phone 100 and its door phone. A wide-angle image captured at 100 is specified. That is, it is possible to guess the next door phone 100 in which it is assumed that the person who needs to be searched is photographed from the moving direction of the person who needs to be searched. Further, from the shooting time (time stamp), it is possible to estimate the shooting time (time stamp) of the wide-angle shot image that is supposed to be taken by the next door phone 100.

  In step S60, the search target person tracking unit 44 performs pattern matching (using a well-known recognition technique) on the estimated wide-angle photographed image of the estimated door phone 100 based on the person characteristics of the search required person. Do.

  In step S62, the search target person tracking unit 44 determines whether or not the search target person is captured in the wide-angle captured image of the door phone 100 estimated as a result of the pattern matching. If the person who needs to be searched is photographed (YES in step S62), the process proceeds to step S64. On the other hand, if the search required person has not been photographed (NO in step S62), the process proceeds to step S66.

  In step S64, the search required person tracking unit 44 separately stores the wide-angle captured image in which the search required person is reflected in the image DB 500-1. After that, the process returns to step S56, the moving direction of the search target person is detected from the wide-angle captured image, and the above-described processing is repeated. Accordingly, the search target person tracking unit 44 can acquire a wide-angle captured image in which the search target person is captured in time series, and can track the movement path of the search target person in the area.

  In step S <b> 66, the search target person tracking unit 44 determines whether all door phones 100 have been searched. If there is a door phone 100 that has not yet been searched (NO in step S66), the process returns to step S58, and the person to be searched for obtained from the previous wide-angle photographed image (in which the person to be searched for is reflected) is returned. From the moving direction, a new next door phone 100 in which the person who needs to be searched is estimated to be taken is identified, and a wide-angle shot image in which the person who needs to be searched is reflected is searched. On the other hand, when all the doorphones 100 have been searched (YES in step S66), the process ends.

Next, an operation example of the present embodiment will be described with reference to FIGS.
FIG. 8 is a diagram illustrating an example of tracking the movement path of a search target person by the monitoring system 1000 according to the present embodiment. FIG. 8 shows a schematic map imitating a certain area where the doorphones P1 to P7 and PS are installed. As shown in FIG. 8, doorphones P <b> 1 to P <b> 7 and PS indicated by circles (◯, ●, hatched circles) are installed in houses, shops, and the like in the area L <b> 1 monitored by the monitoring system of the present embodiment. . As described above, the doorphones P1 to P7 and PS are preferably installed at the boundary (gate pillar) between the site and the road. This is to make it possible to take a wide-angle image of the person who needs to search the road. When there are houses on both sides across the road, it is preferable to provide at least one door phone P1 to P7 and PS across the road in order to eliminate blind spots. In addition, doorphones P1 to P7 and PS may be intensively arranged at the intersection (four doors) in order to accurately detect the moving direction of the person to be searched for.

  In FIG. 8, the dotted line extending from the circle indicates the shooting direction and angle of view of any door phone P1 to P7 and PS. Further, ● indicates a door phone PS in which a call button (operation unit 13) is pressed and a close-up photographed image is photographed. The search target person is tracked starting from the door phone PS. The hatched circles indicate the doorphones P1 to P7 where the moving searcher is photographed. A circle indicates a door phone where the searcher is not photographed. Furthermore, the arrow indicates the direction of movement of the searcher who needs the search, and the two-dot broken line indicates the movement path of the searcher who needs the search.

  FIG. 9 is a conceptual diagram showing detection of the moving direction of the search target person by the monitoring system 1000 of the present embodiment and a wide-angle shot image in which the search target person is reflected. FIG. 9 shows a wide-angle photographed image and a wide-angle photograph taken by doorphones P1 to P7 and PS installed along the movement route when the search target person takes a movement route as shown in FIG. The direction of movement of the search target person obtained from the image is shown. In FIG. 9, the numbers described below the doorphones P <b> 1 to P <b> 7 and PS represent the time taken by the doorphone.

  First, in the door phone PS, as shown in FIG. 9, the person who needs to be searched is photographed close-up (time; 22:05:20). Thereafter, as shown in FIG. 8, the person to be searched for is photographed at the doorphones P1 to P7 installed along the movement path of the person to be searched for.

  First, in the door phone P1, as shown in FIG. 9, a state in which the search target person moves from the left to the right with respect to the shooting angle of view is shot (time; 22:05:30). Next, in the door phone P2, a state in which the search target person moves from the left to the right with respect to the shooting angle of view is shot (time; 22:05:50). Next, in the door phone P3, a scene in which the search target person moves from the right to the left with respect to the shooting angle of view is shot (time: 22:06:10).

  Next, in the door phone P4, as shown in FIG. 9, a state in which the search target person moves from the left to the right with respect to the shooting angle of view and further to the other side of the street is shot (time; 22:06:25). ). Next, in the door phone P5, a scene in which the search target person moves from the left to the right with respect to the shooting angle of view is shot (time; 22:06:30). Next, in the door phone P6, a state in which the search target person moves from the right to the left with respect to the shooting angle of view is shot (time: 22:06:40). Finally, the door phone P7 shoots how the person in search moves from left to right with respect to the shooting angle of view (time; 22:06:45). It is possible to easily grasp the moving direction and moving path of the search target person from the wide-angle captured image shown in FIG.

  As described above, according to the present embodiment, a plurality of doorphones P1 to P7 and PS are installed in each house in a predetermined area, and the predetermined area is photographed by the plurality of doorphones. If it is determined that the person to be searched for is reflected in the captured images taken by each of the images, and if it is determined that the person to be searched for is reflected, it is based on the position of the door phone where the person to be searched is reflected. Since the movement route of the person requiring search is specified, the action of the person searching for can be easily grasped.

  The present invention is not limited to the above-described embodiment, and includes various modifications and improvements as long as the object of the present invention is achieved.

  For example, in the above-described embodiment, the server device 400 detects the moving direction of the search target person based on information such as where the search target person disappeared in the field of view. However, the server apparatus 400 detects from the image captured on the door phone 100 side. Then, the server device 400 may be notified of the detection result.

  In the above-described embodiment, the position information of the facial feature points, the clothing information of the person who needs to be searched, the color information of the belongings, the body type information such as the back appearance, etc. are extracted as the person features, and the image based on the person features The movement direction of the person who needs to be searched is detected using the recognition technology. However, the present invention is not limited to this, and by synchronizing the time of each doorphone 100 correctly, the movement direction of the adjacent doorphone 100 disappears automatically. The person who enters the shooting angle of view of the door phone 100 may be identified as the same person (that is, the person to be searched for).

  In the above-described embodiment, the wide-angle captured image captured by the door phone 100 is transmitted to the server device 400 at a predetermined transmission timing, but may be transmitted to the server device 400 in real time. Alternatively, the overwriting update of the captured image is repeated in the storage unit (RAM 12) of the door phone 100, and an image image in a corresponding time zone is cut out and transferred to the server device 400 based on a request from the server device 400. May be. Alternatively, using a moving body detection technique, if a subject moving in some way is captured, an image captured during that time may be transmitted to the server device 400 at a predetermined timing (when the subject disappears).

  Further, in the above-described embodiment, when the server device 400 detects a search target person, the server apparatus 400 sends an image provision command to the door phone near the door phone 100 that has photographed the search target person, and receives the command. The door phone 100 may transmit the wide-angle captured image to the server device 400.

  In the above-described embodiment, the server device 400 may analyze the behavior of the person who needs to search using past accumulated images. For example, it may be analyzed whether a suspicious person specified by close-up has passed in front of the house many times in the past, or has not moved on a specific route (escape route). By tracking the suspicious person's behavior pattern multiple times, a large amount of information for searching can be collected.

  In the above-described embodiment, for example, even when a real-time close-up image at the moment when a suspicious person arrives at home has not been captured, by enabling pattern matching between wide-angle captured images, the past (for example, The person to be searched for may be specified by analyzing a wide-angle photographed image taken at the time when the vacant nest damage occurred retroactively (within an image accumulation period of about one week).

  In this case, before and after the estimated crime time, the person shown in the wide-angle shot image taken with the doorphone 100 of the house or a neighboring house is identified as a criminal candidate, and color information and body shape information are acquired to search Pattern matching with human images. At this time, it is preferable to specify a person who appears in the wide-angle photographed image taken by the door phone 100 of the house that has suffered vacant nest as a criminal candidate. In addition, after identifying the criminal candidate from the wide-angle shot image taken with the doorphone 100 of the damaged house, pattern matching is performed not only for the wide-angle shot image of the doorphone 100 of another neighboring house but also for the close-up shot image. May be. There is a possibility that the criminal of the vacant nest pushes the doorbell of another house.

  The door phone 100 and the server device 400 of the present invention can read a computer program and execute a corresponding processing operation, so that a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), an I / F It can be implemented as hardware constructed by general-purpose devices such as (Interface) units, dedicated logic circuits constructed to execute predetermined processing operations, combinations thereof, and the like. The various constituent elements of the present invention only have to be formed so as to realize the function. For example, dedicated hardware that exhibits a predetermined function, data processing in which a predetermined function is given by a computer program It can be realized as an apparatus, a predetermined function realized in the data processing apparatus by a computer program, an arbitrary combination thereof, or the like. The various constituent elements of the present invention do not have to be independent of each other, one constituent element is a part of another constituent element, a part of one constituent element and another constituent element. It is allowed to have some overlap.

  The fact that the component (database 500) of the present invention stores data means that the device of the present invention has a function of storing data, and it is not always necessary to store the data.

  The plurality of steps included in the monitoring method of the present invention can be changed in order without impairing the present invention, and a part or all of the plurality of steps can be executed at a timing overlapping each other. To do.

The above embodiment includes the following technical idea.
(1) It is determined whether a search target person is reflected in a plurality of imaging devices that are installed in each house in a predetermined region and shoot the predetermined region, and captured images captured by each of the plurality of imaging devices. If it is determined that the person who needs to be searched is included, the movement path of the person who needs to be searched is specified based on the installation position of the imaging device that has captured the captured image in which the person who needs to be searched is included. And a server device.
(2) The plurality of imaging devices always perform wide-angle shooting including on-road and imaging means, calling means operated by a visitor, and the imaging means so as to perform close-up photography when the calling means is operated. The monitoring system according to (1), further comprising control means for controlling the means.
(3) The plurality of imaging devices further include a communication unit that transmits the wide-angle captured image captured at the wide angle and the close-up captured image captured at the predetermined timing to the server device. The monitoring system according to (2).
(4) In the server apparatus, the person who is reflected in the close-up photographed image and the wide-angle photographed image taken as the close-up photograph based on the pre-registered non-search-required person images is the search-required person. The monitoring system according to (2) or (3) above, further comprising a searchable person determining means for determining whether or not there is a search person.
(5) The searching person determining unit further determines whether the person reflected in the close-up photographed image and the wide-angle photographed image is the searching person based on the searchable person image registered in advance. The monitoring system according to (4), wherein the monitoring system is discriminated.
(6) The server device is extracted by the search person feature extraction means for extracting the person feature of the search target person reflected in the close-up shot image and the wide-angle shot image, and the search person feature extraction means. And a moving direction detecting means for detecting a moving direction of the searching person who is reflected in the close-up photographed image and the wide-angle photographed image based on the person characteristic of the searched person who has been searched. The monitoring system according to (4) or (5) above.
(7) The server device estimates an imaging device that captured the search target person based on the movement direction of the search target person detected by the movement direction detection unit and the installation positions of the plurality of imaging devices. The monitoring system according to (6), further comprising an estimation unit.
(8) The server device further includes a searching person tracking unit that tracks a movement path of the searching person based on an installation position of the imaging device estimated by the estimating unit. The monitoring system according to 7).
(9) An imaging apparatus that is installed in a house in a predetermined area and images a predetermined area, and performs wide-angle shooting including always on an imaging means, a calling means operated by a visitor, and on the road. An image pickup apparatus comprising: control means for controlling the image pickup means so that close-up shooting is performed when the means is operated.
(10) The above (9) further includes a communication unit that transmits the wide-angle captured image taken at the wide angle and the close-up photographed image taken at the predetermined timing to the server device via the network. The imaging device described.
(11) A captured image acquired by a plurality of imaging devices that are installed in each house in a predetermined area and captures the predetermined area is received by the captured image acquisition unit, and is acquired by the captured image acquisition unit. The person to be searched for determining whether or not the person to be searched for is reflected in the captured images taken by each of the plurality of imaging devices, and the person to be searched for is determined to be reflected by the means for determining the person to be searched for. And a movement path specifying means for specifying a movement path of the person to be searched for based on an installation position of the imaging device that has captured the captured image in which the person to be searched is captured. Server device.
(12) The search-required person determination unit is configured to search for a person who is reflected in a close-up photographed image and a wide-angle photographed image including a road based on a pre-registered non-searchable person image. The server device according to (11), wherein it is determined whether or not it is a person.
(13) The searching person determining unit may further determine whether the person reflected in the close-up photographed image and the wide-angle photographed image is the searching person based on a searchable person image registered in advance. The server device according to (12), wherein the server device is discriminated.
(14) Searching person feature extraction means for extracting a person feature of the search target person reflected in the close-up shot image and the wide-angle shot image; and the search required feature extracted by the search person feature extraction means. (12) or (13), further comprising a moving direction detecting means for detecting a moving direction of a search-required person reflected in the wide-angle photographed image based on a person characteristic of the person. Server device.
(15) It further includes an estimation unit that estimates an imaging device that has captured the search target person based on the movement direction of the search target person detected by the movement direction detection unit and the installation positions of the plurality of imaging devices. The server device as described in (14) above, wherein
(16) The above described (15), further comprising: a search target person tracking unit that tracks a movement path of the search target person based on an installation position of the imaging device estimated by the estimation unit. Server device.
(17) A monitoring method for monitoring a person requiring search by a server device that manages captured images captured by a plurality of imaging devices installed in each house in a predetermined area, wherein the plurality of imaging devices are configured to detect a predetermined area. A step of determining a person to be searched for determining whether or not a person to be searched is reflected in the captured image captured by each of the plurality of imaging devices by the server device, and If it is determined that the image is captured, the server device identifies the travel path of the search target person based on the installation position of the imaging device that captured the captured image including the search target person. And a moving path specifying step.
(18) A program for performing search target person monitoring processing using a computer of a server device that manages captured images captured by a plurality of imaging devices installed in each house in a predetermined region, It is determined that the person requiring a search is included in the photographed image captured by each of the imaging devices, and the person requiring a search is determined by the search person determining process. In this case, the computer is caused to execute a movement route specifying process for specifying a movement route of the person to be searched based on an installation position of the imaging device that has taken the photographed image in which the person to be searched is captured. A program characterized by

10 Communication unit 11 ROM
12 RAM
13 Operation part (call button)
DESCRIPTION OF SYMBOLS 14 Image pick-up part 15 Audio | voice control part 16 Speaker 17 Microphone 18 Night light 19 Illuminometer 20 Control part 24 Speaker 40 Captured image acquisition part 41 Searching person discrimination | determination part 42 Searching person characteristic extraction part 43 Searching person moving direction detection part 44 Searching person tracking section (guessing section)
100, 100-1 to 100-n Door phone 200 Router 300 Network 400 Server device 500 Database 500-1 Image DB
500-2 Family Image DB
500-3 Search DB
600 Regional security service server 1000 Monitoring system

Claims (18)

A plurality of imaging devices installed in each house in a predetermined area and shooting the predetermined area;
It is determined whether or not a person requiring a search is reflected in a captured image captured by each of the plurality of imaging devices, and when it is determined that the person requiring a search is reflected, the person requiring a search is reflected. Based on the installation position of the imaging device that captured the captured image, a server device that identifies a movement path of the person to be searched for;
A monitoring system comprising: The plurality of imaging devices include:
Imaging means;
A calling means operated by a visitor;
Control means for controlling the imaging means so as to perform close-up photography when the wide-angle shooting including the road is performed at all times and the calling means is operated;
The monitoring system according to claim 1, further comprising: The plurality of imaging devices include:
Communication means for transmitting the wide-angle photographed image taken at the wide-angle and the close-up photographed image taken at the close-up to the server device at a predetermined timing;
The monitoring system according to claim 2. The server device
Based on the pre-registered non-search-required person image, it is necessary to determine whether the close-up photographed image obtained by the close-up photography and the person reflected in the wide-angle photographed image are the search-required person. Further provided with a search person discrimination means,
The monitoring system according to claim 2 or 3, wherein The searching person determining means includes
Further, based on the search required person image registered in advance, it is determined whether the close-up shot image and the person reflected in the wide-angle shot image are the search required person.
The monitoring system according to claim 4. The server device
Searching person feature extraction means for extracting a person feature of the searching person who is reflected in the close-up shooting image and the wide-angle shooting image;
Based on the person characteristics of the person to be searched for extracted by the person-to-be-searched characteristic extraction means, a movement direction detection for detecting the movement direction of the person to be searched for reflected in the close-up photographed image and the wide-angle photographed image. Means,
The monitoring system according to claim 4, further comprising: The server device
The apparatus further comprises an estimation unit that estimates an imaging device that captured the search target person based on a moving direction of the search target person detected by the movement direction detection unit and installation positions of the plurality of imaging devices. The monitoring system according to claim 6. The server device
The monitoring system according to claim 7, further comprising a search person tracking unit that tracks a movement path of the search target person based on an installation position of the imaging device estimated by the estimation unit. An imaging device that is installed in a house in a predetermined area and photographs a predetermined area,
Imaging means;
A calling means operated by a visitor;
Control means for controlling the imaging means to perform close-up photography when the wide-angle shooting including on the road is performed at all times and the calling means is operated;
An imaging apparatus comprising:   The imaging apparatus according to claim 9, further comprising a communication unit that transmits the wide-angle captured image captured at the wide angle and the close-up captured image captured at the predetermined timing to a server apparatus via a network. . Captured image acquisition means for acquiring, via a network, captured images captured by a plurality of imaging devices that are installed in each house in a predetermined area and capture the predetermined area;
Searching person determining means for determining whether or not a searching person is reflected in a captured image captured by each of the plurality of imaging devices received by the captured image acquisition means;
When it is determined that the person to be searched for is reflected by the means for searching for persons to be searched for, the person to be searched for is based on the installation position of the imaging device that has captured the captured image in which the person to be searched for is reflected. A travel route identifying means for identifying the travel route of
A server device comprising: The searching person determining means includes
Based on the pre-registered non-searching person image, it is determined whether the close-up photographed image and the person reflected in the wide-angle photographed image including the road are the search-required person.
The server device according to claim 11. The searching person determining means includes
Further, based on the search required person image registered in advance, it is determined whether the close-up shot image and the person reflected in the wide-angle shot image are the search required person.
The server device according to claim 12, wherein Searching person feature extraction means for extracting a person feature of the searching person who is reflected in the close-up shooting image and the wide-angle shooting image;
A moving direction detecting means for detecting a moving direction of the searching person in the wide-angle image based on the person characteristics of the searching person extracted by the searching person feature extracting means;
The server device according to claim 12 or 13, further comprising:   The apparatus further comprises an estimation unit that estimates an imaging device that captured the search target person based on a moving direction of the search target person detected by the movement direction detection unit and installation positions of the plurality of imaging devices. The server device according to claim 14.   The server device according to claim 15, further comprising: a search target person tracking unit that tracks a movement path of the search target person based on an installation position of the imaging device estimated by the estimation unit. A monitoring method for monitoring a search target person by a server device that manages captured images taken by a plurality of imaging devices installed in each house in a predetermined area,
An imaging step of imaging a predetermined area by the plurality of imaging devices;
A search target person determining step for determining whether or not a search target person is reflected in the captured image captured by each of the plurality of imaging devices by the server device;
When it is determined that the search target person is reflected, the server device determines the search person's search target position based on the installation position of the imaging device that has captured the captured image including the search target person. A travel route identifying step for identifying a travel route;
The monitoring method characterized by including. A program for performing search processing for a person requiring search using a computer of a server device that manages captured images captured by a plurality of imaging devices installed in each house in a predetermined area,
A search required person determination process for determining whether a search required person is reflected in the captured image captured by each of the plurality of imaging devices;
When it is determined that the search target person is reflected by the search target person determination process, based on the installation position of the imaging device that has captured the captured image in which the search target person is reflected, A travel route identifying process for identifying a travel route of a person,
That causes the computer to execute the program.

Images