JP2004187115A - Monitoring system and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reproduce only the part on which a monitoring target is photographed from among a myriad of photographed images, in reproducing and outputting a photographed image obtained by photographing a moving object as a monitoring target. <P>SOLUTION: A monitoring system 2 for the inside of facility detects whether a monitoring target appears or disappears in the photographed image obtained by photographing a person on a blacklist as a monitoring target. When detecting the appearance of the monitoring target, the system records "starting time"as monitoring start information at that time in a monitor log database 22. When detecting the disappearance of the person, the system records "finishing time" as monitoring end information at that time in the database 22. In reproducing the photographed image, a searching system 3 extracts a photographed image within a range expressed by the "starting time" and "finishing time" in the database 22, and reproduces and outputs the extracted image. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a monitoring system and a program for extracting a monitoring target from a captured image of a moving object as a monitoring target and reproducing and outputting the target.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, for example, the following technology is known as a monitoring device that monitors the behavior of a person by analyzing a captured image of a person in a facility. That is, when pointing to the position of a suspicious individual by a cursor operation on a display screen of a captured image, a cursor area surrounding the suspicious individual is displayed, and the cursor area is moved with the movement of the suspicious individual. Is known (see Patent Document 1). Further, a technique is known in which a shape characteristic and a movement characteristic are specified from a person image in a captured image, and the suspicious person is specified by comparing the information with a previously stored information on the suspicious person (see Patent Document 2). .
[0003]
[Patent Document 1]
JP 2001-111987 A
[Patent Document 2]
JP-A-11-339139
[0004]
[Problems to be solved by the invention]
However, in the technology of Patent Document 1 described above, since a cursor is operated on the display screen of the captured image to specify the position of the suspicious person, a dedicated staff member must be provided. In addition, there is a risk that a suspicious person may be overlooked in human work. Further, in the technology of Patent Document 2 described above, even if a suspicious person can be found, a huge number of captured images are reproduced from the beginning by human work when the captured images are reproduced. A person must be found, and the confirmation work requires a great deal of labor and time.
[0005]
SUMMARY OF THE INVENTION It is an object of the present invention to enable reproduction of only a portion including a monitoring target from a huge number of captured images when reproducing and outputting a captured image captured using a moving object as a monitoring target.
[0006]
[Means for Solving the Problems]
The invention according to claim 1 is a monitoring system that extracts a monitoring target from a captured image captured using a moving object as a monitoring target and reproduces and outputs the monitoring target, and detects whether the monitoring target appears in the captured image. A detection unit for detecting whether the target has exited from the captured image, and when the detection unit detects the appearance of the monitoring target, the information at that time is recorded as monitoring start information, and the target exits. Recording control means for recording the information at that time as the monitoring end information when detected, and extracting and reproducing a captured image within a range indicated by the monitoring start information and the monitoring end information recorded in the recording means. Playback control means for outputting.
Further, the present invention provides a computer with a program for realizing the main functions described in the first aspect of the present invention (the eighth aspect of the present invention).
[0007]
Therefore, the invention according to claims 1 and 8 detects whether the monitoring target has appeared or has left in the captured image obtained by capturing the moving object as the monitoring target, and when the appearance of the monitoring target has been detected, The monitoring start information is recorded as the information at that time, and when the exit is detected, the monitoring end information is recorded as the information at that time, and when the captured image is reproduced, the monitoring start information and the monitoring end information indicate this. Since the captured images within the area to be monitored are extracted and played back and output, only the part where the surveillance target is shown can be played back from the vast amount of captured images, and suspiciousness is accompanied by the efficiency of the playback work It is possible to reliably and quickly monitor the behavior of persons and the like.
[0008]
The invention described in claim 1 may be as follows.
At the time of entrance of the monitoring target, a storage unit is provided for storing feature information of the target obtained by analyzing a captured image of the target, and the detection unit includes the following in a captured image captured after entry. When it is detected that a target having the stored feature information is included, the appearance of the target is detected (the invention according to claim 2).
Therefore, according to the second aspect of the present invention, in addition to having the same effect as the first aspect of the invention, when entering the surveillance target, the characteristic information of the target is analyzed based on the captured image of the target. If the target with the feature information is included in the captured image taken after the entrance, the appearance of the target is detected. It can be detected reliably.
In this case, when acquiring the characteristic information of the monitoring target, the characteristic information may be acquired based on each captured image of the target captured from a plurality of directions.
(The invention according to claim 3), the appearance of the target can be detected more reliably.
[0009]
The detecting means, when detecting the appearance of the monitoring target, adds a mark to the position of the target in the captured image, and the target exits based on the position of the mark that moves following the movement of the target. Is detected (the invention according to claim 4).
Therefore, according to the fourth aspect of the present invention, in addition to having the same effect as the first aspect of the present invention, when detecting the appearance of a monitoring target, a mark is added to the target position in the captured image, and Since the target is detected based on the position of the mark that moves following the movement of the target, the target can be easily tracked and monitored.
[0010]
A plurality of surveillance cameras for photographing the moving object as a surveillance target, wherein the detecting means determines the appearance and retreat of the surveillance target for each surveillance camera based on each captured image of the same target photographed by the plurality of surveillance cameras The recording control means records the monitoring start information and the monitoring end information according to the appearance and exit of the monitoring target detected for each monitoring camera, and the reproduction control means corresponds to each monitoring camera. Each captured image of the same target extracted for each surveillance camera is reproduced and output based on the attached surveillance start information and surveillance end information.
Therefore, according to the fifth aspect of the invention, in addition to having the same effects as the first aspect of the invention, the appearance and appearance of the surveillance target can be determined based on each captured image of the same target captured by a plurality of surveillance cameras. Exit is detected for each monitoring camera, monitoring start information and monitoring end information are recorded for each monitoring camera, and extraction is performed for each monitoring camera based on the monitoring start information and monitoring end information associated with each monitoring camera. Since each captured image of the same target is reproduced and output, three-dimensional (three-dimensional) monitoring can be performed by monitoring the same target with a plurality of monitoring cameras, and the movement of the target can be further improved. It can be surely grasped.
[0011]
Designation means for arbitrarily designating the reproduction condition of the photographed image, and search means for searching the photographed image for a target corresponding to the reproduction condition specified by the specification means, wherein the reproduction control means The captured image within the range indicated by the monitoring start information and the monitoring end information associated with the target searched by the means is extracted and reproduced and output (the invention according to claim 6).
Therefore, according to the sixth aspect of the invention, in addition to having the same effect as the first aspect of the invention, the reproduction condition of the photographed image is arbitrarily specified, and the target corresponding to the specified condition is supported. Since the captured images within the range indicated by the attached monitoring start information and monitoring end information are extracted and reproduced and output, a desired target image can be selected from the captured images in which a large number of targets have been captured. It can be played arbitrarily.
[0012]
Monitoring start information and monitoring end information, which are information when the monitoring target appears and exit, are time information at that time, physical position information on a recording medium for sequentially recording captured images, and a shooting period from the start to end of shooting. The information may be any one of the numerical information counted at a fixed timing in the above (invention according to claim 7).
[0013]
BEST MODE FOR CARRYING OUT THE INVENTION
An embodiment of the present invention will be described below with reference to FIGS.
FIG. 1 is a block diagram showing the overall configuration of a monitoring system according to this embodiment.
This monitoring system is a local communication system (LAN system) built in a facility such as a company or a factory, and monitors the behavior of a person by analyzing a captured image of a person (moving body) in the facility. When it is detected that a surveillance target (a person requiring attention described later) has appeared in the captured image, the information at that time is recorded as surveillance start information, and when the exit of the target is detected, the Is recorded as monitoring end information, and at the time of image reproduction, a captured image within a range indicated by the monitoring start information and the monitoring end information is extracted and reproduced and output. It has a configuration in which an entrance / exit management system 1, an in-facility monitoring system 2, a search system 3, and a security system 4, which are subsystems, are connected via a local communication network 5. .
[0014]
The entrance / exit management system 1 is a management system having a data processing device that manages persons entering and exiting the facility as a core by analyzing images captured by the entrance / exit camera group 11 and includes a registered image described later. It has a file 12, a caution registered person ID memory 13, an entrance / exit management table 14, and an entrance image file 15.
The in-facility monitoring system 2 is a management system having a data processing device that performs a person monitoring by analyzing images captured by a plurality of monitoring monitor cameras 21 as a core, and a monitor log database (DB) described later. ) 22, and an abstracted image file 23. Here, each captured image captured by the monitoring monitor camera 21 is recorded and stored in the storage medium 6 for each corresponding camera. The storage medium 6 is a removable storage medium such as a CD-ROM, a DVD, or the like, and is provided in the monitoring monitor camera 21 corresponding to one body.
[0015]
The search system 3 is based on a data processing device for searching and reproducing and outputting a desired image from a storage medium 6 corresponding to each camera, and stores an image corresponding to an arbitrarily designated reproduction condition in each storage medium 6. Search from inside and play back. In this case, an arbitrary person can be set as a reproduction condition, or an arbitrary time zone can be specified as a reproduction condition. When a person is specified as a reproduction condition, it is specified from a storage medium 6 corresponding to each camera. If the time zone is specified as the playback condition, the image captured within the specified time zone is extracted from the storage medium 6 corresponding to each camera. Playback output.
[0016]
Further, a display device for monitoring is provided on the search system 3 side corresponding to each monitoring monitor camera 21, and an image captured by the monitoring monitor camera 21 is output to the corresponding monitor display device. Is done. Here, when a monitoring target (person in need of attention) is photographed by a plurality of monitoring monitor cameras 21 at the same time, the behavior of the person can be simultaneously confirmed on a plurality of monitors. I have. The search system 3 can access the entrance / exit management table 14, the entrance image file 15, and the monitor log database 22 of the in-facility monitoring system 2 via the network.
The security system 4 is a management system constructed in a security room.
[0017]
FIG. 2 is a diagram conceptually showing a layout of entrances and exits of a facility and cameras installed in the facility.
The entrance / exit camera group 11 photographs the entrance / exit from the front, back, left and right by four cameras installed at the entrance of the facility. In the figure, each arrow in the circled part indicates the entrance / exit. This is a photographing direction indicating that photographing is performed from before, after, right and left, and when entering and leaving, four cameras are used to photograph the visitors and the exiting persons.
The monitoring monitor cameras 21 are installed at various places in the facility so that the entire inside of the facility can be photographed. In the figure, A, B, C, and D are the monitoring monitor cameras 21 installed at the various places. The in-facility monitoring system 2 detects whether a monitoring target (person in need of attention) has appeared or has left in an image captured by any of the monitoring camera 21 for monitoring.
[0018]
FIG. 3A is a diagram for explaining the registered image file 12 and the caution required registered person ID memory 13 provided on the entrance / exit management system 1 side.
The registered image file 12 stores a face image of a person registered in advance as a person requiring attention in a one-person, one-file format, and a person ID for identifying the person is added to the registered image file 12. Have been. The person requiring attention includes, for example, a person who has committed wrongdoing or a person who has performed suspicious behavior in the past, as well as a trader. The face image of the person requiring caution is captured in advance by the entrance / exit camera group 11, and the caution registered person ID memory 13 is a memory that stores and manages a person ID for identifying the person requiring caution in a list format. .
[0019]
FIG. 3B is a diagram for explaining the entrance / exit management table 14 and the entrance image file 15 provided on the entrance / exit management system 1 side.
The entry / exit management table 14 stores and manages information on persons who need to enter and exit within a predetermined period (for example, on a daily basis). For each person requiring attention, the "person ID", "entrance time", " Each item of “exit time” is stored.
The “person ID” is obtained by analyzing a photographed image taken by the entrance / exit camera group 11 and obtaining a “person ID” obtained from the registered image file 12 when a person heading into the facility corresponds to a person requiring attention. It is. The “entrance time” indicates the entry time when the person requiring attention enters from the entrance of the facility. At this time, the front, rear, left, and right shot images taken by the entrance / exit camera group 11 are recorded as the entry image file 15. Is done. “Exit time” indicates the exit time when the user exits from the entrance of the facility.
The entrance image file 15 is a file that stores each of the front, rear, left, and right photographed images corresponding to the “person ID”.
[0020]
FIG. 4A is a diagram showing the contents of the monitor log database 22 provided on the in-facility monitoring system 2 side.
The monitor log database 22 is provided for each monitoring monitor camera 21, and the in-facility monitoring system 2 monitors a person in need of caution entering the facility with a plurality of monitoring monitor cameras 21. Information when a surveillance target (a person requiring attention) appears in an image photographed by the surveillance monitor camera 21 and information when the target leaves the target are recorded in a monitor log database 22 corresponding to the camera. ing. Each of the monitoring records constituting the monitor log database 22 is configured to include items of “person ID”, “mark No”, “start time”, and “end time”.
[0021]
The "person ID" is transmitted from the entrance / exit management system 1 as information for identifying the person of interest when the entrance / exit management system 1 recognizes that the person of interest has entered. When the in-facility monitoring system 2 detects that this person of interest needs to appear in an image captured by any of the monitoring camera 21 for monitoring, it identifies the person of interest as a monitoring target, The "person ID" is used as information for identifying the target, and a monitoring record including the "person ID" is newly generated and additionally registered in the monitor log database 22.
[0022]
“Mark No” is a mark added to the target position in the captured image when it is detected that a monitoring target appears in a captured image captured by any of the monitoring monitor cameras 21. This is information for identification. In this case, when detecting the appearance of the monitoring target, the in-facility monitoring system 2 adds a mark to the position of the target in the captured image as shown in FIG. The mark is made to follow the movement of the target, and the “mark No.” is information for identifying this marked target.
“Start time” is monitoring start information (appearance time) stored as information when the appearance of the monitoring target is detected, and “end time” is stored as information when detection of the exit of the target is detected. This is monitoring end information (exit time).
[0023]
FIG. 4B is a diagram for explaining the abstracted image file 23 provided on the in-facility monitoring system 2 side.
This abstracted image file 23 is used to identify whether or not a surveillance target (a person requiring attention) is included in an image photographed by the viewing monitor camera 21. Image. In this case, when recognizing that the person of interest has entered, the entrance and exit management system 1 abstracts the characteristics of the person of interest by analyzing the images taken of the person of interest from the left, right, front, and back. When the left, right, front and back abstract images are generated and transmitted to the in-facility monitoring system 2, the in-facility monitoring system 2 stores the “left and right” and “front and back” front and back abstract images for each person requiring attention. I am trying to do it.
[0024]
FIG. 6 is a block diagram showing basic components of the data processing device that forms the core of the entrance / exit management system 1.
Since the data processing device forming the in-facility monitoring system 2 and the data processing device forming the search system 3 also have the same components, the data processing device on the entrance / exit management system 1 will be described below. The description will be omitted for the data processing devices on the in-facility monitoring system 2 side and the search system 3 side.
The CPU 101 is a central processing unit that controls the overall operation of the data processing device according to the operating system and various application software in the storage device 102. The storage device 102 has a program storage area and a data storage area. In the program storage area, in addition to an operating system, various application programs are stored. System.
[0025]
The recording device 102 may have a configuration in which a removable storage medium such as a CD-ROM or a DVD can be mounted in addition to a fixed memory such as a hard disk. The programs and data in the storage device 102 are loaded into a RAM (for example, a static RAM) 103 as necessary, or the data in the RAM 103 is saved in the storage device 102. The RAM 103 has a program execution area and a work area. Further, the CPU 101 can directly access and use a program / data of another electronic device via the communication device 104, and can receive a download via the communication device 104. On the other hand, an input device 105 and a display device 106, which are input / output peripheral devices, are connected to the CPU 101 via a bus line, and the CPU 101 controls the operation according to an input / output program.
[0026]
Next, the operation concept of the behavior monitoring system in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, the functions described in these flowcharts are stored in the form of readable program codes, and sequentially execute operations according to the program codes. Further, the operation according to the above-described program code transmitted via the transmission medium can be sequentially performed. That is, an operation unique to this embodiment can be executed using a program / data externally supplied via a transmission medium in addition to a recording medium.
[0027]
FIG. 7 is a flowchart showing the operation of the entrance / exit management system 1 which is started when the power is turned on.
First, the entrance / exit management system 1 constantly acquires each captured image from the monitored entrance / exit camera group 11 and analyzes each of the captured images to determine whether or not there is a person moving in the direction coming toward the facility. Is checked (step A1). That is, the entrance / exit management system 1 checks whether the image of the person facing the front with respect to the camera pointing in the entrance direction (entrance direction) has gradually increased, and when the person has reached a predetermined size. , It is determined that there is a visitor. Now, when a visitor is detected, a front camera is designated for the visitor, and the face image of the person is enlarged and photographed (step A2). The entrance / exit management system 1 compares the registered image file 12 corresponding to the “person ID” with the face image of the visitor while reading “person ID” one by one from the caution registered person ID memory 13 ( At step A3), the visitor checks whether it is a registered person (attention required person) (step A4).
[0028]
If the visitor is a legitimate person such as an employee (NO in step A4), the process proceeds to step A9 without performing any special processing. Saves the photographed image (step A5). That is, the “person ID” is acquired from the registered image file 12 corresponding to the person requiring caution, and the front, rear, left, and right photographed images of the person requiring caution photographed by the entrance / exit camera group 11 are acquired. The “person ID” is added to the image and stored as the entrance image file 15. Then, a management record including the "person ID" and the "current time (entrance time)" is generated and additionally registered in the entrance / exit management table 14 (step A6). After extracting the features of the person from the above, and generating the front, rear, left and right abstract images (step A7), each of the abstract images and the “person ID” is transmitted to the in-facility monitoring system 2 and A notification that the vehicle has entered is provided (step A8).
Thereafter, the process returns to the first step A1 to check whether or not there is an attendant. Hereinafter, each time the entry of a person requiring attention is detected, the above-described operation is repeated (steps A1 to A8).
[0029]
On the other hand, the entrance / exit management system 1 performs basically the same processing as at the time of entry when leaving the facility. That is, the entrance / exit management system 1 analyzes each captured image from the entrance / exit camera group 11 to check for the presence or absence of a person moving in the direction of leaving the facility (step A9). In this case, the entrance / exit management system 1 checks whether the image of the person facing the front with respect to the camera pointing in the exit direction (exit direction) has gradually increased, and when the person has reached a predetermined size, It is determined that there is a leaving party. Now, when the exiting person is detected, the front camera is designated for this exiting person, and the face image of the person is enlarged and photographed (step A10).
[0030]
Then, the entrance / exit management system 1 compares the registered image file 12 corresponding to the “person ID” with the face image of the exited person while reading out the “person ID” one by one from the caution registered person ID memory 13 ( In step A11), if the exited person corresponds to a registered person (attention required person) (step A12), the “person ID” in the registered image file 12 is obtained (step A13), and The access management table 14 is accessed on the basis of this, and the current time (exit time) is set in the corresponding management record (step A13). Hereinafter, each time a leaving person is detected, the above operation is repeated (steps A9 to A14).
[0031]
FIG. 8 is a flowchart showing the operation of the in-facility monitoring system 2 which is started when the power is turned on, and the same operation is performed for each monitoring monitor camera 21. FIG. The operation of each unit will be described, and the operation of the in-facility monitoring system 2 will be described below with reference to FIG. 5 (A-1) to (A-3) show the monitor screens of the monitoring monitor camera A, and (B-1) to (B-4) show the monitoring screens of the monitoring monitor camera B.
The in-facility monitoring system 2 transmits and receives data to and from the entrance / exit management system 1, and when the entrance / exit management system 1 detects the entry of a person of interest, the “abstracted image” is displayed together with the “abstracted image”. When the "person ID" is transmitted from the entrance / exit management system 1, it is received and temporarily stored in the work area.
[0032]
First, the in-facility monitoring system 2 acquires a captured image from the monitoring monitor camera 21 that is constantly monitoring, analyzes the monitor image, checks for a change in the image (step B1), and detects an image change. In this case, it is checked whether the changed image is the above-mentioned marked image (step B2). Now, for example, as shown in FIG. 5 (A-1), when an image with a mark is detected on the monitor screen of the monitor camera A for monitoring, the change position (change amount and change direction) of the image in the monitor screen is detected. ) Is detected and the mark display position is moved in accordance with the change position, so that the mark follows the image movement as shown in FIG. 5A-2 (step B3).
[0033]
In this state, the position of the mark in the monitor screen is tracked and monitored, and it is checked whether or not it has deviated from the monitor screen (step B4). If the mark is present on the monitor screen, the process returns to the first step B1 to follow the mark according to the image movement. However, as shown in FIG. (Step B4), the monitor log database 22 is accessed based on the "mark No.", "end time (current time)" is set in the corresponding monitor record, and "mark No." Is erased (step B5), the process returns to the first step B1, and the above operation is repeated thereafter.
[0034]
If it is detected on the monitor screen of the monitoring monitor camera B that the image is not a marked image (step B2), it is determined whether a person image (new image) newly appearing on the monitor due to the movement of the person. Is checked (step B6), and if it is not a new image, the process returns to the first step B1, but as shown in FIG. 5B-3, when a new image appears on the monitor with the movement of the person. Reads out the above-mentioned “abstracted image” received and temporarily stored from the entrance / exit management system 1, and compares the characteristics of the “abstracted image” with the current “new image” (step B7). It is determined whether or not they are the same person (step B8).
[0035]
Here, if it is not the same person, the process returns to the first step B1, but if it is the same person, in other words, if the person requiring attention appears on the monitor screen, it is shown in FIG. 5 (B-4). In this way, a mark is given to the target image (person-at-care image), and a “mark No.” is newly generated (step B9). Then, the above-mentioned "person ID" temporarily stored corresponding to the "abstract image" is read out, and the "person ID", "mark No", "start time (current time at which the person requiring attention appears)" Is generated and additionally registered in the monitor log database 22 (step B10).
[0036]
FIG. 9 is a flowchart showing the operation of the search system 3 started to be executed when the power is turned on.
First, the search system 3 displays a search menu screen when the power is turned on (step C1). This search menu screen has menu items of “1: time search” and “2: person search”, and after any one of the menu items is selected and designated by the operator, an arbitrary search condition (reproduction condition) is set. When input (Step C2), the selected menu is determined (Step C3).
[0037]
Now, it is assumed that the menu item "2: person search" is selected and specified, and an arbitrary person is input and specified as the search condition (steps C1 to C3). In this case, the search condition is input, for example, as follows. That is, the search system 3 accesses the monitor log database 22 of the in-facility monitoring system 2 and reads out each “person ID”, and then registers the registered image file of the entrance and exit management system 1 based on each “person ID”. 12, the corresponding person image is obtained and displayed in a list. When a desired person image is selected and designated from the list screen, a "person ID" corresponding to the designated image is obtained, and the "person ID" is determined as the input and designated search condition.
[0038]
When the search condition is input and designated by this, each monitor log database 22 corresponding to the monitoring monitor camera 21 is accessed based on the input “person ID”, and the monitor record corresponding to “person ID” is stored in the camera. It is read every time (step C11). After obtaining the “start time” and “end time” from the monitor record read out for each monitoring monitor camera 21, the image within the range indicated by the “start time” and “end time” is to be reproduced. Is extracted from the storage medium 6 corresponding to each camera and reproduced and output. At that time, the recording time is synchronized for each monitor display device corresponding to each camera and the monitor is reproduced (step C10). In other words, the contents of the corresponding recording medium 6 are reproduced and displayed on the plurality of monitor display devices. At this time, the contents within the range from “start time” to “end time” acquired from the monitor record corresponding to the camera are displayed. By reading the captured image from each recording medium 6 in synchronization with the progress of time and simultaneously displaying the captured image simultaneously, when the monitoring target is simultaneously captured by a plurality of monitoring monitor cameras 21, the behavior of the person is monitored. Simultaneous confirmation can be made by displaying a plurality of monitors.
[0039]
On the other hand, when the menu item of “1: time search” is selected and specified, and an arbitrary time is input and specified as the search condition (steps C1 to C3), the monitoring target at the facility at the specified time is determined. To search, access the entry / exit management table 14 of the entrance / exit management system 1 side, and refer to the “entrance time” and “exit time” to identify the person who was in the facility within the designated time, The "person ID" is extracted (step C4). Then, the registered image file 12 is accessed based on the "person ID", and the corresponding registered images are read out and displayed as a list (step C5). The presence or absence of selection of a person for specifying a desired person from the list display of the registered images is received (step C6), and it is determined whether the person is specified (step C7).
[0040]
If an arbitrary person is selected from the list of registered images and the person to be searched is specified (YES in step C7), all monitors corresponding to the corresponding "person ID" are designated within the designated time. The record is read (step C8). That is, the “person ID” of the specified person is acquired, and each monitor log database 22 corresponding to the monitoring camera 21 is accessed based on the “person ID”, and the monitor record corresponding to the “person ID” is stored in the camera. Read each time. Then, for each monitor display device corresponding to each camera, the recording time is synchronized and reproduced on the monitor (step C10).
[0041]
If the person to be searched is not specified (NO in step C7), the “person ID” is obtained for each person who was at the facility at the designated time, and the monitoring monitor camera is obtained based on the “person ID”. After accessing each of the monitor log databases 22 corresponding to 21 and reading out the monitor record corresponding to the "person ID" for each camera (step C9), the recording time is synchronized for each monitor display device corresponding to each camera. Monitor playback is performed (step C10), and the playback operation in this case is sequentially repeated for each person at the facility at the designated time.
[0042]
As described above, the surveillance system in this embodiment includes the entrance / exit management system 1, the in-facility monitoring system 2, the search system 3, and the like. Detects whether the monitoring target has appeared or exited in the image, and when the appearance of the monitoring target is detected, records `` start time '' as monitoring start information at that time, and when exit is detected Records the “end time” in the monitor log database 22 as the monitoring end information at that time, and when the captured image is reproduced, the search system 3 sets “start time” and “end time” in the monitor log database 22. Since the captured images within the range indicated by are extracted and reproduced and output, the surveillance target can be captured from a huge number of captured images. Only portions have a can play, it is possible to perform reliably and quickly activity monitoring such as a suspicious person with the efficiency of the regeneration process.
[0043]
The entrance / exit management system 1 analyzes the characteristic information based on the captured image of the target and generates an abstracted image at the time of entry of the monitoring target, which is a person requiring caution, and transmits the abstracted image to the in-facility monitoring system 2. The in-facility monitoring system 2 saves this as an abstracted image file 23, and if a target image having the feature information is included in a captured image captured after entering, the appearance of the target is determined. Since the detection is performed, the appearance of the target can be reliably detected by the feature comparison.
In this case, the entrance / exit management system 1 generates the abstracted image based on each photographed image of the person photographed from left, right, front and rear, so that the appearance of the target is more reliably detected. be able to.
[0044]
In this case, when detecting the appearance of the monitoring target in the monitor screen, the in-facility monitoring system 2 adds a mark to the target position in the monitor screen and moves the mark following the movement of the target. Since the target is detected from the monitor screen based on the position of the mark, the target can be tracked and monitored only by tracking the mark, and the monitoring can be easily performed. Become.
[0045]
In addition, the appearance and the exit of the monitoring target are detected for each camera based on each captured image of the same target captured by the plurality of monitoring monitor cameras 21, and the “start time” is stored in the monitor log database 22 corresponding to the camera. And the “end time” are recorded for each camera, and the captured images of the same target extracted for each camera are reproduced and output based on the contents of the monitor log database 22 corresponding to the camera. By monitoring the same target by the camera, stereoscopic (three-dimensional) monitoring becomes possible, and the movement of the target can be grasped more reliably.
[0046]
The retrieval system 3 extracts and reproduces and outputs a captured image corresponding to the specified condition by arbitrarily specifying a search condition of the captured image. Can reproduce and output a desired target image arbitrarily. In this case, an arbitrary person can be used as a search condition, or an arbitrary time zone can be specified as a search condition. When a person is specified as a search condition, a specific person is specified from the storage media 6 corresponding to each camera. If a time zone is specified as a search condition, an image photographed within the specified time zone is extracted from the storage medium 6 corresponding to each camera and played back. Can be output.
[0047]
In the above-described embodiment, the “start time” and the “end time” are recorded as information when the monitoring target appears and when the monitoring target exits. However, the information is not limited to the time information. The physical position information (address value) on the recording medium to be recorded may be recorded as monitoring start information and monitoring end information, and a numerical value counted at a certain timing during a photographing period from the start to the end of photographing. Information (counter value) may be recorded as monitoring start information and monitoring end information.
[0048]
In the above-described embodiment, the person requiring attention is set as the monitoring target. However, the monitoring target is not limited to the person.For example, a vehicle in a facility may be set as the monitoring target, and it is monitored whether the vehicle is parked in a proper parking space. May be. The monitoring target is not limited to the facility, but may be a campus such as an amusement park, a zoo, or a theme park.
[0049]
On the other hand, a recording medium (for example, a CD-ROM, a floppy disk, a RAM card, or the like) in which a program code for causing each of the above-described units to be executed may be provided to the computer.
That is, it is a recording medium having a program code that can be read by a computer, detects whether a monitoring target appears in a captured image captured using a moving object as a monitoring target, and removes the target from the captured image. Function to detect whether the target has been detected, and record the information at that time as monitoring start information when the appearance of the monitoring target is detected, and record the information at that time as monitoring end information when the exit of the target is detected And a computer readable recording medium storing a program for realizing a function of extracting and reproducing and outputting a captured image within a range indicated by the monitoring start information and the monitoring end information. It may be.
[0050]
【The invention's effect】
According to this invention (invention of claim 1), it is detected whether or not the monitoring target has appeared or exited in the captured image obtained by capturing the moving object as the monitoring target, and when the appearance of the monitoring target has been detected, Records the monitoring start information as the information at that time, and when the exit is detected, records the monitoring end information as the information at that time, and when the captured image is reproduced, the monitoring start information and the monitoring end information are recorded. The captured image within the range indicated by is extracted and reproduced and output, so only the part where the surveillance target is shown can be reproduced from the huge number of captured images, and with the efficiency of the reproduction work, Thus, it is possible to reliably and promptly monitor the behavior of the suspicious person.
[Brief description of the drawings]
FIG. 1 is a block diagram showing an overall configuration of a monitoring system.
FIG. 2 is a diagram conceptually showing a layout of entrances and exits of a facility and cameras installed in the facility.
3A is a diagram for explaining a registered image file 12 and a caution registered person ID memory 13 provided in the entrance / exit management system 1, and FIG. 3B is a diagram for explaining the entrance / exit management system 1; 3 is a diagram for explaining an entrance / exit management table 14 and an entrance image file 15 provided in FIG.
4A is a diagram showing the contents of a monitor log database 22 provided in the facility monitoring system 2; FIG. 4B is an abstracted image provided in the facility monitoring system 2; The figure for demonstrating the file 23.
5 (A-1) to (A-3) show monitor screens of the monitoring monitor camera A, and FIGS. (B-1) to (B-4) show monitor screens of the monitoring monitor camera B. FIG.
FIG. 6 is a block diagram showing basic components of a data processing device that forms the core of the entrance / exit management system 1.
FIG. 7 is a flowchart showing an operation of the entrance / exit management system 1 started to be executed when the power is turned on.
FIG. 8 is a flowchart showing the operation of one monitor camera on the in-facility monitoring system 2 side, which is started when the power is turned on.
FIG. 9 is a flowchart illustrating an operation of the search system 3 that is started when the power is turned on.
[Explanation of symbols]
1 entrance and exit management system
2 Facility monitoring system
3 search system
4 Security system
5 Private communication network
6 Camera compatible storage media
11 Entrance / exit camera group
12 Registered image file
13 Registered Person ID required
14 Entrance / exit management table
15 Admission image files
21 Monitoring camera for monitoring
22 Monitor log database
23 Abstract image files
101 CPU
102 storage device
104 Communication device
106 display device

Claims (8)

A surveillance system that extracts a surveillance target from a captured image photographed with a moving object as a surveillance target and reproduces and outputs the surveillance target,
Detecting means for detecting whether a monitoring target has appeared in the captured image and detecting whether the target has exited from the captured image;
Recording control means for recording information at that time as monitoring start information when the appearance of a monitoring target is detected by the detection means, and recording the information at that time as monitoring end information when leaving the target is detected. When,
Reproduction control means for extracting and reproducing and outputting a captured image within a range indicated by the monitoring start information and the monitoring end information recorded in the recording means;
A surveillance system comprising: At the time of entrance of the monitoring target, a storage unit is provided for storing feature information of the target obtained by analyzing a captured image of the target, and the detection unit includes the following in a captured image captured after entry. When detecting that a target having the stored feature information is included, detecting the appearance of the target,
The monitoring system according to claim 1, wherein: When acquiring the characteristic information of the monitoring target, acquire the characteristic information based on each captured image of the target captured from a plurality of directions,
3. The monitoring system according to claim 2, wherein The detecting means, when detecting the appearance of the monitoring target, adds a mark to the position of the target in the captured image, and the target exits based on the position of the mark that moves following the movement of the target. Detect
The monitoring system according to claim 1, wherein: It has a plurality of surveillance cameras that shoot moving objects as surveillance targets,
The detection unit detects the appearance and the exit of the monitoring target for each monitoring camera based on each captured image of the same target captured by a plurality of monitoring cameras, and the recording control unit detects the appearance and the leaving of the monitoring target for each monitoring camera. Record the monitoring start information and monitoring end information according to the appearance and exit of the monitoring target,
The reproduction control means reproduces and outputs each captured image of the same target extracted for each monitoring camera based on monitoring start information and monitoring end information associated with each monitoring camera,
The monitoring system according to claim 1, wherein: Designation means for arbitrarily designating reproduction conditions of the photographed image;
Search means for searching a captured image for a target corresponding to the reproduction condition designated by the designation means;
Wherein the playback control means extracts and reproduces and outputs a captured image within a range indicated by monitoring start information and monitoring end information associated with the target searched by the search means.
The monitoring system according to claim 1, wherein: Monitoring start information and monitoring end information, which are information when the monitoring target appears and exit, are time information at that time, physical position information on a recording medium for sequentially recording captured images, and a shooting period from the start to end of shooting. Is any of the numerical information counted at a certain timing in the
The monitoring system according to claim 1, wherein: Against the computer
A function of detecting whether a monitoring target has appeared in a captured image captured using a moving object as a monitoring target, and detecting whether the target has exited from the captured image,
When the appearance of the monitoring target is detected, the information at that time is recorded as monitoring start information, and when the exit of the target is detected, the information at that time is recorded as monitoring end information,
A function of extracting and reproducing and outputting a captured image within a range indicated by the monitoring start information and the monitoring end information;
The program to realize.

Images