JP2005250634A - Automatic monitoring method and device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an automatic monitoring method and device for detecting a suspicious person who intrudes into a monitor zone, and for issuing warning to the supervisor of a manned bureau, and for automatically tracing the suspicious person who has escaped out of the monitor zone. <P>SOLUTION: A monitor camera 111 and a sound collecting microphone 112 or the like are installed in one or more monitor zones 110, and when a video signal and voice signal detected from the monitor camera 111 and the sound collecting microphone 112 are transmitted through a network line 130, they are compared with a video and voice preliminarily registered in an automatic monitor system 140, and a suspicious person is detected based on the matched video signal and voice signal, and primary warning and secondary warning is respectively issued. Then, the image and voice are recorded and stored in an image recording device 144 and the voice recording device 145. Also, when the suspicious person escaps out of the monitor zone 110, the suspicious person is traced by a public monitor camera 120 installed outdoors. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an automatic monitoring method and apparatus, and in particular, receives a video signal and an audio signal by using a monitoring camera and a sound collecting microphone, analyzes the video signal and the audio signal, and monitors and detects a specific person (suspicious person). The present invention relates to an automatic monitoring method and apparatus.

  Surveillance cameras are used to prevent theft and crimes and to identify criminals in the event of a theft. The video signal (or image) taken by this surveillance camera is generally sent to a remote surveillance center, monitored by a supervisor, and / or recorded by recording means such as a magnetic tape, and stored for a certain period of time. Is.

  By monitoring the image captured by such a monitoring camera, it is not necessary to arrange a monitor for each monitored location, and it is also possible to monitor a plurality of monitored locations with a single monitor. Or economic. Furthermore, it becomes evidence by recording the image photographed with the surveillance camera. In addition, it is possible to automatically analyze the abnormality of the monitoring image as necessary and to issue an alarm when the abnormality occurs or to zoom in the monitoring camera and change the photographing angle.

  Prior art relating to surveillance using surveillance cameras is disclosed in several documents. A remote monitoring type video security system is disclosed in which the movement of a suspicious person at a monitored place in a remote place is monitored in real time and the sound is collected by a microphone and recorded in a digital recorder (see, for example, Patent Document 1). ). If the surveillance area is monitored with a surveillance camera and an intruder is detected, the image information of the intruder is checked against the image information of qualified personnel entering the surveillance area. A crime prevention monitoring system for reporting to a restraint organization is disclosed (for example, see Patent Document 2). Further, an automatic notification system is disclosed that includes a camera, a security sensor, and a fire sensor, and reports information to a security company via a telephone line as a still image or a frame-by-frame image when notification information is generated (for example, patents). Reference 3).

Japanese Patent Laid-Open No. 2002-245572 (pages 14-15, FIG. 1) JP-A-5-166090 (page 5-6, FIG. 1) Japanese Patent Laid-Open No. 1-263697 (page 2, FIG. 1)

  Since the conventional monitoring system as described above employs a method of detecting the movement of a person (object) by time sampling of an image, it only detects the movement of a person (object) in an unmanned area. However, it was impossible to specify a person (object). In addition, since the range in which the person (object) can be tracked is stopped in the monitoring area where the system is constructed, there is a problem that it is impossible to track over a wide area outside the monitoring area.

  The present invention has been made in view of the above-described problems in the conventional monitoring system, makes it possible to identify a suspicious person with a specific appearance or voice (word or word), etc., and to monitor a wide area via a network line. It is an object of the present invention to provide an automatic monitoring method and apparatus capable of controlling and controlling tracking over a wide area.

  In order to solve the above-described problems, the automatic monitoring method and apparatus according to the present invention employs the following characteristic configuration.

(1) In an automatic monitoring method for receiving a video signal and an audio signal from a monitoring camera and a sound collecting microphone provided in at least one monitoring area via a network line, and monitoring a suspicious person in the monitoring area,
An automatic monitoring method for collating the video signal and audio signal from the monitoring camera and the sound collecting microphone with video and audio input in advance, and determining the presence or absence of a suspicious person based on the collation result and generating an alarm .

  (2) The automatic monitoring method according to (1), wherein the alarm is generated when both the video signal from the monitoring camera and the audio signal from the sound collecting microphone coincide with the video and audio input in advance.

  (3) The automatic monitoring method according to (1), wherein a preliminary alarm is generated when only one of the video signal from the monitoring camera and the audio signal from the sound collecting microphone matches the video or audio input in advance.

  (4) When the video signal from the monitoring camera or the audio signal from the sound collection microphone matches the video or audio input in advance, the video signal or audio signal is recorded and saved, respectively. Method.

  (5) The automatic monitoring method according to any one of (1) to (4), wherein, when the suspicious person escapes from the monitoring area, the suspicious person is tracked by an external monitoring camera connected to the network line. .

  (6) A monitoring camera, a sound collecting microphone, a sensor for detecting a moving object and the monitoring camera, a sound collecting microphone and a switch for switching the sensor are provided in each of the plurality of monitoring areas, and the monitoring camera, the sound collecting microphone in the monitoring area, and The automatic monitoring device is configured such that the sensor is connected to the automatic monitoring system via the switch and the network line, and can be controlled by the automatic control device of the automatic monitoring system.

  (7) The automatic monitoring system analyzes and collates the video signal from the monitoring camera and the audio signal from the sound collecting microphone in the monitoring area with a specific video and audio inputted in advance, and the suspicious person (6) The automatic monitoring device according to (6) above.

  (8) The automatic monitoring system includes an image recording apparatus and an audio recording apparatus that record the video signal and the audio signal based on an analysis / collation result of the video signal from the monitoring camera and the audio signal from the sound collection microphone. The automatic monitoring device according to (6) or (7).

  (9) The automatic monitoring system is connected to a monitoring camera in the monitoring area and a public monitoring camera outside the monitoring area via the network line, and is configured to track and monitor the suspicious person over a wide area. (6) The automatic monitoring device according to (7) or (8).

  According to the automatic monitoring method and apparatus of the present invention, the following remarkable practical effects can be obtained. That is, it is possible to automatically detect and monitor a specific person (suspicious person) even in an unspecified number of manned areas. This is because the video signal from the surveillance camera and the audio signal from the sound collecting microphone are analyzed and collated with the video and audio input (registered) in advance to detect a suspicious person. In addition, the reliability of detection monitoring is greatly improved. The reason for this is that this alarm is generated based on both the video signal from the surveillance camera and the audio signal from the sound collecting microphone, and a preliminary alarm is generated for either the video signal or the audio signal, and the video signal and the audio signal are recorded and stored. Furthermore, this is because an image signal and an audio signal are transmitted together with an alarm.

  Hereinafter, the configuration and operation of a preferred embodiment of the automatic monitoring method and apparatus according to the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a block diagram showing the overall configuration of a preferred embodiment of an automatic monitoring apparatus according to the present invention. The automatic monitoring apparatus 100 includes a plurality of monitoring areas 110A and 110B, a plurality of outdoor monitoring cameras 120A and 120B, an unmanned automatic monitoring system 140, and a manned station 150. The monitoring areas 110A and 110B, the outdoor (or public) monitoring cameras 120A and 120B, and the unmanned automatic monitoring system 140 are interconnected by a network line 130 such as the Internet.

  In each monitoring area 110, a monitoring camera 111, a sound collecting microphone 112, a sensor 113, and a switch 114 are provided. The monitoring camera 111, the sound collecting microphone 112, and the sensor 113 are connected to the network line 130 via the control switch 114. Furthermore, not only the monitoring camera 111 in each monitoring area 110 but also a plurality of outdoor monitoring cameras 120 installed over a wide area outside the monitoring area are connected to the network line 130.

  An automatic monitoring system 140 is connected to the other side of the network line 130. The automatic monitoring system 140 includes an automatic control device 141, an image processing device 142, an audio processing device 143, an image recording device 144, an audio recording device 145, a camera control circuit 146, and an automatic notification device 147.

  The automatic control device 141 controls the entire system. That is, the automatic control device 141 includes a camera control circuit built in the automatic control device 141 in addition to the image processing device 142, the sound processing device 143, the image recording device 144, the sound recording device 145, and the automatic notification device 147. According to 146, the surveillance camera 111 and the outdoor surveillance camera 120 in the surveillance area 110 connected to the network line 130 are also controlled.

  The automatic notification device 147, the image recording device 144, and the voice recording device 145 in the unmanned automatic monitoring system 140 are connected to the manned station 150. In the manned station 150, an image monitor 151, an audio monitor 152, and a manual control device 153 are provided. The manned station 150 can receive a report from the above-described automatic monitoring system 140 and can monitor images and sounds from the monitoring area 110 and the outdoor monitoring camera 120 by the image monitor 151 and the sound monitor 152. Furthermore, it is possible to control the monitoring camera 111 in each monitoring area 110 by the manual control device 153 in the manned station 150.

  Next, the operation of the automatic monitoring apparatus 100 according to the preferred embodiment of the present invention shown in FIG. 1 will be described. This automatic monitoring device 100 is an embodiment in the case where the automatic monitoring device of the present invention is applied to a security system such as a store, but the present invention is of course not limited to this specific example.

  In the automatic monitoring apparatus 100 shown in FIG. 1, output video signals of the plurality of monitoring cameras 111 and the plurality of outdoor monitoring cameras 120 are input to the automatic control apparatus 141 of the automatic monitoring system 140 via the network line 130. The automatic control device 141 receives a video signal and outputs it to the image processing device 142, the image recording device 144, and the automatic notification device 147. The image processing apparatus 142 inputs or registers specific image information in advance, and performs image analysis or analysis of a video signal input from the monitoring camera 111 or the like. Specifically, it is an analysis of the appearance and belongings of a large number of unspecified persons. For example, in terms of appearance, it is wearing a “Balac” or “full-face helmet”, and in terms of belongings, it is a weapon such as a “knife” or “handgun”. The data of these specific patterns is input or registered in advance in the automatic monitoring device 140 and collated with the video signal from the monitoring camera 111 or the like. If they match as a result of the collation, a detection signal, that is, an alarm is generated from the image processing device 142 to the automatic control device 141.

  In addition, the output audio signal of the sound collection microphone 112 in each monitoring area 110 is also input to the automatic control device 141 via the network line 130 in the same manner as the video signal described above. Further, it is input from the automatic control device 141 to the voice processing device 143. The voice processing device 143 performs voice pattern recognition, and generates a detection signal or alarm to the automatic control device 141 when, for example, words such as “make money” or “money” are recognized or detected.

  The automatic control device 141 recognizes that there is a “suspicious person” based on the two types of detection signals (alarms) described above. However, the detection signal from the image processing device 142 is basically prioritized, and when it is received, the automatic notification device 147 is instructed to issue a primary alarm, and the detection signal from the audio processing device 143 is added. Is received, the automatic notification device 147 is instructed to issue a secondary alarm. Here, the primary alarm and the secondary alarm are distinguished from each other. The primary alarm is a preliminary alarm, and the secondary alarm is a meaning of the main alarm.

  The automatic control device 141 instructs the automatic notification device 147 and simultaneously instructs the image recording device 144 and the audio recording device 145 to record and store the image signal and the audio signal. Then, direction control, video switching, and zooming are instructed to the surveillance camera 111 that has detected the “suspicious person” and the outdoor surveillance camera 120 around it, and the “suspicious person” is automatically tracked. On the other hand, when only the detection signal from the audio processing device 143 is received, a signal is sent to the image recording device 144 and the audio recording device 145 so that only the image and audio are recorded without giving an instruction to the automatic notification device 147. And the direction control of the monitoring camera 111 is performed to prioritize the detection of “suspicious person”. As described above, it is possible to confirm “suspicious person” among a plurality of persons.

  On the other hand, upon receiving the instruction signal, the automatic notification device 147 sends an alarm indicating a suspicious person, a video signal, and an audio signal to the manned station 150. The manned station 150 has an image monitor 151 and an audio monitor 152, and can monitor the transmitted video signal and audio signal when an alarm is generated. Thereby, the reliability of the alarm is improved. In addition, the monitoring device 100 of the present invention is automatically monitored in a normal state, and the monitor only has to monitor the corresponding monitoring area only when an alarm is generated. Therefore, it is possible to monitor a plurality of areas with a small number of personnel. Become. Further, in the manned station 150, in addition to obtaining the recording information of the image recording device 144 and the audio recording device 145, various controls of each monitoring camera 111 can be performed.

  As described above, after detecting the “suspicious person”, the automatic control device 141 not only detects the monitoring camera 111 in the corresponding area (monitoring area 110) but also a plurality of outdoors (public) installed for security and the like. ) By controlling the surveillance camera 120 as well, even if the “suspicious person” escapes to the outdoors (outside the surveillance area), it has a function of tracking the “suspicious person”. In order to realize this, it is assumed that a large number of outdoor surveillance cameras 120 are installed at intervals that do not cause blind spots as much as possible. Even when the “suspicious person” uses a car or the like to escape, the image processing apparatus 142 can determine that the “suspicious person” has boarded if the state of boarding can be confirmed. Therefore, the type and number of the boarded vehicle are specified, and at the same time, the tracking target is changed from a person to a car. As described above, the restraint of the “suspicious person” is supported and facilitated.

  In addition to the above description, monitoring by the sensor 113 can be performed by setting the sensor 113 to “valid” in a time zone when there are no people such as at night. Even when an intruder is detected by the sensor 113, as in the case of the monitoring camera 111, the automatic control device 141 analyzes and records images and sounds, gives instructions for issuing an alarm, and controls the monitoring cameras 111 and 120. Is done. Further, when the monitoring area 110 is dark, the monitoring cameras 111 and 120 are controlled to be switched to the “night vision mode” using, for example, infrared rays or enhancing the imaging sensitivity.

  For privacy protection, it is possible to set the monitoring camera 111 and the sound collecting microphone 112 to “invalid” at any time by operating the manual control device 153 of the manned station 150 by the switch 114, for example. In this case, the monitoring apparatus 100 does not operate.

  Next, FIG. 2 is a flowchart for explaining the operation of the monitoring apparatus 100 according to the present invention described above. That is, one or more monitoring areas 110 are monitored (step S1). It is determined whether or not a specific (suspicious person) image has been detected by any of the monitoring cameras 111 in the monitoring area 110 (step S2). When the specific video is detected (step S2: YES), a primary alarm is generated and the image recording device 144 is operated (step S3). On the other hand, when the specific video is not detected (step S2: NO), the process returns to step S2, and normal monitoring is continued.

  Next, it is determined whether or not specific sound is detected by the sound collection microphone 112 in the monitoring area 110 where the specific video is detected (step S4). When the specific voice is not detected (step S4: NO), the process returns to step S4 and waits for the detection of the specific voice. When the specific voice is detected (step S4: YES), a secondary alarm is generated and the voice recording device 145 is operated (step S5). Then, it is determined whether or not the “suspicious person” has fled outside the monitoring area 110 (step S6). When the “suspicious person” does not escape outside the monitoring area 110 (step S6: NO), the monitoring in the monitoring area 110 is continued (step S7). On the other hand, when the “suspicious person” escapes outside the monitoring area 110 (step S6: YES), the outdoor monitoring camera 120 is operated to track the “suspicious person”. In order to track the “suspicious person” who has escaped outside the monitoring area 110, the outdoor monitoring camera 120 is controlled via the network line 130 by the automatic control device 140 of the automatic monitoring system 140, and the outdoor is also monitored via the network 130. The video signal from the monitoring camera 120 is received and recorded in the image recording device 144.

  The configuration and operation of the preferred embodiment of the automatic monitoring method and apparatus according to the present invention have been described in detail above. However, it should be noted that such examples are merely illustrative of the invention and do not limit the invention in any way. Those skilled in the art will readily understand that various modifications and changes can be made according to a specific application without departing from the gist of the present invention.

It is a block diagram which shows the whole structure of the suitable Example of the automatic monitoring apparatus by this invention. It is a flowchart explaining operation | movement of the automatic monitoring apparatus of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Automatic monitoring apparatus 110 Monitoring area 111 Monitoring camera 112 in monitoring area Sound collecting microphone 120 Outdoor (public) monitoring camera 130 Network line 140 Automatic monitoring system 141 Automatic control apparatus 142 Image processing apparatus 143 Audio processing apparatus 144 Image recording apparatus 145 Audio Recording device 146 Camera control circuit 147 Automatic notification device 150 Manned station

Claims (9)

In an automatic monitoring method for receiving a video signal and an audio signal from a monitoring camera and a sound collecting microphone provided in at least one monitoring area via a network line, and monitoring a person in the monitoring area,
The video signal and the audio signal from the monitoring camera and the sound collecting microphone are collated with video and audio that have been input in advance, and an alarm is generated by determining the presence or absence of a person based on the collation result. An automatic monitoring method characterized by that.   2. The automatic monitoring according to claim 1, wherein the alarm is generated when both a video signal from the monitoring camera and an audio signal from the sound collecting microphone coincide with video and audio input in advance. Method.   2. The automatic alarm according to claim 1, wherein a preliminary alarm is generated when only one of a video signal from the monitoring camera and an audio signal from the sound collection microphone matches a pre-input video or audio. Monitoring method.   2. The video signal or the audio signal is recorded and stored, respectively, when the video signal from the monitoring camera or the audio signal from the sound collecting microphone matches the video or audio input in advance. The monitoring method described.   5. The automatic monitoring method according to claim 1, wherein when the person escapes from the monitoring area, the person is tracked by an external monitoring camera connected to the network line.   A monitoring camera, a sound collecting microphone, a sensor for detecting a moving object and a switch for switching between the monitoring camera, the sound collecting microphone and the sensor in each of a plurality of monitoring areas, and the monitoring camera, the sound collecting microphone and the sensor in the monitoring area, An automatic monitoring device connected to an automatic monitoring system via the switch and a network line and configured to be controllable by an automatic control device of the automatic monitoring system.   The automatic monitoring system specifies a person by analyzing and collating a video signal from the monitoring camera and a sound signal from the sound collection microphone in the monitoring area with a specific video and sound input in advance. The automatic monitoring apparatus according to claim 6.   The automatic monitoring system includes an image recording apparatus and an audio recording apparatus that record the video signal and the audio signal based on an analysis / collation result of the video signal from the monitoring camera and the audio signal from the sound collecting microphone. The automatic monitoring device according to claim 6 or 7.   The automatic monitoring system is connected to a monitoring camera in the monitoring area and a public monitoring camera outside the monitoring area via the network line, and is configured to track and monitor the person over a wide area. The automatic monitoring apparatus according to claim 6, 7 or 8.

Images