JP4713950B2 - Monitoring device - Google Patents

Description

  The present invention relates to a security system that monitors a monitoring device connected to an imaging device, various sensors, and a threatening device that threatens an intruder from a remote monitoring center via a communication line. In particular, the present invention relates to a remote starter of a threatening device installed in a monitoring target from a monitoring center and a monitoring device that can automatically start the monitoring device independently.

  In recent years, a security system for monitoring an abnormality occurring in a monitoring target such as a house in a remote monitoring center has become widespread. In such a security system, various sensors (hereinafter simply referred to as “sensors”) such as door opening / closing detection sensors, human body detection sensors, glass breakage sensors, and wall breakage sensors installed in the monitoring target, and CCD cameras, etc. An imaging device is connected to a monitoring device, and when an abnormality occurs, an abnormality signal or image data is transmitted from the monitoring device to a remote monitoring center via a communication line. The monitoring device includes a card reader that reads a security card (such as a magnetic card or an IC card) in which predetermined data is recorded, and a monitoring set that monitors a monitoring target by a user operating the security card The setting is switched to the mode or the monitoring cancel mode that does not perform monitoring.

  The system described in Patent Document 1 further includes a smoke generating device that can intimidate an intruder by emitting a large amount of smoke, and suppresses criminal acts by activating the smoke generating device and intimidating the intruder. is doing. In this system, there are a case where the smoke generating device is manually activated remotely and a case where the monitoring device is automatically activated. The manual remote activation operation is as follows. When the sensor detects an intruder during the monitoring set mode, the image data photographed by the CCD camera is transmitted to a monitoring center device provided at a remote place. In the monitoring center, a monitor constantly monitors the display means to monitor whether there is an abnormality in the monitoring target. The monitor judges the situation based on the abnormality signal and image data received from the monitoring device, and operates the activation operation unit provided in the monitoring center as necessary to activate the smoke generating device.

  When the activation operation unit is operated, a remote activation signal for remotely activating the smoke generating device is transmitted to the monitoring device. When the monitoring device receives the remote activation signal, the monitoring device activates the smoke generating device. Thereby, smoke is ejected in the intrusion area, and the criminal act of the intruder can be prevented or suppressed. In this case, since the monitoring person confirms the status of the monitoring target from the image of the CCD camera and manually starts the smoke generating device, the smoke generating device can be started accurately and reliably.

Patent Document 1 also describes that the monitoring device independently activates the smoke generation device. When a specific sensor such as a glass breakage sensor or a wall breakage sensor that detects building destruction is detected by the monitoring device, the monitoring device independently activates the smoke generating device regardless of a remote activation signal from the monitoring center. As a result, the smoke generator can be activated without waiting for the time to connect the line to the monitoring center and transmit the image data, and the time for the monitor to confirm the image. It is possible to respond quickly.
JP 2004-171235 A

  As described above, the security system of Patent Document 1 includes a remote activation function that activates the smoke generator from the monitoring center after the monitoring person confirms the status of the monitoring target, and an automatic activation function that causes the monitoring apparatus to independently activate the smoke generator. It has.

  However, although the smoke generator by the remote activation function can be activated accurately and reliably, the image data is transmitted by connecting the line in order to enable the monitoring center to check the image at the monitoring center. I need time. Therefore, it is impossible to quickly cope with a crime aimed at a crime in a short time. On the other hand, the automatic activation function of the smoke generator by the monitoring device can deal with crime more quickly than the remote activation function, but it depends on the accuracy of the detection device such as the building destruction sensor. It is difficult to completely eliminate the possibility of erroneously recognizing a strong vibration or a sensor malfunction caused by the above factor as a building destruction and erroneously starting the smoke generator. The activation of the smoke generating device due to such a malfunction may cause a great inconvenience to the monitoring service provider. In particular, when the building to be monitored is an ATM booth or office, the erroneous activation of the smoke generator is likely to interfere with the business or business of the provider.

  The present invention has been made in view of such problems of the prior art, and can reduce the possibility of malfunction due to automatic activation of the monitoring device, and can be trusted to respond quickly to crimes. An object is to provide a highly reliable monitoring device.

The monitoring device according to the first embodiment of the present invention includes an imaging unit that images a monitoring area and transmits image data, a detection unit that detects an intruder into the monitoring area and transmits an abnormal signal, and an intruder. A monitoring device connected to a monitoring center device for transmitting a remote activation signal for activating the threatening means , via a communication line, and connected to the threatening means for threatening , the abnormality signal from the detection means When the image signal is received, it is determined whether or not the type of the abnormal signal is a specific abnormal signal that activates the threatening means, and the transmission of the image data received from the imaging means to the monitoring center device is performed. receiving a monitoring control unit, and the abnormality monitoring unit to be stored in the storage unit that has transmitted the image data when transmitting the image data by the monitoring control unit, the remote start signal from the monitoring center When, and wherein the determination by the monitoring control unit and the specific abnormal signal and the time it was transmitted image data is determined not to be stored in the storage means, the intimidating means when one of Activation control means for activating the image data, and when the abnormality monitoring means transmits the image data when the monitoring control section determines that the specific abnormality signal is present, the image data Is stored after determining whether the image data has been transmitted by the activation control means .

In this aspect, if it is stored that the image data has already been transmitted to the monitoring center device, the activation control means activates the threatening means even if the monitoring control unit makes a determination as to the specific abnormality signal that activates the threatening means. do not do. The timing for storing the start of transmission of the image data to the monitoring center apparatus may be any timing as long as the monitoring center apparatus can immediately confirm the state of the monitoring area with the image. For example, it is possible to start the transmission of the first image of the image data, or to receive a signal indicating that the monitoring center device has received the first image. is there. As a result, it is possible to suppress the risk of malfunction due to automatic activation when the monitoring center can immediately confirm the state of the monitoring area while maintaining quick response for quickly activating threatening means.

Monitoring device according to another aspect of the present invention, the abnormality monitoring unit, stopping the transmission of the image data, characterized by erasing the memory that was the transmission. In this aspect, the end time of prohibition of automatic activation is set to the time when transmission of image data is stopped. When the transmission of the image data is stopped, it takes time until the image can be confirmed again by the monitoring center device. Therefore, the prohibition of the automatic activation is canceled and the subsequent automatic activation can be performed.

Monitoring device according to another aspect of the present invention, the abnormality monitoring means, when said abnormal state based on the abnormal signal is restored, characterized by erasing the memory that was the transmission. In this aspect, the end time of the automatic start prohibition is set when the abnormal state based on the abnormal signal is recovered. When the abnormal state is recovered, it takes time until the image can be confirmed again at the monitoring center when the detection means detects an intruder, so that automatic startup after recovery can be performed. .

  The monitoring device according to another aspect of the present invention is characterized in that the detection unit is an image sensor that makes a determination by analyzing an image captured by the imaging unit and outputs the abnormal signal. In this aspect, the image sensor has an imaging function and also has an abnormality detection function for analyzing the captured image and detecting an intruder. Image analysis enables more advanced intrusion abnormality determination, so that the accuracy of the automatic activation function can be improved, and the risk of malfunction can be further reduced by integration with the automatic prohibition function.

  The monitoring apparatus according to another aspect of the present invention is characterized in that the image data is current state image data. In this aspect, automatic activation is prohibited only when transmission of the current state image data, which is the latest image of the intrusion site, has already started. In the image data, an image indicating a state before and after detection when an intruder is detected is stored, and the stored image data may be transmitted. Since the activation of the threatening means can be effective when the intruder is near the threatening means, it is automatically activated that the current state image data that can accurately grasp the current state of the site is transmitted. This is a prohibition condition.

  In the monitoring apparatus of the present invention, when the image data has already been sent to the monitoring center apparatus (may be included during transmission), automatic activation of the threatening means by the monitoring apparatus is prohibited, and the threatening means is temporarily activated. Even if a power abnormality signal is detected, the monitoring device does not activate threatening means. When the image data has already been transmitted to the monitoring center device, the monitoring center device can quickly check the status of the monitoring target based on the image data, so that the monitoring center device can quickly and accurately determine and deal with the situation. It becomes. For this reason, during this period, whether or not the threatening means is activated is left to the judgment of the monitoring person monitoring the monitoring center device. Therefore, the threatening means can be activated more accurately than the automatic activation, and erroneous activation can be prevented.

  A monitoring device according to the present invention will be described with reference to the drawings. FIG. 1 is a configuration block diagram showing an example of a security system 10 using the monitoring device 1 of the present invention. The monitoring device 1 is provided in a business office, building, warehouse, or the like to be monitored. The monitoring device 1 includes image sensors 2a to 2e, smoke generators 3a to 3d, an intrusion sensor 4 such as a magnet sensor and a heat ray sensor, a fire sensor 5 such as a heat detector and a smoke detector, and an emergency operated by a user in an emergency. Button 6 is connected. Also connected is a mode setting unit 7 having a card reader for setting a monitoring set mode for enabling monitoring of the image sensor 2 and the intrusion sensor 4 and a monitoring canceling mode for disabling monitoring of the image sensor 2 and the intrusion sensor 4. Has been. Each of the image sensors 2a to 2e in FIG. 1 includes an imaging unit and a detection unit that analyzes a captured image to detect an intruder, and outputs captured image data. When an error is detected, an abnormal signal is output.

  The smoke generating device 3 is one of threatening means against an intruder, and ejects a large amount of smoky substances to threaten the intruder and block the field of view, thereby losing criminal intention or disabling action. As threatening means, it is also possible to install other physical threatening devices such as voice or light threatening devices, water, paint, special paints and the like.

  The image sensor 2 and the smoke generator 3 are installed in association with each monitoring area such as a vault or a CD / ATM corner, which are a plurality of important points in the monitoring target. In the figure, it is shown that the image sensor 2 and the smoke generation device 3 within the broken line frame are installed in association with each other. As shown in the figure, the relationship between the “image sensor 2 and the smoke generator 3” does not necessarily have to be installed in a one-to-one correspondence, but one-to-one (image sensor 2a: smoke generator 3a), multiple-to-one (image Sensors 2b, 2c: smoke generator 3b), one-to-multiple (image sensor 2d: smoke generator 3c, 3d)), and 1: 0 (image sensor 2e: no smoke generator) may be installed in association with each other.

  As a specific installation example of the image sensor 2 and the smoke generation device 3, for example, when the image sensor 2 and the smoke generation device 3 are installed in a one-to-two correspondence in the same room, an important monitoring object (such as a safe) is installed. For example, one image sensor 2 to be accommodated within the photographing range, one on the ceiling above the monitoring object and one near the monitoring object, two smoke generators 3 in total are provided. If the image sensor 2 and the smoke generation device 3 are installed in a one-to-multiple relationship, the smoke generation device 3 can be activated a plurality of times for important monitoring objects, and the crime prevention effect can be enhanced. Further, when a wide range that can be monitored by one image sensor 2 can be covered, it is possible to provide a plurality of smoke generating devices 3 in association with one image sensor 2.

  The monitoring device 1 is further connected to a remote image monitoring center 30 via a communication line 20 such as an ISDN line. A monitoring center device 31 is installed in the image monitoring center 30, and the monitoring center device 31 includes display means and operation means (not shown). The image monitoring center 30 is connected to the monitoring devices 1 installed on a plurality of monitoring targets via the communication line 20, and the status of each monitoring target can be displayed on the display means of the monitoring center device 31. The monitoring person monitors abnormal signals and images from a plurality of monitoring targets by the display means, and if necessary, operates the operation means to generate smoke generated from the monitoring center device 31 on the monitoring target. The device 3 can be activated. As a result of checking the image, when it is determined that there is no abnormality or when the processing for dealing with the abnormality is completed, the monitoring person transmits a recovery signal from the monitoring center device 31 to the monitoring device 1, and the abnormality of the monitoring device 1 is detected. The state can be reset and the monitoring device 1 can be restored to the monitoring set mode that is not in an abnormal state.

(Image sensor)
The image sensor 2 includes a CCD or MOS type (CIS or the like) imaging unit and a detection unit that detects an intruder by analyzing an image captured by the imaging unit. The detection means can analyze the captured image and determine the accuracy of human invasion step by step. In this embodiment, the possibility of intrusion (accuracy) is determined at three levels, and the first abnormality signal (hereinafter referred to as “human detection” signal) and the second abnormality signal (hereinafter referred to as “human detection” signals) are ordered in descending order of accuracy. , Referred to as “intrusion confirmation 1” signal) and a third abnormal signal (hereinafter referred to as “intrusion confirmation 2” signal). The “human detection” signal is a state in which an abnormality has occurred due to an intrusion of a person, but the accuracy is still low. The “intrusion confirmation 1” signal is output when the possibility of human intrusion is higher than the “person detection” signal, but there is still some concern about certainty. The “intrusion confirmation 2” signal is an abnormal signal at the highest level that is judged to have entered a person with extremely high accuracy. In the example of this specification, the “invasion confirmation 2” signal is designated as an abnormal signal that activates the smoke generating device 3. A specific example of an image sensor that accurately determines the possibility of human invasion by analyzing image data will be described in more detail later.

  Further, the image sensor 2 transmits the image data captured by the imaging unit to the monitoring device 1 in response to a request from the monitoring device 1. The image data to be transmitted includes current state image data and accumulated image data. The current state image data is image data for transmitting the latest image captured by the imaging unit in real time, and the accumulated image data is images before and after the detection unit detects the intruder. For example, each image sensor 2 stores, as accumulated image data, a total of 10 image frames when the intruder is detected, 2 image frames immediately before it, and 7 image frames immediately after that as a set. In response to the stored image transmission request, 10 image frames are transmitted to the monitoring apparatus 1.

(Transmission of image data and abnormal signal by image sensor)
The operation procedure of each image sensor 2 in response to a request from the monitoring device 1 will be described with reference to FIG. FIG. 2 is a flowchart illustrating an example of a communication operation processing procedure with the monitoring device 1. The image sensor 2 transmits information corresponding to the request to the monitoring device 1 in response to a request signal from the monitoring device 1. When each image sensor 2 confirms whether the request signal of the monitoring device 1 is a request addressed to itself, and determines that the request signal is addressed to itself (S101; Yes), the received request signal is the stored image data. It is determined whether it is a request signal (S102). If the request signal is stored image data (S103; Yes), the image sensor 2 transmits the stored stored image data to the monitoring device 1 (S109). When that is not right (S102; No), it progresses to process S103. In step S103, it is determined whether the received request signal is a request signal for the current state image data. If it is a request signal for the current state image data (S103; Yes), the image sensor 2 transmits the current state image data captured by the imaging means to the monitoring device 1 (S104).

  If it is not a request signal for the current state image data (S103; No), it is confirmed whether or not it is a request signal for the current status report (S105). If it is not a request signal for the current status report (S105; No), the process goes to step S110. move on. In step S110, processing according to the received request signal is performed. For example, in the case of a stored image deletion request, the stored image data held is canceled and returned to a normal circular storage operation. Alternatively, when a signal for ending the request for the current state image is received, transmission of the current state image is stopped.

  If it is a status report request signal (S105; Yes), it is checked whether there is an abnormal signal held by the image sensor 2 (S106), and if held, the abnormal signal held. Is transmitted to the monitoring apparatus 1 (S107). When the abnormal signal is not held (S106; No), a normal signal is transmitted to the monitoring device 1 (S108).

(Configuration of monitoring device)
FIG. 3 is a functional block diagram of the monitoring device 1 according to the embodiment of the present invention. The monitoring apparatus 1 includes a main control unit 100, a sensor I / F (interface) 101, a communication I / F 102, an image sensor I / F 105, a display unit 103, a storage unit 104, and an operation unit 106. The main control unit 100 includes a CPU or MPU, a control program and control data stored in the storage unit 104, and includes an abnormality monitoring unit 110 and an activation control unit 120.

  The sensor I / F 101 is an interface for inputting signals from the intrusion sensor 4, the fire sensor 5, and the emergency button 6 to the main control unit 100. The communication I / F 102 receives a signal from the monitoring center device 31 of the image monitoring center 30 via the communication line 20 and inputs the signal to the main control device 100, and receives various abnormal signals and image data from the image sensor 2. , An interface that outputs to the monitoring center device 31 via the communication line 20. The image sensor 1 / F 105 is an interface that inputs an abnormality signal and image data from the image sensor 2 to the abnormality monitoring unit 110 and outputs a request signal from the abnormality monitoring unit 110 to the image sensor 2.

  The storage unit 104 stores a control program and control data for operating the main control unit 100, and also includes a monitoring mode set by the mode setting unit 7, abnormal states of various sensors, and automatic activation by the monitoring device 1. An image transmission flag to the monitoring center device 31 for determining whether to prohibit or not, a correspondence table between the image sensor 2 and the smoke generating device 3, and the like are stored. It is also used as a temporary storage area for images received from the image sensor 2.

  The display means 103 is a liquid crystal display that displays the details of the abnormality that has occurred in the monitoring target, the display of the monitoring mode, the setting operation content by the mode setting unit 7 and the like. The operation unit 106 is a switch such as a button for deleting the abnormal state flag, the image transmission flag, and the like stored in the storage unit 104 and restoring the abnormal state of the monitoring device 1.

(Configuration of main controller)
The abnormality monitoring unit 110 and the activation control unit 120 of the main control unit 100 will be described in more detail. The abnormality monitoring unit 110 of the main control unit 100 monitors the abnormality to be monitored, and executes a response process for the abnormality that has occurred if an abnormality has occurred. The abnormality monitoring unit 110 includes a communication control unit 111 and a monitoring control unit 112. The communication control unit 111 controls data communication with the monitoring center device 31 through the communication line 20 based on the control of the monitoring control unit 112. The monitoring control unit 112 is programmed to sequentially check the state of each image sensor 2 by polling, determine the type of abnormality when an abnormality occurs, and take a corresponding process according to the determination.

  The activation control unit 120 controls activation of the smoke generating device 3. The activation control unit 120 includes an activation determination unit 121 and an activation unit 122, and the activation determination unit 121 is based on the image transmission flag stored in the storage unit 104 when the “intrusion confirmation 2” signal is received. Then, it is determined whether or not the smoke generating device 3 is activated. The activation determination unit 121 permits or prohibits the output of the automatic activation signal based on the determination result. The activation unit 122 activates the smoke generating device 3 based on the automatic activation signal output from the activation determination unit 121 or the remote activation signal transmitted from the monitoring center device 31.

(Processing procedure of monitoring device when abnormal signal is received)
An example of a processing procedure of the main control unit 100 of the monitoring apparatus 1 when an abnormal signal is received from the image sensor 2 will be described with reference to FIG.

  When the image sensor 2 detects an intruder, the abnormal signal corresponding to the abnormal state is transmitted to the monitoring device 1 in response to polling of the main control unit 100 of the monitoring device 1. When receiving the abnormal signal from the image sensor 2, the monitoring device 1 first checks whether or not the signal is the “human detection” signal at the lowest level (S201). In the case of a “person detection” signal (S201; Yes), a “person detection” signal is transmitted to the monitoring center apparatus 31 (S202), and a series of processes for transmitting accumulated image data is started (S203). . When the stored image transmission process is activated by this processing procedure, the transmission process of the stored image data is executed independently of the basic processing procedure. The same applies to the transmission processing of current state image data described later. Therefore, even during image transmission, polling to the image sensor and abnormal signal reception processing are sequentially executed in parallel. Further, when the image transmission process is executed and an image reception permission signal is received from the monitoring center device 31, the image transmission flag is set to “ON”. The timing for turning on the image transmission flag will be described in detail later.

  If it is not a “human detection” signal (S201; No), it is confirmed whether it is a “intrusion confirmation 1” signal at the next level (S204). When it is an “intrusion confirmation 1” signal (S204; Yes), an “intrusion confirmation 1” signal is transmitted to the monitoring center apparatus 31 (S205), and the transmission process of the current state image data is activated (S206). State image data is transmitted.

  If it is not the “intrusion confirmation 1” signal (S204; No), since the remaining is “intrusion confirmation 2”, the “intrusion confirmation 2” signal is transmitted to the monitoring center device 31 (S207). Next, it is confirmed whether or not the image transmission flag is currently OFF (S208). When the transmission process of accumulated image data or current state image data has already been started upon receipt of an abnormal signal and has proceeded to a predetermined level, the image transmission flag is “ON”, so that the smoke generating device 3 is started. The basic process is terminated (S208; No). If the image transmission flag is “ON”, it is considered that some image data has already been transmitted to the monitoring center device 31 and the image monitoring center can quickly cope with the abnormality. The automatic activation of the smoke generating device 3 by the device 1 is not performed.

  When the image flag is “OFF” (S208; Yes), since no image data has been transmitted to the image monitoring center 30 yet, in the case of an “intrusion confirmation 2” signal that is very likely to be an intruder. As long as the smoke generating device 3 is automatically activated by the monitoring device 1 (S209). Also, immediately, the transmission process of the current state image data is started (S206), and the current state image data is transmitted to the monitoring center device 31.

  As can be understood from the above description, the monitoring control unit 112 sequentially transmits the current request signals to the plurality of image sensors 2 at predetermined intervals and receives the response signals, so that each image sensor 2 detects an intruder. Check whether it is not. When an abnormality signal is received from any one of the image sensors 2, the abnormality monitoring unit 110 determines the level of the abnormality signal detected by the image sensor 2 and transmits the current state image data or accumulated image data to the image sensor 2. Requesting the image sensor 2 to obtain predetermined image data. The acquired image data is transmitted to the monitoring center device 31 via the monitoring device 1. The abnormality monitoring unit 110 sets the image transmission flag of the storage unit to ON with the transmission of the image data to the monitoring center device 31.

  The monitoring center device 31 is provided with operating means (not shown), and the smoke generating device 3 can be remotely activated by operating the operating means. When the operation means is operated, a remote activation signal for activating the designated smoke generating device 3 is transmitted. When the abnormality monitoring unit 110 receives the remote activation signal, the abnormality monitoring unit 110 outputs the remote activation signal to the activation unit 122 of the activation control unit 120. When the activation unit 122 receives the remote activation signal, unlike the automatic activation signal, the activation unit 122 activates the smoke generating device 3 corresponding to the unconditional condition to eject a large amount of smoke.

  If an “intrusion confirmation 2” signal is received from any of the image sensors 2, the activation determination unit 121 checks whether the image transmission flag is not ON. If the image transmission flag is not ON, the activation determination unit 121 notifies the activation unit 122. In response to this, an automatic start signal is output. The activation unit 122 activates the smoke generating device 3 when receiving the automatic activation signal. Thus, when an abnormal signal having a very high possibility of intrusion is received, the smoke generating device 3 is quickly activated for the intruder without the involvement of the monitoring center device 31.

  When the “intrusion confirmation 2” signal is received and the image flag is ON, the activation determination unit 121 prohibits the output of the automatic activation signal. Thereby, starting of the smoke generating apparatus 3 by automatic starting is prohibited. Therefore, while the activation determination unit 121 prohibits the output of the automatic activation signal, the smoke generating device 3 can be activated only by the remote activation signal.

(Overall operation 1)
Next, an example of the communication processing procedure between the apparatuses from when the monitor set mode is set to when the monitor release mode is set, and the timing of ON / OFF control of the image transmission flag will be described. FIG. 5 is a diagram illustrating a communication procedure between the apparatuses when transmitting the current state image data. The basic processing procedure follows the flowchart shown in FIG. According to the processing procedure of FIG. 4, the transmission of the current state image data is performed when the “intrusion confirmation 1” signal and the “intrusion confirmation 2” signal are received. In addition to this, even when there is a transmission request for the current state image data from the monitoring center device 31, the current state image data is transmitted, but the monitoring center device 31 does not hold an abnormal state for the monitoring target. In the state, the current state image cannot be requested. This is to protect the privacy of the user by preventing the monitor from seeing the image unnecessarily in a situation where the monitoring target is not in an abnormal state.

  First, when the user of the security system 10 operates the mode setting unit 7 of the monitoring device 1 to change the setting from the monitoring release mode to the monitoring set mode, monitoring is started. In the monitoring set mode, a status report request signal is sequentially output to each image sensor 2 by polling from the monitoring device 1. In contrast, each image sensor 2 returns a normal signal if there is no abnormality, and returns an abnormal signal in response to the abnormality if an abnormality has occurred.

  In FIG. 5, the monitoring device 1 receives an “intrusion confirmation 1” signal from one of the image sensors 2. When the monitoring device 1 receives the “intrusion confirmation 1” signal, the monitoring device 1 supplements the communication line 20 and transmits the “intrusion confirmation 1” signal to the monitoring center device 31. At the same time, a transmission request signal for the current state image data is output to the image sensor 2 in which an abnormality has occurred. When the confirmation signal for the request is received from the image sensor 2, the monitoring apparatus 1 transmits a current state image transmission start signal to the monitoring center apparatus 31. Since the current state image data is transmitted from the image sensor 2 following the confirmation signal, the current state image is temporarily stored in the storage unit of the monitoring device 1.

  The monitoring center device 31 receives the current state image transmission start signal from the monitoring device 1 and transmits a reception permission signal to the monitoring device 1. When receiving the reception permission signal from the monitoring center device 31, the monitoring device 1 sets the image transmission flag to “ON” and transmits the current state image data to the monitoring center device 31. When the image transmission flag is “ON”, the activation determination unit 121 (FIG. 3) prohibits the automatic activation of the smoke generating device 3 by the monitoring device 1. The current state image data is continuously sent from the image sensor 2 until the current state image request end signal for ending the request for image data is received from the monitoring center device 31 and sequentially sent to the monitoring center device 31.

  As described above, since the transmission of the image data and the abnormality confirmation process of the image sensor 2 are performed in parallel, even when the current state image data is being transmitted, a request for a status report is sent to each image sensor 2. Polling is taking place. Now, assuming that the “intrusion confirmation 2” signal is received during the transmission of the current state image data, the “intrusion confirmation 2” signal is an abnormal signal for starting the smoke generating device 3, and therefore the smoke generating device is usually used by the monitoring device 1. 3 is activated. However, since the image transmission flag is “ON”, automatic activation from the monitoring device 1 is prohibited. On the other hand, since the remote activation from the monitoring center device 31 is possible, the monitoring device 1 activates the smoke generating device 3 when a remote activation signal is transmitted from the monitoring center device 31 by the operation of the supervisor.

  Even after the smoke generating device 3 is activated, the current state image data is transmitted, so that the monitoring person can confirm the state of the site with the image. Thereafter, when the monitoring person determines that the current state image is no longer necessary, the operation means is operated to transmit a current state image request end signal to the monitoring device 1. The monitoring device 1 transmits a confirmation signal to the monitoring center device 31 and transmits a current state image transmission request end signal to the image sensor 2. The image sensor 2 thereby stops transmission of the current state image and transmits a confirmation signal to the monitoring device 1.

  Thereafter, when all the abnormality handling processing is completed, the monitoring person can operate the operating means to transmit an abnormality recovery signal from the monitoring center device 31, reset the abnormal state, and return to the monitoring set mode that is not in the abnormal state. Thereafter, polling is performed from the monitoring device 1 to the image sensor 2, but a normal signal is returned from the image sensor 2 because no abnormality has occurred. The image transmission flag is set to “OFF” by the abnormality recovery signal, and the smoke generator 3 can be automatically activated again.

  The monitoring set mode is canceled by operating the mode setting unit 7 by a user or a counselor who has dispatched at the request of the image monitoring center 30. It should be noted that the abnormal state can also be reset and recovered by operating the abnormality recovery button of the operation unit 106 of the monitoring device 1 after entering the monitoring cancellation mode.

(Overall operation 2)
Next, the automatic activation at the time of the transmission processing operation of the stored image data will be described with reference to FIG. The image transmission processing procedure is basically the same as that for the current state image data. However, the transmission processing of the stored image data is performed when the “human detection” signal is received, and the transmission processing of the stored image data is terminated by the image transmission of 10 frames before and after the intrusion occurs. .

  When the “person detection” signal is received, the communication line 20 is supplemented and the “person detection” signal is transmitted to the monitoring center device 31. Thereafter, when an accumulated image transmission start signal is transmitted and a reception permission signal is returned, the image transmission flag is set to “ON”. Thereafter, the automatic activation of the smoke generating device 3 is prohibited until the image transmission flag becomes “OFF”, as in the case of FIG.

  When the accumulated image data is sequentially transmitted from 1 frame to 10 frames, a reception completion signal is transmitted from the monitoring center device 31 to the monitoring device 1. As a result, the monitoring apparatus 1 transmits to the image sensor 2 a stored image erasure request signal. In response to this, the image sensor 2 deletes the stored image and sequentially updates the stored image for the next occurrence of abnormality.

  The monitor can further request transmission of the current state image. When there is a request for the current state image data from the monitoring center device 31 by operating the operation means, the monitoring device 1 requests the image sensor 2 to transmit the current state image data. The subsequent processing procedure is the same as the transmission of the current state image data described above. When it is not necessary to check the current state image, the operating means is operated by the monitoring staff. By this operation, the monitoring center apparatus 31 transmits a current state image request end signal and transmits an abnormality recovery signal. When the monitoring device 1 receives the restoration signal, it sets the image transmission flag to “OFF”. Also in the case of transmission of accumulated image data, the smoke generator 2 can be automatically activated when the image transmission flag is “OFF”.

  It should be noted that the condition for turning on the image transmission flag used to determine whether or not to prohibit the output of the automatic activation signal in the activation determination unit 121 is that the monitoring center device 31 can quickly confirm the image data. Conditions for certification can be set arbitrarily. For example, when the monitoring center device 31 receives the first image of the image data received from the monitoring device 1, a reception notification of the first image is transmitted to the monitoring device. When the monitoring apparatus 1 receives the image transmission flag, the image transmission flag may be turned on.

In addition, the time from when the monitoring device 1 receives the abnormal signal to when the line is connected and the image reaches the monitoring center device 31 is measured in advance, and when the monitoring device 1 receives the abnormal signal, the time is measured. A timer is provided to start timing. Then, the image transmission flag can be turned ON when the timer expires. Further, the image transmission flag may be turned ON when the image transmission start signal is transmitted. Further, the monitoring device 1 receives the current state image request end signal shown in FIGS. 5 and 6 from the monitoring center device 31 and transmits the current state image data to the monitoring center device 31 at the timing of turning off the image flag. It may be when you stop. In this way, the monitoring center device 31 can prohibit the automatic activation while the monitor can actually confirm the real-time image of the monitoring area, and can perform the automatic activation in other situations. It is possible to respond quickly to crimes.

(Example of intruder detection by image sensor)
Next, the image sensor 2 will be described with reference to FIGS. FIG. 7 is a functional block diagram showing the image sensor 2 according to the embodiment of the present invention. FIG. 8 is a flowchart illustrating an example of an intrusion determination processing procedure. FIG. 9 is a diagram illustrating a determination result based on the relationship between the human attribute value and the non-human attribute value.

  The image sensor 2 includes an imaging unit including a control unit 202 that controls the entire image sensor, an imaging control unit 207, an imaging unit 205 such as a CCD or CMOS (CIS) that images a monitoring target area, and an illumination unit 206 that illuminates the imaging range. And an image analysis unit 204 that extracts basic data for detecting an intruder from the captured image data, and a detection unit that includes an intrusion determination unit 203 that determines the accuracy of the presence of the intruder in a plurality of stages from the extracted basic data. An image data storage unit 201 that temporarily stores captured image data, an image data output unit 200 that outputs image data, and a connection I / F (interface) 208 that performs data communication with the monitoring device 1.

  The control unit 202 controls each part and the whole of the image sensor 2. The imaging control unit 207 controls the illumination unit 206 and the imaging unit 205 under the control of the control unit 202. The imaging unit 205 periodically images the monitoring target area under the control of the imaging control unit 207 and temporarily accumulates the captured image data in the image data storage unit 201. The image data storage unit 201 includes a ring-structured buffer, stores a predetermined number of image data (for example, about 10 images), and can circularly store old images sequentially by replacing them with new images. When the monitoring device 1 is set to the monitoring release mode, or when the monitoring device 1 is set to the monitoring set mode and is in a normal state where no intruder is detected, the latest image data is updated by cyclically storing in this way. However, the predetermined number is stored. When an intruder is detected, this circular storage stops when seven images are subsequently captured. This is stored image data. Further, the image data captured by the image capturing unit 205 may be output in parallel to the image data output means 200 if there is an image request in the current state.

  Further, the image data captured by the imaging unit 205 is also input to the image analysis unit 204. The image analysis unit 204 includes a background image storage unit 214, a difference extraction unit 212, a tracking unit 213, and an image attribute calculation unit 210, and the presence of a moving object is determined by comparing the latest captured image data with the background image. Further, attributes such as a human attribute, a small animal attribute, a light attribute, and a shadow attribute of the image data in the detection area of the moving object are calculated.

  The background image storage unit 214 of the image analysis unit 204 stores a background image of the imaging region (an image when no moving object such as an intruder exists) in advance. The difference extraction unit 212 performs a difference process between the input image obtained by the imaging unit 205 and the background image stored in the background image storage unit 214, and extracts a difference area having a change. If the tracking unit 213 determines that the difference area obtained by the difference extraction unit 212 is due to the same object as the difference area in the previous frame, the tracking unit 213 gives tracking information up to the previous time to the current difference area. The determination that they are the same object is performed, for example, by using a condition that the amount of movement of the center of gravity and the change in the size of the difference area are within a certain range.

  The image attribute calculation unit 210 includes, for example, a human attribute calculation unit 221, a small animal attribute calculation unit 222, a light attribute calculation unit 223, a shadow attribute calculation unit 224, and the like, and calculates each attribute. In addition to this, it is also possible to use other types of attribute calculation means that can improve the accuracy of determining whether or not a person has entered. The human attribute calculation unit 221 calculates a “human attribute value” that is a high value when the difference area obtained by the difference extraction unit 212 is a person. The human attribute value is a feature amount representing humanity, for example, the size of the difference area, a normalization function with the background image (the degree of coincidence between the background image and the input image), and the edge change rate when compared with the background image Etc.

  The small animal attribute calculation means 222 calculates a “small animal attribute value” that is high when the difference area is a small animal. The small animal attribute value is calculated from a feature amount representing the small animal character, for example, the size of the difference area, the degree of coincidence between the moving direction and the long axis, and the edge change rate when compared with the background image.

  The light attribute calculation unit 223 calculates a “light attribute value” that is a high value when the difference area is light. The light attribute value is calculated from a feature amount representing the lightness, for example, an average luminance value of the difference area in the non-illuminated image, a normalized correlation with the background image, and a rate of change of the edge when compared with the background image. .

  The shadow attribute calculation unit 224 calculates a “shadow attribute value” that is high when the difference area is a shadow. The shadow attribute value is calculated from a feature amount representing the likelihood of shadow, for example, the average luminance value of the difference area in the non-illuminated image, the normalized correlation with the background image, and the edge change rate when compared with the background image.

  The intrusion determination unit 203 uses the human attribute value, the light attribute value, the shadow attribute value, and the small animal attribute value to determine whether the difference area obtained by the difference extraction unit 212 and the tracking unit 213 is a person. Judgment. When the human attribute value is high and the light, shadow, and small animal attribute values are low, it is determined as “person”. The threshold value is set in three stages, and the accuracy of whether or not the difference area is caused by an intruder is determined at three levels. For example, if it is determined that the difference area is likely to be caused by an intruder by analysis of the image data, but the accuracy is low, the lowest human detection signal is output, "Intrusion Confirmation 1" signal, which is higher than the "Intrusion Confirmation 1" level, is output with a higher level of accuracy than the "Intrusion Confirmation 1" level. Is determined to be an “intrusion confirmation 2” level that is almost certain, an “intrusion confirmation 2” signal of the higher level is output. These abnormal signals are transmitted as flag information or coded digital information to the monitoring apparatus 1 via the connection interface 208.

  The calculation method of each attribute value and the determination threshold value for performing such determination are freely set according to the monitoring target environment such as the topography of the monitoring area, the background, the relationship between natural light, artificial light, and shadows. However, it is desirable to determine an optimum value from experimental data according to the environment. For example, in various environments (indoor, outdoor, weather, daytime, night, etc.), experiments or simulations that move people or cause false alarms are repeated, and experimental data or simulation data is accumulated and analyzed. This makes it possible to obtain more accurate attribute value features and threshold information.

  The abnormality signal as the determination result is held in the intrusion determination unit 203 until an erasure request is received from the control unit 202. When a higher level determination is made based on the latest image data, the old determination result is replaced with a determination result at a higher level. When the intruder is no longer detected in the captured image data, the control unit 202 erases the intrusion detection signal that is the determination result held in the intrusion determination unit 203.

  If it is determined as “human detection”, “intrusion confirmation 1” or “intrusion confirmation 2” by the intrusion determination means 203 and the monitoring set mode is set, the image data accumulation means 201 is stored under the control of the control means 202. The image data to be stored is stored and held for several consecutive image data immediately before the determination and several image data immediately after the determination. For example, if the image data storage unit 201 can hold 10 pieces of image data, the immediately preceding 3 image data including the determination time and the immediately following 7 image data are stored, and this image data is deleted from the monitoring device 1. Hold until requested.

  Based on a request from the monitoring apparatus 1, the image data output unit 200 receives the accumulated image data stored in the image data storage unit 201 or the current state image data captured by the imaging unit 205 via the connection interface 208. Send. These image data are transmitted to the monitoring center device 31 by the monitoring device 1 and used for confirmation of an intrusion state by a monitor of the image monitoring center 30.

  Next, an example of the determination processing procedure by the image sensor 2 will be described with reference to the flowchart of FIG. The image sensor 2 calculates attribute values (light, shadow, small animal) other than a person in parallel with the person attribute value. When the person attribute value is high and the attribute value other than the person is low, to decide. Then, the probability that the change area is a person is determined at a level of three levels (intrusion confirmation 2> intrusion confirmation 1> human detection). If the accuracy is lower than “human detection”, the determination is “other than human”.

  First, the imaging control unit 207 controls the illumination unit 206 and the imaging unit 205 to acquire an illumination image when the illumination is turned on and a non-illumination image when the illumination is turned off (S301, S302).

  A difference process between the acquired input image and the background image stored in the background image storage unit 214 is performed, and a difference region obtained by combining pixels whose luminance difference value is equal to or greater than a predetermined threshold is extracted (S303). If the tracking unit 213 determines that the extracted difference area is the same moving object as the difference area of the previous frame, the difference area information (tracking information) up to the previous time is added to the current difference area ( S304). Whether it is due to the same moving object is determined based on conditions such as whether the amount of movement of the center of gravity and the change in the size of the difference area are within a certain range.

When these pre-processes are completed, a difference area attribute calculation process is performed (S305). In the attribute calculation process, various attributes are calculated. In this embodiment, an example of calculating a human attribute, a small animal attribute, a light attribute, and a shadow attribute is shown. When each attribute value is calculated, it is determined whether or not a person has entered based on those attribute values (S306). A specific example of a method for calculating each attribute value and a method for determining a human intrusion will be described below.
(Example of how to calculate each attribute value)

The human attribute of the difference area is calculated by weighting the feature amounts as in the following (1) to (3) and obtaining the sum.
(1) If the difference area size (T1) is within a certain range, the possibility of being a person is high. (2) If the similarity between the input image and the background image in the difference area is low, the possibility of a person is high. High (3) If the rate of change of the edge of the input image compared to the background image in the difference area is high, the possibility of a person is high.
These feature values are normalized so as to approach 1 when the possibility of being a person is high and to approach 0 as it is low. The normalized feature values are a1, a2, and a3, the weights for the feature amounts are b1, b2, and b3, and the human attribute value is obtained by the following equation.
Human attribute value = a1 × b1 + a2 × b2 + a3 × b3 where b1 + b2 + b3 = 1

The small animal attributes are calculated, for example, by weighting the following features (4) to (6) and calculating the sum.
(4) When the area of the difference area is small, the possibility of being a small animal is high (5) When the degree of coincidence between the inclination of the major axis of the difference area and the moving direction is high, the possibility of a small animal is high (6) In the difference area If the rate of change of the edge of the input image compared to the background image is high, the method of calculating the small animal attribute value from such a feature amount that is likely to be a small animal is the same method as the method of calculating the human attribute value. Use. However, weighting and other conditions for these feature quantities are determined through experiments or the like according to the environment.

The light attribute value is calculated, for example, by weighting the following feature amounts (7) to (9) and obtaining the sum.
(7) If the average brightness of the difference area in the unilluminated image is high, the possibility of light is high. (8) If the input image of the difference area and the background image are high, the possibility of light is high (9). When the rate of change of the edge of the input image compared with the background image of the difference area is low, the method of calculating the light attribute value from such a feature amount having a high possibility of light is the same as the method of calculating the human attribute value. Use the method. However, weighting and other conditions for these feature quantities are determined through experiments or the like according to the environment.

The shadow attribute value is calculated, for example, by weighting the feature quantities (10) to (12) and obtaining the sum.
(10) If the average luminance value of the difference area in the non-illuminated image is low, there is a high possibility of being a shadow. (11) If the similarity between the input image and the background image in the difference area is high, it may be a shadow. A method of calculating a shadow attribute value from such a feature amount having a high possibility of a shadow when the edge change rate of the input image compared with the background image of the high (12) difference area is low calculates a human attribute value. A method similar to the method is used. However, weighting and other conditions for these feature quantities are determined through experiments or the like according to the environment.
(Example of determination method for “intrusion of people”)
It is determined whether or not the difference area is “human intrusion” using the various attribute values calculated by the above-described method. This determination is made by dividing the case of “human intrusion” into three levels. Using the threshold values X1, X2, and X3 for determining human attribute values and the threshold values Y1, Y2, and Y3 for determining other attribute values (for example, light, shadow, and small animal attribute values), Determine. These threshold values are stored in the intrusion determination unit 203 of the image sensor 2. The threshold values have a relationship of X1 <X2 <X3 and Y1 <Y2 <Y3.

  Note that the above threshold values (X1 to X3, Y1 to Y3) are based on a large number of image analysis data collected by moving a person in various environments assumed as monitoring targets, misinformation data obtained by detection experiments, and the like. Thus, the probability of human invader can be calculated statistically. Also, based on the past information of the difference area tracked by tracking, the past values of human attribute value, light attribute value, shadow attribute value, and small animal attribute value are accumulated, and the possibility of intrusion is determined using the accumulated attribute value. May be performed.

With reference to FIG. 10, a method of determining the accuracy of “person intrusion” in a plurality of stages will be described. FIG. 10 shows a determination result based on the relationship between the human attribute value and the non-human attribute value. The attribute values other than the person are determined using the maximum value among the calculated “small animal attribute value”, “light attribute value”, and “shadow attribute value”.
In the figure, “A” indicates a so-called “normal” case where it is determined that there is no possibility of intrusion. That is, when the human attribute value is smaller than X1 or other attribute values are larger than Y3, the intrusion determination unit 203 determines “normal”.
In the figure, “B” shows a case of so-called “human detection” when there is a sufficient possibility of factors other than a person and cannot be determined without the possibility of intrusion. That is, when the human attribute value is between X1 and X2 and the other attribute value is larger than Y3, or when the human attribute value is larger than X1 and the other attribute value is between Y2 and Y3, the intrusion determination The means 203 determines “person detection”.
In the figure, “C” indicates a case where there is a slight possibility of a factor other than a person and it cannot be determined that a person is surely intruded, and so-called “intrusion confirmation 1”. That is, intrusion determination means when the human attribute value is between X2 and X3 and the other attribute value is smaller than Y2, or when the human attribute value is larger than X3 and the other attribute value is between Y1 and Y2. 203 determines “intrusion confirmation 1”.
In the figure, “D” indicates a case where it can be determined that the user is an intruder with certainty, and so-called “intrusion confirmation 2”. That is, when the human attribute value is larger than X3 and the other attribute values are smaller than Y1, the intrusion determination unit 203 determines “intrusion confirmation 2”.
(Other examples)
In the above-described embodiment, the example using the image sensor 2 in which the imaging unit and the detection unit are integrally configured has been described. However, as described above, the imaging unit and the detection unit may be separate. For example, a normal surveillance camera, an infrared sensor, and a smoke generation device (intimidation device) may be installed in association with each other. In this case, when a plurality of infrared sensors are installed and only one infrared sensor detects an intruder, the monitoring control unit 112 of the monitoring device 1 is the same as when the above-described “person detection” signal is received. When two infra-red sensors detect an intruder, the same processing is performed as when the above-mentioned “intrusion confirmation 1” signal is received, and three or more infrared rays detect the intruder. In some cases, the same processing as when the above-described “intrusion confirmation 2” signal is received is performed. At this time, when one or two infrared sensors detect an intruder, the smoke generating device 3 is configured not to be automatically activated in the same manner as when the “person detection” signal or the “intrusion confirmation 1” signal is received.
Of course, when only one infrared sensor detects an intruder, the monitoring device 1 does not automatically activate the smoke generating device 3, but when two or more infrared sensors detect an intruder, the above-described processing of “intrusion confirmation 2” is performed. In the same manner as described above, in principle, the smoke generating device 3 can be automatically activated, and the automatic activation can be prohibited in a predetermined case. In the above-described embodiment, the image transmission flag is set to ON regardless of the types of stored image data and current state image data. However, the image transmission flag may be set to ON only for current state image data.

Furthermore, regarding the control for prohibiting automatic activation of the smoke generating device 3 when an intruder is detected,
(1) When any one of the image sensors 2 detects an intruder, the representative image transmission flag is set to ON so that the activation of the smoke generation devices 3 corresponding to all the image sensors 2 is prohibited. ,
(2) Each image sensor 2 has an image transmission flag, and when any one of the image sensors 1 detects intrusion or more, automatic activation is prohibited only for the smoke generating device 3 corresponding to the image sensor 2. Configuring,
Either configuration is possible.

1 is a configuration block diagram showing an example of a security system 10 using a monitoring device 1 of the present invention. 4 is a flowchart illustrating an example of a communication operation processing procedure between the monitoring device 1 and the image sensor 2. It is a functional block diagram of monitoring device 1 concerning one embodiment of the present invention. It is a flowchart which shows an example of the basic processing procedure of the monitoring apparatus when the image sensor 2 detects abnormality. It is a figure which shows the communication procedure between each apparatus in the case of transmitting present state image data, when an image sensor detects an intruder. It is a figure which shows the communication procedure between each apparatus in the case of transmitting accumulation | storage image data, when the image sensor 2 detects an intruder. It is a functional block diagram which shows the image sensor 2 concerning one Embodiment of this invention. 5 is a flowchart illustrating an example of an intrusion determination processing procedure of the image sensor 2. It is a figure which shows the determination result based on the relationship between a human attribute value and attribute values other than a person.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Monitoring apparatus 2 (2a-2e) Image sensor 3 (3a-3d) Smoke generation apparatus 4 Intrusion sensor 5 Fire sensor 6 Emergency button 7 Mode setting device 10 Security system 20 Communication line 30 Image monitoring center 31 Monitoring center apparatus 100 Main control part 101 Sensor I / F 102 Communication I / F
DESCRIPTION OF SYMBOLS 103 Display means 104 Memory | storage means 105 Image sensor I / F 106 Operation part 110 Abnormality monitoring means 111 Communication control part 112 Monitoring control part 120 Start-up control means 121 Start-up determination part 122 Start-up part 200 Image data output means 201 Image data storage means 202 Control Means 203 Intrusion determination means 204 Image analysis section 205 Imaging section 206 Illumination section 207 Imaging control means 208 Connection I / F 210 Image attribute calculation means 212 Difference extraction means 213 Tracking means 214 Background image storage means 221 Human attribute calculation means 222 Small animal attribute calculation Means 223 Light attribute calculation means 224 Shadow attribute calculation means

Claims (5)

Imaging means for transmitting the images the monitoring region image data, wherein a detection unit configured to detect an intruder into the monitored area and transmits an abnormality signal, and threatening means for intimidating the intruder is connected, further, the intimidating means A monitoring center device connected via a communication line to a monitoring center device for transmitting a remote activation signal for activating
When the abnormal signal is received from the detecting means, it is determined whether or not the type of the abnormal signal is a specific abnormal signal that activates the threatening means, and the image data received from the imaging means is used as the monitoring center device A monitoring control unit that performs control to start transmission to
An abnormality monitoring means for storing in the storage means that the image data has been transmitted when the image data is transmitted by the monitoring control unit;
When the remote activation signal is received from the monitoring center , and when it is determined that the specific abnormality signal is determined by the monitoring control unit and the transmission of the image data is not stored in the storage unit A starting control means for starting the threatening means at any of the above ,
When the abnormality monitoring means transmits the image data when the monitoring control unit determines that the specific abnormality signal is present, the activation control means stores the fact that the image data has been transmitted. A monitoring apparatus that is performed after determining whether the transmission of the image data is not stored . The abnormality monitoring unit, upon stopping transmission of the image data, the monitoring device according to claim 1 for erasing the memory that was the transmission. It said abnormality monitoring means, said an abnormal state based on the abnormal signal is restored, the monitoring device according to claim 1 for erasing the memory that was the transmission.   4. The monitoring apparatus according to claim 1, wherein the detection unit is an image sensor that determines by analyzing an image captured by the imaging unit and outputs the abnormality signal. 5.   The monitoring apparatus according to claim 1, wherein the image data is current state image data.

Images