JP2007267332A - Video monitoring device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To monitor a video image, while recognizing the degree of significance of alarm information by fixed intervals of time in the past. <P>SOLUTION: A video monitoring device comprises an alarm information storage section 30 for sequentially storing alarm raising time information and sensor information as alarm information, each time a new abnormality detecting signal is received from abnormality detecting sensors 12-1 to 12-3; a significance degree calculation section 31 for reading alarm information, from among the sequentially stored alarm information, of which the alarm raising time information corresponds to the past only for a predetermined time from the present time, executing weighting processing to the sensor information and weighting processing to the alarm information generation time information, respectively for each of the read alarm information, multiplying the results of the weighting processing and summing up the respective multiplication results for all the read alarm information to calculate a total significance value; and an image processing section 32 for generating image frame data including a frame of thickness corresponding to the total significance value, and compositing images with the outer circumference portion of image data of video signals. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a video monitoring apparatus, and more particularly to a video monitoring apparatus for displaying a monitoring video when an abnormal state to be monitored is detected.

  A video surveillance system in which a supervisor monitors a surveillance video taken by a surveillance camera as image data on a recording device or displayed on a display device has become widespread. Among them, when the abnormality detection means other than the monitoring camera itself or the monitoring camera detects an abnormal state in the imaging field of view, the alarm information based on this detection and the video signal of the monitoring camera are transmitted to the monitoring device. Video monitoring systems that record in a recording unit of a monitoring device or display on a display device connected to the monitoring device are widely used. In such a video monitoring system, when displaying the supplied alarm information and video signal on the display device, the monitoring device displays a list of alarm information as character information in a region different from the display region of the monitoring video. There are many things to control.

  However, when alarm information (a list of character information) and a monitoring video are displayed in different display areas, the supervisor needs to make an appropriate decision by associating the alarm information with the monitoring video, which is a heavy burden on the supervisor. In addition to forcing the monitoring, there is a problem that the supervisor may miss an appropriate judgment, and the monitoring work is not reliable. Therefore, a technique related to a central monitoring device that can easily detect an abnormality in a monitoring video while suppressing the burden on the monitoring person is known (see, for example, Patent Document 1).

Specifically, Patent Document 1 compares two images extracted at a predetermined time interval when recording an image captured by a surveillance camera on an image recording apparatus, and based on the result of this comparison. A technique for coloring a changed portion on an image and displaying alarm information from a sensor before and after the change on the image on a screen together with the colored image is disclosed.
JP 2002-199387 A

  However, according to the technique disclosed in Patent Document 1, although the occurrence of a change in the image can be easily confirmed by the observer watching the colored image, the coloring of the image is the movement of the image. Since it is based only on the amount, the importance according to the type of alarm information or the like cannot be determined instantaneously, and the effect of reducing the burden on the monitoring by the supervisor is not so much improved. In addition, since the image portion is colored, it has a drawback that it is difficult to view the image.

  Therefore, the present invention has been made in view of the above circumstances, and an object thereof is to present the generation of alarm information as a decoration effect on a monitoring video, and to display the decoration based on the type of alarm information and temporal importance. By providing the display, a video monitoring apparatus is provided that can drastically reduce the monitoring burden on the monitor and maintain high monitoring reliability.

In order to solve the above problems, the present invention
[1] While receiving at least an abnormality detection signal including predetermined sensor information output from the abnormality detection sensors (12-1 to 12-3), a video signal supplied from the monitoring camera (11) is received. A video monitoring device (13) for outputting to a display device (14),
Each time a new abnormality detection signal is received from the abnormality detection sensor (12-1 to 12-3), the reception time information and the sensor information included in the received abnormality detection signal are sequentially stored as alarm information. Alarm information storage means (28, 29, 30),
Among the sequentially stored alarm information, the corresponding alarm information is read after the time when the reception time information is a predetermined time later than the current time, and the weighting process and reception for the sensor information in all the read alarm information Importance calculating means (29, 31) for calculating a total importance value based on weighting processing for time information;
Image processing means (32) for generating decoration image data based on the calculated total importance value, synthesizing the decoration image data on the outer periphery of the image data of the video signal, and outputting it to the display device (14). )When,
Video monitoring device (13) having a configuration comprising:
Provide
[2] The importance calculation means (29, 31)
Out of the sequentially stored alarm information, the alarm information corresponding to the time after the time when the reception time information is back by a predetermined time from the current time is read, and the weighting process and reception for the sensor information are performed for each of the read alarm information. The weighting process for time information is executed and multiplied by the weighting process results, and the total importance value is calculated by summing the multiplication results for all the read alarm information. The video surveillance device (13) according to [1]
Provide
[3] The decoration image data is image frame data having image frame thickness corresponding to the total importance value calculated by the importance calculation means (29, 31). ] Or the video surveillance device (13) according to [2]
Is to provide.

  According to the present invention, the monitoring image can be displayed with the decoration reflecting the importance of the alarm information, so that the monitoring burden on the monitoring person can be drastically reduced and the monitoring reliability can be kept high. .

  Hereinafter, the best mode for carrying out the present invention will be described in detail with reference to the drawings. FIG. 1 is an overall configuration diagram of a video surveillance system to which a video surveillance apparatus according to an embodiment of the present invention is applied. In FIG. 1, the video monitoring system 1 includes a monitoring camera 11, abnormality detection sensors 12-1 to 12-3, a video monitoring device 13, and a display device 14. Among these, the monitoring camera 11 and the abnormality detection sensors 12-1 to 12-3 are installed on the monitoring site side, and the video monitoring device 13 and the display device 14 are installed on the monitoring side.

  The monitoring camera 11 is installed at a monitoring site so as to face the monitoring target in the field of view, and constantly outputs the captured monitoring video as an analog video signal. Each of the abnormality detection sensors 12-1 to 12-3 (hereinafter sometimes simply referred to as the abnormality detection sensor 12) occurs when the abnormal state is detected from the detection of the occurrence of the abnormal state in the monitoring target. During this period, the sensor outputs an abnormality detection signal. The abnormality detection sensor 12 is, for example, an open / close sensor that detects the open / close state of a door when the vicinity of a room entrance / exit is to be monitored, and a person detection sensor or lighting device that is lit when a suspicious person's traffic is to be monitored. When the target state is to be monitored, various detection sensors such as a light sensor for detecting light can be applied. The abnormality detection sensor 12 is provided with at least one of unique identification information and sensor type information indicating the sensor type (hereinafter also referred to as sensor information). Outputs the abnormality detection signal including the sensor information.

  The video monitoring device 13 receives a video signal from the monitoring camera 11 and an abnormality detection signal from the abnormality detection sensor 12. The video monitoring device 13 includes signal recording means, which will be described in detail later. The video monitoring apparatus 13 reads a video signal recorded on the signal recording means and a function for recording the video signal based on the input of the abnormality detection signal. And a function to be displayed on the device 14.

  FIG. 2 shows a schematic block configuration of the video monitoring apparatus 13. In the figure, the video monitoring device 13 includes a video signal input terminal 21, a video input processing unit 22, an encoding unit 23, a recording / playback control unit 24, a recording unit 25, a decoding unit 26, and an abnormality detection signal. An input terminal 27, an alarm information generation unit 28, a timing unit 29, an alarm information storage unit 30, an importance calculation unit 31, an image processing unit 32, an image output terminal 33, and a control unit 34 are provided. Yes.

  The video input terminal 21 is a terminal for inputting a video signal output from the surveillance camera 11. The video input processing unit 22 has a function of converting an input video signal into digital video data by an A / D conversion circuit through an analog signal processing circuit of a filter circuit, an amplification circuit, and a color difference conversion circuit. The encoding unit 23 has a function of converting digital video data into encoded video data by a data compression method such as a JPEG method or an MPEG method. In this case, the encoding unit 23 executes processing so that the encoded video data includes time information at the time of encoding.

  The recording / reproducing control unit 24 has a function of executing reproduction control for supplying the encoded video data supplied from the encoding unit 23 to the decoding unit 26 without recording it in the recording unit 25 (normal reproduction mode). Then, the recording / playback control unit 24 records the encoded video data supplied from the encoding unit 23 based on the control of the alarm information generation unit 28 in the recording unit 25 (the above-described signal recording unit) and supplies the encoded video data to the decoding unit 26. A function of executing recording / reproducing control (recording / reproducing mode). Furthermore, the recording / playback control unit 24 has a function of executing read control for reading the encoded video data recorded in the recording unit 25 and supplying the encoded video data to the decoding unit 26 (recorded / playback mode).

  The recording unit 25 is a recording unit that records encoded video data, and preferably has a disk recording medium such as a hard disk or a DVD in terms of access speed. The decoding unit 26 decodes the supplied encoded video data into decoded digital video data and performs encoding according to any one of the normal playback mode, the recording / playback mode, and the recorded / playback mode in the recording / playback control unit 24. It has a function of extracting time information and outputting at least decoded digital video data.

  The abnormality detection signal input terminal 27 is a terminal for inputting an abnormality detection signal (including sensor information) output from the abnormality detection sensor 12. The alarm information generation unit 28 acquires current time information as alarm occurrence time information (reception time information) from the time measurement unit 29 when an abnormality detection signal is input, and extracts sensor information from the abnormality detection signal, and generates an alarm occurrence time. The alarm information storage unit 30 stores a pair of information and sensor information as alarm information. The alarm information generation unit 28 outputs a recording start signal to the recording / playback control unit 24 when an abnormality detection signal is input, and outputs a recording end signal when there is no input of the abnormality detection signal. Have

  The alarm information storage unit 30 has a function of storing alarm information in chronological order of alarm occurrence time information. The importance calculation unit 31 is acquired from the time counting unit 29 among the alarm information stored in the alarm information storage unit 30 when the image processing unit 32 performs image processing on the decoded digital video data output from the decoding unit 26. All alarm information included in the past predetermined time is read from either the current time information or the time information at the time of encoding supplied from the decoding unit 26, and an alarm is generated in the read alarm information It has a function of executing a weighting process for each of the time information and the sensor information, and calculating and outputting a total importance value in the past predetermined time. Details of the calculation process of the total importance value will be described later.

  The image processing unit 32 is supplied with at least decoded digital video data from the decoded digital video data and encoding time information from the decoding unit 26 and is supplied with an overall importance value from the importance calculation unit 31. The image frame data based on the total importance value is generated and combined with the decoded digital video data, and the combined video data with the image frame is output via the image output terminal 33. A display device 14 is connected to the image output terminal 33, and the display device 14 displays video data with an image frame from the video monitoring device 13.

  The control unit 34 has a function of controlling each unit of the video monitoring device 13 described above. In this case, the control unit 34 includes a CPU and a memory (not shown), and has a function of controlling each unit by processing and executing a control program previously stored or recorded in the memory or the recording unit 25 by the CPU.

  Next, the operation of the video monitoring device 13 will be described for each of the normal playback mode, recording / playback mode, and recorded / playback mode.

<Normal playback mode of video surveillance device>
Normally, the control unit 34 operates by setting the video monitoring device 13 to the normal playback mode by executing the control program. This normal reproduction mode is a reproduction mode of the video monitoring apparatus 13 in a state where none of the abnormality detection sensors 12-1 to 12-3 outputs an abnormality detection signal.

  Specifically, the monitoring camera 11 constantly captures an image of the monitoring target and inputs a video signal of the monitoring video to the video signal input terminal 21 of the video monitoring device 13. In the video monitoring device 13, the video input processing unit 22 converts the video signal into digital video data and supplies the digital video data to the encoding unit 23. Next, the encoding unit 23 compresses the digital video data and outputs it as encoded video data. Next, the recording / playback control unit 24 outputs the encoded video data to the decoding unit 26. Next, the decoding unit 26 decodes the encoded video data into decoded digital video data. In this case, the recording / playback control unit 24 adjusts the timing so that the digital video data input to the encoding unit 23 is output from the decoding unit 26 in substantially real time as decoded digital video data without any data loss. measure. Next, the image processing unit 32 outputs the decoded digital video data via the image output terminal 33, and the display device 14 connected to the image output terminal 33 displays the decoded digital video data.

<Recording and playback mode of video surveillance device>
When any of the abnormality detection sensors 12-1 to 12-3 detects an abnormal state to be monitored and outputs an abnormality detection signal, the control unit 34 of the video monitoring device 13 executes the control program to execute the video monitoring device 13. Set to the recording / playback mode.

  Specifically, when any of the abnormality detection sensors 12-1 to 12-3 detects an abnormal state to be monitored, an abnormality detection signal including sensor information is output. This abnormality detection signal is input to the alarm information generation unit 28 via the abnormality detection signal input terminal 27 of the video monitoring device 13. When the abnormality detection signal is input, the alarm information generation unit 28 acquires the current time information as the alarm occurrence time information from the time measuring unit 29 and extracts the sensor information from the abnormality detection signal, and sends it to the recording / reproduction control unit 24. A recording start signal is output. Next, the alarm information generation unit 28 causes the alarm information storage unit 30 to store a pair of alarm occurrence time information and sensor information as alarm information. In this case, the alarm information generation unit 28 constantly monitors the input of the abnormality detection signal, and outputs a recording end signal to the recording / playback control unit 24 when the abnormality detection signal is no longer input.

  As described above, the alarm information generation unit 28 generates alarm information each time an abnormality detection signal is received from any of the abnormality detection sensors 12-1 to 12-3, and stores the alarm information in the alarm information storage unit 30 in chronological order. To do.

  On the other hand, the monitoring camera 11 constantly images the monitoring target and inputs the video signal of the monitoring video to the video signal input terminal 21 of the video monitoring device 13. In the video monitoring device 13, the video input processing unit 22 converts the video signal into digital video data and supplies the digital video data to the encoding unit 23. Next, the encoding unit 23 compresses the digital video data and outputs it as encoded video data. Next, the recording / playback control unit 24 outputs the encoded video data to the decoding unit 26, but when receiving the recording start signal from the alarm information generation unit 28, the recording / playback control unit 24 outputs the encoded video data to the decoding unit 26 while outputting the encoded video data. Start data recording to. Data recording to the recording unit 25 is executed until the recording / reproducing control unit 24 receives a recording end signal output from the alarm information generating unit 28. Next, the decoding unit 26 decodes the encoded video data into decoded digital video data. In this case, the recording / playback control unit 24 adjusts the timing so that the digital video data input to the encoding unit 23 is output from the decoding unit 26 in substantially real time as decoded digital video data without any data loss. measure.

  Next, the image processing unit 32 generates image frame data based on the total importance value supplied from the importance calculation unit 31 and combines it with the decoded digital video data. First, in the importance calculation unit 31, Processing for calculating the total importance value will be described. The importance calculation unit 31 reads out all alarm information included in the past predetermined time from the current time information acquired from the time measuring unit 29 among the alarm information stored in the alarm information storage unit 30, and all of the read out information The total importance value is calculated based on the weighting process for the sensor information in the alarm information and the weighting process for the reception time information. The predetermined time can be arbitrarily set by the monitor of the video monitoring apparatus 13 according to the frequency of abnormality detection.

  The weighting process will be described with a specific example. The importance calculation unit 31 performs a time weighting process on the difference time between each alarm occurrence time information and current time information in the alarm information read from the alarm information storage unit 30. To do. The coefficient of this time weighting process can be expressed by a time weighting curve as an example, and for example, a curve that increases weighting as it is closer to the current time and decreases weighting as it is farther from the current time. it can. By using a coefficient based on such a time weighting curve, it is possible to increase the importance of an abnormal state occurring at a time closer to the current time in the past than the current time. The time weighting curve can be arbitrarily set by the monitor of the video monitoring device 13.

  Next, the importance calculation unit 31 performs sensor weighting processing on each sensor information in the read alarm information. Since the sensor information is at least one of the identification information unique to the abnormality detection sensor 12 and the sensor type information indicating the type of the sensor as described above, for example, the sensor information of the abnormality detection sensors 12-1 to 12-3 The sensor weighting process is executed using a sensor weighting coefficient determined in advance for each of them or a sensor type weighting coefficient determined in advance according to the sensor type. By performing such weighting, it is possible to easily set the importance according to the installation location of the abnormality detection sensor 12 and the importance according to the type of the abnormality detection sensor 12.

  Then, for each alarm information, the importance calculation unit 31 multiplies the time weighting result calculated by the time weighting process and the sensor weighting result calculated by the sensor weighting process, and totals all the multiplication results in the past predetermined time. And output as a total importance value. FIG. 3 schematically shows a calculation example of a specific total importance value of the importance calculation unit 31. This figure shows the time weighting process and sensor weighting process when the past 60 minutes from the current time is set as the past predetermined time. The figure shows that alarm information was generated three times (50 minutes, 20 minutes, and 10 minutes before the current time) during the 60 minutes. The coefficients are “1, 3, and 3” according to the time weighting curve. The sensor weighting coefficient for each alarm information is determined according to the sensor type and is “1, 2, and 1”. Therefore, the multiplication result of the time weighting process result and the sensor weighting process result for each alarm information is “1, 6, and 3”. Therefore, the total importance value is “10” of these totals.

  The above is a specific example of the weighting process. In addition to this, for example, for each alarm information, the time weighting process result and the sensor weighting process result are added, and all the addition results in the past predetermined time are summed. A method for obtaining the degree value or a method for obtaining the importance of alarm information generation in the past predetermined time by a known statistical method may be used.

  The image processing unit 32 is supplied with the decoded digital video data from the decoding unit 26 and is supplied with the total importance value from the importance calculation unit 31, and generates image frame data based on the total importance value to generate the decoded digital data. The image data and image data are combined to generate image data with an image frame. This image frame data has a hollow square shape like a frame and is generated with a frame whose thickness is proportional to the total importance value. In the image composition process, the image frame data is decoded digital video. Image processing is performed so as to be added outside the image data so as not to overlap the data. Therefore, the data size of the decoded digital video data needs to be smaller than the maximum size that can be displayed on the display device 14 in consideration of the maximum width of the frame of the image frame data. The video data with the image frame generated in this way is displayed on the display device 14 connected to the image output terminal 33.

  The image frame data may be combined with the decoded digital video data, that is, the image frame data may be superimposed on the decoded digital video data. This is effective when it is desired to avoid reducing the screen size of the decoded digital video data in consideration of the frame of the image frame data. When the image frame data is processed so as to be superimposed on the decoded digital video data in this way, it is preferable that the overlapping data portion is mixed so that the decoded digital video data can be seen through the image frame data.

  Further, the color of the image frame may be changed according to the total importance value without changing the thickness of the frame of the image frame data. For example, a process of changing the color to a brighter color as the total importance value increases is preferable in terms of visibility. Of course, the change in the thickness of the frame of the image frame data and the change in the color may be combined. Furthermore, the shape of the image frame data is not limited to a square and may be a variety of shapes (decorative image data).

<Recording and playback mode of video surveillance device>
The recorded / reproduced mode of the video monitoring device 13 is not to display the monitoring video from the monitoring camera 11 on the display device 14 by executing the control program, but to read the encoded video data already recorded in the recording unit 25. This is a playback mode to be displayed on the display device 14.

  Specifically, when the encoded video data is read from the recording unit 25 by the read control of the recording / playback control unit 24, the decoding unit 26 decodes the encoded video data into decoded digital video data, and at the time of encoding. Extract time information. Then, the decoded digital video data and the time information at the time of encoding are supplied to the image processing unit 32. Then, the importance level calculation unit 31 acquires time information at the time of encoding from the image processing unit 32, and calculates a total importance level value for the past predetermined time with respect to this time information, whereby the above-described video monitoring device 13 is obtained. In the same manner as in the recording / reproducing mode, the image processing unit 32 can generate video data with an image frame.

  As described above in detail, according to the video monitoring device 13 of the embodiment of the present invention, the video signal of the monitoring camera 11 is set to the normal playback mode by executing the control program of the control unit 34 and the video signal of the monitoring camera 11 is substantially real time. If any of the abnormality detection sensors 12-1 to 12-3 detects an abnormal state to be monitored, the image is changed to the recording / reproducing mode. The framed video data can be displayed on the display device 14. As a result, the monitor can immediately and easily recognize that an abnormal state has occurred at the monitoring site while monitoring the display device 14.

  In particular, based on all alarm information included in a predetermined past time that can be arbitrarily set, the alarm generation time information and the sensor information are generated according to the total importance in the past predetermined time unit by weighting processing for each of the alarm information and sensor information. Since the image frame data is displayed together with the decoded digital video data, the monitor of the display device 14 can not only recognize the occurrence of the alarm information but also immediately and sensibly recognize the importance of the alarm. In addition, since the importance level of the alarm is presented based on the change in the thickness and color of the frame of the image frame data, it is possible to suppress the occurrence of variations in the recognition of the importance level among the monitoring persons when there are a plurality of monitoring persons. .

  Also, even if the alarm occurrence time is short and the monitor may not be aware of the alarm occurrence within that time, an image frame generated according to the total importance in the past predetermined time unit is displayed. Thus, the supervisor can recognize that an abnormal state has occurred within the predetermined time.

  In the present embodiment, an example using three abnormality detection sensors 12-1 to 12-3 has been described, but the number of abnormality detection sensors is not limited to this. In addition, although the connection between the monitoring camera 11 and the video monitoring device 13 has been described as an example using an analog video signal, the configuration of the video monitoring system 1 is not limited to the present embodiment, and monitoring is performed via a network, for example. Of course, the technical idea of the present invention can be applied even when the camera, the abnormality detection sensor, and the video monitoring apparatus are connected to each other.

1 is an overall configuration diagram of a video monitoring system to which a video monitoring apparatus according to an embodiment of the present invention is applied. 1 is a schematic block configuration diagram of a video monitoring apparatus according to an embodiment of the present invention. It is the figure which represented typically the example of concrete calculation of the comprehensive importance value by the importance calculation part.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Video surveillance system 11 Surveillance camera 12-1 to 12-3 Abnormality detection sensor 13 Video surveillance apparatus 14 Display apparatus 21 Video signal input terminal 22 Video input processing part 23 Encoding part 24 Recording / reproduction control part 25 Recording part 26 Decoding part 27 Abnormality detection signal input terminal 28 Alarm information generation unit 29 Timekeeping unit 30 Alarm information storage unit 31 Importance calculation unit 32 Image processing unit 33 Image output terminal 34 Control unit

Claims (3)

At least a video monitoring device that outputs a video signal supplied from a monitoring camera to a display device while receiving an abnormality detection signal including predetermined sensor information output from the abnormality detection sensor,
Alarm information storage means for sequentially storing the reception time information and the sensor information included in the received abnormality detection signal as alarm information each time a new abnormality detection signal is received from the abnormality detection sensor;
Among the sequentially stored alarm information, the corresponding alarm information is read after the time when the reception time information is a predetermined time later than the current time, and the weighting process and reception for the sensor information in all the read alarm information Importance calculating means for calculating a total importance value based on weighting processing for time information;
Image processing means for generating decoration image data based on the calculated total importance value, synthesizing the decoration image data on the outer periphery of the image data of the video signal, and outputting the image to the display device;
A video surveillance apparatus having a configuration comprising: The importance calculation means includes:
Out of the sequentially stored alarm information, the alarm information corresponding to the time after the time when the reception time information is back by a predetermined time from the current time is read, and the weighting process and reception for the sensor information is performed for each read alarm information. A weighting process for time information is performed and multiplied by the weighting process results, and a total importance value is calculated by summing the multiplication results for all the read alarm information. Item 2. The video surveillance device according to Item 1.   3. The video monitoring apparatus according to claim 1, wherein the decoration image data is image frame data having a thickness of an image frame corresponding to a total importance value calculated by the importance calculation means. .

Images