JPH0512579A - Image monitoring device - Google Patents

Abstract

PURPOSE:To easily retrieve a picture concerned by aborting detecting processing at the end of a set time when the processing of a change area in an image inputted from an ITV camera is not completed within a previously set time, outputting an alarm indicating the abort of the detection processing, alarming or displaying the abort and adding a signal to a record in a recording device. CONSTITUTION:When a CPU memory 21 reaches a set time set up by a timer 20 during the storage of labeling information, a display indicating the abort of analyzing processing and a display indicting the completed position of analysis are synthetically displayed on a display device 9. In this case, an alarm is generated by an alarm device 6 or a signal is added to a record in the recording device 7 so as to easily retrieve the picture concerned.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image monitoring device.

[0002]

2. Description of the Related Art FIGS. 8 and 9 show a conventional example of a monitoring device.
In this apparatus, the ITV camera 1 images the monitoring area 8 and the captured image converted into an electric signal is processed by the transmission path 2 into a processing device 3, a display device 5 for displaying an imaging screen, and a VTR.
Sent to 7. The VTR 7 records a monitoring image continuously or when an intruder is detected. On the other hand, the processing device 3
The electrical signal sent to the sampling pulse generation circuit 10
A / D by a predetermined sampling rate output from
It is converted into a digital signal by the converter 11 and stored in the image memory 12 as image data at time t = ti at a predetermined sampling interval (FIG. 10). In order to extract a change area, the image data of t = ti is subjected to a pixel-to-pixel difference calculation with an image captured before this to obtain a difference image, and the difference binarization circuit 14 Thus, the changed pixel is converted into a differential binarized image represented by "1" and stored in the differential binarized memory 15 (FIG. 11). The CPU 13 analyzes the changed area using the difference binarized image, and when it determines that the changed area is an intruder, sounds the alarm device 6 or displays the image of the display device 9 for confirming the intruder. The observer can check what the intruder is, and if the VTR 7 is not operating, operate it to record the image that detected the intruder or the image input from the TV camera. Do. If it is determined that it is not an intruder, the image is continuously captured and the above procedure is repeated.

Generally, either the difference from the background image when there is no intruder or the time-series difference between images captured at a predetermined time interval is used as the inter-pixel calculation for extracting the change. Be done. With the difference from the background image, it can be detected even if the intruder is stopped, but if the environment such as the brightness is changing, such as outdoors, the background image must be updated to find the intruder. Also has the characteristic of producing a change region. In the case of time-series difference, the difference is generally made at relatively close time intervals, so it has excellent followability to environmental changes, but it cannot be detected when an intruder stops, and the intruder moves. However, the difference between the two screens is characterized in that both the disappeared portion and the generated portion of the intruder are detected. To remove the latter drawback of time series difference,
Instead of two screens of t = ti and t = ti-1, further t = ti + 1
The method of performing the difference calculation on the front two screens and the back two screens by using the continuous three screens of, and extracting the intruder in the image of t = ti by the logical product of the two difference images obtained May be taken.

FIG. 12 is a diagram showing the timing in the case of detecting and analyzing a change by the time series difference between two consecutive images. In FIG. 12, (a) is an image capture,
(B) represents the timing of extracting and analyzing the changed area, and the area Si is from time t = ti-1 to time t = t.
Indicates that the change up to i is being analyzed.

[0005]

In the conventional image monitoring apparatus, when there are a plurality of changing regions, the analysis of the changing regions is
Since it is performed for each change area, the calculation time in the CPU is too long, which may impair the real-time property of the device. (See Figure 13)

[0006]

According to the present invention, if the analysis of the changed area for the image being processed is not completed within a predetermined time, the processing for that image is stopped to ensure the real-time property of the apparatus. The fact that the processing has been stopped and how far the processing has ended is displayed on the display device, recorded in the recording device, or notified by an alarm device.

[0007]

[Operation] The analysis of the change area for the image being processed is
If the processing is not completed within the predetermined time, the real-time property of the apparatus can be secured by stopping the processing for the image. In addition, it displays on the display device that the processing has been stopped and how far the processing has ended,
It is possible to call attention to the observer by recording on a recording device or notifying by an alarm device, and
It is possible to easily search for the scene when confirming later.

[0008]

EXAMPLE An example of the present invention will be described with reference to FIGS. FIG. 8 shows an example of the configuration of the monitoring device, and FIG. 1 shows an example of the processing device used in the present invention.

The ITV camera 1 picks up the monitoring area 8 and the picked-up image converted into an electric signal is sent by the transmission line 2 to the processing device 3, the display device 5 for displaying the picked-up image and the VTR 7. The VTR 7 records a monitoring image continuously or when an intruder is detected. On the other hand, the electric signal sent to the processing device 3 is converted into a digital signal by the A / D converter 11 by a predetermined sampling rate output from the sampling pulse generation circuit 10, and the image memory 12 is converted at a predetermined sampling interval. It is stored as image data at time t = ti (FIG. 10). In the image data of t = ti, in order to extract the change area, the pixel difference calculation is performed with the image previously captured in order to obtain the difference image, and the difference binarization circuit 14 By this, the changed pixel is converted into a differential binary image represented by "1" and stored in the differential binary memory 15 (FIG. 1).
1). The CPU 13 analyzes the change area using the difference binary image.

If the analysis of the changed area is completed within the time set by the timer 20 and it is determined that the changed area is an intruder, the alarm device 6 sounds a sound indicating that there is an intruder. Or when the monitor looks at the image on the display device 9 for confirming the intruder to check what the intruder is, or when the VTR 7 continuously records images from the ITV camera 7. Is the character 28 indicating intruder detection
(Fig. 2) A signal for cueing is added together with the VTR
If 7 is not operating, it is operated to record an image in which an intruder is detected or an image input from the ITV camera 1 and the like. If it is determined that the object is not an intruder, the image is continuously captured and the above procedure is repeated.

If the analysis of the changed area is not completed within the time set in the timer 20, the analysis of the changed area is stopped, and the analysis status at the time of the stop is stored in the CPU memory 21. The alarm device 6 generates a sound indicating that the analysis of the changed area is stopped, and the character generator 2
2 is used to generate a character string 23 indicating analysis processing cancellation and a character string 24 indicating information regarding the analysis status stored in the CPU memory 21, and the superimposer 25 performs composite display on the display device 9 (FIG. 4). VTR continuously I
When the image from the TV camera 7 is being recorded, a signal for cueing is added together with the image displayed on the display device 9 in combination, or if the VTR 7 is not in operation, it is operated. The above procedure is repeated after recording the image composited and displayed on the display device 9 or the like.

Next, a processing example of analysis of a change area will be described with reference to FIG. In the change region analysis processing unit of the processing device 3, first, the labeling calculation unit 26 labels a change region of a certain size or more in the image of the change region stored in the difference binarization memory 15, and the CPU memory It is stored in 21. The information stored at this time includes, for example, as shown in FIG. 5, the label number, the starting point of the circumscribing rectangle of the change area, the width, the height, and the like. Next, for example, the shape analysis unit 27 performs shape analysis on each labeled changed region, and the attribute information obtained by the analysis is stored in the CPU memory 21. In the case of FIG. 5, the labels 0 and 1 are "
man ”, label 2 is“ unknown ”, label 3
Recognizes as "car". This analysis processing is completed for all the labeled change regions,
The process is continued until a signal from the timer 20 indicates that the predetermined time has expired. If the image of the change area stored in the differential binarization memory 15 of FIG.
When the content of the memory 21 is as shown in FIG. 3, a predetermined time is reached, and a signal indicating that the predetermined time has expired is issued by the timer 20, and if the analysis processing is completed, the state of the CPU memory 21 becomes a character. It is sent to the generator 22, synthesized by the superimposer 25 with the input image, and displayed on the display device 9 (FIG. 4).

FIG. 6 is a diagram showing the timing when a change is detected and analyzed based on the time-series difference between two consecutive images. In FIG. 6, (a) is image capture, (b)
Indicates the timing of extracting and analyzing the changed area, and the area Si indicates that the change from time t = ti-1 to time t = ti is analyzed. FIG. 6 is an example when the analysis is completed within a predetermined time, and FIG. 7 shows time t =
This is an example including a case where the analysis of the change from ti-1 to time t = ti does not end within a predetermined time. S in FIG.
i indicates the time required to completely analyze the change from time t = ti-1 to time t = ti. In the case of FIG. 7, since si is longer than the time (ts) allowed for the analysis, the analysis of the change from the time t = ti-1 to the time t = ti is stopped at the time t = ti + ts, and the time t = From ti + 1, the change from time t = ti to time t = ti + 1 is analyzed.

In the above description, the timer 2 is used for a predetermined time.
Although it is set to 0, the set time is generally set to the image capturing interval.

In the above description, the character strings are synthesized and displayed or recorded when an intruder is detected or analysis is stopped. However, a graphic is used instead of the character string, or the display color is changed. By doing so, the same effect can be obtained.

[0016]

As described above, if the analysis of the changed area for the image being processed is not completed within a predetermined time, the real-time property of the apparatus can be secured by stopping the processing for the image. become able to.
In addition, it is possible to call attention to the monitor by displaying the fact that the processing has been stopped and how far the processing has ended on the display device, recording it in the recording device, or notifying by the alarm device. However, it is easy to search for the scene when confirming it later.

[Brief description of drawings]

FIG. 1 is a block diagram of a processing apparatus of the present invention.

FIG. 2 is an example of creating a recording screen by synthesizing a character string indicating intruder detection.

FIG. 3 is an example of a display screen when analysis is stopped midway.

FIG. 4 is an example of a display screen when analysis is stopped halfway.

FIG. 5 is an example of analysis of a change area in consideration of timeout.

FIG. 6 is an example of a timing chart of processing in the present invention.

FIG. 7 is an example of a timing chart of processing in the present invention.

FIG. 8 is an example of an image monitoring device.

FIG. 9 is an example of an internal block diagram of a processing device of a conventional image monitoring device.

FIG. 10 is an example of a captured image.

FIG. 11 is an example of a captured image.

FIG. 12 is an example of a timing chart of processing in a conventional image monitoring device.

FIG. 13 is an example of a timing chart of processing in a conventional image monitoring device.

[Explanation of symbols]

1 ... ITV camera, 2 ... Transmission device, 3 ... Processing device, 5 ...
Display device for monitoring area display, 6 ... Alarm device, 7 ... VT
R, 8 ... Monitor area, 9 ... Display device for confirming intruder.

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Shozo Abe 70 Yanagi-cho, Saiwai-ku, Kawasaki-shi, Kanagawa Toshiba Yanagimachi factory

Claims (1)

Claim: What is claimed is: 1. A means for picking up an image in a surveillance area, a means for displaying the image, and an image picked up by the image pick-up means is continuously captured, and the captured image is processed. By doing so, in the image monitoring apparatus including the detection means for detecting the intruding object in the monitoring area, if the detection processing is not completed within the predetermined time, the detection processing for the image being processed is stopped, and An image monitoring device characterized by performing detection processing on the image.