JPH0863683A - Picture monitor device - Google Patents

Abstract

PURPOSE: To detect the occurrence of abnormality in a monitor place only with picture information to monitor it by detecting the change of sunshine or the like in the monitor place to update a reference picture. CONSTITUTION: The reference picture is preliminarily stored in a picture storage part 13 and a newly inputted monitor picture is stored there with respect to the picture signal from a monitor camera 1, and the difference between picture data read out from the picture storage part 13 is calculated by an operation processing part 17, and the calculation result is binarized, and data is stored in a difference picture storage part 18. Respective picture data are differentiated and are stored in a differential picture storage part 22, and the difference is calculated, and the calculation result is binarized, and data is stored in a differential difference picture storage part 21. The size of a prescribed difference value part read out from the difference picture storage part 18 and the differential difference picture storage part 21 is calculated and is compared with a prescribed reference value by a comparison means consisting of a reference value setting part 6, an area discrimination part 7, and a comparison part 8, thus updating the reference picture or the monitor place or detecting the occurrence of abnormality in the monitor place.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image monitoring apparatus for detecting the movement of a moving body in a monitoring area based only on image information.

[0002]

2. Description of the Related Art A conventional monitoring system has a sound sensor or an ultrasonic sensor attached to a monitoring place,
These sensors detect movements of people or the like at the surveillance location, and the image sent from the surveillance camera allows the situation of the surveillance location to be seen. Alternatively, a device in which a monitoring area is monitored only by image information has been developed, and the device is provided with two image memories, and a reference image captured by a monitoring camera is stored in one image memory and the other is stored in the other. The evaluation image of the subsequent monitoring location was stored in the image memory, the image data stored in both image memories were compared, and if a difference was detected, it was considered that an abnormality had occurred and abnormality information was generated. .

[0003]

However, the method of attaching a voice sensor or an ultrasonic sensor to the monitoring place has a problem that the monitoring position is fixed and the sensor installation work is required, which is troublesome. Further, in a method in which two image memories are provided and the initial image and the image at the subsequent monitoring location are read out from the respective memories and compared, there is a possibility that a change in sunshine at the monitoring location may be regarded as an abnormal occurrence and detected. It was The present invention is capable of detecting a change in sunshine of a surveillance place and updating the reference image and continuously comparing the evaluation image of the surveillance place with the reference image to monitor the occurrence of an abnormality in the surveillance place. The purpose is to be able to detect and monitor only the image information from.

[0004]

An image monitoring apparatus according to the first invention of the present application has an input section for inputting an image signal picked up by a surveillance camera, and a reference image for an image input from the input section. As a reference image storage unit, an evaluation image storage unit that stores a newly input image as a monitoring image, and a difference between image data read from the reference image storage unit and the evaluation image storage unit And the calculation result is 2
A differential operation is performed on the image data read from the arithmetic processing unit for binarization, the differential image storage unit for storing the differential data binarized by the arithmetic processing unit, the reference image storage unit and the evaluation image storage unit. An image read out from each of the differential operation section for performing the operation, the differential reference image storage section and the differential evaluation image storage section that store the operation results of the differential operation section, the differential reference image storage section and the differential evaluation image storage section, respectively. For the data,
An arithmetic processing unit for calculating a difference and binarizing an operation result;
The differential difference image storage unit that stores the differential difference data binarized by the calculation processing unit and the size of the predetermined difference value portion read from the difference image storage unit are calculated, and the preset first reference is set. A second comparing means for comparing a value with a first comparing means, and a second comparing value for calculating a size of a predetermined differential difference value portion read from the differential difference image storage section and comparing the preset second reference value. Means and a control unit for controlling the above respective units are provided.

An image monitoring apparatus according to the second invention of the present application is characterized in that a display section is provided in the control section, and an image signal picked up by a surveillance camera input from the input section is displayed on the display section. To do. In the image monitoring apparatus of the third invention of the present application, the control unit is provided with an alarm generation unit, and in the comparison by the first comparison unit, the size of the predetermined difference value portion read from the difference image storage unit is the above-mentioned. A state in which the first reference value is exceeded, and the size of the predetermined differential difference value portion read from the differential difference image storage unit in the comparison by the second comparison means exceeds the second reference value. When it becomes, it is characterized in that the alarm generation unit notifies the abnormality occurrence.

In the image monitoring apparatus according to the fourth aspect of the present invention, the size of the predetermined difference value portion read from the difference image storage unit exceeds the first reference value in the comparison by the first comparing means. When the size of the predetermined differential difference value portion read from the differential difference image storage unit is smaller than the second reference value in the comparison by the second comparing means, the evaluation image is displayed. As the reference image, the reference image storage unit and the differential reference image storage unit are updated. In the image monitoring apparatus according to the fifth aspect of the present invention, the first reference value and the second reference value are set in advance based on the size of the moving body that the first and second comparison means desire to detect. A reference value setting unit, an area determination unit that calculates the size of the predetermined difference value portion read from the difference image storage unit, and the size of the predetermined differential difference value portion read from the differential difference image storage unit; It is characterized by comprising a comparison unit for comparing the reference value read from the reference value setting unit and the calculation result of the area determination unit.

[0007]

According to the present invention, with the above-described configuration, the image in the normal state of the monitoring place is stored in advance in the reference image storage unit as the reference image, and the newly input image is stored in the evaluation image storage unit as the monitoring image. With respect to the image data read from the reference image storage unit and the evaluation image storage unit, the difference is calculated and binarized to calculate the size of the predetermined difference value portion, and based on the size of the moving body desired to be detected. The comparison is made with the set first reference value, and when a change occurs in the image of the monitoring place, the size of the predetermined difference value portion exceeds the first reference value. Further, with respect to the image data read from the reference image storage unit and the evaluation image storage unit, each is differentiated,
Further, the difference is calculated and binarized to calculate the size of the predetermined differential difference value portion, and the size is compared with the second reference value set based on the size of the moving body desired to be detected. However, since the difference value does not make a difference with respect to the change of the entire screen such as, the size of the predetermined differential difference value portion becomes smaller than the second reference value, and when the moving body appears on the screen, The size of the predetermined differential difference value portion exceeds the second reference value.

Therefore, when the size of the predetermined difference value portion is smaller than the first reference value, the monitoring state is continued without any abnormality, and when the size of the predetermined difference value portion exceeds the first reference value, The size of the predetermined differential difference value portion is determined, and when it is smaller than the second reference value, it is regarded as a change in the entire screen such as sunshine,
The reference image stored in the reference image storage unit is updated and the newly input image is used as the reference image. When the second reference value is exceeded, the moving body appears on the screen, and the alarm generation unit outputs the reference image. Outputs a signal that an abnormality has occurred. Therefore, it becomes possible to detect and monitor the occurrence of an abnormality in the monitoring place only with the image information from the monitoring camera.

[0009]

1 is a block diagram showing an embodiment of an image monitoring apparatus of the present invention, and FIG. 3 is a flow chart for explaining an abnormality detecting procedure of the image monitoring apparatus of the present invention. An example will be described with reference to FIGS.
The input unit 3 is composed of a surveillance camera 1 and an A / D converter 2, and the A / D converter 2 converts the image signal of the surveillance place imaged by the surveillance camera 1 into a digital signal and outputs the digital signal. ) 4 controls each part according to the program stored in the ROM 5, takes in the input image signal of the monitoring place, inputs it to the display unit 10 to display the image of the monitoring place, and at the same time as step S1. The image signal of the monitoring place in the normal state is stored in the reference image storage unit 11 of the image storage unit 13 as the reference image signal. In step S2, the reference image signal of the monitoring location read from the reference image storage unit 11 is input to the arithmetic processing unit 17, and the differential arithmetic unit 16 of the arithmetic processing unit 17 differentiates the differential image storage unit 2
2 and stores it in the differential reference image storage unit 19 of the differential image storage unit 22.

After that, in step S3, the monitoring image of the monitoring place is fetched from the input section 3 as an evaluation image and stored in the evaluation image storage section 12 of the image storage section 13, and then in step S4.
Then, the difference calculation unit 14 of the calculation processing unit 17 calculates the difference between the reference image signal of the monitoring location read from the reference image storage unit 11 and the evaluation image signal of the monitoring location read from the evaluation image storage unit 12. The binarization processing unit 15 takes into consideration an error such as noise and binarizes it by a predetermined threshold value. For example, a difference value larger than the predetermined threshold value is set to “1” and smaller than the predetermined threshold value. The difference value is stored in the difference image storage unit 18 as “0”. In step S5, the portion of the data “1” stored in the difference image storage unit 18 is read out,
The area determining unit 7 counts the portion of the data “1” (the number of pixels in which the pixel data is “1”) and calculates the area of the portion of the difference value “1”.

A value that is slightly smaller than the size of the moving object to be detected on the screen is set in advance in the reference value setting unit 6 as the predetermined value (S1), and small animals such as cats and dogs can be detected.
Alternatively, the detection error may not occur, and step S6 is performed.
At the comparison unit 8, the predetermined value set in the reference value setting unit 6 (S
1) is compared with the area of the portion having the difference value “1” calculated by the area determination unit 7 to determine whether the area is larger than a predetermined value (S1). FIG. 2 is an explanatory diagram for explaining the principle of the image monitoring apparatus of the present invention. As shown in FIG. 2 (A), the size of the binarized difference image is the same when there is no change in the monitoring location. When the value becomes smaller than the predetermined value (S1) and the sunshine changes to shade the monitoring place as shown in FIG. 2 (B), or a person enters the monitoring place as shown in FIG. 2 (C). If so, the size of the binarized difference image exceeds a predetermined value (S1). When the area is smaller than the predetermined value (S1), the process returns to step S3, and the procedure following step S3 is repeated to continue monitoring the monitoring place.

If the area is larger than the predetermined value (S1), it means that the condition of the monitoring place has changed.
7, the evaluation image of the monitoring location read from the evaluation image storage unit 12 in step S7 is differentiated by the differential operation unit 16 of the operation processing unit 17 and transferred to the differential image storage unit 22,
It is stored in the differential evaluation image storage unit 20 of the differential image storage unit 22. In step S8, the differential values stored in the differential reference image storage unit 19 and the differential evaluation image storage unit 20 are read out, the difference calculation unit 14 calculates the difference, and the binarization processing unit 15 determines a predetermined value in consideration of an error such as noise. Is binarized by the threshold value of, for example, the differential difference value larger than the predetermined threshold value is set to “1”,
The differential difference value smaller than the predetermined threshold value is stored as “0” in the differential difference image storage unit 21 of the differential image storage unit 22. In step S9, the portion of the data “1” stored in the differential difference image storage unit 21 is read, and the area determination unit 7 determines the portion of the data “1” (the number of pixels for which the pixel data is “1”). The area is counted and the area of the differential differential value "1" is calculated.

A small value, which is slightly smaller than the size of the moving object to be detected on the screen, is set in the reference value setting unit 6 as the predetermined value (S2) in advance, and small animals such as cats and dogs can be detected.
Alternatively, the detection error may not occur and step S1
At 0, the predetermined value (S2) set in the reference value setting section 6 in the comparison section 8 and the differential difference value "1" calculated in the area determination section 7
The areas of the parts are compared to determine whether the area is larger than a predetermined value (S2). As shown in FIG. 2 (B), the change of the whole screen when the sunshine changes and the monitoring place becomes shade,
Since there is no change in the differential image, the binarized differential difference image is smaller than the predetermined value (S2). In this case, there is no abnormality in the monitoring place, but there is a change in the background such as sunshine, and step S11. In step S11, the image stored in the evaluation image storage unit 12 is used as the reference image to update the reference image storage unit 11, and the image stored in the differential evaluation image storage unit 20 is used as the reference image. The reference image storage unit 19 is updated, the process returns to step S3, and the procedure from step S3 is repeated.

As shown in FIG. 2C, when a person enters the monitoring place, the size of the binarized differential difference image exceeds a predetermined value (S2). At this time, the process proceeds to step S12 to input a signal to the alarm generation unit 9 to generate a sound in the alarm generation unit 9 to notify the occurrence of an abnormality, or to generate a signal and input it to the display unit 10. Display the error occurrence on the screen. Therefore, it is possible to detect changes in the sunshine of the surveillance place and update it as a reference image, and by continuously comparing the evaluation image of the surveillance place with the reference image, the surveillance camera can detect an abnormality occurrence at the surveillance place. It is possible to detect and monitor only the image information of.

In the embodiment shown in FIG. 1, the differential image storage unit 22 is provided with the differential evaluation image storage unit 20 and the differential difference image storage unit 21, but the differential difference image storage unit 21 is omitted and the differential evaluation image is omitted. The storage unit 20 may be updated to store the differential difference image. At this time, in step S11 of the flowchart of FIG.
The reference image storage unit 11 uses the image stored in the reference image as a reference image.
And the differential calculation unit 16 of the calculation processing unit 17
Are differentiated and stored in the differential reference image storage unit 19 of the differential image storage unit 22. With this configuration,
One storage unit can be deleted and the cost can be reduced.

[0016]

As described above, according to the present invention,
The difference between the reference image and the evaluation image is calculated, and based on the result of the calculation, it is determined whether the monitoring place has changed. If the monitoring place has changed, the reference image and the evaluation image are differentiated from each other, and The difference between the differential results of is calculated, and based on the result of the calculation, it is determined whether the change of the entire screen such as sunshine or the change in which the moving object appears on the screen. It can be updated as an image, and when a moving object appears on the screen, the alarm generation unit outputs an abnormality occurrence signal.Therefore, an abnormality occurrence at the surveillance location can be detected only by the image information from the surveillance camera. An image monitoring device capable of detecting and monitoring can be provided.

[Brief description of drawings]

FIG. 1 is a block diagram showing an embodiment of an image monitoring apparatus of the present invention.

FIG. 2 is an explanatory diagram illustrating the principle of the image monitoring apparatus of the present invention.

FIG. 3 is a flowchart illustrating an abnormality detection procedure of the image monitoring apparatus of the present invention.

[Explanation of symbols]

 1 Monitoring Camera 2 A / D Converter 3 Input Section 4 Microcomputer 5 ROM 6 Reference Value Setting Section 7 Area Judgment Section 8 Comparison Section 9 Alarm Generation Section 10 Display Section 11 Reference Image Storage Section 12 Evaluation Image Storage Section 13 Image Storage Section 14 Difference calculation unit 15 Binarization processing unit 16 Differential calculation unit 17 Calculation processing unit 18 Difference image storage unit 19 Differential reference image storage unit 20 Differential evaluation image storage unit 21 Differential difference image storage unit 22 Differential image storage unit

Claims (5)

[Claims] 1. An input unit for inputting an image signal picked up by a surveillance camera, a reference image storage unit for storing a reference image in advance for an image input from this input unit, and a newly input image. Of the image data read from the reference image storage unit and the evaluation image storage unit, and an arithmetic processing unit for binarizing the arithmetic result. A differential image storage unit for storing the differential data binarized by the processing unit, a differential operation unit for performing differential operations on the image data read from the reference image storage unit and the evaluation image storage unit, and the differential operation A differential reference image storage unit and a differential evaluation image storage unit that respectively store the calculation results of the calculation unit, and a difference is calculated for the image data read from the differential reference image storage unit and the differential evaluation image storage unit. The operation processing unit that binarizes the calculation result, the differential difference image storage unit that stores the differential difference data binarized by the operation processing unit, and the size of the predetermined difference value portion read from the difference image storage unit. And a preset second value which is calculated by calculating the size of the predetermined differential difference value portion read from the differential difference image storage unit. An image monitoring apparatus, comprising: a second comparing means for comparing the reference value of 1. with a control section for controlling the respective sections. 2. The image monitoring apparatus according to claim 1, wherein the control unit is provided with a display unit, and the image signal captured by the monitoring camera, which is input from the input unit, is displayed on the display unit. . 3. An alarm generation unit is provided in the control unit, and the size of the predetermined difference value portion read from the difference image storage unit in the comparison by the first comparison unit is equal to the first reference value. If the size of the predetermined differential difference value portion read from the differential difference image storage unit exceeds the second reference value in the comparison by the second comparing means, The image monitoring apparatus according to claim 1, wherein the alarm generation unit notifies that an abnormality has occurred. 4. In the comparison by the first comparison means,
When the size of the predetermined difference value portion read from the difference image storage unit exceeds the first reference value,
In the comparison by the comparison means, the size of the predetermined differential difference value portion read from the differential difference image storage unit is the second
The image monitoring apparatus according to claim 1, wherein when the state becomes smaller than the reference value of, the evaluation image is used as a reference image and the reference image storage unit and the differential reference image storage unit are updated. 5. A reference value setting unit for setting the first reference value and the second reference value in advance based on the size of the moving body desired to be detected by the first and second comparing means. , The size of the predetermined difference value portion read from the difference image storage unit,
And an area determination unit that calculates the size of the predetermined differential difference value portion read from the differential difference image storage unit, and a comparison that compares the reference value read from the reference value setting unit and the calculation result of the area determination unit. The image monitoring apparatus according to claim 1, 3, or 4, further comprising a section.