JPH0918828A - Recording device and method and reproducing device and method for digital image data - Google Patents

Abstract

PURPOSE: To provide an image data recording device which is capable of recording a moving pictures for long time. CONSTITUTION: An object is photographed by a camera 11 by a-second period. As for the image data obtained by a thirty-second period of the image data obtained by a photographing, all the image data is recorded in a magnetic tape MT. As for the image data obtained for the thirty-second period, only the data showing the image of a block in motion is recorded in the magnetic tape MT. As for the data showing the image of a motionless part, the data is recorded in the magnetic tape MT by the thirty-second period, and as for the part except the motionless part, only the data showing the image of the part of the block in motion is recorded in the magnetic tape MT. Therefore, the recording for long time can be realized.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and method for picking up an image of a subject at a constant cycle and recording image data representing the subject image on a recording medium, and a reproducing apparatus and method for the image data thus recorded.

[0002]

BACKGROUND OF THE INVENTION In financial institutions such as banks, surveillance cameras are provided for security reasons. The surveillance camera is a still image camera that shoots at a fixed cycle and records it on a micro film, and a time-lapse video that records image data representing a subject image on a video tape that is shot at a fixed cycle using a solid-state electronic image sensor. -There are combinations of cameras and ordinary video cameras. By arranging the surveillance camera, it is easy to identify the criminal in an emergency.

Among such surveillance cameras, a micro camera
A still image camera that records a subject image on film is difficult to search and cannot be searched quickly. On the other hand, in a combination of a time-lapsed video camera and a normal video camera, the amount of image data obtained by shooting becomes enormous, so that it may not be possible to record for a long time.

[0004]

DISCLOSURE OF THE INVENTION An object of the present invention is to provide an image data recording apparatus and method capable of recording for a long time.

Another object of the present invention is to relatively easily retrieve image data recorded on a recording medium.

A further object of the present invention is to make it possible to record image data representing a subject for a desired shooting time.

The digital image data recording apparatus according to the present invention is an image pickup means for picking up an image of a subject in a first cycle (for example, 1 second) and outputting picked-up image data representing the image of the subject, n times the first cycle. Recording control means for recording on the recording medium the entire image data of the object obtained by imaging the object using the imaging means in the second cycle (for example, 30 seconds) of the cycle, First represented by the captured image data output from the image capturing means
Moving object detecting means for detecting a moving portion between the subject image of the subject and the previous subject image represented by the imaged image data obtained from the image capturing means immediately before the first cycle, and the motion. A second recording control means for recording the object partial image data representing the moving portion detected by the portion detecting means on the recording medium is provided.

The present invention also provides a method of recording digital image data. That is, the subject is imaged in the first cycle, the captured image data representing the subject image is obtained, and the first image is obtained.
The first recording control process is performed to record the entire image data of the subject, which is obtained by imaging the subject in a second cycle that is n times the cycle of A moving portion between a first subject image represented by the captured image data and a previous subject image represented by the captured image data obtained by the image capturing at the time of the first cycle immediately before the detected first image. A second recording control process for recording the object partial image data representing the moving part detected by the moving part detecting process on the recording medium is performed.

According to the present invention, the subject is imaged in the first cycle, and the captured image data representing the subject image is obtained.
The captured image data obtained in the second cycle that is n times the first cycle is recorded on the recording medium as the entire subject image data.

It is detected whether or not there is a movement between the subject image represented by the captured image data obtained in the first cycle and the subject image represented by the captured image data obtained in the first cycle immediately before that. , Only data representing an image of a moving part is recorded on the recording medium.

Not all the captured image data obtained in each first cycle and representing the subject image is recorded in the recording medium, but the captured image data obtained in each first cycle is an image of a moving part. Since only the data representing the is recorded on the recording medium, a large amount of information can be recorded on the recording medium, and recording can be performed for a long time.

The image data thus recorded can be reproduced as follows.

From the viewpoint of a reproducing device, a reading means for reading the whole subject image data and the subject partial image data from a recording medium, and the whole subject image data and the subject partial image data read by the reading means are recorded. An image data generation unit that generates and outputs image data that represents the entire image of the subject by combining is provided.

From the viewpoint of a reproducing method, the subject whole image data and the subject partial image data are read from the recording medium, respectively, and the read whole subject image data and the subject partial image data are combined to obtain the subject. It is characterized in that image data representing the entire image is generated and output.

As a result, the entire image of the subject can be obtained, and even a moving portion can be represented.

In the above, the time may be measured, and the data representing the photographing time of each of the subject whole image data and the subject partial image data recorded in the recording medium may be recorded in the recording medium.

This makes it relatively easy to confirm the photographing time.

When the data representing the photographing time is recorded on the recording medium, the reproduction time interval can be designated, the data representing the photographing time is read in addition to the whole subject image data and the subject partial image data, and the image data is read. In the generation processing, image data representing the entire subject image by combining the entire subject image data and the partial subject image data at designated time intervals in accordance with the designation of the reproduction time interval by the reproduction time interval designation processing. Would be generated and output.

Further, in the moving part detecting process, the motion is detected by using different thresholds depending on the types of the color data, the brightness data and the color difference data of the picked-up image data and the subject image data. You may

The above-mentioned subject image data is converted into, for example, R
When divided into (red) data, G (green) data, and B (blue) data, the S / N of R data and B data is worse than that of G data. Therefore, G data, R data and B data
If motion detection is performed using the same threshold value for each piece of data, proper motion detection may not be possible.

In the above, color data (R data, G data, B data, etc.), luminance data, color difference data (R-
(Y, BY) etc., an appropriate threshold is used according to the type of data, so that appropriate motion detection is possible.

It is preferable that data representing a representative color in an image of a portion determined to be moving by the moving portion detection processing is recorded on the recording medium.

In this case, a color can be designated during reproduction, and a representative color of the image portion represented by the subject portion image data read from the recording medium by the reading processing is the color designation processing. Whether the color designated by the color designation process is the representative color is determined by the representative color determination process. It is assumed that image data representing the entire image of the subject is generated and output by combining the partial image data of the subject and the image data of the entire subject.

When the color of the desired subject image in the image obtained by reproduction is known in advance, the subject partial image data representing the image portion in which the designated color is judged to be the representative color and the above Image data representing the entire image of the subject is generated by combining the image data of the entire subject. By displaying the image represented by the generated image data, the moving part having the designated color among the moving parts is displayed. It is possible to quickly find and reproduce a desired subject image.

Further, it is judged whether the added time obtained by adding the photographing time of the recorded data recorded on the recording medium and the remaining recordable photographing time of the recording medium is a predetermined fixed time or more, In the above time determination process,
The whole image of the subject recorded per unit shooting time in the remaining recording area of the recording medium so that the added time is equal to or shorter than the predetermined time because it is determined that the added time is equal to or longer than a predetermined fixed time. The data amount of any one of the data and the partial image data may be reduced.

When the image data recording device is used for monitoring, it is conceivable to predetermine the photographing time to be recorded and start recording the image data on a new recording medium after the photographing time to be recorded is completed. However, the amount of image data recorded on the recording medium per unit photographing time is not constant depending on the degree of movement of the subject and the density of the subject. Therefore, the unrecorded portion of the recording medium may be exhausted before the predetermined photographing time to be recorded is recorded, so that the recording cannot be performed.

When it is determined that the added time is equal to or longer than the predetermined fixed time, it means that the unrecorded portion of the recording medium disappears before recording the predetermined photographing time to be recorded. When it is determined that the added time is equal to or longer than the predetermined fixed time as described above, the additional time is recorded in the remaining recording area of the recording medium per unit photographing time so as to be equal to or shorter than the fixed time. Since the data amount of any one of the whole subject image data and the partial image data is reduced, it is possible to record for a long time, and it is possible to record a predetermined photographing time. It is possible to always secure a fixed shooting time for recording and prevent recording omissions.

In the image data amount adjustment processing, the threshold value used for the motion determination by the motion block determination processing is reduced, the recording frequency of the whole subject image data is reduced by the first recording control processing, or the imaging is performed. This can be achieved by reducing the imaging frequency.

The recording of the entire image data of the subject on the recording medium by the first recording control processing and the second recording
When the subject partial image data is recorded on the recording medium by the recording control process described above, the image data amount reduction process reduces the compression rate in the data compression process when the data compression is performed and the data is recorded on the recording medium. It can be realized by

Further, the moving part detecting process is performed by the first
The first subject image represented by the whole subject image data obtained in the first cycle, and the whole subject image data obtained in the first period at two points immediately before and before the first period. It may be possible to determine whether or not there is any movement between the two overall images of the subject.

In the moving part detection process, when comparing the motions of two images, not only the part where the subject moved in the later image but also the part where the subject moved in the previous image It is judged that there is a movement about. For this reason, the amount of image data in the portion that is determined to be moving increases.
As described above, by determining whether or not there is movement in any of the two overall images of the subject, it is possible to prevent omission of detection of a moving portion and reduce the image data amount of the portion determined to be moving. Therefore, it is possible to lengthen the photographing time to be recorded.

Threshold setting means for setting a threshold for determining the presence or absence of a moving portion in the moving portion detecting means may be provided.

It is necessary to adjust the threshold value for determining the presence / absence of a moving part at the time of setting or when the photographing situation is changed. As described above, the threshold value can be adjusted relatively easily by providing the digital image data recording device with the threshold value setting means. Therefore, it is relatively easy to always set an appropriate threshold value.

It is determined whether or not the motion of the image of the block represented by the subject partial image data read by the reading means is larger than a fixed motion, and the image data generation process is fixed by the motion amount determination process. It is also possible to synthesize the subject whole image data and the subject partial image data in response to the determination that the movement is larger than the movement of the subject, and generate and output image data representing the whole subject image.

Since an image in which a large motion portion appears is reproduced, it is possible to quickly find a truly necessary portion.

The image pickup means is controlled so that the image pickup range is moved in parallel, and the parallel movement amount of the image pickup range which is moved in parallel is recorded on the recording medium under the control, and the motion detection process is performed by the image pickup operation. When the imaging range is moved in parallel based on the control means, the first subject image represented by the imaged image data output from the imaging means in the first cycle and the first cycle immediately before that. At the point of time, the immediately preceding subject image is configured such that the overlapping portion with the immediately preceding subject image represented by the immediately preceding captured image data obtained from the imaging means corresponds, and the immediately preceding constructed subject image and the It is also possible to detect a moving portion between one subject image.

In this case, reproduction is performed as follows. From the viewpoint of a reproducing apparatus, the whole subject image data representing the whole subject image obtained by imaging in the first cycle (for example, 30 seconds) is recorded in the recording medium in the first cycle, and The second period of the 1 / n period (for example, 1
Subject part representing an image of a part in which there is a motion between the subject image represented by the subject image data obtained by capturing the subject image data and the subject image obtained by the subject image data obtained in the second cycle immediately before. A device that reproduces image data when the image data is recorded on a recording medium, and a reading unit that reads the entire image data of the subject and the partial image data of the subject from the recording medium, and a read unit that reads the image data. It is characterized by further comprising image data generating means for generating and outputting image data representing the entire image of the subject by synthesizing the image data of the entire subject and the partial image data of the subject.

From the viewpoint of the reproduction method, the whole subject image data representing the whole subject image obtained by imaging in the first period (for example, 30 seconds) or recorded in the recording medium in the first period, and The object image represented by the object image data obtained by imaging in the second cycle (for example, 1 second) of 1 / n of the cycle and the object image data obtained in the second cycle immediately before that. This is a method of comparing whether or not there is movement with the subject image, and reproducing the image data when subject partial image data representing the image of the portion determined to have movement is recorded on the recording medium. , The subject whole image data and the subject partial image data are read from the recording medium, respectively, and the read whole subject image data and the subject partial image data are read. By combining the data, and outputs to generate image data representing the whole picture subject.

In a surveillance camera or the like, it is preferable to periodically change the photographing range, but since it is judged that all the image parts in which the photographing range is changed are moving, the image data of the moving part is recorded on the recording medium. Even if recorded, the amount of data will be large. For this reason, it is difficult to change the shooting range frequently.

In the above, the photographing range is moved in parallel,
The overlapping portion caused by the parallel movement is treated as having no movement. Therefore, even if the shooting range changes, it is determined that there is movement only in the portion where the subject has substantially moved. The amount of data representing a moving portion can be reduced, and the shooting range can be changed relatively frequently.

[0041]

[Explanation of the embodiment]

(1) First Embodiment FIG. 1 shows a first embodiment of the present invention and is a block diagram showing an electrical configuration of an image data recording apparatus including a surveillance camera. FIG. 2 shows a time chart of shooting and recording in the image data recording apparatus shown in FIG.

In the image data recording apparatus equipped with the surveillance camera, the surveillance camera 11 repeats the photographing of the subject every one second, as shown in FIG. The image data representing the whole image of the subject is recorded on the magnetic tape MT every 30 seconds, and the recording cycle of the image data representing the whole image of the subject (30 seconds)
In between, the presence / absence of movement of the subject image obtained by the photographing of the one second cycle and the subject image one second before are compared, and the moving portion (block as described later) is recorded on the magnetic tape MT. To be done. Rather than recording all the image data representing the subject image obtained for each shooting on the magnetic tape MT, the image data representing the entire subject is recorded on the magnetic tape MT at a cycle slower than the shooting cycle, and other As for the image data obtained at the time point, only the image data representing the moving portion is recorded on the recording medium. The amount of image data recorded on the magnetic tape MT per unit photographing time can be increased, and photographing and recording can be performed for a long time.

The subject is photographed by the surveillance camera 11 at a cycle of 1 second, and a video signal representing the subject image is output. The video signal is converted into digital image data in the analog / digital conversion circuit 12 and given to the frame memory 13 to be temporarily stored.

The image data stored in the frame memory 13 is read out and given to the blocking circuit 14. The block forming circuit 14 groups and outputs the image data so that the image represented by the image data output from the frame memory 13 is divided into a plurality of blocks (1 block is, for example, 8 pixels × 8 pixels). Is. The image data output from the blocking circuit 14 is given to the changeover switch 15 as input full-screen image data.

Each of the change-over switches 15 and 16 is connected to the a terminal side when recording data representing the entire image of the subject on the magnetic tape MT, and is otherwise connected to the b terminal side. The changeover switches 15 and 16 are connected to the a terminal side every 30 seconds, and are connected to the b terminal side otherwise.

When the a terminals of the change-over switches 15 and 16 are connected, the input full-screen image data representing the whole image of the subject is given to the reference frame memory 22 and temporarily stored.

The input full-screen image data is DCT (Disc
rete cosine transform) circuit 17 and discrete cosine transform is performed. The image data output from the DCT circuit 17 is quantized in the quantization circuit 18 and given to the Huffman compression circuit 19. The image data representing the entire image of the subject, which is data-compressed in the Huffman compression circuit 19, is given to the magnetic recording device 20. Image data representing the entire image of the subject is recorded on the magnetic tape MT by the magnetic recording device 20 every 30 seconds.

At times other than the time period of 30 seconds, the changeover switches 15 and 16 are both connected to the b terminal side, and image data representing the input full-screen image obtained by the photographing of the surveillance camera 11 is sent to the motion detection circuit 30. Given. The reference full-screen image data from the reference frame memory 22 is also given to the motion detection circuit 30. In the motion detection circuit 30, the input full-screen image data output from the blocking circuit 14 and the reference full-screen image data output from the reference frame memory 22 are compared, and the captured image represented by the input full-screen image data is compared. Whether there is motion between the reference image represented by the reference full-screen image data and the reference image is detected for each of the blocks divided by the blocking circuit 14. With respect to the image of the moving block, the image data representing the image of the moving block is output from the motion detection circuit 30. The motion block image data output from the motion detection circuit 30 includes the changeover switch 16 and the DCT circuit 1
7, the quantization circuit 18 and the Huffman compression circuit 19 to be applied to the magnetic recording device 20. As a result, the magnetic recording device 20 records the motion block image data on the magnetic tape MT.

The motion block image data is also given to the reference frame memory 22. When the motion block image data is given to the reference frame memory 22, the reference frame memory 22 is constantly updated according to the movement of the subject, and the image data representing the latest moving subject image is stored in the reference frame memory 22. And output as reference full-screen image data.

Image capture time data representing the input full-screen image data used to detect the motion block image data, data representing the number of motion blocks, data representing the position of the motion block, and a reference frame memory.
The full-screen flag indicating that the image data stored in 22 has been updated (set to 1 when the image data stored in the reference frame memory 22 is updated, set to 0 when not updated) It is output from the detection circuit 30 and given to the header creation circuit 21. The header creating circuit 21 creates header data (data to be recorded in an APP1 marker described later) for recording on the magnetic tape MT from the supplied data and supplies it to the magnetic recording device 20. The header data created by the header creating circuit 21 by the magnetic recording device 20 is recorded on the magnetic tape MT.

An example of data recorded on the magnetic tape MT is shown in FIG. These data are recorded every time the input full-screen image data or the motion block image data is recorded on the magnetic tape MT. Referring to FIG.
The start of image represented by the marker code “0xFFD8” represents the start of the data shown in FIG. The APP1 marker represented by the marker code “0xFFE1” is the data of the area that can be used by the user. In this embodiment, the APP1 marker is provided with the full screen flag generated in the header generation circuit 21, time data, data representing the number of motion blocks, and data representing the position of the motion block. In the quantization table represented by the marker code “0xFFD8”, the data of the table used for the quantization performed in the quantization circuit 18 is arranged. Marker code "0
In the Huffman table represented by “xFFC4”, the data of the table used in the Huffman compression circuit 19 is arranged. Marker code "0xFFC0"
In the start of frame represented by, data representing the configuration of pixels is arranged. Marker code "0
In the start-of-scan represented by “xFFDA”, data relating to the Huffman-compressed image data from the DCT is arranged, and the image data compressed in this start-of-scan is also arranged. The end of image represented by the marker code "0xFFD9" represents the end of the data shown in FIG.

FIG. 3 shows a configuration example of the motion detection circuit 30, and FIG. 4 shows a procedure of motion detection processing.

Referring to FIGS. 3 and 4, a motion detection circuit
The control unit 37 controls the operation of the unit 30. This control device 37 includes a timer and outputs the above-mentioned time data.

The input full-screen image data and the reference full-screen image data supplied to the motion detection circuit 30 are supplied to the comparison circuit 31. In the comparison circuit 31, the presence or absence of motion between the captured image represented by the input full-screen image data and the reference image represented by the reference full-screen image data is determined for each block. The number of motion blocks is also calculated (step 41). Data representing the calculated number of motion blocks is stored in the area 34 of the memory 32.

Whether it is the time to update the full screen (30
It is determined whether the second has elapsed (step 42). If it is not the time to update all screens (N in step 42)
O), the full screen flag stored in the areas 33, 34 and 35 of the memory 32, the data representing the number of motion blocks and the data representing the position of the motion block are output and supplied to the header generation circuit 21. At the full screen update time (YES in step 42), the full screen flag is set to 1 and the memory
It is stored in the area 33 of 32 (step 43). In this case, the full screen flag set to 1 is output from the memory 32 (step 44).

FIG. 6 is a block diagram showing the electrical construction of an apparatus for reproducing the magnetic tape MT on which image data is recorded by using the image data recording apparatus shown in FIG. FIG. 7 shows FIG.
5 is a flowchart showing a read control processing procedure in the reproducing apparatus shown in FIG. FIG. 8 shows an example of a multi-print image obtained from the reproducing apparatus shown in FIG.

The read control circuit 50 controls the entire operation of the reproducing apparatus shown in FIG.

In the reproducing apparatus shown in FIG. 6, the display condition is input from the input device 51, and only when the display condition is met, the print output from the printer 71 or the display device 72 is performed.
Is displayed. The display condition is, for example, a condition indicating that the image is displayed at regular time intervals or when the subject image moves.

The magnetic tape MT is set in the reproducing device,
The magnetic reproduction circuit 52 reads the image data and other data recorded on the magnetic tape MT (step 8).
1). It is determined whether or not the full screen flag is set to 1 in the data read from the magnetic tape MT (step 82).

If the full screen flag is set to 1 (YES in step 82), the image data read from the magnetic tape MT is not the data representing the image of the moving block but the image data representing the entire subject. It means that. Therefore, the image data stored in the FIFO buffer 53 is cleared (step 82). If the full screen flag is not set to 1 (NO in step 82),
Since the image data read from the magnetic tape MT is data representing an image of a moving block, the entire image of the subject cannot be formed by itself, and the FIFO
By combining with the image data of the entire subject image stored in the buffer 53, the entire subject image can be formed. Therefore, the FIFO buffer 53 is not cleared when the full screen flag is not set to 1.

The image data read by the magnetic reproducing device 52 is given to the FIFO buffer 53 and sequentially stored (step 53).

It is judged whether or not the display condition given from the input device 51 is met (step 85), and if the display condition is not met, the processes of steps 81 to 84 are repeated (NO at step 85). If the display conditions are met (YE
S), the image data stored in the FIFO buffer 53 is output (step 86).

The image data output from the FIFO buffer 53 is given to the Huffman decompression circuit 54, and Huffman decompression is performed at the decompression rate according to the data in the Huffman table. The decompressed image data output from the Huffman decompression circuit 54 is dequantized in the dequantization circuit 55, and the decompression DC
Inverse DCT is performed in the T circuit 56, and the result is given to the pixel conversion and rearrangement circuit 57. Pixel conversion and rearrangement circuit
Reference numeral 57 is a circuit that restores the image data blocked by the blocking circuit 14 to the original image data of the pixel array when recording the image data, and arranges the image data in the order of the image scanning order. The pixel conversion and rearrangement circuit 57 performs pixel conversion and rearrangement on image data suitable for display and printing. The output image data of the pixel conversion and rearrangement circuit 57 is a frame
It is given to the memory 58 and temporarily stored.

The image data stored in the frame memory 58 is the multi-screen frame memory 59 and the changeover switch.
It is given to the b terminal side of 60. The multi-screen frame memory 59 is for outputting a plurality of reduced images as one image, and can store image data for a plurality of images. The image data stored in the multi-image frame memory 59 is read and given to the a terminal side of the changeover switch 60.

When the terminal a is connected in the changeover switch 60, the image data stored in the multi-screen frame memory 59 is given to the print output circuit 61 and the analog / digital conversion circuit 62, and the printer 71 outputs the data as shown in FIG. A fine print is obtained and displayed on the display device 72.
When the terminal b of the changeover switch 60 is connected, the image data stored in the frame memory 58 is given to the print output circuit 61 and the analog / digital conversion circuit 62 so that the printer 71 can obtain a print and the display device.
Displayed at 72.

In any case, in the reproducing apparatus shown in FIG.
The reproduction process is performed according to the display condition input from the input device 51.

(2) Second Embodiment FIGS. 9 to 12 show a second embodiment of the present invention.

FIG. 9 is a block diagram showing the electrical construction of the image data recording apparatus with surveillance camera. In FIG. 9, FIG.
The same parts as those shown in FIG. FIG. 10 is a flowchart showing a procedure of motion detection processing in the image data recording device shown in FIG. Also in FIG. 10, the same processes as those shown in FIG. 4 are designated by the same reference numerals, and the description thereof will be omitted. FIG. 11 shows a processing procedure for converting to a representative color code, and FIG. 12 shows the contents of data recorded on the magnetic tape.

The image data recording apparatus shown in FIG. 9 performs motion detection processing using different threshold values for the luminance data Y and the color difference data C, respectively. FIG.
The image data recording apparatus shown in FIG. 1 also records the data representing the representative color of the image of the block in which the motion is detected on the magnetic tape MT.

The image data stored in the frame memory 13 is read and given to the YC conversion circuit 23. The YC conversion circuit 23 is a circuit for generating and outputting luminance data Y and color difference data of Cb (= BY) and Cr (= RY) from given image data. The luminance data Y and the color difference data of Cb and Cr output from the YC conversion circuit 23 are given to the color thinning circuit 24. Color thinning circuit 24 is Cb
It is a circuit for thinning out the data amount of the color difference data of Cr and Cr so as to be half the data amount of the luminance data and outputting it. For example, when shooting, 720 pixels horizontally and vertically
When the image data representing the number of pixels of 480 pixels is obtained, the luminance data Y and Cb representing the number of pixels of 720 pixels in the horizontal direction and 480 pixels in the vertical direction in the YC conversion circuit 23.
Color difference data of C and Cr are generated, but Cb and C
The color difference data of r is subjected to color thinning in the color thinning circuit 24 and becomes color difference data representing an image having a pixel number of 360 pixels in the horizontal direction and 480 pixels in the vertical direction.

The luminance data Y and the color difference data of Cb and Cr are output from the blocking circuit 14 as data for each block, passed through the changeover switch 15 and given to the motion detection circuit 30.

In the comparison circuit 31 (see FIG. 3) included in the motion detection circuit 30, threshold values for motion detection are set in accordance with the luminance data Y and the color difference data of Cb and Cr (step). 45). Since the threshold value for motion detection is set according to the luminance data Y and the color difference data of Cb and Cr, the optimum threshold value can be set according to the type and property of the data. It is possible to detect various movements. In the motion detection process, when even one type of data among the luminance data Y or the color difference data of Cb or Cr is detected to be in motion, the block represented by the data is determined to be in motion,
Luminance data Y and Cb representing the image of the block
The color difference data of Cr and Cr are output from the motion detection circuit 30 as a motion block image.

Here, the determination of the motion block is performed according to the following equation for each block.

[0074]

[Equation 1] Σ | Y _t −Y _(t-1) | ≧ Y _Th Equation 1

[0075]

[Number 2] _{Σ | Cr t -Cr (t-} 1) | ≧ Cr Th ‥‥ type 2

[0076]

## EQU3 ## Σ | Cb _t −Cb _(t-1) | ≧ Cb _Th Equation 3

In equations 1 to 3, Y _t , Cr _t and C
b _t represents the current luminance data, the color difference data of Cr and the color difference data of Cb obtained by photographing, and Y _(t-1) ,
Cr _(t-1) and Cb _(t-1) indicate luminance data obtained by photographing one second before, color difference data of Cr and color difference data of Cb, Y _Th , Cr _Th and Cb _Th are luminance data, The thresholds used for motion detection of the Cr color difference data and the Cb color difference data are shown. If all of Expressions 1 to 3 are satisfied, it is determined that there is motion, and if any of Expressions 1 to 3 is not satisfied, it is determined that there is no motion.

The representative color of the image representing the motion block detected by the motion detection circuit 30 is also the motion detection circuit.
Detected at 30. The detection of this representative color is performed as follows.

Referring to FIG. 11, luminance data Y and C
The color difference data of b and Cr has 8 bits, and the lower 3 bits of the 8-bit data are cut off to obtain 5-bit luminance data Y and Cb and Cr color difference data. Memory of motion detection circuit 30
32 includes a color code conversion table, and the color code conversion table is referred to detect the representative color of the image of the motion block represented by the luminance data Y and the color difference data of Cb and Cr. The data representing this representative color is output from the motion detection circuit as a representative color code and given to the header generation circuit 21.

In the header generation circuit 21, time data,
Data of number of motion blocks, data of motion block position,
In addition to the full screen flag, the data is arranged so as to be recorded on the magnetic tape MT with respect to the representative color code and is given to the magnetic recording device 20. As a result, as shown in FIG. 12, the representative color code for the motion block is recorded on the APP1 marker indicated by the marker code “0xFFE1”.

The magnetic tape MT recorded by the image data recording apparatus shown in FIG. 9 can be reproduced by using the image data reproducing apparatus shown in FIG.

In the image data recording apparatus shown in FIG. 9, since the representative color code representing the representative color of the image of the motion block is recorded on the magnetic tape MT, only the portion of the specific color is designated and the It is possible to display only a moving part having a specified color as a moving image. In this case, the color is first designated using the input device of the image data reproducing device shown in FIG.

Full-screen image data representing the entire image of the subject is read from the magnetic tape MT and stored in the FIFO buffer. The representative color code stored in the magnetic tape MT is also read and given to the read control circuit 50. When the representative color code represents a color designated by the input device 50, the image data of the motion block having the representative color code is stored in the FIFO buffer 53. When the representative color code does not represent the color designated by the input device 50, the image data of the motion block having the representative color code is not stored in the FIFO buffer 53.

The image data stored in the FIFO buffer 53 is read out, and the Huffman expansion circuit 54, the inverse quantization circuit 55,
Inverse DCT circuit 56, pixel conversion rearrangement circuit 57, frame
It is given to the display device 72 via the memory 58, the changeover switch 60 and the analog / digital conversion circuit 62. As a result, on the display device 72, a moving part, which is a part of the subject having the color designated by the input device 51, is displayed as a moving image. When the user wants to see the movement of a desired subject, if the color of the subject is known, the movement of the desired subject can be seen simply by designating the color of the subject.

(3) Third Embodiment FIGS. 13 to 18 show a third embodiment.

In the third embodiment, the field of view of the surveillance camera is moved to record an image over a wide range. There are methods such as zooming out to widen the field of view, but this method increases the amount of image data to be recorded and also deteriorates the resolution. In this embodiment, it is intended to obtain image data over a wide range while moving the surveillance camera and to reduce the amount of image data to be recorded as much as possible.

FIG. 13 is a block diagram showing the electrical construction of an image data recording device with a surveillance camera. In FIG. 13, the same parts as those shown in FIG. 1 are designated by the same reference numerals and the description thereof will be omitted.

In the image data recording apparatus with a surveillance camera shown in FIG. 13, the camera 11 is provided with the camera platform 10, and the photographing direction can be changed by controlling the camera platform. For example, when the subject is being photographed as shown in the upper left part of Fig. 17, by controlling the pan head 10, Δ
It is possible to capture an image in the X, downward shift by ΔY (see area A _{0 in the} upper right part of FIG. 17).

In the image data recording apparatus shown in FIG. 13, a camera platform control circuit 3 is provided to control the camera platform 10.

FIG. 14 shows a processing procedure for pan head control.

When changing the photographing direction, the photographing direction instruction input device 2 inputs the photographing direction instruction (step 8).
1). Data representing the shooting direction instruction input is given to the camera platform control circuit 3. In the camera platform control circuit 3, how much the shooting direction instruction input provided to the shooting direction instruction input device 2 deviates from the current shooting direction in the horizontal direction (the amount of deviation in the horizontal direction is ΔX) and in the vertical direction. The amount of deviation (the amount of deviation in the vertical direction is ΔY) is calculated (step 82). Data representing the horizontal shift amount ΔX and the vertical shift amount ΔY are given to the recording control circuit 7 and the motion detection circuit 6, respectively. Also, the amount of deviation in the horizontal direction Δ
The data representing X is supplied to the X-direction drive circuit 4, and the data representing the vertical shift amount ΔY is supplied to the Y-direction drive circuit 5.

The motion detecting circuit 6 receives the data representing the deviation amounts ΔX and ΔY output from the camera platform control circuit 3, calculates the movement amount in the photographing direction, and calculates the deviation amounts ΔX and ΔY.
Is set to be an integral multiple of the size of the block generated in the block formation circuit 14, and the horizontal shift amount ΔX
Is a circuit for generating and outputting the correction data of and the correction data of the deviation amount ΔY in the vertical direction. The correction data of the deviation amount ΔX output from the motion detection circuit 6 is the X-direction drive circuit 4
The correction data of the shift amount ΔY is given to the Y-direction drive circuit 5. The X-direction drive circuit 4 controls the horizontal direction of the camera platform 10 to an amount that is an integral multiple of the size of the block and that is closest to the deviation amount ΔX given from the camera platform control circuit 3. Also, the Y-direction drive circuit 5 sets the pan head 10 to an amount that is an integral multiple of the size of the block and that is closest to the deviation amount ΔY given from the pan-head control circuit 3.
Is controlled in the vertical direction (steps 83 and 84).

X-direction drive circuit 4 and Y-direction drive circuit 5
The camera platform 11 controls the camera platform 10 so that the camera 11 shoots in the shooting direction designated by the shooting direction designation input device 2.

The image data obtained by photographing the subject is supplied to the motion detection circuit 30 for each block and compared with the reference full-screen image data supplied from the reference frame memory 22 for each block.

Since the reference frame memory 22 stores the reference full-screen image data, which is updated every 30 seconds and represents the entire image of the subject, it can be obtained by photographing when the camera 11 is moved and the photographing direction changes a little. The image and the image represented by the reference full-screen image data stored in the reference frame memory 22 do not have a portion corresponding to the corresponding position, and are displaced. Therefore, in the motion detection in the motion detection circuit 30, it is considered that the entire subject has moved, and all the images obtained by shooting are output from the motion detection circuit 30 as motion block images. Therefore, the shooting direction cannot be changed frequently. For example, there is a reference image represented by reference full-screen image data stored in the reference frame memory 22 as shown in the lower left of FIG.
As shown in the upper left of FIG. 17, when the camera 11 is shooting in the same direction as this reference image, only the part that has moved within the shooting range indicated by the solid line is determined by the motion detection circuit 30 as a motion block. When the photographing direction is moved by the horizontal direction ΔX and the vertical direction ΔY as shown in the upper right of FIG. 17, the reference image shown in the lower left of FIG. 17 and the captured image shown by the solid line in the upper right of FIG. 17 are compared. Since the shooting directions of these images are deviated, it is assumed that all the subjects within the shooting range in which motion detection is performed have moved.

Therefore, in the image data recording apparatus shown in FIG. 13, the reading of the reference full-screen image data stored in the reference frame memory 22 is changed according to the shift amounts ΔX and ΔY of the camera 11 in the shooting direction. doing. That is, even if the shooting direction of the camera 11 is deviated, the reference full-screen image data is read from the reference frame memory 22 so as to correspond to the reference image for the image portion common to the shot image and the reference image. It For example, as shown in the upper part of FIG. 17, when the camera platform 10 is controlled and the shooting direction is deviated, the reference frame memory 22 displays the reference image representing the reference image obtained by the shooting before the camera platform 10 is controlled. When the screen image data is stored, the overlapping area of the captured image after the platform control and the reference image (in the case of FIG. 17, the captured image area A ₀₃ and the reference image area A ₁₃ overlap). Are searched based on the deviation amounts ΔX and ΔY. Further, the non-overlapping regions (the captured image regions A ₀₁ and A ₀₂ and the reference image regions A ₁₁ and A _{12 in the} case of FIG. 17) of the captured image and the reference image after the platform control are searched. Regarding the area A _{13 of the} reference image that overlaps with the captured image after pan head control, the reading of the reference frame memory 22 is controlled so as to be compared with the corresponding area A ₀₃ of the captured image. Areas A ₁₁ and A ₁₂ of the reference image that do not overlap with the shot image after the platform control are stored in the reference frame memory 22 so as to form one image as shown in the lower right diagram of FIG. The reading of image data is controlled. For example, in the case shown in FIG. 17, the areas A ₀₁ and A ₀₂ of the photographed image after the platform control are compared with the areas A ₁₁ and A _{12 of the} reference image, and the image data from the reference frame memory 22 is detected so as to detect the motion. Is controlled. In this case, since the areas A ₀₁ and A ₁₁ and the areas A ₀₂ and A ₁₂ generally represent completely different parts, the areas A ₀₁ and A ₀₂ of the photographed image are judged to be moving parts, and The motion detection circuit 30 will output the image data representing the areas A ₀₁ and A ₀₂ .

Data representing the deviation amounts ΔX and ΔY in the photographing direction are given from the recording control circuit 7 to the magnetic recording device 20. In addition to data such as time data, the magnetic recording device 20 also records data representing the deviation amounts ΔX and ΔY on the magnetic tape MT. The data representing the deviation amounts ΔX and ΔY is the same as the time data A as shown in FIG.
It is stored in the PP1 marker.

When the camera platform control process is not performed in the image data recording device shown in FIG. 13, the motion detection process is performed in the process procedure shown in FIG.

FIG. 18 shows a reading processing procedure when the pan head control is performed and the recording processing is performed in the image data recording apparatus shown in FIG. 18, the same processes as those in FIG. 7 are designated by the same reference numerals and the description thereof will be omitted. Even a magnetic tape MT on which image data is recorded by using the image data recording device shown in FIG. 13 can be reproduced by using the image data reproducing device shown in FIG.

When the shift amounts ΔX and ΔY are recorded on the magnetic tape MT, the photographing direction is moved by the pan head control, and the reading of the reference frame memory 22 is controlled as described above to detect the motion. That is the case. For this reason, the original captured image cannot be restored when the full-screen image data stored in the FIFO buffer 53 is read as it is.

Therefore, in the read control process shown in FIG. 18, when various data of the APP1 marker is read from the magnetic tape MT (step 87), the shift amounts ΔX and ΔY are detected.
Is set and the reading of the image data stored in the FIFO buffer 53 is controlled (step 88). For example, F
The image represented by the full-screen image data stored in the IFO buffer 53 is the lower left reference image in FIG. 17, but the image compared with the captured image in motion detection during recording is the lower right reference in FIG. It is an image. Therefore the FIF
The reading is controlled so that the image data representing the reference image at the lower right of FIG. 17 is output from the O buffer 53.

When image data is read from the FIFO buffer 53, it is confirmed whether all the data stored in the FIFO buffer 53 has been read (step 89). When all the data stored in FIFO buffer 53 is read (YES in step 89), the next data is read.

The image corresponding to the captured image is restored at the time of reproduction.

(4) Fourth Embodiment FIGS. 19 and 20 show a fourth embodiment.

FIG. 19 is a block diagram showing the electrical construction of the image data recording apparatus with a surveillance camera. 19 in FIG.
The same parts as those shown in FIG.

The image data recording device shown in FIG. 19 is a device capable of increasing the amount of recorded image data per unit photographing time.

In the image data recording apparatus, a photographing time to be recorded on the magnetic tape MT is expected, and a new recording is made after the photographing time to be recorded has elapsed or when the magnetic tape MT has no unrecorded area and recording cannot be performed. Replaced with magnetic tape MT. However, the amount of image data recorded on the magnetic tape MT per unit shooting time is not constant depending on the degree of movement of the subject and the density of the subject.
Therefore, the unrecorded area of the magnetic tape MT may be exhausted before recording for a predetermined shooting time to be recorded, and recording may not be possible. In such a case, if it is not known that the unrecorded area has disappeared in the magnetic tape MT, it cannot be replaced with a new magnetic tape MT, so that the recording of image data cannot be continued, and even if the camera 11 shoots the unrecorded area. It takes time.

The image data recording apparatus shown in FIG. 19 reduces the recording data amount per unit photographing time when the remaining recordable time of the magnetic tape MT becomes short and recording cannot be performed during the photographing time that should be recorded in advance. However, the previously expected shooting time for recording on the magnetic tape MT is secured.

FIG. 20 is a flow chart showing the procedure for changing the recording data amount per unit photographing time.

First, the recording control circuit 8 calculates the photographing time until now (step 91). It is determined whether or not the calculated shooting time has reached a predetermined determination time (step 92), and when the determination time is reached (YES in step 92), the remaining capacity of the magnetic tape MT is checked (step 93). ). Subsequently, the photographing time at which the image data can be recorded is calculated based on the remaining capacity of the magnetic tape MT (step 94). This recordable shooting time is calculated based on the shooting time up to now and the amount of image data recorded on the magnetic tape MT. That is, it is assumed that the subject having the average density of the subjects photographed so far moves with the average movement of the subjects photographed so far, and the photographing time recordable in the remaining capacity of the magnetic tape MT is calculated. .

The calculated recordable photographing time is compared with the remaining photographing time required for recording the predetermined photographing time (step 95). If the recordable shooting time exceeds the remaining shooting time (NO in step 95),
Since recording can be performed during the shooting time predicted in advance, shooting and recording can be continued as they are. If the recordable time is less than the remaining recording time (YES in step 95), recording will not be possible during the shooting time predicted in advance. Therefore, in this case, the recording amount changing process is performed so that the amount of image data recorded on the magnetic tape MT per unit shooting time is reduced (step 9).
6). This recording amount change processing is performed by controlling the photographing cycle of the camera 11, storing the full-screen image data stored in the reference frame memory 22 and the full-screen image data recorded on the magnetic tape MT, controlling the recording cycle, and detecting the motion. This can be realized by controlling the threshold value in the circuit 30 or controlling the compression rate in the quantization circuit 18. Of course, the recording amount changing process may be performed by combining a plurality of these controls.

Of these recording amount changing processes, first, the camera
The control of the shooting cycle of 11 will be described.

In the image data recording apparatus shown in FIG. 19, the photographing of a subject is usually repeated at a cycle of 1 second. In such a case, there is no problem from the viewpoint of monitoring for crime prevention even if the shooting cycle is delayed a little. Therefore, the recording control circuit 8 controls the camera 11 so that the photographing cycle of the camera 11 is delayed. For example, by delaying the shooting cycle from 1 second to 1.1 seconds, the amount of image data recorded per unit shooting time can be reduced by about 10%.

Next, the processing for changing the recording amount by controlling the storage and recording cycle of the full-screen image data stored in the reference frame memory 22 and the full-screen image data recorded on the magnetic tape MT will be described.

The image data recording apparatus shown in FIG. 19 normally records the image data representing the entire image of the subject on the magnetic tape MT at a period of 30 seconds and stores it in the reference frame memory 22 as shown in FIG. The reference full-screen image data is updated. During the period of 30 seconds, only the moving block image data is recorded in the captured subject image. Changeover switches 15 and 16, a reference frame memory 22, a DCT circuit 1 so as to delay the cycle of recording the image data representing the entire image of the subject on the magnetic tape MT.
7, the quantization circuit 18, the Huffman compression circuit 19 and the magnetic recording device 20 are controlled. For example, by delaying the period of recording the image data representing the entire image of the subject on the magnetic tape MT from the period of 30 seconds to the period of 60 seconds, the amount of image data recorded per unit photographing time can be reduced by about 20%. In this case, the reference frame memory 22 is also updated in accordance with the recording of the image data representing the entire image of the subject image on the magnetic tape MT.

Next, the process of changing the recording amount by controlling the threshold value in the motion detecting circuit 30 will be described.

The image data recording apparatus shown in FIG. 19 has an image represented by the input full-screen image data obtained by photographing and a reference image represented by the reference full-screen image data stored in the reference frame memory 22. It is detected for each block whether or not there is a movement between them, and for the portion having the movement, image data representing the portion having the movement is recorded on the magnetic tape MT. In this motion detection, a threshold value is used to determine whether there is motion. If this threshold value is made small, motion can be detected even if it is a small motion, but if it is too small, it is judged to be moving even if there is no motion due to the influence of noise.
The optimum threshold is empirically determined. By increasing the threshold value in the motion detection circuit 30, the number of blocks in the motion detection circuit 30 that are determined to be moving is reduced. For this reason, it is possible to reduce the amount of image data representing a moving portion recorded on the magnetic tape MT per unit shooting time.

Next, the process of changing the recording amount by controlling the compression rate in the quantizing circuit 18 will be described.

In the image data recording apparatus shown in FIG. 19, the quantization circuit 18 quantizes using a predetermined quantization table, Huffman-compresses it, and records it on the magnetic tape MT. By increasing the quantization step in the quantization circuit 18, the recording amount of image data per unit shooting time can be reduced.

In any case, by reducing the recording amount of the image data per unit photographing time, it becomes possible to record the image data for a predetermined photographing time.

(5) Fifth Embodiment FIGS. 21 to 24 show a fifth embodiment.

FIG. 21 is a block diagram showing the electrical construction of the image data recording apparatus with surveillance camera. 21, the same parts as those shown in FIG. 1 are designated by the same reference numerals and the description thereof will be omitted. FIG. 22 is a flowchart showing a procedure of motion detection processing in the image data recording device shown in FIG. Figure 23
(A), (B) and (C) show the motion detection.

The image data recording device with a surveillance camera shown in FIG. 21 is provided with another reference frame memory 25 in addition to the reference frame memory 22. The first reference frame memory 22 stores the first reference full-screen image data representing the reference image that has moved immediately before the image pickup by the camera 11. This first reference full-screen image data is given to the motion detection circuit 30. Also the first reference frame
When the next reference full-screen image data is stored in the memory 22, the first reference full-screen image data stored in the first reference frame memory 22 is given to and stored in the second reference frame memory 25. To be done. Therefore, the first reference frame memory 22 stores the reference full-screen image data immediately before the input full-screen image data obtained by photographing,
The second reference frame memory 25 stores second reference full-screen image data representing a reference image moved immediately before the reference full-screen image data stored in the first reference frame memory 22. .

For example, the image obtained by the current photographing is shown in FIG. 23 (C), the reference image having a motion immediately before that is shown in FIG. 23 (B), and the image having a motion immediately before that is shown in FIG.
If it is (A), the first reference frame memory 22
The first reference image data representing the first reference image shown in FIG. 23 (B) is stored in the second reference frame memory 25.
In FIG. 23A, the second reference image data representing the second reference image shown in FIG. 23 (A) is stored.

First reference frame memory 22 and second
The first reference full-screen image data and the second reference full-screen image data stored in the reference frame memory 25 are supplied to the motion detection circuit 30. In the motion detection circuit 30, the input full-screen image shown in FIG. 23 (C) and the reference full-screen image shown in FIG. 23 (B) are compared, and the input full-screen image shown in FIG. The reference full-screen image shown in (A) is compared. In the motion detection circuit 30, only the image of the block whose input full-screen image is determined to be moving with respect to both the first reference full-screen image and the second reference full-screen image has a motion. Judged as a block image. Figure
In the examples shown in 23 (A), (B), and (C), the area A _{1 in the} input full-screen image shown in FIG. 23 (C) moves when compared with the reference full-screen image shown in FIG. 23 (B). However, when compared with the reference full-screen image shown in Fig. 23 (A), there is no motion, so it is determined that there is no motion. On the other hand, since the area A _{2 in the} input full-screen image shown in FIG. 23 (C) is moving compared to any of the reference full-screen images shown in FIGS. 23 (A) and (B), it is regarded as a moving area. To be judged. Image data representing the area A ₂ is output from the motion detection circuit 30 as motion block image data (in the example shown in FIGS. 23A, 23B and 23C, only the object Ob moves. Motion detection portion) Is only this object Ob, but is represented by area A ₁ and area A ₂ for convenience).

The motion detection process in the image data recording apparatus shown in FIG. 21 will be described with reference to FIG.

First, the input full-screen image (FIG. 23 (C)) obtained by photographing with the camera 11 and the first reference frame
The first reference full-screen image (FIG. 23 (B)) represented by the reference full-screen image data read from the memory 22 is compared for each block (step 101). It is determined in this comparison whether there is any movement (step 10).
2). If there is no motion (NO in step 102), motion detection is performed on the input full-screen image obtained by the next shooting. When it is determined that there is movement (step 102)
YES), the input full-screen image (Fig. 23 (C)) and the second reference full-screen image represented by the reference full-screen image data read from the second reference frame memory 25 (Fig. 23 (A)).
And are compared block by block (step 103). In this comparison, it is determined whether there is any movement (step 104). If there is a motion, since the image of the block of the input full-screen image is moving for both the first reference full-screen image and the second reference full-screen image, the block is not moved for the first time (step 105). If there is no movement between the input full-screen image (Fig. 23 (C)) and the second reference full-screen image (Fig. 23 (A)) (NO in step 104), the input full-screen image (Fig. 23 (C)). )) And the first reference full-screen image (Fig. 23 (B))
Even if there is a motion between and, it is not determined that there is motion, and motion detection is performed for the input full-screen image obtained by the next shooting.

In the image data recording apparatus shown in FIG. 21, if it is not determined that the input full-screen image is moving with respect to both the first reference full-screen image and the second reference full-screen image, Even if it is determined that there is motion only for the image of, it is not determined that there is motion. Therefore, the area A ₂ after the moving object Ob has moved is determined to be moving, but the area A ₁ existing before the moving object Ob has moved is determined to be unmoving. Therefore, it is determined that only a part of the subject where the actually moved object has moved is determined to be in motion, and the amount of image data representing the motion block image can be substantially deleted.

FIG. 24 is a flow chart showing another processing procedure of the motion detection processing in the image data recording apparatus shown in FIG.

The motion detection process shown in FIG. 22 compares the input full-screen image with the first reference full-screen image, and compares the block image determined to have motion with the second reference full-screen image. On the other hand, the motion detection process shown in FIG. 24 is performed regardless of whether the input full-screen image and the first reference full-screen image or the second reference full-screen image are moving. The reference full-screen image and the input full-screen image are compared with the second reference full-screen image to detect motion.

Referring to FIG. 24, the motion detection circuit 30 receives image data representing the input full-screen image via the changeover switch 15 and the first reference frame memory 22 outputs the first image data.
Reference full-screen image data is given (step 111
). For each block, input full screen image data and first
The difference sum S1 from the reference full-screen image data is calculated (step 112).

Further, the motion detection circuit 30 includes a changeover switch 15
The image data representing the input full-screen image and the second reference full-screen image data output from the second reference frame memory 25 are provided via (step 113). The difference sum S2 between the input full-screen image data and the second reference full-screen image data is calculated for each block (step 11).
Four).

It is judged whether the smaller one of these difference sums S1 and S2 (denoted as S) is larger than the motion detection threshold value (step 115,
116). When the difference sum S is larger than the motion detection threshold value, it is determined that there is motion (step 117), and when it is smaller than the motion detection threshold value, it is determined that there is no motion (step 118).

Also in the processing shown in FIG. 24, if the input full-screen image is not determined to be moving with respect to both the first reference full-screen image and the second reference full-screen image, it means that there is motion. Not judged. Therefore, as shown in FIG. 23 (C), the area A ₂ after the moving object Ob has moved is judged to be moving, but the area A ₁ existing before the moving object Ob moves. Is judged to have no movement. For this reason, it is determined that only the part of the subject where the actually moved object has moved is determined to be in motion, and the amount of image data representing the motion block image can be substantially reduced.

In the image data recording apparatus shown in FIG. 21, the threshold value used in the motion detecting circuit 30 can be set by the user. The procedure of this threshold value setting process is shown in the flowchart of FIG. The threshold value setting process shown in FIG. 25 is performed in threshold value control circuit 10.
The threshold control circuit 10 is also provided with an input device 10A used for threshold setting. This threshold setting is premised on the case where motion detection is determined when the difference sum of data between the input image and the reference image is a certain value or more.

With reference to FIGS. 21 and 25, the input device 10A
Is used to set the number of times of photographing N (step 121).
Subsequently, the camera 11 is used to photograph a reference image, image data representing the reference image is read from the frame memory 13 and supplied to the threshold control circuit 10 (step 12).
2). Image data representing a plurality of specific pixels is extracted from the image data representing the reference image (step 123).
). The processing of steps 122 and 123 is performed by the input device 10A.
The process is repeated until the number N of times of photographing set by is reached (step 124).

Among N reference images obtained by N times of photographing, the standard deviation is calculated according to the equation 1 for each pixel existing at the same position.

[0138]

## EQU4 ## S = {Σ (x _i −X) ² / N} ^1/2 ... Equation 4

In Expression 4, x _i is the pixel level and X is the average value of the pixel levels.

The largest value S _{max of} the standard deviations obtained from Equation 1 is selected. 2 of this selected value S _max
The doubled value is set in the motion detection circuit 30 as a threshold value.
If the noise variation follows a normal distribution by setting in this way, motion detection can be performed without being significantly affected by noise.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an electrical configuration of an image data recording device with a surveillance camera.

FIG. 2 is a time chart of shooting and recording.

FIG. 3 is a block diagram showing an electrical configuration of a motion detection circuit.

FIG. 4 is a flowchart showing a processing procedure of motion detection.

FIG. 5 shows the contents of data recorded on a magnetic tape.

FIG. 6 is a block diagram showing an electrical configuration of the image data reproducing device.

FIG. 7 is a flowchart showing a processing procedure of read control.

FIG. 8 shows an example of a print image.

FIG. 9 is a block diagram showing an electrical configuration of an image data recording device with a surveillance camera.

FIG. 10 is a flowchart showing a processing procedure for motion detection.

FIG. 11 shows a processing procedure for calculating a representative color code.

FIG. 12 shows an example of data recorded on a magnetic tape.

FIG. 13 is a block diagram showing an electrical configuration of an image data recording device with a surveillance camera.

FIG. 14 is a flowchart showing a processing procedure for pan head control.

FIG. 15 is a flowchart showing a processing procedure of motion detection when pan head control is performed.

FIG. 16 shows an example of data recorded on a magnetic tape.

FIG. 17 shows an example of a captured image and a reference image when the camera platform is controlled.

FIG. 18 is a flowchart showing a read control processing procedure.

FIG. 19 is a block diagram showing an electrical configuration of an image data recording device with a surveillance camera.

FIG. 20 is a flowchart showing a processing procedure of recording for a predetermined shooting time.

FIG. 21 is a block diagram showing an electrical configuration of an image data recording device with a surveillance camera.

FIG. 22 is a flowchart showing a processing procedure for motion detection.

23A and 23B show examples of reference images,
(C) shows an example of the input image.

FIG. 24 is a flowchart showing a processing procedure for motion detection.

FIG. 25 is a flowchart showing a threshold value setting processing procedure.

[Explanation of symbols]

 11 Camera 14 Blocking circuit 15, 16 Changeover switch 20 Magnetic recording device 22 Reference frame memory 30 Motion detection circuit MT Magnetic tape

Claims (30)

[Claims] 1. An image pickup means for picking up an image of a subject in a first cycle and outputting picked-up image data representing the subject image.
A first recording control means for recording on the recording medium the entire image data of the object obtained by imaging the object with the imaging means in a second cycle which is n times the cycle of Between the first subject image represented by the captured image data output from the image capturing means and the previous subject image represented by the captured image data obtained from the image capturing means at the time point of the first cycle immediately before that. Digitally provided with a moving portion detecting means for detecting a certain moving portion, and second recording control means for recording subject partial image data representing the moving portion detected by the moving portion detecting means on the recording medium. Image data recording device. 2. A photographing means for measuring time, and photographing for recording on the recording medium data representing photographing times of the whole image data of the subject and the partial image data of the subject recorded on the recording medium. The digital image data recording apparatus according to claim 1, further comprising time data recording control means. 3. The moving part detecting means detects a moving part using different thresholds according to the types of the color data, the brightness data and the color difference data of the captured image data. The image data recording device according to claim 1, wherein 4. A representative color data recording control means for recording, on the recording medium, data representing a representative color in an image of a portion in which movement is detected by the movement portion detecting means. 1. The digital image data recording device described in 1. 5. A judgment is made as to whether or not the added time obtained by adding the photographing time of the recorded data recorded on the recording medium and the recordable photographing time to the rest of the recording medium is a predetermined fixed time or more. The time determination means and the time determination means determine that the addition time is longer than or equal to a predetermined fixed time, and thus the unit is set in the remaining recording area of the recording medium so that the addition time is equal to or shorter than the predetermined time 2. The digital image data recording apparatus according to claim 1, further comprising image data amount adjusting means for reducing a data amount of at least one of the entire image data of the subject and the partial image data recorded per shooting time. 6. The image data amount adjusting means lowers a threshold value used for motion determination by the moving part detecting means, lowers the recording frequency of the whole subject image data by the first recording control means, or A decrease in the frequency of image pickup by the image pickup means reduces the data amount of at least one of the whole image data of the subject and the partial image data recorded in the remaining recording area of the recording medium per unit photographing time. The digital image data recording device according to claim 5. 7. The data compression is performed by recording the whole image data of the subject on the recording medium by the first recording control means and recording the partial image data of the subject on the recording medium by the second recording control means. The data is recorded on the recording medium, and the image data amount adjusting means reduces the compression rate in the data compression processing,
6. The digital according to claim 5, wherein the amount of data of at least one of the entire image data of the subject and the partial image data recorded per unit shooting time in the remaining recording area of the recording medium is reduced. Image data recording device. 8. The moving part detecting means includes a first object image represented by the entire object image data obtained in the first cycle, and two images immediately before and before the first cycle. 2. The apparatus for recording digital image data according to claim 1, wherein it is determined whether or not there is any movement with respect to two subject whole images represented by the whole subject image data obtained in the first period at the time. . 9. The digital image data recording apparatus according to claim 1, further comprising threshold setting means for setting a threshold for determining the presence or absence of a moving portion in said moving portion detecting means. 10. An imaging control means for controlling the imaging means so that the imaging range is translated, and a translation amount of the imaging range translated under the control of the imaging control means is recorded on the recording medium. Image pickup image data output from the image pickup means in the first cycle when the movement detecting means makes parallel movement of the image pickup range based on the image pickup control means. And the immediately preceding subject image represented by the immediately preceding captured image data obtained from the image capturing means at the time of the first cycle immediately before the immediately preceding subject image. 2. The digital image according to claim 1, wherein the subject image is formed, and a moving portion between the immediately preceding formed subject image and the first subject image is detected. Data recording device. 11. Object whole image data representing a whole object image obtained by imaging in a first cycle is recorded in a recording medium in the first cycle, and has a cycle of 1 / n of the first cycle. Represents an image of a portion in which there is a movement between the subject image represented by the subject image data obtained by capturing in the second cycle and the subject image obtained by the subject image data obtained in the second cycle immediately before the subject image. A device for reproducing image data when subject partial image data is recorded on a recording medium, and a reading unit that reads the entire subject image data and the subject partial image data from the recording medium, and a read unit that reads the reading unit. The image data representing the entire image of the subject is generated by synthesizing the obtained whole image data of the subject and the partial image data of the subject. A digital image data reproducing device having image data generating means for outputting the image data. 12. A motion amount determination means for determining whether or not a movement of an image of a portion represented by the subject partial image data read by the reading means is larger than a certain movement, and the image data generation means includes , The subject whole image data and the subject partial image data are combined in response to the movement amount judging means judging that the movement is larger than a certain movement, and image data representing the whole subject image is generated and output. The digital image data reproducing device according to claim 11, which is a digital image data reproducing device. 13. A reproduction time interval designating unit for designating a reproduction time interval, wherein the recording medium stores time data representing a photographing time of the subject whole image data and the subject partial image data in the subject whole image data. And is recorded corresponding to the above-mentioned subject partial image data,
The reading means reads the time data in addition to the whole image data of the subject and the partial image data of the subject, and the image data generating means responds to the designation of the reproduction time interval by the reproduction time interval designating means. Then, the image data representing the entire image of the subject is generated and output by synthesizing the image data of the entire subject and the partial image data of the subject at specified time intervals.
12. The digital image data reproducing device according to claim 11. 14. A color designating means for designating a color, and a representative color of an image portion represented by the subject partial image data read from the recording medium by the reading means is designated by the color designating means. An image portion in which a representative color determination means for determining whether or not the color corresponds is provided, and the image data generation means determines that the color designated by the color designation means is a representative color by the representative color determination means. The image data representing the entire subject image is generated and output by synthesizing the object partial image data representing the subject and the entire subject image data.
11. A digital image data reproducing device according to item 11. 15. The whole subject image data representing the whole subject image obtained by imaging in the first cycle is recorded on a recording medium, and is recorded when the imaging range is translated. The first subject image represented by the captured image data output from the image capturing means in the first cycle, and the entire subject image data immediately before obtained from the image capturing means at the time of the first cycle immediately before the first subject image. The immediately preceding whole subject image is configured so that the overlapping portion with the immediately preceding whole subject image represented corresponds, and there is a moving part between the immediately preceding constituted subject image and the first subject image. Is a device that reproduces image data when subject partial image data representing the above and parallel movement amount data indicating the parallel movement amount are recorded in the recording medium,
Reading means for reading the whole image data of the subject, the partial image data of the subject and the parallel movement amount data from the recording medium, and the whole image data of the subject and the subject based on the parallel movement amount data read by the reading means. A digital image data reproducing device comprising image data generating means for generating and outputting image data representing an entire image of a subject from partial image data. 16. A subject obtained by picking up an image of a subject in a first cycle, obtaining picked-up image data representing a subject image, and picking up an image of a subject in a second cycle that is n times the first cycle. A first recording control process of recording the entire image data on a recording medium is performed, and a first subject image represented by the imaged image data obtained by the imaging in the first cycle and the first cycle immediately before that. At a point of time, the moving part existing between the front image of the object represented by the imaged image data obtained by the above-mentioned imaging is detected, and the object partial image data representing the moving part detected by the moving part detecting process is A digital image data recording method for performing a second recording control process for recording on a recording medium. 17. The time is measured in advance, and the data representing the photographing time of each of the subject whole image data and the subject partial image data recorded in the recording medium is recorded in the recording medium. Recording method of digital image data described in. 18. The moving part detecting process determines whether or not there is a motion using different thresholds according to the types of the color data, the brightness data and the color difference data of the captured image data. 17. The image data recording method according to claim 16, wherein the determination is made for each block divided by the image blocking means. 19. The digital image data recording method according to claim 16, wherein data representing a representative color in an image of a portion determined to have movement by the moving portion detection processing is recorded on the recording medium. 20. It is determined whether or not the added time obtained by adding the shooting time of the recorded data recorded on the recording medium and the recording time that can be recorded on the rest of the recording medium is a predetermined fixed time or more. , In the above time determination process,
The whole image of the subject recorded per unit shooting time in the remaining recording area of the recording medium so that the added time is equal to or shorter than the predetermined time because it is determined that the added time is equal to or longer than a predetermined fixed time. The digital image data recording method according to claim 16, wherein the data amount of at least one of the data and the partial image data is reduced. 21. The image data amount adjustment processing lowers a threshold value used for motion determination by the moving portion detection processing, lowers the recording frequency of the entire subject image data by the first recording control processing, or A reduction in the imaging frequency due to imaging reduces the data amount of at least one of the entire image data of the subject and the partial image data recorded per unit imaging time in the remaining recording area of the recording medium. Item 20. The digital image data recording method according to Item 20. 22. Recording of the whole image data of a subject on the recording medium by the first recording control process and the second recording
The recording of the subject partial image data on the recording medium by the recording control process of No. 1 is performed by performing data compression and recording on the recording medium, and the image data amount reduction process reduces the compression rate in the data compression process. The data amount of at least one of the whole image data of the subject and the partial image data recorded per unit shooting time in the remaining recording area of the recording medium is thereby reduced. Recording method of the described digital image data. 23. The moving part detecting process includes a first subject image represented by the whole subject image data obtained in the first period, and two images immediately before and before the first period. 17. The method for recording digital image data according to claim 16, wherein it is determined whether or not there is any movement between two subject whole images represented by the whole subject image data obtained in the first period at the time. . 24. A threshold value for determining the presence or absence of a moving portion in the moving portion detecting means can be set.
The method for recording digital image data according to claim 16. 25. The image pickup means is controlled so that the image pickup range moves in parallel, and the amount of parallel movement of the image pickup range moved in parallel under the image pickup control is recorded in the recording medium. A first subject image represented by the imaged image data output from the image pickup means in the first cycle when the imaging range is translated in parallel based on the image pickup control means, and the first object image immediately before the first object image. The immediately preceding subject image is configured such that the overlapping portion with the immediately preceding subject image represented by the immediately preceding captured image data obtained from the imaging means at the time of one cycle corresponds to the immediately preceding configured subject image. 17. The method for recording digital image data according to claim 16, which detects a moving portion between the first subject image and the first subject image. 26. Object whole image data representing an entire object image obtained by imaging in a first cycle is recorded on a recording medium in the first cycle, and has a cycle of 1 / n of the first cycle. It is compared whether or not there is motion between the subject image represented by the subject image data obtained by capturing in the second cycle and the subject image obtained by the subject image data obtained in the second cycle immediately before the subject image data. Is a method for reproducing image data when subject part image data representing an image of a part determined to be moving is recorded on a recording medium, and the whole subject image data and the subject part are recorded from the recording medium. Read each image data,
A method of reproducing digital image data, which synthesizes the read whole image data of the subject and the partial image data of the subject to generate and output image data representing the whole image of the subject. 27. It is determined whether the movement of the image of the portion represented by the subject partial image data read by the reading means is larger than a certain movement, and the image data generation processing is the movement amount determination processing. 27. The subject image data and the subject partial image data are combined in response to the determination that the movement is larger than a certain movement by, and image data representing the entire subject image is generated and output. A method for reproducing digital image data according to. 28. A reproduction time interval can be designated, and time data representing the photographing time of the subject whole image data and the subject partial image data is stored in the recording medium, the whole subject image data and the subject partial image data. Is recorded corresponding to the above, the reading process reads the time data in addition to the entire subject image data and the subject partial image data, and the image data generation process specifies the reproduction time interval. The image data representing the entire image of the subject is generated and output by synthesizing the entire image data of the subject and the partial image data of the subject at a designated time interval according to the designation of the reproduction time interval by the processing. 27. The digital image data reproducing method according to claim 26. 29. A color can be designated, and a representative color of an image portion represented by the subject partial image data read from the recording medium by the reading processing corresponds to the color designated by the color specifying processing. The image data generation process determines whether or not the image data generation process represents the image part in which the color designated by the color designation process is determined to be a representative color by the representative color determination process and the subject partial image data and the subject. 27. The digital image data reproducing method according to claim 26, wherein image data representing the entire image of the subject is generated and output by combining with the entire image data. 30. The subject whole image data representing the whole subject image obtained by imaging in the first cycle is recorded on a recording medium, and is recorded when the photographing range is translated. It is represented by a first subject image represented by the captured image data output from the image capturing means in the first cycle, and by the entire subject image data immediately before obtained from the image capturing means at the time of the first cycle immediately before. The immediately preceding subject entire image is configured such that the overlapping portions with the immediately preceding subject entire image correspond to each other, and a moving portion between the immediately preceding constituted subject image and the first subject image is detected. This is a method of reproducing image data when the object partial image data represented and the parallel movement amount data representing the parallel movement amount are recorded on the recording medium. An image representing the entire subject image from the entire subject image data and the subject partial image data based on the read parallel displacement amount data by reading the entire image data of the object, the subject partial image data, and the parallel displacement amount data. A method for reproducing digital image data that generates and outputs data.