JP3606634B2 - Image data recording apparatus, digital image data recording method, and digital image data reproducing apparatus and method - Google Patents

Description

[0001]
【Technical field】
The present invention relates to a digital video tape recorder (DVTR), a method for recording digital image data in the DVTR, and a playback apparatus and method for digital image data recorded on a magnetic tape by this DVTR or this recording method.
[0002]
BACKGROUND OF THE INVENTION
A digital video tape recorder (DVTR) captures a subject using a solid-state electronic image sensor such as a CCD, converts a video signal representing the subject image obtained by the imaging into digital image data, and applies it to a magnetic tape. To record. A CCD used in a digital video tape recorder generally has a horizontal direction of 720 pixels × vertical direction of 480 pixels = about 350,000 pixels. In the DVTR, when recording a moving image, interlace readout of the CCD is performed at a constant cycle, and a field image consisting of pixels in odd rows and a field image consisting of pixels in even rows are alternately obtained, and image data for one frame is obtained. obtain. This is because the shooting cycle can be shortened, and even a fast-moving subject can record a smooth moving image. Image data for one frame is recorded on a magnetic tape using a recording area of 10 tracks over a time period of 1/30 seconds.
[0003]
In a digital video tape recorder, one frame of image data out of digital image data obtained by photographing a subject using a 350,000 pixel CCD is recorded on 10 tracks over 1/30 second. This recording method has become a standard in the industry (see, for example, NIKKEI ELECTRONICS BOOKS “Data Compression and Digital Modulation”, pages 137 to 152, Nikkei Business Publications, 1993).
[0004]
When a moving image is reproduced, a frame image is formed by alternately providing a field image made up of odd-numbered pixels and a field image made up of even-numbered pixels, and is displayed on the television apparatus.
[0005]
In order to obtain a desired scene as a print, DVTRs that have a still image reproduction function in addition to a moving image reproduction function have been developed. However, when a field image obtained in moving image recording is printed, the field image is composed of pixels in odd rows or even rows, so that the vertical resolution is low and high quality printing cannot be obtained.
[0006]
In order to reproduce a moving image with smooth motion, it is necessary to increase the shooting cycle. However, in order to meet the above-mentioned standard, the number of pixels cannot be increased. On the other hand, in order to obtain a high-quality still image, the number of pixels must be increased. As described above, in the digital video tape recorder, the demand for moving picture reproduction and the demand for still picture reproduction are contradictory.
[0007]
For this reason, some analog video tape recorders record a signal representing a still image in a PCM audio recording area of the video tape by compressing it as necessary (for example, Japanese Patent Laid-Open No. 4-13277). ). However, with this method, it is difficult to record all video signals for generating a high-quality complete still image for one frame in the PCM audio recording area, and many PCM audio recording areas are used for recording all of them. There must be.
[0008]
DISCLOSURE OF THE INVENTION
An object of the present invention is to obtain a high-quality still image and a moving image with smooth motion.
[0009]
A digital image data recording apparatus according to a first aspect of the invention includes a solid-state electronic image sensor that generates image data having a data amount n times the data amount of unit image data for a single frame image. An imaging unit that outputs captured image data representing a subject image obtained by imaging in a first cycle, and n frames output from the imaging unit during a second period n times the first cycle. Image data dividing means for dividing the captured image data of a predetermined frame of the captured image data into divided image data each representing an image of one frame and having the data amount of the unit image data; The divided image data representing one of the frames and the captured image data of the other frames excluding the predetermined frame out of the captured image data for the n frames and the one frame. Difference data generating means for calculating difference data with extracted image data corresponding to image data (representing an image of one frame and having a data amount of unit image data), and all the data obtained by the division by the image data dividing means The divided image data is divided into n unit image data recording areas of the recording medium and recorded, and the difference data obtained by the difference data generating means is recorded in an auxiliary recording area other than the unit image data recording area of the recording medium. The recording control means is provided.
[0010]
The first invention also provides a method for recording image data. That is, it includes a solid-state electronic image sensor that generates image data having a data amount n times the data amount of unit image data for one frame image. The captured image data representing the subject image is captured by the solid-state electronic image sensor. The captured image data for a predetermined frame out of the captured image data for n frames obtained by the imaging during the second period n times the first period, each of which is an image of one frame. And divided into divided image data having the data amount of the unit image data, divided image data representing one frame of the divided image data, and the predetermined image of the captured image data for the n frames. The difference data with the extracted image data extracted from the captured image data of other frames excluding one frame and corresponding to the divided image data of the one frame is calculated, and divided by the image data dividing process. Thus, all the divided image data obtained are divided and recorded in n unit image data recording areas of the recording medium, and the difference data obtained by the difference data generation process is recorded in the area other than the unit image data recording area of the recording medium. It records in the auxiliary recording area.
[0011]
In the first invention, the unit image data corresponds to one frame image data in the current industry standard described above. The first imaging cycle is 1/30 seconds, for example, and the second imaging cycle is 1/15 seconds, for example.
[0012]
In the first invention, a solid-state electronic image sensor that generates image data having a data amount n times the image data amount of unit image data is used. Since a solid-state electronic image sensor having a large number of pixels is used, a high-quality image is captured at the stage of imaging.
[0013]
In the first invention, the captured image data for a predetermined frame during the second imaging cycle is divided so as to have a data amount of unit image data, and the recording medium is recorded in accordance with a standard recording method. It is recorded in the unit image data recording area.
[0014]
In this way, the image quality of the high-quality image data obtained by imaging is stored as it is and recorded in a form that conforms to the conventional standard. Therefore, as described later, it is possible to reproduce a high-quality still image.
[0015]
In the first invention, the difference data is recorded in the auxiliary recording area of the recording medium. The difference data is extracted from the divided image data representing one frame of the divided image data and the captured image data of other frames excluding the predetermined one of the n frames of captured image data, and It represents the difference from the extracted image data corresponding to the divided image data. Image data obtained by imaging the subject in the first imaging cycle other than the time of the second imaging cycle from the image data recorded in the unit image data recording area and the difference data recorded in the auxiliary recording area Can be restored. As a result, an image representing an image during the second imaging cycle can also be generated, and a moving image with smooth motion can be reproduced.
[0016]
A digital image data recording apparatus according to a second aspect of the present invention includes a solid-state electronic image sensor that generates image data having a data amount n times the data amount of unit image data for one frame image. An imaging unit that outputs captured image data representing a subject image obtained by imaging in a first cycle, and n frames output from the imaging unit during a second period n times the first cycle. Image data dividing means for dividing the captured image data of a predetermined frame of the captured image data into divided image data each representing an image of one frame and having the data amount of the unit image data; The divided image data representing one of the frames and the captured image data of the other frames excluding the predetermined frame out of the captured image data for the n frames and the one frame. Difference data generating means for calculating difference data with extracted image data corresponding to image data (representing an image of one frame and having a data amount of unit image data), and recording the imaged image data for the predetermined frame described above It comprises recording control means for recording in the image data recording area of the medium and recording the difference data obtained by the difference data generating means in an auxiliary recording area other than the image data recording area of the recording medium. To do.
[0017]
The second invention also provides a digital image data recording method. That is, it includes a solid-state electronic image sensor that generates image data having a data amount n times the data amount of unit image data for one frame image. The captured image data representing the subject image is captured by the solid-state electronic image sensor. Captured image data for a predetermined frame among the captured image data for n frames obtained by the imaging during a second cycle that is n times the first cycle, respectively. Is divided into divided image data having a data amount of the unit image data, and divided image data representing one frame of the divided image data and captured image data of the n frames Difference data with respect to the extracted image data extracted from the captured image data of the other frames excluding the predetermined one frame and the extracted image data corresponding to the divided image data of the one frame is calculated. Recording the image image data in the image data recording area of the recording medium, the difference data obtained by said difference data generating process, characterized in that recorded in the auxiliary recording area other than the image data recording area of the recording medium.
[0018]
In the second invention, the unit image data corresponds to one-field image data in the current industry standard described above. The first imaging cycle is 1/60 seconds, for example, and the second imaging cycle is 1/30 seconds, for example.
[0019]
In the second invention, a solid-state electronic image sensor that generates image data having a data amount n times the image data amount of unit image data (field image data) is used. Since a solid-state electronic image sensor having a large number of pixels is used, a high-quality image is captured at the stage of imaging.
[0020]
Also in the second invention, the captured image data for a predetermined frame during the second imaging cycle is divided so as to have a data amount of unit image data. It is recorded in the unit image data recording area.
[0021]
In this way, the image quality of the high-quality image data obtained by imaging is stored as it is and recorded in a form that conforms to the conventional standard. Therefore, as described later, it is possible to reproduce a high-quality still image.
[0022]
Also in the second aspect, the difference data is recorded in the auxiliary recording area of the recording medium. Therefore, by reproducing the difference data recorded in the auxiliary recording area and the image data recorded in the image data recording area, a data amount n times the unit image data obtained by photographing during the second photographing period can be obtained. The stored image data can be restored. As a result, an image representing an image during the second imaging cycle can also be generated, and a moving image with smooth motion can be reproduced.
[0023]
In the above, the part corresponding to the part detected by the motion detection process is detected by detecting a part having a motion between images represented by the image data obtained by the first imaging cycle by the imaging. The difference data obtained by the difference data generation may be recorded in the auxiliary recording area.
[0024]
As a result, the amount of difference data recorded in the auxiliary recording area can be reduced.
[0025]
Further, the difference data obtained by the difference data calculation process may be compressed, and the difference data compressed by the compression process may be recorded in the auxiliary recording area.
[0026]
Even in this case, the amount of difference data recorded in the auxiliary recording area can be substantially reduced. In this case, at the time of reproduction, the compressed differential data is subjected to data expansion.
[0027]
The apparatus and method for reproducing digital image data according to the present invention reproduces image data from a recording medium recorded as described above. This reproducing apparatus and method can be applied to the above-described digital video tape recorder or can be realized as an independent digital image data reproducing apparatus.
[0028]
If the digital image data reproducing apparatus is defined from the viewpoint of moving image reproduction, the reproducing apparatus reads the divided image data recorded in the unit image data recording area of the recording medium and the difference data recorded in the auxiliary recording area. From the reading means, and the divided image data and the difference data read by the reading means, other than a predetermined one frame output from the imaging means at the time of the first imaging period between the second imaging periods. It is characterized by comprising moving image reproduction image data generation means for generating and outputting captured image data.
[0029]
The digital image data reproduction method reads the divided image data recorded in the unit image data recording area of the recording medium and the difference data recorded in the auxiliary recording area, and from the read divided image data and difference data, Characterized as generating and outputting captured image data other than a predetermined frame at the time of the first period between the second periods.
[0030]
If the digital image data playback device is defined from the viewpoint of playback of moving images and still images, the playback device is divided into divided image data recorded in the unit image data recording area of the recording medium and differential data recorded in the auxiliary recording area. Reading means, mode setting means for selectively setting a still reproduction mode and a movie reproduction mode, and when the still reproduction mode is set by the mode setting means, it is divided into n unit image data recording areas. Still image data generating means for generating image data representing a still image of one frame by synthesizing the recorded divided image data, and reading by the reading means when the movie playback mode is set by the mode setting means From the divided image data and the difference data obtained, the first image during the second imaging cycle is obtained. It characterized at the time of the shooting period of as having a video playback image data generating means for generating and outputting the captured image data other than the predetermined one frame output from the image pickup means.
[0031]
The digital image data reproducing method reads the divided image data recorded in the unit image data recording area of the recording medium and the difference data recorded in the auxiliary recording area, and selectively selects a still reproduction mode or a movie reproduction mode. When the still playback mode is set, image data representing a still image of one frame is generated by combining the divided image data recorded in the n unit image data recording areas. Then, when the movie playback mode is set, from the read divided image data and difference data, an imaging moving image other than a predetermined frame at the time of the first period between the second periods It is characterized as generating and outputting image data for reproduction.
[0032]
Image data is read from the image data recording area of the recording medium. The divided image data separately recorded in the image data recording area is synthesized so as to represent the original still image. The synthesized still image data is given to a display device for display, or given to a printer to print a still image.
[0033]
Since the image data obtained from the solid-state electronic image pickup device having a large number of pixels is restored as it is, a high-quality still image can be obtained.
[0034]
In moving image reproduction, difference data recorded in the auxiliary recording area is read. From this difference data and the image data read from the image data recording area, it is possible to restore the image data (image data having n times the data amount) to be obtained during the second imaging cycle.
[0035]
Since the image data representing the image during the second shooting cycle can be restored, it is possible to reproduce a moving image with smooth motion even for a moving subject.
[0036]
When the differential data is compressed and recorded in the auxiliary recording area, the read differential data is subjected to data expansion. Image data representing an image during the second imaging cycle is restored using the difference data that has been decompressed.
[0037]
A digital image data recording apparatus according to a third aspect of the invention includes a solid-state electronic image sensor that generates image data having a data amount n times as large as unit image data for a single frame image. Imaging unit for outputting captured image data representing a subject image obtained by imaging in a first cycle, and image data having the n times data amount output from the imaging unit in the first shooting cycle as the unit Image data extraction means for extracting image data output from the imaging means so as to form a single image each having a data amount of image data; a second imaging that is n times the first imaging period Image data of a predetermined frame of the imaged image data output from the imaging unit during the cycle and extracted by the image data extracting unit. Difference data calculating means for calculating difference data between the remaining image data and the image data of the predetermined frame taken by the image data extracting means, and the image data extracting means. A recording control means for recording the recorded image data in a unit image data recording area of the recording medium and recording the difference data output from the difference data calculating means in an auxiliary recording area other than the unit image data recording area. It is characterized by that.
[0038]
The third invention also provides a digital image data recording method. That is, a captured image representing a subject image obtained by imaging a subject with the solid-state electronic imaging device, including a solid-state electronic imaging device that generates image data having a data amount n times the data amount of unit image data for one frame image. Imaging means for outputting data in a first cycle, and image data having the n times the amount of data output in the first shooting cycle by the imaging is the data amount of the unit image data, each of which is one frame Image data obtained by the imaging process is extracted so as to form an image, and the image data obtained by the imaging process during a second imaging period n times the first imaging period is extracted. The remaining image data of the predetermined one frame of the captured image data extracted by the image data extraction process and the predetermined one frame of the captured image data The difference data with the image data extracted by the image data extraction process is calculated, the image data extracted by the image data extraction process is recorded in the unit image data recording area of the recording medium, and obtained by the difference data calculation process. The obtained difference data is recorded in an auxiliary recording area other than the unit image data recording area.
[0039]
In the third invention as well, as in the first invention, a solid-state electronic image sensor that generates image data having a data amount n times the image data amount of unit image data (frame image data) is used. Since a solid-state electronic image sensor having a large number of pixels is used, a high-quality image is captured at the stage of imaging.
[0040]
In the third aspect of the invention, the image data extraction processing is performed so that each of the image data having n times the data amount obtained in the first imaging cycle has a data amount of unit image data and each constitutes one frame image. Is done. The extracted image data is recorded in the unit image data recording area of the recording medium according to a standard recording method.
[0041]
In this way, it is recorded in a form that matches the conventional standard. The moving image can be reproduced simply by reading the image data recorded in the unit image data recording area. Since the image data is obtained for each of the first shooting cycles with a short shooting cycle interval, a moving image that follows the movement of the subject can be obtained.
[0042]
In the third invention, the difference data is recorded in the auxiliary recording area of the recording medium. A high-quality image having a data amount n times the data amount of the unit image data is represented from the difference data recorded in the auxiliary recording region and the image data having the data amount of the unit image data recorded in the image recording region. Image data can be generated. As a result, a high-quality still image can be reproduced.
[0043]
According to a fourth aspect of the present invention, there is provided a digital image data recording apparatus including a solid-state electronic image pickup device that generates image data having a data amount n times the amount of unit image data for one frame image. Imaging unit for outputting captured image data representing a subject image obtained by imaging in a first cycle, and image data having the n times data amount output from the imaging unit in the first shooting cycle as the unit Image data extraction means for extracting image data output from the imaging means so as to form a single image each having a data amount of image data; a second imaging that is n times the first imaging period Of the captured image data output from the imaging means during the period, the captured image data for a predetermined frame and the image data extracted by the image data extraction means Difference data calculation means for calculating difference data between the image data obtained by the image data extracted from the image data extraction means by the image data extraction means, and a predetermined output output from the imaging means. Recording control means for recording one frame of captured image data in an image data recording area of the recording medium and recording difference data output from the difference data calculating means in an auxiliary recording area other than the unit image data recording area. It is characterized by having.
[0044]
The fourth invention also provides a digital image data recording method. That is, a captured image representing a subject image obtained by imaging a subject with the solid-state electronic imaging device, including a solid-state electronic imaging device that generates image data having a data amount n times the data amount of unit image data for one frame image. Imaging means for outputting data in a first cycle, and image data having the n times the amount of data output in the first shooting cycle by the imaging is the data amount of the unit image data, each of which is one frame Image data obtained by the imaging process is extracted so as to form an image, and the image data obtained by the imaging process during a second imaging period n times the first imaging period is extracted. The remaining image data of the predetermined one frame of the captured image data extracted by the image data extraction process and the predetermined one frame of the captured image data The difference data with the image data extracted by the image data extraction process is calculated, the captured image data for a predetermined frame obtained by the imaging process is recorded in the unit image data recording area of the recording medium, and the difference The difference data obtained by the data calculation process is recorded in an auxiliary recording area other than the unit image data recording area.
[0045]
In the fourth invention, as in the second invention, a solid-state electronic image pickup device that generates image data having a data amount n times the image data amount of unit image data (field image data) is used. Since a solid-state electronic image sensor having a large number of pixels is used, a high-quality image is captured at the stage of imaging.
[0046]
In the fourth aspect of the invention, the image data extraction processing is performed so that each of the image data having the n-times data amount obtained in the first imaging cycle has a data amount of unit image data and each constitutes one frame image. Done. The extracted image data is recorded in the unit image data recording area of the recording medium according to a standard recording method.
[0047]
Since it conforms to the conventional standard, it is possible to reproduce a moving image simply by reading the image data recorded in the image data recording area. Since the image data is obtained for each first imaging cycle with a short interval, a moving image that follows the movement of the subject can be obtained.
[0048]
Also in the fourth invention, the difference data is recorded in the auxiliary recording area of the recording medium. Frame image data representing a frame image is generated from the difference data recorded in the auxiliary recording area and the image data recorded in the image recording area. Therefore, it is possible to reproduce high-quality still images.
[0049]
Also in the third or fourth invention, the difference data output from the difference data generating means may be compressed, and the difference data compressed by the compression process may be recorded in the auxiliary recording area.
[0050]
As a result, the amount of difference data recorded in the auxiliary recording area is substantially reduced.
[0051]
The digital image data reproducing apparatus and method according to the present invention reproduces image data from a recording medium recorded as in the third or fourth aspect of the invention. This reproducing apparatus and method can be applied to the above-described digital video tape recorder or can be realized as an independent digital image data reproducing apparatus.
[0052]
If the digital image data reproducing apparatus is defined from the viewpoint of reproducing a still image, the reproducing apparatus reads the image data recorded in the image data recording area of the recording medium and the differential data recorded in the auxiliary recording area. A still image for generating and outputting a predetermined frame of captured image data output from the imaging unit during the second imaging cycle from the image data and difference data read from the reading unit It is characterized as having reproduction image data generating means.
[0053]
The digital image data reproduction method reads the image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area, and reads the second data from the read image data and difference data. It is characterized by generating and outputting image data representing a predetermined one frame of still image having the above-mentioned n times the amount of data obtained during a period of.
[0054]
If the digital image data playback device is defined from the viewpoint of playback of moving images and still images, this playback device can store the image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area. Reading means for reading, mode setting means for selectively setting a still reproduction mode and a movie reproduction mode, and image data read from the reading means when the movie reproduction mode is set by the mode setting means. Image data output means for reproducing a moving image output every period, and image data and difference data read from the reading means for a predetermined frame output from the imaging means during the second imaging period It is characterized by comprising image data generating means for still image reproduction for generating and outputting image data.
[0055]
The digital image data reproduction method reads the image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area, and selectively sets a still reproduction mode and a movie reproduction mode. The image data read when the movie playback mode is set is output for each first period, and when the still playback mode is set, the read image data and the difference data are output. , And generating and outputting image data representing a still image of a predetermined frame having the data amount of n times obtained during the second period.
[0056]
Image data is read from the image data recording area of the recording medium. The read image data is given to the monitor display device, and a moving image is displayed. Since image data is obtained for each first shooting cycle with a short shooting interval, a natural moving image that follows the movement can be obtained even with a moving subject.
[0057]
In still image reproduction, the difference data recorded in the auxiliary recording area is read out. From the difference data and the image data read from the image data recording area, image data having a data amount n times the data amount of unit image data or image data having a data amount of frame image data is generated. The generated image data has high image quality, and a high-quality still image can be obtained.
[0058]
When the difference data is compressed and recorded, the difference data is subjected to data expansion to generate image data for obtaining a high quality image.
[0059]
According to a fifth aspect of the present invention, there is provided a digital image data recording apparatus including a solid-state electronic image sensor that generates image data having a data amount n times as large as unit image data for one frame image. Imaging means for outputting captured image data representing a subject image obtained by imaging in a first cycle, and captured image data having the n times data amount output from the imaging means in the first shooting cycle is the above Image data extraction means for extracting the captured image data output from the imaging means so that each of them constitutes a single frame image, and the captured image data output from the imaging means. The image data other than the image data extracted by the image data extracting means is converted into the extracted image data extracted by the image data extracting means. Image data generating means to be generated based on the generated image data generated by the image data generating means and image data corresponding to the generated image data, output from the imaging means and extracted by the extracting means Difference data calculation means for calculating difference data with image data other than the extracted image data, and the extracted image data extracted by the image data extraction means are recorded in a unit image data recording area of the recording medium, and the difference data The recording apparatus includes recording control means for recording difference data output from the computing means in an auxiliary recording area other than the unit image data recording area.
[0060]
The fifth invention also provides a digital image data recording method. That is, a captured image representing a subject image obtained by imaging a subject with the solid-state electronic imaging device, including a solid-state electronic imaging device that generates image data having a data amount n times the data amount of unit image data for one frame image. Imaging means for outputting data in a first cycle, and the captured image data having the n times the amount of data obtained in the first shooting cycle by the imaging is the data amount of the unit image data, each of which is one frame The imaged image data obtained by the imaging is extracted so as to constitute an image, and the image data other than the image data extracted by the image data extraction process is obtained by the imaging. The generated image data is generated based on the image data extracted by the data extraction process and generated by the image data generation process. And difference data between the image data corresponding to the generated image data and image data other than the extracted image data obtained by the imaging and extracted by the extraction means, and by the image data extraction process The extracted image data is recorded in a unit image data recording area of the recording medium, and the difference data obtained by the difference data calculation process is recorded in an auxiliary recording area other than the unit image data recording area. To do.
[0061]
Also in the fifth aspect of the invention, a solid-state electronic image sensor that generates image data having a data amount n times the image data amount of unit image data (field image data) is used. Since a solid-state electronic image sensor having a large number of pixels is used, a high-quality image is captured at the stage of imaging.
[0062]
In the fifth aspect of the invention, the image data extraction processing is performed so that each of the image data having n times the data amount obtained in the first imaging cycle has a data amount of unit image data and each frame constitutes one frame image. Is done. The extracted image data is recorded in the unit image data recording area of the recording medium according to a standard recording method.
[0063]
Since it conforms to the conventional standard, it is possible to reproduce a moving image simply by reading the image data recorded in the image data recording area. Since the image data is obtained for each first imaging cycle with a short interval, a moving image that follows the movement of the subject can be obtained.
[0064]
Also in the fifth aspect, the difference data is recorded in the auxiliary recording area of the recording medium. Frame image data representing a frame image is generated from the difference data recorded in the auxiliary recording area and the image data recorded in the image recording area. Therefore, it is possible to reproduce high-quality still images.
[0065]
It is determined whether or not the sum of the difference data calculated by the difference data calculation process within a predetermined area is equal to or greater than a predetermined threshold value, and the image data extracted by the image data extraction process is determined. Image data recorded in the unit image data recording area of the recording medium and generated by the image data generation process in the area where the sum of the difference data is determined to be equal to or greater than the threshold value by the determination May be recorded in the auxiliary recording area.
[0066]
The image data generation process extracts data representing pixels that are above and below the missing pixel and pixels that should be present in the horizontal or vertical position adjacent to the missing pixel. The addition value of the data representing is obtained, and it is determined whether or not the obtained addition value is increased or decreased as much as the addition value for the pixel existing in the horizontal direction or the vertical direction. Data representing the missing pixel is generated using data representing the upper, lower, left and right pixels of the pixel, and when not increasing or decreasing, the pixel above, below, left and right of the missing pixel The correlation value of the pixels in the three directions of the upper and lower pixels is calculated, and the data representing the missing pixel is calculated using the data representing the pixel that gives the highest correlation. It can be realized by generating.
[0067]
The difference data calculated by the difference data calculation process is compressed, and the recording control can record the difference data compressed by the compression process in the auxiliary recording area.
[0068]
As a result, the difference data recorded in the auxiliary recording area is substantially reduced. Even if the data amount of the difference data is relatively large, it can be recorded in the auxiliary recording area.
[0069]
The apparatus and method for reproducing digital image data according to the present invention reproduces image data from a recording medium recorded as in the fifth aspect. This reproducing apparatus and method can be applied to the above-described digital video tape recorder or can be realized as an independent digital image data reproducing apparatus.
[0070]
When the digital image data reproducing apparatus is defined from the viewpoint of reproducing a still image, the reproducing apparatus reads the image data recorded in the unit image data recording area and the difference data recorded in the auxiliary recording area. , And image data output from the image pickup means other than the image data extracted by the image data extraction means from the image data and difference data read by the reading means, and generated image data It is characterized by comprising still image data generating means for generating still image data by combining data and image data read by the reading means.
[0071]
The digital image data reproduction method reads the image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area, and reads the second data from the read image data and difference data. It is characterized by generating and outputting image data representing a still image having the above-mentioned n times the amount of data obtained during the period.
[0072]
If the digital image data playback device is defined from the viewpoint of playback of moving images and still images, the playback device reads the image data recorded in the unit image data recording area and the difference data recorded in the auxiliary recording area. Means for selectively setting the still reproduction mode and the movie reproduction mode, and when the movie reproduction mode is set by the mode setting means, the image data read by the reading means is output for reproducing the moving image. When the still image reproduction mode is set by the moving image data generation means and the mode setting means, the image data output from the imaging means from the image data and difference data read by the reading means, and the image data extraction means Generate image data other than the image data extracted by And image data, characterized as having a still image data generating means for generating still image data by synthesizing the image data read by said reading means.
[0073]
The digital image data reproduction method reads the image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area, and selectively sets a still reproduction mode and a movie reproduction mode. The image data read when the movie playback mode is set is output for each first period, and the image data and the difference data read when the still playback mode is set It is characterized by generating and outputting image data representing a still image having the n times the amount of data obtained during the second period.
[0074]
Even in this case, the image data is read from the image data recording area of the recording medium. The read image data is given to the monitor display device, and a moving image is displayed. Since image data is obtained for each first shooting cycle with a short shooting interval, a natural moving image that follows the movement can be obtained even with a moving subject.
[0075]
In still image reproduction, the difference data recorded in the auxiliary recording area is read out. From the difference data and the image data read from the image data recording area, image data having a data amount n times the data amount of unit image data or image data having a data amount of frame image data is generated. The generated image data has high image quality, and a high-quality still image can be obtained.
[0076]
When the difference data is compressed and recorded, the difference data is subjected to data expansion to generate image data for obtaining a high quality image.
[0077]
A digital image data recording apparatus according to a sixth aspect of the invention includes a solid-state electronic image pickup device that generates image data having a data amount n times as large as unit image data for one frame image, and images a subject by the solid-state electronic image pickup device. Imaging means for outputting captured image data representing a subject image obtained in a first cycle, and captured image data having the n times data amount output from the imaging means in the first imaging cycle Averaged means for averaging the image data output from the imaging means so as to have the data amount of unit image data, the image data averaged by the averaging means, and the averaged image data Difference data calculation means for calculating difference data with respect to captured image data output from the image pickup means, the data representing the pixel corresponding to the pixel, The image data averaged by the averaging means is recorded in the unit image data recording area of the recording medium, and the difference data output from the difference data calculating means is recorded in an auxiliary recording area other than the unit image data recording area. A recording control means is provided.
[0078]
The sixth invention also provides a digital image data recording method. That is, it includes a solid-state electronic image sensor that generates image data having a data amount n times the data amount of unit image data for one frame image. The captured image data representing the subject image is captured by the solid-state electronic image sensor. An image obtained by the imaging so that the captured image data having the data amount of n times that is obtained in the first cycle and output in the first imaging cycle by the imaging becomes the data amount of the unit image data. Averaged data, image data averaged by the averaging process, and data representing pixels corresponding to the pixels represented by the averaged image data, and captured image data obtained by the imaging The difference data is calculated, and the image data averaged by the averaging process is recorded in the unit image data recording area of the recording medium. The difference data obtained by the data processing, characterized in that recorded in the auxiliary recording area other than the unit image data recording area.
[0079]
In the sixth aspect of the invention, a solid-state electronic image sensor that generates image data having a data amount n times the image data amount of unit image data (field image data) is used. Since a solid-state electronic image sensor having a large number of pixels is used, a high-quality image is captured at the stage of imaging.
[0080]
In the sixth aspect of the invention, the image data extraction process is performed so that each of the image data having the n-times data amount obtained in the first imaging cycle has a data amount of unit image data and each constitutes one frame image. Done. The extracted image data is recorded in the unit image data recording area of the recording medium according to a standard recording method.
[0081]
Since it conforms to the conventional standard, it is possible to reproduce a moving image simply by reading the image data recorded in the image data recording area. Since the image data is obtained for each first imaging cycle with a short interval, a moving image that follows the movement of the subject can be obtained.
[0082]
Also in the sixth invention, the difference data is recorded in the auxiliary recording area of the recording medium. Frame image data representing a frame image is generated from the difference data recorded in the auxiliary recording area and the image data recorded in the image recording area. Therefore, it is possible to reproduce high-quality still images.
[0083]
In the sixth invention as well, it is determined whether or not the sum of the difference data calculated by the difference data calculation process within a predetermined area is greater than or equal to a predetermined threshold value, and is extracted by the image data extraction process. The recorded image data is recorded in the unit image data recording area of the recording medium, and in the area where the sum of the difference data is determined to be greater than or equal to the threshold value by the determination, the image data generation process in the area The generated image data may be recorded in the auxiliary recording area.
[0084]
Preferably, the difference data calculated by the difference data calculation process is compressed, and the recording control process records the difference data compressed by the compression in the auxiliary recording area.
[0085]
This is because the amount of difference data is substantially reduced.
[0086]
The apparatus and method for reproducing digital image data according to the present invention reproduces image data from a recording medium recorded as in the sixth aspect. This reproducing apparatus and method can be applied to the above-described digital video tape recorder or can be realized as an independent digital image data reproducing apparatus.
[0087]
When the digital image data reproducing apparatus is defined from the viewpoint of reproducing a still image, the reproducing apparatus reads the image data recorded in the unit image data recording area and the difference data recorded in the auxiliary recording area. , And image data output from the image pickup means other than the image data extracted by the image data extraction means from the image data and difference data read by the reading means, and generated image data It is characterized by comprising still image data generating means for combining the data and image data read by the reading means to generate still image data having the n times the data amount.
[0088]
The digital image data reproduction method reads the image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area, and reads the second data from the read image data and difference data. It is characterized as generating and outputting image data representing a still image having the above-mentioned n times the amount of data obtained at the time of the period.
[0089]
If a digital image data playback device is defined from the viewpoint of playback of moving images and still images, this playback device reads the image data recorded in the unit image data recording area and the difference data recorded in the auxiliary recording area. Reading means, mode setting means for selectively setting a still reproduction mode and a movie reproduction mode, and when the movie reproduction mode is set by the mode setting means, the image data read by the reading means is output for moving image reproduction. When the still reproduction mode is set by the moving image data generating means and the mode setting means, the image data output from the imaging means is extracted from the image data and difference data read by the reading means, and the image data extraction is performed. Generate image data other than the image data extracted by the means, The image data that has been made, characterized as having a still image data generating means for generating still image data having a data amount of the n times by synthesizing the image data read by said reading means.
[0090]
Further, the digital reproduction method reads the image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area, and can selectively set a still reproduction mode and a movie reproduction mode. The image data read from the reading means when the movie playback mode is set is output every first cycle, and the image data and the difference data read when the still playback mode is set. From the above, it is characterized as generating and outputting image data representing a still image having the n times the amount of data obtained at the time of the second period.
[0091]
According to a seventh aspect of the present invention, there is provided a digital image data recording apparatus including a solid-state electronic image pickup device that generates a data amount n times the image data amount of unit image data for one frame image. An image pickup means for outputting image data representing a subject image obtained by taking an image, and a data amount of the unit image data, n times the data output from the image pickup means so that each constitutes one frame image Image data dividing means for dividing image data having a quantity, high-frequency component data extracting means for extracting high-frequency components of one image data out of the image data divided by the image data dividing means, and division by the image data dividing means Of the recorded image data, other image data other than the one image data is recorded in the image data recording area of the recording medium, and The high-frequency component data extracted by the frequency component data extracting means, characterized in that it comprises a recording control means for recording the auxiliary recording area other than the image data recording area.
[0092]
The seventh invention also provides a digital image data recording method. That is, image data representing a subject image obtained by imaging a subject using a solid-state electronic image sensor that generates a data amount n times the image data amount of unit image data for one frame image is obtained, and the unit image data The image data having n times the amount of data obtained by the imaging is divided so that each of them constitutes one frame image, and one of the image data divided by the image data dividing process is selected. High frequency component of the image data is extracted, and other image data other than the one image data is recorded in the image data recording area of the recording medium among the image data divided by the image data dividing means, and the high frequency component The high-frequency component data extracted by the data extraction process is recorded in an auxiliary recording area other than the image data recording area.
[0093]
In the seventh invention as well, the subject is imaged using the solid-state electronic image sensor that generates image data having a data amount n times the data amount of the unit image data. Since the solid-state electronic image sensor has a large number of pixels, a high-quality image is captured at the stage of imaging.
[0094]
In the seventh aspect of the invention, the image data having the n times the data amount becomes the data amount of the unit image data and is divided so that each constitutes one frame image. Of the divided image data, one image data is compressed and recorded in the image data recording area, and for the other image data, a high frequency component is extracted and the extracted high frequency component is recorded in the auxiliary recording area.
[0095]
At the time of image reproduction, reproduction image data is generated from the image data recorded in the image data recording area and the high-frequency component recorded in the auxiliary recording area. Since the image data for reproduction is generated using high-frequency components, it is possible to obtain a detailed image as a reproduced image in detail.
[0096]
The extracted high frequency component may be compressed and recorded in the auxiliary recording area. As a result, a substantially large number of high-frequency components can be recorded in the auxiliary recording area, and a higher-definition reproduced image can be obtained.
[0097]
An apparatus and method for reproducing digital image data according to the present invention reproduces image data from a recording medium recorded as described above. This reproducing apparatus and method can be applied to the above-described digital video tape recorder or can be realized as an independent digital image data reproducing apparatus.
[0098]
When the digital image data reproducing apparatus is defined from the viewpoint of reproducing a still image, the reproducing apparatus reads the compressed image data recorded in the image data recording area of the recording medium and the differential data recorded in the auxiliary recording area. It is assumed that there is provided reading means and still image data generating means for generating image data constituting one frame of high-quality still image having the amount of data n times from the image data and difference data read by the reading means. Characterized.
[0099]
Also, the digital image data reproducing method reads the compressed image data recorded in the image data recording area of the recording medium and the differential data recorded in the auxiliary recording area, and n times the read image data and differential data. It is characterized as generating image data that constitutes a single high-quality still image having a data amount of.
[0100]
When the digital image data playback device is defined from the viewpoint of playback of moving images and still images, reading means for reading compressed image data recorded in the image data recording area of the recording medium and difference data recorded in the auxiliary recording area, Mode setting means for selectively setting a still reproduction mode and a movie reproduction mode, a moving image data output means for outputting image data read by the reading means when the movie reproduction mode is set by the mode setting means, and When the still reproduction mode is set by the mode setting means, a still image for generating image data constituting one frame of a high-quality still image having the data amount n times from the image data and difference data read by the reading means Characterized as having data generation means.
[0101]
The digital image data reproducing method reads the compressed image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area, and selectively selects a still reproduction mode or a movie reproduction mode. When the movie reproduction mode is set, the image data decompressed by the first data decompressing means is output, and when the still reproduction mode is set, the image data and the difference data are read from the n data. Image data constituting one frame of a high-quality still image having a double data amount is generated.
[0102]
[Explanation of Examples]
(1) First embodiment
Prior to the description of the configuration and operation of the digital video tape recorder, an existing standard industry standard concerning the recording method on the magnetic tape by the digital video tape recorder will be described.
[0103]
The recording format of the magnetic tape is shown in FIGS. 8 (A) and 8 (B). FIG. 8A shows a track Tr of the magnetic tape 8, and a large number of tracks Tr are formed at a certain angle in an oblique direction with respect to the longitudinal direction of the magnetic tape 8. One frame of digital image data is recorded using 10 consecutive tracks among these many tracks Tr.
[0104]
FIG. 8B shows the track format. One track Tr includes a subcode recording area, a video recording area, an auxiliary recording area, an audio recording area, and a track information recording area. Information such as a time code and an absolute track number for high-speed search is recorded in the subcode recording area. Digital image data representing a subject image is recorded in the video recording area. Data representing sound is recorded in the audio recording area. In the track information recording area, information serving as a reference for the track Tr for the magnetic head to trace the center of the track Tr is recorded. The auxiliary recording area is provided in a skipped manner, and additional information is recorded in this auxiliary recording area. The gap provided between the regions is not shown.
[0105]
The CCD used in the imaging unit of a digital video tape recorder is generally (conventional) a horizontal CCD transfer clock frequency of 13.5 MHz, approximately 350,000 pixels of 720 pixels in the horizontal direction and 480 pixels in the vertical direction. Those with numbers are used. One frame of digital image data obtained using such a CCD is recorded on 10 tracks of the magnetic tape 8. This is an existing standard.
[0106]
In order to improve the image quality of the image represented by the image data recorded on the magnetic tape 8, a CCD having a large number of pixels may be used. However, in the digital video tape recorder, the standard is determined so that about 350,000-pixel digital image data of 720 pixels in the horizontal direction and 480 pixels in the vertical direction is recorded on 10 tracks. If digital image data obtained by imaging a subject using a CCD having a larger number of pixels than the number of pixels is recorded on the magnetic tape 8, it will be out of this standard. The digital video tape recorder according to the present invention images a subject using a CCD having a pixel number larger than the 350,000 pixel number generally used for a digital video tape recorder, It is possible to record image data that conforms to the conventional recording standard of video tape recorders.
[0107]
FIG. 1 shows an embodiment of the present invention and is a block diagram showing an electrical configuration of a digital video tape recorder (DVTR) capable of recording and reproducing digital image data. The overall operation of the digital video tape recorder is controlled by the system controller 21 (control lines are not shown).
[0108]
As shown in FIG. 2, the CCD 11 used in the image pickup unit of this digital video tape recorder has a number of pixels of about 700,000 pixels of 1440 pixels in the horizontal direction and 480 pixels in the vertical direction. Image data twice as large as a 10,000 pixel CCD can be obtained. The data amount of image data for one frame obtained from the 700,000 pixel CCD 11 corresponds to the data amount of image data for two frames of the 350,000 pixel CCD.
[0109]
In the digital video tape recorder of this embodiment, one frame of image data obtained from the CCD 11 is divided into two frames of 350,000 pixels of image data, and one frame is used for 10 tracks each for the magnetic tape 8. This makes it possible to record image data that conforms to the conventional recording standards of digital video tape recorders while achieving high-quality shooting.
[0110]
The digital video tape recorder shown in FIG. 1 is different in image data recording processing for still image reproduction and image data recording processing for moving image reproduction.
[0111]
FIG. 5 is a perspective view showing how the frame image data having the number of pixels of 700,000 pixels is continuously given. 6 shows a still image recording / reproducing process in a plan view, and FIG. 7 shows a moving image recording / reproducing process in a plan view.
[0112]
In the digital video tape recorder, the recording mode is set so that the subject is continuously photographed by the CCD 11 having the number of pixels of about 700,000 pixels at a constant cycle of 1/30 seconds. Thereby, as shown in FIG. 5, image data having about 700,000 pixels is periodically obtained every 1/30 seconds. Of the obtained image data, the odd-numbered frame image data (first frame image data FL1, third frame image data FL3, fifth frame image data FL5, seventh frame image data FL7 in the example shown in FIG. 5). Is referred to as odd-numbered frame image data, and even-numbered frame image data (second frame image data FL2, fourth frame image data FL4, sixth frame image data FL6, eighth frame image data in the example shown in FIG. 5). FL8) is referred to as even frame image data.
[0113]
Referring to FIG. 6, in still image recording / playback processing, even frame image data (FL2, FL4) out of approximately 700,000 frame image data of 1440 pixels in the horizontal direction and 480 pixels in the vertical direction given every 1/30 seconds. ) Is not recorded, and so-called piece drop processing is performed. On the other hand, for odd frame image data (FL1, FL3), frame image data of about 700,000 pixels of 1440 pixels in the horizontal direction and 480 pixels in the vertical direction has about 350,000 pixels of 720 pixels in the horizontal direction and 480 pixels in the vertical direction. It is divided into two frame image data (FL1a and FL1b, FL3a and FL3b). Of course, it is not limited to 350,000 pixels of 720 pixels in the horizontal direction and 480 pixels in the vertical direction, and frame image data of about 700,000 pixels may be divided into two frame image data of about 350,000 pixels. The two frame image data of about 350,000 pixels are composed of the video recording area a of the magnetic tape 8 using 10 tracks for each frame image data. ₂ To be recorded.
[0114]
At the time of reproducing the frame image data recorded in this way, the same 300000 pixel frame image data (FL1a and FL1b) in which the same 700,000 pixel frame image data (F1 or FL3) is recorded separately are recorded. Alternatively, the original frame image data (FL1 and FL2) of 700,000 pixels is restored even if FL3a or FL3b) is combined. Since this frame image data has a pixel number of about 700,000 pixels, which is twice the conventional about 350,000 pixels, it becomes a high-definition image and is suitable for still image reproduction.
[0115]
Referring to FIG. 7, in the moving image recording / reproducing process, frame image data (FL1, FL2, FL3, FL4) of about 700,000 pixels, which is given every 1/30 seconds and has 1440 pixels in the horizontal direction and 480 pixels in the vertical direction, Image data is extracted so as to have a frame image data amount of about 350,000 pixels of 720 pixels in the horizontal direction and 480 pixels in the vertical direction (FL1a, FL2a, FL3a, FL4a). The difference between the extracted frame image data of about 350,000 pixels is calculated between adjacent frame image data (FL1a-FL2a and FL3a-FL4a). The difference data (FL1a-FL2a and FL3a-FL4a) obtained by the calculation is the auxiliary recording area a of the track. ₃ To be recorded.
[0116]
During video playback, the auxiliary recording area a of the track ₃ The differential data (FL1a-FL2a and FL3a-FL4a) recorded on the magnetic tape 8 is read from the magnetic tape 8. Also, the video recording area a of the track in the still image recording / playback processing ₂ The 350,000-pixel frame image data (FL1a and FL3a) of the 350,000-pixel frame image data recorded in (1) is read from the magnetic tape 8. Difference data (FL1a-FL2a and FL3a-FL4a) is subtracted from the read frame image data (FL1a and FL3a) of 350,000 pixels (FL1a- (FL1a-FL2a) and FL3a- (FL3a-FL4a)). As a result, even frame image data (FL2a and FL4a) of about 350,000 pixels not recorded on the magnetic tape 8 is restored. At the time of reproduction, continuous 350,000-pixel frame image data is obtained every 1/30 seconds. Accordingly, a moving image with relatively smooth movement is reproduced.
[0117]
Referring again to FIG. 1, in the recording mode, the subject is continuously photographed with a period of 1/30 seconds by the CCD 11 having about 700,000 pixels. The shutter speed for photographing is determined by so-called electronic shutter control so as to be appropriate (for example, 1/60 seconds, or shorter if necessary). The video signal representing the subject image output from the CCD 11 is supplied to the AD converter 12 and converted into digital image data. The digital image data is given to the recorded image data processing circuit 13.
[0118]
As described with reference to FIG. 6, the recorded image data processing circuit 13 divides odd-numbered frame image data of 700,000 pixels into two pieces of frame image data of 350,000 pixels and outputs them in the still image recording / reproducing process. As described with reference to FIG. 7, it is a circuit that performs processing for generating and outputting difference data in the moving image recording / playback processing. The configuration and specific processing of the recording image data processing circuit 13 will be described later.
[0119]
The frame image data of 350,000 pixels output from the recorded image data processing circuit 13 is given to the frame memory 19 via the data compression circuit 14 (simply passed) and temporarily stored. The frame image data stored in the frame memory 19 is sequentially supplied to the data compression circuit 14 and subjected to data compression such as DCT (Discrete Cosine Transform) processing. The image data subjected to the data compression is given (simply passed) to the frame memory 20 via the error correction code adding circuit 15 and temporarily stored. The frame image data stored in the frame memory 20 is sequentially supplied to the error correction code adding circuit 15. The difference data output from the recorded image data processing circuit 13 is once given to the system controller 21 and transferred from the system controller 21 to the error correction code adding circuit 15.
[0120]
The digital video tape recorder shown in FIG. 1 can record audio data in addition to recording image data, and a microphone 17 is provided for recording audio data. The audio signal output from the microphone 17 is supplied to the AD converter 18, converted into digital audio data, and supplied to the error correction code adding circuit 15.
[0121]
In the error correction code addition circuit 15, an error correction code is added to the image data given from the frame memory 20. Further, in the error correction code adding circuit 15, the given image data, audio data, and difference data are respectively stored in the video recording area a of the track of the magnetic tape 8. ₂ , Audio recording area a ₄ And auxiliary recording area a ₃ Data processing is performed so as to be recorded in Also, the auxiliary recording area a of the track of the magnetic tape 8 ₃ In the auxiliary recording area a ₃ Also, identification data indicating that the difference data is recorded and data indicating the frame number of the image data are also recorded.
[0122]
The data output from the error correction code adding circuit 15 is supplied to the recording / encoding circuit 16 controlled by the mechanical controller 22, encoded (for example, NRZI encoding), and supplied to the recording / reproducing amplifier circuit 23. The data amplified in the recording / reproducing amplifier circuit 23 is given to the magnetic head included in the head cylinder 24. As a result, the video recording area a of 10 consecutive tracks among the tracks on the magnetic tape 8 is recorded by the magnetic head. ₂ 350,000 pixel frame image data is recorded in the audio recording area a. ₄ Audio data is recorded in the auxiliary recording area a ₃ Is recorded with difference data, identification data indicating that the difference data is recorded, and data indicating the frame number.
[0123]
The digital video tape recorder shown in FIG. 1 can also reproduce digital image data and digital audio data recorded on the magnetic tape 8.
[0124]
In the digital image data reproduction mode, digital image data, digital audio data, difference data, and other data recorded on the magnetic tape 8 are read by the magnetic head included in the head cylinder 24 and supplied to the recording / reproducing amplifier circuit 23. It is done. The data amplified in the recording / reproducing amplifier circuit 23 is given to the demodulation circuit 31. The demodulating circuit 31 demodulates the data and provides it to the error correcting circuit 32. The difference data is supplied from the error correction circuit 32 to the system controller 21 and from the system controller 21 to the reproduced image data processing circuit 34. Digital image data and digital audio data are given from the error correction circuit 32 to the frame memory 20 and temporarily stored. The digital audio data stored in the frame memory 20 is sequentially read out and given to the DA converter 40, where it is converted into an analog audio signal. The analog audio signal is output to the speaker 41 as sound. The digital image data stored in the frame memory 20 is sequentially read and applied to the error correction circuit 32. If there is a data error in the image data demodulated by the demodulation circuit 31, an error correction process is performed in the error correction circuit 32. The digital image data subjected to the error correction processing is given to the frame memory 19 via the data expansion circuit 33 and stored. The digital image data stored in the frame memory 19 is sequentially read and the compressed image data is decompressed. The digital image data decompressed by the data decompression circuit 33 is supplied to the reproduction image data processing circuit 34 for each frame image data of 350,000 pixels.
[0125]
When the still reproduction mode is set, the reproduction image data processing circuit 34, as described with reference to FIG. 6, has two 350,000 pixel frames divided from the same 700,000 pixel frame image data. This is a circuit that synthesizes image data, performs image data composition processing to compose frame image data of 700,000 pixels representing one frame, and outputs the synthesized frame image data for 700,000 pixels. Further, when the movie playback mode is set, the playback image data processing circuit 34 uses 1/30 from the difference data and the odd-numbered 350,000-pixel frame image data as described with reference to FIG. Odd-numbered and even-numbered 350,000-pixel moving image frame image data continuous every second is generated and output. The configuration and specific processing of the reproduction image data processing circuit 34 will be described later in detail.
[0126]
When the movie playback mode is set, the 350,000-pixel moving image frame image data output from the playback image data processing circuit 34 is supplied to the DA converter 38 and converted into an analog video signal. The analog video signal is given to the display device 39 to reproduce the moving image. Since the display device 39 is provided with a video signal photographed at a period of 1/30 seconds every 1/30 seconds, a relatively smooth moving image is reproduced.
[0127]
When the still reproduction mode is set, 700,000-pixel frame image data output from the reproduction image data processing circuit 34 is supplied to the vertical interpolation circuit 35. The 700,000-pixel frame image data is composed of 1440 pixels in the horizontal direction and 480 pixels in the vertical direction. On the other hand, the frame image data of 350,000 pixels is composed of 720 pixels in the horizontal direction and 480 pixels in the vertical direction. Therefore, the frame image data of 700,000 pixels has improved resolution in the horizontal direction, but is the same as the frame image data of 350,000 pixels in the vertical direction. Therefore, the vertical interpolation circuit 35 improves the vertical resolution. Details of the vertical interpolation processing in the vertical interpolation circuit 35 will be described later. The image data output from the vertical interpolation circuit 35 is given to the DA converter 36 and converted into an analog video signal. The analog video signal is given to the printer 37 and printed out. The print output from the printer 37 is obtained using the CCD 11 having 700,000 pixels, and has a high definition. In the still reproduction mode, vertical interpolation processing is performed, but this is not always necessary. In that case, the vertical interpolation circuit 35 is skipped.
[0128]
FIG. 3 shows the configuration of the recorded image data processing circuit 13.
[0129]
The frame image data of 700,000 pixels is input to and stored in either the frame memory 51 or 52 via the changeover switch 50. The changeover switch 50 is changed each time 700,000 pixel frame image data passes. Therefore, 700,000 pixel frame image data for one frame to be input is alternately supplied to the frame memory 51 or 53. The frame memories 51 and 53 have a capacity capable of storing frame image data of 700,000 pixels. For example, if the first frame image data FL1 is given to the frame memory 51, the next second frame image data FL2 is given to the frame memory 53. Here, odd frame image data is stored in the frame memory 51, and even frame image data is stored in the frame memory 53.
[0130]
The odd frame image data of 700,000 pixels stored in the frame memory 51 is sequentially supplied to the pixel extraction circuit 52. The pixel extraction circuit 52 divides and outputs odd frame image data of 700,000 pixels into two frame image data (FL1a and FL1b) of 350,000 pixels each. Two frame image data (FL1a and FL1b) of 350,000 pixels output from the pixel extraction circuit 52 are applied to the data compression circuit 14 as described above, subjected to data compression, and recorded on the magnetic tape 8. Further, in the pixel extraction circuit 52, one frame image data (FL1a) of the frame image data (FL1a and FL1b) of 350,000 pixels divided into two is also supplied to the motion detection circuit 55.
[0131]
The 700,000-pixel even frame image data stored in the frame memory 53 is sequentially supplied to the pixel extraction circuit 54. In the pixel extraction circuit 54, 350,000 pixel frame image data corresponding to the 350,000 pixel frame image data (FL1a) given from the pixel extraction circuit 52 to the motion detection circuit 55 is given 700,000 pixel frame image data. Extracted from (FL2) (FL2a). The 350,000-pixel frame image data output from the pixel extraction circuit 54 is supplied to the motion detection circuit 55.
[0132]
The motion detection circuit 55 gives a block (for example, 8 × 8 pixels) from two given 350,000-pixel frame image data (FL1a and FL2a) to determine whether or not there is motion between images represented by these frame image data. It is a circuit for comparing each. In the motion detection circuit 55, the presence / absence of motion of a block determined to have motion is detected based on whether the level difference is equal to or greater than a predetermined threshold value. Regarding the image data, two 350,000-pixel frame image data (for example, FL1a and FL2a) are supplied to the difference calculation circuit 56, respectively. The image data of the block determined to have no motion in the motion detection circuit 55 is not given to the difference calculation circuit 56.
[0133]
In the difference calculation circuit 56, the difference calculation of the given image data is performed (for example, FL1a-FL2a), and this difference data is given to the difference data compression circuit 57. The differential data compressed in the differential data compression circuit 57 is given to the system controller 21 and the auxiliary recording area a of the magnetic tape 8 as described above. ₃ To be recorded.
[0134]
FIG. 4 shows the configuration of the reproduced image data processing circuit 34.
[0135]
The frame image data of 350,000 pixels is input to and stored in either the frame memory 61 or 62 via the changeover switch 60. The changeover switch 60 is changed each time frame image data of 350,000 pixels passes. Therefore, the 350,000-pixel frame image data for one frame to be input is alternately supplied to the frame memory 61 or 63. The two 350,000-pixel frame image data provided to the frame memories 61 and 63 are combined to become 700,000-pixel frame image data representing an image of one frame.
[0136]
Frame image data (FL1b and FL1a) of 350,000 pixels stored in the frame memories 61 and 63 are sequentially read out and applied to the image composition circuit 62. In the image synthesis circuit 62, two 350,000-pixel frame image data are synthesized, and 700,000-pixel frame image data (FL1) representing an image of one frame is generated and output. The frame image data of 700,000 pixels output from the image synthesizing circuit 62 is subjected to vertical interpolation processing as necessary and printed by the printer 37 as described above.
[0137]
The frame image data (FL1a) of 350,000 pixels stored in the frame memory 63 is also supplied to the arithmetic processing circuit 65. The compressed difference data is given to the data decompression circuit 64 and subjected to data decompression. The expanded difference data (FL1a-FL2a) is applied to the arithmetic processing circuit 65. The arithmetic processing circuit 65 is a circuit for subtracting the difference data (FL1a-FL2a) given from the data decompression circuit 64 from the 350,000-pixel frame image data (FL1a) given from the frame memory 63. As a result, frame image data (FL2a) of 350,000 pixels is obtained.
[0138]
The 350,000 pixel frame image data stored in the frame memory 63 and the 350,000 pixel frame image data output from the arithmetic processing circuit 65 are alternately output, and the reproduced image data processing circuit 34 uses the moving image image. Data output. The moving image image data output from the reproduction image data processing circuit 34 is applied to the display device 39 as described above. An image obtained on the basis of an image obtained by photographing every 1/30 seconds is displayed on the display device 39, and a relatively smooth moving image reproduction is performed.
[0139]
In the above-described embodiment, the differential data is subjected to data compression, but it is not always necessary to perform data compression. Although motion detection is performed and difference data is calculated and recorded only for a block having motion, the difference data may be calculated for all data as well as a block having motion.
[0140]
Next, vertical interpolation processing in the vertical interpolation circuit 35 will be described.
[0141]
The vertical interpolation processing in the vertical interpolation circuit 35 is performed as follows.
[0142]
FIG. 9 shows a part of the pixel array, and the central pixel S _{m, n} Are pixels whose image data should be generated by interpolation. Image data S of the pixel to be interpolated _{m, n} (Hereinafter, image data uses the same symbol as the pixel), the pixel S to be interpolated is calculated. _{m, n} Pixel D adjacent above and below _{m, n} Image data and D _{m, n + 1} Difference from image data of ₁ = | D _{m, n + 1} -D _{m, n} |, Pixel D diagonally adjacent vertically _{m-1, n} And D _{m + 1, n + 1} Difference of image data from ₂ = | D _{m + 1, n} -D _{m-1, n + 1} ｜, and D _{m + 1, n} And D _{m-1, n + 1} Difference from ₃ = | D _{m-1, n + 1} -D _{m + 1, n} | Is calculated respectively.
[0143]
Next, the difference Δ between the calculated image data ₁ , Δ ₂ And Δ ₃ The smallest of these is detected. An arithmetic average of the two image data used to calculate the smallest difference is calculated. The pixel S to be interpolated is the data obtained by this arithmetic mean. _{m, n} Image data. For example, Δ ₁ ~ Δ ₃ Δ ₁ Is the smallest, the image data of the pixel to be interpolated is S _{m, n} = (D _{m, n + 1} + D _{m, n} ) / 2. Δ ₂ S is the smallest _{m, n} = (D _{m + 1, n} + D _{m-1, n + 1} ) / 2, and Δ ₃ S is the smallest _{m, n} = (D _{m-1, n + 1} + D _{m + 1, n} ) / 2.
[0144]
As a result, vertical interpolation is performed so that the correlation becomes stronger in the vertical and diagonal directions, so that the edge of the obtained still image becomes smooth.
[0145]
Such vertical interpolation processing is performed between all the columns, and image data having pixels which are substantially doubled by 480 pixels in the vertical direction is obtained.
[0146]
In the above-described embodiment, the case where a subject is photographed using a CCD having a pixel number of 700,000 pixels has been described. However, the present invention is not a pixel number of 700,000 pixels but a CCD having a pixel number of 350,000 pixels. It can be applied even if it exists. In the case of a CCD having 350,000 pixels, recording / reproduction processing is performed as follows. In the case of a CCD having 350,000 pixels, a subject is selectively photographed with a period of 1/60 seconds. Thus, frame image data of 350,000 pixels is continuously obtained every 1/60 seconds. In this case, 350,000 pixel image data should be output from the CCD over 1/60 seconds, with the readout clock being doubled compared to when 350,000 pixel image data is output from the CCD over 1/30 seconds. It becomes.
[0147]
FIG. 10 shows a still image recording / reproducing process in a plan view.
[0148]
In the still image recording / playback process, every third frame image data of ten thousand tracks out of 350,000-pixel frame image data (fl1, fl2, fl3, fl4) obtained every 1/60 seconds is recorded. And recorded on the magnetic tape 8. Therefore, frame image data of 350,000 pixels is recorded on the magnetic tape 8 every 1/30 seconds, and recording is performed according to the conventional standard. At the time of reproduction of a still image, frame image data representing a desired image is retrieved from the frame image data recorded in this way and is supplied to the printer 37. This gives a print. Since the number of pixels is relatively large, relatively high-precision printing can be obtained.
[0149]
FIG. 11 shows a moving image recording / reproducing process in a plan view.
[0150]
In the moving image recording / reproducing process, adjacent frame image data of 350,000 pixel frame image data (fl1, fl2, fl3, fl4) obtained every 1/60 seconds, and pixels in odd rows or even rows are changed. The difference between the represented field image data is calculated. The difference data obtained by this calculation is the auxiliary recording area a of the magnetic tape 8. ₃ To be recorded. During playback, the auxiliary recording area a ₃ A field image of an image not recorded in the still image recording / reproducing process is generated from the difference data recorded on the image data and the image data recorded on the track of the magnetic tape 8 in the still image recording / reproducing process. A field image is obtained from the image data recorded in the still image recording / reproducing process. These field images are alternately given to the display device every 1/60 seconds to reproduce a moving image.
[0151]
With reference to FIG. 11, the moving image recording / reproducing process will be described in detail. In FIG. 11 (also in FIG. 10), odd-numbered rows of pixels are represented using the symbol A, and even-numbered rows of pixels are represented using the symbol B.
[0152]
Of the 350,000-pixel frame image data given every 1/60 seconds, image data representing even-numbered rows of image data representing an adjacent image is subtracted (B1-B2). The difference data (B1-B2) obtained by this subtraction processing is the auxiliary recording area a of the magnetic tape. ₃ To be recorded. During playback, the auxiliary recording area a ₃ Difference data (B1-B2) and video recording area a ₂ The frame image data (fl1) recorded in each is read out. Field image data (A1) composed of pixels in odd rows is extracted from the frame image data (fl1). Further, field image data (B1) composed of pixels in even rows is extracted from the frame image data (fl1), and difference data (B1-B2) is subtracted from the extracted field image data (B1) (B1- ( B1-B2)). As a result, field image data (B2) which is the second field image data and is composed of pixels in even rows is obtained. The field image data (A1) composed of the pixels in the odd rows and the field image data (B2) composed of the pixels in the even rows obtained in this way are alternately supplied to the display device, and the moving image is reproduced.
[0153]
In these cases, in the still image recording / playback processing shown in FIG. 10, the desired frame image is easily obtained by providing the frame image data to be recorded to the frame memory 51 shown in FIG. 3 and the frame memory 61 shown in FIG. Data can be provided to the printer 37. Further, the composition processing in the image composition circuit 62 is not necessary. In the moving image recording / playback processing shown in FIG. 11, field image data (B1) consisting of pixels in even-numbered rows in the first field is extracted in the pixel extracting circuit 52 in FIG. 3, and even-numbered rows in the second field are extracted in the pixel extracting circuit 54. The field image data (B2) composed of pixels is extracted, and the difference between these field image data is calculated by the difference calculation circuit 56 (B1-B2). This difference data is the auxiliary recording area a. ₃ To be recorded. When the moving image is reproduced, the first frame of image data (fl1) is supplied to the frame memory 63, and the odd-numbered field image data (A1) is output from the frame memory 63 to the image reproduction processing circuit. The image data (B1) is given to the arithmetic processing circuit 65. The difference data (B1-B2) is also given to the arithmetic processing circuit 65. In the arithmetic processing circuit 65, the difference data (B1-B2) is subtracted from the field image data (B1) of the even-numbered row to obtain the second field image data B2 including the pixels of the even-numbered row. Moving image reproduction is performed by alternately supplying field image data composed of odd-numbered pixels and field image data composed of even-numbered pixels to the display device every 1/60 seconds.
[0154]
(2) Second embodiment
12 to 18 are for explaining the second embodiment.
[0155]
In the digital video tape recorder according to the second embodiment, the configuration of the recording image data processing circuit 13 and the reproduction image data processing circuit 34 of the digital video tape recorder shown in FIG. 1 is changed.
[0156]
First, the concept of the moving image recording / playback processing and still image recording / playback processing according to the second embodiment will be described with reference to FIGS.
[0157]
Referring to FIG. 14, the digital video tape recorder in the second embodiment has about 700,000 pixels of 1440 pixels in the horizontal direction and 480 pixels in the vertical direction, similarly to the digital video tape recorder in the first embodiment. A subject is photographed continuously with a period of 1/30 seconds using the CCD 11 having the number of pixels. As a result, frame image data of 700,000 pixels is obtained every 1/60 seconds (FL1, FL2, FL3, FL4). In the case of moving image recording / playback processing, approximately 700,000 pixel frame image data having a pixel number of 1440 pixels in the horizontal direction is obtained every 1/30 seconds, and approximately 350,000 pixels having 720 pixels in the horizontal direction. Image data extraction processing is performed so as to obtain frame image data having the number of pixels. In this image data extraction process, the amount of frame image data of about 700,000 pixels becomes the amount of frame image data of about 350,000 pixels, and it is sufficient to form one frame image, and the number of pixels in the horizontal direction is not necessarily reduced by half. It is not something to be done. However, preferably, image data extraction processing will be performed every other pixel in the horizontal direction. In this way, frame image data of 350,000 pixels is obtained every 1/30 seconds, and the obtained frame image data of 350,000 pixels (FL1a, FL2a, FL3a, FL4a) is 10 tracks every 1/30 seconds. Video recording area a ₂ To be recorded.
[0158]
The frame image data of 350,000 pixels recorded on the magnetic tape 8 is read every 1/30 second and given to the display device, thereby reproducing the moving image.
[0159]
Referring to FIG. 15, odd frame image data (FL1, FL3) among 700,000 pixel frame image data (FL1, FL2, FL3, FL4) obtained every 1/30 seconds in the case of still image recording / playback processing. The image data is divided so that the data amount is 350,000 pixels. Even frame image data (FL2, FL4) is skipped. For the divided odd frame image data (FL1a, FL1b, FL3a, FL3b), the difference between 350,000 pixel frame image data divided from the same 700,000 pixel frame image is calculated (FL1a-FL1b, FL3a-FL3b). The difference data (FL1a-FL1b, FL3a-FL3b) obtained by the difference calculation is the auxiliary recording area a of the magnetic tape 8. ₃ To be recorded.
[0160]
In still image playback, the auxiliary recording area a ₃ Difference data (FL1a-FL1b, FL3a-FL3b) and video recording area a ₂ The odd numbered 350,000 pixel frame image data (FL1a, FL3a) recorded in (1) are respectively read out. The difference data (FL1a-FL1b, FL3a-FL3b) is subtracted from the odd-numbered 350,000 pixel frame image data (FL1a, FL3a). As a result, odd-numbered 350,000 pixel frame image data (FL1b, FL3b) that is not recorded on the magnetic tape 8 in the moving image recording / playback process is obtained. The odd numbered 350,000 pixel frame image data (FL1b, FL3b) and the other odd numbered 35th pixel frame image data (FL1a, FL3a) are combined to generate an odd numbered 700,000 pixel odd numbered image. Frame image data (FL1, FL3) is obtained. The 700,000-pixel frame image data is subjected to vertical interpolation processing if necessary, and is supplied to the printer 37. As a result, a still image is printed.
[0161]
FIGS. 12 and 13 are block diagrams showing configurations of the recorded image data processing circuit 13 and the reproduced image data processing circuit 34 of the digital video tape recorder according to the second embodiment.
[0162]
Referring to FIG. 12, frame image data of 700,000 pixels is input to and stored in either frame memory 71 or 72 via changeover switch 70. The changeover switch 70 is changed each time frame image data of 700,000 pixels passes. Accordingly, the input image data for one frame is alternately supplied to the frame memory 71 or 73. Here, it is assumed that first frame image data FL1 of 700,000 pixels is stored in the frame memory 73, and second frame image data FL2 of 700,000 pixels is stored in the frame memory 71.
[0163]
The second frame image data FL2a of 350,000 pixels is extracted from the second frame image data FL2 of 700,000 pixels stored in the frame memory 71 and output. A pixel extraction circuit 74 is provided so that two pieces of first frame image data FL1a and FL2a of 350,000 pixels are separately output from the first frame image data FL1 of 700,000 pixels stored in the frame memory 73. Extracted by The first frame image data FL1a having 350,000 pixels and the second frame image data FL2a having 350,000 pixels become the output of the recorded image data processing circuit 13 and are given to the data compression circuit 14, and the video recording area a of the magnetic tape 8 is recorded. ₂ To be recorded.
[0164]
The two 350,000-pixel first frame image data FL1a and FL1b output from the pixel extraction circuit 74 are supplied to the difference amount detection circuit 75. In the difference amount detection circuit 75, a difference between given frame image data FL1a and FL1b is calculated for each block (one block is, for example, 8 × 8 pixels). If the calculated difference is equal to or greater than a predetermined value, the frame image data FL1a and FL1b are applied to the difference calculation circuit 76, and the difference is calculated (FL1a-FL1b). The difference data FL1a-FL1b output from the difference calculation circuit 76 is given to the difference data compression circuit 77, and the data is compressed. The data-compressed difference data (FL1a-FL1b) is supplied to the system controller 21 and the auxiliary recording area a of the magnetic tape 8 is recorded. ₃ To be recorded.
[0165]
Referring to FIG. 13, video recording area a of magnetic tape 8 ₂ The frame image data FL1 of 350,000 pixels and the difference data FL1a-FL1b recorded in the above are read out. The read frame image data FL1 of 350,000 pixels is given to the frame memory 81 and temporarily stored, and is output to the reproduction image data processing circuit 34 and is given to the display device 39 via the DA converter 38. Thereby, moving image reproduction is performed.
[0166]
The difference data is given to the data decompression circuit 82 and decompressed and given to the arithmetic processing circuit 83. On the other hand, the 350,000-pixel frame image data FL 1 a stored in the frame memory 81 is supplied to the arithmetic processing circuit 83 and the image composition circuit 84. In the arithmetic processing circuit 83, the difference data FL1a-FL1b given from the data expansion circuit 82 is subtracted from the 350,000-pixel frame image data FL1a given from the frame memory 81 to obtain the first 350,000-pixel frame image data. The video recording area a of the magnetic tape 8 ₂ The frame image data FL1b of 350,000 pixels not recorded in is generated. The 350,000-pixel frame image data FL1b is supplied to the image composition circuit 84. The two 350,000-pixel frame image data FL1a and FL1b given in the image synthesis circuit 84 are synthesized, and 700,000-pixel frame image data FL1 constituting one frame image is restored. The restored frame image data FL1 of 700,000 pixels becomes an output of the reproduction image data processing circuit 34. If necessary, vertical interpolation processing is performed in the vertical interpolation circuit 35, and is supplied to the printer 37 via the DA converter 36. As a result, a highly accurate print can be obtained.
[0167]
In the above, the difference amount is detected by the difference amount detection circuit 75 and the difference calculation is performed only when the difference amount is equal to or greater than a predetermined threshold value. However, the difference amount is not detected and the difference amount is not detected. Difference calculation may be performed. Also in the above, it is not always necessary to compress the difference data.
[0168]
In the above embodiment, the subject is photographed using the CCD 11 having about 700,000 pixels. However, the present invention is a digital video tape recorder having a CCD having about 350,000 pixels. It can also be applied to.
[0169]
FIGS. 16 and 17 are plan views for explaining the moving image recording / reproducing process and the still image recording / reproducing process in the case of continuously photographing using a CCD having about 350,000 pixels. Also in FIGS. 16 and 17, as shown in FIGS. 10 and 11, the pixels in the odd rows are indicated by the symbol A and the pixels in the even rows are indicated by the symbol B. When a subject is photographed using a CCD having 350,000 pixels, the photographing period is 1/60 second.
[0170]
Referring to FIG. 16, in the moving image recording / playback process, the odd-numbered frame image data is extracted from the 350,000-pixel frame image data obtained every 1/60 seconds for the odd-numbered frame image data. , For even-numbered frame image data, image data of pixels in even-numbered rows is extracted. By this extraction processing, the data amount of field image data becomes half of the data amount of frame image data of 350,000 pixels. The image data obtained by the image extraction process is a video recording area a for 10 tracks each with a data amount of one frame of 350,000 pixels. ₂ To be recorded.
[0171]
When recording a moving image, the video recording area a of the magnetic tape 8 ₂ The image data recorded in (1) is read out and sequentially applied to the display device every 1/60 seconds. Since the shooting interval is 1/60 seconds and is relatively short, it is possible to reproduce a moving image with smooth movement.
[0172]
Referring to FIG. 17, image data representing even rows of pixels is extracted from 350,000 pixel frame image data representing adjacent images, and the difference is calculated (B2-B1, B4-B3). This difference data (B2-B1, B4-B3) is the auxiliary recording area a of the magnetic tape 8. ₃ To be recorded.
[0173]
When playing back still images, the video recording area a ₂ From the even-numbered image data (B2, B4) of the even-numbered frame image data recorded in the auxiliary recording area a ₃ The difference data (B2-B1, B4-B3) recorded on the video recording area a is subtracted. ₂ Is generated, image data (B1, B3) of even-numbered pixels of the odd-numbered frame image data that is not recorded in is generated. The generated image data (B1, B3) and odd-numbered frame image data in the video recording area a ₂ Are combined with the image data (A1, A3) of the odd-numbered rows recorded in the frame to generate frame image data (fl1, fl3) of 350,000 pixels. The generated frame image data of 350,000 pixels becomes an output of the reproduction image data processing circuit 34 and is given to the printer 37. Since the image data has a relatively high number of pixels, a relatively high-quality print can be obtained.
[0174]
In order to perform the moving image recording / playback processing shown in FIG. 16, in the recorded image data processing circuit 13 shown in FIG. 12, odd-numbered frame image data (fl1, fl3) is stored in the frame memory 71, and pixels in the odd-numbered rows are stored. The image data (A1, A3) representing is extracted and output. Further, even-numbered frame image data (fl2, fl4) is stored in the frame memory 73, and image data (B2, B4) representing even-numbered rows of pixels is output. Difference data between the image data (B1, B3) to be represented and the image data (B2, B4) representing the pixels in the even-numbered rows is calculated. At the time of reproduction, image data (B1.A3) representing odd-numbered frame image data and odd-numbered frame image data and image data (B2) representing even-numbered frame image data. , B4) to the display device alternately.
[0175]
In order to perform the still image recording / reproducing process shown in FIG. 17, the difference data (B2-B1, B4-b3) calculated in the difference calculation circuit shown in FIG. ₃ To record. At the time of reproduction, image data (B2, B4) and difference data (B2-B1, B4-B3) of even-numbered pixels in the even-numbered frame image data are supplied to the arithmetic processing circuit 83. In the arithmetic processing circuit 83, the difference data is subtracted from the image data (B2, B4) of the pixels in the even rows to restore the image data (B1, B3) of the pixels in the even rows of the odd-numbered frame image data. . The restored image data (B1, B3) and the video recording area a ₂ The image synthesis circuit 84 synthesizes the image data (B2, B4) of the pixels in the odd-numbered rows among the even-numbered frame image data recorded in. As a result, frame image data of 350,000 pixels is obtained and given to the printer 37, whereby a high-definition print can be obtained.
[0176]
(3) Third embodiment
18 to 25 are for explaining the third embodiment.
[0177]
In the digital video tape recorder according to the third embodiment, the configuration of the recording image data processing circuit 13 and the reproduction image data processing circuit 34 of the digital video tape recorder shown in FIG. 1 is changed.
[0178]
Similarly to the digital video tape recorder in the first or second embodiment, the digital video tape recorder in the third embodiment has about 700,000 pixels in the horizontal direction of 1440 pixels and the vertical direction of 480 pixels. A subject is photographed continuously at a period of 1/30 seconds using a CCD 11 having a resolution of 700,000 pixels, and frame image data is obtained every 1/30 seconds.
[0179]
In the digital video tape recorder according to the third embodiment, every other pixel in the horizontal direction is extracted from the frame image data of about 700,000 pixels in the recording and reproduction of the moving image, and the horizontal direction is 720 pixels and the vertical direction is 480 pixels. A frame image of about 350,000 pixels is generated. This 350,000-pixel frame image data is a 10-track video recording area a. ₂ To be recorded. When playing back moving images, the video recording area a ₂ The frame image data of 350,000 pixels recorded in 1 is read out every 1/30 seconds and given to the display device 39. Thereby, the moving image is displayed on the display device 39.
[0180]
Next, still image recording / reproduction in the digital video tape recorder of the third embodiment will be described with reference to FIGS.
[0181]
Referring to FIG. 20 and FIG. 21, the still image recording / reproducing process in the digital video tape recorder of the third embodiment is a high definition image represented by frame image data of 700,000 pixels obtained by photographing. Pure still image recording / reproduction processing (FIG. 20) restored at the time of reproduction and pseudo reproduction image recording / reproduction processing for reproducing a pseudo image approximated to a high-definition image represented by frame image data of 700,000 pixels obtained by photographing ( 21).
[0182]
With reference to FIGS. 20 and 22A, 22B, and 22C, a pure still image recording / reproducing process will be described.
[0183]
22A, 22B and 22C show a part of the image extracted.
[0184]
The subject is continuously photographed every 1/30 seconds, and frame image data FL1 of about 700,000 pixels of 1440 pixels in the horizontal direction and 480 pixels in the vertical direction is obtained (FIG. 22A). The frame image data FL1 of about 700,000 pixels is divided into image data FL1a of pixels Da of odd columns and image data FL1b of pixels Db of even columns. Interpolation processing is performed based on the divided image data of the pixels Da in the odd columns (FIG. 22B), and a pixel corresponding to the pixel Db in the even columns is generated as the interpolation pixel Ds (FIG. 22 ( C)). The image data representing the interpolation pixel Ds is set as interpolation image data FL1s.
[0185]
The difference between the generated interpolated image data FL1s and the image data FL1b of the even-numbered pixels Db is calculated to obtain difference data FL1s-FL1b. The obtained difference data FL1s-FL1b is the auxiliary recording area a of the magnetic tape 8. ₃ To be recorded. Up to here is the recording process.
[0186]
In the still image playback process, the video recording area a ₂ The image data FL1a of the pixels Da in the odd-numbered columns recorded in is read out, and interpolation image data FL1s is generated from the image data FL1a. The difference data FL1s-FL1b is subtracted from the generated interpolated image data FL1s, and the image data FL1b of the pixels Db in the even columns is restored. The restored image data FL1b of the even-numbered pixels Db and the video recording area a ₂ Are combined with the image data FL1a of the pixels Da of the odd-numbered columns recorded in the frame to obtain 700,000-pixel frame image data FL1 obtained at the time of photographing as shown in FIG. As a result, a high-definition image that is the same as the subject can be printed.
[0187]
Next, the pseudo still image recording / reproducing process will be described with reference to FIG. 21 and FIGS. 22 (A), (B) and (C).
[0188]
In the pseudo still image recording / reproducing process, unlike the pure still image recording / reproducing process, the difference data (FL1s-FL1b) between the interpolated image data FL1s and the image data FL1b of the even-numbered pixels Db is stored in the auxiliary recording area a. ₃ Not recorded. In the pseudo still image recording / playback process, the video recording area a ₂ The interpolated image data FL1s is generated from the image data FL1a of the pixels Da in the odd-numbered columns recorded in (1). The generated interpolated image data FL1s and the image data FL1a of the odd-numbered pixels Da are combined to generate pseudo 700,000 pixel frame image data FL1 as shown in FIG. This enables high-definition printing.
[0189]
FIGS. 18 and 19 are block diagrams showing configurations of the recorded image data processing circuit 13 and the reproduced image data processing circuit 34 of the digital video tape recorder according to the third embodiment.
[0190]
The frame image data FL1 of 700,000 pixels obtained by photographing is given to the pixel extraction circuit 91, and the pixel extraction circuit 91 divides the image data FL1a of the odd-numbered pixel Da and the image data FL1b of the even-numbered pixel Db. . The image data FL1a of the pixels Da in the odd-numbered columns is supplied to the interpolated image data generation circuit 92 and is also output from the recording image data processing circuit 13. The data is compressed and the video recording area a of the magnetic tape for reproducing moving images. ₂ To be recorded.
[0191]
Interpolated image data FL 1 s representing the interpolated pixel Ds is generated by the interpolated image data generating circuit 92 and is supplied to the difference data generation comparison determination circuit 93. The generation of the interpolated image data in the interpolated image data generation circuit 92 can be realized by, for example, an arithmetic average of the pixels Da adjacent to the pixel Ds to be generated by the interpolation process.
[0192]
The difference data generation comparison determination circuit 93 is supplied with the image data FL1b and the interpolated image data FL1s of the pixels Db in the even columns. When the difference FL1s−FL1b of the image data given in the difference data comparison / determination circuit 93 is equal to or greater than a predetermined threshold value, it is compared for each block (for example, 8 × 8 pixels). The difference data FL1s-FL1b is supplied to the data compression circuit 94 and subjected to data compression. When it is not equal to or greater than the threshold value, the difference data FL1s-FL1b is not output from the comparison determination circuit 93. The process when the comparison determination circuit 93 determines that the data difference FL1s-FL1b is greater than or equal to the threshold value and the comparison determination circuit 93 outputs the difference data FL1s-FL1b is the pure still image recording / reproduction process of FIG. The processing when the data difference FL1s−FL1b is determined to be smaller than the threshold value and the difference data FL1s−FL1b is not output from the comparison determination circuit 93 corresponds to the pseudo still image recording / reproducing processing of FIG. To do. The difference data FL1s-FL1b output from the comparison determination circuit 93 is given to the data compression circuit 94 and is compressed. The data-compressed differential data FL1s-FL1b is given to the system controller 21 and the auxiliary recording area a ₃ To be recorded. In addition to the difference data, the determination threshold value in the difference data generation comparison determination circuit 93 is also the auxiliary recording area a. ₃ To be recorded.
[0193]
Referring to FIG. 19, at the time of reproduction, video recording area a ₂ The image data of the pixels Da in the odd-numbered columns recorded in (1) is read out and simply passed through the reproduction image data processing circuit 34 and given to the display device 39, and the moving image reproduction is performed. The image data FL1a of the pixels Da in the odd columns is given to the interpolation image data generation circuit 103, and the interpolation image data FL1s representing the interpolation pixel Ds is generated. The generated interpolated image data FL1s is given to the difference data adding circuit 102. Auxiliary recording area a ₃ The difference data recorded in the data is read out and applied to the data decompression circuit 101. The differential data FL1s-FL1b decompressed by the data decompression circuit 101 is applied to the arithmetic processing circuit 102. In the arithmetic processing circuit 102, the difference data FL1s-FL1b is subtracted from the interpolated image data FL1s to restore the image data FL1b of the pixels Db in the odd columns. The restored image data FL1b of the odd-numbered pixels Db is supplied to the image composition circuit 104. The image composition circuit 104 is also supplied with the image data FL1a of the odd-numbered pixels Da, and the image composition circuit 104 composes the image data FL1a of the odd-numbered pixels Da and the image data FL1b of the even-numbered pixels Db. Is done. The image data output from the image composition circuit 104 is subjected to vertical interpolation processing in the vertical interpolation circuit 35 if necessary, and is supplied to the printer 37 via the DA converter 36. As a result, as shown in FIG. 22A, a high-definition image that is the same as the image obtained by photographing is printed.
[0194]
Further, when the difference of data given in the operation of the difference data comparison / determination circuit 93 during recording is smaller than a predetermined threshold value, the difference data FL1s-FL1b is stored in the auxiliary recording area a. ₃ Therefore, the output of the arithmetic processing circuit 102 becomes the interpolation image data FL1s generated in the interpolation image data generation circuit 103. Therefore, in the image composition circuit 104, the image data FL1a and the interpolated image data FL1s of the pixels Da in the odd columns are synthesized. As a result, the image represented by the image data output from the image composition circuit 104 is as shown in FIG.
[0195]
In the above-described embodiment, the interpolation image data generation processing is simply performed by arithmetic averaging of pixels adjacent to the pixel to be interpolated, but can be performed as follows. In the following description, a case where pixels are missing every other row will be described. However, in the interpolation processing according to the third embodiment, pixels are missing every other column, so that the rotation may be applied by 90 degrees.
[0196]
FIG. 23 is a block diagram showing an electrical configuration of the interpolation pixel value calculation circuit. FIG. 24 shows a pixel block of 3 pixels × 3 pixels. In FIG. 24, pixels where image data exists are indicated by hatching. In FIG. 24, image data exists in pixels A, B, C, F, G, and H, and no image data exists in pixels D, X, and E.
[0197]
The interpolated pixel value calculation circuit shown in FIG. 23 considers a pixel block of 3 × 3 pixels centered on this pixel X, where X is a pixel for which data is to be generated as shown in FIG. 24, and is included in this pixel block. The data of the pixel X considered to be preferable is generated with reference to the data representing the pixel to be displayed.
[0198]
When the upper and lower pixels (A and F, B and G, and C and H) of pixels where no data exists are added, if the added value increases or decreases as the added value in the horizontal direction, the image of that portion Is a stepped portion, and if the arithmetic average of the image data of pixels above and below the pixel for which no data exists is the image data of the pixel lacking, the stepped portion is emphasized. On the other hand, if the correlation value of the two pixels around the pixel X is calculated, and the arithmetic average of the pixels giving the highest correlation is the image data of the missing pixel, the pixel X of the missing data Levels of image data of pixels A, F, C, and H in columns adjacent to the column are extremely low and highly correlated (for example, when all levels are 0), the levels of image data of pixels B and G above and below pixel X Is high and the correlation is low (for example, when the maximum level is close to the maximum level), an unnatural image may be obtained.
[0199]
The interpolated pixel value calculation circuit shown in FIG. 23 is a pixel that is missing so that a natural image can be obtained even if the portion of the image for generating data is a stepped portion. Is a circuit for generating the data. In the interpolated pixel value calculation circuit shown in FIG. 23, two pixels that are considered to be most preferable for generating missing pixel data are found, and the average value of the image data of the two found pixels is lacking. It is assumed that the image data represents the current pixel.
[0200]
FIG. 25 shows a procedure for generating image data of missing pixels. The level of image data representing a pixel is also indicated by the same reference numeral as the pixel.
[0201]
First, the addition value Da of the image data of the pixels A and F, the addition value Xa of the image data of the pixels B and G, and the addition value Ea of the image data of the pixels C and H are calculated (step 140). The obtained addition values Da, Xa, and Ea are compared, and it is determined whether the addition value in the horizontal direction increases (Da <Xa <Ea) or decreases (Da>Xa> Ea) (step 141). . If it is not increased or decreased (NO in step 141), it is considered that the peripheral portion of the pixel X that generates data is not a stepped portion, and the arithmetic average of the pixels B and G above and below the pixel X is the pixel X Data (step 147). If it is increased or decreased (YES in step 141), the peripheral portion of the pixel X that generates data is considered to be a stepped portion, and the arithmetic average of the image data of the pixels B and G above and below the pixel X Is the pixel X image data, the stepped portion is emphasized. Therefore, the arithmetic average of the image data of the pixel having the highest correlation among the two pixels in the diagonal direction of the pixel X is the image data of the pixel X. Is done.
[0202]
The absolute value difference S1 (= | A−H |) between the image data of the upper left pixel A of the pixel X and the image data of the lower right pixel H, the image data of the pixel B above the pixel X, and the lower pixel G The absolute value difference S2 (= | B−G |) from the image data and the absolute value difference S3 (= | C−F |) between the image data of the upper right pixel C of the pixel X and the image data of the lower left pixel F are Each is calculated (step 62). The combination of pixels having the highest correlation is determined from the calculation result of these absolute value differences (steps 143 and 144), and the average of the image data of the pixels giving the highest correlation is set as the image data of the pixel X (step 145). , 146 or 147).
[0203]
Referring to FIG. 23, one frame of digital image data representing luminance is stored in frame memory 111. Image data representing the upper left, upper, upper right, lower left, lower and lower right pixels (A, B, C, F, G, and H) of the pixel X that generates data is read from the frame memory 111 to determine the interpolation direction. The signal is supplied to the circuit 113 and the average value calculation circuit 114, respectively. In the interpolation direction discriminating circuit 113, the processing of steps 140 to 144 in FIG. When the interpolation direction discriminating circuit 113 finds two optimal pixels for generating the image data of the pixel X, a signal representing the two pixels is given to the average value calculation circuit 114. In the average value calculation circuit 114, the average value calculation process of the optimal image data of two pixels is performed (the processes of steps 145 to 147 in FIG. 25). Data representing the calculation result in the average value calculation circuit 114 is given to the field memory 112 and stored therein. By repeating the interpolation direction discriminating process in the interpolation direction discriminating circuit 113 and the average value computing process in the average value computing circuit 114, all the data representing the pixels in the missing row in the frame image data for one frame are generated. It is stored in the memory 112. Data output from the frame memory 112 becomes interpolated image data, and is supplied to the difference data generation comparison judgment circuit 93.
[0204]
(4) Fourth embodiment
26 to 30 are for explaining the fourth embodiment.
[0205]
The digital video tape recorder according to the fourth embodiment also changes the configuration of the recorded image data processing circuit 13 and the reproduced image data processing circuit 34 of the digital video tape recorder shown in FIG. In the digital video tape recorder recording / playback processing in the third embodiment, the interpolated image data FL1s is generated, the difference between the interpolated image data FL1s and the image data FL1b of the pixels Db in the even-numbered columns is calculated, and the difference data is used. On the other hand, in the recording / reproducing process of the digital video tape recorder in the fourth embodiment, image data of the pixel DAV representing the average value is generated, and this average value image data and the image data FL1b of the even-numbered pixels Db are generated. And the difference data is used.
[0206]
Similarly to the digital video tape recorder in the first or second embodiment, the digital video tape recorder in the fourth embodiment has approximately 700,000 pixels in the horizontal direction of 1440 pixels and the vertical direction of 480 pixels. A subject is photographed continuously at a period of 1/30 seconds using a CCD 11 having a resolution of 700,000 pixels, and frame image data is obtained every 1/30 seconds.
[0207]
In the digital video tape recorder of the fourth embodiment, in the recording and reproduction of moving images, an arithmetic average of image data representing adjacent pixels is calculated for frame image data of about 700,000 pixels, and 720 pixels in the horizontal direction and vertical An averaged frame image data of about 350,000 pixels of 480 pixels in the direction is obtained. This averaged frame image data of 350,000 pixels is a 10-track video recording area a. ₂ To be recorded. When playing back moving images, the video recording area a ₂ The frame image data of 350,000 pixels recorded in 1 is read out every 1/30 seconds and given to the display device 39. Thereby, the moving image is displayed on the display device 39.
[0208]
Next, still image recording / reproduction in the digital video tape recorder of the fourth embodiment will be described with reference to FIGS.
[0209]
Referring to FIG. 28 and FIG. 29, in the still image recording / reproducing process in the digital video tape recorder of the fourth embodiment, the frame image data of 700,000 pixels obtained by photographing as in the third embodiment. A pure still image recording / reproducing process (FIG. 28) for restoring the high-definition image represented by the following during reproduction, and a pseudo image approximating the high-definition image represented by the frame image data of 700,000 pixels obtained by shooting, There is a pseudo reproduction image recording / reproduction process (FIG. 29) for reproduction.
[0210]
With reference to FIG. 28 and FIGS. 30A, 30B, and 30C, a pure still image recording / reproducing process will be described.
[0211]
FIGS. 30A, 30B, and 30C show a part of the image extracted.
[0212]
The subject is continuously photographed every 1/30 seconds, and frame image data FL1 of about 700,000 pixels of 1440 pixels in the horizontal direction and 480 pixels in the vertical direction is obtained (FIG. 30A). Image data is averaged so that an average pixel DAV of adjacent pixels Da and even columns Db of the approximately 700,000 pixel frame image data FL1 is obtained. By this averaging process, the number of pixels in the horizontal direction is changed from 1440 pixels to 720 pixels, and the amount of image data is also changed from about 700,000 pixels to about 350,000 pixels (FIG. 30B). Further, image data FL1b representing pixels Db in an even number column is extracted from frame image data FL1 of about 700,000 pixels.
[0213]
The difference between the average image data FL1AV representing the average pixel DAV and the image data FL1b representing the odd-numbered pixel Db is obtained by averaging. The difference data FL1Δ = FL1b−FL1AV representing the pixel DΔ obtained by the difference calculation processing is the auxiliary recording area a of the magnetic tape 8. ₃ To be recorded. Up to here is the recording process.
[0214]
In the still image playback process, the video recording area a ₂ The average image data FL1AV of the average pixel DAV recorded on the auxiliary recording area a is read out. ₃ Are read out, respectively. In the read image data FL1AV and FL1Δ, addition processing FL1AV + FL1Δ and subtraction processing FL1AV-FL1Δ of the respective image data are performed. By this addition processing, image data FL1b of even-numbered pixels Db is obtained (FL1AV + FL1Δ = FL1AV + FL1b−FL1AV = FL1b). Further, the image data FL1a of the pixels Da in the odd-numbered columns is obtained by the subtraction process (FL1AV−FL1Δ = FL1AV− (FL1b−FL1AV) = 2FL1AV−FL1b = 2 (FL1a + FL1b) / 2−FL1b = FL1a). The image data FL1a of the even-numbered pixels Da and the image data FL1b of the odd-numbered pixels Db thus obtained are combined, and the 700,000-pixel frame image data FL1 obtained at the time of photographing is restored. This enables high-definition printing.
[0215]
Next, the pseudo still image recording / reproducing process will be described with reference to FIG. 29 and FIGS. 30 (A), (B) and (C).
[0216]
The pseudo still image recording / reproducing process differs from the pure still image recording / reproducing process in that the difference data FL1Δ is stored in the auxiliary recording area a. ₃ Not recorded. In the pseudo still image recording / playback process, the video recording area a ₂ The average image data FL1AV representing the average pixel DAV recorded in (1) is read out, and a print is generated from this average image data FL1AV.
[0217]
26 and 27 are block diagrams showing the configurations of the recorded image data processing circuit 13 and the reproduced image data processing circuit 34 of the clause / video / tape / recorder according to the fourth embodiment.
[0218]
The frame image data FL1 of 700,000 pixels obtained by photographing is given to the pixel extraction circuit 151, and the image data FL1b of the even-numbered pixels Db is extracted and given to the difference data generation comparison judgment circuit 153. Further, the pixel extraction circuit 151 outputs the image data FL1a representing the odd-numbered columns of pixels Da and the image data FL1b representing the even-numbered columns of pixels Db to be supplied to the averaging circuit 152. In the averaging circuit 152, the input image data FL1a and FL1b are averaged to obtain average image data FL1AV representing the average pixel DAV. The average image data FL1AV is supplied to the difference data generation comparison judgment circuit 153, and is also supplied to the data compression circuit 14 as output image data of the recording image data processing circuit 13, and is recorded on the video recording area a of the magnetic tape 8. ₂ To be recorded.
[0219]
In the difference data generation comparison determination circuit 153, the average image data FL1AV of the average pixel DAV is subtracted from the image data FL1b of the pixels Db in the odd columns, and difference data FL1Δ representing the difference pixel DΔ is obtained. In the difference data comparison / determination circuit 153, whether or not the difference FL1Δ = FL1b−FL1AV of the difference image data is equal to or greater than a predetermined threshold value is compared for each block (for example, 8 × 8 pixels) and is equal to or greater than the threshold value. Sometimes the difference data FL1Δ = FL1b−FL1AV is applied to the data compression circuit 154 to perform data compression. When it is not equal to or greater than the threshold value, the difference data FL1Δ = FL1b−FL1AV is not output from the comparison determination circuit 153. The comparison determination circuit 153 determines that the data difference FL1Δ = FL1b−FL1AV is equal to or greater than the threshold value and the comparison determination circuit 153 outputs the difference data FL1Δ = FL1b−FL1AV. This corresponds to the image recording / playback processing, and the processing when the data difference FL1Δ = FL1b−FL1AV is determined to be smaller than the threshold value and the difference data FL1Δ = FL1b−FL1AV is not output from the comparison determination circuit 153 is shown in FIG. This corresponds to pseudo still image recording / playback processing. The difference data FL1Δ = FL1b−FL1AV output from the comparison / determination circuit 153 is applied to the data compression circuit 154 to be compressed. The data-compressed difference data FL1Δ = FL1b−FL1AV is given to the system controller 21 and the auxiliary recording area a ₃ To be recorded. In addition to the difference data, the determination threshold value in the difference data generation comparison determination circuit 153, the video recording area a ₂ The data indicating that the averaged image data is recorded also includes the auxiliary recording area a. ₃ To be recorded.
[0220]
Referring to FIG. 27, at the time of reproduction, video recording area a ₂ The image data FL1AV of the average pixel DAV recorded in the above is read out and simply passed through the reproduction image data processing circuit 34 and given to the display device 39 to reproduce the moving image. The average image data FL1AV of the average pixel DAV is given to the difference data calculation circuit 162. Auxiliary recording area a ₃ The differential data FL1Δ recorded in the data is read out and applied to the data expansion circuit 161. The differential data FL1Δ = FL1b−FL1AV expanded in the data expansion circuit 161 is applied to the differential data circuit 162. In the difference data calculation circuit 162, the above-described addition processing and subtraction processing are performed. Image data FL1b of the pixels Db in the even columns is obtained by the addition process (FL1AV + FL1Δ = FL1AV + FL1b−FL1AV = FL1b). Further, the image data FL1a of the pixels Da in the odd-numbered column is obtained by the subtraction process (FL1AV−FL1Δ = FL1AV− (FL1b−FL1AV) = 2FL1AV−FL1b = 2 (FL1a + FL1b) / 2−FL1b = FL1a). The image data FL1a of the even-numbered pixels Da and the image data FL1b of the odd-numbered pixels Db obtained in this way are supplied to the image composition circuit 163. The frame image data FL1 of 700,000 pixels obtained at the time of photographing is synthesized by the image synthesis circuit 163 and restored. The restored image data FL1 becomes an output of the reproduction image data processing circuit 34, and is given to the printer 37 to enable high-definition printing.
[0221]
(5) Fifth embodiment
FIGS. 31 to 34 are for explaining the fifth embodiment.
[0222]
FIG. 31 is a block diagram showing the electrical configuration of the recording system of the digital video tape recorder, and FIG. 32 is a block diagram showing the electrical configuration of the playback system of the digital video tape recorder. FIG. 33 shows a method for dividing an image, and FIG. 34 shows an example of an image. 31 and 32, the same components as those shown in FIG.
[0223]
In the digital video tape recorder shown in FIG. 31, a CCD having a pixel number of about 700,000 pixels of 1440 pixels in the horizontal direction and 480 pixels in the vertical direction is used in the same manner as the digital video tape recorder shown in FIG. The subject is continuously photographed every 1/30 seconds. The image data is divided so that the frame image data of 700,000 pixels obtained by photographing becomes an image data amount of half 350,000 pixels, and each represents an image of one frame. One of the divided image data is compressed in the same manner as the recording process of a normal digital video tape recorder, and the video recording area a of the magnetic tape 8 is compressed. ₂ To be recorded. On the other hand, the high frequency component is extracted from the other divided image data, and the data representing the extracted high frequency component is the auxiliary recording area a of the magnetic tape 8. ₃ To be recorded.
[0224]
At the time of moving image reproduction, a video recording area a is recorded in the same manner as recording of image data in a normal digital video tape recorder. ₂ The image data recorded in is read out and applied to the display device 39. As a result, the moving image is displayed on the display device 39. Video recording area a during still image playback ₂ And the image data recorded and read in the auxiliary recording area a ₃ Are combined with the image data representing the high-frequency component recorded in. Since the image data representing the high frequency component represents a fine portion of the image, the image data represented by the image data obtained by the synthesis is high definition. Therefore, a high-definition print can be obtained.
[0225]
Referring to FIG. 31, frame image data of about 700,000 pixels of 1440 pixels in the horizontal direction and 480 pixels in the vertical direction obtained by shooting is given to a DSP (Digital Signal Processor) 171, and in this DSP 171, as follows. It is divided into frame image data of about 350,000 pixels, which is half the number of pixels.
[0226]
FIGS. 33A, 33B and 33C schematically show how the pixel array in the CCD 11 and the image data of these pixels are divided into two frames. In the horizontal direction and the vertical direction, the number of pixels is drawn very small for convenience of illustration. Further, the arrangement method (mosaic, stripe, delta, etc.) does not matter here. As shown in the upper part of FIG. 33A, the image data for one frame output from the CCD 11 and A / D converted is all pixels in the horizontal and vertical directions of the CCD 11 (720 pixels in the horizontal direction, 480 pixels in the vertical direction). Image data for pixel).
[0227]
In the DSP circuit 171, image data is read out twice for each frame.
[0228]
The image data of the first frame read out for the first time is image data of pixels in odd columns. The image data of these odd-numbered columns of pixels is represented by white circles. The pixel represented by the read image data is shown in FIG. The second frame of image data read in the second time is even-numbered column image data. The image data of these even-numbered pixels is represented by black circles. The pixel represented by the read image data is shown in FIG.
[0229]
The image data of all the pixels is read out once in any frame. In addition, the pixels of the image data constituting each field are skipped in the horizontal direction, and the entire subject image can be expressed by the image data of any frame.
[0230]
Reading of image data over these two frames can be easily expressed by controlling addressing. For example, in the reading of the first frame, an odd column is designated as the horizontal address and all rows are designated as the vertical address. In reading the second frame, an even column is designated as the horizontal address, and all rows are designated as the vertical address. Reading out image data for one frame may be performed in 1/30 second. Such address signal generation may be performed by the system controller 178, or may be constituted by a counter, a frequency divider, a logic circuit, or the like.
[0231]
The process of dividing the image data for one frame into the image data for two frames in the DSP circuit 171 is performed based on an image data output mode setting signal given from the system controller 178.
[0232]
The image data output from the DSP circuit 171 passes through the data rearrangement circuit 172 and is sequentially supplied to the data compression circuit 14. The data compression circuit 14 performs data compression on the image data.
[0233]
The image data for two frames stored in the frame memory 6 is sequentially applied to the error correction code adding circuit 15 to add an error correction code.
[0234]
Data compression processing in the data compression circuit 14 includes block processing for dividing image data into blocks of 8 × 8 pixels, processing for DCT conversion of the divided blocks, processing for quantization, and processing of quantized image data. A process of rearranging in order from the high frequency component is included, and data compression is performed by these processes. By this data compression processing, the high-frequency component of the image data, that is, the high-density portion of the image is known. The digital video tape recorder includes a block position detection and data length calculation circuit 176 to detect the position of the block of the image represented by the high frequency component image data. The block position detection and data length calculation circuit 177 also calculates the length of the image data at the position of the detected image block. Data representing the position of these image blocks and the length of the image data is provided to the system controller 178. Data representing the position of the image block and the length of the image data is output from the system controller 178 and applied to a memory control circuit 173 and a recording data generation circuit 176 described later.
[0235]
The other 350,000-pixel frame image data divided by the DSP 171 is temporarily stored by being given to the memory 174 via the memory control circuit 173. Of the 350,000-pixel frame image data stored in the memory 174, the high-frequency component image data is stored in the memory control circuit 174 based on the image block position data representing the position of the image block represented by the high-frequency component image data. Read under control.
[0236]
The high-frequency component image data read by the memory control circuit 173 is supplied to the data compression circuit 175 and subjected to data compression. The data compression circuit 175 may be the same type as the data compression circuit 14. The high-frequency component image data compressed in the data compression circuit 175 is supplied to the auxiliary area recording data generation circuit 176 and converted into auxiliary area recording data in a form suitable for recording in the auxiliary recording area a3. The converted auxiliary area recording data is supplied to the error correction code adding circuit 15.
[0237]
Data according to the format of the track format shown in FIG. 8B is the image data given from the data compression circuit 14 in the error correction code adding circuit 15 and the auxiliary area recording data given from the auxiliary area recording data generation circuit 176. The arrangement is corrected so as to be an arrangement, and is provided to the recording encoding circuit 16. Thus, the video recording area a of the magnetic tape 8 ₂ Image data is recorded in the auxiliary recording area a. ₃ Is recorded with auxiliary area data.
[0238]
Next, with reference to FIG. 32, the reproduction process of the digital video tape recorder will be described.
[0239]
Auxiliary area recording data, position data, and image data recorded on the magnetic tape are read out by the magnetic head included in the head cylinder 24, respectively.
[0240]
Similarly to the digital video tape recorder shown in FIG. 1, the digital video tape recorder shown in FIG. 32 can reproduce moving images and still images.
[0241]
In moving image reproduction, image data read from a magnetic tape is supplied to a data rearrangement circuit 186 through an amplification circuit 23, a demodulation circuit 31, an error correction circuit 32, and a data expansion circuit 33, and the image data is arranged in an arrangement suitable for reproduction display. Returned. This image data is given to the display device 39 to display a moving image.
[0242]
In still image reproduction, position data representing the position of high-frequency component image data read from the magnetic tape 8 is supplied from the error correction circuit 32 to the system controller 181. This position data is supplied from the system controller 181 to the memory control circuit 184. The auxiliary area recording data read from the magnetic tape 8 is given to the data reconstruction circuit 182 and restored from the data form suitable for recording in the auxiliary area to the data form suitable for display. The auxiliary area recording data output from the data reconstruction circuit 182 is given to the data decompression circuit 183, subjected to data decompression, given to the memory 185 via the memory control circuit 184, and temporarily stored.
[0243]
The printer 37 is supplied with frame image data of 350,000 pixels output from the data rearrangement circuit 186. When the frame image data of 350,000 pixels output from the data rearrangement circuit 186 is given to the printer 37, the auxiliary area recording stored in the memory 185 is stored at the position specified by the position data supplied from the system controller 181. The auxiliary area recording data is read from the memory 185 and supplied to the printer 37 so that the data is added. As a result, an image is generated for the high-definition portion using the auxiliary area recording data in addition to the image data. Therefore, a still image representing the fineness is printed according to the roughness of the image. For example, as shown in FIG. 34, if the hatched portion is a fine portion of the image, auxiliary area recording data is extracted for this portion and the auxiliary recording area a ₃ To be recorded. At the time of reproduction, the auxiliary area recording data is used in addition to the image data of 350,000 pixels constituting one screen, so that an image is generated, and a high-definition image is expressed in the hatched portion shown in FIG. .
[Brief description of the drawings]
FIG. 1 is a block diagram showing an electrical configuration of a digital video tape recorder according to a first embodiment.
FIG. 2 shows a configuration of a CCD.
FIG. 3 is a block diagram showing an electrical configuration of a recorded image data processing circuit.
FIG. 4 is a block diagram showing an electrical configuration of a reproduced image data processing circuit.
FIG. 5 is a perspective view of a frame image obtained by photographing.
FIG. 6 is a plan view showing still image recording / playback processing.
FIG. 7 is a plan view showing a moving image recording / reproducing process.
8A shows a recording format of a magnetic tape, and FIG. 8B shows a track format.
FIG. 9 shows an example of a pixel array.
FIG. 10 is a plan view showing still image recording / playback processing.
FIG. 11 is a plan view showing moving image recording / playback processing.
FIG. 12 is a block diagram illustrating an electrical configuration of a recording image data processing circuit according to the second embodiment.
FIG. 13 is a block diagram showing an electrical configuration of a reproduction image data processing circuit.
FIG. 14 is a plan view showing moving image recording / playback processing.
FIG. 15 is a plan view showing still image recording / playback processing.
FIG. 16 is a plan view showing moving image recording / playback processing.
FIG. 17 is a plan view showing still image recording / playback processing.
FIG. 18
FIG. 10 is a block diagram illustrating an electrical configuration of a recorded image data processing circuit according to a third embodiment.
FIG. 19
It is a block diagram which shows the electrical structure of the reproduction | regeneration image data processing circuit.
FIG. 20
The still image recording / reproducing process is shown in plan.
FIG. 21
The still image recording / reproducing process is shown in plan.
FIG. 22
(A), (B) and (C) show examples of pixels represented by image data.
FIG. 23
It is a block diagram which shows the electrical structure of an interpolation pixel value calculating circuit.
FIG. 24
Fig. 4 illustrates a pixel block for generating missing pixel data.
FIG. 25
It is a flowchart which shows the process sequence for producing | generating the data of the missing pixel.
FIG. 26
FIG. 10 is a block diagram illustrating an electrical configuration of a recorded image data processing circuit according to a fourth embodiment.
FIG. 27
It is a block diagram which shows the electrical structure of the reproduction | regeneration image data processing circuit.
FIG. 28
The still image recording / reproducing process is shown in plan.
FIG. 29
The still image recording / reproducing process is shown in plan.
FIG. 30
(A), (B) and (C) show examples of pixels represented by image data.
FIG. 31
FIG. 10 is a block diagram illustrating an electrical configuration of a recording system of a digital video tape recorder according to a fifth embodiment.
FIG. 32
It is a block diagram which shows the electric constitution of the reproduction | regeneration system of a digital video tape recorder.
FIG. 33
(A), (B) and (C) schematically represent pixels represented by image data.
FIG. 34
An example of an image is shown.
[Explanation of symbols]
11 CCD
13 Recorded image data processing circuit
24 head cylinder
34 Reproduced image data processing circuit
52,54 pixel extraction circuit
56 Difference calculation circuit
62 Image composition circuit
65 Arithmetic processing circuit

Claims (53)

In an image data recording apparatus for recording unit image data obtained by imaging a subject in a first cycle in a unit image data recording area of a recording medium,
Including a solid-state electronic image sensor that generates image data having a data amount twice as large as the unit image data, and the captured image data representing the subject image obtained by imaging the subject with the solid-state electronic image sensor is the first image data. Imaging means for outputting at a cycle of
First captured image data of the first and second captured image data output from the imaging means during a second period that is twice the first period, each representing a subject image and Image data dividing means for dividing the unit image data into first and second divided image data having a data amount;
Image data extraction means for extracting image data representing a subject image and having a data amount of the unit image data from the second captured image data;
Difference data generating means for calculating difference data between the first divided image data and the image data extracted by the image data extracting means among the first and second divided image data divided by the image data dividing means; And the first and second divided image data obtained by the division by the image data dividing means are recorded separately in two unit image data recording areas of the recording medium, and the difference data obtained by the difference data generating means Recording control means for recording in an auxiliary recording area other than the unit image data recording area of the recording medium,
An image data recording apparatus comprising: A motion detecting means for detecting a portion where there is a motion between images represented by captured image data output from the imaging means at each first imaging cycle;
The recording control means is
For the portion corresponding to the portion detected as having motion by the motion detection means, the difference data output from the difference data generation means is recorded in the auxiliary recording area.
The image data recording apparatus according to claim 1. Means for compressing the difference data output from the difference data generating means;
The recording control means is
The difference data compressed by the compression means is recorded in the auxiliary recording area.
The image data recording apparatus according to claim 1 or 2. Reading means for reading the first divided image data recorded in the unit image data recording area of the recording medium and the difference data recorded in the auxiliary recording area; and the first divided image data read by the reading means; Moving image reproduction image data generating means for generating and outputting image data corresponding to the second captured image data having the data amount of the unit image data from the difference data;
The image data recording device according to claim 1, further comprising: Mode setting means for selectively setting still playback mode and movie playback mode;
When the still reproduction mode is set by the mode setting means, the first and second divided image data recorded separately in the two unit image data recording areas are read, and the read first and second divided image data are read. When the movie reproduction mode is set by the still image data generating means for generating image data representing one frame of the still image by combining the second divided image data and the mode setting means, the two units Of the first and second divided image data recorded in the image data recording area, the first divided image data and the difference data recorded in the auxiliary recording area have the data amount of the unit image data. Moving image reproduction image data generation means for generating and outputting image data corresponding to the second captured image data;
The image data recording device according to claim 1, further comprising: Compressed difference data is recorded in the auxiliary recording area,
6. The image data recording apparatus according to claim 4, further comprising means for expanding the compressed differential data recorded in the auxiliary recording area. In an apparatus for reproducing a recording medium in which a subject image is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
The recording medium includes first and second captured image data having a data amount twice as large as the image data amount of the unit image data, which is given during a second period that is twice the first period. The first captured image data is recorded separately in the two unit image data recording areas, and the captured image data having twice the data amount given during the second period is the unit image. The first divided image data of the first and second divided image data divided so as to have the data amount, the subject image extracted from the second imaging data, and the unit image data Difference data with the extracted image data having the data amount is recorded in an auxiliary area other than the unit image data recording area,
Reading means for reading first divided image data recorded in the unit image data recording area of the recording medium and differential data recorded in the auxiliary recording area, and first divided image data read by the reading means And image data generating means for reproducing a moving image that generates and outputs image data corresponding to the second captured image data having the data amount of the unit image data from the difference data,
A digital image data reproducing apparatus comprising: In an apparatus for reproducing a recording medium in which a subject image is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
The recording medium includes first and second captured image data having a data amount twice as large as the image data amount of the unit image data, which is given during a second period that is twice the first period. The first captured image data is divided into two unit image data recording areas, and the first and second divided image data, which are divided so that each has the data amount of the unit image data, are recorded. Difference data between the first divided image data and the extracted image data extracted from the second imaging data and representing the subject image and having the data amount of the unit image data is the unit image data recording area. Is recorded in the auxiliary area other than
Mode setting means for selectively setting still playback mode and movie playback mode;
When the still reproduction mode is set by the mode setting means, the first and second divided image data recorded separately in the two unit image data recording areas are read, and the read first and second read image data are read. Still image data generating means for generating image data representing a still image of one frame by synthesizing two divided image data, and two unit image data when the movie playback mode is set by the mode setting means Of the first and second divided image data recorded separately in the recording area, the first divided image data and the difference data correspond to the second captured image data having the data amount of the unit image data. Image data generation means for moving image reproduction for generating and outputting image data to be output;
A digital image data reproducing apparatus comprising: In an image data recording apparatus for recording unit image data obtained by imaging a subject in a first cycle in a unit image data recording area of a recording medium,
Including a solid-state electronic image sensor that generates image data having a data amount twice as large as the unit image data, and the captured image data representing the subject image obtained by imaging the subject with the solid-state electronic image sensor is the first image data. Imaging means for outputting at a cycle of
The image data output from the image pickup means is output from the image pickup means so that the image data having the double data amount output in the first shooting cycle is the data amount of the unit image data and each represents a subject image. Image data extracting means for extracting first extracted image data from the image data;
First imaged image data out of the first and second imaged image data output from the imaging unit during a second imaging period that is twice the first imaging period is output by the image data extracting unit. Difference data calculation means for calculating difference data between the first extracted image data obtained by the extraction and the second extracted image data obtained by removing the first extracted image data from the first captured image data , And the first extracted image data extracted by the image data extracting means is recorded in a unit image data recording area of the recording medium, and the difference data output from the difference data calculating means is recorded in a region other than the unit image data recording area. Recording control means for recording in the auxiliary recording area of
An apparatus for recording digital image data. Means for compressing the difference data output from the difference data calculation means;
The recording control means is
The difference data compressed by the compression means is recorded in the auxiliary recording area.
The digital image data recording apparatus according to claim 9. Reading means for reading the first extracted image data recorded in the unit image data recording area of the recording medium and the difference data recorded in the auxiliary recording area, and the first extracted image data read from the reading means, Still image reproduction image data generation means for generating and outputting the first captured image data from the difference data;
The digital image data recording apparatus according to claim 9 or 10, further comprising: Mode setting means for selectively setting still playback mode and movie playback mode;
When the movie reproduction mode is set by the mode setting means, the first extracted image data recorded in the unit image data recording area is read, and the read first extracted image data is read in the first cycle. The first extracted image data extracted from the first captured image data and the auxiliary recording area when the still reproduction mode is set by the moving image reproduction image data output means output by the mode setting means and the mode setting means Image data generation means for reproducing a still image, which reads out the difference data recorded in the image data, generates the second captured image data from the read first extracted image data and difference data, and outputs the second imaged image data;
12. The digital image data recording apparatus according to claim 9, further comprising: Compressed difference data is recorded in the auxiliary recording area,
13. The digital image data recording apparatus according to claim 11, further comprising means for expanding compressed differential data recorded in the auxiliary recording area. In an apparatus for reproducing a recording medium in which a subject image is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
In the recording medium, image data representing a single frame having a data amount twice the data amount of the unit image data given in the first cycle is the data amount of the unit image data, First extracted image data extracted so as to represent a subject image is recorded in the unit image data recording area, and the first and second data amounts are doubled during the second period. Second extracted image data obtained by removing the first extracted image data extracted by the extraction process from the first captured image data of the two captured image data, and the first extracted by the extraction process. Difference data representing a difference from the extracted image data is recorded in an auxiliary area other than the unit image data recording area,
Reading means for reading the first extracted image data recorded in the image data recording area of the recording medium and the differential data recorded in the auxiliary recording area; and the first extracted image data read by the reading means; Still image reproduction image data generating means for generating and outputting the first captured image data having the double data amount obtained during the second period from the difference data,
A digital image data reproducing apparatus comprising: In an apparatus for reproducing a recording medium in which a subject image is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
In the recording medium, image data representing a single frame having a data amount twice the data amount of the unit image data given in the first cycle is the data amount of the unit image data, First extracted image data extracted so as to represent a subject image is recorded in the unit image data recording area, and the first and second data amounts are doubled during the second period. Second extracted image data obtained by removing the first extracted image data extracted by the extraction process from the first captured image data of the two captured image data, and the first extracted by the extraction process. Difference data representing a difference from the extracted image data is recorded in an auxiliary area other than the unit image data recording area,
Reading means for reading the first extracted image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area;
Mode setting means for selectively setting still playback mode and movie playback mode;
Moving image reproduction image data output means for outputting the first extracted image data read from the reading means for each of the first periods when the movie reproduction mode is set by the mode setting means, and the mode setting When the still reproduction mode is set by the means, the first extracted image data and the difference data read by the reading means have the twice the amount of data obtained during the second period. Image data generation means for still image reproduction for generating and outputting one captured image data;
A digital image data reproducing apparatus comprising: In an image data recording apparatus for recording unit image data obtained by imaging a subject in a first cycle in a unit image data recording area of a recording medium,
Including a solid-state electronic image sensor that generates image data having a data amount twice as large as the unit image data, and the captured image data representing the subject image obtained by imaging the subject with the solid-state electronic image sensor is the first image data. Imaging means for outputting at a cycle of
Of the first and second picked-up image data having the double amount of data output from the image pickup means in the first shooting cycle, the first picked-up image data each represents a subject image, and Image data dividing means for dividing the image data into first and second divided image data having a data amount of unit image data;
Interpolation image data generating means for generating interpolation image data corresponding to the second divided image data from the first divided image data divided by the image data dividing means;
Difference data calculation means for calculating difference data between the interpolation image data generated by the interpolation image data generation means and the second divided image data divided by the image data dividing means;
Image data extraction means for extracting image data representing a subject image and having a data amount of the unit image data from the second captured image data, extracted image data extracted by the image data extraction means, and the image data The first divided image data divided by the dividing means is recorded in two unit image data recording areas of the recording medium, and the difference data output from the difference data calculating means is used as an auxiliary area other than the unit image data recording area. Recording control means for recording in the recording area;
A digital image data recording apparatus comprising: Determining means for determining whether or not the sum of the difference data calculated by the difference data calculating means within a predetermined area is greater than or equal to a predetermined threshold;
The recording control means is
The image data extracted by the image data extracting means and the first image data divided by the image data dividing means are recorded in two unit image data recording areas of the recording medium, and the difference data is recorded by the determining means. The difference data determined to be equal to or greater than the threshold value is recorded in the auxiliary recording area as difference data in the area.
17. The digital image data recording apparatus according to claim 16. The interpolated image data generating means is
Extract the data representing the missing pixels and the pixels above and below the pixels that should be adjacent to the missing pixels in the horizontal or vertical direction, and add the sum of the data representing these pixels. And means for determining whether the resulting sum value is increasing or decreasing as much as the sum value for pixels present in the horizontal or vertical direction, and when increasing or decreasing, Data representing the missing pixel is generated using data representing the upper and lower or left and right pixels, and when there is no increase or decrease, the upper and lower or left and right pixels of the missing pixel and the diagonally upper and lower pixels 3 Calculate the correlation value of the pixel in the direction, and generate data representing the missing pixel using the data representing the pixel that gives the highest correlation Stage,
18. The digital image data recording apparatus according to claim 16, further comprising: Means for compressing the difference data calculated by the difference data calculation means;
The recording control means records the difference data compressed by the compression means in the auxiliary recording area;
19. The digital image data recording apparatus according to any one of claims 16 to 18. Interpolation image data generation means for generating the interpolation image data from the first divided image data recorded in the unit image data recording area;
Second divided image data generation means for generating the second divided image data from the interpolation image data generated by the second interpolation image data generation means and the difference data recorded in the auxiliary recording area;
Still image data generation for generating still image data from the first divided image data recorded in the unit image data recording area and the second divided image data generated by the second divided image data generation means means,
20. The digital image data recording apparatus according to any one of claims 16 to 19, further comprising: Mode setting means for selectively setting still playback mode and movie playback mode;
Interpolation image data generation means for generating the interpolation image data from the first divided image data recorded in the unit image data recording area;
Second divided image data generation means for generating the second divided image data from the interpolation image data generated by the second interpolation image data generation means and the difference data recorded in the auxiliary recording area;
When the movie reproduction mode is set by the mode setting means, moving image data generation means for outputting the first divided image data and the extracted image data recorded in the two unit image data recording areas for moving image reproduction. And when the still reproduction mode is set by the mode setting means, the first divided image data recorded in the unit image data recording area and the second divided image data generated by the second divided image data generating means. Still image data generating means for generating still image data from the divided image data of
21. The digital image data recording apparatus according to claim 16, further comprising: In an apparatus for reproducing a recording medium in which an image of one frame is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
In the two unit image data recording areas of the recording medium, the first captured image data of the first and second captured image data each having a data amount twice as large as the unit image data is stored. , Each of the first divided image data and the second captured image data of the first and second divided image data divided so as to represent the subject image and have the data amount of the unit image data. Extracted image data that represents a subject image and has the data amount of the unit image data is recorded, and is generated from the first divided image data in the auxiliary recording area of the recording medium. Difference data between the interpolated image data corresponding to the second divided image data and the second divided image data is recorded;
Interpolation image data generation means for generating the interpolation image data from the first divided image data recorded in the unit image data recording area;
Second divided image data generation means for generating the second divided image data from the interpolation image data generated by the second interpolation image data generation means and the difference data recorded in the auxiliary recording area;
Still image data generation for generating still image data from the first divided image data recorded in the unit image data recording area and the second divided image data generated by the second divided image data generation means means,
A digital image data reproducing apparatus comprising: In an apparatus for reproducing a recording medium in which an image of one frame is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
In the two unit image data recording areas of the recording medium, the first captured image data of the first and second captured image data each having a data amount twice as large as the unit image data is stored. , Each of the first divided image data and the second captured image data of the first and second divided image data divided so as to represent the subject image and have the data amount of the unit image data. Extracted image data that represents a subject image and has the data amount of the unit image data is recorded, and is generated from the first divided image data in the auxiliary recording area of the recording medium. Difference data between the interpolated image data corresponding to the second divided image data and the second divided image data is recorded;
Mode setting means for selectively setting still playback mode and movie playback mode;
Interpolation image data generation means for generating the interpolation image data from the first divided image data recorded in the unit image data recording area;
Second divided image data generation means for generating the second divided image data from the interpolation image data generated by the second interpolation image data generation means and the difference data recorded in the auxiliary recording area;
When the movie reproduction mode is set by the mode setting means, the moving image data reproduction means for outputting the first divided image data and the extracted image data recorded in the two unit image data recording areas for moving image reproduction. And when the still reproduction mode is set by the mode setting means, the first divided image data recorded in the unit image data recording area and the second divided image data generated by the second divided image data generating means. Still image data generating means for generating still image data from the divided image data of
A digital image data reproducing apparatus comprising: In an image data recording apparatus for recording unit image data obtained by imaging a subject in a first cycle in a unit image data recording area of a recording medium,
Including a solid-state electronic image sensor that generates image data having a data amount twice as large as the unit image data, and the captured image data representing the subject image obtained by imaging the subject with the solid-state electronic image sensor is the first image data. Imaging means for outputting at a cycle of
The captured image data that is output from the imaging means in the first imaging cycle and has a double data amount and that represents a subject image having an odd number column and an even number column is the data amount of the unit image data. Averaging means for averaging image data output from the imaging means;
Image data extracting means for extracting image data representing the subject images in the odd-numbered or even-numbered columns from the captured image data;
Difference data calculating means for calculating difference data between the image data extracted by the image data extracting means and the image data averaged by the averaging means, and the image data averaged by the averaging means Recording control means for recording in a unit image data recording area of the medium and recording the difference data output from the difference data calculating means in an auxiliary recording area other than the unit image data recording area;
An apparatus for recording digital image data. Determining means for determining whether or not the sum of the difference data calculated by the difference data calculating means within a predetermined area is greater than or equal to a predetermined threshold;
The recording control means is
The image data averaged by the averaging means is recorded in the unit image data recording area of the recording medium, and the difference data for which the sum of the difference data is determined to be greater than or equal to the threshold value by the determination means Is recorded in the auxiliary recording area as the difference data in
25. The digital image data recording apparatus according to claim 24. Means for compressing the difference data calculated by the difference data calculation means;
The recording control means records the difference data compressed by the compression means in the auxiliary recording area;
26. The digital image data recording apparatus according to claim 24 or 25. Reading means for reading the averaged image data recorded in the unit image data recording area and the difference data recorded in the auxiliary recording area, and output from the imaging means from the image data and difference data read by the reading means Image data other than the image data extracted by the image data extraction unit is generated, and the generated image data and the image data read by the reading unit are combined to double the above Still image data generating means for generating still image data having a data amount of
27. The digital image data recording apparatus according to claim 24, further comprising: Reading means for reading the averaged image data recorded in the unit image data recording area and the difference data recorded in the auxiliary recording area;
Mode setting means for selectively setting still playback mode and movie playback mode;
When the movie reproduction mode is set by the mode setting means, the moving image data generating means for outputting the averaged image data read by the reading means for moving image reproduction, and the still reproduction mode is set by the mode setting means. The image data output from the imaging unit is generated from the image data read by the reading unit and the difference data, and the image data other than the image data extracted by the image data extracting unit is generated. Still image data generating means for combining image data and image data read by the reading means to generate still image data having twice the data amount;
27. The digital image data recording apparatus according to any one of claims 24 to 26, comprising: In an apparatus for reproducing a recording medium in which a subject image is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
In the recording medium, captured image data representing an image of one frame having a data amount twice the data amount of the unit image data given in the first period is the data amount of the unit image data. Image data averaged so as to represent the subject image is recorded in the unit image data recording area, and image data representing the odd-numbered or even-numbered subject image extracted from the captured image data and the averaged image Difference data from the data is recorded in an auxiliary area other than the unit image data recording area,
From the image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area, and from the averaged image data and difference data read by the reading means, the imaging Image data generation means for still image reproduction for generating and outputting image data;
A digital image data reproducing apparatus comprising: In an apparatus for reproducing a recording medium in which a subject image is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
In the recording medium, captured image data representing an image of one frame having a data amount twice the data amount of the unit image data given in the first period is the data amount of the unit image data. Image data averaged so as to represent the subject image is recorded in the unit image data recording area, and image data representing the odd-numbered or even-numbered subject image extracted from the captured image data and the averaged image Difference data from the data is recorded in an auxiliary area other than the unit image data recording area,
Reading means for reading the image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area;
Mode setting means for selectively setting still playback mode and movie playback mode;
The moving image reproduction image data output means for outputting the averaged image data read from the reading means for each first period when the movie reproduction mode is set by the mode setting means, and the mode setting means. Still image reproduction image data generation means for generating and outputting the captured image data from the averaged image data and the difference data read by the reading means when the still reproduction mode is set,
A digital image data reproducing apparatus comprising: In an image data recording apparatus for recording unit image data obtained by imaging a subject in a first cycle in a unit image data recording area of a recording medium,
Including a solid-state electronic image sensor that generates a data amount twice as large as the image data amount of the unit image data, and the captured image data representing the subject image obtained by imaging the subject using the solid-state electronic image sensor. Imaging means for outputting at a cycle of
Image data dividing means for dividing the captured image data output from the imaging means so that each of the unit image data has a data amount and represents a subject image;
Of the image data divided by the image data dividing means, the high frequency component data extracting means for extracting the high frequency component of one divided image data, and the other image data among the image data divided by the image data dividing means A recording control means for recording the high frequency component data extracted by the high frequency component data extracting means in an auxiliary recording area other than the image data recording area;
An apparatus for recording digital image data. Compression means for compressing the high frequency component data extracted by the high frequency component data extraction means;
The recording control means is
High-frequency component data compressed by the compression means is recorded in the auxiliary recording area,
32. The digital image data recording apparatus according to claim 31. From the compressed image data recorded in the image data recording area of the recording medium and the high frequency component data recorded in the auxiliary recording area, and from the divided image data and high frequency component data read by the reading means, n Still image data generating means for generating image data constituting one frame of high-quality still image having double data amount,
32. The digital image data recording apparatus according to claim 31, further comprising: Reading means for reading the divided image data recorded in the image data recording area of the recording medium and the high-frequency component data recorded in the auxiliary recording area;
Mode setting means for selectively setting still playback mode and movie playback mode;
When the movie reproduction mode is set by the mode setting means, moving image data output means for outputting the divided data read by the reading means, and when the still reproduction mode is set by the mode setting means, the reading means reads Still image data generating means for generating image data constituting one frame of high-quality still image having twice the amount of data from the divided image data and high-frequency component data,
32. The digital image data recording apparatus according to claim 31, further comprising: The compressed high frequency component data is recorded in the auxiliary recording area,
35. The digital image data recording apparatus according to claim 33 or 34, wherein the reading unit includes a data expansion unit that expands compressed differential data compressed and recorded in the auxiliary recording area. An image of one frame is represented by unit image data having a predetermined amount of image data, and the size of the recording area of the unit image data is specified in advance, and in accordance with this specification, the data amount is twice the data amount of the unit image data. The image data representing an image of one frame is divided into unit image data so that each represents an object image, and one of the divided image data is recorded in the unit image data recording area. A digital image data reproducing apparatus for reproducing the image of one frame from a recording medium in which high-frequency components of other image data are recorded in an auxiliary recording area other than the unit image data recording area.
Reading means for reading the divided image data recorded in the image data recording area of the recording medium and the high-frequency component data recorded in the auxiliary recording area, and the double from the image data and high-frequency component data read by the reading means Still image data generating means for generating image data constituting a single frame high-quality still image having a data amount of
A digital image data reproducing apparatus comprising: An image of one frame is represented by unit image data having a predetermined amount of image data, and the size of the recording area of the unit image data is specified in advance, and in accordance with this specification, the data amount is twice the data amount of the unit image data. The image data representing an image of one frame is divided into unit image data so that each represents an image of one frame, and one image data among the divided image data is recorded in the unit image data recording area, A digital image data reproducing device for reproducing the image of one frame from a recording medium in which high-frequency components of other image data among the divided image data are recorded in an auxiliary recording area other than the unit image data recording area;
Reading means for reading the image data recorded in the image data recording area of the recording medium and the high-frequency component data recorded in the auxiliary recording area;
Mode setting means for selectively setting still playback mode and movie playback mode;
When the movie reproduction mode is set by the mode setting means, the moving image data output means for outputting the divided image data read by the reading means in the first cycle, and the still reproduction mode is set by the mode setting means. Sometimes still image data generating means for generating image data constituting one frame of high-quality still image having double the data amount from the divided image data and high frequency component data read by the reading means,
A digital image data reproducing apparatus comprising: In the auxiliary recording area, compressed high frequency component data is recorded,
38. The digital image reproducing apparatus according to claim 36 or 37, wherein the reading means includes data expansion means for expanding compressed high-frequency component data compressed and recorded in the auxiliary recording area. In an image data recording apparatus for recording unit image data obtained by imaging a subject in a first cycle in a unit image data recording area of a recording medium,
Including a solid-state electronic image sensor that generates image data having a data amount twice as large as the unit image data, and the captured image data representing the subject image obtained by imaging the subject with the solid-state electronic image sensor is the first image data. With a period of
The first captured image data of the first and second captured image data obtained during the second period that is twice the first period, each representing the subject image and the unit image data Dividing into first and second divided image data having a data amount;
Image data representing a subject image and having a data amount of the unit image data is extracted from the second captured image data;
Calculating difference data between the first divided image data and the extracted image data among the divided first and second divided image data;
The first and second divided image data obtained by the division are divided and recorded in two unit image data recording areas of the recording medium, and the obtained difference data is recorded on the recording medium other than the unit image data recording area. Record in the auxiliary recording area,
Image data recording method. In an apparatus for reproducing a recording medium in which a subject image is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
The recording medium includes first and second captured image data having a data amount twice as large as the image data amount of the unit image data, which is given during a second period that is twice the first period. The first captured image data is recorded separately in the two unit image data recording areas, and the captured image data having twice the data amount given during the second period is the unit image. The first divided image data of the first and second divided image data divided so as to have the data amount, the subject image extracted from the second imaging data, and the unit image data Difference data with the extracted image data having the data amount is recorded in an auxiliary area other than the unit image data recording area,
Reading the first divided image data recorded in the unit image data recording area of the recording medium and the difference data recorded in the auxiliary recording area;
Generating and outputting image data corresponding to the second captured image data having the data amount of the unit image data from the read first divided image data and difference data;
Digital image data reproduction method. In an apparatus for reproducing a recording medium in which a subject image is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
The recording medium includes first and second captured image data having a data amount twice as large as the image data amount of the unit image data, which is given during a second period that is twice the first period. The first captured image data is divided into two unit image data recording areas, and the first and second divided image data, which are divided so that each has the data amount of the unit image data, are recorded. Difference data between the first divided image data and the extracted image data extracted from the second imaging data and representing the subject image and having the data amount of the unit image data is the unit image data recording area. Is recorded in the auxiliary area other than
A mode setting means for selectively setting the still playback mode and the movie playback mode is provided.
When the still reproduction mode is set by the mode setting means, the first and second divided image data recorded separately in the two unit image data recording areas are read, and the read first and second read image data are read. The image data representing the still image of one frame is generated by combining the two divided image data,
Of the first and second divided image data recorded separately in the two unit image data recording areas when the movie reproduction mode is set by the mode setting means, the first divided image data and Generating and outputting image data corresponding to the second captured image data having the data amount of the unit image data from the difference data;
Digital image data reproduction method. In an image data recording apparatus for recording unit image data obtained by imaging a subject in a first cycle in a unit image data recording area of a recording medium,
Including a solid-state electronic image sensor that generates image data having a data amount twice as large as the unit image data, and the captured image data representing the subject image obtained by imaging the subject with the solid-state electronic image sensor is the first image data. Obtained from the imaging means with a period of
The image data output from the image pickup means is output from the image pickup means so that the image data having the double data amount output in the first shooting period is the data amount of the unit image data and each represents a subject image. Extracting first extracted image data from the image data,
First imaged image data out of the first and second imaged image data output from the imaging unit during a second imaging period that is twice the first imaging period is obtained by the image data extracting unit. Calculating difference data between the first extracted image data obtained by the extraction and the second extracted image data obtained by removing the first extracted image data from the first captured image data;
The extracted first extracted image data is recorded in a unit image data recording area of the recording medium, and the difference data output from the difference data calculating means is recorded in an auxiliary recording area other than the unit image data recording area.
Digital image data recording method. In an apparatus for reproducing a recording medium in which a subject image is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
In the recording medium, image data representing a single frame having a data amount twice the data amount of the unit image data given in the first cycle is the data amount of the unit image data, First extracted image data extracted so as to represent a subject image is recorded in the unit image data recording area, and the first and second data amounts are doubled during the second period. Second extracted image data obtained by removing the first extracted image data extracted by the extraction process from the first captured image data of the two captured image data, and the first extracted by the extraction process. Difference data representing a difference from the extracted image data is recorded in an auxiliary area other than the unit image data recording area,
Reading the first extracted image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area;
Generating and outputting the first captured image data having the double data amount obtained during the second period from the read first extracted image data and difference data;
Digital image data reproduction method. In an apparatus for reproducing a recording medium in which a subject image is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
In the recording medium, image data representing a single frame having a data amount twice the data amount of the unit image data given in the first cycle is the data amount of the unit image data, First extracted image data extracted so as to represent a subject image is recorded in the unit image data recording area, and the first and second data amounts are doubled during the second period. Second extracted image data obtained by removing the first extracted image data extracted by the extraction process from the first captured image data of the two captured image data, and the first extracted by the extraction process. Difference data representing a difference from the extracted image data is recorded in an auxiliary area other than the unit image data recording area,
Reading the first extracted image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area;
A mode setting means for selectively setting the still playback mode and the movie playback mode is provided.
Outputting the first extracted image data read when the movie reproduction mode is set by the mode setting means for each of the first periods;
The first data having the double data amount obtained during the second period from the first extracted image data and the difference data read when the still reproduction mode is set by the mode setting means. Generate and output captured image data of
Digital image data reproduction method. In an image data recording apparatus for recording unit image data obtained by imaging a subject in a first cycle in a unit image data recording area of a recording medium,
Including a solid-state electronic image sensor that generates image data having a data amount twice as large as the unit image data, and the captured image data representing the subject image obtained by imaging the subject with the solid-state electronic image sensor is the first image data. Obtained from the imaging means with a period of
Of the first and second picked-up image data having the double amount of data output from the image pickup means in the first shooting cycle, the first picked-up image data each represents a subject image, and Dividing into first and second divided image data having a data amount of unit image data;
Interpolated image data corresponding to the second divided image data is generated from the divided first divided image data;
Calculating difference data between the generated interpolated image data and the divided second divided image data;
Image data representing a subject image and having a data amount of the unit image data is extracted from the second captured image data;
The extracted extracted image data and the first divided image data divided by the image data dividing means are recorded in two unit image data recording areas of the recording medium, and the difference data output from the difference data calculating means Is recorded in an auxiliary recording area other than the unit image data recording area,
Digital image data recording method. In an apparatus for reproducing a recording medium in which an image of one frame is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
In the two unit image data recording areas of the recording medium, the first captured image data of the first and second captured image data each having a data amount twice the data amount of the unit image data is stored. , Each of the first divided image data and the second captured image data out of the first and second divided image data divided so as to represent the subject image and have the data amount of the unit image data. Extracted image data, which represents the subject image and has the data amount of the unit image data, is recorded, and is generated from the first divided image data in the auxiliary recording area of the recording medium. Difference data between the interpolated image data corresponding to the second divided image data and the second divided image data is recorded,
Generating the interpolated image data from the first divided image data recorded in the unit image data recording area;
Generating the second divided image data from the generated interpolated image data and the difference data recorded in the auxiliary recording area;
Still image data is generated from the first divided image data recorded in the unit image data recording area and the generated second divided image data.
Digital image data reproduction method. In an apparatus for reproducing a recording medium in which an image of one frame is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
In the two unit image data recording areas of the recording medium, the first captured image data of the first and second captured image data each having a data amount twice the data amount of the unit image data is stored. , Each of the first divided image data and the second captured image data out of the first and second divided image data divided so as to represent the subject image and have the data amount of the unit image data. Extracted image data, which represents the subject image and has the data amount of the unit image data, is recorded, and is generated from the first divided image data in the auxiliary recording area of the recording medium. Difference data between the interpolated image data corresponding to the second divided image data and the second divided image data is recorded,
A mode setting means for selectively setting the still playback mode and the movie playback mode is provided.
Generating the interpolated image data from the first divided image data recorded in the unit image data recording area;
Generating the second divided image data from the generated interpolated image data and the difference data recorded in the auxiliary recording area;
When the movie playback mode is set by the mode setting means, the first divided image data and the extracted image data recorded in the two unit image data recording areas are output for moving image playback,
When the still reproduction mode is set by the mode setting means, the first divided image data recorded in the unit image data recording area and the second divided image data generated by the second divided image data generating means. Generate still image data from image data,
Digital image data reproduction method. In an image data recording apparatus for recording unit image data obtained by imaging a subject in a first cycle in a unit image data recording area of a recording medium,
Including a solid-state electronic image sensor that generates image data having a data amount twice as large as the unit image data, and the captured image data representing the subject image obtained by imaging the subject with the solid-state electronic image sensor is the first image data. Obtained from the imaging means with a period of
The captured image data that is output from the imaging means in the first imaging cycle, has the double data amount, and represents a subject image having an odd number column and an even number column, becomes the data amount of the unit image data. Average the image data output from the imaging means,
Extracting image data representing subject images in the odd-numbered or even-numbered rows from the captured image data;
Calculate difference data between the extracted image data and the image data averaged by the averaging means,
The averaged image data is recorded in a unit image data recording area of the recording medium, and the difference data output from the difference data calculation means is recorded in an auxiliary recording area other than the unit image data recording area.
Digital image data recording method. In an apparatus for reproducing a recording medium in which a subject image is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
In the recording medium, captured image data representing an image of one frame having a data amount twice the data amount of the unit image data given in the first period is the data amount of the unit image data. Image data averaged so as to represent the subject image is recorded in the unit image data recording area, and image data representing the odd-numbered or even-numbered subject image extracted from the captured image data and the averaged image Difference data from the data is recorded in an auxiliary area other than the unit image data recording area,
Reading the image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area;
The captured image data is generated and output from the read averaged image data and difference data,
Digital image data reproduction method. In an apparatus for reproducing a recording medium in which a subject image is represented by unit image data having a predetermined amount of image data and the unit image data is recorded in a unit image data recording area in a first period,
In the recording medium, captured image data representing an image of one frame having a data amount twice the data amount of the unit image data given in the first period is the data amount of the unit image data. Image data averaged so as to represent the subject image is recorded in the unit image data recording area, and image data representing the odd-numbered or even-numbered subject image extracted from the captured image data and the averaged image Difference data from the data is recorded in an auxiliary area other than the unit image data recording area,
Reading the image data recorded in the image data recording area of the recording medium and the difference data recorded in the auxiliary recording area;
A mode setting means for selectively setting the still playback mode and the movie playback mode is provided.
The averaged image data read when the movie playback mode is set is output for each of the first periods,
Generate and output the captured image data from the averaged image data and difference data read when the still playback mode is set,
Digital image data reproduction method. In an image data recording apparatus for recording unit image data obtained by imaging a subject in a first cycle in a unit image data recording area of a recording medium,
Including a solid-state electronic image sensor that generates a data amount twice as large as the image data amount of the unit image data, and the captured image data representing the subject image obtained by imaging the subject using the solid-state electronic image sensor. Imaging means for outputting at a cycle of
The captured image data output from the imaging unit is divided so that each unit image data has a data amount and represents a subject image.
Of the divided image data, extract the high frequency component of one divided image data,
Of the divided image data, other image data is recorded in the image data recording area of the recording medium, and the high frequency component data extracted by the high frequency component data extracting means is recorded in the auxiliary recording area other than the image data recording area. Do,
Digital image data recording method. An image of one frame is represented by unit image data having a predetermined amount of image data, and the size of the recording area of the unit image data is defined in advance. The image data representing an image of one frame is divided into unit image data so that each represents an object image, and one of the divided image data is recorded in the unit image data recording area. A digital image data reproducing device for reproducing the image of one frame from a recording medium in which a high-frequency component of other image data is recorded in an auxiliary recording area other than the unit image data recording area.
Read the divided image data recorded in the image data recording area of the recording medium and the high frequency component data recorded in the auxiliary recording area,
Generating image data constituting a high-quality still image of one frame having the double amount of data from the read image data and high-frequency component data;
Digital image data reproduction method. An image of one frame is represented by unit image data having a predetermined amount of image data, and the size of the recording area of the unit image data is specified in advance, and in accordance with this specification, the data amount is twice the data amount of the unit image data. The image data representing an image of one frame is divided into unit image data so that each represents an image of one frame, and one image data among the divided image data is recorded in the unit image data recording area, A digital image data reproducing device for reproducing the image of one frame from a recording medium in which high-frequency components of other image data among the divided image data are recorded in an auxiliary recording area other than the unit image data recording area;
Read the image data recorded in the image data recording area of the recording medium and the high frequency component data recorded in the auxiliary recording area,
A mode setting means for selectively setting the still playback mode and the movie playback mode is provided.
When the movie reproduction mode is set by the mode setting means, the divided image data read by the reading means is output in a first cycle,
When the still reproduction mode is set by the mode setting means, image data constituting one frame of a high-quality still image having twice the data amount is generated from the divided image data and high-frequency component data read by the reading means. ,
Digital image data reproduction method.

Images