KR100254081B1 - Apparatus and method for processing image data - Google Patents

Abstract

An image data processing apparatus comprising: a first imaging element for outputting a green image signal, and a second and second arrangement for outputting a red image signal and a blue image signal at a position offset in the oblique direction from registration with respect to the first imaging element; 3 The subject is picked up by the image pickup element, and the image signals output from these image pickup elements are converted into digital green image signals, digital red image signals, and digital blue image signals, respectively, and stored in a memory after data compression.

Description

Image data processing device and method

1 is a block diagram showing one embodiment of an image data processing apparatus according to the present invention;

FIG. 2 is a schematic diagram for explaining the arrangement of an imaging device in the image data processing apparatus shown in FIG.

FIG. 3 is a schematic diagram for explaining the relationship between the compression ratio, the data amount, and the number of recordable images in the image data processing apparatus shown in FIG.

4 is a schematic diagram for explaining the operation of the image data processing apparatus shown in FIG.

5 is a block diagram showing another embodiment of the image data processing apparatus according to the present invention.

FIG. 6 is a schematic diagram for explaining the relationship between the compression ratio, the data amount, and the number of recordable images in the image data processing apparatus shown in FIG.

FIG. 7 is a schematic diagram for explaining the operation of the image data processing apparatus shown in FIG.

* Explanation of symbols for main parts of the drawings

1: imaging lens 2: imaging device

3: analog / digital converter 4: frame memory

5 memory controller 6 interpolation circuit

7 data compression / expansion circuit 8 recording medium

9: central processing unit (CPU)

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image data processing apparatus and method for signal processing image data obtained by imaging with an image pickup device, and more particularly, to an image data processing apparatus and method for digital signal processing image data to store image data after signal processing. will be.

Background Art Conventionally, for example, an electronic still camera in which analog image data obtained by imaging with an imaging device such as a solid state image sensor is recorded on a magnetic disk in analog form is known, for example, from US Pat. No. 4,541,016.

By the way, as can be seen in still video cameras, the electronicization of the camera is progressing, but even higher resolution and higher resolution are required in the future even when compared with existing silver salt photographs.

However, conventional electronic still cameras which record image data on a magnetic disk in analog form have problems such as jitter, color bleeding, etc. in the output image, resulting in poor resolution and deterioration in image quality.

SUMMARY OF THE INVENTION An object of the present invention is to provide an image data processing apparatus and method capable of storing a large number of images with high resolution and high image quality with a small memory capacity without causing jitter, color bleeding, or the like.

In order to achieve the object of the present invention, in the present invention, in the image data processing apparatus, the first image pickup device for outputting a green image signal and the first image pickup device are disposed at a position offset in the oblique direction with respect to the first image pickup device. Image pickup means having second and third image pickup elements for outputting a red image signal and a blue image signal, and a green image signal, a red image signal, and a blue image signal output from the image pickup means, respectively, a digital green image signal and a digital red image. Conversion means for converting the signal into a digital blue image signal, compression means for data compression of the digital green image signal, the digital red image signal, and the digital blue image signal, respectively, the digital green image signal and the digital red image signal compressed by the compression means. And storage means for storing the digital blue image signal.

1 is a configuration diagram showing an embodiment of an image data processing apparatus of a digital electronic still camera according to the present invention.

1, reference numeral 1 is an imaging lens, reference number 2 is an imaging device, reference number 3 is an analog / digital (A / D) converter, and reference number 4 is a frame. Memory, reference number 5 is a memory controller, reference number 6 is an interpolation circuit, reference number 7 is a data compression / extension circuit, reference number 8 is a recording medium, reference number 9 Each denotes a CPU.

The imaging lens 1 collects light from an object (not shown) and forms an image at a predetermined position of the imaging device 2.

The imaging device 2 generates an analog electric signal corresponding to a light reception amount, for example, R (Red: red), G (Green: green), and B (Blue: blue) of three primary colors of color. Three charge coupling elements (CCDs) are provided to output analog image data signals.

As shown in FIG. 2, the imaging device 2 of the three CCDs in this example is a direction shifted by half a pixel in the inclination direction, specifically, in the horizontal and vertical directions, with respect to the G CCD grating. CCDs of R and B are arranged to interpolate. In this example, R and B are arranged at the same position in the registration (for this kind of technology, see, for example, Japanese Patent Laid-Open No. 2-177672).

The A / D converter 3 converts the red, blue and green analog image data signals obtained by the imaging device 2 into digital signals, respectively.

The frame memory 4 stores image data converted by the A / D converter 3 into a digital signal and image data decompressed by the data compression / expansion circuit 7 under the control of the memory controller 5.

The interpolation processing circuit 6 outputs from the data compression / expansion circuit 7 and the digital image data in which the G stored in the frame memory 4 is shifted in the oblique direction, for example, pixels (768 × 480 × 3) In the original image data having a capacity of 1.08 MB, interpolation processing (fixed processing) for the above-described variation is performed to obtain high definition image data having a pixel of (1536 x 480 x 3) and a capacity of 4.3 MB.

Based on the control of the CPU 9, the data compression / expansion circuit 7 selects original image data having a pixel (768 x 480 x 3) stored in the frame memory 4 and a capacity of 1.08 MB in the compression process. Compression ratio, for example 0 (uncompressed), 1/2, 1/3, 1/4... Compress the data with The data-compressed image data is stored in the recording medium 8 as described later.

The data compression / expansion circuit 7 expands the data until the compressed image data read out from the recording medium 8 is equal to the original image data based on the control of the CPU 9 in the decompression / interpolation process. The video signal is converted into a predetermined format and stored in the frame memory 4.

The recording medium 8 is formed of, for example, an 8 MB integrated circuit (IC) card, and records image data compressed by the data compression / expansion circuit 7 based on the control of the CPU 9. The recorded image data is read out by the data compression / expansion circuit 7 based on the control of the CPU 9.

3 shows the amount of data after processing in the interpolation circuit 6, the data compression / expansion circuit 7, and the number of image data that can be stored in the recording medium (8MB IC card) 8.

As can be seen from FIG. 3, since the digital image data is compressed in the data compression / expansion circuit 7 at a predetermined compression rate and stored in the recording medium 8, many images can be stored in one IC card. .

For example, the data can be compressed and stored in the recording medium 8 after the predetermined interpolation process is performed on the digital image data. However, in this example, the compression ratio can be made smaller than in the case of compression after this interpolation process. . In addition, a plurality of uncompressed original image data can be stored.

In addition, by increasing the compression ratio, the number of saved images of one IC card can be increased.

The CPU 9 performs control of data transfer between the frame memory 4 and the data compression / expansion circuit 7 and between the data compression / expansion circuit 7 and the recording medium 8 and at the same time. The high definition image data output from the interpolation circuit 6 is converted into a video signal of a predetermined format and output as RGB image data.

Next, the operation by the above configuration will be described with reference to FIGS. 1 and 4.

Light generated from an object not shown is incident on the imaging lens 1 and is imaged at a predetermined position of the imaging device 2 by the imaging lens 1. In the imaging device 2, red, blue and green analog electric signals corresponding to the received light amount are generated, and after predetermined processing, are input to the A / D converter 3 as analog image data signals. As described above, these image data are image data in which only G is shifted in the inclined direction for half of the image.

In the A / D converter 3, the input red, blue and green analog image data signals are converted into red, blue and green digital signals, respectively. This digital image data signal is stored in the frame memory 4 as RGB original image data.

Image data having a pixel stored in the frame memory 4 (768 x 480 x 3) and a capacity of 1.08 MB is read out by the data compression / extension circuit 7.

The data compression / expansion circuit 7 performs data compression processing on the digital red image data, the digital blue image data, and the digital green image data at a predetermined compression rate, or is kept as it is (uncompressed), so that the compression / uncompression The image data is stored in the recording medium 8 based on the control of the CPU 9.

Here, when outputting image data stored in the recording medium 8 to a display device such as a liquid crystal display (LCD), a printer, or the like, predetermined recording of the recording medium 8 is performed based on the control of the CPU 9. Desired digital red, blue and green image data from the area is read out in the data compression / extension circuit 7.

In the data compression / expansion circuit 7, the data is decompressed and stored in the frame memory 4 until the compressed image data read out from the recording medium 8 becomes equivalent to the original image data. The image data stored in the frame memory 4 is read out by the interpolation circuit 6.

In the interpolation circuit 6, since G is shifted in the oblique direction in R, G, and B image data, interpolation processing (fixed processing) or the like is performed on this, and the pixel is (1536 x 480 x 3). It is output to the CPU 9 as image data with a capacity of 4.3 MB.

The CPU 9 converts the video signal into a predetermined format and outputs the RGB image data.

As described above, according to this embodiment, after converting the analog image data obtained by the shift of the inclined pixel of the CCD in the electronic still camera into digital image data, the image data is compressed and stored at a predetermined compression rate. When outputting the data, the stored image data is decompressed and then subjected to high-definition (interpolation) processing, and the interpolated image data is output. An image can be obtained.

In addition, since image data after A / D conversion is immediately compressed and stored in the recording medium 8, a large number of image data can be stored for one IC card even when an IC card is applied as the recording medium. In this way, a practical and highly versatile device can be realized.

For example, the data can be compressed and stored in the recording medium 8 after the predetermined interpolation process is performed on the digital image data. However, in this example, the compression ratio is reduced compared with the case of compressing the data after the interpolation process. The compression processing time can be shortened, and more original image data can be stored.

In this embodiment, three CCD oblique direction pixel shifts are performed, and the case where high definition images are obtained by performing high-definition processing (interpolation processing) on this example is described as an example, but the present invention is not limited thereto. It goes without saying that the present invention can be applied to a case of using a single CCD camera, two CCD cameras, or horizontal pixel shift.

As described above, according to the present invention, a high resolution can be realized and a high quality image is obtained.

In addition, since the image data is compressed and recorded in the storage means, a large number of image data can be stored for one recording medium even when an IC card is applied as the recording medium, for example, and thus a practical and highly versatile device. Can be realized.

Next, another embodiment of the present invention will be described with reference to FIG. In addition, the same components as in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted.

The A / D converter 3 converts the analog image data signal obtained by the imaging device 2 into a digital signal.

The frame memory 4 stores image data converted into a digital signal by the A / D converter 3 under the control of the memory controller 5.

The interpolation processing circuit 6 includes digital image data in which G stored in the frame memory 4 is shifted in the oblique direction, for example, original image data having a pixel of (768 × 480 × 3) and a capacity of 1.08 MB. The interpolation processing (fixed-definition processing) for the above-described variation is performed to obtain high-definition image data having a pixel of (1536 × 480 × 3) and a capacity of 4.3 MB.

The data compression / extension circuit 7 converts 4.3 MB of image data interpolated by the interpolation circuit 6 into predetermined compression ratios, for example, 1/4, 1/8, 1/12, 1/16. Compress the data into The data-compressed image data is stored in the recording medium 8 as described later.

In addition, the data compression / expansion circuit 7 expands the compressed image data read out from the recording medium 8 until it becomes equivalent to the original image data, converts it into a video signal of a predetermined format, and outputs it as RGB image data.

The recording medium 8 is made of, for example, an 8 MB IC card, and records image data compressed by the data compression / expansion circuit 7 based on the control of the CPU 9. The recorded image data is read out by the data compression / expansion circuit 7 based on the control of the CPU 9.

6 shows the amount of data after processing in the interpolation circuit 6, the data compression / expansion circuit 7, and the number of image data that can be stored in the recording medium (8MB IC card) 8.

As can be seen from FIG. 6, the data compression / extension circuit 7 compresses the interpolated image data at a predetermined compression rate and stores the data on the recording medium 8, whereby a large number of images can be stored on one IC card. have.

In addition, by increasing the compression ratio, the number of saved images of one IC card can be increased.

Next, the operation by the above configuration will be described with reference to FIGS. 5 and 7.

Light generated from an object not shown is incident on the imaging lens 1, and is imaged at a predetermined position of the imaging device 2 by the imaging lens 1. In the imaging device 2, an analog electric signal corresponding to the amount of light received is generated, and after a predetermined process, is input to the A / D converter 3 as an analog image data signal. As described above, this image data is image data in which only G is displaced in the inclination direction of the half image.

In the A / D converter 3, the input analog image data signal is converted into a digital signal. This digital image data signal is stored in the frame memory 4 as RGB original image data.

Image data having a pixel stored in the frame memory 4 (768 x 480 x 3) and a capacity of 1.08 MB is read out by the interpolation circuit 6.

In the interpolation circuit 6, G in the original image data is shifted in the oblique direction, so that interpolation processing (fixed fine processing) or the like is performed so that the pixel is (1536 × 480 × 3) and the capacity is 4.3 MB. The image data is output to the data compression / expansion circuit 7 as image data.

In the data compression / expansion circuit 7, a data compression process is performed on the input image data at a predetermined compression rate, and the image data in which the data is compressed is stored in the recording medium 8 under the control of the CPU 9.

Here, in the case of outputting the image data stored in the recording medium 8 to a display device such as an LCD, a printer, or the like, a desired image from a predetermined recording area of the recording medium 8 under the control of the CPU 9. Data is read into the data compression / extension circuit 7.

In the data compression / expansion circuit 7, the compressed image data read out from the recording medium 8 is extended until it is equivalent to the original image data, converted into a video signal of a predetermined format, and output as RGB image data.

As described above, according to the present embodiment, after converting the analog image data obtained by the gradient pixel shift of the CCD in the electronic still camera into digital image data, high definition (interpolation) processing is performed, and the interpolated image data. Since the data is compressed and stored at a predetermined compression rate, and the stored image data is extended and output at the time of output, generation of jitter and color blur can be prevented, and a high quality image can be obtained at high resolution.

Since the interpolated image data is compressed and stored in the recording medium 8, a large number of image data can be stored for one IC card even when the IC card is applied as the recording medium, for example. It is possible to realize a highly versatile and versatile device.

In the present embodiment, the case where three CCD oblique direction pixel shifts are performed and high-definition processing (interpolation processing) is performed is described as an example, but the present invention is not limited thereto. It goes without saying that the present invention can also be applied to a case where a CCD camera, two CCD cameras, or horizontal pixel variations are used.

As described above, according to the present invention, a high resolution can be realized and a high quality image is obtained.

In addition, since the interpolated image data is compressed and recorded in the storage means, a large number of image data can be stored for one recording medium even when an IC card is applied as the recording medium, for example, so that it is practical and versatile. High device can be realized.

Claims (8)

In the image data processing apparatus, A first image pickup device for outputting a green image signal, and second and third image pickup devices for outputting a red image signal and a blue image signal at a position offset in an oblique direction from registration with respect to the first image pickup device; Imaging means for imaging the camera; Conversion means for converting the green image signal, the red image signal, and the blue image signal output from the image pickup means into a digital green image signal, a digital red image signal, and a digital blue image signal, respectively; Compression means for data-compressing the digital green image signal, the digital red image signal, and the digital blue image signal, respectively; and Storage means for storing the digital green image signal, the digital red image signal, and the digital blue image signal compressed by the compression means; An image data processing apparatus comprising a. The method of claim 1, Decompression means for data decompression of the digital green image signal, the digital red image signal, and the digital blue image signal read out from the storage means, and Interpolation means for generating and outputting high-resolution image data by interpolation processing from the digital green image signal, digital red image signal, and digital blue image signal extended by the decompression means. The image data processing apparatus further comprises. An image data processing apparatus according to claim 1, wherein said storage means is an IC card. In the image data processing apparatus, A first image pickup device for outputting a green image signal, and second and third image pickup devices for outputting a red image signal and a blue image signal at a position offset in an oblique direction from registration with respect to the first image pickup device; Imaging means for imaging the camera, Conversion means for converting the green image signal, the red image signal, and the blue image signal output from the image pickup means into a digital green image signal, a digital red image signal, and a digital blue image signal, respectively; Interpolation means for interpolating the digital green image signal, the digital red image signal, and the digital blue image signal; Compression means for respectively data-compressing the digital green image signal, the digital red image signal, and the digital blue image signal after interpolation processing, and Storage means for storing the digital green image signal, the digital red image signal, and the digital blue image signal compressed by the compression means; An image data processing apparatus comprising a. 5. The image data processing apparatus according to claim 4, further comprising decompression means for decompressing and outputting the digital green image signal, the digital red image signal, and the digital blue image signal respectively read out from the storage means. An image data processing apparatus according to claim 4, wherein said storage means is an IC card. In the image data processing method, The subject is photographed by a first imaging device that outputs a green image signal, and second and third imaging devices that are disposed at positions offset in an oblique direction from registration with respect to the first imaging device, and output red and blue image signals. Imaging; Converting the green image signal, the red image signal, and the blue image signal into a digital green image signal, a digital red image signal, and a digital blue image signal, respectively; Data compression of the digital green image signal, the digital red image signal, and the digital blue image signal, respectively, and Storing the compressed digital green image signal, digital red image signal, and digital blue image signal Image data processing method comprising a. The method of claim 7, wherein Reading out the digital green image signal, the digital red image signal, and the digital blue image signal stored in the storage step, Data decompressing the read digital green picture signal, digital red picture signal, and digital blue picture signal, and Generating image data of high resolution by interpolation processing from the decompressed digital green image signal, digital red image signal, and digital blue image signal The image data processing method further comprises.