KR100207984B1 - High definition image pickup device using 3board type image sensor - Google Patents

Abstract

The present invention relates to a high-resolution image pickup apparatus using a three-plate type image sensor, and more particularly, to a signal processing apparatus for an HDTV image pickup apparatus using an inexpensive three-plate CCD, The pixel positions of the red image sensor and the blue image sensor are shifted in the vertical direction and the horizontal direction corresponding to the green image sensor And the red and blue component pixels are shared by the green component pixels existing in the adjacent scan lines in the same field by using the video signal synthesizing apparatus of the present invention provided with the line memories for red and blue channels Thereby increasing the number of vertical scanning lines.

According to the high resolution image pickup apparatus using the three-plate type image sensor according to the present invention, it is possible to implement a high resolution HDTV image pickup apparatus with a normal resolution image sensor without using an additional image sensor while using the conventional three- , Eliminating the costly redundancy of the product, thereby providing high practicality and economy for HDTV imaging devices.

Description

High resolution imaging device using 3 - plate image sensor.

The present invention relates to a high-resolution imaging apparatus, and more particularly, to an imaging apparatus for a high definition television (HDTV) using an inexpensive three-plate type CCD (Charge Coupled Device) A CCD having a normal resolution of a PAL (Phase Alternation by Lines) method (that is, a vertical resolution of an HDTV vertical resolution Resolution image pickup using a three-plate type image sensor that increases the resolution of an imaging device by sharing red and blue component pixels by adjacent green component pixels by using a line memory for red and blue channels) ≪ / RTI >

A video system such as a video tape recorder, a television, and a computer monitor uses pixels of a video display device such as a CRT (Cathode Ray Tube), a LCD (Liquid Crystal Device), and a PDP (Plasma Display Panel) The motion of a continuous image composed of a predetermined number of frames per second is detected. This means that even if only a video signal for a specific point on the video display device per unit time is provided, .

In this case, the scanning method is an interlace scanning method for eliminating the flicker effect by dividing an image of one frame into an odd field and an even field, And a progressive scanning method in which scanning is performed sequentially along a scanning line.

Meanwhile, the present invention is directly related to the aspect ratio and resolution of an image pickup apparatus (i.e., a camera, etc.) that converts a natural image into an electrical signal and provides the image signal to the image system. NTSC system and a typical HDTV (Grand Alliance HDTV) such as GA-HDTV will be described.

The screen aspect ratio of the NTSC system having a scan line of 525 and a transmission speed of 30 fps (flame per second), which is interlaced and used in TV standards in Korea, North America and Japan, 3.

On the other hand, the HDTV (High Definition TeleVision), which is called the next generation TV, is expanding the visibility and the liveliness of the screen by setting the screen aspect ratio to 16: 9 and expanding to the visual area based on human visual characteristics. For example, in the US GA-HDTV (Grand Alliance HDTV), GA-HDTV has a resolution of 1920 pixels × 1080 pixels per frame, so HDTV has twice the vertical and horizontal resolution of the current TV, (International Telecommunication Union-RS), which has a 16: 9 screen aspect ratio and a CD (Compact Disk) sound quality digital audio performance that is better than the current TV, Is somewhat satisfied.

As described above, the GA-HDTV, which is an example of the HDTV, needs about twice the number of scanning lines compared to the NTSC method even if the horizontal resolution is only compared. Therefore, in order to satisfy this requirement, a high density image sensor image sensor), that is, a high resolution CCD is required.

However, considering the current technology level of the CCD, the CCD which satisfies the HDTV standard is very expensive, and therefore, it is accompanied with a lot of problems when it is provided as a commercial type. In other words, because of high resolution, high-speed signal processing is required, large power consumption is required, and peripheral devices also require high technical difficulty, so these factors are directly related to the price of the product, .

Due to such a problem, it has been generally predicted that much time will be required for an HDTV imaging device to be widely used. However, in recent years, a large number of devices and methods capable of satisfying HDTV resolution using a CCD having a normal resolution have been known have.

For example, there is a method proposed in Japanese Patent Application No. Hei 5-78730, which is a kind of method for obtaining a high-resolution image signal for Hi-Vision. To summarize the point of the patent application, (R, G, B) separated by red (R), green (G) and blue (B) At this time, the image sensor of the green component signal is arranged in a vertical direction by crossing one pixel, and masking is performed on the light receiving portion of each pixel to obtain a double vertical resolution.

However, in this method, since the opening portions of the respective pixels constituting the image sensor mask about half of the upper and lower sides, there is a problem that the amount of light received is reduced by half, and the sensitivity is lowered accordingly.

In view of such a problem and a technical background, Japanese Patent Application No. Hei 7-327233 proposed and disclosed in Japanese Patent Application Hei 7-327233 relates to the technical background of the present invention, so that the gist of the present invention will be cited .

Japanese Patent Application No. Hei 7-327233 discloses an image pickup apparatus and an image signal processing apparatus which are provided with a blue image sensor, a red image sensor, a first green image sensor, and a second green image sensor using a commonly used image sensor Type image pickup device.

Figs. 1 (A) to 1 (C) show a pixel arrangement diagram of an image pickup apparatus and an image signal processing apparatus. Japanese Patent Application Laid-open No. 7-327233 discloses a method of obtaining an effective scan player corresponding to HDTV by using a CCD having normal resolution 1A, a four-plate CCD (charge coupled device) comprising a blue image sensor DB, a red image sensor DR, a first green image sensor DG1, and a second green image sensor DG2, , The pixel positions of the blue image sensor DB and the red image sensor DR correspond to the second green image sensor DG2 The pixel positions of the blue image sensor DB and the red image sensor DR are arranged so as to intersect with the second green image sensor DG2 It is possible to improve the resolution with respect to the vertical direction by staggering in the vertical direction by the pixel pitch.

On the other hand, as shown in FIG. 1B, the pixel positions of the first green image sensor DG1 are arranged so as to intersect with the pixel positions of the second green image sensor DG2 in the vertical direction by a small pitch 1C, the pixel position of the first green image sensor DG1 and the pixel position of the second green image sensor DG2 are shifted in the horizontal direction Are arranged so as to intersect with each other by a pixel pitch.

In this way, the pixel position of the first green image sensor DG1 and the pixel position of the second green image sensor DG2 are shifted in the horizontal direction It is possible to improve the resolution with respect to the horizontal direction by arranging the pixel pitches so as to cross each other.

Thereafter, the vertical high-frequency components are extracted from the image signals obtained from the blue image sensor DB and the red image sensor DR in which the pixel positions are arranged, and the field image signals DG1 and DG2 obtained from the green image sensors DG1 and DG2, The vertical resolution is improved without causing the aperture ratio to decrease due to the mask process.

However, the above-mentioned Japanese Patent Application No. Hei 7-327233 and Japanese Patent Application No. Hei 5-78730 disclose an image pickup apparatus and an image signal processing apparatus as well as a dual green image sensor (i.e., a first green image sensor, Image sensor), it is accompanied by an absolute price increase factor in comparison with a three-plate type image sensing apparatus using a single green image sensor in terms of economy.

That is, the four-plate type image sensing apparatus requires another green image sensor as compared with the three-plate type image sensing apparatus, and a new color separation optical system capable of supporting the same is required.

In particular, as described above, the image pickup apparatus and the image signal processing apparatus of Japanese Patent Application No. Hei 7-327233 extract the vertical high-frequency component from the image signal obtained from the blue image sensor DB and the red image sensor DR There is a problem that a plurality of line memories and field memories for compensating the field image signals obtained from the green image sensors DG1 and DG2 are required, so that the additional burden directly related to the price of the product is required.

In order to provide a low-cost HDTV imaging device by providing practicality and economy by lowering the price of a product, it is required to provide a cost-effective redundancy There is a problem in that the production cost of the product can not be lowered to a predetermined value or less.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide an image pickup apparatus using a three-plate type image sensor which is widely spread to the current user and technically low in the producer side, A conventional colorimetric optical system for supporting a three-plate type CCD imaging device is used and an additional scanning line is set for correction of a shaking motion in order to significantly reduce an economical burden factor. It is possible to increase the resolution of the imaging device by doubling the number of scanning lines by a spatial pixel shifting method by providing a CCD having a normal resolution or a CCD having a normal resolution of a PAL system and a line memory for red and blue channels, Resolution imaging device using a three-plate type image sensor that can be used as an imaging device The purpose is to provide.

1 is a block diagram of an image pickup apparatus and an image signal processing apparatus according to Japanese Patent Application Hei 7-327233,

FIG. 2 is a schematic view showing a general color separation optical system,

3 is a pixel layout diagram showing an embodiment of a pixel arrangement used in the present invention,

4A, 4B, and 4C are diagrams showing the positions of pixels of the red image sensor, the blue image sensor, and the green image sensor, respectively, in the odd field unit, the even field unit,

5 is a block diagram showing a video signal synthesizing apparatus according to the present invention.

Description of the Related Art

100: Line memory unit 200:

210: first pixel signal constituent unit 220: second pixel signal constituent unit

To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described, a high-resolution imaging apparatus using a three-plate type image sensor according to the present invention includes an image sensor having a normal resolution of NTSC system or PAL system, So that the pixel positions of the red image sensor and the blue image sensor correspond to the green image sensor in the vertical direction and the horizontal direction The pixels of the image sensors are arranged in a staggered arrangement and the line memories for red and blue channels are provided so that red and blue component pixels are arranged on adjacent scan lines in the same field It is possible to implement a high-resolution HDTV imaging device with an image sensor of a normal resolution while minimizing deterioration of image quality due to use of a normal image sensor having a low resolution by making the existing green component pixel shared, Feature.

A three-plate type color separation optical system, which is a color separation optical system used in the present invention, will be described with reference to Japanese Patent Application No. Hei 7-327233 based on an image pickup apparatus and an image signal processing apparatus.

2 is a block diagram showing an embodiment of a color separation optical system of an image pickup apparatus and an image signal processing apparatus according to Japanese Patent Application No. Hei 7-327233.

A blue light prism 10 for obtaining a blue light component B is disposed on the optical input side and a prism 12 for red light for obtaining a red light component R is disposed on the light output side of the blue light prism 10 . A prism for green light 14 for obtaining a green light component G is disposed on the light output side of the prism 12 for red light and the prism 14 for green light is provided with a reflecting mirror 16, It is installed at an angle of 45 °. That is, the prism 14 for green light is divided into the first green prism 16A and the second green prism 16B with the semi-reflective mirror 16 as a boundary.

The blue light component B and the red light component R are imaged on the blue image sensor DB and the red image sensor DR through a trimming filter 11_1 and a red trimming filter 12_1, The first green light component G1 and the second green light component G2 are transmitted through the first green image trimming filter 16_1 and the second green trimming filter 16_2 via the first green image sensor DG1 and the second green image sensor D2, (DG2).

At this time, the image-forming surfaces formed by the first green image sensor DG1 and the second green image sensor DG2 are 90 ° to each other, so that the first green light component G1, which is imaged on the first green image sensor DG1, The second green light component G2, the blue light component B, and the red light component R that are imaged on the green image sensor DG2 are inverted in the left and right directions. In order to invert the first left green light component, Frame memory or the like.

In the present invention, as described above, a conventional three-plate color separation optical system that supports a three-plate type image sensor is used. In the four-plate color separation optical system of FIG. 2, the first green trimming filter 16_1 and the anti- And the first green image sensor DG1 are removed, a general three-plate type color separation optical system is obtained. This means that the prism 14 for green light, which is separated into the first green prism 16A and the second green prism 16B, is used solely for a single green light with the semi-reflective mirror 16 as a boundary.

In other words, when a four-plate color separation optical system is used, another green image sensor is required in comparison with a three-plate optical system, and there is an additional burden of requiring a new color separation optical system capable of supporting the same.

For further details on the above, refer to the Development of 4 CCD Comsumer Use Hi-Vision Camera using 4-plate CCD for public use and published in Japanese Journal of Vol. 50, 7-327233 will be referred to an image pickup apparatus and an image signal processing apparatus.

3 is a pixel layout diagram showing an embodiment of a pixel arrangement used in the present invention.

In the present invention, as shown in FIG. 3, in a three-plate CCD including a blue image sensor DB, a red image sensor DR, and a green image sensor DG, The pixel positions of the red image sensor DR and the blue image sensor DB are shifted in the vertical direction and the horizontal direction corresponding to the green image sensor DG Are arranged so as to intersect with each other by a pixel pitch.

FIG. 4A shows the pixel positions of the red image sensor DR, the blue image sensor DB and the green image sensor DG by the odd field unit, FIG. 4B by the even field unit, and FIG. 4C by the frame unit , The pixels scanned in the odd field are indicated by a solid line rectangle while the pixels scanned in the even field are indicated by a dotted rectangle in the interlaced scanning. In order to facilitate pixel identification, an index is assigned to each pixel. The green component pixel is represented by G _mn , and the red and blue component pixels are represented by R _mn / B _mn .

Here, the subscript m of G _mn and R _mn / B _mn is an index for the pixel position in the vertical direction, and the subscript n is the index for the pixel position in the horizontal direction. For convenience of explanation, it is assumed that the division of the odd field and the even field is the odd odd odd field and m is the even odd odd field.

In this case, a pixel in which m is an even number may be considered as an even field as described above. However, when a pixel in which m is an odd number is a pixel in the current field, a pixel in which m is an even number is regarded as a pixel one field before the current field It is also acceptable.

4A to 4C, the interval between the solid line and the solid line and the interval between the dotted line and the dotted line are one pixel pitch, and the interval between the solid line and the dotted line is a half pixel pitch.

In this way, the pixel positions of the red image sensor and the blue image sensor are staggered in correspondence with the green image sensor, and the red and blue component pixels are made the same by using the video signal synthesizer of the present invention provided with the line memories for red and blue channels The number of vertical scanning lines is increased by making the green component pixels existing in the adjacent scanning lines in the field shared.

On the other hand, when the pixel positions of the red image sensor and the blue image sensor correspond to the green image sensor only in the vertical direction But they may be arranged so as to cross by the pixel pitch.

In order to form one color pixel, pixel signals related to red, green and blue (R, G, B) are required in principle. However, in the present invention, , Which provides a high resolution using the number of pixels that are less than the number of pixels that are substantially needed for resolution, meaning that it provides pseudo-resolution using complementary relationships between adjacent pixels in terms of resolution do.

Hereinafter, a video signal synthesizing apparatus according to an embodiment of the present invention will be described with reference to FIG.

As shown in Fig. 5, the video signal synthesizing apparatus of the present invention receives red pixel signals and blue pixel signals in respective fields of an image pickup apparatus using a three-plate CCD, delays the signals for two scanning lines, A line memory unit 100 for generating a signal _Rm-1n and a previous red pixel signal _Bm-1n and a second memory unit for receiving the previous red pixel signal _Rmn and the previous blue pixel signal _Bmn , to the present time, based on which are color pixel signal input to the current receiving the green pixel signal (G _mn) and the current red pixel signal (R _mn) and the current blue pixel signal (B _mn) of the previous blue pixel signals (R _{m -1n),} the previous red pixel signal (B _m-1n) and the current green pixel signal (G _mn) the first pixel signal _{(R m-1n G mn B} m-1n) of the first pixel signal (R consisting of at least a pixel position after the first line with respect to the _{m-1n G mn B m-} 1n) and, wherein the current recording A pixel signal (G _mn), the current red pixel signal (R _mn) and the current blue pixel signal (B _mn) signal generating unit 200 that outputs the second pixel signal (R _mn G _mn B _mn) consisting of .

Here, the signal configuration unit 200 receives the previous blue pixel signal R _m-1n , the previous red pixel signal B _m-1n , and the current green pixel signal G _mn , A first pixel signal constituting part 210 constituting the first pixel signal R _m-1n G _mn B _m-1n by the current pixel signal G _mn and the current red pixel signal R _mn, And a second pixel signal _generator 220 receiving the current blue pixel signal B _mn and outputting the second pixel signal R _mn G _mn B _mn according to a color signal combining method.

The operation of the video signal synthesizing apparatus according to one embodiment of the present invention will be described with reference to FIGS. 4A to 4C and FIG. 5. FIG.

First, when a Red, Green, and Blue (RGB) image signal is applied to each field in the respective fields, the line memory 100 receives the red pixel signal and the blue pixel signal, (R _m-1n ) and the previous red pixel signal (B _m-1n ).

The signal configuration unit 200 receives the previous red pixel signal _Rmn and the previous blue pixel signal _Bmn and outputs the current green pixel signal _Gmn , The red pixel signal R _mn and the current blue pixel signal B _mn are received and the first blue pixel signal R _m-1n and the previous red pixel signal B _{m -1n)} and using the current green pixel signal (G _mn), the first pixel signal _{(R m-1n G mn B} m-1n) output, and the second pixel signal generating unit 220, a green pixel consisting of the current signal (G _mn), the current red pixel signal (R _mn) and the current blue pixel signal (B _mn) the second pixel signal (R _mn G _mn B _mn) the configuration to the second pixel signal (R _mn G _mn B _mn consisting of ) Is positioned at least one line after the position of the pixel generated by the first pixel signal R _m-1n G _mn B _m-1n .

That is, the pixel structure of the present invention will be described in detail with reference to FIGS. 4A to 4C.

If an odd field work, R ₃₁ / B _31, when G ₃₁ is input three to point to the present time is the output of the line memory unit 100 is the R ₁₁ / B _11, the first pixel signal generating unit 210 (R ₁₁ G ₃₁ B ₁₁ ) using R ₁₁ / B ₁₁ and G ₃₁ and the second pixel unit 220 uses the R ₃₁ / B ₃₁ and G ₃₁ to form the first pixel signal Signal (R ₃₁ G ₃₁ B ₃₁ ). In addition, R ₃₂ / B _32, G when a _32-input three to point to the present time is the output of the line memory unit 100 is the R ₁₂ / B _12, the first pixel signal generating unit 210 R ₁₂ / B _12, the first pixel signal using a _{G 32 (R 12 G 32 B} 12) configuration, and the second pixel-signal generating unit 220 includes a second pixel using the R ₃₂ / B _32, G ₃₂ signal ( R ₃₂ G ₃₂ B ₃₂ ).

Also, when the even field, R ₄₁ / B _41, G when a ₄₁ is input three to point to the present time is the output of the line memory unit 100 is the R ₂₁ / B _21, the first pixel signal generating unit (210 ) Constitute the first pixel signal (R ₂₁ G ₄₁ B ₂₁ ) using R ₂₁ / B ₂₁ and G ₄₁ and the second pixel signal constituting unit 220 constitutes the first pixel signal (R ₂₁ G ₄₁ B ₂₁ ) using R ₄₁ / B ₄₁ and G ₄₁ And constitutes a second pixel signal (R ₄₁ G ₄₁ B ₄₁ ). In _{addition, R 42 / B 42, G} 42 is, when the three to the time the input in the present time, the output of the line memory unit 100 R ₂₂ / B _22, and the first pixel-signal generating unit 210 R ₂₂ / B _22, G _42, using the first picture element signals (R ₂₂ G ₄₂ B _22), the configuration, and the second pixel-signal generating unit 220 by using the R ₄₂ / B _42, G ₄₂ the second pixel signal ( R ₄₂ G ₄₂ B ₄₂ ).

At this time, when finally described with reference to frame-by-frame the positional relationship between pixels to be displayed, the resolution is expanded, the first pixel signal (R ₁₁ G ₃₁ B ₁₁₎ after the first pixel on a same scan line signal (R ₁₂ G ₃₂ B ₁₂ ) are generated, and a first pixel signal (R ₁₁ G ₃₁ B ₁₁ ) is generated in the horizontal direction on the scanning lines on one or more lines of the scanning line on which the first pixel signal (R ₁₁ G ₃₁ B ₁₁₎ ), the first pixel signal in the same position as the (R ₂₁ G ₄₁ B ₂₁₎ is located, the first pixel signal (R ₂₁ G ₄₁ B ₂₁₎ after the first pixel on a same scan line signal (R ₂₂ G ₄₂ B ₂₂₎ Is generated.

Thereafter, in the same manner as described above, the second pixel signals R ₃₁ G ₃₁ B ₃₁ and the second pixel signals R ₃₂ G ₃₂ B ₃₂ are present on the same scanning line, The second pixel signal R ₄₁ G ₄₁ B ₄₁ , and the second pixel signal R ₄₂ G ₄₂ B ₄₂ are successively positioned.

As a result, it is apparent that the number of scan lines can be doubled by using the video signal synthesizer as described above.

At this time, in the odd field and even field, the a first picture element signals _{(R m-1n G mn B} m-1n) according to each of the fields not the first scanning line is not present, the red and blue color component for the pixel of the previous line And the red and blue component pixels are stored in the last scan line of each field by using the line memory unit 100 as there is no scan line to refer to the red and blue component pixels of the previous line, .

As described in detail above, in the signal processing apparatus of the HDTV image pickup apparatus using the low-cost three-plate type CCD, an image sensor having an additional scanning line for correction of an unintentional hand movement or an image sensor having a PAL- The pixel positions of the image sensor and the blue image sensor correspond to the green image sensor in the vertical direction and the horizontal direction And the red and blue component pixels are shared by the green component pixels existing in the adjacent scan lines in the same field by using the video signal synthesizing apparatus of the present invention provided with the line memories for red and blue channels According to the high-resolution imaging apparatus using the three-plate type image sensor according to the present invention for increasing the number of vertical scanning lines, the conventional three-plate type color separation optical system is used without modification and at the same time, Since HDTV imaging devices can be implemented, it is highly practical and economical for HDTV imaging devices by eliminating costly redundancy of products.

Claims (5)

1. An image pickup apparatus using a three-plate type image sensor, comprising: A red image sensor for picking up a red image and generating a red pixel signal; A green image sensor for sensing a green image and generating a green pixel signal; And And a blue image sensor for picking up a blue image and generating a blue pixel signal, wherein the pixel positions of the red image sensor and the blue image sensor are arranged in a vertical direction and a horizontal direction respectively corresponding to pixel positions of the green image sensor Wherein the image pickup device is arranged so as to intersect the image pickup device by a pixel pitch. 1. An image pickup apparatus using a three-plate type image sensor, comprising: A red image sensor for picking up a red image and generating a red pixel signal; A green image sensor for sensing a green image and generating a green pixel signal; And And a blue image sensor for picking up a blue image and generating a blue pixel signal, wherein a pixel position of the red image sensor and the blue image sensor is shifted in a vertical direction corresponding to a pixel position of the green image sensor Wherein the image pickup device is arranged so as to intersect the image pickup device by a pixel pitch. 3. The method according to claim 1 or 2, A data storage unit for receiving the red pixel signal and the blue pixel signal and generating a previous blue pixel signal and a previous red pixel signal by delaying the red pixel signal and the blue pixel signal based on a frame for two scanning lines; And The previous red pixel signal and the previous blue pixel signal, receiving the current green pixel signal, the current red pixel signal, and the current blue pixel signal, which are color pixel signals inputted with reference to the current time, The current red pixel signal, the current red pixel signal, and the current green pixel signal, and the pixel is located at least one line after the first pixel signal, And a signal component for outputting a second pixel signal composed of the current blue pixel signal. The signal processing device according to claim 3, A first pixel signal configuration unit configured to receive the previous blue pixel signal, the previous red pixel signal, and the current green pixel signal to configure the first pixel signal by a color signal combining method; And And a second pixel signal configuration unit configured to receive the current green pixel signal, the current red pixel signal, and the current blue pixel signal and configure the second pixel signal according to a color signal combining method. High resolution imaging device. 2. The image sensor according to claim 1, Resolution image pickup device using a three-plate type image sensor, characterized in that it is a CCD (Charge Coupled Device) having a normal resolution and a normal resolution of a PAL (Phase Alternation by Lines) method in which an additional scanning line is set for correction of camera shake.