KR100517493B1 - Camera image processing apparatus and method - Google Patents

Abstract

Disclosed are a camera signal processing apparatus and a method for implementing a high resolution image signal using an optical path changing device. The camera signal image processing apparatus includes an optical path changing unit for periodically changing an optical path of an input image by a predetermined unit by capturing camera shake every frame, and a photoelectric conversion unit for converting the optical image signal changed by the optical path changing unit into an image signal having electrical characteristics. And a frame storage unit for delaying the image signal converted by the photoelectric conversion unit by one frame, and adjusting the specific gravity of the current image signal converted by the photoelectric conversion unit and the image signal delayed by one frame in the frame storage unit. It includes a data operation unit that determines the value of B, and high-resolution output is possible using a single CCD.

Description

Camera image processing device and method

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a camera signal processing apparatus and a method thereof, and more particularly, to a camera signal processing apparatus and a method for implementing a high resolution image signal using an optical path changing apparatus.

In general, digital broadcasts for wide TVs and HDTVs have a 16: 9 aspect ratio and provide a horizontal screen, unlike conventional NTSC broadcasts having an aspect ratio of 4: 3. Accordingly, digital broadcasting cameras used in commercial and broadcasting stations also require imaging methods of various standards.

Until now, commercialized cameras used single-chip CCD (Charged Coupled Device) mainly for home use, but 3CCD was developed for business or broadcasting. In general, there are two methods for obtaining a high resolution image, a spatial pixel shifting method using three CCDs, and a method for obtaining data between pixels by vibrating the CCD.

1 is an overall block diagram showing a high resolution camera device using a conventional 3CCD.

First, the optical image information incident through the lens is separated into R (Red), G (Green), and B (Blue) optical images through an OLPF (Optical Low Pass Filter) and a color separation prism. The B optical image is photoelectrically converted through three CCDs to form analog image R, G, and B signals. At this time, the three CCDs are driven by driving timing signals generated from the CCD driving timing generator 130 controlled by the microcomputer 140, and are spaced apart by half a pixel and input to the color separation prism to improve the resolution. Increase the sampling point of optical image information. Analog R, G, and B image signals output from the CCD are pre-processed by the analog preprocessor 112 and the analog / digital (A / D) converter 114. It is converted into preprocessed R, G, B image data (NR, NG, NB). The image signals NR, NG, and NB are converted into high-resolution R, G, and B image data HR, HG, and HB having improved resolution by signal processing through a double clock in the high resolution processing unit 120.

FIG. 2 illustrates the spatial arrangement of R, G and B CCDs in the apparatus of FIG. 1, in which G-CCDs and R / B-CCDs are arranged in sequence.

In the apparatus of FIG. 1, the high-resolution processor 120 double-samples G data and R / B data, respectively, using the spatial positional relationship of the CCD shown in FIG. 2, and then generates a luminance signal at each position (1/2 pixel interval). (Y) and color signal (C) are obtained.

As described in the apparatus of FIG. 1, the spatial pixel shifting method of obtaining R, G, and B data by arranging three CCDs spatially by half a pixel is disadvantageous in that hardware burden such as color separation prism is increased and product cost increases. There is a disadvantage that the method by the CCD vibration processing has to be added to the separate hardware for this.

The present invention provides a high resolution image signal processing apparatus and method including a single CCD and periodically shifting an optical path of an input image every frame to sample image information of the same point of a subject with different color filters. To provide.

In order to solve the above technical problem, the present invention provides a camera image signal processing apparatus comprising: an optical path changing unit for periodically changing an optical path of an input image by a predetermined unit by capturing camera shake every frame; A photoelectric conversion unit converting the optical image signal changed by the optical path changing unit into an image signal having electrical characteristics; A frame storage unit which delays the image signal converted by the photoelectric conversion unit by one frame; And a data operation unit configured to determine R, G, and B values at each pixel by adjusting specific gravity of the current image signal converted by the photoelectric conversion unit and the image signal delayed by one frame in the frame storage unit. It is an image processing device.

SUMMARY OF THE INVENTION In order to solve the above technical problem, the present invention includes an optical path changing unit for changing an optical path and a photoelectric conversion element for converting an optical image signal into an electrical image signal, the method for processing a camera image signal every frame By periodically changing the optical path of the input image, the position of the input image formed on the photoelectric conversion element is varied by a predetermined unit every frame, and the specific gravity of the current image data output from the photoelectric conversion element and the image data one frame before is changed. A camera signal processing method characterized by forming image data in each pixel by adjusting.

Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings.

3 is an overall block diagram of a camera signal image processing apparatus according to the present invention.

First, the optical path change controller 310 controls the optical path of the optical image signal to the subject 308 to be input according to the camera shake information.

The optical image of the subject is input to the optical path changing unit 310, and the optical path changing unit 310 uses an optical path changing element such as a variable angle prism or a mirror to control the optical path changing unit 380. Under the control, the optical path to the subject 308 is changed periodically by one pixel or one line every frame (or every field). At this time, the optical path changing controller 380 receives the information on the hand shake from the microcomputer 370 to change the optical path position thereof to the optical path changing unit 310.

The optical image signal changed through the optical path and incident through the lens passes through the CCD 316, which is a single photoelectric conversion device in which the R, G, and B color filters are incorporated, and is converted into an electrical R, G, B image signal.

The preprocessor 320 outputs the R, G, and B image data by performing preprocessing to remove noise and analog-digital conversion of the R, G, and B image signals output from the CCD 316.

The frame memory 330 delays image data output from the preprocessor 320 for one frame or one field. The memory controller 350 controls the address of the frame memory 330.

The R, G, and B calculators 340 are known in CCD cameras, and include a first line memory 342, a second line memory 344, an R operator 345, a G operator 346, and a B operator 347. ) To calculate R, G, and B data. That is, the R, G, and B calculators 340 preprocess the current image data, image data line-delayed through the first line memory 342 and the second line memory 344, and one frame in the frame memory 330. The image data R, G, and B of each pixel are newly configured through the process of interpolation and selection according to a constant coefficient provided by the operation control unit 360 by inputting the image data and the delayed signal. In other words, the R, G, and B values at each sampling point are determined by appropriately adjusting the specific gravity of the image R, G, and B data captured by the current CCD 316 and preprocessed R, G, and B data. do.

4 (a) and 4 (b) show the refraction of an optical axis using a variable angle prism as an example of the optical path changing unit of FIG. 3.

FIG. 4A illustrates a case in which the microcomputer 370 built in the camera does not capture the movement of the hand shake, and the glass plate is fixed so that no optical refraction occurs. 4B illustrates a case in which the microcomputer 370 built in the camera captures a motion for shaking a hand, and at this time, the optical path changing controller 380 changes one side of the glass plate to change the optical refraction.

5A and 5B illustrate another example of refraction of an optical axis using a mirror as another example of the optical path changing unit of FIG. 3.

FIG. 5A illustrates a case in which the microcomputer 370 built in the camera does not capture the movement of the hand shake, and the mirror is fixed so that no optical refraction occurs. 4B illustrates a case in which the microcomputer 370 built in the camera captures the movement of the hand shake, and the optical path changing controller 380 changes the optical refraction by changing the position of the mirror.

6A to 6D illustrate a CCD screen when the optical path is changed every frame in the vertical direction through the lens Lens using the optical path changing unit 310.

6A to 6D illustrate an example in which an optical path is changed by the shaking of the optical path changing unit 310 so that a subject is captured by the CCD in the vertical direction.

7 (a) to 7 (c) show CCD output R, G and B image data in a case where an optical path change by one line per frame occurs in the vertical direction, (a) is a subject, (b) is the first (previous) frame picked up by the CCD 316, and (c) is the second (current) frame picked up by moving in the vertical direction by one line by periodic shaking with the CCD 316. . As shown in Figs. 7B and 7C, the sampling point is changed for each frame by changing the optical path.

8A to 8D illustrate a CCD screen when the optical path is changed every frame in the horizontal direction through the lens Lens using the optical path changing unit 310.

8A to 8D show an example in which the optical path is changed by the shaking of the optical path changing unit 310 so that the subject is picked up by the CCD in the horizontal direction.

9 (a) to 9 (c) show CCD output R, G, and B image data in the case where a light path change of one pixel per frame occurs in the horizontal direction, (a) is a subject, (b) is the first (previous) frame picked up by the CCD 316, and (c) is the second (current) frame picked up by moving one pixel horizontally by periodic shaking with the CCD 316. . As shown in Figs. 9B and 9C, the sampling point is changed for each frame by changing the optical path.

(A) to (c) of FIG. 10 show that the R, G, and B operations unit 340 of FIG. 3 applies periodic shaking of one pixel in the horizontal direction every frame to give an example of R, G, and B operations. In this case, the imaging relationship between the subject and the CCD output data is shown in more detail.

That is, the R, G, and B calculators 340 appropriately adjust the specific gravity of the frame image data (c) currently captured by the CCD and the image data (b) of one frame stored in the frame storage unit 330 to adjust each sampling point. Determine the R, G, and B values at.

At each point of the subject a, the following four patterns are periodically repeated for the R, G, and B data of the current frame c.

At 11 points of the subject (a), the R, G, and B data

R = 2R22

G = K (1G21) + (1-K) {α (2G12) + β (2G21) + γ (2G22) + δ (2G32)}

B = {α (2B11) + β (2B12) + γ (2B31) + δ (2B32)},

At 12 points of the subject (a), the R, G, and B data

R = K (1R22) + (1-K) {m (2R22) + (1-m) 2R23}

G = 2G22

B = n (2B12) + (1-n) (2B32),

At 21 points of the subject (a), the R, G, and B data

R = K (1R22) + (1-n) (2B32)

G = 2G32

B = K (1B31) + (1-K) {m (2B31) + (1-m) 2B32}

R, G, and B data at 22 points of the subject (a)

R = α (2R22) + β (2R23) + γ (2R42) + δ (2R43)}

G = K (1G32) + (10K) {α (2G22) + β (2G32) + γ (2G33) + δ (2G42)}

B = 2B32.

However, α + β + γ + δ = 1 0 ≦ K, m, n ≦ 1, wherein α, β, γ, δ, m and n are arbitrary setting values and k is a correlation coefficient value between frames.

In this case, the coefficient value K is adjusted according to the specific gravity of the two frame data so that the coefficient value K is close to 1 for increasing the specific gravity of the previous frame.

The present invention is not limited to the above-described embodiment, and of course, modifications may be made by those skilled in the art within the spirit of the present invention.

As described above, according to the present invention, a high resolution output is possible even by using one CCD by appropriately utilizing data between two frames obtained by periodically changing and controlling the optical path of the input image every frame using the image stabilizer optical path changing device. Do.

1 is an overall block diagram showing a high resolution camera device using a conventional 3CCD.

2 illustrates the spatial arrangement of R, G and B CCDs in the apparatus of FIG.

3 is an overall block diagram of a camera signal image processing apparatus according to the present invention.

4A and 4B are examples of the optical path changing unit of FIG. 3.

5A and 5B show another example of the optical path changing unit of FIG. 3.

6A to 6D show CCD screens in the case where the optical path is changed in the vertical direction by using the optical path changing unit 310.

7A to 7C show CCD output R, G, and B image data when an optical path change of one line per frame occurs.

8A to 8D show a CCD screen when the optical path is changed in the horizontal direction by using the optical path changing unit 310.

9A to 9C show CCD output R, G, and B image data when an optical path change of one pixel per frame occurs in the horizontal direction.

10A to 10C show an imaging relationship between the subject and the CCD output data when periodic shaking of one pixel is applied in the horizontal direction every frame.

Claims (7)

In the camera image signal processing apparatus, An optical path changing unit for periodically changing the optical path of the input image by a predetermined unit by capturing the camera shake every frame; A photoelectric conversion unit converting the optical image signal changed by the optical path changing unit into an image signal having electrical characteristics; A frame storage unit which delays the image signal converted by the photoelectric conversion unit by one frame; And a data operation unit configured to determine R, G, and B values at each pixel by adjusting specific gravity of the current image signal converted by the photoelectric conversion unit and the image signal delayed by one frame in the frame storage unit. Image processing apparatus. 2. The camera signal image processing apparatus according to claim 1, wherein the optical path changing unit generates an optical path change of one pixel in a horizontal direction every frame when a hand shake occurs. 2. The camera signal image processing apparatus according to claim 1, wherein the optical path changing unit generates an optical path change of one line in a vertical direction for each frame when hand shake occurs. The image processing apparatus of claim 1, wherein the optical path changing unit is a variable angle prism. 2. The camera signal image processing apparatus according to claim 1, wherein the optical path changing unit is a mirror. A method of processing a camera image signal, comprising: an optical path changing unit for changing an optical path and a photoelectric conversion element for converting an optical image signal into an electrical image signal, By periodically changing the optical path of the input image every frame, the position of the input image formed in the photoelectric conversion element is varied by a predetermined unit every frame, And controlling the specific gravity of the current image data output from the photoelectric conversion element and the image data one frame before, to configure the image data in each pixel. The method according to claim 6, wherein the correlation coefficient value between the frames is adjusted according to the specific gravity of the image data of the two frames.