JPH06217328A - Color image pickup device - Google Patents

Abstract

PURPOSE:To provide the color image pickup device from which a picture without color slurring is obtained even when an object is moving. CONSTITUTION:A motion of an object 36 is detected and when the motion amount exceeds a 1st prescribed value, a motion vector of the output of an area sequential image pickup device 1 is detected and a command to fetch the output of a color slurring correction device 3 into a monitor 19 correcting a picture element deviation in response to the detected value is given to a picture synthesis circuit 18. Furthermore, when a motion of the object 36 exceeds a 1st prescribed value and exceeds a 2nd prescribed value, a command to give an output of a simultaneous image pickup device 2 to the monitor 19 is given to the picture synthesis circuit 18. When a motion of the object 36 exceeds the 1st prescribed value and is within the 2nd prescribed value, an output from a color slurring correction means 3 and the output of the simultaneous image pickup device 2 are synthesized and the result is outputted to the monitor 19 by an object motion detection circuit 17.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a color image pick-up device for picking up a color image of a subject by using a frame-sequential image pick-up device and a simultaneous image pick-up device.

[0002]

2. Description of the Related Art In recent years, there has been a color image pickup device and a frame sequential image pickup device for performing color image pickup by rotating a color filter disk in front of a monochrome image pickup tube or a monochrome image pickup element. In addition, a simultaneous image pickup device in which a color mosaic filter is attached to the front surface of an image pickup tube or an image pickup element to perform color image pickup or color separation is performed by a dichroic mirror and image pickup is performed by a plurality of image pickup tubes or image pickup elements has been put into practical use and spread. .

On the other hand, as disclosed in, for example, Japanese Unexamined Patent Publication No. 3-219788, a frame-sequential image pickup device and a simultaneous image pickup device are combined to detect the motion of a subject, and the signals from both image pickup devices are detected. There is a device that switches between.

[0004]

The frame sequential image pickup device is
When the subject and the image pickup device are relatively moving, a color shift phenomenon occurs, which makes it difficult to view the image.

In the simultaneous type image pickup device, a color chip is attached to the image pickup tube or the image pickup element, or a single tube is attached.
Alternatively, the single-chip color image pickup device has a drawback that the resolution is not sufficient because the color is determined by a plurality of pixels.

In a three-plate or three-tube type image pickup device using a dichroic mirror, it is difficult to position each element or image pickup tube, and a high resolution type uses three expensive image pickup elements or image pickup tubes. Therefore, there is a drawback that the price becomes high.

On the other hand, a device that has both a frame-sequential image capturing device and a simultaneous image capturing device and switches the signals from both image capturing devices by detecting the motion of the subject has a drawback that the resolution of the image decreases when the subject moves. was there.

The present invention has been made in order to eliminate the above-mentioned drawbacks, and an object of the present invention is to provide a color image pickup apparatus capable of obtaining an image without color shift even when a subject is moving.

[0009]

In order to achieve the above object, the invention according to claim 1 is a frame-sequential system in which a color filter is rotated in front of a black-and-white image pickup means to color-image a subject and output it to a monitor. An image pickup device, a color shift correction unit that detects a motion vector amount of an output of the frame sequential image pickup device, shifts pixels according to the detected value to correct a color shift, and performs color separation by a color separation device to perform the color separation. An image in which a simultaneous imaging device that simultaneously color-images a subject and outputs the same to the monitor, and an output that switches the outputs of the simultaneous imaging device and the frame-sequential imaging device that are input to the monitor, or that combines the both outputs Synthesizing means,

The amount of movement of the subject is detected, and when the amount of movement exceeds a first predetermined value, a command for taking in the output of the color misregistration correction means to the monitor is given to the image synthesizing means. In addition, when the amount of movement of the subject exceeds a first predetermined value and exceeds a second predetermined value, a command for fetching the output of the simultaneous image pickup device to the monitor is given to the image combining means. And the amount of movement of the subject is first
And a motion detection means for giving a command for synthesizing the output from the color misregistration correction means and the output of the simultaneous image pickup apparatus and outputting the combined output to the monitor. It is a color imaging device equipped with.

[0011]

According to the first aspect of the invention, when the amount of movement of the object exceeds the first predetermined value, the output of the color misregistration correction means is taken into the monitor, and the amount of movement of the object is the first predetermined value. When the output exceeds the second predetermined value, the output of the simultaneous image pickup apparatus is captured by the monitor, and the amount of movement of the subject is the first
If the output of the color misregistration correction means and the output of the simultaneous image pickup device are combined and output to the monitor when the value exceeds the predetermined value of 2 and within the second predetermined value, the frame sequential image pickup device and the color separation are performed. The advantage of the device can be utilized, and an image without color shift can be obtained even when the subject is moving.

[0012]

Embodiments of the present invention will be described below with reference to the drawings.

First, a first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram showing a schematic configuration diagram of the color image pickup apparatus of the first embodiment, which is a frame sequential image pickup apparatus 1 and a simultaneous image pickup apparatus 2.
, Color misregistration correction device 3, illumination device 4, and stage 5
The objective lens 6, the imaging lens 7, the half prism 8, the subject movement detection circuit 17, the image composition circuit 18 and the monitor 19.

The frame-sequential image pickup device 1 includes a rotary filter 9,
Motor 11, motor drive circuit 12, CMD (Charge Mod
ulation device) A camera 13 (which constitutes a frame-sequential imaging device) and a CMD control circuit 15.

The simultaneous image pickup device 2 comprises a color mosaic filter 10, a CCD (Charge Coupled Device) camera 14 (which constitutes a simultaneous image pickup device), and a CCD control circuit 16.

From the illumination device 4, the stage 5 and the subject 35
The light that has passed through passes through the objective lens 6 and the imaging lens 7 and reaches the half prism 8. In the half prism 8, the incident light is divided into two and distributed to the field sequential image pickup device 1 and the simultaneous image pickup device 2. One of the distributed lights passes through the rotary filter 9 and enters the CMD camera 13 to be imaged, and the other distributed light passes through the color mosaic filter 10 and enters into the CCD camera 14 to image. .

The rotary filter 9 has R (red), G (green), and B windows (not shown) formed in the peripheral portion of the disk.
A (blue) color transmission filter is attached and rotated by a motor 11 driven by a motor drive circuit 12.

The signal focused on the CMD camera 13 is C
The MD control circuit 15 converts the digital signal into an R, G, B image signal by an A / D converter (not shown), which is input to the color misregistration correction device 3.

As shown in FIG. 2, the color shift correction device 3 is composed of field memories 30, 31, 32, a motion vector detection circuit 33, and an address control circuit 34. The field memories 30, 31, 32 temporarily store the R, G, B image signals from the CMD control circuit 15, and the motion vector detection circuit 33 stores the R, G, B signals from the CMD control circuit 15. The amount of motion vector of the image signal is detected, and the address control circuit 34 shifts the timing of sending the image signal from the motion vector detection circuit 33 to the image synthesizing circuit 18 to shift pixels (color shift).
Is performed to correct the color misregistration.

The signal focused on the CCD camera 14 is C
The CD control circuit 16 converts the digital signal into an R, G, B image signal by an A / D converter (not shown), and inputs the image signal to the image synthesizing circuit 18 and the subject motion detecting circuit 17.

The subject motion detection circuit 17 detects the motion of the subject 36 based on, for example, a difference between frames, and the subject 36 is detected.
Is output to the image synthesizing circuit 18. Specifically, the amount of movement of the subject 36 is detected, and when the amount of movement exceeds a first predetermined value, the image composition circuit 18
To the monitor 19, and when the motion amount of the subject 36 exceeds the first predetermined value and exceeds the second predetermined value, the image combining circuit A command for fetching the output from the CCD control circuit 16 of the simultaneous image pickup device to the monitor 19 is given to 18, and the amount of movement of the subject 36 exceeds the first predetermined value, and the second
Within a predetermined value of C and the output from the color misregistration correction device 3 and C
A command for synthesizing the outputs of the CD control circuit 16 and outputting to the monitor 19 is given.

The image synthesizing circuit 18 switches the outputs of the CCD control circuit 16 and the color misregistration correction device 3 of the simultaneous image pickup device 2 input to the monitor 19 and the visual field of the image signal corrected by the color misregistration correction device 3. When the image becomes small, the output image of the simultaneous image pickup device 2 can be supplemented around the output image of the frame sequential image pickup device 1, and this operation is instructed from the subject motion detection circuit 17. According to.

The color misregistration correction device 3 will now be described with reference to FIG.
5 to FIG. 5, the principle of the motion vector detection circuit 33 will be described first with reference to FIG. The motion vector detection circuit 33 performs a correlation calculation between the image information of the representative point thinned out from the image information of the previous frame and the image information of the current frame. When the entire image shown in FIG. 3 is divided into small blocks made up of K × L images, it becomes the extraction region of the representative point of each block, and this block is M × N in total.

The horizontal coordinate of the image of one frame is the x direction, the vertical coordinate is the y direction, and the i-th horizontal block and the j-th vertical block is expressed as Bij. The representative point is 1
One point is selected for the block, for example, the center of the block. In FIG. 3, the coordinates of the representative point of the block Bij are Cij.
If this Cij is (Ci, Cj),
It is shown by the equation (1). Ci = K (i-1) + K / 2

Cj = L (j-1) + L / 2 (i = 1 to M, j = 1 to N) (1) The block Bij indicates the relationship between the representative point extraction area and the correlation detection area. And the size of the correlation detection area is Sx ×
Sy. Then, the correlation value between the representative point Cij of the previous frame and the image information of each point in the corresponding correlation detection area of the current frame is obtained by the equation (2).

Pij (u, v) = | Gt (Ci-u, Cj-v
) -Gt-1 (Ci, Cj) | ... (2) (2),
(U, v) represents the shift amount in the x and y directions, Gt represents the image of the current frame, and Gt-1 represents the image of the previous frame.

The equation (2) is performed for each block individually, and the correlation values p'of the entire image are cumulatively added by the number of small blocks over the entire image to obtain the correlation value p'of the entire image by the equation (3). Ask.

[0028]

[Equation 1] Here, the range that the deviation amounts u and v can take is represented by the equation (4). −K / 2 + 1 ≦ u ≦ K / 2

-L / 2 + 1≤v≤L / 2
(4) Then, u and v that minimize the correlation value p ′ within the range of the equation (4) give a motion vector. In this example, since the representative point extraction area includes the correlation detection area, there is a relationship as shown in equation (5). −K / 2 + 1 ≦ −Sx / 2 ≦ u ≦ Sx / 2 ≦ K / 2

-L / 2 + 1≤-Sy / 2≤v≤Sy / 2
≤L / 2 (5) That is, the correlation of the image information of the correlation detection region with respect to the image information of a certain representative point is obtained by one calculation.
Therefore, a means for holding all the image information is not necessary, and a means for holding only the image information of the representative point will suffice.

The motion vector detection circuit 33 shown in FIG. 2 is based on the above principle, and the CMD control circuit 15
The image signals of R, G, and B from are divided into blocks as shown in FIG. 4, and the difference between the representative point of each block of G and each point of each block of R and B at the same position is calculated. , And add the result at the same coordinates of each block (a (0,0) + b (0,0)
+ ... i (0,0)), the place with the smallest value is determined as the place where the representative point of G has moved.

The address control circuit 34 controls the field memory 30 by the output according to the movement amount and the movement direction.
Pixel shifting is performed by changing the timing of sending an image from 31 and 32 to the image synthesizing circuit 18. When the color shift correction is performed by such pixel shifting, the effective range of the image becomes a shaded portion shown in FIG. 5, that is, a portion where the R, G, and B images overlap.

The operation of the first embodiment thus constructed will be described. First, the case where the detection signal is not output from the subject motion detection circuit 17, that is, the subject 36 is not moving will be described. Illumination light emitted from the illumination device 4 passes through the subject 36 to form an optical image and is input into the television camera. Inside the television camera, the half prism 8 distributes the input optical image to the CMD camera 13 which is one image pickup device and the CCD camera 14 which is the other image pickup device at a desired ratio, for example, 1: 1. CMD
In the camera 13, the optical image is input through the rotation filter 9, and in the CCD camera 14, the optical image is input through the mosaic filter 10. Here, the signal output from the CMD camera 13 is a frame sequential signal, and the signal output from the CCD camera 14 is a simultaneous signal.

The frame sequential signal from the CMD camera 13 is
It is input to the CMD control circuit 15, converted into a digital signal by an A / D converter, and output as an R, G, B image signal, which is monitored via the field memories 30 to 32 and the image synthesizing circuit 18. Is output to. In this case, since the switching means of the image synthesizing circuit 18 is adapted to receive only the output from the CMD control circuit 15, the output from the CCD controlling circuit 16 is the image synthesizing circuit 18.
And nothing is input to the monitor 19.

The above-described operation is performed when the subject 36 does not move, but when the subject 36 moves, the following operation is performed. That is, the subject movement detection circuit 17 detects the movement of the subject and inputs a detection signal corresponding to the movement of the subject to the image synthesis circuit 18. Image synthesis circuit 1
When the amount of movement of the object is extremely small, the image signal 8 is output to the monitor 19 after the pixel shift of the output of the frame sequential image pickup device by the color shift correction device 3.

When the amount of movement of the subject becomes large and the image signal from the color misregistration correction device 3 has a small field of view, the image synthesizing circuit 18 moves around the image signal from the color misregistration correction device 3. An image signal enclosing the image of the simultaneous image pickup from the CCD control circuit 16 is output to the monitor 19.

Further, when the amount of movement of the subject 36 becomes large, the image synthesizing circuit 18 outputs only the pixel signal from the CCD control circuit 16 to the monitor 19. As a result, taking advantage of the fact that there is no color misregistration, which is an advantage of the simultaneous image pickup device, the disadvantage that the resolution is low is compensated, and a high resolution image which is an advantage of the frame sequential image pickup device is obtained. By making use of the points, it is possible to make up for the disadvantage that color shift easily occurs.

FIG. 6 is a block diagram showing a second embodiment of the present invention. The difference from the first embodiment described above is that the subject motion detection circuit 17 is not provided and the movement of the stage 5 is detected. A stage movement detection circuit 25 is provided. Specifically, this uses an integrated circuit for movement amount detection,
Alternatively, an encoder is used. It goes without saying that the second embodiment can also obtain the same effect as the first embodiment.

In the embodiment of FIG. 1 described above, the output from the CCD control circuit 16 is input to the subject movement detection circuit 17, but this may be input from the CMD control circuit 15.

[0040]

As described above, according to the present invention, it is possible to provide a color image pickup apparatus capable of obtaining an image without color shift even when a subject is moving.

[Brief description of drawings]

FIG. 1 is a block diagram showing a schematic configuration of a first embodiment of a color image pickup apparatus according to the present invention.

FIG. 2 is a block diagram for explaining the color misregistration correction device in FIG.

FIG. 3 is a diagram for explaining the principle of the motion vector detection circuit of FIG.

FIG. 4 is a block diagram for explaining the color misregistration correction device in FIG.

5 is a block diagram for explaining the color misregistration correction device in FIG.

FIG. 6 is a block diagram showing a schematic configuration of a second embodiment of a color image pickup device according to the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Frame sequential imaging device, 2 ... Simultaneous imaging device, 3 ... Color shift correction device, 4 ... Illumination device, 5 ... Stage, 6 ... Objective lens, 7 ... Imaging lens, 8 ... Half prism, 9 ... Rotation Filter, 10 ... Color mosaic filter, 11 ... Motor, 12 ... Motor drive circuit, 13 ... CMD TV camera, 14 ... CCD TV camera, 15 ... CMD control circuit, 16 ... CCD control circuit, 17 ... Subject motion detection circuit, 18 … Image synthesis circuit, 19… Television monitor, 25…
Stage movement detection circuit, 36 ... Subject.

Claims (1)

[Claims] 1. A frame-sequential image pickup device for rotating a color filter in front of a black-and-white image pickup device to perform color image pickup of an object and outputting the image to a monitor, and detecting a motion vector amount of the output of the frame-sequential image pickup device, A color misregistration correction unit that corrects color misregistration by shifting pixels according to the detected value, a simultaneous imaging device that color-separates with a color separation device to simultaneously color-image the subject, and outputs the images to the monitor; An image synthesizing unit that switches between outputs of the simultaneous image pickup apparatus and the field sequential image pickup apparatus, or synthesizes both outputs, and a movement amount of the subject is detected. When a predetermined value is exceeded, a command for taking in the output of the color shift correction means to the monitor is given to the image composition means,
Further, when the amount of movement of the subject exceeds a first predetermined value and exceeds a second predetermined value, a command for taking in the output of the simultaneous image pickup device to the monitor is given to the image synthesizing means. Further, when the amount of movement of the subject exceeds a first predetermined value and is within a second predetermined value, the output from the color misregistration correction unit and the output from the simultaneous imaging device are combined and output to the monitor. A color image pickup apparatus comprising: a motion detection unit that gives a command for performing the operation.