JP2001111879A - Iimage pickup device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enhance the image quality of a still picture photographed by a video camera while avoiding a cost increase. SOLUTION: A so-called spatial pixel shift method is utilized for capturing a picked up image by a CCD as a still picture. In obtaining a plurality of pictures whose optical axes are deflected, an optical camera-shake correction function provided substantially for camera-shake correction is utilized to apply physical moving control to an active prism or an active lens.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an imaging device,
For example, it is preferably applied to a video camera.

[0002]

2. Description of the Related Art Recently, for example, a CCD (Charge Coupled)
2. Description of the Related Art Video camera devices that combine a camera part provided with an image pickup device (photoelectric conversion element) and a media drive part capable of recording an image captured by the camera part as a moving image on a recording medium have become widespread. . In addition, among such video cameras, those having a still image photographing function capable of photographing a captured image as a still image and recording the still image have become widespread.

[0003]

The resolution of an image picked up by a video camera largely depends on the resolution (number of pixels) of a CCD. Therefore, in order to improve the image quality by increasing the resolution, it is only necessary to adopt a CCD having a large number of pixels, but this leads to an increase in cost. Is generally limited to a certain number of pixels for a CCD.

[0004] On the other hand, in a so-called digital still camera or the like on the assumption that only a still image is photographed,
In some cases, the function is limited only to still image shooting. In particular, in recent years, the number of pixels of the CCD has been significantly improved even in popular products.

[0005] For this reason, when a still image is shot by a video camera having the above-described still image shooting function, the resolution of the image is significantly lower than that of a digital still camera, and the image quality is inferior. I'm starting to have problems.

[0006]

In order to solve the above-mentioned problems, the present invention avoids factors that may cause an increase in cost, for example, by increasing the number of pixels of a CCD.
It is an object of the present invention to improve the image quality of a captured still image in an imaging device such as a video camera.

For this reason, a lens optical system, photoelectric conversion means for converting imaging light obtained by the lens optical system into an electric signal, and a picked-up image generation for obtaining a picked-up image based on the electric signal obtained by the photoelectric conversion means Means and a predetermined movable optical part provided in the lens optical system are moved to move the optical axis of the imaging light, thereby performing control so as to correct the fluctuation of the captured image accompanying the movement of the imaging apparatus. Means for controlling the movement of the movable optical part to obtain a plurality of imaging light beams having different deflection positions of the optical axis, and a captured image generation unit combines the captured images obtained by the plurality of imaging light beams to obtain a stationary image. The image capturing apparatus is configured to include a still image capturing control unit that controls so that a captured image as an image is generated.

According to the above arrangement, the apparent resolution as a still image is obtained by using a so-called spatial pixel shifting technique of synthesizing a plurality of picked-up images obtained by a plurality of picked-up lights having different optical axis deflection positions. To be higher. In order to obtain imaging light having different deflection positions of the optical axis, a camera shake correction function provided in the imaging device and configured to control movement of a movable portion in a lens optical system is used.

[0009]

Embodiments of the present invention will be described below. The imaging device according to the present embodiment is provided in a video camera. Further, the video camera of the present embodiment has a still image recording function of recording a captured image as a still image in addition to a moving image recording function of recording a captured image as a moving image.

FIG. 1 is a block diagram showing a configuration example of a video camera according to the present embodiment. The video camera shown in FIG. 1 includes a camera block 1. In the camera block 1, first, a lens block 2 is disposed, and imaging light is obtained through the lens block 2. Then, the imaging light is received by the CCD 4 having a predetermined resolution (the number of pixels), is photoelectrically converted, and is output as an electric signal.

The lens block 2 is provided with a so-called active prism 3 such as a variable apex angle prism for correcting a camera shake described later. As is well known, the active prism 3 can be deflected in the horizontal and vertical directions by driving the active prism 3 by a motor (not shown) or the like.

In this case, the electric signal (image pickup signal) outputted from the CCD 4 is branched and outputted to a moving picture recording / reproduction signal processing section 5 and a still picture recording / reproduction signal processing section 8. The moving image recording / reproducing signal processing unit 5 performs necessary signal processing for recording an image pickup signal output from the CCD 4 as a moving image, for example, during recording. Then, image information as a moving image is recorded on a predetermined recording medium which is assumed to be loaded in the moving image media drive unit 7. At the time of moving image reproduction, moving image information is read from the recording medium loaded in the moving image media drive unit 7, and the moving image recording / reproduction signal processing unit 5 executes reproduction signal processing. Then, a reproduced video signal is output from a video output terminal not shown here, or a reproduced moving image is displayed and output on a display unit or the like not shown here.

The still image recording / reproducing signal processing section 8 generates image information for one frame as a still image from an image pickup signal output from the CCD 4 during recording, Recording as still image information is performed on a predetermined type of recording medium loaded in the drive unit 9. Further, at the time of reproduction, a data file as a still image is read from a recording medium loaded in the still image media drive unit 9,
The still image recording / reproduction signal processing unit 8 executes signal processing for reproducing and outputting as a still image signal.

When executing the signal processing for recording or reproduction in the moving image recording / reproducing signal processing section 5 and the still image recording / reproducing signal processing section 8, the frame memory 10
Is used as the work area. In the present embodiment, the capacity of the frame memory 10, that is, the number of pixels is determined as follows. That is, the horizontal resolution (the number of horizontal pixels) of the CCD 4 is M, and the vertical resolution (vertical resolution) is
Is N, the number of horizontal pixels of the frame memory 10 is 2M
Larger, and the number of vertical pixels is larger than 2N. This is because the above-described number of pixels is required when writing image data to the frame memory using the method of spatial pixel shifting at the time of recording a still image to be described later.

In this embodiment, moving image recording /
The reproduction signal processing unit 5 may be configured to process a video signal as a moving image as an analog signal or may be configured to process a video signal as a digital signal. This is the same for the still image recording / reproduction signal processing unit 8. However, the moving image recording / reproduction signal processing unit 5 and the still image recording / reproduction signal processing unit 8 execute digital signal processing, and the moving image media drive unit 7
The image information is also recorded as digital data on each of the recording media loaded in the still image media drive unit 9. As a recording medium to be loaded into the moving image media drive unit 7 and the still image media drive unit 9, for example, a tape-shaped recording medium can be considered. Here, it is not particularly limited here. However, as a recording medium that the still image media drive unit 9 corresponds to, for example, still image data can be smaller in data size than a moving image. In addition, the media size can be small. It is also conceivable to adopt a configuration in which the moving image media drive unit 7 and the still image media drive unit 9 are shared, and the moving image and the still image can be recorded and reproduced on the same recording medium.

Further, a motion detecting section 6 is provided for the moving picture recording / reproducing signal processing section 5. In the present embodiment, the motion detection unit 6 is used for camera shake correction at the time of capturing a moving image. In the motion detection unit 6, the moving image recording /
A motion vector of an image is detected for an image signal that is sequentially processed in the reproduction signal processing unit 5. This detection information is output to the terminal Ta of the switch 13.

The switch 13 is configured such that the terminal Ta and the terminal Tb are alternatively connected to the terminal Tc.
This switching is controlled by the system controller 14. The detection information from the motion detection unit 6 described above is input to the terminal Ta, and the pseudo detection signal output from the pseudo detection signal generation unit 12 is input to the terminal Tb. The terminal Tc is connected to the camera shake correction servo control unit 11.

Here, when the moving image recording mode for recording a moving image is set, the terminal Ta and the terminal Tc are connected to the switch 13, so that the detection signal of the motion detecting section 6 is used for the camera shake correction servo. It is input to the control unit 11.
The camera shake correction servo controller 11 calculates horizontal and vertical screen shakes (movements) caused by camera shake based on the input detection signal of the motion detector 6, and calculates the screen shakes. The movement of the active prism 3 is controlled so as to be canceled. Thereby, in the lens block 2, the optical axis of the imaging light is deflected so as to cancel image shaking due to camera shake, and as a result, a captured image without image shaking can be obtained. That is,
Camera shake correction is realized.

The method of correcting the camera shake by physically moving the components in the optical system as described above is sometimes referred to as "optical camera shake correction". The technique of the optical camera shake correction is not particularly limited. That is,
In the configuration shown in FIG. 1, a method using the active prism 3 is employed. For example, in addition to the above, the camera shake correction is performed by moving a specific lens among the lenses constituting the lens system as an active lens. The method of performing is also known. The present invention can be applied to a system employing such an active lens.

In a still image recording mode for recording a still image, the switch 13 switches the pseudo detection signal output from the pseudo detection signal generator 12 by connecting the terminals Tc and Tb. The camera shake correction servo controller 11
Is obtained. The pseudo-detection signal output from the pseudo-detection signal generating unit 12 is an active prism corresponding to deflecting the optical axis of the imaging light in a predetermined direction by a predetermined amount when recording a still image using a spatial pixel shifting method described later. Is used to control the movement of

The system controller 14 includes, for example, a microcomputer, a ROM, a RAM, and the like, and controls the operation of each functional circuit unit in the video camera. In particular, in the present embodiment, switching of the switch 13 and control of the pseudo-detection signal generator 12 are performed in order to realize an image capturing operation described later when recording a still image.

Incidentally, in the configuration shown in FIG.
Is provided exclusively for image stabilization,
For example, when recording moving image data on a recording medium, if data compression is performed by a predetermined method involving motion detection such as the MPEG method, the motion detection unit 6 is used for both camera shake correction and data compression. You may make it. Further, for the detection of image shaking for camera shake correction, for example, an angular velocity sensor or the like is provided in place of a detection method using an image signal as in the motion detecting unit 6, and a horizontal movement obtained by this angular velocity sensor is provided. Alternatively, the detection may be performed based on the amount of vibration in the vertical direction.

As can be seen from the above configuration, in the video camera according to the present embodiment, not only a moving image but also a captured image can be recorded as a still image.
In recording a still image, a so-called “spatial pixel shift” technique is applied so that a resolution apparently higher than the resolution determined by the CCD 4 is obtained. The purpose is to improve the image quality. Therefore, hereinafter, the still image recording according to the present embodiment will be described.

Here, as a comparison with this embodiment, a conventional still image capturing operation will be described with reference to FIG. FIG. 8A shows a subject “I” as an example of a subject to be imaged, that is, an original image. The original image shown in FIG. 8A is obtained by dividing the number of horizontal pixels (pixels) × the number of vertical pixels (pixels) = M × N
When an image is captured by a CD, light is received at each pixel as shown in FIG. 8B, for example. Then, the image captured by the CCD is written (mapped) as image data to the frame memory. Here, when the image captured by the CCD is written to the frame memory, the area of the frame memory is also used.
The same number of horizontal pixels × the number of vertical pixels as the number of pixels of the above CCD = M
It is assumed that an area corresponding to × N is used. Then, in the frame memory, as shown in FIG. 8C, an image "A" corresponding to the M × N resolution is obtained.

On the other hand, in the present embodiment, FIG.
As shown in FIG. 5, an image is taken in at the time of recording a still image. It should be noted that the image capture described with reference to these figures is a conceptual operation, and is actually described later with reference to FIGS. Also in the following description, it is assumed that the original image as the subject is the character “A”.

Here, in the present embodiment, the CCD
4, the number of horizontal pixels (pixels) × the number of vertical pixels (pixels) = M × N.
The use area of 0 is assumed to be the number of horizontal pixels (pixels) × the number of vertical pixels (pixels) = 2M × 2N. In other words, here, the use area of the frame memory is assumed to be assigned twice as many pixels in the horizontal and vertical directions as the number of pixels of the CCD 4.

When the still image recording is to be performed, first, the first image capturing operation shown in FIGS. 2A and 2B is performed. That is, in a state where the active prism 3 in the lens block 2 is at a predetermined reference position, an image signal captured by the CCD 4 is written to the frame memory 10 as shown in FIG. You.

Here, when writing into the frame memory 10, it is assumed that a pixel block BL composed of 2 (pixels) × 2 (pixels) = 4 pixels is formed in the use area as shown in FIG. I assume it. In this case, the frame memory 10 stores the CCD resolution (the number of pixels) of 2 in each of the vertical and horizontal directions.
Since it has twice the number of pixels (addresses),
One pixel block BL composed of pixels corresponds to one pixel in the CCD 4. Then, corresponding to the fact that this pixel block BL is composed of 2 × 2 4 pixels,
As described below, the image capturing operation including the first image capturing operation is also performed 4 (= 2 ² ) times.

In this case, the signal of each pixel of the CCD obtained by the first image capturing operation is converted into the pixel (address) at the position indicated by in each block in FIG.
Is written to. In other words, in this case, the addresses (X, Y =
With (1, 0) as a base point, every other data is mapped in each of the horizontal direction and the vertical direction. This result is shown in FIG. 2B as write data on the frame memory.

Assuming that the first image capturing operation has been completed as described above, the process proceeds to the second image capturing operation shown in FIGS. 2 (c) and 2 (d). Here, as the second image capturing operation, the optical axis of the captured image received on the CCD 4 moves by a half pixel in the horizontal direction with respect to the reference position of the active prism 3 at the time of the first image capturing operation ( Shift), the movement of the active prism 3 is controlled. In this case, as shown by an arrow in FIG. 2C, the active prism 3 is moved so that the imaging light received by the CCD 4 shifts to the left. Such movement control of the active prism 3 is performed by controlling the system controller 14 such that the terminal Tc and the terminal Tb are connected in the switch 13 and then a pseudo movement corresponding to a necessary movement amount of the active prism 3 is performed. This is realized by outputting a detection signal from the pseudo detection signal generation unit 12 to the camera shake correction servo control unit 11. That is, in the present embodiment, in order to realize the pixel shifting method, a camera shake correction function provided in a video camera, which moves an optical system, is used. In this regard, the same applies to the movement control of the active prism 3 during the third and fourth image capturing operations described below.

When the image picked up by the CCD 4 in this state is taken into the frame memory 10,
Is written to the position indicated by the symbol in each pixel block BL indicated by the symbol. In other words, here
The address (X, Y = 0,
With 0) as the base point, every other data is mapped in each of the horizontal direction and the vertical direction. The position indicated by in each pixel block BL is
Pixel block BL corresponding to the above first image capturing operation
As can be seen from being located on the left side of the position in the figure, the one corresponding to the positional relationship of the captured image in the CCD 4 between the first image capturing operation and the second image capturing operation. It is.

The data written to the frame memory only by the second image capturing operation includes:
The result is as shown in FIG. The character "A" shown in FIG. 2D is actually shifted to the right in the frame memory 10 by one pixel with respect to the character "A" shown in FIG. 2B. It is what is drawn in.

Subsequently, the operation shifts to the third image capturing operation shown in FIGS. 3 (a) and 3 (b). In the third image capturing operation, the optical axis of the captured image on the CCD 4 is vertically shifted by ピ ク セ ル pixel with respect to the reference position of the active prism 3 at the time of the first image capturing operation. Then, the movement of the active prism 3 is controlled. In this case, as indicated by the arrow in FIG.
It is assumed that the active prism 3 is moved so that the imaging light received at D4 shifts downward.

In this state, when the image picked up by the CCD 4 is taken into the frame memory 10, FIG.
Is written to the position indicated by the symbol in each pixel block BL indicated by the symbol. Here, starting from the address (X, Y = 1, 1) in the frame memory 10, every other data is mapped in the horizontal and vertical directions. This third
FIG. 3B shows data written in the frame memory only by the image capturing operation.
The character “A” shown in FIG. 3B is actually stored in the frame memory 10 as the character “A” shown in FIG.
Is drawn at a position shifted downward by one pixel with respect to the character of.

Subsequently, the operation shifts to the fourth image capturing operation. In the fourth image capturing operation, the optical axis of the captured image on the CCD 4 is shifted by 1/2 pixel in the horizontal and vertical directions with respect to the reference position of the active prism 3 at the time of the previous first image capturing operation. Then, the movement of the active prism 3 is controlled. That is, the optical axis of the captured image is shifted obliquely at an angle of 45 ° with respect to the reference position. In this case, as shown by an arrow in FIG. 3C, the active prism 3 is moved so that the imaging light received by the CCD 4 is shifted obliquely to the lower left by 45 °.

In this state, when the image picked up by the CCD 4 is taken into the frame memory 10, FIG.
Data writing is performed at the position indicated by in each pixel block BL. Here, starting from the address (X, Y = 0, 1) in the frame memory 10, every other data is mapped in each of the horizontal direction and the vertical direction. Data written to the frame memory only by the fourth image capturing operation includes:
The result is as shown in FIG. The character "A" shown in FIG. 3D is actually one pixel leftward and lower than the character "A" shown in FIG. This means that the image is drawn at the position shifted by the distance.

In this way, a total of four times of the first
The images written in the frame memory 10 by the fourth to fourth image capturing operations, that is, the results of synthesizing the data on the frame memory 10 obtained by each of the first to fourth image capturing operations are as shown in FIG. Become. This figure 5
As can be seen by comparing the image shown in FIG. 8 with the image shown in FIG. 8 earlier, the image shown in FIG. 5 has smaller jaggies than the image shown in FIG. Therefore, in the present embodiment, a still image having a higher resolution than the resolution of the same CCD 4 can be obtained.

The order of the first to fourth image capturing operations may be changed as the still image capturing operation of the present embodiment described above. Further, the direction of movement with respect to the reference position is appropriately changed according to which position in the pixel block BL corresponds to the reference position of the active prism 3. And
As an actual still image capturing operation, the order of four image capturing operations corresponding to the first to fourth image capturing operations is changed as described below. The deflection direction with respect to the reference position is also changed.

FIG. 6 shows a processing operation for realizing an image capturing operation at the time of actual still image recording according to the present embodiment. For example, assuming that the user performs an operation for recording a still image or the like to set the still image recording mode, the system controller 14 proceeds to step S101, and first connects the terminal Tc of the switch 13 to the terminal Tb. Control as follows. As a result, a state is obtained in which a pseudo detection signal output from the pseudo detection signal generation unit 12, that is, a control signal for movably controlling the active prism 3 can be input to the camera shake correction servo control unit 11.

In the following step S102, the active prism 3 is fixed at a reference position such as a neutral position. For this purpose, for example, under the control of the system controller 14, the pseudo detection signal generation unit 12 outputs a pseudo detection signal for causing the active prism 3 to be located at the neutral position. In addition, for convenience of the following description, this reference position is also referred to as a “first position”. Then, as processing of the subsequent step S103,
A first captured image is taken in a state where the active prism 3 is at the first position. Here, capture of a captured image refers to an operation of receiving imaging light in the CCD 4 and converting it into an electric signal. Then, by the processing of the next step S104, the captured image signal output from the CCD 4 is written to the frame memory 10 as data.

At this time, data is written to the frame memory as follows. FIG. 7 shows how to write data to the frame memory 10 in accordance with the processing operation shown in FIG. 6 in a form according to FIG. When writing the image data obtained by the first image capturing operation in step S104, as shown in FIG. 7, data is written to the pixel at the position indicated by in the 2 × 2 pixel block BL. Is written. This is because, for example, for an address (coordinate) corresponding to a pixel of the frame memory, for example, as shown in FIG.
= 0, 1, 2, 3,..., Y =
If it is defined as 0, 1, 2, 3,..., Writing to an address represented by (X = 2n, Y = 2n) (n is an integer of 0 or more) is performed. Become. That is, the system controller 14 writes the data of M × N pixels obtained by imaging with the CCD 4 by specifying the address (pixel) represented by the above (X = 2n, Y = 2n). It is.

When the step S104 is completed, the first image capturing operation is completed. This is shown in FIG.
This corresponds to the first image capturing operation shown by (b).

The following steps S105 to S107 are processing for the second image capturing operation. First, in step S105, the active prism 3 is moved so that the optical axis of the imaging light obtained by the CCD 4 is shifted in the horizontal direction by 1/2 pixel to the right from the first position (reference position). Note that this position state is also referred to herein as a “second position”. In the movement of the active prism 3 described above, a pseudo detection signal corresponding to the moving amount and the moving direction of the optical axis of the imaging light from the first position to the second position is output from the pseudo detection signal generation unit 12. like,
This is performed by the system controller 14 executing the control. Then, in the next step S106, the imaging light of the CCD 4 obtained under the second position is captured as an image signal, and in the next step S107, the data as the image signal is written to the frame memory 10. To be.

The writing of data into the frame memory 10 in step S107 is performed on an address indicated by a pixel position in each pixel block BL of the frame memory 10 shown in FIG. That is, writing is performed at a pixel position located to the right of the pixel position in accordance with the movement of the optical axis of the imaging light in the CCD 4. Therefore, in this case, (X = 2n + 1, Y = 2n) in the frame memory 10
The data of the captured image received by the CCD 4 is written to the address indicated by. The second image capturing operation shown in FIG.
(C) Corresponds to the second image capturing operation shown in (d). However, in the process of FIG. 7, when the CCD 4 obtains a captured image whose optical axis is shifted by a half pixel in the horizontal direction with respect to the reference position, the optical axis is shifted to the right with respect to the reference position. Is what it is.

The following steps S108 to S110 are processing for the third image capturing operation. Step S
At 108, the control for moving the active prism 3 is executed so that the optical axis of the imaging light obtained by the CCD 4 is shifted in the vertical direction by １ ／ pixel from the second position. This position state is also referred to herein as a “third position”. This third position is a reference position (first position)
Is a position shifted by 1/2 pixel in the horizontal and vertical directions. That is, this third image capturing operation in FIG. 7 corresponds to the fourth image capturing operation shown in FIGS. However, in this case,
The horizontal movement component is rightward.

Then, in the next step S109,
The captured image of the CCD 4 obtained at the third position is fetched, and data is written to the frame memory 10 in the subsequent step S110. At the time of data writing in step S110, data writing is performed to the pixel position in each pixel block BL shown in FIG. This pixel position has a positional relationship shifted by one pixel to the right and one pixel downward in the frame memory 10 with respect to the pixel position. The optical axis received by the CCD 4 is a reference position. This corresponds to the positional relationship between the (first position) and the third position. Therefore, as the system controller 14, (X = 2n + 1, Y = 2n +
While specifying the address (pixel) represented by 1), the CC
The image data captured in D4 is to be mapped.

Then, the next steps S111 to S113
Is the last processing for the fourth image capturing operation. In step S111, the optical axis of the imaging light obtained by the CCD 4 is deflected by ピ ク セ ル pixel in the horizontal direction to the left from the third position moved in step S108. The movement of the active prism 3 is controlled. This position is the fourth position, and the first position has a positional relationship deflected by 1/2 pixel in the lower vertical direction. And the next step S
At 112, the CCD obtained at the fourth position
4 and the data is written into the frame memory 10 in the next step S113.

In this case, the writing position of the image data to the frame memory 10 is the pixel position in each pixel block BL shown in FIG. That is, the reference position (first
The data is written to the pixel position adjacent to the lower side of the pixel position corresponding to (position). Also in this case, the positional relationship between the pixel positions corresponds to the positional relationship between the first position and the fourth position as the deflection positions of the captured image in the CCD 4. That is, the fourth image capturing operation corresponds to the third image capturing operation shown in FIGS. Then, as an actual process of the system controller 14, an address (pixel) indicated by (X = 2n, Y = 2n + 1) on the frame memory 10 is specified and image data obtained by imaging by the CCD 4 is mapped. Will go.

As a result of executing the processing as described above,
In the frame memory 10, for each pixel position in each pixel block BL shown in FIG.
This means that the image data obtained by the first to fourth image capturing operations has been written. That is,
This means that the optical axes are deflected by 1/2 pixel on the frame memory and the four image data received by the CCD 4 are combined. This makes it possible to obtain a still image having a higher resolution than the resolution of the CCD 4, as in the case described with reference to FIGS. In practice, the still image data obtained in this manner is subjected to necessary signal processing such as compression processing if necessary, and is applied to the medium loaded in the still image media drive unit 9. Recording is performed as a still image data file.

As a result of following the processing operation shown in FIG. 6, the order of writing data to each pixel block BL by the first to fourth image capturing operations is as shown in FIG.
The change in the pixel position indicated by the arrow also corresponds to the movement of the optical axis of the imaging light obtained by the CCD 4, as can be understood from the above description. . This corresponds to the direction of movement of the active prism 3 for deflecting the optical axis.
For example, assuming that images are actually captured in the order according to the first to fourth image capturing operations according to FIGS. 2 and 3, the deflection of the optical axis is indicated in the upper left pixel block BL in FIG. Therefore, the direction of movement of the active prism 3 also corresponds to this. In this case, to move the active prism 3 so as to correspond to the transition from the pixel position to the pixel position,
It becomes necessary to control both the horizontal direction and the vertical direction.
On the other hand, as shown in FIG. 7, the transition to the next pixel position is always made only in one of the horizontal and vertical directions. In this way, as in the case of FIG. 4, when the active prism 3 is moved for optical axis deflection, both the horizontal direction and the vertical direction are not controlled. There is no waste, and the processing for controlling the movement of the active prism 3 can be simplified.

In the above embodiment, the CCD
It is described that the address area of the frame memory 10 corresponding to twice the number of pixels in the horizontal and vertical directions for the number of pixels of 4 is used. That is, CCD4
Assuming that the number of horizontal pixels = M and the number of vertical pixels = N, the address area used as the frame memory is represented by the number of horizontal pixels M ×
Assuming that n is the number of vertical pixels N × n (n is a natural number of 2 or more), the above embodiment has been described on the assumption that n = 2. However, in the present invention, the variable n may be set to a number larger than 2 as long as the capacity as the frame memory is sufficient. For example, if the variable n = 3 and the frame memory 10 uses an address area corresponding to the number of horizontal pixels M × 3 and the number of vertical pixels N × 3, one pixel block BL is 3
× 3 = 9 pixels. Therefore, nine image capturing operations may be performed while deflecting the optical axis so as to correspond to the pixel positions in the pixel block BL. Also in this case, when the optical axis is deflected, the optical axis is always deflected in the horizontal direction or the vertical direction at a distance of 1/3 pixel on the CCD 4 (1 pixel on the frame memory). In this case, the amount of movement of the active prism 3 for one still image recording can be reduced.

As will be understood from the above description, the present embodiment utilizes a so-called spatial pixel shifting technique to improve the resolution of a still image. The detailed method is not limited to the method described in the above embodiment.

The image pickup apparatus according to the present invention is not limited to the configuration of the video camera shown in FIG. 1 as the above embodiment, but may be any image pickup apparatus having an optical camera shake correction function. Applicable.

[0054]

As described above, according to the present invention, for example, C
A so-called spatial pixel shifting technique is used when capturing a captured image obtained by capturing using a CD (photoelectric conversion unit) or the like as a still image. When obtaining a plurality of images whose optical axes are deflected, the optical system (movable optical part) is physically moved by using the optical camera shake correction function originally provided for camera shake correction (image shake correction). The movement is controlled. That is, in the present invention, it is not necessary to increase the number of pixels of, for example, a CCD by adopting a spatial pixel shifting method, and the optical axis is particularly deflected by using the optical image stabilization function secondarily. There is no need to add a mechanism for obtaining an image, and therefore, there is an effect that the image quality of a still image can be improved without increasing the cost.

Further, according to the present invention, the number of horizontal pixels M × n and the number of vertical pixels N × n (n is a natural number of 2 or more) (M is a natural number) in terms of it was decided to use the area of the frame memory having an address), the optical axes respectively so as to obtain the n ² times the imaging beam deflected. Then, the image data of the imaging light is written to the pixel on the frame memory corresponding to the deflection position, and the synthesized image is synthesized. By adopting such a configuration, as the present invention, as the variable n as the number of horizontal pixels M × n and the number of vertical pixels N × n of the frame memory is increased, a still image with higher resolution can be easily obtained. Is possible.

When the image light picked up by the CCD is to be moved from the current deflection position to the next deflection position, it is adjacent to the current deflection position in the horizontal or vertical direction. The movement of the movable optical part is controlled so that the movement to the deflection position is performed. Thereby, the moving direction of the movable optical part is limited to a predetermined amount of movement in the horizontal direction or the vertical direction. For example, jumping between deflection positions and movement in an oblique direction are eliminated, so that one still image is obtained. In this case, the amount of movement of the movable optical part can be substantially minimized, and the processing for controlling the movement of the movable optical part can be simplified. This also contributes, for example, to obtaining a quick still image shooting operation.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a video camera as an embodiment of the present invention.

FIG. 2 is an explanatory diagram showing an outline of an image capturing operation for recording a still image according to the embodiment.

FIG. 3 is an explanatory diagram illustrating an outline of an image capturing operation for recording a still image according to the embodiment;

FIG. 4 is an explanatory diagram showing a method of writing data to a frame memory as an image capturing operation for recording a still image shown in FIGS. 2 and 3.

FIG. 5 is an explanatory diagram showing composite data on a frame memory obtained by an image capturing operation according to the present embodiment.

FIG. 6 is a flowchart showing a processing operation for realizing an image capturing operation for actual still image recording according to the present embodiment.

FIG. 7 is an explanatory diagram showing how to write data to a frame memory according to the processing operation shown in FIG. 6;

FIG. 8 is an explanatory diagram showing a conventional still image capturing operation.

[Explanation of symbols]

Reference Signs List 1 camera block, 2 lens block, 3 active prism, 4 CCD, 5 moving image recording / playback signal processing unit, 6 motion detecting unit, 7 moving image media drive unit, 8 still image recording / playback signal processing unit, 9 still image Media drive section, 10 frame memory, 11 camera shake correction servo control section, 12 pseudo detection signal generation section, 13
Switch, 14 system controller, BL pixel block

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/335 H04N 5/335 VF term (Reference) 5C022 AA11 AA13 AB45 AB55 AC42 AC51 AC54 AC69 AC74 AC79 5C023 AA11 AA31 AA34 AA36 AA37 BA01 BA11 CA02 DA04 DA08 5C024 AA01 BA00 BA01 CA07 CA11 DA05 DA07 EA04 EA06 EA10 FA01 FA11 GA11 HA13 HA24

Claims (3)

[Claims] 1. A lens optical system, a photoelectric conversion unit that converts imaging light obtained by the lens optical system into an electric signal, and a captured image generation that obtains a captured image based on the electric signal obtained by the photoelectric conversion unit Means for moving a predetermined movable optical part provided in the lens optical system to move the optical axis of the imaging light, thereby performing control so as to correct shaking of a captured image accompanying movement of the imaging apparatus. The shake correction means, and by controlling the movement of the movable optical part, obtain a plurality of imaging lights, each of which has a different deflection position of the optical axis, and, in the captured image generation means, obtain each captured image obtained by the plurality of imaging lights. A still image capturing control unit configured to control the combined image to generate a captured image as a still image. 2. The image-capturing image generating means, wherein the number of horizontal pixels M and the number of vertical pixels N of the photoelectric conversion means are equal to the number of horizontal pixels M × n and the number of vertical pixels N × n (where n is 2 or more). on which is intended to use the area of the frame memory means having a number of pixels natural number), the still image capturing control means that controls movement of the said movable optical part ^twice n, deflection of the optical axis The imaging light having different positions is obtained n ² times, and the data of n ² captured images obtained by these imaging lights are respectively stored in the frame memory in the pixels corresponding to the deflection positions of the imaging light. 2. The image processing apparatus according to claim 1, wherein the image is synthesized by writing.
An imaging device according to claim 1. 3. The still image capturing control means according to claim 1, wherein, when a movement from the current deflection position to the next deflection position is to be performed, the still image imaging control means is adjacent to the current deflection position in a horizontal direction or a vertical direction. 3. The imaging apparatus according to claim 2, wherein the movable optical portion is controlled to move so that the moving deflection position is moved.