JPH1141504A - Image pickup device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a miniaturized lightweight image pickup device, with which a composite image can be formed by composting plural images, by providing a mode selecting means for selecting either a standard image pickup mode or a high definition image pickup mode. SOLUTION: While the standard image pickup mode is selected by a mode selecting part 66, images within a range to pick up images are fetched by image pickup operation one time of a two-dimensional imaging device 12. While the high definition image pickup mode is selected, an operation control part 64 controls a focal distance control part 65 and sets the focal distance of an optical image pickup system 11 to the longer focal distance. A direction control part 63 divides the range to pick up images into 1st-4th area and controls the optical axis of the optical image pickup system 11 so as to successively turn it towards the centers of the respective divided areas. An image compositing part 74 composites the expanded image data of 1st-4th areas and forms the high definition composite image data over all the range to pick up images.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an imaging apparatus for synthesizing a plurality of digital images to obtain a single high-definition image or wide image.

[0002]

2. Description of the Related Art Conventionally, there has been known an apparatus for synthesizing a plurality of images captured using a digital image capturing apparatus to obtain one high-definition image or a wide image. In a first conventional example shown in FIG. 12, a beam splitter 1 is provided between an imaging optical system 101 and two two-dimensional imaging elements 102a and 102b.
03, the light beam is split into two, and one two-dimensional image sensor 102a captures, for example, the right half of the image, and
The left half of the image is captured by the two-dimensional image sensor. Then, digital signals corresponding to the two images captured by the two two-dimensional image sensors 102a and 102b are processed to substantially
A composite image is formed.

In the second conventional example shown in FIG.
A two-dimensional imaging device 112 is connected to a so-called XY driving device 113.
And within the image circle of the imaging optical system 111
The two-dimensional image sensor 112 is moved, and the imaging range (subject)
100 different plural (for example, four) regions 100a
Images are captured for each of to 100d, and a digital signal corresponding to each image is processed to form one composite image.

[0004] In any of the conventional examples, when a subject is considered as a reference, a substantially constant range is imaged by a plurality of two-dimensional imaging elements, and the number of pixels of the two-dimensional imaging element is increased. It is equivalent and a high definition image is obtained. Meanwhile, 2
Considering the two-dimensional imaging device as a reference, images of subjects in different ranges are synthesized (combined), and the angle of view of the imaging optical systems 101 and 111 is substantially widened (the focal length is shortened). And a wide image is obtained.

[0005]

However, in the above-mentioned first and second conventional examples, both of the two-dimensional
The imaging optical system 1 having a large image circle as compared with the imageable area (area of the pixel portion) of the pixels 02a, 102b, and 112.
01 and 111 are required, and the imaging optical systems 101 and 111 themselves become large. Furthermore, a large dark box or lens barrel is required to house the beam splitter 103, the XY driving device 113, and the like. As a result, there is a problem that the entire image pickup apparatus becomes large.

Further, a wide image obtained by synthesizing images is also substantially limited to the image circle of the imaging optical systems 101 and 111. There was a problem that only an image could be obtained.

In the first and second conventional examples, even when a high-definition image is not required, image synthesis is always performed, which causes a problem that processing time and power for image synthesis are lost. Had.

Further, in the second conventional example, since a plurality of images are captured while moving the two-dimensional image sensor 112 using the XY drive mechanism 113, the position of each captured image (the position of the Whether the part is taken in) depends on the positioning accuracy of the XY driving device 113. Therefore, if the positioning accuracy of the XY driving device 113 is low, pixel data may be missing or duplicated at a portion where the image of each region is bonded, and the sharpness of the bonded portion of the combined image is poor. There was a problem that. In addition, if the imaging apparatus moves due to so-called “camera shake” while the two-dimensional imaging element 112 is moving, chipping or duplication of pixel data occurs in a wide range near a bonded portion of each image, so that images can be combined. However, there is a problem that the imaging fails as a result.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problem of the prior art. A plurality of images can be combined to form a combined image in an arbitrary range, and the image bonding accuracy is high. It is an object of the present invention to provide a small and lightweight imaging device capable of correcting "camera shake".

[0010]

In order to achieve the above object, an image pickup apparatus according to the present invention comprises: an image pickup optical system capable of taking at least two or more focal lengths; and a two-dimensional image sensor provided near a focal plane of the image pickup optical system. An image pickup element, a focal length control means for changing a focal length of the image pickup optical system, a direction control means for controlling a direction of an optical axis of the image pickup optical system, and one image obtained by combining a plurality of images captured by the two-dimensional image pickup element Image synthesizing means for forming a synthesized image, a mode selecting means for selecting one of a standard imaging mode and a high-definition imaging mode, and a focal length control means and a direction control in accordance with the imaging mode selected by the mode selecting means. Means for controlling the two-dimensional imaging device and the image synthesizing means, and when the standard imaging mode is selected, the operation control means controls the focal length control means to control the imaging light. When the focal length of the system is set to the first focal length, an image of the entire imaging range is captured by the two-dimensional imaging device, and the high-definition imaging mode is selected, the operation control unit controls the focal length control unit. To set the focal length of the imaging optical system to a second focal length longer than the first focal length, and control the direction control means to divide the direction of the optical axis of the imaging optical system into a plurality of areas to be imaged. Are sequentially moved so as to face the center of each of the captured areas, images of each area are captured by a two-dimensional image sensor, and the captured images are combined by an image combining unit to obtain a high-definition combined image of the entire imaging range. .

That is, the imaging apparatus of the present invention has two imaging modes, a standard imaging mode for imaging at a standard resolution and a high-definition imaging mode for imaging at a high resolution, and selects an imaging mode as needed. Is possible. In the standard imaging mode, the focal length of the imaging optical system is set to the shorter first focal length (so-called wide-angle side), and an image in a wide imaging range is captured by one imaging operation of the two-dimensional imaging device.
On the other hand, in the high-definition imaging mode, the focal length of the imaging optical system is set to a long second focal length (so-called telephoto side),
The imaging range is divided into a plurality of regions, and an image enlarged and formed on the imaging surface of the two-dimensional imaging device is captured for each region. Furthermore, by synthesizing each captured image,
In effect, the number of pixels of the two-dimensional image sensor will be increased,
A high-definition image of the imaging range can be obtained.

In the high-definition imaging mode, it is preferable to set the focal length of the imaging optical system to the first focal length, capture a reference image of the entire imaging range, and perform image synthesis with reference to the reference image. . That is, the focal length of the imaging optical system is set to the first focal length on the wide-angle side, and a seamless reference image is obtained although the resolution is not so high. By referring to this reference image, the composition of the images captured at the second focal length on the telephoto side of the imaging optical system, in particular, the processing at the bonded portion of the images is facilitated.

The imaging optical system is selected from a bifocal lens and a zoom lens, and the second focal length is preferably substantially an integral multiple of the first focal length.
In general, bifocal lenses and zoom lenses are often designed so that the focal length at the telephoto end is an integral multiple of twice, three times, or the like at the wide-angle end. For example, when the second focal length is set to approximately twice the first focal length, the imaging range is set to 2 in the vertical and horizontal directions, respectively.
By dividing the image into four regions one by one, one composite image is obtained. In this case, in the high-definition imaging mode,
A resolution approximately four times the resolution of the standard imaging mode can be obtained.
Similarly, when the second focal length is set to be approximately three times the first focal length, a resolution approximately nine times that of the standard imaging mode can be obtained in the high-definition imaging mode. In addition, considering the error of the stuck part of each image, the second focal length is set to the first focal length.
Is preferably slightly shorter than the integral multiple of the focal length.

The imageable area of the two-dimensional image sensor is
In the high-definition imaging mode, it is preferable that the area is larger than the area of each image synthesized by the image synthesis means. That is, by setting the area of the pixel portion of the two-dimensional image sensor to be slightly larger than the area of each image stuck by the image synthesizing unit in the high-definition imaging mode, the position of the image to be stuck can be shifted. It is possible to adjust the error of the stuck part of each image. Further, in the high-definition imaging mode, when the imaging apparatus has moved due to “shake” between capturing a certain image and capturing the next image, while referring to the reference image,
By shifting the position of the image to be pasted, "camera shake" can be substantially corrected.

In the above configuration, it is preferable that the direction control means is a driving mechanism for driving a housing of an imaging unit having an imaging optical system and a two-dimensional imaging element in a predetermined direction and at a predetermined angle. Alternatively, the direction control means is preferably a movable mirror provided on the optical axis of the imaging unit and driven in a predetermined direction and in a predetermined direction. these,
In any case, the image circle of the imaging optical system only needs to cover at least the imageable area of the two-dimensional image sensor, and the imaging optical system having an image circle larger than the imageable area of the two-dimensional image sensor as in the above-described conventional example. No system is required. As a result, the entire imaging device is reduced in size and weight.

[0016]

BEST MODE FOR CARRYING OUT THE INVENTION

(First Embodiment) A first embodiment of the imaging apparatus of the present invention will be described with reference to the drawings. FIG. 1 is a perspective view showing a configuration of a main part of the imaging apparatus according to the first embodiment, and FIG.
FIG. 3 is a cross-sectional view showing the configuration in the initial state, and FIG. 3 is a cross-sectional view showing the operation state.

As shown in FIG. 1 to FIG.
In the case of 0, at least a part of the outer surface 15 is a spherical surface. As shown in FIGS. 2 and 3, an imaging optical system 11 and a two-dimensional imaging device 1 such as a CCD are provided inside the imaging unit 10.
2. A lens driving mechanism 16 for controlling the focal length and the focal position of the imaging optical system 11 is provided. The imaging optical system 11 is a bifocal lens or a zoom lens, and the shortest focal length (so-called wide-angle end) is set as a first focal length,
The longest focal length (so-called telephoto end) is called a second focal length. For example, the second focal length is set to be approximately an integral multiple (for example, about twice) of the first focal length.

As shown in FIG. 2 and FIG.
And has a substantially spherical space 24 for accommodating the imaging unit 10. An opening 23 is formed on the front surface of the housing 20, and a portion of the imaging optical system 11 of the imaging unit 10 projects outside from the opening 23. A plurality of balls 26 are provided between the concave spherical surface of the space 24 and the convex spherical surface of the outer surface 15 of the imaging unit 10, and hold the imaging unit 10 so as to be able to rotate around an arbitrary axis passing through the center O of the sphere. doing. Here, the ball 26 forms a so-called ball bearing, and reduces the rotational load of the imaging unit 10.

As shown in FIG. 1, an X drive mechanism 61 and a Y drive mechanism 62 are provided at the top and side of the imaging unit 10, respectively. The X drive mechanism 61 and the Y drive mechanism 62 are respectively a motor 31 and an elastic roller 3 such as rubber.
2. The image pickup unit 10 is constituted by an encoder 33 and the like, and the elastic roller 32 rolls on the spherical portion of the outer surface 15 of the image pickup unit 10 to relatively rotate the image pickup unit 10 around the X axis and the Y axis. A detection signal from each encoder 33 is input to a control unit 60 provided inside the housing 20, and the rotation angles (rotation amounts) of the imaging unit 10 in the X-axis direction and the Y-axis direction are calculated. As a result, the imaging optical system The directions of the eleven optical axes are specified.

As shown in FIGS. 2 and 3, the housing 20 is provided with an angular velocity sensor 40 and a switch panel 50. The angular velocity sensor 40 detects the moving direction and the moving amount by the two-dimensional image pickup device 12 when the whole image pickup device moves due to, for example, “shake” between the time of taking a certain image and the time of taking the next image. I do. As will be described later, so-called “shake” can be corrected based on information on the moving direction and the moving amount of the imaging device. The switch panel 50 is provided with a switch (a mode selection unit 6 shown in FIG.
6) It functions as an input device (screen format setting unit 67 shown in FIG. 4) for setting an image format and the like. Note that, as shown in FIG. 4, a flash light emitting device 70 may be provided integrally with or separately from the imaging device.

Next, FIG. 4 shows a block configuration of a main part including the control unit 60. X drive mechanism 61 and Y drive mechanism 6
Each of the motors 31 is driven by a predetermined number (or amount) of rotation in the forward or reverse direction according to a control signal from the direction control unit 63, and the number of rotations (or amount) of the motor or the like detected by each encoder 33 is This is fed back to the direction control unit 63. As a result, the imaging optical system 11 of the imaging unit 10
Is controlled so that the optical axis of the optical element faces a predetermined direction.

The focal length control unit 65 includes the imaging unit 10
And a lens driving mechanism 16 for controlling the focal length and the focal position of the imaging optical system 11 provided in the camera. The focal length control unit 65 changes the focal length and the like of the imaging optical system 11 according to a control signal from the operation control unit 64, and also transmits the center-of-gravity position information and the focal length information of the imaging optical system 11 to the direction control unit 63 and the operation. Output to the control unit 64 and the like.

The switch panel 50 provided on the housing 20 of the imaging device functions as a mode selection unit 66, a screen format setting unit 67, and the like. The mode selection unit 66 selects one of two imaging modes, a standard imaging mode for imaging at a standard resolution and a high-definition imaging mode for imaging at a high resolution. Further, the screen format setting section 67 is for setting the height and width of the screen displayed on the display section 75 to be respectively enlarged to the same arbitrary magnification or to different arbitrary magnifications.

The angular velocity sensor 40 provided on the housing 20
Detected the acceleration and the like in the X-axis direction and the Y-axis direction of the image sensor (that is, the housing 20) between the time when a certain image was captured and the time when the next image was captured by the two-dimensional image sensor 12. The signal is output to the shake signal processing unit 41. The blur signal processing unit 41 calculates the amount of movement in the X-axis direction and the Y-axis direction based on the signal from the angular velocity sensor 40, stores the calculation result in the blur amount storage unit 42, and outputs the calculation result to the operation control unit 64. .

The operation control unit 64 includes a photographing mode and screen format setting unit 6 selected by the mode selection unit 66.
The imaging range is set in accordance with the screen format set by step 7 and the focal length (angle of view) of the imaging optical system 11 is set.
(The two-dimensional image sensor 12)
And the center position of each divided area is calculated, and the X drive mechanism 61 and the Y drive mechanism 62 are controlled via the direction control unit 63. Further, when the imaging apparatus is moved due to “camera shake” or the like, the X drive mechanism 61 and the Y drive mechanism 62 are controlled based on the output signal from the shake signal processing unit 41 and the focal length information from the focal length control unit 65. Correct the drive amount.

The two-dimensional image sensor 12 outputs an analog signal corresponding to the electric charge accumulated in each pixel to the image capturing unit 72 according to a clock signal from the image capturing unit 72 and the like.
The image capturing unit 72 converts an analog signal captured from the two-dimensional image sensor 12 into a digital signal, and temporarily stores the digital signal in the image storage unit 73. The image synthesizing unit 74 includes the operation control unit 6
In accordance with the instruction from Step 4, a plurality of pieces of image data stored in the image storage unit 73 are combined to form one piece of composite image data. The formed composite image data is stored again in the image storage unit 73, and is again converted into an NTSC signal or the like and displayed on the display unit 75 such as a monitor display device. Further, the operation control unit 65 controls the flash control unit 71 as necessary, and causes the flash light emitting device 70 to emit light in synchronization with the image capturing by the two-dimensional image sensor 12.

[0027]

First Embodiment Next, a description will be given of a first embodiment of the operation of the imaging apparatus according to the first embodiment of the present invention. The first embodiment relates to switching between the standard imaging mode and the high-definition imaging mode by the mode selection unit 66. For the sake of simplicity, it is assumed that the screen is set to the standard size by the screen format setting unit 67.

When the standard imaging mode is selected by the mode selection unit 66, the operation control unit 64 controls the focal length control unit 65 to change the focal length of the imaging optical system 11 to an arbitrary focal length (imaging optical system). When the system 11 is a zoom lens, the focal length is not limited to the first focal length and the second focal length), and the image in the imaging range is captured by one imaging operation of the two-dimensional imaging device 12.

On the other hand, when the high-definition imaging mode is selected, first, the operation control unit 64 controls the focal length control unit 65 to reduce the focal length of the imaging optical system 11 to the first focal length on the shorter side. 5 and the image capturing unit 72 is controlled to
As shown in (a), the reference image 200 in the wide imaging range
Is captured by one imaging operation of the two-dimensional imaging element 12. Further, the image capturing section 72 converts the captured image data into A
/ D converted and stored in the image storage unit 73. Next, the operation control unit 64 controls the focal length control unit 65 to set the focal length of the imaging optical system 11 to the second focal length on the long side (the so-called telephoto side). Here, for example, when the second focal length is approximately twice the first focal length, as shown in FIG. 5B, the direction control unit 63 sets the imaging range to the first to fourth focal lengths.
And the optical axis of the imaging optical system 11 is sequentially shifted to the center 20 of each of the divided regions 201 to 204.
The drive amounts of the X drive mechanism 61 and the Y drive mechanism 62 are calculated so as to be directed to 1a to 204a. Further, the operation control unit 64 controls the image capturing unit 72, and interlocks with the driving of the imaging unit 10 by the direction control unit 63 so that the first area 20.
The images enlarged and formed on the image pickup surface of the two-dimensional image pickup device 12 are taken in order from 1. The image capturing unit 72 performs A / D conversion on the captured image data of the areas 201 to 204 and stores the data in the image storage unit 73.

The image synthesizing unit 74 refers to the reference image 200 stored in the image storage unit 73, and
To the fourth areas 201 to 204 to form high-definition combined image data of the entire imaging range. Further, the composite image data is stored in the image storage unit 73 and displayed on the display unit 75. The composite image displayed on the display unit 75 is substantially equivalent to an image captured by a two-dimensional image sensor having about four times the number of pixels of the two-dimensional image sensor 12, and a high-definition image is obtained.

The portions of the data of the reference image 200 corresponding to the images of the first to fourth regions 201 to 204 to be synthesized are substantially the same as the image data of the first to fourth regions 201 to 204, respectively. (For example, if attention is paid to the scanning line at the bonding portion, the light and dark have the same periodicity).
Accordingly, the data of the reference image 200 and the respective areas 201 to 20
By comparing the image data of Nos. 4 and 4, it is possible to find a portion having the same periodicity. As a result, the processing in the part where the images are bonded is facilitated.

The second focal length of the image pickup optical system 11 is made slightly shorter than an integral multiple of the first focal length in consideration of an error in a portion where images are bonded. Alternatively, the image-capturable area (the area of the pixel portion) of the two-dimensional image pickup device 12 is set to each image 2 combined by the image combining unit in the high-definition imaging mode.
The area should be wider than 01 to 204. In any case, for example, regarding the first region 201, the image actually obtained by the two-dimensional imaging device 12 is larger than the first region 201 as shown by the dashed line 12a in FIG. . As a result, the first to fourth regions 201 to 201
The capturing position of the image 204 can be shifted, and the error of the bonded portion can be adjusted. In addition, when the imaging apparatus moves due to “camera shake” or the like between the capture of a certain image and the capture of the next image by the two-dimensional image sensor 12, while referring to the reference image,
By shifting the image capturing positions of the first to fourth regions 201 to 204 to be pasted, it is possible to substantially correct "camera shake".

[0033]

Second Embodiment Next, a description will be given of a second embodiment of the operation of the imaging apparatus according to the first embodiment of the present invention. The second embodiment relates to an ultra-wide image that exceeds the first focal length on the wide-angle side of the imaging optical system 11 in the standard imaging mode among the settings of an arbitrary screen format by the screen format setting unit 67.

The focal length of the image pickup optical system 11 is set to the first
Let us consider a case where an ultra-wide image having an angle of view approximately twice as large as the angle of view obtained when the focal length is set is synthesized. The operation control unit 64 controls the focal length control unit 65 to set the focal length of the imaging optical system 11 to the shorter first focal length. In addition, the direction control unit 63 controls the imaging range 2 shown in FIG.
10 is divided into first to fourth regions 211 to 214, and each region 211 where the optical axis of the imaging optical system 11 is divided.
The X drive mechanism 61 is directed to the centers 211a to 214a of the first to fourth 214 and the center 215a of the fifth fifth region 215 at the center.
And the respective drive amounts of the Y drive mechanism 62 are calculated. Further, the operation control unit 64 controls the image capturing unit 72, and interlocks with the driving of the imaging unit 10 by the direction control unit 63, and in the order from the first area 211 to the fifth area 215, the two-dimensional imaging device The image formed on the imaging surface 12 is captured. The image capturing unit 72 performs A / D conversion on the captured image data of the areas 211 to 215 and stores the converted image data in the image storage unit 73.

The image synthesizing section 74 synthesizes the image data of the first to fourth areas 211 to 214 using the image of the fifth area 215 located at the center of the area 210 to be imaged as a reference image. The combined image data of the entire area 210 is formed. Further, the composite image data is stored in the image storage unit 73 and displayed on the display unit 75. The composite image displayed on the display unit 75 is obtained by the imaging optical system having an angle of view twice as large as the angle of view obtained when the first focal length of the imaging optical system 11 is set. It is equivalent and an ultra wide image is obtained.

In the second embodiment, the so-called zooming in which the vertical and horizontal sides of the screen are enlarged to the same magnification has been described. However, as shown in FIG. 7, for example, the horizontal magnification is larger than the vertical magnification. The same applies to the case where the magnification in the vertical direction is larger than the magnification in the horizontal direction as shown in FIG. In the case of a digital camera, it is difficult to change the vertical and horizontal positions of the camera, so the configuration shown in FIG.
This is effective when the imaging range (subject) is vertically long.

The pixel portion 12 of the two-dimensional image pickup device 12
The area of “a” is calculated for each image 2 synthesized by the image synthesis unit 74.
By making the area larger than 11 to 214,
The image capturing positions of the fourth regions 201 to 204 can be shifted, and the error of the bonded portion can be adjusted. In addition, when the imaging apparatus moves due to “camera shake” or the like, the image in the fifth area 215 is used as a reference image, and the capturing position of the image in the first to fourth areas 211 to 214 to be bonded is shifted. Thus, it is possible to substantially correct "camera shake".

[0038]

Third Embodiment Next, a description will be given of a third embodiment of the operation of the imaging apparatus according to the first embodiment of the present invention. The third embodiment relates to zooming and a wide image in the high-definition imaging mode among the settings of an arbitrary screen format by the screen format setting unit 67.

First, since the high-definition imaging mode is selected by the mode selection unit 66, the operation control unit 64 controls the focal length control unit to change the focal length of the imaging optical system 11 to the second focal length on the telephoto side. Set to a distance (in the case of a zoom lens, any focal length on the telephoto side may be used). Further, the direction control unit 63 divides the imaging range into a predetermined number based on the magnification in the vertical direction and the horizontal direction set by the screen format setting unit 67. For example, in the case shown in FIG. 9A, since the vertical and horizontal directions are set to about 1.7 times,
The direction control unit 63 sets the imaging range to the first to fourth regions 20.
Each of the regions 201 to 20 is divided into four regions
The X-scanning mechanism 61 and the Y-scanning mechanism Y are so arranged that the optical axis of the imaging optical system 11 is sequentially directed to the centers 201a to 204a of the divided regions 201 to 204 so that the images of the four images are partially overlapped. The scanning mechanism 62 is controlled. The procedure of image composition is the same as in the first embodiment. FIG.
As compared with the high-definition image (in the vertical direction and the horizontal direction, about twice as large) in the first embodiment shown in FIG.

On the other hand, in the case shown in FIG. 9B, the vertical direction is set to about 1.7 times, but the horizontal direction is set to about 2.7 times. Is divided into three regions in the horizontal direction and two regions in the vertical direction, for a total of six regions, and the images of the first to sixth regions 201 to 206 are synthesized while partially overlapping each other. Center 201a-206 of each area 201-206 where the optical axis of
The X scanning mechanism 61 and the Y scanning mechanism 62 are controlled so as to face a. The procedure of image composition is the same as in the first embodiment. In this case, a wide image is obtained in the high-definition imaging mode.

In the case shown in FIG. 9C, since the magnification is set to about 2.7 times in both the vertical and horizontal directions, the direction control unit 63 sets the imaging range in the horizontal direction by three columns in the vertical direction. Are divided into a total of nine areas in three stages, and the first to ninth areas 201 to 2
The X-scanning mechanism 61 and the Y-scanning so that the optical axes of the imaging optical system 11 face the centers 201a to 209a of the divided regions 201 to 209 so that the respective images 09 are partially overlapped and synthesized. The mechanism 62 is controlled. The procedure of image composition is the same as in the first embodiment. In this case, as compared with the high-definition image (approximately twice in both the vertical and horizontal directions) according to the first embodiment illustrated in FIG. 5B, zooming to the wide-angle side is performed in the high-definition imaging mode.

[0042]

Fourth Embodiment Next, a description will be given of a fourth embodiment of the operation of the imaging apparatus according to the first embodiment of the present invention. The fourth embodiment relates to “camera shake” correction using an output signal from the angular velocity sensor 40.

For example, as shown in FIG. 5B, consider a case where images of four areas are combined to form one combined image. In the case of a digital camera, the time required to capture an image of one area is about 30 msec. In general, it is considered that the flow of an image during capture of an image of one area (so-called “camera shake” in a still camera using a silver halide film) is small. If the imaging range (subject) is dark, the flash control unit 71 may be controlled to cause the flash light emitting device 70 to emit light. 2
The time required from capturing an image of a certain area by the two-dimensional image sensor 12 to driving the X drive mechanism 61 and the Y drive mechanism 62 to capture the image of the next area is 50 to 10 times.
If it is set to 0 msec, it takes 0.3 to 0.5 sec to capture all the images of the four regions. Here, when the imaging device is used by hand, “camera shake” (a concept similar to “camera shake” in a video camera) occurs during that time, and the positional relationship between the images in the four regions is shifted.

When the "camera shake" occurs, the angular velocity sensor 40 detects accelerations in the X-axis direction and the Y-axis direction, and the shake signal processing unit 41 detects the direction and movement of the "camera shake" from the output signal of the angular velocity sensor 40. The amount is calculated, and signals corresponding to the direction and the amount of movement of “shake” are stored in the shake amount storage unit 42 and output to the operation control unit 64.

In FIG. 10, it is assumed that "camera shake" A occurs between the time when the image of the first area 201 is captured and the time when the image of the second area 202 is captured. If the X drive mechanism 61 and Y
When the driving mechanism 62 is driven, the optical axis of the imaging optical system 11 is shifted to the center 20 of the original second area 202 indicated by a dashed line in the figure.
2a, which has not moved to the area 2a and has moved as shown by the solid line in the figure.
02 'at the center 202a'. Therefore, the operation control unit 64 calculates a correction amount B in a direction opposite to the camera shake direction using a signal corresponding to the camera shake direction and the movement amount from the camera shake signal processing unit 41 and outputs the correction amount B to the direction control unit 63. . The direction control unit 63 drives the X drive mechanism 61 and the Y drive mechanism 62 using the drive amount corrected by the correction amount B.
As a result, the original second region 202 indicated by a dashed line in the drawing
Since the image in the same region as that of the image is captured by the two-dimensional image pickup device 12, the synthesized image has no apparent "camera shake".

As described in the first to third embodiments, each of the images 201, 202,.
If the area is wider than the area, a signal corresponding to the direction and amount of movement of the camera shake from the camera shake signal processing unit 41 is output to the image synthesis unit 7.
4 and the image capture position of the moved area 202 is shifted by the amount of movement in the direction opposite to the camera shake direction, whereby "camera shake" can be corrected.

In each of the above embodiments, the imaging optical system 11 has been described as a bifocal lens or a zoom lens capable of taking at least a first focal length and a second focal length. It goes without saying that the same effect can be obtained even with a single focus lens.

(Second Embodiment) A second embodiment of the imaging apparatus according to the present invention will be described with reference to FIG. FIG. 11 is a perspective view illustrating a configuration of a main part of an imaging device according to the second embodiment. In the first embodiment, the imaging optical system 11 and the two-dimensional imaging device 12 are provided inside the imaging unit 10, and the direction of the optical axis of the imaging optical system 11 is controlled by driving the entire imaging unit 10. In the second embodiment, the imaging optical system 11 and the two-dimensional imaging device 12 are fixed to an imaging device main body (not shown), and a mirror 60 having a gimbal structure provided on the optical axis of the imaging optical system 11 is driven by X driving. The mechanism 61 and the Y drive mechanism 62 are configured to be driven to rotate about the X axis and the Y axis. Therefore, in the second embodiment, although the mechanism for controlling the direction of the optical axis of the imaging optical system 11 is different, the control method is substantially the same as that in the first embodiment. Therefore, description of the control method in the second embodiment will be omitted.

[0049]

As described above, according to the imaging apparatus of the present invention, either the standard imaging mode or the high-definition imaging mode can be selected by the mode selection means. When the focal length of the system is set to the first focal length, an image of the entire imaging range is captured by the two-dimensional imaging device, and when the high-definition imaging mode is selected, the focal length of the imaging optical system is set to the first focal length. The second focal length is set to be longer than the distance, and the direction of the optical axis of the imaging optical system is
The image-capturing range is sequentially divided so as to face the center of each of the plurality of divided areas, and the image for each area is captured by the two-dimensional image sensor, and the captured images are combined to form a high-definition composition of the entire image-capturing range. Since an image is obtained, in the high-definition imaging mode, the number of pixels of the two-dimensional imaging device can be substantially increased, and a high-definition image of an imaging range can be obtained.

Further, in the high-definition imaging mode, the focal length of the imaging optical system is set to the first focal length, a reference image of the entire imaging range is captured, and the image is synthesized by referring to the reference image. It is possible to refer to a seamless reference image, and it is possible to easily combine images captured at the second focal length on the telephoto side of the imaging optical system, in particular, to perform processing at a portion where images are bonded.

Further, the imaging optical system is selected from a bifocal lens and a zoom lens, and the second focal length is set to be substantially an integral multiple of the first focal length, so that the second focal length can be reduced. If the first focal length is set to approximately twice, the resolution of the high-definition imaging mode can be about four times the resolution of the standard imaging mode. Similarly, when the second focal length is set to be approximately three times the first focal length, it is possible to obtain about nine times the resolution of the standard imaging mode in the high-definition imaging mode.

Further, by making the imageable area of the two-dimensional image pickup device (the area of the pixel portion) larger than the area of each image synthesized by the image synthesizing means in the high-definition image pickup mode, the capture position of each image can be set. It is possible to shift, and it is possible to adjust an error of a bonded portion. For example, in the high-definition imaging mode, if the imaging device moves due to “shake” between capturing an image and capturing the next image, referring to the reference image, the By shifting the capturing position, “camera shake” can be substantially corrected.

As a direction control means, a drive mechanism for driving a housing of an image pickup unit having a built-in image pickup optical system and a two-dimensional image pickup element in a predetermined direction and at a predetermined angle, or provided on an optical axis of the image pickup unit, By using the movable mirror driven in the predetermined direction and the predetermined direction, the image circle of the imaging optical system can be made small enough to cover at least the imageable area of the two-dimensional image sensor,
The entire imaging device can be reduced in size and weight.

[Brief description of the drawings]

FIG. 1 is a perspective view illustrating a configuration of an imaging unit and a driving mechanism thereof in a first embodiment of an imaging device of the present invention.

FIG. 2 is a cross-sectional view showing an initial configuration of an imaging unit and its housing in the imaging apparatus according to the first embodiment of the present invention.

FIG. 3 is a cross-sectional view illustrating a configuration of the imaging unit and its housing in an operation state according to the first embodiment of the imaging apparatus of the present invention.

FIG. 4 is a block diagram illustrating a configuration of a control unit according to the first embodiment of the imaging apparatus of the present invention.

FIG. 5A is a diagram illustrating an image in a standard imaging mode in Example 1 of the first embodiment of the imaging apparatus of the present invention, and FIG. 5B is a diagram illustrating a composite image in the high-definition imaging mode. .

FIG. 6 is a diagram illustrating an example of a super wide image synthesizing method according to a second example of the first embodiment of the imaging apparatus of the present invention.

FIG. 7 is a diagram illustrating an example of a method for synthesizing a horizontally long image in Example 2 of the imaging apparatus according to the first embodiment of the present invention.

FIG. 8 is a diagram illustrating an example of a method of synthesizing a vertically long image in Example 2 of the imaging apparatus according to the first embodiment of the present invention.

9A is a diagram illustrating a telephoto-side zoom image in a high-definition imaging mode in Example 3 of the imaging apparatus according to the first embodiment of the present invention, and FIG. 9B is a horizontally long image in the high-definition imaging mode. FIG. 3C is a diagram illustrating a panoramic image, and FIG. 3C is a diagram illustrating a wide-angle zoom image in a high-definition imaging mode.

FIG. 10 is a diagram illustrating an example of a “camera shake” correction method in Example 4 of the first embodiment of the imaging apparatus of the present invention.

FIG. 11 is a perspective view illustrating a configuration of an imaging unit and a driving mechanism thereof in a second embodiment of the imaging apparatus of the present invention.

FIG. 12 is a diagram illustrating a configuration of a first conventional imaging apparatus.

FIG. 13 is a perspective view illustrating a configuration of a second conventional imaging apparatus.

[Explanation of symbols]

 Reference Signs List 10: imaging unit 11: imaging optical system 12: two-dimensional imaging device 20: housing 40: angular velocity sensor 41: blur signal processing unit 42: blur amount storage unit 50: switch panel 60: control unit 61: X drive mechanism 62: Y drive mechanism 63: direction control unit 64: operation control unit 65: focal length control unit 66: mode selection unit 67: screen format setting unit 70: flash light emitting device 71: flash control unit 72: image capture unit 73: image storage Unit 74: image combining unit 75: display unit 200: combined image 201: first region 202: second region 203: third region 204: fourth region

Claims (6)

[Claims] An imaging optical system capable of taking at least two or more focal lengths, a two-dimensional imaging device provided near a focal plane of the imaging optical system, and a focal length control for changing a focal length of the imaging optical system Means, direction control means for controlling the direction of the optical axis of the imaging optical system, image combining means for combining a plurality of images captured by the two-dimensional image sensor to form one combined image, and standard imaging mode And a mode selection unit for selecting any of the high-definition imaging mode, and according to the imaging mode selected by the mode selection unit,
An operation control unit that controls the focal length control unit, the direction control unit, the two-dimensional imaging device, and the image combining unit, and when the standard imaging mode is selected, the operation control unit Controlling the distance control means to set the focal length of the imaging optical system to the first focal length, capturing an image of the entire imaging range by the two-dimensional imaging element, and selecting the high-definition imaging mode The operation control unit controls the focal length control unit to set the focal length of the imaging optical system to a second focal length longer than the first focal length.
And the direction control means is controlled to sequentially move the direction of the optical axis of the imaging optical system so as to face the center of each of the plurality of divided areas to be imaged.
An image for each area is captured by a two-dimensional image sensor,
An imaging apparatus for combining a plurality of captured images by the image combining means to obtain a high-definition combined image of the entire imaging range. 2. In the high-definition imaging mode, a focal length of the imaging optical system is set to the first focal length, a reference image of the entire imaging range is captured, and image synthesis is performed with reference to the reference image. The imaging device according to claim 1, wherein the imaging is performed. 3. The image pickup optical system is selected from a bifocal lens and a zoom lens, and the second focal length is substantially an integral multiple of the first focal length. Item 3. The imaging device according to Item 1 or 2. 4. The image-capable area of the two-dimensional image sensor is:
4. The imaging apparatus according to claim 1, wherein in the high-definition imaging mode, an area of each image synthesized by the image synthesis unit is larger. 5. The apparatus according to claim 1, wherein the direction control unit is a driving mechanism that drives a housing of an imaging unit including the imaging optical system and the two-dimensional imaging device in a predetermined direction and a predetermined angle. 5. The imaging device according to any one of items 1 to 4. 6. The apparatus according to claim 1, wherein the direction control means is a movable mirror provided on an optical axis of the imaging unit and driven in a predetermined direction and in a predetermined direction. Imaging device.