JPH1141509A - Image pickup device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To form a composite image in an arbitrary range by compositing plural images by arbitrarily setting a range to pick up images through a picture formatting means and fetching the images while controlling the optical axis direction of an optical image pickup means. SOLUTION: A picture formatting part 67 sets the vertical and horizontal sizes of a picture to be displayed on a display part 75 so as to expand it in arbitrary magnification. According to the picture format set by the picture formatting part 67, the range to pick up images is set. An operation control part 64 operates the number of areas dividing the range to pick up images (the number of images to be fetched by a two-dimensional imaging device 12) and the central positions of the respective divided areas. Then, X and Y driving mechanisms 61 and 62 are controlled through a direction control part 63 so that the optical axis of an optical image pickup system 11 can be turned towards the centers of the respective divided areas. An image compositing part 74 composites the image data of respective areas fetched by and image fetching part 72 and forms high definition synthetic image data over all the range to pick up images.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an imaging apparatus for synthesizing a plurality of digital images to obtain a single high-definition image or wide image.

[0002]

2. Description of the Related Art Conventionally, there has been known an apparatus for synthesizing a plurality of images captured using a digital image capturing apparatus to obtain one high-definition image or a wide image. In a first conventional example shown in FIG. 12, a beam splitter 1 is provided between an imaging optical system 101 and two two-dimensional imaging elements 102a and 102b.
03, the light beam is split into two, and one two-dimensional image sensor 102a captures, for example, the right half of the image, and
The left half of the image is captured by the two-dimensional image sensor. Then, digital signals corresponding to the two images captured by the two two-dimensional image sensors 102a and 102b are processed to substantially
A composite image is formed.

In the second conventional example shown in FIG.
A two-dimensional imaging device 112 is connected to a so-called XY driving device 113.
And within the image circle of the imaging optical system 111
The two-dimensional image sensor 112 is moved, and the imaging range (subject)
100 different plural (for example, four) regions 100a
Images are captured for each of to 100d, and a digital signal corresponding to each image is processed to form one composite image.

[0004] In any of the conventional examples, when a subject is considered as a reference, a substantially constant range is imaged by a plurality of two-dimensional imaging elements, and the number of pixels of the two-dimensional imaging element is increased. It is equivalent and a high definition image is obtained. Meanwhile, 2
Considering the two-dimensional imaging device as a reference, images of subjects in different ranges are synthesized (combined), and the angle of view of the imaging optical systems 101 and 111 is substantially widened (the focal length is shortened). And a wide image is obtained.

[0005]

However, in the above-mentioned first and second conventional examples, both of the two-dimensional
The imaging optical system 1 having a large image circle as compared with the imageable area (area of the pixel portion) of the pixels 02a, 102b, and 112.
01 and 111 are required, and the imaging optical systems 101 and 111 themselves become large. Furthermore, a large dark box or lens barrel is required to house the beam splitter 103, the XY driving device 113, and the like. As a result, there is a problem that the entire image pickup apparatus becomes large.

Further, a wide image obtained by synthesizing images is also substantially limited to the image circle of the imaging optical systems 101 and 111. There was a problem that only an image could be obtained.

In the first and second conventional examples, even when a high-definition image is not required, image synthesis is always performed, which causes a problem that processing time and power for image synthesis are lost. Had.

Further, in the second conventional example, since a plurality of images are captured while moving the two-dimensional image sensor 112 using the XY drive mechanism 113, the position of each captured image (the position of the Whether the part is taken in) depends on the positioning accuracy of the XY driving device 113. Therefore, if the positioning accuracy of the XY driving device 113 is low, pixel data may be missing or duplicated at a portion where the image of each region is bonded, and the sharpness of the bonded portion of the combined image is poor. There was a problem that. In addition, if the imaging apparatus moves due to so-called “camera shake” while the two-dimensional imaging element 112 is moving, chipping or duplication of pixel data occurs in a wide range near a bonded portion of each image, so that images can be combined. However, there is a problem that the imaging fails as a result.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problem of the prior art. A plurality of images can be combined to form a combined image in an arbitrary range, and the image bonding accuracy is high. It is an object of the present invention to provide a small and lightweight imaging device capable of correcting "camera shake".

[0010]

In order to achieve the above object, an image pickup apparatus according to the present invention comprises: an image pickup optical system; a two-dimensional image pickup device provided near a focal plane of the image pickup optical system; Direction control means for controlling the direction of the axis, image synthesizing means for synthesizing a plurality of images captured by the two-dimensional image sensor to form a single composite image, and screen format setting means for setting an imaging range to be imaged Calculating the number of images captured by the two-dimensional imaging device and the direction of the optical axis of the imaging optical system when capturing images from the imaging range set by the screen format setting unit, and a direction control unit based on the calculation result; An operation control unit for controlling the two-dimensional image pickup device and the image synthesizing unit;

That is, the imaging apparatus of the present invention can arbitrarily set the imaging range by the screen format setting means, so that the direction of the optical axis of the imaging optical system is controlled based on the set screen format. By taking in the images by the two-dimensional image sensor and bonding the images by the image combining means, an image in an arbitrary range having an angle of view wider than the angle of view of the imaging optical system is formed. Therefore,
There is no limitation on the number of composite images as in the above-described conventional examples, and the range (angle of view) of the composite image can be freely set.
Further, the user only needs to set a desired screen format, and control of the direction of the optical axis of the imaging optical system, image synthesis, and the like are automatically performed.

It is preferable that the screen format setting means can be set so as to enlarge the vertical and horizontal directions of the screen to the same arbitrary magnification or different arbitrary magnifications respectively. For example, a so-called zooming effect can be obtained by enlarging the screen vertically and horizontally to the same arbitrary magnification. Further, for example, a so-called panoramic effect can be obtained by making the magnification in the horizontal direction larger than the magnification in the vertical direction.

The imageable area of the two-dimensional image sensor is
It is preferable that the area is larger than the area of each image synthesized by the image synthesis means. That is, by making the area of the pixel portion of the two-dimensional image sensor slightly larger than the area of each image to be stuck by the image synthesizing means, the position of the image to be stuck can be shifted. It is possible to adjust the error of the matching part. Also,
If the image capturing apparatus moves due to “camera shake” between capturing one image and capturing the next image, it is possible to substantially correct “camera shake” by shifting the position of the image to be pasted. It is possible.

The direction control means includes an image pickup optical system and
It is preferable that the driving mechanism is a driving mechanism that drives a housing of an imaging unit having a two-dimensional imaging device in a predetermined direction and a predetermined angle. Alternatively, the direction control means is preferably a movable mirror provided on the optical axis of the imaging unit and driven in a predetermined direction and in a predetermined direction. In any of these cases, the image circle of the imaging optical system only needs to cover at least the imageable area of the two-dimensional image sensor, and has an image circle larger than the imageable area of the two-dimensional image sensor as in the above-described conventional example. No imaging optical system is required. As a result, it is possible to reduce the size and weight of the entire imaging device.

[0015]

BEST MODE FOR CARRYING OUT THE INVENTION

(First Embodiment) A first embodiment of the imaging apparatus of the present invention will be described with reference to the drawings. FIG. 1 is a perspective view showing a configuration of a main part of the imaging apparatus according to the first embodiment, and FIG.
FIG. 3 is a cross-sectional view showing the configuration in the initial state, and FIG. 3 is a cross-sectional view showing the operation state.

As shown in FIG. 1 to FIG.
In the case of 0, at least a part of the outer surface 15 is a spherical surface. As shown in FIGS. 2 and 3, an imaging optical system 11 and a two-dimensional imaging device 1 such as a CCD are provided inside the imaging unit 10.
2. A lens driving mechanism 16 for controlling the focal length and the focal position of the imaging optical system 11 is provided. The imaging optical system 11 is a bifocal lens or a zoom lens, and the shortest focal length (so-called wide-angle end) is set as a first focal length,
The longest focal length (so-called telephoto end) is called a second focal length. For example, the second focal length is set to be approximately an integral multiple (for example, about twice) of the first focal length.

As shown in FIG. 2 and FIG.
And has a substantially spherical space 24 for accommodating the imaging unit 10. An opening 23 is formed on the front surface of the housing 20, and a portion of the imaging optical system 11 of the imaging unit 10 projects outside from the opening 23. A plurality of balls 26 are provided between the concave spherical surface of the space 24 and the convex spherical surface of the outer surface 15 of the imaging unit 10, and hold the imaging unit 10 so as to be able to rotate around an arbitrary axis passing through the center O of the sphere. doing. Here, the ball 26 forms a so-called ball bearing, and reduces the rotational load of the imaging unit 10.

As shown in FIG. 1, an X drive mechanism 61 and a Y drive mechanism 62 are provided at the top and side of the imaging unit 10, respectively. The X drive mechanism 61 and the Y drive mechanism 62 are respectively a motor 31 and an elastic roller 3 such as rubber.
2. The image pickup unit 10 is constituted by an encoder 33 and the like, and the elastic roller 32 rolls on the spherical portion of the outer surface 15 of the image pickup unit 10 to relatively rotate the image pickup unit 10 around the X axis and the Y axis. A detection signal from each encoder 33 is input to a control unit 60 provided inside the housing 20, and the rotation angles (rotation amounts) of the imaging unit 10 in the X-axis direction and the Y-axis direction are calculated. As a result, the imaging optical system The directions of the eleven optical axes are specified.

As shown in FIGS. 2 and 3, the housing 20 is provided with an angular velocity sensor 40 and a switch panel 50. The angular velocity sensor 40 detects the moving direction and the moving amount by the two-dimensional image pickup device 12 when the whole image pickup device moves due to, for example, “shake” between the time of taking a certain image and the time of taking the next image. I do. As will be described later, so-called “shake” can be corrected based on information on the moving direction and the moving amount of the imaging device. The switch panel 50 is provided with a switch (a mode selection unit 6 shown in FIG.
6) It functions as an input device (screen format setting unit 67 shown in FIG. 4) for setting an image format and the like. Note that, as shown in FIG. 4, a flash light emitting device 70 may be provided integrally with or separately from the imaging device.

FIG. 4 shows a block diagram of a main part including the control unit 60. X drive mechanism 61 and Y drive mechanism 6
Each of the motors 31 is driven by a predetermined number (or amount) of rotation in the forward or reverse direction according to a control signal from the direction control unit 63, and the number of rotations (or amount) of the motor or the like detected by each encoder 33 is This is fed back to the direction control unit 63. As a result, the imaging optical system 11 of the imaging unit 10
Is controlled so that the optical axis of the optical element faces a predetermined direction.

The focal length control unit 65 includes the image pickup unit 10
And a lens driving mechanism 16 for controlling the focal length and the focal position of the imaging optical system 11 provided in the camera. The focal length control unit 65 changes the focal length and the like of the imaging optical system 11 according to a control signal from the operation control unit 64, and also transmits the center-of-gravity position information and the focal length information of the imaging optical system 11 to the direction control unit 63 and the operation. Output to the control unit 64 and the like.

The switch panel 50 provided on the housing 20 of the imaging device functions as a mode selection unit 66, a screen format setting unit 67, and the like. The mode selection unit 66 selects one of two imaging modes, a standard imaging mode for imaging at a standard resolution and a high-definition imaging mode for imaging at a high resolution. Further, the screen format setting section 67 is for setting the height and width of the screen displayed on the display section 75 to be respectively enlarged to the same arbitrary magnification or to different arbitrary magnifications.

An angular velocity sensor 40 provided on the housing 20
Detected the acceleration and the like in the X-axis direction and the Y-axis direction of the image sensor (that is, the housing 20) between the time when a certain image was captured and the time when the next image was captured by the two-dimensional image sensor 12. The signal is output to the shake signal processing unit 41. The blur signal processing unit 41 calculates the amount of movement in the X-axis direction and the Y-axis direction based on the signal from the angular velocity sensor 40, stores the calculation result in the blur amount storage unit 42, and outputs the calculation result to the operation control unit 64. .

The operation control section 64 is a section for setting the imaging mode and screen format setting section 6 selected by the mode selection section 66.
The imaging range is set in accordance with the screen format set by step 7 and the focal length (angle of view) of the imaging optical system 11 is set.
(The two-dimensional image sensor 12)
And the center position of each divided area is calculated, and the X drive mechanism 61 and the Y drive mechanism 62 are controlled via the direction control unit 63. Further, when the imaging apparatus is moved due to “camera shake” or the like, the X drive mechanism 61 and the Y drive mechanism 62 are controlled based on the output signal from the shake signal processing unit 41 and the focal length information from the focal length control unit 65. Correct the drive amount.

The two-dimensional image pickup device 12 outputs an analog signal corresponding to the electric charge accumulated in each pixel to the image capturing unit 72 according to a clock signal or the like from the image capturing unit 72.
The image capturing unit 72 converts an analog signal captured from the two-dimensional image sensor 12 into a digital signal, and temporarily stores the digital signal in the image storage unit 73. The image synthesizing unit 74 includes the operation control unit 6
In accordance with the instruction from Step 4, a plurality of pieces of image data stored in the image storage unit 73 are combined to form one piece of composite image data. The formed composite image data is stored again in the image storage unit 73, and is again converted into an NTSC signal or the like and displayed on the display unit 75 such as a monitor display device. Further, the operation control unit 65 controls the flash control unit 71 as necessary, and causes the flash light emitting device 70 to emit light in synchronization with the image capturing by the two-dimensional image sensor 12.

[0026]

First Embodiment Next, a description will be given of a first embodiment of the operation of the imaging apparatus according to the first embodiment of the present invention. The first embodiment relates to switching between the standard imaging mode and the high-definition imaging mode by the mode selection unit 66. For the sake of simplicity, it is assumed that the screen is set to the standard size by the screen format setting unit 67.

When the standard imaging mode is selected by the mode selection unit 66, the operation control unit 64 controls the focal length control unit 65 to change the focal length of the imaging optical system 11 to an arbitrary focal length (the imaging optical system). When the system 11 is a zoom lens, the focal length is not limited to the first focal length and the second focal length), and the image in the imaging range is captured by one imaging operation of the two-dimensional imaging device 12.

On the other hand, when the high-definition imaging mode is selected, first, the operation control unit 64 controls the focal length control unit 65 to reduce the focal length of the imaging optical system 11 to the shorter first focal length. 5 and the image capturing unit 72 is controlled to
As shown in (a), the reference image 200 in the wide imaging range
Is captured by one imaging operation of the two-dimensional imaging element 12. Further, the image capturing section 72 converts the captured image data into A
/ D converted and stored in the image storage unit 73. Next, the operation control unit 64 controls the focal length control unit 65 to set the focal length of the imaging optical system 11 to the second focal length on the long side (the so-called telephoto side). Here, for example, when the second focal length is approximately twice the first focal length, as shown in FIG. 5B, the direction control unit 63 sets the imaging range to the first to fourth focal lengths.
And the optical axis of the imaging optical system 11 is sequentially shifted to the center 20 of each of the divided regions 201 to 204.
The drive amounts of the X drive mechanism 61 and the Y drive mechanism 62 are calculated so as to be directed to 1a to 204a. Further, the operation control unit 64 controls the image capturing unit 72, and interlocks with the driving of the imaging unit 10 by the direction control unit 63 so that the first area 20.
The images enlarged and formed on the image pickup surface of the two-dimensional image pickup device 12 are taken in order from 1. The image capturing unit 72 performs A / D conversion on the captured image data of the areas 201 to 204 and stores the data in the image storage unit 73.

The image synthesizing section 74 refers to the reference image 200 stored in the image storage section 73, and
To the fourth areas 201 to 204 to form high-definition combined image data of the entire imaging range. Further, the composite image data is stored in the image storage unit 73 and displayed on the display unit 75. The composite image displayed on the display unit 75 is substantially equivalent to an image captured by a two-dimensional image sensor having about four times the number of pixels of the two-dimensional image sensor 12, and a high-definition image is obtained.

The portions of the data of the reference image 200 corresponding to the images of the first to fourth regions 201 to 204 to be synthesized are substantially the same as the image data of the first to fourth regions 201 to 204, respectively. (For example, if attention is paid to the scanning line at the bonding portion, the light and dark have the same periodicity).
Accordingly, the data of the reference image 200 and the respective areas 201 to 20
By comparing the image data of Nos. 4 and 4, it is possible to find a portion having the same periodicity. As a result, the processing in the part where the images are bonded is facilitated.

The second focal length of the image pickup optical system 11 is made slightly shorter than an integral multiple of the first focal length in consideration of an error in a portion where images are bonded. Alternatively, the image-capturable area (the area of the pixel portion) of the two-dimensional image pickup device 12 is set to each image 2 combined by the image combining unit in the high-definition imaging mode.
The area should be wider than 01 to 204. In any case, for example, regarding the first region 201, the image actually obtained by the two-dimensional imaging device 12 is larger than the first region 201 as shown by the dashed line 12a in FIG. . As a result, the first to fourth regions 201 to 201
The capturing position of the image 204 can be shifted, and the error of the bonded portion can be adjusted. In addition, when the imaging apparatus moves due to “camera shake” or the like between the capture of a certain image and the capture of the next image by the two-dimensional image sensor 12, while referring to the reference image,
By shifting the image capturing positions of the first to fourth regions 201 to 204 to be pasted, it is possible to substantially correct "camera shake".

[0032]

Second Embodiment Next, a description will be given of a second embodiment of the operation of the imaging apparatus according to the first embodiment of the present invention. The second embodiment relates to an ultra-wide image that exceeds the first focal length on the wide-angle side of the imaging optical system 11 in the standard imaging mode among the settings of an arbitrary screen format by the screen format setting unit 67.

The focal length of the imaging optical system 11 is set to the first wide-angle side.
Let us consider a case where an ultra-wide image having an angle of view approximately twice as large as the angle of view obtained when the focal length is set is synthesized. The operation control unit 64 controls the focal length control unit 65 to set the focal length of the imaging optical system 11 to the shorter first focal length. In addition, the direction control unit 63 controls the imaging range 2 shown in FIG.
10 is divided into first to fourth regions 211 to 214, and each region 211 where the optical axis of the imaging optical system 11 is divided.
The X drive mechanism 61 is directed to the centers 211a to 214a of the first to fourth 214 and the center 215a of the fifth fifth region 215 at the center.
And the respective drive amounts of the Y drive mechanism 62 are calculated. Further, the operation control unit 64 controls the image capturing unit 72, and interlocks with the driving of the imaging unit 10 by the direction control unit 63, and in the order from the first area 211 to the fifth area 215, the two-dimensional imaging device The image formed on the imaging surface 12 is captured. The image capturing unit 72 performs A / D conversion on the captured image data of the areas 211 to 215 and stores the converted image data in the image storage unit 73.

The image synthesizing section 74 synthesizes image data of the first to fourth areas 211 to 214 using the image of the fifth area 215 located at the center of the imaging range 210 as a reference image, and The combined image data of the entire area 210 is formed. Further, the composite image data is stored in the image storage unit 73 and displayed on the display unit 75. The composite image displayed on the display unit 75 is obtained by the imaging optical system having an angle of view twice as large as the angle of view obtained when the first focal length of the imaging optical system 11 is set. It is equivalent and an ultra wide image is obtained.

In the second embodiment, the so-called zooming in which the vertical and horizontal directions of the screen are enlarged to the same magnification has been described. However, as shown in FIG. 7, for example, the horizontal magnification is larger than the vertical magnification. The same applies to the case where the magnification in the vertical direction is larger than the magnification in the horizontal direction as shown in FIG. In the case of a digital camera, it is difficult to change the vertical and horizontal positions of the camera, so the configuration shown in FIG.
This is effective when the imaging range (subject) is vertically long.

The pixel portion 12 of the two-dimensional image pickup device 12
The area of “a” is calculated for each image 2 synthesized by the image synthesis unit 74.
By making the area larger than 11 to 214,
The image capturing positions of the fourth regions 201 to 204 can be shifted, and the error of the bonded portion can be adjusted. In addition, when the imaging apparatus moves due to “camera shake” or the like, the image in the fifth area 215 is used as a reference image, and the capturing position of the image in the first to fourth areas 211 to 214 to be bonded is shifted. Thus, it is possible to substantially correct "camera shake".

[0037]

Third Embodiment Next, a description will be given of a third embodiment of the operation of the imaging apparatus according to the first embodiment of the present invention. The third embodiment relates to zooming and a wide image in the high-definition imaging mode among the settings of an arbitrary screen format by the screen format setting unit 67.

First, since the high-definition imaging mode is selected by the mode selection unit 66, the operation control unit 64 controls the focal length control unit to change the focal length of the imaging optical system 11 to the second focal length on the telephoto side. Set to a distance (in the case of a zoom lens, any focal length on the telephoto side may be used). Further, the direction control unit 63 divides the imaging range into a predetermined number based on the magnification in the vertical direction and the horizontal direction set by the screen format setting unit 67. For example, in the case shown in FIG. 9A, since the vertical and horizontal directions are set to about 1.7 times,
The direction control unit 63 sets the imaging range to the first to fourth regions 20.
Each of the regions 201 to 20 is divided into four regions
The X-scanning mechanism 61 and the Y-scanning mechanism Y are so arranged that the optical axis of the imaging optical system 11 is sequentially directed to the centers 201a to 204a of the divided regions 201 to 204 so that the images of the four images are partially overlapped. The scanning mechanism 62 is controlled. The procedure of image composition is the same as in the first embodiment. FIG.
As compared with the high-definition image (in the vertical direction and the horizontal direction, about twice as large) in the first embodiment shown in FIG.

On the other hand, in the case shown in FIG. 9B, the vertical direction is set to about 1.7 times, but the horizontal direction is set to about 2.7 times. Is divided into three regions in the horizontal direction and two regions in the vertical direction, for a total of six regions, and the images of the first to sixth regions 201 to 206 are synthesized while partially overlapping each other. Center 201a-206 of each area 201-206 where the optical axis of
The X scanning mechanism 61 and the Y scanning mechanism 62 are controlled so as to face a. The procedure of image composition is the same as in the first embodiment. In this case, a wide image is obtained in the high-definition imaging mode.

In the case shown in FIG. 9C, since the magnification is set to about 2.7 times in both the vertical and horizontal directions, the direction control unit 63 sets the imaging range in the horizontal direction by three columns in the vertical direction. Are divided into a total of nine areas in three stages, and the first to ninth areas 201 to 2
The X-scanning mechanism 61 and the Y-scanning so that the optical axes of the imaging optical system 11 face the centers 201a to 209a of the divided regions 201 to 209 so that the respective images 09 are partially overlapped and synthesized. The mechanism 62 is controlled. The procedure of image composition is the same as in the first embodiment. In this case, as compared with the high-definition image (approximately twice in both the vertical and horizontal directions) according to the first embodiment illustrated in FIG. 5B, zooming to the wide-angle side is performed in the high-definition imaging mode.

[0041]

Fourth Embodiment Next, a description will be given of a fourth embodiment of the operation of the imaging apparatus according to the first embodiment of the present invention. The fourth embodiment relates to “camera shake” correction using an output signal from the angular velocity sensor 40.

For example, as shown in FIG. 5B, consider a case where images of four areas are combined to form one combined image. In the case of a digital camera, the time required to capture an image of one area is about 30 msec. In general, it is considered that the flow of an image during capture of an image of one area (so-called “camera shake” in a still camera using a silver halide film) is small. If the imaging range (subject) is dark, the flash control unit 71 may be controlled to cause the flash light emitting device 70 to emit light. 2
The time required from capturing an image of a certain area by the two-dimensional image sensor 12 to driving the X drive mechanism 61 and the Y drive mechanism 62 to capture the image of the next area is 50 to 10 times.
If it is set to 0 msec, it takes 0.3 to 0.5 sec to capture all the images of the four regions. Here, when the imaging device is used by hand, “camera shake” (a concept similar to “camera shake” in a video camera) occurs during that time, and the positional relationship between the images in the four regions is shifted.

When the "camera shake" occurs, the angular velocity sensor 40 detects accelerations in the X-axis direction and the Y-axis direction. The amount is calculated, and signals corresponding to the direction and the amount of movement of “shake” are stored in the shake amount storage unit 42 and output to the operation control unit 64.

In FIG. 10, it is assumed that "camera shake" A occurs between the time when the image of the first area 201 is captured and the time when the image of the second area 202 is captured. If the X drive mechanism 61 and Y
When the driving mechanism 62 is driven, the optical axis of the imaging optical system 11 is shifted to the center 20 of the original second area 202 indicated by a dashed line in the figure.
2a, which has not moved to the area 2a and has moved as shown by the solid line in the figure.
02 'at the center 202a'. Therefore, the operation control unit 64 calculates a correction amount B in a direction opposite to the camera shake direction using a signal corresponding to the camera shake direction and the movement amount from the camera shake signal processing unit 41 and outputs the correction amount B to the direction control unit 63. . The direction control unit 63 drives the X drive mechanism 61 and the Y drive mechanism 62 using the drive amount corrected by the correction amount B.
As a result, the original second region 202 indicated by a dashed line in the drawing
Since the image in the same region as that of the image is captured by the two-dimensional image pickup device 12, the synthesized image has no apparent "camera shake".

As described in the first to third embodiments, each of the images 201, 202,...
If the area is wider than the area, a signal corresponding to the direction and amount of movement of the camera shake from the camera shake signal processing unit 41 is output to the image synthesis unit 7.
4 and the image capture position of the moved area 202 is shifted by the amount of movement in the direction opposite to the camera shake direction, whereby "camera shake" can be corrected.

In each of the above embodiments, the imaging optical system 11 has been described as a bifocal lens or a zoom lens capable of taking at least a first focal length and a second focal length. It goes without saying that the same effect can be obtained even with a single focus lens.

(Second Embodiment) A second embodiment of the imaging apparatus according to the present invention will be described with reference to FIG. FIG. 11 is a perspective view illustrating a configuration of a main part of an imaging device according to the second embodiment. In the first embodiment, the imaging optical system 11 and the two-dimensional imaging device 12 are provided inside the imaging unit 10, and the direction of the optical axis of the imaging optical system 11 is controlled by driving the entire imaging unit 10. In the second embodiment, the imaging optical system 11 and the two-dimensional imaging device 12 are fixed to an imaging device main body (not shown), and a mirror 60 having a gimbal structure provided on the optical axis of the imaging optical system 11 is driven by X driving. The mechanism 61 and the Y drive mechanism 62 are configured to be driven to rotate about the X axis and the Y axis. Therefore, in the second embodiment, although the mechanism for controlling the direction of the optical axis of the imaging optical system 11 is different, the control method is substantially the same as that in the first embodiment. Therefore, description of the control method in the second embodiment will be omitted.

[0048]

As described above, in the imaging apparatus according to the present invention, the imaging range to be imaged is set by the screen format setting means, and is taken in from the imaging range set by the screen format setting means by the two-dimensional imaging device. The number of images and the direction of the optical axis of the imaging optical system at the time of capturing the images are calculated, and the direction control unit, the two-dimensional imaging device, and the image synthesis unit are controlled based on the calculation results. The direction of the optical axis of the imaging optical system can be controlled based on an arbitrary range to be imaged, so that images can be captured by the two-dimensional imaging device and the images can be combined by the image combining unit. An image in an arbitrary range having an angle of view wider than the angle of view can be formed. Further, the user only needs to set a desired screen format, and can automatically control the direction of the optical axis of the imaging optical system and perform image synthesis.

Also, the screen format setting means
By making it possible to set the vertical and horizontal dimensions of the screen to the same arbitrary magnification or different arbitrary magnifications, for example, the vertical and horizontal dimensions of the screen are enlarged to the same arbitrary magnification, respectively, so-called zooming An effect or a so-called panoramic effect, for example, in which the horizontal magnification is larger than the vertical magnification, can be obtained.

Further, by making the imageable area of the two-dimensional image pickup device (the area of the pixel portion) larger than the area of each image synthesized by the image synthesizing means, the capturing position of each image can be shifted. In this way, it is possible to adjust the error of the bonded portion. For example, if the imaging device has moved due to `` shake '' between capturing a certain image and capturing the next image, by shifting the capturing position of the image to be pasted while referring to the reference image, Substantially, "camera shake" can be corrected.

As a direction control means, a drive mechanism for driving a housing of an image pickup unit having a built-in image pickup optical system and a two-dimensional image pickup device in a predetermined direction and at a predetermined angle, or provided on an optical axis of the image pickup unit, By using the movable mirror driven in the predetermined direction and the predetermined direction, the image circle of the imaging optical system can be made small enough to cover at least the imageable area of the two-dimensional image sensor,
The entire imaging device can be reduced in size and weight.

[Brief description of the drawings]

FIG. 1 is a perspective view illustrating a configuration of an imaging unit and a driving mechanism thereof in a first embodiment of an imaging device of the present invention.

FIG. 2 is a cross-sectional view showing an initial configuration of an imaging unit and its housing in the imaging apparatus according to the first embodiment of the present invention.

FIG. 3 is a cross-sectional view illustrating a configuration of the imaging unit and its housing in an operation state according to the first embodiment of the imaging apparatus of the present invention.

FIG. 4 is a block diagram illustrating a configuration of a control unit according to the first embodiment of the imaging apparatus of the present invention.

FIG. 5A is a diagram illustrating an image in a standard imaging mode in Example 1 of the first embodiment of the imaging apparatus of the present invention, and FIG. 5B is a diagram illustrating a composite image in the high-definition imaging mode. .

FIG. 6 is a diagram illustrating an example of a super wide image synthesizing method according to a second example of the first embodiment of the imaging apparatus of the present invention.

FIG. 7 is a diagram illustrating an example of a method for synthesizing a horizontally long image in Example 2 of the imaging apparatus according to the first embodiment of the present invention.

FIG. 8 is a diagram illustrating an example of a method of synthesizing a vertically long image in Example 2 of the imaging apparatus according to the first embodiment of the present invention.

9A is a diagram illustrating a telephoto-side zoom image in a high-definition imaging mode in Example 3 of the imaging apparatus according to the first embodiment of the present invention, and FIG. 9B is a horizontally long image in the high-definition imaging mode. FIG. 3C is a diagram illustrating a panoramic image, and FIG. 3C is a diagram illustrating a wide-angle zoom image in a high-definition imaging mode.

FIG. 10 is a diagram illustrating an example of a “camera shake” correction method in Example 4 of the first embodiment of the imaging apparatus of the present invention.

FIG. 11 is a perspective view illustrating a configuration of an imaging unit and a driving mechanism thereof in a second embodiment of the imaging apparatus of the present invention.

FIG. 12 is a diagram illustrating a configuration of a first conventional imaging apparatus.

FIG. 13 is a perspective view illustrating a configuration of a second conventional imaging apparatus.

[Explanation of symbols]

 Reference Signs List 10: imaging unit 11: imaging optical system 12: two-dimensional imaging device 20: housing 40: angular velocity sensor 41: blur signal processing unit 42: blur amount storage unit 50: switch panel 60: control unit 61: X drive mechanism 62: Y drive mechanism 63: direction control unit 64: operation control unit 65: focal length control unit 66: mode selection unit 67: screen format setting unit 70: flash light emitting device 71: flash control unit 72: image capture unit 73: image storage Unit 74: image combining unit 75: display unit 200: combined image 201: first region 202: second region 203: third region 204: fourth region

Claims (5)

[Claims] An imaging optical system, a two-dimensional imaging device provided near a focal plane of the imaging optical system, a direction control unit for controlling a direction of an optical axis of the imaging optical system, and the two-dimensional imaging device. Image synthesizing means for synthesizing a plurality of images captured by the above to form one composite image, a screen format setting means for setting an imaging range to be imaged, and an imaging range set by the screen format setting means. 2 above
The number of images captured by the two-dimensional imaging device and the direction of the optical axis of the imaging optical system when capturing the images are calculated, and the direction control unit, the two-dimensional imaging device, and the image combining unit are controlled based on the calculation result. An imaging device comprising an operation control unit. 2. The screen format setting means according to claim 1, wherein said screen format setting means can be set so as to magnify the screen vertically and horizontally to the same arbitrary magnification or to different arbitrary magnifications. Imaging device. 3. The image-capable area of the two-dimensional image sensor is:
The imaging apparatus according to claim 1, wherein an area of each image combined by the image combining unit is larger than an area of each image combined. 4. The apparatus according to claim 1, wherein the direction control unit is a driving mechanism that drives a housing of an imaging unit including the imaging optical system and the two-dimensional imaging device in a predetermined direction and at a predetermined angle. 4. The imaging device according to any one of claims 1 to 3. 5. The apparatus according to claim 1, wherein the direction control means is a movable mirror provided on an optical axis of the imaging unit and driven in a predetermined direction and in a predetermined direction. Imaging device.