JP5696192B1 - Imaging apparatus, imaging method, and program - Google Patents

Abstract

An imaging apparatus, an imaging method, and a program that can be reduced in price and that enable a photographer to acquire a photographed image having an arbitrary shift amount. An imaging method for generating a shift image, the method comprising: obtaining first image information at an alignment position where an optical axis of an optical system and an optical axis of an imaging unit coincide; and light of the optical system Acquiring the second image information at a non-aligned position where the axis and the optical axis of the imaging means do not match, the distortion amount acquired from the first image information and the second image information, A calculation process for calculating the relationship between the optical axis of the optical system and the shift amount of the optical axis of the imaging means, and a shift image from the first or second image information based on the relationship between the distortion amount and the shift amount. An image generation method comprising: an image generation step, and a program and an image pickup apparatus for executing the method. [Selection] Figure 1

Description

  The present invention relates to an imaging apparatus having a shift function, an imaging method having a shift function, and a program for realizing the shift function, and more specifically, in the case of imaging a subject that extends relatively in one direction, such as a building. The present invention relates to an imaging apparatus, an imaging method, and a program that can generate a shift image that can eliminate the influence of perspective on image information.

  Conventionally, in shooting with a camera, a video camera, etc., the optical axis of the optical system is shifted in the vertical direction with respect to the optical axis of the imaging means, which is the imaging plane, so that the distortion of the captured image of the subject is steep. A shift (or tilt) process for correction is performed.

  For example, Patent Document 1 discloses a shift lens system used for a so-called silver salt camera. The shift lens system includes a front lens group and a rear lens group, and corrects distortion by shifting the whole or a part of the rear lens group in a direction perpendicular to the optical axis.

  Japanese Patent Application Laid-Open No. 2004-228561 discloses an imaging unit that captures an image of a subject to obtain image data, a storage control unit that stores the image data obtained by the imaging unit in a predetermined form as an image data file, and a memory card. Reproduction control means for reproducing the image data stored in the image data, and image data processing means for synthesizing the image data from the imaging means and the image data from the reproduction control means to generate image data and store it in a memory card And display control means for displaying the image data from the imaging means on the LCD and simultaneously displaying the image data from the reproduction control means on the LCD or displaying the image data from the image data processing means on the LCD. A digital camera is disclosed. In this digital camera, when a panoramic image is generated from a plurality of the image data stored in the storage medium, a correction process is performed on the connected image data.

Japanese Patent Laid-Open No. 4-253041 JP 2001-309212 A

  As described above, in the diversion of the shift lens system having the shift function in the silver salt camera disclosed in Patent Document 1, it is difficult to meet the recent demand for cost reduction of the imaging device. Further, since Patent Document 2 is an imaging device that performs tilt correction only when a plurality of images are combined in a panoramic shape, it is difficult to meet the demand for a photographer to acquire a captured image with an arbitrary shift amount.

  The present invention has been made in view of such circumstances. That is, it is an object of the present invention to provide an imaging apparatus, an imaging method, and a program that can be reduced in price and that enable a photographer to acquire a captured image having an arbitrary shift amount.

  In order to solve the above-described problems and achieve the object, the first aspect of the imaging apparatus according to the present invention acquires an optical system having an optical axis and image information of a subject by incidence of a light beam from the optical system. The first image information acquired by the imaging unit, the optical axis of the optical system, and the optical axis of the imaging unit at an alignment position where the optical axis of the imaging unit and the optical axis of the optical system coincide with the optical axis of the imaging unit The relationship between the amount of distortion acquired from the second image information acquired by the imaging unit at the non-aligned position where does not match and the shift amount of the optical axis of the optical system and the optical axis of the imaging unit is calculated. Computation means, and image processing means for generating a shift image from the first or second image information based on the relationship between the distortion amount and the shift amount.

  According to the second aspect of the imaging apparatus of the present invention, at the non-alignment position, the optical axis of the optical system and the optical axis of the imaging means are the optical axis of the optical system or the light of the imaging means. It is displaced in the direction perpendicular to the axis.

  According to the third aspect of the imaging apparatus of the present invention, the image pickup apparatus includes a camera shake prevention function executed by relatively shifting the optical axis of the optical system and the optical axis of the imaging means, and the distortion amount The shift amount is acquired during execution of the camera shake function.

  Furthermore, in order to solve the above-described problems and achieve the object, the first aspect of the imaging method of the present invention is the first aspect in the alignment position where the optical axis of the optical system and the optical axis of the imaging means coincide. Obtaining image information; obtaining second image information at a non-aligned position where the optical axis of the optical system and the optical axis of the imaging means do not match; the first image information and the first 2 based on the relationship between the distortion amount acquired from the image information 2 and the shift amount of the optical axis of the optical system and the shift amount of the optical axis of the imaging means, and the relationship between the distortion amount and the shift amount. An image generation step of generating a shift image from the first or second image information.

  A first aspect of the program of the present invention is a program for causing a computer to execute the first aspect of the imaging method.

  According to the imaging apparatus, the imaging method, and the program according to the present invention, by calculating the relationship between the distortion amount and the shift amount based on the first image information and the second image information, an arbitrary shift amount can be obtained from the relationship. The image information can be generated at low cost.

It is a schematic cross section which shows the digital camera which concerns on embodiment along an optical axis, (a) shows the matching position where the optical axis of a 1st and 2nd lens group and the optical axis of an image pick-up element correspond, b) shows a non-alignment position where the optical axes of the first and second lens groups and the optical axis of the image sensor are shifted. It is a schematic diagram which shows typically LCD which displays a building, (a) is a state where a building does not fit in LCD, (b) is a state where the building is zoomed out and housed in LCD, (c) Is a state where a shift image is displayed. (A), (b) is a figure for demonstrating the calculation method for calculating the relationship between distortion amount and shift amount. It is a graph which shows the relationship between distortion amount and shift amount. It is a block diagram of a digital camera. It is a flowchart for producing | generating a shift image. (A), (b) is a figure for demonstrating the calculation method for calculating the relationship between distortion amount and shift amount.

  Hereinafter, an imaging apparatus, an imaging method, and a digital camera according to an embodiment to which a program according to the present invention is applied will be described with reference to the drawings. In addition, this invention is not limited by this embodiment.

  FIG. 1 is a schematic cross-sectional view showing the digital camera 1 according to the embodiment along the optical axes O and P. FIG. 1A shows the optical axes O of the first and second lens groups 3 and 5. FIG. 1B shows a non-alignment position where the first and second lens groups 3 and 5 and the optical axis P of the CCD 13 serving as the image sensor are shifted. FIG. 2 is a schematic diagram schematically showing the LCD 15 displaying the building B. FIG. 2A is a state where the building B does not fit in the LCD 15, and FIG. 2B is a zoomed out view. FIG. 2C shows a state where the building B is housed in the LCD 15 and a state where a shift image is displayed. FIGS. 3A and 3B are diagrams for explaining a calculation method for calculating the relationship between the distortion amount x and the shift amount S. FIG. 4 shows the distortion amount x and the shift amount S. 5 is a block diagram of the digital camera 1, and FIG. 6 is a flowchart for generating a shift image.

  The digital camera 1 with a camera shake function according to this embodiment includes light beams from the first and second lens groups 3 and 5, which are optical systems having an optical axis O, and the first and second lens groups 3 and 5. Is an alignment position where the optical axis O of the CCD 13, which is the imaging means for acquiring the image information of the subject, the first and second lens groups 3, 5 and the optical axis P of the CCD 13 coincide (FIG. )) And the non-alignment position (see FIG. 1A) where the optical axis O of the first and second lens groups 3 and 5 and the optical axis P of the CCD 13 do not coincide with each other. 1 and the second lens groups 3, 5 and the actuator 17 which is a driving means capable of relatively moving the CCD 13, and the first image information acquired by the CCD 13 at the alignment position and the non-alignment position (FIG. 1B ) Refer to the second image information acquired by the CCD 13 in FIG. The obtained distortion amount x (see FIG. 1A) and the shift amount S of the optical axis O of the first and second lens groups 3 and 5 and the optical axis P of the CCD 13 (see FIG. 1B). ) Is calculated based on the relationship between the distortion amount and the shift amount S. The calculation unit 115 (see FIG. 5) which is a calculation means for calculating the relationship between And an image processing unit 109 which is an image processing unit generated from the second image information. Various drive mechanisms such as piezoelectric elements can be used as the drive means.

As shown in FIG. 1, the digital camera 1 further includes, as additional constituent elements, an LCD 15 that is a liquid crystal screen, a control unit 101 (see FIG. 5), and an operator using the digital camera 1 inputs a command. Operating section 113 (see FIG. 5) and an external memory 111 (see FIG. 5). Further, as shown in FIG. 5, the control unit 101 includes a CPU (central processing unit) 103 that controls each component, and a RAM (Random) that stores acquired image information and the like.
(Access Memory) 105 and a ROM (Read Only Memory) 107 in which a program for operating the digital camera 1 is stored. Each component of the digital camera 1 is electrically connected through a bus.

  Further, the CPU 103 causes the optical axis P of the CCD 13 to deviate in a direction perpendicular to the optical axis O of the first and second lens groups 3 and 5 (vertical direction when the digital camera 1 is placed on a horizontal plane). , An actuator 17 that can move the CCD 13, an angular velocity sensor 51 for detecting camera shake of the digital camera 1, and the CCD 13 are electrically connected to each other, and a signal is transmitted between the CCD 13, the motor 17, the angular velocity sensor 51, and the CPU 103. Send and receive and be controlled.

  Note that the camera shake prevention function of the present embodiment measures the shake (movement) amount of the digital camera 1 itself by the angular velocity sensor 51 and drives the actuator 17 which is a drive means for moving the CCD 13 in the vertical direction based on the movement amount. This is a known method of moving the CCD 13 up and down and left and right so that light reaches a predetermined position. Of course, instead of moving the CCD 13 based on the amount of movement of the digital camera 1 acquired by the angular velocity sensor 51, the optical system (for example, the second lens group 5) is moved by the driving means, and light is emitted to a predetermined position of the CCD 13. It is also possible to apply a method for preventing camera shake.

  Next, a shift function by the digital camera 1 having the above configuration will be described. In the initial state, the optical axis O of the first and second lens groups 3 and 5 of the digital camera 1 and the optical axis P of the CCD 13 coincide with each other at an alignment position (see FIG. 1A). is there. An operator operates the shift function using the operation unit 113 of the digital camera 1.

  The photographer points the digital camera 1 toward the building B as a desired subject while watching the LCD 15 of the digital camera 1. It is identified whether or not the subject is within the LCD 15, that is, the area in the CCD 13 (step S 101 in FIG. 6). At this time, for example, as shown in FIG. 2A, when the entire building does not fit within the area of the LCD 15, the optical system (the first optical system is arranged on the wide-angle side of the zoom function mounted in advance in the digital camera 1. And the second lens group 3, 5) is operated by the operation unit 113 and adjusted so that the entire building B is accommodated in the LCD 15 (step S102 in FIG. 6). At this time, as shown in FIG. 2B, the left and right wall surfaces of the building B are displayed on the LCD 15 in a tapered state. Further, the image information at this time is stored in storage means such as the RAM 105 and the external memory 111 as first imaging information at an alignment position where the optical axis O and the optical axis P coincide (see FIG. 1A). (Step S103 in FIG. 6).

  Next, the drive signal from CPU103 is sent to the actuator 17, and the actuator 17 act | operates. The actuator 13 moves the CCD 13 so that the optical axis P of the CCD 13 is arranged at a non-alignment position shifted by a distance S1 in the vertical direction perpendicular to the optical axis O (see FIG. 1B). The image information at this time is displayed on the LCD 15 in a state where the left and right wall surfaces of the building B extend parallel to each other (substantially in the vertical direction) as shown in FIG. The second image information is stored in the storage means such as the memory 111 (step S104 in FIG. 6).

  Next, the calculation unit 115 uses the first image information at the alignment position (see FIG. 2B) and the second image information at the non-alignment position (see FIG. 2C). Based on this, the relationship between the distortion amount x and the shift amount S is calculated.

  The distortion amount x and the shift amount S are calculated as follows. This is the ratio of the length (number of pixels) of the upper side 33 to the length (number of pixels) of the bottom 31 of the building B based on the first image information shown in FIG. 3 (a) corresponding to FIG. 2 (b). The distortion amount b0 / a0 is acquired. On the other hand, based on the second image information (shifted image) shown in FIG. 3B corresponding to FIG. 2C, the length (pixels) of the upper side 37 with respect to the length (number of pixels) of the base 35 of the building B The distortion amount b1 / a1 that is the ratio of the number) is acquired.

  Here, x is a distortion amount indicating the ratio of the length (number of pixels) of the upper side 33 to the length (number of pixels) of the bottom 31 of the building B, and S is the optical system (first and second lenses). The distance (shift amount) between the optical axis 0 of the groups 3 and 5) and the optical axis P of the CCD 13 is defined. Then, the following equation 1 indicating the relationship between the distortion amount x and the shift amount S with respect to the upper side 33 is acquired (step S105 in FIG. 6). When Equation 1 is acquired, the photographer adjusts the shift amount S by the operation unit 113 while watching the LCD 15, adjusts the distortion amount x (that is, b / a) of the building B, and acquires an arbitrary shift image. it can.

  S = {1 / (b1 / a1-b0 / a0)}. {(S1-S0) x + (b1 / a1) .S0- (b0 / a0) .S1} (Formula 1)

  According to the above configuration, the distortion amount x is calculated from the first image information at the alignment position (T point in the graph in FIG. 4) and the second image information at the non-alignment position (point U in the graph in FIG. 4). The relationship of the shift amount S is calculated and acquired and stored in a storage means such as the RAM 105. In the above step S105, the relationship between the shift amount S related to the upper side 33 and the distortion amount x of the building B has been described. However, in this step, the width dimension of the building B is arranged below the pixel row constituting the upper side 33. Are also calculated and obtained for each of the pixel columns corresponding to. For example, it is assumed that the number of pixels that define the height dimension of the building B (height dimension) is h. In this case, there are h stages of pixel rows (including the pixel row constituting the upper side b) that define the length in the width direction (left-right direction in FIG. 2) constituting the building B. With respect to all the pixel columns in the h stage, a relational expression between the shift amount S of each pixel column and the distortion amount x of the building B is calculated and acquired.

  After that, when the operator acquires a shift image having an arbitrary distortion amount (for example, the point V in the graph of FIG. 4, the distortion amount b2 / a2, and the shift amount S2), an expression related to the pixel column for h stages. Based on 1 and the first and second image information, the h-stage image information generated by the image processing unit 109 can be displayed and viewed on the LCD 15 (step S106 in FIG. 6).

  In the above embodiment, it is identified whether or not the entire building B, which is the subject, falls within the imaging area of the CCD 13 (step S101), and if not, adjustment is made so as to fit (step S102). Needless to say, these steps are not essential steps when generating a shift image. This embodiment merely shows an example of generating a shift image of the building B.

(Modification 1)
In the above embodiment, the CCD 13 that is the image sensor is moved by the actuator 17. However, the digital camera according to Modification 1 fixes the CCD 13 and the optical system (the first lens group 3 or the second lens). The group 5) is moved. For example, it is possible to provide a shift function by moving the optical axis of the second lens group 5 serving as a correction optical system on a vertical line that is a perpendicular to the optical axis P of the CCD 13.

  In this configuration, the operator of the digital camera 1 uses the operation unit 113 to first match the optical axis O of the optical system (first and second lens groups 3 and 5) with the optical axis P of the CCD 13. In FIG. 1A, the first image information as shown in FIG. 2B is acquired and stored in the storage means such as the RAM 105. Then, at a non-alignment position (see FIG. 1B) in which the optical axis of the second lens group 5 is shifted in a direction perpendicular to the optical axis P of the CCD 13, a building B as shown in FIG. The second image information is acquired and stored in storage means such as the RAM 105. Thereafter, Equation 1 indicating the relationship between the distortion amount x and the shift amount S is acquired as in the above embodiment, and an arbitrary shift image is generated by the image processing unit 109 based on Equation 1 and displayed on the LCD 15.

  After that, as in the embodiment, while operating the operation unit 113, the shift image generated by the image processing unit 109 is displayed on the LCD 15, and the operation unit 113 is operated while watching the image, and the image of the desired building B is displayed. Information is acquired and stored in the external memory 111 or the like as necessary.

(Modification 2)
Modification 2 of the above embodiment is a configuration that realizes a shift function by using a camera shake function built in the digital camera 1 in advance. A camera shake image is a phenomenon in which a captured image flows even though a still subject is imaged by an operator moving the digital camera 1 while the shutter of the digital camera is open.

  In the camera shake prevention function, the movement (camera shake amount) of the digital camera 1 itself in the three-dimensional direction obtained by the angular velocity sensor 51 is detected as described above, and the optical axis O of the optical system and the optical axis of the CCD 13 according to the camera shake amount. R is moved relative to P.

  In the digital camera of the second modification, the operator substitutes the image information necessary for the shift function by the operation unit 113 with the image information acquired by the camera shake function. Specifically, the image information when the camera shake function is not activated is acquired as the first image information, the image information when the camera shake function is activated is acquired as the second image information. The shift amount information when the second image information is acquired is acquired. In the camera shake function, the calculation unit 115 calculates the shift amount of the CCD 13 based on the shake amount acquired by the angular velocity sensor 51.

  Note that the shift amount in the camera shake function is not necessarily the amount of movement in the direction perpendicular to the optical axis O. Therefore, when a shift image related to the vertical direction is acquired as in the embodiment, the vertical component of the shake amount, that is, the shift amount S is calculated based on the acquired shake amount, and the storage unit such as the RAM 105 is used. Stored in

  Further, similarly to the above-described embodiment, the distortion amount x, which is the ratio of the upper side b to the lower side a of the same building B, is calculated and stored in the storage means such as the RAM 105 in the same way as in the previous embodiment. Is done. Thereafter, the relational expression of Expression 1 is acquired from the first and second image information, the distortion amount x, and the shift amount S stored in the storage unit by the calculation unit. Therefore, the operator can acquire an arbitrary shift image while viewing the captured image generated by the image processing unit 109 and displayed on the LCD 15.

  As described above, the shift function can be realized by using the image information acquired by the built-in camera shake prevention function without newly incorporating a component for the shift function in the imaging apparatus. Therefore, the shift function can be provided to the imaging apparatus with a simpler configuration than in the embodiment and the first modification.

  In the configuration of the second modification, the shift amount S acquired in connection with the camera shake prevention function and the distortion amount x between the upper side and the bottom side of the building B are relatively small because they originate from camera shake. That is, it is assumed that the image information or the like used for the shift function in the camera shake prevention function does not include image information when the distortion amount x is 1 (no distortion).

  Even in this case, as described in connection with the above-described embodiment, the image information of the shift image can be calculated and acquired. That is, the value of the graph T in FIG. 4 is obtained from the first image information acquired at the alignment position, and the value of the V point in the graph in FIG. 4 is obtained from the second image information acquired at the non-alignment position. If so, the relationship of Equation 1 is calculated and acquired for each pixel row of h stages recognized as the building B. For example, the CPU 103 receives a command for acquiring image information (a state in which there is no distortion with a distortion amount of 1) at the point U from the operation unit 113. At that time, the calculation unit 115 calculates and obtains the distortion amount x related to the pixel columns (width dimensions) for each of the h stages from Equation 1 regarding the pixel columns for the h stages, and obtains the shift image (in this case, the upper side and the bottom side). Are generated on the LCD 15.

  Thus, as long as the first image information at the alignment position and the second image information at the non-alignment position can be acquired, the relationship represented by Equation 1 can be calculated and acquired. Can be generated by the image processing unit 109 and the image information can be displayed on the LCD 15 (step S106 in FIG. 6). Also in the embodiment, similarly, even if the amount of distortion of the shift image indicated by the second image information is smaller than 1 (that is, there is distortion), an arbitrary shift image can be acquired from Expression 1. Needless to say, you can.

  Note that the shift function of the second modification is realized by a configuration in which an actuator used for a camera shake function is used to move the image sensor or the optical system with respect to the optical axis. By the way, the shift amount used in the shift image tends to be larger than the shift amount according to the vertical component (or horizontal component) of the blur amount. For example, in the graph of FIG. 4, it is expected that the maximum value of the shift amount used in the shift image is the U point and the maximum value of the shift amount corresponding to the blur amount is the V point. In order to increase the accuracy of the shift image generated under such conditions, the drive range in which the optical system or the image sensor can be moved by the actuator constituting the camera shake function is driven by the actuator according to the shift amount according to the blur amount. It is preferable to set wider than the range (for example, so that the shift amount can reach the V point).

  In the above embodiment and the first and second modifications, the shift function for acquiring the shift image in the vertical direction is provided. However, the present invention is not limited to this configuration. For example, it is possible to acquire a shift amount in the horizontal direction and generate a shift image. FIGS. 7A and 7B are diagrams for explaining the calculation method for calculating the relationship between the distortion amount and the shift amount, corresponding to FIGS. 3A and 3B.

  With respect to the horizontal direction, the first image information (see FIG. 7A) at the alignment position where the optical axis of the optical system and the optical axis of the image sensor coincide with each other, and the second image information at the non-alignment position where both optical axes do not coincide. Image information (see FIG. 7B), the distortion amount (a0 / b0, a1 / b1) in the horizontal direction and the shift amount (distance between the optical axis O and the optical axis P in the horizontal direction). Get the relationship. This relational expression can be expressed by the same expression as Expression 1. The operator can generate a shift image having an arbitrary distortion amount. Furthermore, it goes without saying that the shift direction of the shift image is not limited to the vertical direction and the horizontal direction, and can be set in any direction.

  In the above-described embodiment and the first modification thereof, based on the two pieces of image information, Formula 1 indicating the relationship between the distortion amount and the shift amount is acquired, and a desired shift image is acquired from the relationship equation. The present invention is not limited to this configuration. That is, it goes without saying that a shifted image can be acquired without using the above-described relational expression within a range in which the imaging device or the correction optical system with respect to the optical axis 0 can be physically (mechanically) shifted. Therefore, a shift image can be acquired without using the above equation 1 within the movement range (that is, a shiftable range) of the image sensor or the correction optical system with respect to the optical axis O, and shift is performed in a region beyond the shiftable range. An image may be generated using Expression 1.

  Further, in Expression 1 of the present embodiment, the relationship between the distortion amount and the shift amount is represented by a straight line, but the relationship of the present invention is not limited to a straight line. Based on the type of subject, the composition of the subject, and the like, the shift amount is used to acquire the distortion amount and the shift amount, the information is accumulated, and an expression representing the relationship is derived from the accumulated information.

  In addition, in this embodiment and the modification 1, although the actuator 17 which is a drive means to move between an alignment position and a non-alignment position is provided, it is not an indispensable component requirement of this invention. That is, it is only necessary that the first image information at the alignment position and the second image information at the non-alignment position can be acquired for the same subject. For example, a first image sensor (or correction optical system) arranged at the alignment position and a second image sensor (or correction optical system) arranged at the non-alignment position are provided, and the former is applied to the same subject. First image information is acquired, and second image information is acquired from the latter. It is also possible to obtain a shift image by obtaining Equation 1 from these two pieces of image information. According to this configuration, since the actuator is not provided, the imaging apparatus can be simplified. As described above, the imaging apparatus can be configured to include a plurality of imaging elements (or correction optical systems).

  In the above embodiment and the first and second modifications, the shift function is incorporated in the compact digital camera. However, the present invention is not limited to this configuration. For example, it can be incorporated into a mirrorless single-lens camera, a camera-equipped mobile phone, a print sticker, an automatic ID photographic camera, a digital video camera, or used as a program for causing a computer to execute a shift function.

  In the above-described embodiment and its modifications 1 and 2, the relational expression between the distortion amount and the shift amount is acquired based on two pieces of image information. However, the relational expression between the distortion amount and the shift amount based on three or more pieces of image information. It is also possible to improve the generation accuracy of the shift image. Furthermore, the subject for which the shift image is created is not limited to the above-mentioned building, and it goes without saying that the subject can be applied to any subject in which distortion occurs, such as a person, a group photo of people, or a landscape.

1 Digital camera 3, 5 First and second lens group 13 CCD
15 LCD
17 Actuator 51 Angular velocity sensor 101 Control unit 103 CPU
105 RAM
109 Image processing unit 113 Operation unit 115 Calculation unit B Building S Shift amount x Distortion amount

Claims (5)

An optical system having an optical axis;
Imaging means for acquiring image information of a subject upon incidence of a light beam from the optical system;
The first image information acquired by the imaging unit and the optical axis of the optical system and the optical axis of the imaging unit do not match at an alignment position where the optical axis of the optical system and the optical axis of the imaging unit match. Arithmetic means for calculating the relationship between the distortion amount acquired from the second image information acquired by the imaging means at the non-alignment position and the shift amount of the optical axis of the optical system and the optical axis of the imaging means;
An image processing apparatus comprising: an image processing unit that generates a shift image from the first or second image information based on a relationship between the distortion amount and the shift amount.   The optical axis of the optical system and the optical axis of the imaging unit are shifted in a direction perpendicular to the optical axis of the optical system or the optical axis of the imaging unit at the non-alignment position. Item 2. The imaging device according to Item 1.   A camera shake prevention function that is executed by relatively shifting the optical axis of the optical system and the optical axis of the imaging means, and the distortion amount and the shift amount are acquired during execution of the camera shake function. The imaging apparatus according to claim 1 or 2, wherein An imaging method for generating a shift image,
Obtaining first image information at an alignment position where the optical axis of the optical system and the optical axis of the imaging means coincide;
Obtaining second image information at a non-alignment position where the optical axis of the optical system and the optical axis of the imaging means do not match;
A calculation step of calculating a relationship between the distortion amount acquired from the first image information and the second image information, and the shift amount of the optical axis of the optical system and the optical axis of the imaging unit;
An image generation method comprising: generating a shift image from the first or second image information based on a relationship between the distortion amount and the shift amount.   A program for causing a computer to execute the imaging method according to claim 4.

Images