JP2015032912A - Photographing apparatuses and photographing methods - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide photographing apparatuses and photographing methods that may reduce fixed pattern noise by performing dark current operation, in comparison to conventional methods of reducing fixed pattern noise.SOLUTION: A photographing apparatus includes: an image sensor; a photographing control unit that photographs a plurality of photographed images; a vibration reduction mechanism control unit that shifts a coordinate position of each of the photographed images in a photographing region, in which a subject image is formed, sequentially by a preset pixel count within a photographable region of the two-dimensional coordinate system of an image plane of the image sensor every time the photographing control unit photographs a photographed image; a coordinate transformation unit that performs coordinate transformation in the two-dimensional coordinate system of the photographed images such that coordinate positions of a plurality of photographed images match a coordinate position of any photographed image; and an image combining unit that combines a plurality of coordinate-transformed photographed images by superimposition.

Description

  The present invention relates to an imaging apparatus and a method thereof.

An imaging apparatus such as a digital camera or a video camera forms a subject image on an imaging element such as an image sensor through a lens that performs imaging and an optical system having a camera shake correction mechanism to obtain captured image data of the subject.
The above-described camera shake correction mechanism is provided to prevent image blur due to camera shake in a digital camera or the like. For example, when a change in posture of the digital camera is detected by a sensor such as a gyro sensor, the position of the dedicated correction optical system or the image sensor is relatively changed so as to cancel image blur due to camera shake.

Further, in the image pickup device, a noise signal called dark current (dark current) is generated due to temperature even in a light-shielded state. As a result, there is a problem in that fixed pattern noise due to dark current is superimposed on the captured image data read from the effective pixel area of the image sensor, and the black level increases.
In this case, the accuracy of color reproduction of the subject image in the captured image data is lowered. For this reason, the captured image data of the image sensor in a state where light is not irradiated (dark state) is subtracted from the captured image data to suppress fixed pattern noise (see, for example, Patent Document 1).

Japanese Patent Laid-Open No. 06-133185

  However, when performing the A / D conversion of the captured image data obtained by capturing the subject image and the captured image data captured in the dark state when performing the subtraction of the dark current, the dark current components in both are obtained during the quantization process. There will be an error in the energy. For this reason, even if dark current subtraction is performed, sufficient fixed pattern noise cannot be removed from the captured image data, and fixed pattern noise may remain in the captured image data obtained by capturing the subject image.

When dark current subtraction processing is performed, the following results are obtained. The signal intensity of the captured image is I, the variation in dark current is σd, and the variation after dark current subtraction processing is σd ′.
(Σd ′) ² = σd ² + σd ²
σd ′ = 2 ^1/2 σd
S / N ′ = I (2 ^1/2 σd)
As described above, when the dark current subtraction process is performed, the energy of the fixed pattern noise of the captured image decreases, but the deviation increases.

  The present invention has been made in view of such circumstances, and further reduces the fixed pattern noise in the captured image as compared to the conventional case in which the fixed pattern noise is reduced in the captured image by performing a dark current calculation. An object of the present invention is to provide an imaging apparatus and an imaging method capable of performing the above.

  The imaging apparatus of the present invention includes an imaging element, an imaging control unit that captures a plurality of captured images, and an imaging region of a subject image that is formed each time the imaging control unit captures the captured image. An image stabilization mechanism control unit that sequentially shifts the coordinate position of the captured image by a preset number of pixels within a two-dimensional coordinate system imageable area of the imaging surface of the image sensor, and coordinate positions of the plurality of captured images An image that is synthesized by superimposing the coordinate conversion unit that performs coordinate conversion of the captured image in the two-dimensional coordinate system so as to match the coordinate position of any captured image and the plurality of captured images that have undergone coordinate conversion And a combining unit.

  The imaging apparatus according to the present invention further includes a dark current calculation unit that performs dark current subtraction on each of the captured images.

  In the imaging device of the present invention, the image stabilization mechanism control unit moves an image stabilization lens interposed between the imaging lens that forms the subject image on the image sensor and the image sensor, and the image sensor The position where the subject image is formed on the imaging surface is shifted.

  The image pickup apparatus according to the present invention is characterized in that the image stabilization mechanism control unit moves the image pickup element and shifts a position where the subject image is formed on the image pickup surface of the image pickup element.

  The imaging method of the present invention includes an imaging control process of imaging a plurality of captured images by an imaging element, and an imaging area of a subject image that is formed each time the captured image is captured in the imaging control process. An image stabilization mechanism control process for sequentially shifting the coordinate position of the captured image by a preset number of pixels within the imageable area of the imaging surface of the image sensor on the two-dimensional coordinate system, and coordinate positions of the plurality of captured images. An image that is synthesized by superimposing a coordinate conversion process for performing coordinate conversion of the captured image in the two-dimensional coordinate system so as to match the coordinate position of any captured image and the plurality of captured images that have undergone coordinate conversion And a synthesis process.

  According to the present invention, the fixed pattern noise can be reduced as random noise, the S / N ratio in the combined captured image can be improved, and the fixed pattern noise can be further reduced as compared with the conventional example. It becomes possible.

A first embodiment of the present invention will be described. FIG. 1 is a schematic block diagram illustrating a configuration example of an imaging apparatus according to the first embodiment of the present invention. 6 is a diagram illustrating the position of a captured image moved by an image stabilization mechanism control unit 112 on the imaging surface of the imaging element 104. FIG. It is a figure which shows the captured image in the imaging data written and memorize | stored in the memory | storage part. It is a figure which shows the state of fixed pattern noise when the image synthetic | combination part 115 synthesize | combined each captured image of the imaging range 300 to the imaging range 305. FIG. It is a flowchart which shows the operation example of imaging including the fixed pattern noise reduction by the imaging device 100 by this embodiment. It is a schematic block diagram which shows the structural example of the imaging device by the 2nd Embodiment of this invention. It is a flowchart which shows the operation example of imaging including fixed pattern noise reduction by the imaging device 100A by this embodiment.

<First Embodiment>
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a schematic block diagram illustrating a configuration example of an imaging apparatus according to the first embodiment of the present invention. In FIG. 1, the imaging apparatus 100 according to the present embodiment includes an imaging lens 101, an image stabilization mechanism 102, an image stabilization lens 103, an image sensor 104, a shutter mechanism 105, a viewfinder 106, and an image processing unit 110. The imaging processing unit 110 includes an imaging parameter setting unit 111, an image stabilization mechanism 112, an imaging control unit 113, a coordinate conversion unit 114, an image composition unit 115, and a storage unit 116.

In the present embodiment, a fixed pattern noise is suppressed as random noise by using a vibration isolation mechanism that prevents camera shake of a captured image provided in an imaging apparatus such as a digital camera. Here, the present embodiment uses composite processing in which a plurality of photographs (captured images) are combined to generate a final captured image. Here, each of the captured images to be combined is captured by shifting the position where the subject image is formed on the imaging surface of the image sensor 104 by a predetermined number of pixels. Then, coordinate conversion is performed on each pixel of the captured image captured by shifting, and the fixed pattern noise is suppressed as random noise by superimposing the pixels in a state where the position of the fixed pattern noise is shifted in each captured image.
In the present embodiment, the user can arbitrarily switch the mode between prevention of normal camera shake and suppression of fixed pattern noise by an input unit (not shown).

The imaging lens 101 forms a subject image on the imaging surface (two-dimensional coordinate system: imaging plane) of the imaging element 104.
The image stabilization mechanism 102 drives the image stabilization lens 103 on a two-dimensional plane parallel to the imaging surface, and moves the image of the subject image to a predetermined position on the imaging surface of the image sensor 104.
The shooting parameter setting unit 111 sets parameters used when shooting an object such as exposure setting and F-number setting of the imaging lens 101 by user input.

  The imaging device 104 is configured by an image sensor such as a CCD (Charge Coupled Device) or a MOS (Metal Oxide Semiconductor), and outputs a subject image formed on the imaging surface to the imaging control unit 113 as a captured image. Since the imaging position of the subject is moved by the image stabilization mechanism on the imaging surface of the imaging element 104, an area larger than the size of the actual captured image is configured as an imageable area for generating a captured image. The imaging element 104 outputs imaging data of the entire imageable area including the captured image to the imaging control unit 113.

The shutter mechanism 105 transmits a shutter signal to the image sensor 106 when the user presses the shutter.
The viewfinder 106 displays a subject image formed on the imaging surface of the image sensor 106.
When a shutter signal is supplied from the shutter mechanism 105, the imaging control unit 113 reads a plurality of imaging data from the imaging element 104 in time series. In addition, when reading each of a plurality of pieces of imaging data at the time of imaging, the imaging control unit 113 outputs an image stabilization control signal to the image stabilization mechanism control unit 113 at each reading timing.
When the image stabilization control signal is supplied from the image capturing control unit 113, the image stabilization mechanism control unit 112 shifts the position of the captured image on the image capturing surface of the image sensor 104 by a preset pixel value. A drive signal is output to.

  FIG. 2 is a diagram illustrating the position of the captured image moved by the image stabilization mechanism control unit 112 on the imaging surface of the image sensor 104. In FIG. 2, NO indicates the position of fixed pattern noise. In addition, on the imaging surface 1041 of the imaging element 104, an imageable area 1042 for acquiring imaging data is set. In FIG. 2, the imaging control unit 113 reads, for example, six times of imaging data in one imaging process. The imaging range 300 indicates the position in the imageable area of the captured image in the imaging data read for the first time. Similarly, each of the imaging range 301 to the imaging range 305 indicates the position in the imageable area of the captured image in the imaging data read at the second time, the third time, the fourth time, and the fifth time. Here, when performing composite processing, the imaging control unit 113 divides the exposure time in the normal imaging mode that is not composite processing by the number of captured images to be combined, and the division result is used as the exposure time for each of the plurality of captured images. Then, a plurality of captured images are sequentially captured. Therefore, the total value of the exposure times in the plurality of images subjected to the composite process is the same as the exposure time in one image capturing in the normal image capturing mode.

  The coordinate position Z1 of the reference point P1 is (X0 + ΔX1, Y0 + ΔY1) shifted by ΔX1 in the x-axis direction and ΔY1 in the y-axis direction with respect to the coordinate position Z0 (X0, Y0) of the reference point P0. Similarly, the coordinate position Z2 of the reference point P2 is (X0 + ΔX2, Y0 + ΔY2) shifted by ΔX2 in the x-axis direction and ΔY2 in the y-axis direction with respect to the coordinate position Z0 (X0, Y0) of the reference point P0. The coordinate position Z3 of the reference point P3 is (X0 + ΔX3, Y0 + ΔY3) shifted by ΔX3 in the x-axis direction and ΔY3 in the y-axis direction with respect to the coordinate position Z0 (X0, Y0) of the reference point P0. The coordinate position Z4 of the reference point P4 is (X0 + ΔX4, Y0 + ΔY4) shifted from the coordinate position Z0 (X0, Y0) of the reference point P0 by ΔX4 in the x-axis direction and ΔY4 in the y-axis direction. The coordinate position Z5 of the reference point P5 is (X0 + ΔX5, Y0 + ΔY5) shifted by ΔX5 in the x-axis direction and ΔY5 in the y-axis direction with respect to the coordinate position Z0 (X0, Y0) of the reference point P0.

  ΔX1 to ΔX5 and ΔY1 to ΔY5 as the number of pixels to be shifted are previously written and stored in the storage unit 115. Each time the image stabilization control signal is supplied from the image capturing control unit 113, the image stabilization mechanism control unit 112 sequentially reads out the number of pixels to be shifted set in the storage unit 116, and the captured image is captured on the image capturing surface of the image sensor 104. The anti-vibration lens 103 is moved by the anti-vibration mechanism 102 to a position where the (region on which the subject image is formed) is shifted by the number of pixels.

  Similarly, each of the imaging range 301 to the imaging range 305 indicates the position of the captured image in the image data read from the second time to the sixth time. In FIG. 2, the imaging range 300 is arranged at the center of the imageable area. Each of the imaging range 300 to the imaging range 305 is provided with a reference point P0 to a reference point P5 for alignment described later. The plurality of pieces of image data are sequentially written into the storage unit 116 by the imaging control unit 113.

  FIG. 3 is a diagram illustrating a captured image in the captured data that is written and stored in the storage unit 116. FIG. 3A shows a captured image of the imaging range 300 in the imaging data of the imageable area 1042. FIG. 3B shows a captured image of the imaging range 301 in the imaging data of the imageable area 1042. FIG. 3C shows a captured image of the imaging range 302 in the imaging data of the imageable area 1042. FIG. 3D shows a captured image of the imaging range 303 in the imaging data of the imageable area 1042. FIG. 3E shows a captured image of the imaging range 304 in the imaging data of the imageable area 1042. FIG. 3F shows a captured image in the imaging range 305 in the imaging data of the imageable area 1042.

  As can be seen from FIG. 3A to FIG. 3F, the position of the fixed pattern noise in each captured image is shifted. The fixed pattern noise in the captured image in FIG. 3A is denoted by NO_0, the fixed pattern noise in the captured image in FIG. 3B is denoted by NO_1, and the fixed pattern noise in the captured image in FIG. 3C is denoted by NO_2. The fixed pattern noise in the captured image in FIG. 3D is denoted by NO_3, the fixed pattern noise in the captured image in FIG. 3E is denoted by NO_4, and the fixed pattern noise in the captured image in FIG. Show.

  Returning to FIG. 1, the coordinate conversion unit 114 adjusts each pixel of the imaging range 300 in the storage unit 116 so that the coordinate positions of the other reference points P1 to P5 match the coordinate position of the reference point P0. The number of pixels shifted from the coordinate value is subtracted, and the corresponding pixels in each of the imaging ranges 301 to 305 are set to the same coordinate value with respect to the coordinate value of each pixel in the imaging range 300. Accordingly, the coordinate conversion unit 114 has the same coordinate value from the reference point P1 to the reference point P5 of the other imaging range 301 to the imaging range 305 with respect to the reference point P0 of the imaging range 300.

  The image synthesis unit 115 synthesizes the captured images from the imaging range 300 to the imaging range 305 so that all of the reference points P0 to P5 overlap. Here, the image composition unit 115 adds image data (for example, gradation) of pixels at the same coordinate position in each of the imaging range 300 to the imaging range 305. The image synthesis unit 115 writes the image data of the addition result as image data of each pixel of the synthesized captured image obtained by synthesizing the captured image, and stores it in the external storage unit 200.

  FIG. 4 is a diagram illustrating a state of fixed pattern noise when the image synthesis unit 115 synthesizes the captured images of the imaging range 300 to the imaging range 305. In the composite captured image shown in FIG. 4, the pixel whose fixed pattern noise is shifted moves to a position shifted relative to the position in the captured image of the imaging range 300. Thereby, when a plurality of captured images are combined, the energy of the gradation of the fixed pattern noise is reduced, and the S / N ratio of the captured image is improved.

That is, when N (for example, 6) captured images in FIG. 3 are superimposed and combined, the S / N ′ ratio of the combined captured image of the N captured images is one noise as follows as random noise. It is calculated from the S / N ratio of the captured image. In the following equation, the signal intensity per captured image (for example, the gradation of each pixel) is I, the signal intensity obtained by combining N captured images is I ′, and the noise intensity per captured image is α and the intensity of N synthesized noises is α ′.
I '= NI
(Α ′) ² = Nα ²
S / N ′ = I ′ / α ′ = N ^1/2 S / N

Next, the imaging operation including the fixed pattern noise reduction of the imaging apparatus 100 according to the present embodiment will be described with reference to the drawings. FIG. 5 is a flowchart illustrating an example of an imaging operation including fixed pattern noise reduction by the imaging apparatus 100 according to the present embodiment.
In the following description, reduction of fixed pattern noise by combining N captured images, for example, six captured images will be described.

Step S1:
The shooting parameter setting unit 111 sets the parameters of each shooting when performing composite shooting that combines a plurality of photos as parameters input by the user when the imaging device is turned on and power is supplied. To do. For example, the shutter opening time for obtaining the necessary exposure is set to 1 / N (the number of shots). Also, the setting of the number of pixels to be shifted for N sets, that is, the imaging parameter setting unit 111 writes and stores the number of pixels to be shifted in correspondence with the storage unit 116 in order. This parameter is read from the storage unit 116 by the imaging control unit 113 and the image stabilization mechanism control unit 112 at the time of shooting, and controls imaging.
In addition, each of the image stabilization mechanism control unit 112 and the imaging control unit 113 resets an internal counter to zero.

Step S2:
The imaging control unit 113 causes the viewfinder 106 to display a captured image of the subject image formed on the imaging surface of the imaging element 104.
The imaging control unit 113 determines whether or not a shutter signal is supplied from the shutter mechanism 105 at regular intervals. At this time, when the shutter signal is supplied, the imaging control unit 113 proceeds the process to step S3, and when the shutter signal is not supplied, the imaging control unit 113 returns the process to step S2.

Step S3:
When the shutter signal is detected, the imaging control unit 113 outputs an image stabilization control signal to the image stabilization mechanism control unit 112.
When the image stabilization control signal is supplied from the imaging control unit 113, the image stabilization mechanism control unit 112 reads the number of shifted pixels corresponding to the count number of the internal counter from the storage unit 116. For example, if the count number is 0, the captured image is in the imaging range 300, so there is no need to shift the number, and the number of shifted pixels is 0. On the other hand, if the count number is 1, the number of pixels to be shifted is (ΔY1, ΔX1) because the captured image to be captured is an imaging warp 301. Further, when the count advances and the count number is 5, the number of shifted pixels is (ΔY5, ΔX5) because the captured image to be captured is the imaging range 305.

The anti-vibration mechanism control unit 112 controls the anti-vibration mechanism 102 to shift the number of pixels read out according to the count number, the imaging position of the subject image, that is, the imaging range within the imageable range 1042, and The vibration lens 103 is moved.
Further, the image stabilization mechanism control unit 112 transmits an end signal to the image capturing control unit 113 when the image stabilization mechanism 102 moves the image stabilization lens 103.

Step S4:
When the end signal is supplied, the imaging control unit 113 reads imaging data from the imaging element 104, performs imaging processing of one imaging data among a plurality of images used for composition, and advances the processing to step S5.

Step S5:
Next, the imaging control unit 113 adds identification information for identifying the imaging data, for example, a number indicating the order of imaging, to the imaging data read from the imaging element 104.
Then, the imaging control unit 113 writes and stores the imaging data to which the identification information is added in the storage unit 116, transmits an imaging end signal to the image stabilization mechanism control unit 112, and advances the processing to step S6. .

Step S6:
Next, when the imaging end signal is supplied, the image stabilization mechanism control unit 112 increments the internal counter (increases it by one) and advances the process to step S7.
At this time, the imaging control unit 113 increments an internal counter.

Step S7:
The imaging control unit 113 determines whether or not the internal counter is N (= 6). At this time, if the count value of the internal counter becomes N, the imaging control unit 113 advances the process to step S9. If the count value of the internal counter is less than N, the imaging control unit 113 advances the process to step S8.

Step S8:
The anti-vibration mechanism control unit 113 controls the anti-vibration mechanism 102 after the counting of the internal counter is completed, returns to the reference position before the movement, and advances the process to step S3.

Step S9:
The coordinate conversion unit 114 converts the coordinate position of each pixel in the imaging range 301 to the imaging range 305 to the coordinate position of the corresponding pixel in the imaging range 300 in the subject image.
That is, the coordinate conversion unit 114 reads the imaging data in numerical order from the storage unit 116, and shifts the imaging position of the subject image at the time of each imaging from the coordinate positions of all the pixels in the imaging range 301 to the imaging range 305. The number of pixels is subtracted, and coordinate conversion is performed so as to be the same as the coordinate position of the pixel in the imaging range 300 (including the reference point P0). For example, in the case of the imaging range 301, the number of pixels to be subtracted is ΔX1 in the X-axis direction and ΔY1 in the Y-axis direction. Thereby, the coordinate position Z1 (X0 + ΔX1, Y0 + ΔY1) of the reference point P1 in the imaging range 301 becomes the coordinate position Z1 (X0, Y0), which is the same as the coordinate position Z0 (X0, Y0) of the reference point P0. As a result, the coordinate position of each pixel in the imaging range 301 is also subjected to coordinate conversion relative to the reference point P1, so that the same coordinate value as the coordinate position of each pixel in the imaging range 300 corresponding to the reference point P0 is obtained. Become.

Step S10:
The image composition unit 115 adds the image data of the pixels at the same coordinate position as the imaging range 300 in each of the imaging range 301 to the imaging range 305 to the image data of each pixel in the imaging range 300 after imaging. The images in the range 300 to the imaging range 305 are combined.

Step S11:
The image composition unit 115 writes and stores the captured image obtained by combining the images in the imaging range 305 from the imaging range 300 in the external storage unit 200 as a composite captured image.
Then, the image composition unit 115 proceeds with the process to step S2.

  As described above, according to the present embodiment, the fixed pattern noise can be random noise, the fixed pattern noise can be sufficiently reduced as compared with the conventional case, and the S / N ratio of the captured image can be reduced. Can be improved.

<Second Embodiment>
The second embodiment of the present invention will be described below with reference to the drawings. FIG. 6 is a schematic block diagram illustrating a configuration example of an imaging apparatus according to the second embodiment of the present invention. In FIG. 6, the same components as those of the imaging apparatus 100 according to the present embodiment shown in FIG. The imaging apparatus 100A includes an imaging lens 101, an image stabilization mechanism 102, an image stabilization lens 103, an image sensor 104, a shutter mechanism 105, a viewfinder 106, and an image processing unit 110. The imaging processing unit 110A includes an imaging parameter setting unit 111, an image stabilization mechanism 112, an imaging control unit 113, a coordinate conversion unit 114, an image synthesis unit 115, a storage unit 116, and a dark current subtraction unit 17. The second embodiment is different from the first embodiment in that a dark current subtracting unit 17 is added. Only the different points will be described below.

The dark current subtracting unit 17 forms an image of each pixel of the imaging data obtained by imaging the image data of each pixel of the imaging data when the imaging surface of the imaging element 104 is dark and the subject image on the imaging surface of the imaging element 104. Performs dark current subtraction processing to subtract from data.
Thereby, the dark current subtraction unit 17 reduces the energy of the fixed pattern noise NO_0 to the fixed pattern noise NO_5 in each of the imaging range 300 to the imaging range 305.
Then, as in the first embodiment, the image synthesis unit 115 synthesizes each image in the imaging range 305 from the imaging range 300 having the reduced fixed pattern noise.

Next, FIG. 7 is a flowchart illustrating an example of an imaging operation including fixed pattern noise reduction by the imaging apparatus 100A according to the present embodiment. In the flowchart of FIG. 7, step S4A performed by the dark current subtraction unit 117 described above is inserted between step S4 and step F5.
In step S4A, the following processing is performed. After the imaging is performed, the imaging control unit 113 reads dark state imaging data from the imaging element 104 when the imaging surface of the imaging element 104 is in a dark state.

Next, the dark current subtraction unit 117 subtracts the image data of each pixel of the dark state imaging data for each corresponding pixel from the image data of each pixel of the imaging data, and performs dark current subtraction processing. Then, the dark current subtraction unit 117 outputs imaging data obtained by performing dark current subtraction to the imaging control unit 113.
When the imaging data is supplied in step S5, the imaging control unit 113 adds the identification information to the imaging data and writes and stores it in the storage unit 116, as described above. The image is transmitted to the image stabilization mechanism control unit 112, and the process proceeds to step S6.

  Thus, in the present embodiment, after performing dark current subtraction, the fixed pattern noise is reduced by the process of making the fixed pattern noise random noise. Therefore, the fixed pattern is more fixed than in the first embodiment. Noise energy can be reduced.

In the first and second embodiments, the image stabilization mechanism 102 is moved by the image stabilization lens 103, but a configuration in which the image stabilization process is not performed by the image stabilization lens 103 may be used. Good. For example, the imaging device 104 may be configured to have an image stabilization device that operates in the X-axis and Y-axis directions on an XY plane parallel to the imaging surface of the imaging device 104.
That is, the imaging device is configured so that the pixel for shifting the imaging element 104 is moved in a plane, and the imaging range of the captured image on which the subject image is formed (the area to be the captured image) is moved within the range of the imageable area. May be. The processes already described in the first and second embodiments are the same for processes such as coordinate conversion of other imaging ranges and synthesis of captured images.

  Also, a program for realizing the fixed pattern noise removal function of each of the imaging apparatus 100 in FIG. 1 and the imaging apparatus 100A in FIG. 6 is recorded on a computer-readable recording medium and recorded on this recording medium. The program may be read into a computer system and executed to control the fixed pattern noise as random noise to reduce the energy of the fixed pattern noise. Here, the “computer system” includes an OS and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes design and the like within a scope not departing from the gist of the present invention.

DESCRIPTION OF SYMBOLS 100,100A ... Imaging device 101 ... Imaging lens 102 ... Anti-vibration mechanism 103 ... Anti-vibration lens 104 ... Imaging element 105 ... Shutter mechanism 106 ... Viewfinder 110, 110A ... Imaging process part 111 ... Imaging parameter setting part 112 ... Anti-vibration mechanism Control unit 113 ... Imaging control unit 114 ... Coordinate conversion unit 115 ... Image composition unit 116 ... Storage unit 117 ... Dark current subtraction unit 200 ... External storage unit

Claims (5)

An image sensor;
An imaging control unit that captures a plurality of captured images;
Each time the imaging control unit captures the captured image, the imaging area of the subject image to be formed is set to the coordinate position of the captured image within the imageable area of the two-dimensional coordinate system of the imaging surface of the imaging element. An anti-vibration mechanism control unit that sequentially shifts by a preset number of pixels;
A coordinate conversion unit that performs coordinate conversion in the two-dimensional coordinate system of the captured image so that the coordinate positions of the plurality of captured images match the coordinate positions of any captured image;
An image synthesizing device comprising: an image synthesis unit that synthesizes the plurality of coordinate-transformed captured images by superimposing them.   The imaging apparatus according to claim 1, further comprising a dark current calculation unit that performs dark current subtraction on each of the captured images. The anti-vibration mechanism control unit moves an anti-vibration lens interposed between the imaging lens that forms the subject image on the imaging element and the imaging element, and the subject image on the imaging surface of the imaging element The imaging apparatus according to claim 1, wherein a position where the image is formed is shifted. The image pickup apparatus according to claim 1, wherein the image stabilization mechanism control unit moves the image pickup device and shifts a position where the subject image is formed on the image pickup surface of the image pickup device. An imaging control process of capturing a plurality of captured images by the imaging element;
In the imaging control process, each time the captured image is captured, the imaging area of the subject image to be formed is set to the coordinate position of the captured image within the imageable area of the two-dimensional coordinate system of the imaging surface of the imaging element. Are sequentially controlled by a predetermined number of pixels, and a vibration isolation mechanism control process,
A coordinate conversion process of performing coordinate conversion in the two-dimensional coordinate system of the captured image so that the coordinate positions of the plurality of captured images match the coordinate position of any captured image;
An image synthesis process comprising: synthesizing a plurality of the coordinated image-captured images by superimposing the images.

Images