JP4846394B2 - Imaging apparatus and imaging method - Google Patents

Description

  The present invention relates to an imaging apparatus and an imaging method that are mounted on a mobile phone terminal, a digital camera, or the like and correct image distortion caused by camera shake.

  Conventionally, many CCDs (Charge Coupled Devices) have been applied as imaging devices for digital cameras. However, in recent years, imaging devices using CMOS (Complementary Metal Oxide Semiconductor) sensors that consume less power and are less expensive than CCDs are becoming popular in place of CCDs. In addition, CMOS sensors are often used for mobile phone terminals because of low power consumption and low noise and low influence on communication (for example, see Patent Document 1).

Incidentally, in recent years, the functions of cameras provided in mobile phone terminals have also been enhanced, and those having functions such as camera shake correction as provided in digital cameras have been applied.
JP 2002-303909 A

  However, the image sensor of the CMOS sensor is not a full-screen simultaneous photographing method in which the electric charge accumulated in the pixels of the full screen is transferred at once when the electronic shutter is activated like a CCD, and exposure control is performed for each pixel. In other words, a method is employed in which the charges accumulated in the pixels are sequentially output by scanning each pixel, that is, by scanning. Therefore, in the CMOS sensor, there is a time difference in the output timing of a signal to be output based on the output electric charge, and there is a problem that an image shifts in the scanning direction when camera shake occurs during scanning. . FIG. 10 is a diagram showing image shift due to camera shake. In a mobile phone terminal, camera shake occurs in the vertical direction, so that the image in the stationary state shown in FIG. When the amount of camera shake is large, the state shown in FIG. 10B is obtained. When the amount of camera shake is small, the state shown in FIG. 10C is obtained.

The present invention has been made to solve the above problems, and an object thereof is to provide an imaging apparatus and an imaging method for correcting image distortion due to camera shake.

In order to solve the above-mentioned problems, the following means were adopted.
An imaging apparatus according to the present invention includes a housing and an imaging unit that starts scanning each pixel of the image sensor and captures an image of a subject reflected on the image sensor using the image sensor provided in the housing. In the imaging device provided, the vibration detection means for detecting the vibration of the housing, and the vibration speed in the same vibration direction based on the vibration detected by the vibration detection means when the imaging means starts imaging. A correction unit that detects a late point and corrects the scanning start time so that the center pixel of the image is captured at the detected point, a screen that displays the image, and a memory that stores the image And image processing means for reading out the image stored in the storage means and displaying the image on the screen at predetermined intervals .

The image may be an image captured before being corrected by the correcting unit and an image captured after being corrected by the correcting unit .

An imaging apparatus according to the present invention includes a housing and an imaging unit that starts scanning each pixel of the image sensor and captures an image of a subject reflected on the image sensor using the image sensor provided in the housing. In the imaging device provided, the vibration detection means for detecting the vibration of the housing, and the vibration speed in the same vibration direction based on the vibration detected by the vibration detection means when the imaging means starts imaging. A correction unit that detects a slow point and corrects the start point of the scan so that the center pixel of the image is captured at the detected point, and is corrected and imaged in the same vibration direction by the correction unit. Image processing means for superimposing and synthesizing a plurality of images, and outputting the synthesized image as a captured image.

The vibration detecting unit detects vibration in a scanning direction of a pixel of the image sensor by the imaging unit.

  The image sensor is a CMOS sensor.

An imaging apparatus according to the present invention is an imaging method for starting scanning of each pixel of the image sensor and outputting an image of a subject reflected on the image sensor using an image sensor provided in the housing. detecting the vibration of the body, the so detecting a portion where the speed of the vibration is delayed in the same vibration direction based on the detected vibration, the center of the pixel of the image at the detected location is imaged The method includes a step of correcting a start time of scanning, and a step of superposing and combining a plurality of images that are corrected and imaged in the same vibration direction.

  According to the present invention, the imaging device detects the vibration of the housing, detects a part where the vibration speed is slow in the same vibration direction based on the detected vibration, and detects the center of the image at the detected part. The scanning start time is corrected so that pixels are imaged. As a result, when a CMOS sensor that starts scanning each pixel and outputs an image of a subject is used, image distortion due to camera shake can be suppressed.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a schematic block diagram illustrating a mobile phone terminal 100 including the imaging device 1 according to the present embodiment. In the mobile phone terminal 100, the communication unit 22 performs telephone communication and data communication with the base station device. The operation unit 20 includes a keyboard, buttons, and the like, detects a user's keyboard operation and button presses, and inputs the detected information to other function units. A liquid crystal screen or the like is applied to the screen 21 and displays a preview video before shooting, a still image after shooting, or the like.

  The imaging device 1 is a camera built in the mobile phone terminal 100 and shoots a subject. In the imaging apparatus 1, the imaging unit 11 includes a CMOS sensor as an imaging element inside, and images a subject through the lens 10. Further, the imaging unit 11 is activated when a start instruction is input from the operation unit 20, receives a signal output from the internal CMOS sensor, converts the received signal into image data, and converts the converted image data. Record in the buffer memory 12. In addition, for example, a volatile RAM (Random Access Memory) is applied to the buffer memory 12, and the buffer memory 12 has a storage capacity of one frame or more. The buffer memory 12 stores the image data recorded by the imaging unit 11 in order from the new data while the imaging unit 11 is activated, and deletes the old data exceeding the storage capacity.

  The image processing unit 13 is activated when a start instruction is input from the operation unit 20, reads image data recorded in the buffer memory 12 from the buffer memory 12 at predetermined intervals, and displays the image data on the screen 21. In addition, when a shooting instruction is input from the operation unit 20, the image processing unit 13 reads a plurality of image data from the buffer memory 12, combines the plurality of read image data, and combines the combined image data with the captured image. The data is recorded in the storage area for storing the image file in the mobile phone terminal 100.

  For example, an acceleration sensor or the like is applied to the vibration detection unit 15 and detects vibration in the scanning direction of the CMOS sensor, that is, the scanning direction, that is, detects acceleration indicating vibration.

  Based on the acceleration detected by the vibration detection unit 15, the correction unit 14 calculates a vibration amount, which is the magnitude of the vibration, and a relative time of occurrence, and calculates a direction of hand shake vibration from the calculated vibration amount and the relative time. To do. Further, the correction unit 14 calculates a vibration wave that is predicted to be generated thereafter based on the calculated vibration direction and vibration amount, and detects a portion where the speed is slow in the same vibration direction in the vibration wave. The detected location is set as a synchronization target location that synchronizes the center of the image captured by the imaging unit 11. Specifically, based on the direction and amount of vibration already obtained, either one of the peak side or the valley side of the vibration wave generated thereafter is detected. Further, the correction unit 14 determines that the center of the image captured by the imaging unit 11 is the synchronization target location based on the scanning timing information for each pixel output from the imaging unit 11 and the detected synchronization target location information. The scanning start timing of the CMOS sensor in the imaging unit 11 is corrected so as to match.

  Next, pixel scanning processing in the CMOS sensor will be described with reference to FIG. FIG. 2 is a diagram illustrating the relationship between the vibration direction of the mobile phone terminal 100, the arrangement of pixels on the imaging surface of the CMOS sensor provided in the imaging unit 11, and the scanning direction of the CMOS sensor. As shown in FIG. 2, it is assumed that 5 × 5 25 pixels exist on the imaging surface of the CMOS sensor. Also, the scanning direction of the CMOS sensor corresponds to the vertical direction of the screen 21 of the mobile phone terminal 100, and the mobile phone terminal 100 generates vibration due to camera shake in the vertical direction. It is supposed to be.

  In the CMOS sensor, while VSYNC (vertical synchronization signal) is generated, HSYNC (horizontal synchronization signal) is generated five times in the direction from pixel line A to pixel line E in FIG. 2, and further, HSYNC is generated. During this time, PCLK (pixel clock) for outputting the charge of each pixel is generated five times corresponding to each pixel 1 to 5 of the pixel line A to pixel line E. By the scanning process performed by these synchronization signals, the charge of each pixel on the imaging surface of the CMOS sensor is output in the order of pixels A1, A2, A3, A4, A5, and then the pixels B1, B2,. Output in order. Then, after the output is performed up to the pixel E5, the output is performed again from the pixel A1 in response to the occurrence of VSYNC. That is, in the CMOS sensor, VSYNC is an imaging period for each frame of the image displayed on the screen 21, and the correction unit 14 has a portion where the speed is slow in the same vibration direction in vibration generated by camera shake. The start timing of VSYNC is corrected so as to coincide with the center of the imaging surface, that is, the third pixel of the pixel C3.

(First embodiment)
Next, correction processing for correcting the start timing of VSYNC by the correction unit 14 according to the first embodiment of the present invention will be described with reference to FIGS. In FIG. 3, V represents VSYNC, H represents HSYNC, P represents PCLK, and Im represents the pixel exposure time. In addition, pixel lines A, B, C, D, and E in step Sa3 in FIG. 3 indicate pixel lines before correction, and pixel lines A ′, B ′, C ′, D ′, and E ′ indicate corrected pixels. Show the line.

  FIG. 3 is a diagram for explaining the principle of correction processing by the correction unit 14 according to the first embodiment. In FIG. 3, it is assumed that vibration due to camera shake occurs in the vertical direction of the mobile phone terminal 100, and the change in the vibration is indicated by a vibration wave W.

(Process Sa1)
The imaging unit 11 to which the start instruction is input from the operation unit 20 generates VSYNC at a constant imaging cycle for the CMOS sensor, and generates HSYNC and PCLK according to VSYNC as shown in FIG. The correction unit 14 calculates a vibration wave W indicating a change in vibration based on the vibration detected by the vibration detection unit 15, and further, a valley side portion and a mountain side portion where the vibration speed of the vibration wave W is reduced 3 is detected, that is, the synchronization target portion G1 corresponding to the vertical broken line in FIG. Information on the timing of the synchronization signal composed of VSYNC, HSYNC, and PCLK is input from the imaging unit 11 to the correction unit 14, and the correction unit 14 corresponds to the synchronization target location G1 from the information on the timing of the synchronization signal. It is detected that the current pixel is the pixel D3.

(Process Sa2)
When the correction unit 14 detects that the pixel corresponding to the synchronization target location G1 is the pixel D3, the correction unit 14 performs an operation for predicting the next wave to be generated based on the already calculated inclination of the vibration wave W, etc. The synchronization target location G2, which is the valley side portion, is calculated. Then, the correction unit 14 matches the calculated timing of scanning of the pixel D3 with the calculated generation timing of the synchronization target location G2, and the timing at which the start timing of the next generated VSYNC (II) is indicated by VSYNC (II '). The correction is made so that

(Process Sa3)
The correction unit 14 further indicates the start timing of VSYNC (II ′) as VSYNC (II ″) in order to match the scanning timing of the pixel C3 at the center of the imaging surface of the CMOS sensor with the generation timing of the synchronization target location G2. The corrected VSYNC start timing information is input to the imaging unit 11. The imaging unit 11 generates VSYNC (II ″) based on the VSYNC start timing information input to the CMOS sensor.

  In contrast to the movement process of the mobile phone terminal 100, by correcting to VSYNC (II ″), the mobile phone terminal 100 is in the middle of starting to move in the valley direction of the vibration wave W and is slower than before the correction. At the timing, scanning starts at the timing of VSYNC (II ″). That is, imaging starts at the position of the lens 10 one pixel lower than the position before correction, and the portion of the subject that was reflected in the pixel D3 in the VSYNC (II ′) before correction is corrected. In the later VSYNC (II ″), the image appears in the center pixel C′3.

  Due to the occurrence of VSYNC (II ″), the exposure time Im (II-A1) in VSYNC (II) of the pixel A1 before correction and the exposure time (II ″ -A ′) in VSYNC (II ″) after correction. 1) will overlap. For this reason, in the pixel A1, charges accumulated up to a time not overlapping with the exposure time (II ″ -A′1) during the exposure time Im (II-A1) are discarded. Similarly, in each pixel, charges with overlapping exposure times are discarded.

  With the above correction process, the scanning process is performed on the pixel C′3 at the center of the imaging surface of the CMOS sensor at the valley side where the vibration speed of the vibration wave W is slow. Generally, it is known that by reducing the distortion at the center of the subject, the displayed image becomes an image with little distortion as a whole. It is possible to obtain an image with high visibility with little distortion due to vibration at the center of the subject.

  Next, imaging processing performed by the imaging device 1 will be described with reference to FIGS. 4 and 5. FIG. 4 is a diagram illustrating a vibration wave W <b> 1 that is a change in vibration detected by the correction unit 14 based on the vibration detected by the vibration detection unit 15. The correction unit 14 calculates the vibration wave W1 based on the vibration detected by the vibration detection unit 15 during the time β1, and the valley side which is one of the valley side and the mountain side where the vibration speed is slowed by the vibration wave W1. , That is, the position α1 in FIG. 4 is detected. Then, the correction unit 14 calculates the VSYNC start timing γ1 that the imaging unit 11 generates in the CMOS sensor, based on the detected α1 location.

  FIG. 5 shows a captured image composed of image data recorded in the buffer memory 12 by the imaging unit 11 and a screen read out from the buffer memory 12 by the image processing unit 13 when the vibration W1 of FIG. 4 occurs. 21 is a diagram illustrating a relationship between an output image output to 21, VSYNC, and pixel exposure time. FIG. In FIG. 5, a pixel B corresponds to the pixel A1 in FIG. 3, a pixel M corresponds to the pixel C3, and a pixel E corresponds to the pixel E5.

  5, in the second period of VSYNC: Ta1 before correction, that is, VSYNC (2), the information of the VSYNC start timing γ1 calculated by the correction unit 14 in accordance with the principle of the correction process of FIG. The exposure control is switched by the imaging unit 11. The imaging unit 11 causes the CMOS sensor to generate corrected VSYNC: Ta2 based on the input information of the VSYNC start timing γ1. When a half of one cycle of the exposure time Ta2M of the center pixel has elapsed by the scanning process of the CMOS sensor based on the VSYNC: Ta2 (FIG. 5, the position of the circle in the center of the exposure time of III-M of the exposure time Ta2M ) Coincides with the synchronization target portion where the vibration speed in the vibration wave W1 becomes slow, that is, the synchronization target portion δ1 in FIG. In the actual VSYNC, in the imaging unit 11, the second period of VSYNC: Ta1 before correction and the third and subsequent periods of VSYNC: Ta2 after correction are combined, and the timing indicated by VSYNC: Tav is obtained.

  At this time, the exposure time of each pixel of the imaging unit 11 overlaps due to the temporal relationship between VSYNC: Ta1 before correction and VSYNC: Ta2 after correction. Specifically, in the exposure time of the first pixel B, the exposure time Ta1B (3-B) corresponding to the third period of VSYNC before correction (VSYNC (3)) and the third period of VSYNC after correction Since the exposure time Ta2B (III-B) corresponding to (VSYNC (III)) overlaps, the portion of the exposure time Ta1B (3-B) that does not overlap with the exposure time Ta2B (III-B), that is, the exposure time (3-B The charge in the shaded area is discarded because the exposure is not sufficient. In the same way, in the exposure times Ta1M and Ta2M of the center pixel M and the exposure times Ta1E and Ta2E of the last pixel E, the charges in the overlapping portions, that is, the hatched portions shown in FIG. 5, are discarded.

  Even after correction by the correction unit 14, the imaging unit 11 records the captured image in the buffer memory 12 according to the scanning speed of the CMOS sensor, and the image processing unit 13 reads the image from the buffer memory 12 at predetermined intervals. Image data is read and output to the screen 21. At this time, even if VSYNC: Ta1 is corrected and the timing becomes VSYNC: Tav, the image processing unit 13 displays the image data stored in the buffer memory 12 at a fixed interval timing TbB. : Image data can be output independently of the Tav timing. As a result, it is possible to prevent the image from being lost during the display on the screen 21 or the image from stopping due to the timing of the display being out of time.

(Second Embodiment)
Next, correction processing for correcting the start timing of VSYNC by the correction unit 14 according to the second embodiment of the present invention will be described with reference to FIGS. In the first embodiment, correction has been described in a case where a portion where the speed of vibration caused by camera shake is slow, that is, a synchronization target portion corresponds to a region below the center pixel of the CMOS sensor. In the second embodiment, The correction when the synchronization target portion corresponds to the region above the center pixel of the CMOS sensor will be described.

  FIG. 6 is a diagram for explaining the principle of correction processing by the correction unit 14 according to the second embodiment. Also in FIG. 6, it is assumed that vibration due to camera shake occurs in the vertical direction of the mobile phone terminal 100 and the change in the vibration is indicated by a vibration wave W. In FIG. 6, V represents VSYNC, H represents HSYNC, P represents PCLK, and Im represents the exposure time of the pixel. In addition, pixel lines A, B, C, D, and E in step Sb3 of FIG. 6 indicate pixel lines before correction, and pixel lines A ′, B ′, C ′, D ′, and E ′ indicate corrected pixels. Show the line.

(Process Sb1)
Similar to the first embodiment, the correction unit 14 calculates a vibration wave W indicating a change in vibration based on the vibration detected by the vibration detection unit 15, and further, a trough in which the vibration speed of the vibration wave W decreases. A portion on the valley side that is one of the mountain side and the mountain side, that is, a synchronization target location G1 corresponding to the vertical broken line in FIG. 6 is detected. Information on the timing of the synchronization signal composed of VSYNC, HSYNC, and PCLK is input from the imaging unit 11 to the correction unit 14, and the correction unit 14 corresponds to the synchronization target location G1 from the information on the timing of the synchronization signal. It is detected that the current pixel is the pixel B3.

(Process Sb2)
When the correction unit 14 detects that the pixel corresponding to the synchronization target location G1 is the pixel B3, the correction unit 14 performs an operation for predicting the next wave to be generated based on the already calculated inclination of the vibration wave W, etc. The synchronization target location G2 is calculated. Then, the correction unit 14 indicates the start timing of VSYNC (II) to be generated by the CMOS sensor next by VSYNC (II ′) in order to match the generation timing of the synchronization target location G2 with the calculated scanning timing of the pixel B3. Correction is performed so that the timing is correct.

(Process Sb3)
The correction unit 14 further has a timing at which the start timing of VSYNC (II ′) is indicated by VSYNC (II ″) in order to match the scanning timing of the pixel C3 at the center of the imaging surface of the CMOS sensor with the synchronization target location G2. The corrected VSYNC start timing information is input to the imaging unit 11. The imaging unit 11 causes the CMOS sensor to generate VSYNC (II ″) based on the input VSYNC start timing information.

  As a specific movement of the mobile phone terminal 100, by correcting to VSYNC (II ″), the mobile phone terminal 100 is in the middle of starting to move in the valley direction of the vibration wave W, and before the correction. The scanning is started at the timing of VSYNC (II ″) at an early timing. That is, imaging starts at the position of the lens 10 one pixel higher than the position before correction, and the portion of the subject that was reflected in the pixel B3 in the VSYNC (II ′) before correction is corrected. In the later VSYNC (II ″), the image appears in the center pixel C′3.

  Further, due to the occurrence of VSYNC (II ″), the exposure time Im (II-A1) in VSYNC (II) of the pixel A1 before correction and the exposure time (II ″ − in VSYNC (II ″) after correction. A′1) will overlap. For this reason, the imaging unit 11 discards the charges accumulated up to the time not overlapping with the exposure time (II ″ -A′1) during the exposure time Im (II-A1) for the pixel A1. Similarly, in each pixel, charges with overlapping exposure times are discarded.

  As a result, the scanning process is performed for the pixel C ′ 3 at the center of the CMOS sensor at the valley side where the vibration speed of the vibration wave W is slow.

  Next, FIG. 7 is a diagram illustrating a case where the synchronization target portion corresponds to a region above the center pixel of the CMOS sensor, similarly to the principle of the correction processing illustrated in FIG. The vibration wave W ′ caused by camera shake shown in FIG. 7 has a shorter vibration cycle than the vibration wave W of FIG. That is, in FIG. 7, the vibration speed due to camera shake is faster than in the case shown in FIG. 6. Therefore, the synchronization target location G2 'occurs at a point earlier than the synchronization target location G2 in FIG.

  In the case of FIG. 7, the correction unit 14 generates VSYNC (II ″) at a timing earlier than the timing at which VSYNC (II) before correction is generated in step Sc3 which is the last correction processing step. Become. Due to the occurrence of VSYNC (II ′), the exposure time Im (I-A1) in the first cycle VSYNC (I) of the pixel A1 before correction and the second cycle exposure time of VSYNC (II ″) after correction In (II ″ -A′1), the hatched portions in FIG. 7 overlap. At this time, since sufficient exposure time cannot be secured for VSYNCII ″ -A′1 of the pixel A1, the imaging unit 11 discards the charge corresponding to the exposure time (II ″ -A′1), and performs buffering. The image data corresponding to the exposure time (I-A1) stored in the memory 12 is re-recorded in the buffer memory 12 as image data corresponding to the exposure time (II ″ -A′1).

  With the above configuration, the image that is read from the buffer memory 12 by the image processing unit 13 and displayed on the screen 21 is a discontinuous image. It is possible to display no image.

Next, imaging processing by the imaging apparatus 1 will be described with reference to FIGS.
FIG. 8 is a diagram illustrating a vibration wave W2 that is a change in vibration calculated by the correction unit 14 based on the vibration detected by the vibration detection unit 15. The correction unit 14 calculates the vibration wave W2 based on the vibration detected by the vibration detection unit 15 during the time β2, and the valley which is one of the valley side and the mountain side where the vibration speed is slowed down by the vibration wave W2. The side part, that is, the part α2 in FIG. 8 is detected. Then, the correction unit 14 calculates the VSYNC start timing γ2 that is next generated in the CMOS sensor in the imaging unit 11 based on the detected α2.

  FIG. 9 shows a captured image composed of image data captured by the imaging unit 11 and recorded in the buffer memory 12 when the vibration wave W2 of FIG. 8 is generated, and read from the buffer memory 12 by the image processing unit 13. It is the figure which showed the relationship between the output image output and output on the screen 21, and VSYNC and the exposure time of a pixel. 9, pixel B corresponds to pixel A1 in FIG. 3, pixel M corresponds to pixel C3, and corresponds to pixel E5.

  In FIG. 9, information on VSYNC start timing γ2 calculated by the correction unit 14 in accordance with the principle of the correction processing in FIG. 6 described above is input to the imaging unit 11 in the second period of VSYNC: Tb1 before correction in VSYNC (2). Then, the exposure control is switched in the imaging unit 11. The imaging unit 11 causes the CMOS sensor to generate corrected VSYNC: Tb2 based on the input information of the VSYNC start timing γ2. The synchronization target point at which the vibration speed in the vibration W1 becomes slow, that is, the synchronization target point in FIG. 8, when a half of one period of the exposure time Tb2M of the center pixel has passed by scanning of the CMOS sensor based on the VSYNC: Tb2. It corresponds to δ2. Note that the actual VSYNC is obtained by combining VSYNC: Tb1 before correction and VSYNC: Tb2 after correction in the imaging unit 11, and at a timing indicated by VSYNC: Tbv.

  By the correction of the correction unit 14, the exposure time Tb1B (2-B) for the pixel B in the second cycle of VSYNC: Tb1 before the correction and the exposure time Tb2B (III-B) for the pixel B in the third cycle of VSYNC: Tb2 are corrected. In FIG. 9, the hatched portions in FIG. 9 overlap, so that the exposure time for the pixel B in the third cycle of VSYNC: Tb2 is insufficient. Therefore, the imaging unit 11 discards the charge accumulated at the exposure time (III-B), and uses the image obtained by the charge accumulated at the exposure time (2-B) as an image in the third period. Therefore, an image corresponding to the exposure time (2-B) recorded in the buffer memory 12 is re-recorded in the buffer memory 12 as an image in the third period. Similarly, for the center pixel M and the last pixel E, the imaging apparatus 11 also uses the second period exposure time (Tb1M and Tb1E) before correction and the third period exposure time (Tb2M and Tb2E) after correction. Since duplication occurs, the image of the previous cycle is set as the image of the third cycle in the same manner as the first pixel B.

  Since a sufficient exposure time (IV-B, IV-M, IV-E) is secured after the fourth cycle (IV) of VSYNCTb2, the imaging unit 11 scans the CMOS sensor according to VSYNC: Tb2. As a result, the vibration speed at the vibration W2 becomes slow at the time when half of one period of the exposure time Tb2M of the center pixel has passed (the circle in FIG. 9, Tb2M, the center of the IV-M exposure time). This corresponds to the synchronization target portion, that is, the synchronization target portion δ2 in FIG.

  Even after correction by the correction unit 14, the imaging unit 11 records the captured image in the buffer memory 12 according to the scanning speed of the CMOS sensor, and the image processing unit 13 reads the image from the buffer memory 12 at predetermined intervals. The image is read and output to the screen 21. At this time, even if VSYNC: Tb1 is corrected and the timing becomes VSYNC: Tbv, the image processing unit 13 displays the captured image stored in the buffer memory 12 at the timing TbB at a constant interval. : An image can be output regardless of the timing of Tbv. As a result, it is possible to prevent the image from being lost during the display on the screen 21 or the image from stopping due to the timing of the display being out of time.

  In the first and second embodiments, the image processing unit 13 reads a plurality of image data from the buffer memory 12 when a shooting instruction is input from the operation unit 20, and the plurality of read images. The data is combined, and the combined image data is recorded as captured image data in a storage area for storing an image file in the mobile phone terminal 100. Conventionally, when generating captured image data by compositing, image distortion is reduced by shifting and correcting the frame position of the image data. In this embodiment, the frame position is also shifted and compositing is performed. In this embodiment, a plurality of pieces of image data in which distortion in one image data is reduced are combined, so that the captured image data obtained by the combination can be obtained. Distortion can be further reduced.

  In the above-described embodiment, only the trough side of the vibration wave caused by vibration is the synchronization target portion having a low vibration speed, but the present invention is not limited to this, and only the peak side of the vibration wave is a synchronization target portion having a low vibration speed. May be corrected as follows. In other words, the part where the vibration direction of hand shake changes is the place where the vibration speed is the slowest. Therefore, by adjusting the scanning start timing so that this part corresponds to the center pixel in the image, image distortion is reduced. The Then, when synthesizing a plurality of images by setting the part where the vibration speed as a reference is slow to be either the valley side or the mountain side of the vibration wave (the part where the vibration speed is slow in the same vibration direction) In addition, since the images captured on the same valley side (or mountain side) are combined, the shift amount of the image frame can be suppressed.

It is a block diagram which shows the internal structure of the mobile telephone terminal which concerns on this embodiment. It is a figure for demonstrating the scanning process of the CMOS sensor which concerns on the same embodiment. It is a figure for demonstrating the principle of the correction process which concerns on 1st Embodiment. It is the figure which showed the vibration wave by the camera shake vibration in the specific example of the imaging process which concerns on 1st Embodiment. It is a timing chart which showed the flow of the imaging processing concerning a 1st embodiment. It is FIG. (1) for demonstrating the principle of the correction process which concerns on 2nd Embodiment. It is FIG. (2) for demonstrating the principle of the correction process which concerns on 2nd Embodiment. It is the figure which showed the vibration wave by the camera shake vibration in the specific example of the imaging process which concerns on 2nd Embodiment. It is the timing chart which showed the flow of the imaging processing which relates to 2nd execution form. It is the figure which showed the example of the distortion of the image by a CMOS sensor at the time of camera shake occurrence.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Imaging device 10 Lens 11 Imaging part 12 Buffer memory 13 Image processing part 14 Correction part 15 Vibration detection part 22 Communication part 20 Operation part 21 Screen 100 Mobile phone terminal

Claims (6)

An imaging apparatus comprising: a housing; and an imaging device that starts scanning each pixel of the imaging device using the imaging device provided in the housing and captures an image of a subject reflected on the imaging device.
Vibration detecting means for detecting vibration of the housing;
Based on the vibration detected by the vibration detection means when the imaging means starts imaging, a location where the vibration speed is slow in the same vibration direction is detected, and the pixel at the center of the image is detected at the detected location. Correction means for correcting the start time of the scanning so as to be imaged;
A screen for displaying the image;
Storage means for storing the image;
Image processing means for reading out the image stored in the storage means and displaying it on the screen at predetermined intervals;
An imaging apparatus comprising: The imaging apparatus according to claim 1, wherein the image is an image captured before being corrected by the correcting unit and an image captured after being corrected by the correcting unit . An imaging apparatus comprising: a housing; and an imaging device that starts scanning each pixel of the imaging device using the imaging device provided in the housing and captures an image of a subject reflected on the imaging device.
Vibration detecting means for detecting vibration of the housing;
Based on the vibration detected by the vibration detection means when the imaging means starts imaging, a location where the vibration speed is slow in the same vibration direction is detected, and the pixel at the center of the image is detected at the detected location. Correction means for correcting the start time of the scanning so as to be imaged;
An image processing unit that superimposes and combines a plurality of images that are corrected and captured in the same vibration direction by the correction unit, and outputs the combined image as a captured image;
An imaging apparatus comprising: The vibration detection means, the imaging apparatus according to claims 1 to 3, characterized by detecting the vibration in the direction of scanning of the pixels of the imaging device by the imaging device. The imaging device, the imaging device according to any one of claims 1 to 4, characterized in that it is a CMOS sensor. An imaging method that starts scanning each pixel of the image sensor using an image sensor provided in a housing and outputs an image of a subject reflected on the image sensor,
A step of said detecting a vibration of the housing, for detecting the portion where the speed of the vibration is delayed in the same vibration direction based on the detected vibration,
Correcting the start point of the scan so that the center pixel of the image is imaged at the detected location;
A step of superimposing and synthesizing a plurality of images that are corrected and imaged in the same vibration direction;
An imaging method comprising:

Images