JP2007325129A - Imaging apparatus, control method of imaging apparatus, program, and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera shake detecting function achievable with the small number of frame memories. <P>SOLUTION: An imaging apparatus is provided with an imaging means for picking up a subject image and outputting video signals; a first memory means for temporarily storing the video images from the imaging means; a second memory means for receiving the successively inputted video signals stored in the first memory means, and storing composite video signals to be successively generated so as to be composited with the previously stored video signals; and a detecting means for detecting deviation quantity between the two video signals, i.e. between the video signals stored in the first memory means and the composite video signals stored in the second memory means. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an imaging apparatus that detects camera shake and enables camera shake correction, a control method for the imaging apparatus, a program, and a storage medium.

  2. Description of the Related Art Conventionally, it is known that an imaging device such as a digital camera captures a plurality of frame images and obtains a correlation between the frame images to detect a movement amount due to camera shake. In this case, based on this detection result, a plurality of frame images are combined while being shifted, and electronic camera shake correction processing is performed to correct image blur due to camera shake. This type of electronic camera shake correction processing does not require an optical drive unit, unlike the optical camera shake correction method in particular, so that the image pickup apparatus can be downsized.

  For example, as illustrated in FIG. 10, the imaging apparatus includes a first memory 200 and a second memory 202. Then, the arithmetic unit 201 detects motion vectors in characteristic areas between the frame images (203) that are continuously shot and stored in the first memory 200 and the second memory 202, respectively. The motion vector thus detected is output from the motion vector output unit 204. Then, as shown in FIG. 11, based on the motion vector that is the detection result, the frame images that are sequentially captured are subjected to addition processing while shifting in the direction opposite to the direction of camera shake. Thus, Patent Document 1 discloses an invention in which a frame image subjected to camera shake correction processing can be obtained in the compositing memory 205.

Further, the electronic camera shake correction process described with reference to FIG. 10 requires a plurality of frame memories. In addition, as shown in FIG. 12, it may be possible to provide a memory 300 having a frame memory area wider than one frame. In this case, camera shake correction processing can be performed by superimposing the frame image data sequentially captured based on the camera shake movement information by the movement amount detection device while shifting them. Such an invention capable of performing camera shake correction processing with one compositing memory is also disclosed in Patent Document 2.
JP 2005-033785 A JP 2005-328326 A

  However, in Patent Document 1, in order to detect camera shake, it is necessary to store frame images moving back and forth in time. Therefore, at least two frame memories, an addition processing circuit, and a correction result are stored for camera shake detection. A frame memory for synthesis is required.

  In Patent Document 2, camera shake correction is realized by using a single frame memory for synthesis by using a movement amount detection device. However, since a mechanical device is used for movement amount detection, there is a limit to downsizing of the device. . In addition, when using a frame image that moves back and forth in camera shake detection without using a movement amount detection device in Patent Document 2, two frame memories for detecting camera shake and a composite image are stored as in the conventional invention. It is necessary to have a frame memory.

  Accordingly, an object of the present invention is to provide a camera shake detection function that can be realized with a small number of frame memories in an imaging apparatus.

In order to achieve the above object, an imaging apparatus according to an embodiment of the present invention includes an imaging unit that captures a subject image and outputs a video signal;
First memory means for temporarily storing the video signal from the imaging means;
Second video means for sequentially storing the video signals stored in the first memory means, and synthesizing the video signals generated in advance and synthesizing the video signals.
Detecting means for detecting a shift amount between two video signals between the video signal stored in the first memory means and the synthesized video signal stored in the second memory means; It is characterized by that.

In order to achieve the above object, a method for controlling an imaging apparatus according to another embodiment of the present invention includes:
An imaging process for capturing a subject image and outputting a video signal;
A first accumulation step of temporarily accumulating the video signal acquired in the imaging step in a first memory means;
A second storage step for sequentially storing the video signals stored in the first memory means and combining the previously stored video signals and sequentially generating a composite video signal generated in the second memory means;
A detection detecting step of detecting a shift amount between two video signals between the video signal stored in the first memory means and the synthesized video signal stored in the second memory means. It is characterized by that.

  In order to achieve the above object, in yet another embodiment of the present invention, a computer-executable program is described in which a procedure of a control method for an imaging apparatus according to the above embodiment is described.

  In order to achieve the above object, in yet another embodiment of the present invention, there is provided a computer readable storage medium storing a program in which a procedure of a control method of an imaging apparatus of the above embodiment is described.

  According to the present invention, it is possible to realize a camera shake detection function with a small number of frame memories in an imaging apparatus.

<Embodiment 1>
FIG. 1 is a block diagram of an imaging apparatus according to Embodiment 1 of the present invention. FIG. 5 is a flowchart illustrating processing procedures of the camera shake detection unit 9 and the window control unit 7 in the imaging apparatus according to the first embodiment. FIG. 8 is a flowchart showing the processing procedure of the composition calculation unit 8.

  In FIG. 1, a subject image that has entered through the imaging optical unit 1 is photoelectrically converted into an electrical signal by an imaging element of the imaging unit 2. The A / D conversion unit 3 converts the video signal output from the imaging unit 1 into digital image data. The signal processing unit 4 converts the image data output from the A / D conversion unit 3 into image data in a YUV data format used in a camera shake detection unit 9 to be described later, so that a white balance circuit, a gamma correction circuit, a matrix conversion Including circuits. Image data output from the signal processing unit 4 is temporarily stored in the memory unit 6 via the memory I / F 5. Here, as shown in FIG. 2, the memory unit 6 has at least two storage areas, a frame memory area 6-1 and a frame memory area 6-2 for synthesis processing. In the first embodiment, a storage area wider than the frame memory area 6-1 is set in the frame memory area 6-2 for synthesis processing.

  The frame memory area 6-1 stores N-th image data when the number of captured images is N, and the composition processing frame memory area 6-2 includes a plurality of images up to the (N-1) th image. Composite image data obtained by combining the data is stored. The camera shake detection unit 9 includes N−1 sheets from the Nth image data stored in the frame memory area 6-1 of the memory unit 6 and the combined image data stored in the frame memory area 6-2 for combination processing. Extract the region of the eye image data. From the image data extracted in this way, the amount of image movement of the image data due to camera shake is obtained.

  The method for detecting the amount of camera shake in image data is basically to detect motion vectors. First, the screen is divided into multiple regions, and statistical processing such as local movement amount averaging for each region is performed. Then, the amount of movement of the entire screen is obtained, and the amount of camera shake of the imaging device is determined. At this time, since the (N-1) th image data input to the camera shake detection unit 9 is extracted from the composite image data, the brightness level is different from that of the Nth image data.

  Therefore, in this way, when the composite image data is composite image data in which signals are simply combined without considering the signal level, the (N−1) th image data to be extracted is 1 / (N−1). ) After the signal level is lowered by a factor of 2, it is input to the camera shake detection unit 9. The above operation will be described with reference to FIG. 2. The Nth image data is input from the frame memory area 6-1 to the camera shake detection unit 9 via the memory I / F 5. On the other hand, the (N−1) th image data from the synthesis processing frame memory area 6-2 is input to the camera shake detection unit 9 via the memory I / F 5 and further via the signal level adjustment unit 18. The signal level adjustment unit 18 lowers the signal level of the (N−1) th image data by 1 / (N−1) times before being input to the camera shake detection unit 9. The signal level adjustment unit 18 has a function of adjusting the signal level according to the level control signal from the CPU 13.

  In this way, camera shake detection is performed between the two image data with the signal levels combined. The movement information of the image data due to the camera shake obtained by the camera shake detection unit 9 is sent to the CPU 13. Based on this movement information, the window control unit 7 displays a window indicating a memory storage area in which the Nth image data is overlaid on the composition processing frame memory area 6-2 of the memory unit 6 via the memory I / F 5. Set (Window Win-A). The window controller 7 also sets a window indicating the entire area of the composite image data (window Win-B). The above operation will be described with reference to FIG. 3. The synthesis calculation unit 8 functionally includes a signal level adjustment unit 19 and an addition unit 20, and the Nth image data is transferred from the frame memory area 6-1 to the memory I. It is input to the composition calculation unit 8 via / F5. On the other hand, the (N−1) th image data from the composition processing frame memory area 6-2 is also input to the composition calculation unit 8 via the memory I / F 5. In adding these two image data, the signal level conversion unit 19 converts the signal level of the (N−1) -th image data from the frame memory area 6-2 for composition processing to 1 / (N−1) times. And input to the adder 20. As a result, the signal levels of the two image data to be combined are combined, and the combined image data is sent from the adder 20 via the memory I / F 5 to the frame memory area 6-2 for combining processing in the memory section 6. Will be written again.

  Returning to the description of FIG. 1, the imaging apparatus of the embodiment of FIG. 1 further includes a display control unit 10, a display I / F 11, and a display unit 12. Therefore, it is possible to view the pre-photographed image and the image data captured and stored in the memory unit 6 by the display unit 12. Further, in order to operate the CPU 13, a ROM 14 in which various programs are stored and a RAM 15 as a work memory for the operation of the CPU 13 are provided. An operation unit 17 that performs various adjustments, switching, shutter operations, and the like performed by the user is coupled to the CPU 13 via the operation input I / F 16, and the imaging apparatus operates according to a program stored in the ROM 14. The CPU 13 can control various signal processing and operations according to the embodiment of the present invention without being limited to the operation relationship. Further, the detachable memory card 30 composed of a flash memory or the like is provided, and the image data stored in the memory unit 6 can be sequentially stored.

  FIG. 4 is an image diagram for explaining the operation of two windows set in the frame memory area 6-1 of the memory unit 6 and the frame memory area 6-2 for composition processing. First, as shown in FIGS. 4A and 4B, the first (N = 1) image data captured and stored in the frame memory area 6-1 in FIG. 4 is stored in the frame memory area 6-1. To the synthesis processing frame memory area 6-2. The storage area is determined by the previously set window Win-A.

  Next, as shown in (b), the second (N = 2) image data obtained by the second imaging is stored in the frame memory area 6-1. Next, with the second image data stored in the frame memory area 6-1 in (b) and the image data in the window Win-A shown in (d) of the frame memory area 6-2 for composition processing. A camera shake detection process is performed. Based on this detection processing result, the position of the window Win-A is shifted in the direction in which camera shake correction processing is performed, as shown in (e) of the frame memory area 6-2 for composition processing. Further, following the shift of window Win-A, the area of window Win-B is expanded as shown by the solid line in the figure.

  Next, the second image data stored in (b) of the frame memory area 6-1 is superimposed on the window Win-A of (e) in the frame memory area 6-2 for composition processing. Details of the superposition at this time will be described in a later-described synthesis processing method.

  Next, as shown in (c) of the frame memory area 6-1, the third (N = 3) image data obtained by the third imaging is stored in the frame memory area 6-1. Then, camera shake detection processing is performed using the third image data (c) in the frame memory area 6-1 and the image data in the window Win-A (e) in the frame memory area 6-2 for composition processing. Is called. Based on this detection processing result, the position of the window Win-A is shifted as shown in (f) of the frame memory area 6-2 for composition processing. In addition, the area of window Win-B is expanded following the shift of window Win-A. Then, the third image data stored in (c) of the frame memory area 6-1 is superimposed on the window Win-A of (f) in the frame memory area 6-2 for composition processing. Thereafter, the same processing is performed until N exposure times set by the user are completed. In FIG. 4, storage areas for three frames are set in the frame memory area 6-1 and the composition processing frame memory area 6-2, respectively. However, this is for explanation of the operation. Basically, the frame memory area 6-1 and the frame memory area for synthesis processing 6-2 store one frame as shown in FIGS. The area is set.

  Next, a processing procedure of the window control unit 7 of the imaging apparatus according to the first embodiment of the present invention will be described with reference to FIGS. 5 and 6.

  First, FIG. 6 will be described. FIG. 6 is an image of the memory storage area of the synthesis processing frame memory area 6-2 in the memory unit 6. FIG.

  Two windows are set by the window control unit 7 in the storage area of the frame memory area 6-2 for composition processing in the memory unit 6. One window is a window showing an area of the Nth image data that is overlapped with the (N-1) th image data based on the camera shake detection processing result. In the first embodiment, the window is a window Win-A. It is clearly stated. The other window is a window indicating the area of the composite image data, and is clearly shown as window Win-B in this embodiment. Win-B is a window in which the size of the area is changed in accordance with the area of the composite image data when the area of the composite image data is expanded by overlaying the Nth image data.

The mutual relationship regarding each window will be described in detail. First, as shown in FIG. 6A, the upper left coordinate is set to (0, 0) and the lower right coordinate is set to (n, n) in the memory area of the composition processing frame memory area 6-2. (N ≧ 0)
The coordinates of the window Win-A are initialized as a window indicating an area for storing the first image data. For example, as shown in FIG. 6A, the upper left coordinates of the window Win-A are (xs (1), ys (1)), and the lower right coordinates are (xe (1), ye (1)). And

  Further, as shown in FIG. 6B, the upper left coordinates of the window Win-B are set to (Xs, Ys) and the lower right coordinates are set to (Xe, Ye). Here, the window Win-B is a window indicating the area of the composite image data, but the same coordinates as the initial coordinates of the window Win-A are set for the first image data.

That is, Xs = xs (1) (a),
Ys = ys (1) (b),
Xe = xe (1) (c) and Ye = ye (1) (d).

  The window Win-B updates the coordinates as the composite image data area expands as the image data is overlaid. In the present embodiment, the coordinates are updated when the following condition is satisfied.

That means
If xs (N) <Xs, substitute xs (N) for Xs (e),
If ys (N) <Ys, substitute ys (N) for Ys (f),
If xe (N)> Xe, substitute xe (N) for Xe ... (g) and if ye (N)> Ye, substitute Ye (N) for Ye ... (h) Become.

  Next, the change of the window when the second image data is captured will be described. When the second image data is captured, the camera shake detection unit 9 detects the amount of camera shake based on the image data of the window Win-A and the second image data. Here, the window Win-A indicates an area where the first image data is placed.

  The camera shake detection processing method in the camera shake detection unit 9 first divides the image data of only the luminance signal component into a plurality of regions, and performs statistical processing such as averaging of the local movement amount for each region for the entire screen. The amount of movement is obtained, and the amount of camera shake of the imaging apparatus is determined.

  Based on the determined amount of camera shake, the window Win-A is set as a region shifted from the first image data. For example, as shown in FIG. 6C, it is assumed that the second image data is corrected so as to overlap at a position shifted in the lower right direction from the first image data. At this time, the upper left coordinates of the window Win-A are set as (xs (2), ys (2)), and the lower right coordinates are set as (xe (2), ye (2)).

Here window Win-B
xe (2)> Xe (i) and ye (2)> Ye (j)
Therefore, xe (2) is set for Xe and ye (2) is set for Ye. As a result, as shown in FIG. 6D, the coordinates of the window Win-B are updated as a window indicating all areas in which the first and second image data are placed.

  Next, the change of the window when the third image data is captured will be described. When the third image data is captured, the camera shake detection unit 9 detects the amount of camera shake based on the image data in the area of the window Win-A and the third image data. Here, the window Win-A indicates an area where the second image data is placed.

  Based on the detected amount of camera shake, the window Win-A is set as an area at a position shifted from the second image data. For example, as shown in FIG. 6E, it is assumed that the third image data is corrected so as to be shifted in the upper left direction with respect to the second image data. At this time, the upper left coordinates of the window Win-A are set as (xs (3), ys (3)), and the lower right coordinates are set as (xe (3), ye (3)).

Here, the window Win-B has xs (3) <Xs (k) and ys (3) <Ys (l).
Therefore, xs (3) is set for Xs and ys (3) is set for Ys. As a result, as shown in FIG. 6F, the coordinates of the window Win-B are updated as a window indicating all areas in which the composite image data and the third image data are placed. The above processing is performed N times for the number of shots.

  Next, a window control processing procedure will be described with reference to FIG. In FIG. 5, an initialization process is first executed in process procedure S100. In this initialization process, initialization of coordinates indicating the position of the window Win-A and initialization of values of all storage areas of the synthesis process frame memory area 6-2 are executed. Further, Nmax is set to how many frame images the user performs camera shake correction. In addition, the number of images N is initially zero. Next, the number N of captured images is set to N + 1 in the processing procedure S101, and the N (= 1) th imaging is performed in the processing procedure S102. In the processing procedure S103, it is determined whether the number of images to be taken is the first image or the second image. When the first image is taken, the processing proceeds to the processing procedure 110, and the coordinates of the window Win-A are input to the coordinates indicating the position of the window Win-B. Is done.

  Next, in the processing procedure S111, the first image data is stored in the area of the window Win-A. If it is determined in process step S103 that the number of images to be taken is the second or later, the process proceeds to process step S104. In the processing procedure S104, camera shake detection processing is performed on the image data of the window Win-A indicating the area of the (N-1) th image data in the composite image and the captured Nth image data. At this time, only the luminance signal component is used for camera shake detection, and the image data read from the window Win-A is input to the camera shake detection unit 9 with the signal level adjusted to 1 / (N-1) times. This operation has been functionally described with reference to FIG.

  Next, in processing step S105, the coordinates are corrected in the direction opposite to the camera shake direction so that the camera shake correction processing is performed on the coordinates of the window Win-A based on the camera shake detection result. When the window Win-A is shifted to an area outside the window Win-B in the processing procedure S106 due to this coordinate change, the coordinates of the window Win-B are updated in the processing procedure S107. When the window Win-A is not shifted to an area outside the window Win-B, the coordinates of the window Win-B are not updated. Here, in the first embodiment, when the following conditions are satisfied using the coordinates shown in FIG. 6, it is determined that the window Win-A has shifted out of the area of the window Win-B, and the coordinates of the window Win-B are determined. Update.

That is,
xs (N) <Xs, or ys (N) <Ys, or xe (N)> Xe, or ye (N)> Ye (m)
At the time, update the coordinates of window Win-B.

  Next, in the processing procedure S108, the image data captured on the Nth image is combined with the image data of the area of the window Win-A. The composition processing method in this processing procedure S108 will be described later with reference to the flowchart of FIG. In process step S109, if the number N of images has reached Nmax set by the user, the process flow is exited and the process is terminated. If not, the process returns to process step S101 and the subsequent process flow is repeated. In accordance with the above flow, two windows are set in the storage area of the synthesis processing frame memory area 6-2. Further, it is possible to extract the (N−1) th image data from the composite image data by the window and perform a camera shake detection process with the Nth image data.

  Next, the image composition processing of this embodiment will be described with reference to FIG. FIG. 7 is an image representation of the arrangement of image data in the frame memory area 6-1 and the composition processing frame memory area 6-2 in the memory unit 6 during image composition. In the synthesis processing frame memory area 6-2, the entire storage area is initialized with 0 as described in the flowchart of FIG.

  First, as shown in FIG. 7A, the first image data is placed in the frame memory area 6-1 when the first image is captured. Next, the first image data is placed in the composition processing frame memory area 6-2 in the area of the window Win-A as shown in FIG.

  Next, in the second image pickup, as shown in FIG. 7B, the second image data is stored in the frame memory area 6-1. Then, as shown in FIG. 7F, a window Win-A is set at the position where the second image data is corrected by the amount of camera shake movement compared to the first image, and the image data is synthesized. .

  In this synthesis process, the signal level is adjusted to N / (N-1) times, that is, twice the area inside window Win-B and outside window Win-A in FIG. Stored. When the data in the area inside the window Win-A and in the frame memory area 6-2 for composition processing is 0, the signal level is adjusted to N times the second image data, that is, twice, It is stored in the frame memory area 6-2 for composition processing. This part is indicated by hatching in the figure. Further, when the data in the area inside the window Win-A and the data in the compositing process frame memory area 6-2 is other than 0, the second image data and the data in the compositing process frame memory area 6-2 are stored. Accumulate and write back the current image data. As described above, signal level adjustment is performed even in a region where the first and second image data do not overlap, and image synthesis processing is performed at the same signal level in all regions of the composite image data.

  Next, as shown in FIG. 7C, the third image data is stored in the frame memory area 6-1 when the third image is captured. Then, as shown in FIG. 7G, the window image Win-A is set in the position where the third image data is corrected by the amount of camera shake movement compared to the second image data, and the image data is synthesized.

  In FIG. 7 (g), this combining process is performed by N / (N-1) times, that is, 3/2 times the signal level inside the window Win-B and outside the window Win-A. Is adjusted and stored. Further, when the data in the area inside the window Win-A and the data in the compositing process frame memory area 6-2 is 0, the third image data is multiplied by N, that is, tripled, and the compositing process frame. Store in the memory area 6-2. Furthermore, if the data in the area inside the window Win-A and the data in the compositing process frame memory area 6-2 is other than 0, the third image data and the compositing process frame memory area 6-2 are stored. Accumulate and write back data. As described above, the signal level adjustment is performed even in a region where the synthesized image data up to the second image and the third image data do not overlap, and the image synthesis process is performed at the same signal level in all the regions of the synthesized image data.

  Next, as shown in FIG. 7D, the fourth image data is stored in the frame memory area 6-1 when the fourth image is captured. Then, as shown in (h) of FIG. 7, the window Win-A is set at the position where the image data of the fourth image is corrected by the amount of movement of the camera shake compared to the image data of the second image, and the image data is synthesized.

  In FIG. 7 (h), this combining process is performed by N / (N-1) times, that is, 4/3 times the signal level inside the window Win-B and outside the window Win-A. Is adjusted and stored. Further, when the data in the area inside the window Win-A and the data in the compositing process frame memory area 6-2 is 0, the third image data is multiplied by N, that is, quadrupled, and the compositing process frame. Store in the memory area 6-2. Further, if the data in the area inside the window Win-A and the data in the compositing process frame memory area 6-2 is other than 0, the fourth image data is stored in the compositing process frame memory area 6-2. Accumulate and write back data. As described above, the signal level adjustment is performed even in the region where the synthesized image data up to the third image and the fourth image data do not overlap, and the image synthesis processing is performed at the same signal level in all the regions of the synthesized image data. The above processing is performed N times for the number of shots.

  In the above description, the signal level is adjusted by giving level control signals corresponding to various adjustment levels to the signal level adjusting unit 19 described in FIG.

  The processing procedure of the image composition processing method will be described with reference to FIGS. In the first embodiment, the image composition processing is performed in the processing procedure S108 of FIG. First, in the processing procedure S200 of FIG. 8, image data is read pixel by pixel from the area of the window Win-B. In the present embodiment, as shown in FIG. 9, data is read out in raster format in order from the start address in the upper left of the window Win-B area. In the processing procedure S201, it is determined whether or not the pixel data read from the window Win-B area is in the window Win-A area. If the pixel data read at this time is located in an area outside the window Win-A area, the process proceeds to step S207.

  In the processing procedure S207, the pixel data read from the area of the window Win-B is adjusted by N / (N−1) times, and the process proceeds to the processing procedure S205. If it is determined in the processing procedure S201 that the pixel data read from the window Win-B area is inside the window Win-A area, the process proceeds to the processing procedure S202. In the processing procedure S202, the read pixel data and the Nth image data are added.

  Next, in process step S203, in process step S200, it is determined whether or not the value of the pixel data read from the window Win-B area is 0. If the value is 0, the process proceeds to process step S204. In step S204, the level of the pixel data is adjusted N times, and the process proceeds to processing procedure S205. On the other hand, when it is determined in the processing procedure S203 that the value of the read pixel data is not 0, the process jumps to the processing procedure S205.

  In the processing procedure S205, the pixel data added or level-adjusted to the same address as the read address is written back to the synthesis processing frame memory area 6-2. Next, in processing step S206, it is determined whether all the pixel data in the area of the window Win-B has been read out. If not all of the pixel data has been read out, the processing returns to processing step S200 and the subsequent processing steps are repeated. If it is determined in the processing procedure S206 that all the pixel data in the area of the window Win-B has been read, the process flow of FIG. In the above description, the adjustment of the pixel signal level is performed by giving level control signals corresponding to various adjustment levels to the signal level adjustment unit 19 described in FIG.

  As described above, during image composition processing, image composition processing is performed while performing gain adjustment other than the addition region for each frame, and therefore, the entire area of the composite image data is stored with the same gain. Data can be extracted. The image signal subjected to the electronic image stabilization in this way is stored as a synthesized video signal in the synthesis processing frame memory area 6-2. This synthesized video signal is displayed on the display unit 12 and stored in the memory card 30.

  As mentioned above, the embodiment described in this specification is cited for explaining an example of the present invention, and if the invention expressed in the claims of the present invention is satisfied, the configuration is as follows. It is not limited to the embodiments disclosed herein.

  For example, in this embodiment, the gain adjustment at the time of addition is performed after adding the Nth image data and the image data read from the area of the window Win-B, but the level adjustment is performed on each data before the addition. In addition, a configuration of adding the values may be taken.

  In this embodiment, the memory area is imaged as window control and the window area is expressed by coordinates. However, the memory area may be directly used to express the area in the window.

  The object of the present invention can also be achieved by supplying a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus. That is, it goes without saying that this can also be achieved by the computer (or CPU or MPU) of the system or apparatus reading and executing the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.

  As a storage medium for supplying the program code, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, nonvolatile semiconductor memory card, ROM, or the like can be used. .

  Further, the functions of the above-described embodiments may be realized by executing the program code read by the computer. However, when the OS (operating system) operating on the computer performs part or all of the actual processing based on the instruction of the program code, and the functions of the above-described embodiments are realized by the processing. Needless to say, is also included.

  Furthermore, the program code read from the storage medium may be written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. After that, based on the instruction of the program code, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing, and the processing of the above-described embodiment is realized by the processing. Needless to say.

It is a block block diagram of the imaging device in Embodiment 1 of this invention. It is a block block diagram explaining the function of the signal level adjustment performed at the time of the camera-shake detection of the imaging device in Embodiment 1 of this invention. It is a block block diagram explaining the function of the signal level adjustment performed in the case of the synthetic | combination process of the imaging device in Embodiment 1 of this invention. It is an image figure for demonstrating operation | movement of the camera shake detection method in the imaging device of Embodiment 1 of this invention. It is the flowchart figure which showed the process sequence of the camera-shake detection process in the imaging device of Embodiment 1 of this invention. It is an image figure for demonstrating the operation | movement of the image composition process in the imaging device of Embodiment 1 of this invention. It is an image figure for demonstrating operation | movement of the window control method in the imaging device of Embodiment 1 of this invention. It is the flowchart figure which showed the process sequence of the image composition process in the imaging device of Embodiment 1 of this invention. It is an image figure for demonstrating the read-out operation | movement of the image data at the time of the image synthesis in the imaging device of Embodiment 1 of this invention. It is a block diagram of the electronic camera shake detection apparatus in a prior art. It is an image figure for demonstrating operation | movement of the electronic camera shake detection method in a prior art. It is an image figure for demonstrating operation | movement of the electronic camera-shake correction method in a prior art.

Claims (22)

Imaging means for capturing a subject image and outputting a video signal;
First memory means for temporarily storing the video signal from the imaging means;
Second video means for sequentially storing the video signals stored in the first memory means, and synthesizing the video signals generated in advance and synthesizing the video signals.
Detecting means for detecting a shift amount between two video signals between the video signal stored in the first memory means and the synthesized video signal stored in the second memory means; An imaging apparatus characterized by that.   The imaging apparatus according to claim 1, wherein the first memory unit and the second memory unit divide a storage area of the same memory and set each storage area.   3. The image pickup apparatus according to claim 1, wherein a storage area of the second memory unit is larger than a storage area of the first memory unit.   2. The composite video signal stored in the second memory means corresponds to a video signal one frame before the video signal stored in the first memory means. The imaging device according to any one of 1 to 3.   2. The signal level of the composite video signal output from the second memory means is adjusted so as to be the signal level of the video signal output from the first memory means. 5. The imaging device according to any one of items 1 to 4.   The detecting means calculates a deviation amount between two video signals based on a difference in signal level between the video signal output from the first memory means and the synthesized video signal output from the second memory means. The imaging device according to claim 1, wherein the imaging device is detected.   Correction means for correcting storage area information indicating an area for storing the video signal output from the first memory means and synthesized and accumulated in the second memory means based on a detection result of the detection means; The imaging apparatus according to claim 1, further comprising:   The detection means includes two video signals between a luminance signal included in the video signal output from the first memory means and a luminance signal included in the composite video signal output from the second memory means. The image pickup apparatus according to claim 1, wherein an amount of deviation is detected.   The imaging apparatus according to claim 1, wherein the detection of a shift amount between the two video signals executed by the detection unit detects a motion vector.   In the level adjustment, when the video signal output from the first memory means is the Nth picture and the composite video signal output from the second memory means is the N-1th picture, the second memory means The image pickup apparatus according to claim 5, wherein a signal level of the composite video signal output from the video signal is adjusted to 1 / (N−1). An imaging process for capturing a subject image and outputting a video signal;
A first accumulation step of temporarily accumulating the video signal acquired in the imaging step in a first memory means;
A second storage step for sequentially storing the video signals stored in the first memory means and combining the previously stored video signals and sequentially generating a composite video signal generated in the second memory means;
A detection detecting step of detecting a shift amount between two video signals between the video signal stored in the first memory means and the synthesized video signal stored in the second memory means. A method for controlling an imaging apparatus, characterized by:   12. The imaging apparatus control method according to claim 11, wherein the first memory unit and the second memory unit divide a storage area of the same memory and set each storage area.   13. The method according to claim 11, wherein the storage area of the second memory means is larger than the storage area of the first memory means.   2. The composite video signal stored in the second memory means corresponds to a video signal one frame before the video signal stored in the first memory means. The control method of the imaging device according to any one of 11 to 13.   12. The signal level of the composite video signal output from the second memory means is adjusted so as to be the signal level of the video signal output from the first memory means. The control method of the imaging device according to any one of 1 to 14.   In the detecting step, a deviation amount between two video signals is calculated based on a difference in signal level between the video signal output from the first memory means and the synthesized video signal output from the second memory means. The method of controlling an imaging apparatus according to claim 11, wherein detection is performed.   A correction step of correcting storage region information indicating a region for storing the video signal output from the first memory unit and synthesized and accumulated in the second memory unit based on a detection result of the detection step; The imaging apparatus control method according to claim 11, further comprising:   The detection step includes two video signals between a luminance signal included in the video signal output from the first memory means and a luminance signal included in the composite video signal output from the second memory means. The method of controlling an imaging apparatus according to claim 11, wherein an amount of deviation is detected.   The method of controlling an imaging apparatus according to claim 11, wherein the detection of a shift amount between the two video signals performed in the detection step includes a motion vector detection. .   In the level adjustment, when the video signal output from the first memory means is the Nth picture and the composite video signal output from the second memory means is the N-1th picture, the second memory means The method of controlling an imaging apparatus according to claim 15, wherein the level of the composite video signal output from the signal is adjusted to 1 / (N−1).   21. A computer-executable program in which a procedure of a control method for an imaging apparatus according to any one of claims 11 to 20 is described.   21. A computer-readable storage medium storing a program in which a procedure of a control method for an imaging apparatus according to claim 11 is described.

Images