JP2006339903A - Imaging device, image processing method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable anybody to easily obtain a panning image whose background seems to be panned while a subject in motion is made stationary when the subject in motion is photographed. <P>SOLUTION: A control section 32 is equipped with: a means for acquiring a plurality of successive image data from a CCD 32 in specified timing; a means for specifying main subject parts from the respective image data; a means for detecting relative shift quantities of the specified subject parts between the respective image data and the shift direction; and a means for composing the respective image data according to the shift quantities and shift direction that main subject parts overlap in the same position. Consequently, when the subject in motion is photographed, anybody can easily obtain the panning image whose background seems to be panned while the subject is made stationary without moving the camera to accurately follow up the movement of the subject. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image pickup apparatus such as a digital camera, and more particularly to an image pickup apparatus suitable for use when performing a panning shot using a moving body as a subject, and an image processing method and program used for the image pickup apparatus.

  When shooting a moving subject to obtain an image with a sense of speed, the photographer pans (moves) the camera according to the movement of the subject while the shutter speed is set slower than usual. A technique such as so-called “panning” is used in which the background is flushed.

On the other hand, a technique for creating an image representing temporal movement of a subject by synthesizing a plurality of pieces of image data obtained by continuously shooting a moving subject based on a background portion is known. (For example, refer to Patent Document 1).
JP 2001-274970 A

  However, the above-described shooting by panning requires the camera to follow the moving subject accurately, so it is very difficult if not used to it, and the shutter speed is slowed down. The subject is often blurred. In this case, if you set the shutter speed faster, you can reduce the blurring of the main subject, but on the other hand, there will be less blurring of the background, making it impossible to obtain an image that emphasizes the sense of speed of the subject. There is a problem.

  Also, a method for obtaining an image representing the movement of a subject by image composition as in Patent Document 1 is known. However, since the composition is based on the background portion, the main subject is stopped and the background is obtained. You can't get images like panning shots.

  Accordingly, an object of the present invention is to provide an imaging apparatus, an image processing method, and a program that anyone can easily obtain a panning image in which a subject is stopped and the background is flushed when a moving subject is photographed. Is to provide.

  According to a first aspect of the present invention, an imaging device that acquires a plurality of continuous image data from an imaging device at a predetermined timing and specifies a main subject portion from each image data obtained by the imaging device. Based on the deviation amount and the deviation direction detected by the detection means, the detection means for detecting the relative deviation amount and deviation direction between the respective image data of the main subject part identified by the identification means, And image processing means for synthesizing the image data so that the main subject portion overlaps the same position.

  According to such a configuration, a main subject portion is specified from a plurality of image data obtained by continuous shooting, and each image data is synthesized based on the main subject portion. As a result, when shooting a moving subject, anyone can easily get a panoramic image with the subject still and the background flowing without having the camera accurately follow the movement of the subject. Can do.

  According to a second aspect of the present invention, in the imaging apparatus according to the first aspect, the photographing unit performs continuous photographing while setting an exposure time shorter than a predetermined time as a photographing condition, and the image processing unit includes: When the respective image data obtained by the photographing means are superimposed, at least the value of each pixel of the main subject portion is corrected to an appropriate value.

  According to such a configuration, blurring of the main subject portion in each piece of image data can be reduced by continuously shooting with a short exposure time. In this case, even if the exposure time is set to be short, the brightness of the main subject portion can be sufficiently secured by image synthesis, and noise can be removed to improve the SN ratio.

  According to a third aspect of the present invention, in the imaging apparatus according to the first aspect, the specifying unit sets a reference region for capturing a main subject in the finder, and is obtained by the photographing unit. The main subject portion is specified from the positional relationship between each image data obtained and the reference region.

  According to such a configuration, even if the camera does not accurately follow the movement of the subject, the subject portion closest to the reference area set in the finder is identified as the main subject, and the main subject is panned. Images can be obtained.

  According to a fourth aspect of the present invention, in the image pickup apparatus according to the first aspect, a first mode for photographing by following the movement of the subject or a second mode for photographing the subject by fixing the camera is set. Mode setting means, and identification means for identifying a plurality of object parts having different moving speeds based on the respective image data obtained by the photographing means, and the specifying means is the first setting means by the mode setting means. When the mode is set, a portion having the slowest moving speed is identified as the main subject portion among the subject portions identified by the identifying means, and the second mode is set by the mode setting means. In this case, a portion having the fastest moving speed among the subject portions identified by the identifying means is specified as the main subject portion.

  According to such a configuration, even when shooting is performed in accordance with the movement of the subject, or when shooting is performed with the camera fixed, the main subject is specified for each, and the main subject is panned. An image can be obtained.

  According to a fifth aspect of the present invention, there is provided the imaging apparatus according to the first aspect, further comprising interval setting means for arbitrarily setting a time interval for acquiring a plurality of image data by the photographing means.

  According to such a configuration, the amount of blurring of the background portion relative to the main subject and the smoothness of the image can be adjusted by changing the time interval of continuous shooting.

  According to a sixth aspect of the present invention, the image pickup apparatus according to the first aspect further comprises a number setting means for arbitrarily setting the number of image data used for the composition by the image processing means.

  According to such a configuration, the amount of blurring of the background portion relative to the main subject and the smoothness of the image can be adjusted by changing the number of continuous shots.

  An image processing method according to claim 7 of the present invention includes a step of acquiring a plurality of continuous image data from an image sensor at a predetermined timing, a step of specifying a main subject portion from each of the image data, and the specification Detecting a relative shift amount and shift direction between the respective image data of the main subject portion, and based on the detected shift amount and shift direction, the main subject portion overlaps at the same position. Synthesizing each image data.

  According to such an image processing method, the same effect as that of the first aspect of the present invention can be achieved by executing the processing according to each step.

  A program according to claim 8 of the present invention is a program executed by a computer installed in an imaging apparatus, and has a function of acquiring a plurality of continuous image data from an imaging element at a predetermined timing in the computer, A function of specifying a main subject portion from each image data, a function of detecting a relative shift amount and a shift direction between the image data of the specified main subject portion, the detected shift amount, and And a function of combining the image data so that the main subject portion overlaps the same position based on a shift direction.

  Therefore, when the computer executes the program for realizing each function, the same effects as those of the first aspect of the invention can be achieved.

  As described above, according to the present invention, when a moving subject is photographed, the subject can be stopped by simply photographing the subject continuously without having to follow the camera accurately in accordance with the movement of the subject. Anyone can easily get a panoramic image with a background.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing an external configuration when a digital camera is taken as an example of an imaging apparatus according to an embodiment of the present invention. FIG. 1 (a) is mainly a front configuration, and FIG. It is a perspective view which shows the structure of a back surface.

  The digital camera 1 has a photographing lens 3, a self-timer lamp 4, an optical finder window 5, a strobe light emitting unit 6, a microphone unit 7 and the like on the front surface of a substantially rectangular thin plate-like body 2 on the upper surface (for the user). On the right end side, a power key 8 and a shutter key 9 are provided.

  The power key 8 is a key operated every time the power is turned on / off, and the shutter key 9 is a key for instructing a photographing timing at the time of photographing.

  Also, on the back of the digital camera 1, a shooting mode (R) key 10, a playback mode (P) key 11, an optical viewfinder 12, a speaker unit 13, a macro key 14, a strobe key 15, a menu (MENU) key 16, a ring A key 17, a set (SET) key 18, a display unit 19, and the like are provided.

  The shooting mode key 10 is operated automatically from the power-off state to automatically turn on the power and shift to the still image shooting mode. On the other hand, by repeatedly operating from the power-on state, the still image mode and the moving image mode are switched. Set cyclically. The still image mode is a mode for photographing a still image. The moving image mode is a mode for shooting a moving image.

  The shutter key 9 is commonly used for these photographing modes. That is, in the still image mode, a still image is taken at the timing when the shutter key 9 is pressed. In the moving image mode, shooting of a moving image is started at a timing when the shutter key 9 is pressed, and shooting of the moving image is ended when the shutter key 9 is pressed again.

  When the playback mode key 11 is operated from the power-off state, the playback mode key 11 is automatically turned on to enter the playback mode.

  The macro key 14 is operated when switching between normal shooting and macro shooting in the still image shooting mode. The strobe key 15 is operated when switching the light emission mode of the strobe light emitting unit 6. The menu key 16 is operated when selecting various menu items including the panning mode. The ring key 17 is integrally formed with item selection keys in the up, down, left, and right directions, and the set key 18 located in the center of the ring key 17 sets the item selected at that time. To operate.

  The display unit 19 is composed of a color liquid crystal panel with a backlight, and displays a through image on the monitor as an electronic viewfinder in the photographing mode, and reproduces and displays the selected image and the like in the reproduction mode.

  Further, the digital camera 1 is provided with an optical zoom function, and the enlargement ratio of the image can be changed by physically changing the focal length by operating the zoom keys 20a and 20b. Of the zoom keys 20a and 20b, one zoom key 20a is for the telephoto end and is used when the zoom magnification is changed to the telephoto side. The other zoom key 20b is for the wide end and is used when the zoom magnification is changed to the wide angle side.

  Although not shown, the digital camera 1 has a memory card slot for attaching / detaching a memory card used as a recording medium, a serial interface connector for connecting to an external personal computer, etc., for example, USB (Universal). Serial Bus) connector and the like are provided.

  FIG. 2 is a block diagram showing an electronic circuit configuration of the digital camera 1.

  In the digital camera 1, a lens optical system 22 including a focus lens and a zoom lens (not shown) constituting the photographing lens 3 is provided so as to be movable within a predetermined range in the optical axis direction by driving a motor 21. . A CCD (charge coupled device) 23 that is an image sensor is disposed behind the optical axis of the lens optical system 22. The CCD 23 receives light from each part of the subject input through the photographing lens 3 and outputs an electrical signal corresponding to the intensity of the light.

  In the recording mode, which is the basic mode, the CCD 23 is scanned and driven by a timing generator (TG) 24 and a driver 25, and outputs a photoelectric conversion output corresponding to a light image formed at regular intervals for one screen. The photoelectric conversion output of the CCD 23 is appropriately gain-adjusted for each primary color component of RGB in the state of an analog value signal, sampled and held by the sample hold circuit 26, and converted into digital data by the A / D converter 27. The

  Then, the image processing circuit 28 performs image processing including pixel interpolation processing and γ correction processing to generate a digital luminance signal Y and color difference signals U and V (Cb, Cr), and DMA (Direct Memory Access). ) Output to the controller 29.

  The DMA controller 29 once uses the luminance signal Y and the color difference signals U and V output from the image processing circuit 28 by using the composite synchronization signal, the memory write enable signal, and the clock signal from the image processing circuit 28 once. And the DMA transfer to the DRAM 31 used as the buffer memory via the DRAM interface (I / F) 30.

  The control unit 32 controls the entire digital camera 1 and is constituted by a microcomputer including a CPU, a ROM storing an operation program executed by the CPU, and a RAM used as the work memory 32a. Is done.

  After the DMA transfer of the luminance and color difference signals to the DRAM 31, the control unit 32 reads the luminance and color difference signals from the DRAM 31 via the DRAM interface 30 and writes them to the VRAM 34 via the VRAM controller 33.

  The digital video encoder 35 periodically reads the luminance and color difference signals from the VRAM 34 via the VRAM controller 33, generates a video signal based on these data, and outputs the video signal to the display unit 19.

  As described above, the display unit 19 functions as a monitor display unit (electronic finder) at the time of shooting. By performing display based on the video signal from the digital video encoder 35, the display unit 19 captures from the VRAM controller 33 at that time. An image based on the image information is displayed in real time.

  As described above, when the image at that time is displayed in real time as the monitor image on the display unit 19, for example, when the shutter key 9 is pressed at a timing at which still image shooting is desired, a trigger signal is generated.

  In response to the trigger signal, the control unit 32 immediately stops the path from the CCD 23 to the DRAM 31 immediately after the DMA transfer of the luminance and color difference signals for one screen captured from the CCD 23 to the DRAM 31 is completed. , Transition to the record storage state.

  In this recording and storage state, the control unit 32 outputs the luminance and color difference signals for one frame written in the DRAM 31 to 8 pixels × 8 pixels for each of Y, Cb, and Cr components via the DRAM interface 30. The data is read out in units called basic blocks and written in a JPEG (Joint Photographic Coding Experts Group) circuit 37. The JPEG circuit 37 uses an ADCT (Adaptive Discrete Cosine Transform) and an entropy coding system. Data compression is performed by processing such as conversion.

  The obtained code data is read out from the JPEG circuit 37 as a data file of one image and written in the recording memory 38. The memory 38 includes a memory card that is detachably mounted as a recording medium in addition to an internal memory such as a flash memory built in the main body in advance. With the compression processing of the luminance and color difference signals for one frame and the completion of writing all the compressed data to the memory 38, the control unit 32 activates the path from the CCD 23 to the DRAM 31 again.

  The control unit 32 is further connected with an audio processing unit 39, a USB interface (I / F) 40, and a strobe driving unit 41.

  The sound processing unit 39 includes a sound source circuit such as a PCM sound source, digitizes a sound signal input from the microphone unit (MIC) 7 during sound recording, and performs a predetermined data file format such as MP3 (MPEG-1 audio layer). 3) Data compression is performed in accordance with the standard to create an audio data file and send it to the memory 38. On the other hand, when reproducing the audio, the audio data file read from the memory 38 is uncompressed and converted into an analog signal. The sound is output through a speaker unit (SP) 13 provided on the back side.

  The USB interface 40 performs communication control when image data and other information are transmitted / received to / from another information terminal device such as a personal computer connected by wire via a USB connector. The strobe drive unit 41 charges a strobe capacitor (not shown) at the time of shooting, and then drives the strobe light emitting unit 6 to flash based on control from the control unit 32.

  In addition to the shutter key 9 described above, the key input unit 36 includes a power key 8, a shooting mode key 10, a playback mode key 11, a macro key 14, a strobe key 15, a menu key 16, a ring key 17, and a set key. 18, zoom keys 20 a and 20 b and the like, and signals accompanying these key operations are sent directly to the control unit 32.

  Further, when shooting a moving image instead of a still image, when the shutter key 9 is pressed, the above-described JPEG circuit 37 compresses the captured moving image using a technique such as motion-JPEG (Joint Photographic Experts Group). To the memory 38. When the shutter key 9 is operated again, the recording of the moving image data is finished.

  On the other hand, in the playback mode which is the basic mode, the control unit 32 selectively reads out the image data recorded in the memory 38 and is compressed by a procedure completely opposite to the procedure of data compression in the recording mode by the JPEG circuit 37. Decompress image data. The decompressed image data is held in the DRAM 31 via the DRAM interface 30, and then the content held in the DRAM 31 is stored in the VRAM 34 via the VRAM controller 33. The image data is periodically read out from the VRAM 34. A video signal is generated and reproduced and output by the display unit 19.

  If the selected image data is not a still image but a moving image, the multiple frames of still image data that make up the moving image data are played back and displayed sequentially in chronological order, and all the still image data is played back. For example, the top still image data is displayed until the next playback instruction is given.

  Here, before describing the operation of the digital camera 1, the image composition method of the present invention will be briefly described.

  FIG. 3 is a diagram schematically showing the transition of image data when a moving subject is continuously photographed. The hatched portion in the figure is a moving subject. Here, it is assumed that four images P1 to P4 are obtained by continuous shooting.

  Since the main subject is moving, it is difficult to continue shooting at the same position in the frame. For this reason, when the images P1 to P4 obtained by continuous shooting are simply combined, an image in which the subject is blurred as shown in FIG.

  Therefore, by detecting a shift of the main subject between the images, the images P1 to P4 are synthesized so that the main subject overlaps the same position. By such image composition, an image in which the subject is stationary as shown in FIG. 4B is obtained. In addition, since the portion other than the subject in each image, that is, the background portion is changed, an image in which the background portion is flowed can be obtained by compositing with the subject as a reference.

  Next, a specific processing operation for creating such a panning image will be described. Note that the processes shown in the following flowcharts are executed when the control unit 32, which is a microcomputer, reads a predetermined program recorded in a recording medium such as a ROM or a RAM.

  FIG. 5 is a flowchart showing a photographing process by the digital camera 1.

  Assume that a still image is taken mainly with a moving subject such as an automobile. When the shooting mode is set by operating the shooting mode key 10 of FIG. 1, first, a preview image (also referred to as a through image) of the subject currently being shot is displayed on the display unit 19 (step A11).

  The control unit 32 reads the image data sequentially obtained from the CCD 23 until the shutter key 9 is pressed (No in Step A12) (Step A13), and displays the image data on the display unit 19 as a preview image. (Step A14).

  Here, when the shutter key 9 is pressed (Yes in Step A12), the control unit 32 executes a predetermined number of continuous shootings and synthesizes each image data obtained by the continuous shooting (Step A15). . The continuous shooting and image composition processing at this time will be described in detail later with reference to the flowcharts of FIGS.

  When a composite image is obtained in this manner, the composite image is confirmed and displayed on the display unit 19 as a simple panning image (step A16), and then compressed and recorded in the memory 38 by a predetermined method (step S16). Steps A17 and A18).

  Next, the continuous shooting and image composition processing executed in step A15 will be described in detail.

  6 and 7 are flowcharts showing the continuous shooting and image composition processing by the digital camera 1.

  First, it is determined whether or not the panning mode is set (step B11). This panning mode is a mode for easily creating a panning image by image synthesis, and is arbitrarily set by operating the menu key 16, for example.

  Further, when this panning mode is set, a panning mode selection screen 51 as shown in FIG. 8 is displayed. This panning mode selection screen 51 is provided with items 52 to 54 for selecting any one of “camera follow-up mode”, “camera fixed mode”, and “free mode” as the panning mode.

  The “camera follow-up mode” is a mode that assumes a case where the photographer pans and shoots the camera in accordance with the movement of the main subject as shown in FIG. As shown in FIG. 10, the “camera fixed mode” is a mode assuming a case where a main subject is shot with a shooting range of the camera fixed. The “free mode” is a mode that assumes a case where a main subject is photographed by normal camera operation without fixing the camera.

  When such a panning mode is set (Yes in step B11), first, as an imaging condition, the exposure time during continuous shooting is longer than a predetermined time (time determined according to the brightness of the subject). Short (step B12). Continuous shooting is performed at predetermined intervals according to the exposure time, and a predetermined number of image data is acquired from the CCD 23 and temporarily stored in the work memory 32a in the control unit 32 (step B13).

  Note that the continuous shooting time interval and the number of shots can be freely set by the photographer through a continuous shooting setting screen (not shown) displayed by operating the menu key 16, for example.

  Here, the control unit 32 compares a plurality of image data stored in the work memory 32a, and extracts a region portion in which the pixel value and the arrangement pattern thereof are continuously similar over a predetermined area ( Step B14). Then, the movement vectors (velocity and direction) of each pixel in the image of these area portions are calculated (step B15), and the area portions having different movement vectors (velocity and direction) on the image are actually separated with different movement speeds. (Step B16).

  Subsequently, a main subject among these subject portions is specified. The main subject is a subject that the photographer is paying attention to, and the movement of the subject varies depending on the shooting state of the camera. In other words, when shooting with the camera fixed, the main subject moves the fastest on the image, whereas when shooting while panning the camera, the main subject moves the slowest on the image. Will be.

  Therefore, the control unit 32 determines the type of the panning mode that is currently set (step B17). As a result, if the “camera following mode” is set, the image of the subject portion with the slowest moving speed is determined as the main subject (step B18). On the other hand, if the “camera fixed mode” is set, the image of the subject portion with the fastest moving speed is determined as the main subject (step B19).

  If the “free mode” is set, the control unit 32 determines the image of the subject portion closest to the target area in the finder as the main subject (step B20). The target area is set in advance as a reference for capturing the main subject, and is, for example, the center of the screen in the viewfinder.

  When the main subject portion is specified in this way, the control unit 32 detects the relative shift amount and shift direction of the main subject portion between the images based on the movement vector of the main subject portion of each image data. (Step B21).

  Based on the detected relative shift amount and shift direction of the main subject portion, the control unit 32 superimposes the image data so that the main subject portion is at the same position (step B22). At that time, with respect to each pixel corresponding to the main subject portion, each pixel value is averaged except for those that are far apart, or noise removal processing such as majority processing of each pixel value is performed, and each pixel Brightness is corrected by multiplying the pixel value by a predetermined coefficient (step B23). For the values of the pixels corresponding to the portion other than the main subject portion, that is, the background portion, the value of each pixel is added and the brightness is corrected as necessary (step B24).

  In this way, one composite image is generated by correcting the value of each pixel (step B25). FIG. 11 shows an example of a composite image. Reference numeral 61 in the figure denotes a moving subject, which is a portion taken by the photographer as a main subject. Reference numeral 62 denotes a portion other than the main subject, that is, a background portion.

  In this way, when shooting a moving subject, an image based on the subject portion can be obtained simply by continuously shooting the subject without having to follow the camera accurately in accordance with the movement of the subject. By synthesizing, it is possible to easily obtain a panning image in which the main subject portion is stationary and the other background portions are flowed.

  In this case, in normal panning, it is necessary to shoot with a slow shutter speed, so the main subject is likely to be shaken. However, in the present invention, the exposure time for shooting each piece of image data is set short. Therefore, it is possible to reduce the shake of the main subject.

  In general, when the exposure time is shortened, the captured image becomes dark. However, by superimposing the main subject portions of the respective image data by image synthesis, sufficient brightness can be secured and noise can be removed to reduce the SN ratio. Can improve. Such an effect is obtained by image composition based on the main subject portion, and cannot be obtained by image composition based on the background image.

  Further, by shortening the exposure time, even if a portion other than the main subject portion, that is, a background portion is photographed without blurring, the positions of the background portions of each image are shifted and superimposed, as shown in FIG. Can produce a great flow effect.

  In addition, by changing the continuous shooting time interval and the number of shots in step B13 in FIG. 6, the amount of blurring of the background portion relative to the main subject portion and the smoothness of the image can be adjusted.

  In the confirmation display of the composite image in step A16 of the flowchart shown in FIG. 5, when the photographer instructs to redo, the image data used for image composition is not compressed and recorded and stored without performing image compression and recording storage of the composite image. It is also possible to change the number of images and start again from image composition, or return to step A11 and change the interval of continuous shooting to restart from continuous shooting.

  In the above-described embodiment, the digital camera has been described as an example. However, the present invention is not limited to this. For example, in addition to a digital movie camera, a mobile phone or a PDA (Personal Digital Assistant) having a similar imaging function. It is also applicable to.

  In short, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

FIG. 1 is a diagram showing an external configuration when a digital camera is taken as an example of an imaging apparatus according to an embodiment of the present invention. FIG. 2 is a block diagram showing an electronic circuit configuration of the digital camera in the embodiment. FIG. 3 is a diagram schematically showing the transition of image data when a moving subject is continuously photographed. FIG. 4 is a diagram for explaining a method of combining image data obtained by continuous shooting. FIG. 5 is a flowchart showing photographing processing by the digital camera in the embodiment. FIG. 6 is a flowchart showing processing of continuous shooting and image composition by the digital camera in the embodiment. FIG. 7 is a flowchart showing processing of continuous shooting and image composition by the digital camera in the embodiment. FIG. 8 is a diagram showing an example of a panning mode selection screen by the digital camera in the embodiment. FIG. 9 is a diagram for explaining a “camera following mode” by the digital camera in the embodiment. FIG. 10 is a view for explaining the “camera fixing mode” by the digital camera in the embodiment. FIG. 11 is a diagram showing an example of a composite image by the digital camera in the embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Digital camera, 2 ... Body, 3 ... Shooting lens, 4 ... Self-timer lamp, 5 ... Optical finder window, 6 ... Strobe light emission part, 7 ... Microphone part, 8 ... Power key, 9 ... Shutter key, 10 ... Photographing Mode key, 11 ... Playback mode key, 12 ... Optical viewfinder, 13 ... Speaker unit, 14 ... Macro key, 15 ... Strobe key, 16 ... Menu (MENU) key, 17 ... Ring key, 18 ... Set key, DESCRIPTION OF SYMBOLS 19 ... Display part, 20a, 20b ... Zoom key, 21 ... Motor, 22 ... Lens optical system, 23 ... CCD, 24 ... Timing generator (TG), 25 ... Driver, 26 ... Sample hold circuit (S / H), 27 A / D converter, 28 Image processing circuit, 29 DMA controller, 30 DRAM interface (I / F), 31 DRAM, 3 Control unit 32a Work memory 33 VRAM controller 34 VRAM 35 Digital video encoder 36 Key input unit 37 JPEG circuit 38 Memory 39 Audio processing unit 40 USB interface ( (I / F), 41... Strobe driving unit, 51 .. panning mode selection screen, 61... Main subject portion, 62.

Claims (8)

Photographing means for acquiring a plurality of continuous image data from the image sensor at a predetermined timing;
Specifying means for specifying a main subject portion from each image data obtained by the photographing means;
Detecting means for detecting a relative shift amount and a shift direction between the image data of the main subject part specified by the specifying means;
An image processing apparatus comprising: an image processing unit configured to combine the image data so that the main subject portion overlaps the same position based on a shift amount and a shift direction detected by the detection unit. The photographing means performs continuous photographing by setting an exposure time shorter than a predetermined time as a photographing condition,
The image processing means corrects at least the value of each pixel of the main subject portion to an appropriate value when the image data obtained by the photographing means are superimposed. Imaging device.   The specifying unit sets a reference region for capturing a main subject in the finder, and specifies a main subject part from a positional relationship between each image data obtained by the photographing unit and the reference region. The imaging apparatus according to claim 1. Mode setting means for setting a first mode in which shooting is performed following the movement of the subject or a second mode in which the subject is shot while the camera is fixed;
Identification means for identifying a plurality of subject portions having different moving speeds based on each image data obtained by the photographing means,
The specifying unit specifies a portion having the slowest moving speed as a main subject portion among the subject portions identified by the identifying unit when the first mode is set by the mode setting unit, 2. The portion having the fastest moving speed among the subject portions identified by the identifying means when the second mode is set by the mode setting means is specified as a main subject portion. The imaging device described.   The imaging apparatus according to claim 1, further comprising an interval setting unit that arbitrarily sets a time interval for acquiring a plurality of image data by the imaging unit.   2. The image pickup apparatus according to claim 1, further comprising a number setting unit that arbitrarily sets the number of image data used for composition by the image processing unit. Acquiring a plurality of continuous image data from the image sensor at a predetermined timing;
Identifying a main subject portion from each of the image data;
Detecting a relative shift amount and shift direction between the image data of the identified main subject portion;
Combining the image data so that the main subject portion overlaps the same position based on the detected shift amount and shift direction. A program executed by a computer mounted on an imaging device,
In the computer,
A function of acquiring a plurality of continuous image data from the image sensor at a predetermined timing;
A function for specifying a main subject portion from each image data;
A function of detecting a relative shift amount and shift direction between the image data of the identified main subject portion;
And a function of combining the image data so that the main subject portion overlaps the same position based on the detected shift amount and shift direction.

Images