JPWO2013065242A1 - Image generating apparatus, imaging apparatus, and program - Google Patents

Abstract

The image generation device includes an image acquisition unit that acquires a plurality of still image data acquired by imaging at predetermined time intervals, and a first still image data and a second still image among the plurality of still image data. The composite image generation that generates the first composite image data by combining the data and generates the second composite image data by combining the third still image data and the fourth still image data among the plurality of still image data And a moving image generation unit that generates moving image data having a reproduction interval of the combined image data shorter than a predetermined time interval using the first combined image data and the second combined image data.

Description

  The present invention relates to an image generation device, an imaging device, and a program.

A technique is known in which information is captured and stored in a still image and then converted into a moving image (see, for example, Patent Document 1).
[Prior art documents]
[Patent Literature]
[Patent Document 1] JP-A-11-231385

  When a plurality of still image data is converted into a moving image and reproduced, the image may be difficult to view. For example, if the shutter speed at the time of taking a still image is high, the change in the subject does not look smooth. In addition, if there is a variation in exposure at the time of image capture, the video appears to flicker greatly.

  In the first aspect of the present invention, an image generation device includes an image acquisition unit that acquires a plurality of still image data acquired by imaging at predetermined time intervals, and a plurality of still image data. The first still image data and the second still image data are combined to generate first combined image data, and the third still image data and the fourth still image data of the plurality of still image data are combined to form the first still image data. 2. A moving image that is reproduced at a time interval shorter than a predetermined time interval by using a composite image generating unit that generates composite image data and the first composite image data and the second composite image data. A moving image generation unit for generating data.

  In the second aspect of the present invention, the imaging device generates the moving image data using the imaging unit that captures a plurality of still images at predetermined time intervals and the still image data of the plurality of still images. A generating unit.

  In the third aspect of the present invention, the program acquires a plurality of still image data acquired by imaging at a predetermined time interval, and a first still image of the plurality of still image data The first still image data is generated by combining the data and the second still image data, and the second still image data is generated by combining the third still image data and the fourth still image data among the plurality of still image data. And generating a moving image data having a reproduction interval of the composite image data shorter than a predetermined time interval using the first composite image data and the second composite image data.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

1 shows a block configuration of a camera 2 according to an embodiment. An example of the setting screen regarding time-lapse photography is shown. The still image data and moving image frame obtained by time-lapse photography are schematically shown. An example of the composition process with respect to still image data is shown. An example of the further another synthetic | combination process with respect to still image data is shown. An example of another synthesis process for still image data is shown. A processing flow from the start to the end of the camera 2 is shown. An example of the processing flow accompanied with imaging is shown.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 shows a block configuration of a camera 2 according to an embodiment. A camera 2 as a single-lens reflex camera, which is an example of an interchangeable lens camera, includes a lens 4, a mirror 12, a finder unit 8, an image sensor 26, an A / D conversion circuit 30, a timing generator 28, an image processing block 22, a CPU 16, A display device 18, an operation member 20, an image display device 36, and a recording medium 44 are provided. The image processing block 22 includes an image memory 34, a display circuit 38, and an image processing circuit 24.

  In the imaging preparation stage, the subject luminous flux is guided to the finder unit 8 by the mirror 12, and the subject image can be presented to the user. The finder unit 8 is provided with a photometric element that measures the subject luminous flux, and the output of the photometric element is used to calculate the proper exposure. When an imaging instruction is received from a user or the like, the subject light beam formed by the lens 4 is projected onto the imaging element 26 by raising the mirror 12 and opening the shutter 13.

  The image sensor 26 converts the subject light beam formed by the lens 4 into an electric signal. Examples of the imaging element 26 include solid-state imaging elements such as CMOS and CCD. The image sensor 26 generates and outputs an analog signal of accumulated charges based on the timing signal given by the timing generator 28. The A / D conversion circuit 30 converts the signal output from the image sensor 26 into a digital signal indicating image data and outputs the digital signal to the image processing block 22.

  The image memory 34 temporarily stores image data obtained by imaging by the image sensor 26. When the imaging element 26 performs the imaging operation a plurality of times, a plurality of image data corresponding to each imaging operation is stored in the image memory 34. When the camera 2 captures a still image, the image data of the still image is stored in the image memory 34. When the camera 2 captures a plurality of images as a moving image, a plurality of image data corresponding to the captured plurality of images is stored in the image memory 34 as a plurality of frames constituting the moving image data.

  The image processing circuit 24 performs various image processing on the image data stored in the image memory 34. The display circuit 38 causes the image display device 36 to display the image data obtained by imaging as an image. In addition, the display circuit 38 causes the image display device 36 to display various setting menus for setting the operation of the camera 2. The image display device 36 displays an image and various setting menus according to the signal generated by the display circuit 38. An example of the image display device 36 is a color liquid crystal device such as a TFT liquid crystal.

  The recording medium 44 records the image data processed by the image processing circuit 24. The recording medium 44 may be a non-volatile recording medium. An example of the recording medium 44 is a memory card such as a semiconductor memory that can be attached to and detached from the camera 2.

  For example, the recording medium 44 records image data generated by the image processing circuit. For example, when the camera 2 captures a still image, still image data that is image data of the still image is encoded by a still image data encoding method such as JPEG, and is recorded on the recording medium 44 as still image file data. Is done. The recording medium 44 may record still image data as RAW format data. When still image data is recorded on the recording medium 44, it may be recorded as data in an Exif format image file. Information such as the imaging time may be included in Exif header information and recorded. The information on the imaging time included in the header information may be used when determining whether or not the image file is obtained by time-lapse photography described later. Note that an operation mode capable of capturing and recording a still image is referred to as a still image mode, and an operation mode for performing time-lapse shooting is referred to as a time-lapse shooting mode.

  The recording medium 44 stores a plurality of frames constituting the moving image data by Motion JPEG, H.264, and the like. You may record as moving image data based on standards, such as H.264. As an example, the camera 2 captures images at an imaging rate of about 24 to 60 frames per second when capturing images constituting a moving image. The plurality of frames obtained by imaging may be encoded into moving image data displayed at the same display rate as the imaging rate. Note that an operation mode in which images constituting a moving image can be captured and moving image data can be recorded is referred to as a moving image mode.

  The CPU 16 performs overall control of the camera 2. The display device 18 displays the state of the camera 2 and the like. The display device 18 may be a liquid crystal device that performs simple display. The operation member 20 acquires an instruction from the user. Examples of the operation member 20 include a power switch, a release button, and a live view button. The CPU 16 controls each part of the camera 2 in accordance with a user instruction acquired by the operation member 20.

  The camera 2 can perform time-lapse photography in addition to taking the images constituting the above-described still images and moving images and recording them as data. For example, time-lapse photography is used in a situation where a relatively slowly changing phenomenon is recorded as still image data while the position of the camera 2 and the imaging direction are fixed. In time-lapse photography, the image sensor 26 captures a plurality of still images at predetermined time intervals. In time-lapse photography, the camera 2 converts a plurality of still image data obtained by taking an image into a moving image. For example, moving image data having a display rate higher than a still image capturing rate is generated. This animation enables the user to observe the change in the event in a short time. Of the operations of the camera 2 according to the present embodiment, operations in the case of generating moving image data from a plurality of still image data obtained by time-lapse photography will be mainly described.

  Here, the difference between the moving image mode and the time-lapse shooting mode will be briefly described. Time-lapse photography is performed in order to generate moving image data that is defined to have a playback time shorter than a duration that is a time during which imaging is continued. If the number of frames acquired per second is set to 30 frames in the moving image mode, for example, the generated moving image data is reproduced at a display rate of 30 frames per second as a standard even during reproduction. That is, the time axis at the time of imaging and the time axis at the time of reproduction substantially coincide. In the moving image mode, imaging is performed in synchronism with the real time of display. On the other hand, in the time-lapse shooting mode, for example, one frame of still image is captured at intervals of 4 seconds to generate moving image data. For example, 900 frames of moving image data are generated by one-hour time-lapse photography. However, the moving image data is normally played back at a display rate of 30 frames per second at the time of playback, and the playback is completed in 30 seconds. That is, the time axis during imaging is compressed during reproduction. In other words, according to the time-lapse shooting, it can be said that the imaging interval at the time of imaging is longer than the imaging interval in the normal moving image mode. Note that the duration of imaging in time-lapse photography is expressed as the time from the start of imaging until the end of imaging. For example, when the time lapse duration is set to 1 hour, 900 frames of still image data is obtained when a still image of one frame is captured at intervals of 4 seconds as described above. That is, the time lapse duration includes the time during which the image sensor 26 is not exposed during the still image capturing.

  In the still image mode, the image sensor 26 accumulates subject light as electric charges until the mirror 12 is raised and the shutter 13 is closed. When the charge accumulation is completed, the mirror 12 is lowered and inserted into the subject luminous flux. As described above, the accumulated charge is output to the analog signal A / D conversion circuit 30, and the digital signal indicating the image data is output from the A / D conversion circuit 30. The image data is supplied to the image processing block 22 and subjected to image processing such as white balance adjustment and gamma correction. The image data is further encoded by an encoding method such as JPEG, and is recorded on the recording medium 44 as still image file data.

  In the moving image mode, the shutter 13 is opened with the mirror 12 raised. Accordingly, the subject light flux is always projected onto the image sensor 26. Unlike the still image mode, in the moving image mode, the image sensor 26 sequentially exposes lines by a so-called rolling shutter system. Image processing such as white balance adjustment and gamma correction is performed on the frame of the subject image captured by the rolling shutter system. The image data is further encoded by an encoding method such as JPEG, and is recorded on the recording medium 44 as a file such as Motion JPEG. This operation is continued until an operation for ending the moving image mode is performed. The frame includes H.264. Needless to say, encoding processing such as intra-frame encoding and inter-frame encoding may be performed by an encoding method such as H.264.

  The motion mode operation settings include a frame rate setting for setting the number of times of imaging per second, an image quality setting for setting image quality, and the like. For example, when imaging 30 times per second, for example, 30 fps is selected as the frame rate. In this case, moving image data in which a frame is reproduced at a display rate of 30 fps is generated. In the high image quality setting, for example, a frame having the number of pixels of 1920 × 1080 is generated.

  When time-lapse photography is performed, the image sensor 26 is driven in the same manner as in the still image mode. Specifically, the image sensor 26 captures a plurality of still images at a predetermined time interval by a so-called interval timer method. Then, the image processing circuit 24 converts the obtained plurality of still image data into moving image data by a method suitable for time-lapse photography as will be described later. As an example, a plurality of still image data obtained by time-lapse photography is converted into a moving image according to a moving image operation setting. For example, when the frame rate is set so as to generate moving image data of 30 fps, moving image data with a playback time of 1 second is generated when 30 frames of still images are captured by time-lapse shooting.

  There are four parameters for time-lapse shooting: a still image capturing interval, a continuous time for capturing a plurality of still images, a reproduction time, and a frame rate. The duration is a total period for capturing a plurality of still images, and may be a time from the start of imaging to the end of imaging. For example, when the frame rate is set to 30 fps, the duration is set to 1 hour, and the playback time is set to 30 seconds, the imaging interval is set to 4 seconds.

  FIG. 2 shows an example of a setting screen for setting time-lapse shooting parameters. The frame rate is a display rate at the time of moving image reproduction, and can be selected from 24 fps, 25 fps, 30 fps, 50 fps, and 60 fps. In this example, 30 fps is specified. If two other imaging intervals, durations, and playback times are specified, the remaining one is automatically set. For example, when the duration is specified as 1 hour and the playback time is specified as 30 seconds, the number of still images to be captured is 900, and the imaging interval is set to 4 seconds. If the imaging interval and duration are specified, the playback time is determined. If the imaging interval and playback time is specified, the duration is determined. The CPU 16 controls imaging and generation of moving image data according to each parameter set through the operation member 20.

  FIG. 3 schematically shows still image data and moving image frames obtained by time-lapse photography. In this example, it is assumed that N frames of still image data have been acquired. As described above, the still image data is Motion JPEG, H.264. It is converted into a moving image frame by applying an encoding method such as H.264 and recorded as moving image data that can be presented as a video to the user. Here, with the parameters illustrated in FIG. 2, still images are captured at intervals of 4 seconds. As described above, in time-lapse shooting, still images are captured at a time interval longer than the imaging interval of a normal moving image frame. Therefore, when each of a plurality of obtained still image data is applied as a moving image frame, The motion does not make the image look smooth. For example, when the exposure changes due to a change in sunlight, the image has a flickering feeling.

  Therefore, the image processing circuit 24 generates a single composite image data by combining a plurality of still image data, and applies the generated composite image data as a moving image frame. In this figure, the still image data 300-1 for the first frame and the still image data 300-2 for the second frame are combined to form a first frame 310-1. Similarly, the still image data 300-2 for the second frame and the still image data 300-3 for the third frame are combined into a second frame 310-2. By repeating this, N-1 frames are generated. The image processing circuit 24 may generate moving image data without using any of the still image data 300 of the plurality of still image data 300 as a moving image frame. The image processing circuit 24 may generate moving image data using only the generated N−1 frames 310 as moving image frames. In order to generate moving image data including N frames, N + 1 still images may be captured.

  As shown in this example, by synthesizing multiple still image data and generating each frame of a moving image, the subject image may be blurred in each frame, but when moving images are played back, it is smooth It becomes a picture. Further, even when there is a change in exposure during the imaging of continuously generated still image data, since the exposure is averaged, it is possible to reduce image flicker. According to the camera 2, even if the exposure time is shorter than that in the moving image mode, a smooth image with less flicker can be provided.

  FIG. 4 shows an example of a synthesis process for still image data. As described with reference to FIG. 3, the image processing circuit 24 synthesizes two consecutive frames of still image data into one frame. For example, as described with reference to FIG. 3, the first frame 310-1 is generated by synthesizing the still image data 300-1 and the still image data 300-2 obtained by imaging in the period 400-1. The still image data 300-2 and the still image data 300-3 obtained by imaging in the period 400-2 are combined to generate the second frame 310-2. Further, the third frame 310-3 is generated by synthesizing the third frame still image data 300-3 and the fourth frame still image data 300-4 obtained by imaging in the period 400-3. Also, the fourth frame 310-4 is generated by synthesizing the fourth frame still image data 300-4 and the fifth frame still image data 300-5 obtained by imaging in the period 400-4. Here, the image processing circuit 24 applies w1 as the synthesis weight to the still image data of the first frame, and applies w2 as the synthesis weight to the still image data of the second frame. Specifically, the image processing circuit 24 weights and adds the corresponding pixel values of the two frames of still image data with the corresponding weights, and applies them to the pixel values of the moving image frame. As an example, w1 and w2 may be halved. In this case, two frames of still image data can be synthesized with a gain of ½, and the brightness can be adjusted to suit the exposure at the time of imaging. By applying weights so that the sum is 1, the exposure can be averaged.

  FIG. 5 shows an example of still another synthesis process for still image data. In the example of FIG. 4, two continuous frames of still image data are combined, but in this example, two frames of still image data are combined every other frame to form one frame.

  Specifically, the image processing circuit 24 synthesizes the still image data 300-1 for the first frame and the still image data 300-3 for the third frame among the still image data obtained by imaging in the period 500-1. The first frame 510-1. Similarly, the image processing circuit 24 synthesizes the still image data 300-2 for the second frame and the still image data 300-4 for the fourth frame out of the still image data obtained by imaging in the period 500-2. As the second frame 510-2, the third frame of the still image data 300-3 and the fifth frame of the still image data 300-5 and the fifth frame of the still image data obtained by imaging in the period 500-3 are combined to form the third frame. 510-3. This is repeated to generate N-2 frames. In order to generate moving image data including N frames, N + 2 still images may be captured.

  Here, the image processing circuit 24 applies w1 and w2 as synthesis weights to the still image data of two frames used to generate one frame, respectively. For example, the weight is set so that w1 + w2 = 1. By setting the weights so that the sum of the weights becomes 1, the exposure can be averaged. As an example, you may set 1/2 to w1 and w2. In this case, two frames of still image data can be synthesized with a gain of ½, and the brightness can be adjusted to suit the exposure at the time of imaging.

  According to this example, it is possible to generate one frame from still image data obtained by imaging within a long time range as compared to the example of FIG. For this reason, even when the brightness change of the subject is large, it is possible to reduce the flicker of the image.

  FIG. 6 shows an example of another synthesis process for still image data. In the example of FIG. 4, two continuous frames of still image data are combined, but in this example, three consecutive frames of still image data are combined into one frame. The time range for selecting still image data to be used for composition is the same as in the example of FIG. 5, but the number of still image data used to generate one frame is larger than that in the example of FIG.

  Specifically, the image processing circuit 24 synthesizes the still image data 300-1 to 300-3 of the first frame to the third frame obtained by imaging in the period 600-1 to form a first frame 610-1. Similarly, the image processing circuit 24 combines the still image data 300-2 to 4 of the second frame to the fourth frame obtained by imaging in the period 600-2 to form the second frame 610-2, and the period 600- The still image data 300-3 to 5 of the third frame to the fifth frame obtained by the imaging of the third frame are combined into a third frame 610-3. This is repeated to generate N-2 frames. In order to generate moving image data including N frames, N + 2 still images may be captured.

  For each still image data group including three frames of still image data used for generating one frame, the image processing circuit 24 applies w1 as a synthesis weight to the still image data of the first frame, the second frame, and the third frame. , W2 and w3 apply. For example, the weight is set so that w1 + w2 + w3 = 1. By setting the weights so that the sum of the weights becomes 1, the difference in exposure can be averaged. As an example, you may set 1/3 to w1, w2, and w3. In this case, the still image data of three frames can be combined with a gain of 1/3, and the brightness suitable for the exposure at the time of imaging can be obtained.

  According to this example, one frame can be generated from a larger amount of still image data than in the example of FIG. For this reason, even when the brightness change of the subject is large, it is possible to further reduce the flicker of the video. Note that the user may be allowed to select which of the combining processes described with reference to FIGS. 4 to 6 is applied to the time-lapse shooting.

  As described above, the image processing circuit 24 acquires a plurality of still image data obtained by imaging at predetermined time intervals, and first still image data among the plurality of still image data. And the second still image data are combined to generate first combined image data, and the third still image data and the fourth still image data of the plurality of still image data are combined to generate the second combined image data. Generate. Then, the image processing circuit 24 uses the first composite image data and the second composite image data to generate moving image data in which the playback interval of the composite image data is shorter than a predetermined time interval. The image processing circuit 24 generates moving image data without using a plurality of still image data as image data constituting the moving image data. The image processing circuit 24 may generate moving image data using only a plurality of composite image data as image data. Here, as illustrated in FIG. 4, a plurality of time ranges that should include imaging times of still image data used for generating a plurality of composite image data including the first composite image data and the second composite image data are continuous. It may be a time range to be. Further, as illustrated in FIG. 5 or FIG. 6, a plurality of time ranges may partially overlap. That is, the second still image data and the third still image data may be the same still image data.

  As described with reference to FIGS. 4 to 6, when combining a plurality of still image data, the image processing circuit 24 sets a weight for combining each of the plurality of still image data to be combined. In the examples of FIGS. 4 to 6, the synthesis weight is constant. However, the image processing circuit 24 may set a larger value as a weight to still image data whose imaging time is closer to the center time of each time range. For example, in the example of FIG. 6, the still image data of the second frame may be set more heavily than the still image data of the first frame and the third frame in each still image data group. For example, w1 and w3 may be 0.25 and w2 may be 0.5. Further, the timing at which the maximum weight is set may not be the timing at the center of the time range or the timing in the vicinity thereof, but may be a reference timing predetermined in the time range. For example, the maximum weight may be set for the still image data of the first frame. Specifically, w1, w2, and w3 may be set to 0.5, 0.3, and 0.2, respectively. Needless to say, the maximum weight may be set for the still image data of the third frame. That is, the image processing circuit 24 may set a weight that gradually decreases or increases within each time range. As described above, the image processing circuit 24 may set a larger value as a weight to still image data whose imaging time is closer to a predetermined time in at least one of a plurality of time ranges. . For this reason, the image of the subject at the reference time is reflected relatively strongly in the frame, and at least one of the previous or subsequent frames is taken into consideration, thereby providing an image that has less flicker and looks smooth. Can do.

  Note that the number of uses, which is the number of still image data used for generating one frame, and the time range for selecting still image data used for generating one frame may be set by the user. However, the image processing circuit 24 may automatically set at least one of the usage number and the time range according to the change of the subject. For example, the image processing circuit 24 may set the number of the plurality of still image data used for generating at least one of the plurality of frames as the image change in the plurality of still image data increases. The image processing circuit 24 may set at least one of the plurality of time ranges to be longer as the image change in the plurality of still image data is larger. Here, the image change may be determined based on a brightness change in a plurality of still image data. By setting at least one of the number of uses and the time range based on the brightness change, flicker as an image can be reduced.

  Note that the image processing circuit 24 may set the lengths of the plurality of time ranges so that the brightness change in the plurality of frames is smaller than a predetermined value. For example, when there is a period in which the brightness change of the image represented by the still image data is larger than a predetermined value, the time range is set so that the brightness change includes a period smaller than the predetermined value. The brightness change in a plurality of frames can be made smaller than a predetermined value.

  Instead of setting the time range or in addition to setting the time range, the image processing circuit 24 sets the synthesis weight so that the brightness change in the plurality of frames is smaller than a predetermined value. May be set. For example, in the first time range and the second time range in which continuous or partial periods overlap, the average value of the brightness of the plurality of still image data is brighter in the second time range than in the first time range. In this case, the image processing circuit 24 may set the weight so that the brightness change in the plurality of frames is smaller than a predetermined value in consideration of the brightness of the image represented by each still image data. For example, the image processing circuit 24 sets a larger weight to the still image data of a brighter image in the first time range, and sets a larger weight to the still image data of a darker image in the second time range. May be set. In some cases, flicker as an image can be reduced by the weight setting or the time range setting described above.

  FIG. 7 shows a processing flow from the start to the end of the camera 2. This flow is started when the power switch is turned on.

  In step S700, the CPU 16 performs initial setting. For example, the CPU 16 expands various parameters and the like for controlling the camera 2 from the nonvolatile system memory provided in the CPU 16 to the internal RAM. Examples of the various parameters include the time-lapse photography parameters described with reference to FIG. The CPU 16 sets operating conditions of each part of the camera 2 based on various parameters developed in the internal RAM.

  Subsequently, in step S702, the setting result is displayed on the image display device. For example, the CPU 16 causes the image display device 36 to display the setting result set in step S700.

  Subsequently, in step S704, the CPU 16 determines the content of the user operation on the operation member 20. For example, when a user operation for performing various settings is performed on the operation member 20, the CPU 16 performs the instructed setting process (step S706). Examples of the setting process include a process for setting time-lapse shooting parameters, a process for setting the number of pixels, a process for setting an operation mode with an imaging operation, and the like. Examples of the operation mode include a time-lapse shooting mode. When a user operation for setting the time-lapse shooting mode is performed, the operation mode is set to the time-lapse shooting mode. Further, in this step, it may be selected according to a user operation which one of the synthesis processes described with reference to FIGS. 4 to 6 is applied.

  In step S704, if there is a user operation for instructing the operation member 20 to reproduce an image, reproduction processing is executed (step S722). Examples of the reproduction process include a process of reading out the image data recorded on the recording medium 44 and displaying the thumbnail, a process of displaying the image data instructed by the user on the image display device 36, and the like.

  In step S704, when there is a user operation related to execution of imaging on the operation member 20, a process involving imaging is performed (step S712). Note that examples of user operations related to imaging execution include operations on a release button, a live view button, and the like. If the release button is pressed when the operation mode is not set to the time-lapse shooting mode, a still image is captured. When the live view button is pressed, the live view operation is started. In the live view operation, the captured image is displayed on the image display device 36 in parallel with the image capturing by the image sensor 26. If the release button is operated during the live view operation, a still image is captured and still image data is recorded. When a moving image button is operated as a part of the operation member during the live view operation, the moving image mode is operated. The operation when the operation mode is set to the time-lapse shooting mode will be described with reference to FIG.

  If there is no user instruction in step S704, a photometric process using a photometric element included in the finder unit 8 is performed (step S732). Specifically, photometry by the photometry element and determination of the current appropriate exposure value are executed at regular time intervals. Information indicating the current exposure value determined in step S732 is displayed on the image display device 36 in real time and presented to the user.

  When the processes of step S706, step S712, step S722, and step S732 are completed, the process proceeds to step S708, and it is determined whether or not to turn off the power. For example, it is determined to turn off the power when the power switch is switched to the OFF position, or when there is no user instruction for a predetermined period after the power switch is turned on. If it is determined that the power is to be turned off, the operation is terminated. If it is determined that the power is not to be turned off, the process proceeds to step S704.

  FIG. 8 shows an example of a processing flow involving imaging. That is, it is an example of internal processing in step S712 of FIG. In particular, a processing flow including an imaging operation in time-lapse photography is shown. Specifically, a processing flow when a predetermined user operation is performed when the operation mode is set to the time-lapse shooting mode is shown.

  In step S802, the focus of the lens 4 is adjusted. For example, when the release button is pushed in one step, the CPU 16 adjusts the focus of the lens 4 on a preset focus detection area. When the release button is pressed further deeply, the operation proceeds to time-lapse shooting operation after step S804.

  In step S804, a still image is captured to acquire still image data. Specifically, under the overall control of the CPU 16, the mirror 12 is raised, the shutter 13 is opened according to the timing signal supplied from the timing generator 28, the image sensor 26 is exposed, the shutter 13 is closed, and the mirror 12 is moved. Bring it down. One frame of still image data obtained by imaging is stored in the image memory 34. Subsequently, the image processing circuit 24 performs image processing such as white balance correction and gamma correction on the still image data stored in the image memory 34, and the still image data subjected to the image processing is stored in the image memory 34. Stored (step S806).

  In step S808, it is determined whether still image data having the number of frames used to generate one frame has been acquired. For example, when one frame is generated by combining three frames of still image data, it is determined whether or not at least three frames of still image data used for frame generation are stored in the image memory 34. If still image data having the number of frames used to generate one frame has not been acquired, the process proceeds to step S814.

  When still image data having the number of frames used for synthesis of one frame has been acquired, the still image data is synthesized to generate a frame (step S810). For example, the frame is generated by applying any of the synthesizing processes described with reference to FIGS. The generated frame is encoded by, for example, the JPEG encoding method and stored in the image memory 34 (step S812).

  In step S814, it is determined whether or not to acquire still image data. For example, it is determined whether still image data having the number of frames described in relation to FIG. If still image data having a predetermined number of frames has not been acquired, the process waits until the next imaging timing (step S816). For example, it waits so that the next imaging is started at a timing after a predetermined time interval from the previous imaging timing. The next imaging operation may be triggered and started when a predetermined period has elapsed from the previous imaging timing under the control of a timer or the like. When the wait is completed, the process proceeds to step S804.

  If it is determined in step S814 that still image data having a predetermined number of frames has been acquired, moving image data is generated using a plurality of frames stored in the image memory 34 (step S818). The recorded moving image data is recorded on the recording medium 44 (step S820). For example, motion JPEG format moving image data is generated. When the recording on the recording medium 44 is completed, this flow ends.

  In this flow, not only the frame obtained by combining a plurality of still image data but also a plurality of still image data may be recorded on the recording medium 44. The camera 2 may generate a frame by acquiring a plurality of still image data recorded on the recording medium 44 from the recording medium 44 and combining them.

  In the above description, it is assumed that the camera 2 performs processing from imaging to generation of moving image data. However, by capturing still images from a plurality of still images acquired by the camera and transferring them to a computer such as a personal computer, a program such as application software is operated on the computer to generate moving image data. May be. As described above, according to the processing described in relation to the camera 2 of the present embodiment, flickering and jerky feeling are suppressed by synthesizing a plurality of still image data obtained by time-lapse photography. Video can be provided.

  In step S818 in FIG. 8, moving image data may be generated using a plurality of still image data stored in the image memory 34 in addition to the moving image data generated using a plurality of frames. In this case, in step S820, the first moving image data, which is moving image data generated using a plurality of frames, is recorded on the recording medium 44, and the second moving image, which is moving image data generated using a plurality of still image data. Data may be recorded on the recording medium 44. The second moving image data is recorded in, for example, the Motion JPEG format. Here, the second moving image data is moving image data that is reproduced at a time interval in which the reproduction interval of the still image data is shorter than a predetermined time interval. The first moving image data and the second moving image data may be recorded on the recording medium 44 in association with each other as image data obtained by time-lapse photography. When the first moving image data and the second moving image data are generated and recorded on the recording medium 44, when the reproduction of the image data obtained by the time-lapse shooting is instructed in step S722 illustrated in FIG. One moving image data to be reproduced may be selected from the one moving image data and the second moving image data, and the selected moving image data may be reproduced.

  In step S818, the second moving image data may be generated without generating the first moving image data. In this case, in step S820, the second moving image data may be recorded on the recording medium 44 as the image data obtained by the time-lapse shooting. When the second moving image data is recorded on the recording medium 44 as image data obtained by time-lapse photography, when reproduction of the image data obtained by time-lapse photography is instructed in step S722 illustrated in FIG. The user may select whether to reproduce the second moving image data or to perform reproduction to which the synthesis process is applied. When it is selected that the second moving image data is to be reproduced, the second moving image data is reproduced. When it is selected that the reproduction is applied with the synthesis process, the frame to which the synthesis process is applied is selected. It may be generated and played back. Here, the still image data to which the synthesis process is applied may be generated from the second moving image data recorded on the recording medium 44. For example, frames obtained by applying the synthesis processing described in relation to FIGS. 4 to 6 to a plurality of still image data obtained by decoding the second moving image data in the Motion JPEG format are sequentially applied. You may play it. When the second moving image data is generated and recorded on the recording medium 44 without generating the first moving image data, a plurality of still image data recorded on the image memory 34 by the imaging operation is further recorded on the recording medium 44. May be. In step S722, when it is selected that the reproduction to which the synthesis process is applied is selected, a plurality of still image data recorded on the recording medium 44 is related to FIG. 4 to FIG. The frames obtained by applying the synthesis process described above may be sequentially reproduced. Whether or not to further record a plurality of still image data on the recording medium 44 may be selected in advance by the user. For example, it may be set in advance in step S706 illustrated in FIG.

  As illustrated in the processing flow of FIG. 8, when the first moving image data is generated and recorded on the recording medium 44 without generating the second moving image data, a plurality of still images recorded in the image memory 34 by the imaging operation are recorded. Data may be further recorded on the recording medium 44. In this case, when the reproduction of the image data obtained by the time-lapse photographing is instructed in step S722 illustrated in FIG. 7, the first moving image data should be reproduced or a plurality of still images recorded on the recording medium 44 are recorded. The user may select whether the image data should be reproduced as a moving image. When it is selected that the first moving image data should be reproduced, the first moving image data is reproduced, and when it is selected that a plurality of still image data recorded on the recording medium 44 should be reproduced as a moving image. The still image data recorded on the recording medium 44 is reproduced at a time interval shorter than a predetermined time interval.

  Further, a plurality of still image data recorded in the image memory 34 by the imaging operation may be recorded in the recording medium 44 without generating either the first moving image data or the second moving image data. In this case, in step S722 illustrated in FIG. 7, when reproduction of image data obtained by time-lapse photography is instructed, whether or not reproduction to which the synthesis processing is applied is to be performed is recorded on the recording medium 44. The user may select whether to reproduce a plurality of still image data as a moving image. When it is selected that a plurality of still image data recorded on the recording medium 44 should be reproduced as a moving image, the still image data recorded on the recording medium 44 is shorter than a predetermined time interval. Play at intervals. When it is selected that the playback to which the synthesis process is applied is selected, the synthesis process described with reference to FIGS. 4 to 6 and the like for a plurality of still image data recorded on the recording medium 44 The frames obtained by applying are sequentially reproduced.

  The first moving image data and the second moving image data are generated and recorded, the second moving image data is generated and recorded without generating the first moving image data, or the first moving image is generated without generating the second moving image data. Whether to generate and record data or to record a plurality of still image data recorded in the image memory 34 without generating any of the first moving image data and the second moving image data may be selected in advance by the user. For example, it may be set in advance in step S706 illustrated in FIG. In addition, when image data such as moving image data and still image data recorded on the recording medium 44 is transferred to a computer such as a personal computer and reproduced as a moving image on a computer, the program is controlled by a program running on the computer. The computer may execute processing similar to the processing described in relation to step S722 in FIG.

  The processing described in relation to the camera 2 of the present embodiment can be realized by causing each unit of the camera 2 such as the CPU 16 to operate according to a program. That is, the process can be realized by a so-called computer device. The computer device may load a program for controlling the execution of the above-described process, operate according to the read program, and execute the process. The computer device can load the program by reading a computer-readable recording medium storing the program.

  In the present embodiment, an example of the imaging apparatus has been described by taking up the camera 2 that is a single-lens reflex camera with interchangeable lenses. As imaging devices, entertainment devices such as compact digital cameras and other non-interchangeable cameras, mirrorless single-lens cameras, video cameras, mobile phones with an imaging function, portable information terminals with an imaging function, game machines with an imaging function, etc. For example, various devices having an imaging function can be applied.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The execution order of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior”. It should be noted that they can be implemented in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for the sake of convenience, it means that it is essential to carry out in this order. is not.

2 camera, 4 lens, 8 viewfinder, 12 mirror, 13 shutter, 16 CPU, 18 display device, 20 operation member, 22 image processing block, 24 image processing circuit, 26 image sensor, 28 timing generator, 30 A / D conversion Circuit, 34 image memory, 36 image display device, 38 display circuit, 44 recording medium

Claims (13)

An image acquisition unit for acquiring a plurality of still image data acquired by imaging at predetermined time intervals;
The first still image data and the second still image data of the plurality of still image data are combined to generate first combined image data, and the third still image data and the first still image data of the plurality of still image data are generated. A synthesized image generating unit that generates the second synthesized image data by synthesizing the four still image data;
A moving image generation unit that generates moving image data in which a reproduction interval of the combined image data is shorter than the predetermined time interval using the first combined image data and the second combined image data;
An image generation apparatus comprising: An image number setting unit for setting the number of still image data used for generating at least one of the first synthesized image data and the second synthesized image data as the image change in the plurality of still image data increases; The image generation apparatus according to claim 1. The time range that should include the imaging time of still image data used to generate at least one of the first composite image data and the second composite image data is set longer as the image change in the plurality of still image data is larger. The image generation apparatus according to claim 1, further comprising a time range setting unit. The image generation apparatus according to claim 2, wherein the image change is determined based on a brightness change in the plurality of still image data. 5. The image generation apparatus according to claim 1, further comprising a weight setting unit configured to set a weight in the composition for each of the still image data used for the composition. The weight setting unit has an imaging time at a predetermined time in a time range that should include an imaging time of still image data used for generating at least one of the first composite image data and the second composite image data. The image generation apparatus according to claim 5, wherein a larger value is set as the weight for near still image data. The image generation apparatus according to claim 6, wherein the weight setting unit sets a larger value as the weight for still image data whose imaging time is closer to the central time in the time range. The said time range setting part sets the length of the said time range so that the brightness change in the said 1st synthetic image data and the said 2nd synthetic image data may become smaller than a predetermined value. Image generation device. The image generation apparatus according to claim 5, wherein the weight setting unit sets the weight so that a change in brightness in the first composite image data and the second composite image data is smaller than a predetermined value. The image generation apparatus according to any one of claims 1 to 9, wherein the second still image data and the third still image data are the same still image data. The image generation apparatus according to claim 1, further comprising a recording unit that records the moving image data on a nonvolatile recording medium. An imaging unit that generates a plurality of still image data by imaging at the predetermined time interval;
The image generation device according to any one of claims 1 to 11, wherein the moving image data is generated using the plurality of still image data;
An imaging apparatus comprising: Acquiring a plurality of still image data acquired by imaging at predetermined time intervals;
The first still image data and the second still image data of the plurality of still image data are combined to generate first combined image data, and the third still image data and the first still image data of the plurality of still image data are generated. Synthesizing four still image data to generate second synthesized image data;
Using the first synthesized image data and the second synthesized image data to generate moving image data in which a reproduction interval of the synthesized image data is shorter than the predetermined time interval;
A program that causes a computer to execute.

Images