JP6159096B2 - Imaging apparatus, imaging method, and program - Google Patents

Description

  The present invention relates to an image pickup apparatus, and more particularly to an image pickup apparatus and a shooting method for processing a still image and an alternative frame image using a processing parameter in still image shooting during moving image shooting.

  When taking a still image during moving image shooting, there are cases where it is desired to process the still image such as a small face. At this time, since the moving image shooting is temporarily interrupted at the time of still image shooting and a part of the moving image frame is lost, an alternative frame image corresponding to the lost moving image frame is generated. If the same processing as that for the still image is performed on the substitute frame image, and then the encoded moving image frame is lost, an unnatural change may occur in the moving image.

  FIG. 1 shows the same processing parameter as that of a moving image still image, as an alternative frame image that compensates for a missing moving image frame in still image shooting while recording a moving image that has been processed into a moving image using a processing parameter B (not shown). It is the schematic of the processing structure in the case of processing using A. The still image 101 acquired during moving image shooting is resized 102 for the substitute frame image, and the still image 101 and each of the resized substitute frame images 102 are processed 103 using the same processing parameter A 103. At this time, since there is a difference in processing between the moving image frame An 104 immediately before the still image shooting, the moving image frame B 1106 immediately after the still image shooting, and the alternative frame image 105 between them, unnaturalness may occur.

  Conventionally, with respect to such an imaging apparatus, many alternative frame image capturing methods and processing methods for interpolating a missing moving image frame have been proposed. For example, in Patent Document 1, a white balance control value is set independently for each of a still image and a substitute frame image, and the still image and the substitute frame image are developed using the set white balance control value. Yes. However, Patent Document 1 does not describe the setting configuration of the processing parameters when processing such as a small face is performed to generate an alternative frame image.

JP 2006-287803 A

  Therefore, an object of the present invention is to perform processing that does not give unnaturalness to a moving image even for an alternative frame image when recording and performing processing on a captured still image by setting processing parameters during moving image shooting. It is an object of the present invention to provide an imaging device that makes it possible.

  In order to achieve the above object, according to the present invention, an imaging apparatus having a function of capturing a still image while capturing a moving image includes a still image acquisition means for acquiring a still image captured during the recording of a moving image, An alternative frame image generating unit that generates an alternative frame image to be used as a moving image frame that has been lost due to image shooting from the still image, and an image processing unit that processes the moving image and the still image using processing parameters corresponding to each The processing parameter determining means for obtaining the processing parameter of the alternative frame image for processing the alternative frame image separately from the processing parameter for processing the still image and the moving image, and obtaining the processing parameter by the image processing means, The substitute frame image is processed using the processing parameters of the substitute frame image.

  According to the present invention, it is possible to appropriately process an alternative frame image for interpolating a missing frame in still image shooting during moving image shooting.

It is a figure which shows an example of a process structure in the case of processing using the same process parameter for a still image and an alternative frame image in the still image shooting during moving image shooting. 1 is a block diagram illustrating a configuration of an imaging apparatus according to a first embodiment of the present invention. It is a figure which shows an example of the process parameter used in the still image photography in the moving image photography which concerns on 1st Example of this invention. It is a figure which shows the flowchart of the still image shooting operation | movement in the video shooting imaging | photography concerning the 1st Embodiment of this invention. It is a figure which shows an example of the process parameter used in the still image imaging | photography during the video recording which concerns on 2nd Example of this invention. It is a figure which shows the flowchart of the still image shooting operation | movement during the video recording based on 2nd Example of this invention. It is a figure which shows the flowchart of the setting operation | movement of the process parameter which concerns on 2nd Example of this invention. It is a figure which shows an example of the process parameter used in the still image imaging | photography during the video recording which concerns on 3rd Example of this invention. It is a figure which shows the flowchart of the still image shooting operation | movement in the video shooting imaging | photography concerning the 3rd Embodiment of this invention. It is a figure which shows the flowchart of the setting operation | movement of the process parameter which concerns on 3rd Example of this invention.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 2 is a block diagram showing the configuration of the image pickup apparatus 301 according to the first embodiment of the present invention.
In the figure, 202 is an imaging lens, 203 is focus control, 204 is a stop, 205 is exposure control of 204, 206 is an image sensor, 207 is an A / D converter, and 208 is timing control. Light incident from the imaging lens 202 passes through the diaphragm 204 and is converted into an analog electric signal by the imaging element 206. The analog signal output from the image sensor 206 is converted into a digital signal by the A / D converter 207. An image processing unit 209 performs processing such as signal processing and compression of the image output from the A / D converter 207. A memory 210 stores still image data and moving image data. Reference numeral 211 denotes an operation unit that accepts user input, 215 a recording medium, 216 a display control unit, and 217 a display unit. A processing parameter management unit 212 manages processing parameters for each of a still image, a moving image, and an alternative frame image. A processing parameter determination unit 213 uses the processing parameters managed by the processing parameter management unit to determine processing parameters for the substitute frame image. An image processing unit 214 processes each of the still image, the moving image, and the substitute frame image. The image processing unit 214 processes still images and moving images using the processing parameters managed by the processing parameter management unit 212, and uses the processing parameters for the substitute frame image determined by the processing parameter determination unit 213. To process. A control unit 218 executes a control program stored in a memory (not shown) included in the control unit, and controls the focus control 203, the exposure control 203, the timing control 208, the display control unit 215, and the like, and controls data transfer. To do.

Processing parameters managed by the processing parameter management unit 212 of FIG. 2 will be described with reference to FIG.
FIG. 3 is a diagram illustrating an example of processing parameters when separate processing parameters are used for a still image and an alternative frame image in the present embodiment. With respect to each processing content shown in FIG. 3, all processing is performed on the still image, only whitening processing on the skin and teeth is performed on the moving image, and other processing content is not implemented. At this time, the processing parameters for the still image and the moving image are individually set so that the processing parameters for the alternative frame image are executed in the alternative frame image, for example, with a part of the processing content that is not performed in the moving image.

  In this embodiment, the substitute frame image is processed using the processing parameters for the substitute frame image which are different from the still image and moving image processing parameters set as described above.

  The operation of still image shooting while shooting a moving image by the imaging apparatus including the processing parameter determination unit 213 of the present embodiment will be described with reference to the flowchart of FIG. FIG. 4 is a flowchart showing a flow of operations from the start of moving image shooting to the encoding of a substitute frame image into a moving image according to the present embodiment. This operation is achieved by the control unit 218 executing a control program to control each unit of the imaging apparatus.

  First, when the user operates the operation unit 211 or a power switch (not shown) provided separately from the operation unit 211, the imaging apparatus is activated (S401), and moving image shooting is started (S402). Here, the control unit 218 determines whether or not the moving image shooting ends (S403). If the video shooting is finished, the operation of the imaging device is finished (S404). If not, it is determined whether or not the shutter button has been fully pressed (S405). When the shutter button is fully pressed, the control unit 218 interrupts the moving image shooting (S406), and acquires a still image before processing from the memory 310 (S407). After obtaining a still image before processing, two processing operations are performed.

  For example, first, the image processing unit 214 obtains, from the processing parameter management unit 212, still image processing parameters set by the user, for example, by operating the operation unit 211 (S408). Subsequently, the image processing unit 214 processes the still image before processing acquired in S407 using the processing parameters acquired in S408, and stores the processed still image (S409 and S410).

  In another processing operation, the control unit 218 generates a resized image for an alternative frame image corresponding to the moving image frame in which the period during which the moving image capturing is interrupted in S406 is lost from the acquired still image (S411). Next, the processing parameter determination unit 213 acquires processing parameter information for the substitute frame image set by the user by operating the operation unit 211, for example, from the processing parameter management unit 212, and determines the processing parameter information for the alternative frame image. (S412). Subsequently, the image processing unit 214 processes the substitute frame image using the resized image for the substitute frame image acquired in the substitute frame image generation of S411 and the processing parameter determined in S412 and encodes it into a moving image (S413 and S414). . When S410 and S414 are finished, the control unit 218 resumes moving image shooting (S415).

  In the present embodiment, the processing parameters for the still image and the substitute frame image are determined using the processing parameters set by the user, but may be determined using the processing parameters set by the imaging apparatus. Good.

  In addition, although the still image processing unit and the alternative frame image processing unit are illustrated as one processing unit, the still image and the alternative frame image are processed using different processing parameters using different processing units. It is good also as a form. Also, in this embodiment, the execution / non-execution settings for each processing content can be set by the user. However, even if it is fixed, it is configured to be managed by the resolution of the image at the time of shooting or the shooting mode. Also good. For example, the setting as to whether or not the processing content to be performed on the substitute frame image is set may be configured to be performed when the processing value of each processing content of the processing parameter of the still image is smaller than the corresponding threshold value. In this case, the threshold value can be changed according to the resolution of the image at the time of shooting, the shooting mode, and the like.

  According to the present embodiment, in still image shooting during moving image shooting, it is possible to perform appropriate processing on the substitute frame image that interpolates the missing frame, and the processing of the substitute frame image is unnatural to the shot moving image. Makes it possible to prevent giving.

  Next, a second embodiment of the present invention will be described with reference to FIGS. The present embodiment is different from the first embodiment in that the processing parameter indicating the degree of processing of the still image and the processing parameter of the substitute frame image are set using the processing amount threshold provided for each processing content. . Since the configuration of the imaging apparatus is the same as that of the first embodiment, a description thereof is omitted here. Hereinafter, the setting and determination configuration of the processing parameter of the substitute frame image according to the present embodiment will be described.

First, the processing parameters managed by the processing parameter management unit 212 in FIG. 2 will be described with reference to FIG.
FIG. 5 is a diagram illustrating an example in which the processing parameters of the alternative frame image are set separately from the still image using the processing amount indicating the degree of processing of the still image and the processing amount threshold provided for each processing content. It is. Note that the value of the machining amount in FIG. 5 indicates that the greater the value, the greater the degree of machining.

  As shown in FIG. 5, a processing amount threshold is provided for each processing content. Each threshold value is compared with the processing amount of each processing content performed on the still image. Here, when the processing amount of the processing content performed on the still image is equal to or less than the threshold value, the processing amount of the alternative frame image is set to be the same as the processing amount of the still image. If the amount of processing performed on the still image is larger than the threshold value, the processing amount of the substitute frame image is set to be the same as the threshold value.

Next, the operation of still image shooting during moving image shooting using the processing parameters according to the present embodiment shown in FIG. 5 will be described with reference to the flowchart of FIG.
FIG. 6 is a flowchart showing the flow of operations from the start of moving image shooting to the encoding of a substitute frame image into a moving image according to the present embodiment. FIG. 7 is a flowchart showing details of the flow for setting the processing parameters of the substitute frame image according to the present embodiment. In the figure, the same parts as those of the first embodiment shown in FIG.

  Since the operations in S401 to S411 and S413 to S414 are the same as those in the first embodiment, description thereof is omitted here.

  Also in the present embodiment, as in the first embodiment, two processing operations are performed after obtaining the still image processing parameters in S408. One is an operation of processing and storing a still image similar to that of the first embodiment (S409 and S410). Another processing operation is an operation of processing and encoding an alternative frame image using the processing parameters of FIG. 5 according to the present embodiment. Hereinafter, this operation will be described.

  In step S406, the control unit 218 generates a resized image for an alternative frame image corresponding to a moving image frame that lacks a period during which moving image shooting is interrupted from the acquired still image (S411). Next, the processing parameter determination unit 213 acquires processing parameter threshold values provided for each processing content (S601), and uses the processing parameters for still images acquired in S408 and the threshold values acquired in S601 to substitute frames. Processing parameters for the image are determined (S602). The detailed operation of S602 will be described later. Subsequently, the image processing unit 214 processes the resized image for the substitute frame image acquired by the generation of the substitute frame image in S411 using the processing parameters determined in S602, and encodes the resized image into a moving image (S413 and S414). When S410 and S414 are finished, the control unit 218 resumes moving image shooting (S415).

The operation of the machining parameter setting unit 213 of this embodiment will be described with reference to the flowchart of FIG.
FIG. 7 shows a detailed flowchart of the operation of the machining parameter determination unit 213 in S602. The machining content set in the machining parameters is selected (S701). The processing amount of the still image of the selected processing content is compared with the threshold value of the selected processing content (S702). Here, if the amount of processing performed on the still image is equal to or less than the threshold, the amount of processing of the substitute frame image is set to be the same as the amount of processing of the still image (S703). If the amount of processing performed on the still image is larger than the threshold value, the processing amount of the substitute frame image is set to be the same as the threshold value (S704). It is confirmed whether all the processing parameters of the substitute frame image have been set (S705). If they have not been set, the processing parameters of the processing contents of the alternative frame image that have not been set from S701 are set. With the operation as described above, the processing parameter determination unit 213 determines the processing parameter for the substitute frame image.

  In the present embodiment, the still image processing parameters set by the user are used. However, the processing parameters set by the imaging apparatus may be used. Further, when the processing amount performed on the still image is larger than the threshold value, the substitute frame image is processed using the threshold value. However, a configuration may be adopted in which processing is performed with another processing amount set based on the threshold value.

  Further, when the processing amount performed on the still image is smaller than the threshold value, the substitute frame image is processed with the processing amount of the still image. However, the processing may be performed with a processing amount set separately with reference to the threshold value. In this embodiment, the still image processing unit and the alternative frame image processing unit are illustrated as one processing unit. However, different processing parameters are used for the still image and the alternative frame image, respectively. Then, it may be processed. In this embodiment, the threshold value set for each processing content is fixed, but may be set and managed according to the resolution of the image at the time of shooting and the shooting mode. In this embodiment, the still image processing parameter is acquired before the resized image for the alternative frame is acquired. However, the still image processing parameter may be acquired in each of the still image processing operation and the alternative frame image processing operation.

  Also in this embodiment, in still image shooting during moving image shooting, it is possible to perform appropriate processing on the substitute frame image that interpolates the missing frame, and the processing of the substitute frame image makes the shot moving image unnatural. It is possible to prevent that.

  Next, a third embodiment of the present invention will be described with reference to FIGS. In this embodiment, when setting the processing parameters of the substitute frame image, it is possible to select whether the processing amount of each processing content is set based on the processing parameters of the still image or the processing parameters of the moving image. To do. Note that the threshold value is provided for the processing amount indicating the degree of processing of the still image, as in the second embodiment. Further, since the configuration of the imaging apparatus is the same as that of the first embodiment, description thereof is omitted here.

The machining parameters managed by the machining parameter management unit 212 will be described with reference to FIG.
FIG. 8 shows processing parameters set according to the present embodiment. In the figure, the processing parameters for the substitute frame image are based on either the processing amount indicating the degree of processing of still images and moving images, the processing amount threshold provided for each processing content, or the processing parameters of still images or moving images. It is set based on the selection of whether or not to use. In the figure, the value of the processing amount of each processing content indicates that the greater the value, the greater the degree of processing.

  According to FIG. 8, when the moving image processing parameter is selected as a reference, the alternative frame is equal to or less than the moving image processing amount, and when the still image processing parameter is selected, the processing amount is equal to or less than the still image processing amount. Process the image. In this case, the processing amount of each selected processing content is compared with the threshold value provided for each processing content, and if the threshold value is exceeded, the substitute frame image is processed with the processing amount equal to or less than the threshold value.

  The operation of still image shooting during moving image shooting using the processing parameters according to the present embodiment shown in FIG. 8 will be described with reference to the flowcharts of FIGS.

  FIG. 9 is a flowchart showing a flow of operations from the start of moving image shooting to encoding of a substitute frame image into a moving image according to the present embodiment. FIG. 10 is a detailed flowchart of an operation for setting a processing parameter for an alternative frame image according to the present embodiment. In the figure, the same parts as those in the first embodiment shown in FIG.

  Since the operations in S401 to S411 and S413 to S414 are the same as those in the first embodiment, description thereof is omitted here. Also in this embodiment, two processing operations are performed after obtaining the still image processing parameters in S408. One is the operations of S409 and S410 that process and store a still image. Since this operation is the same as that in the first embodiment, the description thereof is omitted as described above. Here, another processing operation will be described.

  In step S406, the control unit 218 generates a resized image for a substitute frame image corresponding to a moving image frame during a period in which moving image shooting is interrupted from the acquired still image (S411). Next, the processing parameter determination unit 213 acquires a processing parameter for a moving image set by the user from the processing parameter management unit 212 (S901), and acquires a threshold provided for each processing content of the processing parameter (S902). . Next, the processing parameter determination unit 213 selects which of the still image processing parameter acquired in S408 and the moving image processing parameter acquired in S901 should be used as a reference for the parameter for processing the substitute frame image (S903). . This selection can be performed by the user operating the operation unit 211. Processing amount for substitute frame image based on processing parameter for still image acquired in S408, processing parameter for moving image acquired in S901, threshold acquired in S902, and selection of moving image or still image in S903 Is set (S904). Thereby, the processing parameters for the substitute frame image are determined. Details of the operation of S904 will be described later.

  Subsequently, the image processing unit 214 processes the substitute frame image using the processing parameters determined in S904 for the resized image for the substitute frame image acquired in S413, and encodes it into a moving image (S413 and S414). When S410 and S414 are finished, the control unit 218 resumes moving image shooting (S415).

The operation of the machining parameter determination unit 213 according to the present embodiment will be described using the flowchart of FIG.
FIG. 10 shows a detailed flowchart of the operation of the machining parameter determination unit 213 in S904.

  First, the machining content set in the machining parameter is selected (S1001). In step S1001, it is determined which of the still image processing parameter and the moving image processing parameter is selected in step S903 as a reference for the processing amount of the selected processing content. When still image use is selected, when the processing amount standard (reference processing amount) for the substitute frame image of the processing content selected in S1001 is set as the still image processing amount, and for moving image is selected, The processing amount of the moving image is selected as the reference processing amount (S1003 and S1004).

  Next, for the machining content selected in S1001, the reference machining amount selected in S1003 or S1004 is compared with the threshold value of the machining content selected in S1001 (S1005). Here, when the reference processing amount is equal to or smaller than the threshold, the processing amount of the alternative frame image is set to be the same as the reference processing amount (S1006). If the reference processing amount is larger than the threshold value, the processing amount of the substitute frame image is set to be the same as the threshold value (S1007). It is confirmed whether all the processing parameters of the substitute frame image have been set (S1008). If they have not been set, the processing parameters of the processing contents of the alternative frame image that have not been set from S1001 are set. With the configuration as described above, the processing parameter determination unit 213 determines a processing parameter for an alternative frame image.

  In the present embodiment, when the selected reference processing amount is larger than the threshold value, the substitute frame image is processed with the threshold value. However, the processing may be performed with another processing amount set based on the threshold value. Further, when the selected reference processing amount is smaller than the threshold value, the substitute frame image is processed with the reference processing amount. However, a configuration may be adopted in which processing is performed with another processing amount set based on the threshold value.

  In this embodiment, the still image processing unit, the moving image processing unit, and the alternative frame image processing unit are illustrated as one processing unit. However, still images, moving images, and alternative frame images are separately processed using the respective processing units. It is good also as a form processed using these processing parameters. In this embodiment, as shown in FIGS. 9 and 10, threshold determination is performed after selecting a processing parameter as a reference, but after processing parameters for still images and moving images are determined as thresholds, the processing parameters are changed. It may be configured to be selected. In this embodiment, the threshold value set for each processing content is fixed. However, the threshold value may be set and managed according to the resolution of the image at the time of shooting and the shooting mode.

  In this embodiment, still image processing parameters are acquired before acquisition of a resized image for an alternative frame. However, a configuration may be used in which each of the still image processing operation and the alternative frame image processing operation is acquired. . Further, in this embodiment, after obtaining the resized image for the substitute frame, the processing parameters and threshold values for the moving image are obtained and the reference parameter is selected. However, both are performed before obtaining the resized image for the substitute frame. It is good.

  Also in this embodiment, in still image shooting during moving image shooting, it is possible to perform appropriate processing on the substitute frame image that interpolates the missing frame, and the processing of the substitute frame image makes the shot moving image unnatural. It is possible to prevent that.

  The respective units constituting the still image shooting during the shooting of the moving image and the operation steps in the imaging apparatus according to the embodiment of the present invention described above are realized by the operation of a program stored in the RAM or ROM of the computer. it can. This program and a computer-readable storage medium storing the program are included in the present invention.

  In addition, the present invention can be implemented as, for example, a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system including a plurality of devices. The present invention may be applied to an apparatus composed of a single device.

  In the present invention, a software program (program corresponding to the flowcharts shown in FIGS. 4, 6, 7, 9, and 10) for realizing the functions of the above-described embodiments is directly or remotely supplied to the system or apparatus. Including cases. This includes the case where the system or the computer of the apparatus is also achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. That is, the present invention also includes a computer program for realizing the functional processing of the present invention. In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Examples of the storage medium for supplying the program include a flexible disk, a hard disk, an optical disk, and a magneto-optical disk. Further, there are MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R) and the like.

  As another program supply method, there is a method of connecting to an Internet home page using a browser of a client computer. It can also be supplied by downloading the computer program itself of the present invention or a compressed file including an automatic installation function from a homepage to a storage medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  As another method, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and encrypted from a homepage via the Internet to users who have cleared predetermined conditions. Download the key information to be solved. It is also possible to execute the encrypted program by using the key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. Furthermore, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can be realized by the processing.

  As another method, a program read from a storage medium is first written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Then, based on the instructions of the program, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are also realized by the processing.

  Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included.

Claims (11)

In an imaging device having a function of shooting a still image while shooting a video,
Still image acquisition means for acquiring a still image captured during the recording of the video;
An alternative frame image generating means for generating an alternative frame image to be used as a moving image frame that is lost due to shooting of the still image from the still image;
Image processing means for processing the moving image and the still image using processing parameters corresponding to each,
Processing parameter determination means for acquiring processing parameters of the substitute frame image for processing the substitute frame image separately from processing parameters for processing the still image and the moving image; and
With
The imaging apparatus, wherein the image processing means processes the substitute frame image using a processing parameter of the substitute frame image.   Each parameter of the moving image, the still image, and the alternative frame image includes a processing amount corresponding to at least a plurality of processing contents, and the processing parameter determination unit performs processing contents and corresponding processing amount to be executed on the alternative frame image. The imaging apparatus according to claim 1, wherein at least one of the parameters is set separately from a processing parameter for processing each of the still image and the moving image.   The processing parameter determination means sets the processing amount of each processing content of the processing parameter of the substitute frame image based on the processing amount of the processing content corresponding to the processing parameter of the still image and a threshold value. The imaging device according to claim 2.   The processing parameter determination unit sets the processing amount of each processing content of the processing parameter of the substitute frame image based on the processing amount and threshold value of the processing content corresponding to the processing parameter of either the moving image or the still image. The imaging apparatus according to claim 2. The processing parameter determination means sets the processing amount of each processing content of the processing parameter of the substitute frame image, the processing amount and threshold value of the processing content corresponding to the processing parameter of the moving image, and the processing parameter of the still image 5. The imaging apparatus according to claim 4 , wherein a processing amount and a threshold value to be processed are selected for each processing content of the substitute frame image. The processing parameter determining means determines the threshold value of the processing amount of each processing content, the imaging apparatus according to any one of claims 3 to 5, characterized in that set in accordance with the resolution or photographing mode of the photographing. In a control method of an image pickup apparatus having a function of taking a still image while shooting a moving image,
A still image acquisition step of acquiring a still image obtained by a function of shooting during shooting of the moving image;
An alternative frame image generation step for generating an alternative frame image to be used as a moving image frame that has been lost due to shooting of the still image from the still image; and
An image processing step of processing the moving image and the still image using processing parameters corresponding to each,
A processing parameter determining step for obtaining processing parameters of the alternative frame image for processing the alternative frame image separately from the processing parameters for processing the still image and the moving image; and
With
The image processing step includes processing the substitute frame image using a processing parameter of the substitute frame image. A program for controlling an imaging device having a function of shooting a still image while shooting a video,
Computer
A still image acquisition means for acquiring a still image taken during shooting of the moving image;
An alternative frame image generating means for generating an alternative frame image to be used as a moving image frame that has been lost due to the shooting of the still image from the still image;
Image processing means for processing the moving image and the still image using processing parameters corresponding to each of the moving image and the still image;
The processing parameter of the substitute frame image for processing the substitute frame image is acquired separately from the processing parameter for processing the still image and the moving image, and is obtained using the processing parameter of the substitute frame image A program that functions as image processing means for processing the substitute frame image. A computer-readable storage medium storing the program according to claim 8 . The program which makes a computer function as each means of the imaging device as described in any one of Claims 1 thru | or 6 . A storage medium storing a program that causes a computer to function as each unit of the imaging apparatus according to any one of claims 1 to 6 .

Images