JP5885451B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus that images a subject and generates image data of the subject.

  2. Description of the Related Art In recent years, there have been known imaging apparatuses such as digital cameras that have a function of intentionally adding effects such as noise, shading, and blurring as well as a function of generating a clean image having a natural impression. An imaging apparatus having such a function enables photographing that gives a unique impression that has not been obtained in the past.

  For example, the following Patent Document 1 discloses a technique for generating a high-contrast image while having a grainy feeling (noise feeling) like a film. According to this technique, it is possible to take a rough and powerful image.

  Further, Patent Document 2 below discloses a technique for generating an image in which the peripheral portion is dimmed. According to this technique, it is possible to take an image having an impression as if taken with a toy camera.

  These conventional techniques can be applied not only to still image shooting but also to moving image shooting. When shooting a moving image, a unique video expression unique to a moving image that does not exist in a still image can be performed by using temporal image transition.

JP 2010-62836 A JP 2010-74244 A

  By the way, in the imaging apparatus, a technique that can perform still image shooting during moving image shooting is also known. In such a case, it is conceivable to give a special effect to the still image by adding moving image-like seasoning using moving image data captured before that.

  However, the number of pixels and the aspect ratio are generally different between a moving image and a still image, and it has been difficult to apply a special effect similar to a special effect to be applied to a moving image to a still image. For this reason, there has been a demand for a technique that can realize optimum video expression individually for moving images and still images taken during moving image shooting.

  The present invention has been made in view of the above, and an object of the present invention is to provide an imaging apparatus capable of realizing optimal video expression individually for a moving image and a still image captured during moving image shooting. To do.

  In order to solve the above-described problems and achieve the object, an imaging apparatus according to the present invention captures a subject, generates image data of the subject, can shoot a moving image, and includes immediately after the end of moving image shooting. An imaging apparatus capable of capturing a still image during moving image shooting, performing image processing to give a first special effect that causes a visual effect over a plurality of frames corresponding to moving image data, and A moving image special that performs image processing for applying a second special effect corresponding to the first special effect to a still image taken during shooting using image data of the moving image taken before the still image An effect image processing unit, and a control unit that controls an application mode of the first and second special effects in the moving image special effect image processing unit are provided.

  In the present invention, still image shooting during moving image shooting includes shooting a still image while shooting a moving image and shooting a still image immediately after moving image shooting. In addition, shooting a still image while shooting a moving image includes a case where moving image shooting is temporarily stopped during still image shooting and a case where still image shooting is performed in parallel with moving image shooting.

  Moreover, in the imaging device according to the present invention, in the above invention, the control unit performs the second special effect on a still image included between the plurality of frames to which the first special effect is applied. It is characterized in that control is performed without imparting.

  Moreover, in the imaging device according to the present invention, in the above invention, the control unit performs the second special effect on a still image included between the plurality of frames to which the first special effect is applied. It is characterized by carrying out control to give.

  The imaging apparatus according to the present invention further includes a storage unit that stores the image data, and the control unit is included between the plurality of frames to which the first special effect is applied. Performing control to give the second special effect to a still image, and storing the image data to which the second special effect is given and the image data to which the second special effect is not given in the storage unit It is characterized by.

  Further, in the imaging device according to the present invention, in the above invention, the special effect image processing unit during moving image sets the number of pixels of moving image data captured before the still image to the number of pixels of image data of the still image. The image processing apparatus includes a resizing processing unit that performs a resizing process that approximates, and combines the image data of the moving image and the image data of the still image that have been subjected to the resizing process by the resizing processing unit.

  In the imaging device according to the present invention, the image processing performed by the moving image special effect image processing unit in the above invention is a process of combining the image data of the previous frame and the latest image data at a predetermined ratio. And when the latest image data is still image data, the resizing processing unit performs resizing processing on the image data.

  In the image pickup apparatus according to the present invention, the image processing performed by the moving image special effect image processing unit may sequentially synthesize specific image data and image data captured after the image data at a predetermined ratio. And when the latest image data is still image data, the resize processing unit performs resizing processing on the image data. It is characterized by performing.

  According to the present invention, while performing image processing to give a first special effect that causes a visual effect over a plurality of frames corresponding to moving image data, a still image shot during moving image shooting, In order to perform image processing to give a second special effect corresponding to the first special effect using image data of a moving image shot before the still image, a moving image and a still image shot during moving image shooting are processed. The optimal video expression can be realized individually.

FIG. 1 is a block diagram showing a configuration of an imaging apparatus according to Embodiment 1 of the present invention. FIG. 2 is a perspective view showing the configuration of the imaging device according to Embodiment 1 of the present invention on the side facing the user (front side). FIG. 3 is a diagram showing an outline of art effect image processing performed by the art effect image processing unit of the imaging apparatus according to Embodiment 1 of the present invention. FIG. 4 is a diagram for explaining the outline of multi-echo. FIG. 5 is a diagram for explaining the outline of the one-shot echo. FIG. 6 is a diagram showing the time change of the coefficient of the SDRAM image synthesized with the latest photographed image. FIG. 7 is a diagram for explaining the outline of transit. FIG. 8 is a diagram showing a temporal change in the coefficient of art effect applied before the start trigger is input in the transit process. FIG. 9 is a diagram for explaining an outline of fluctuation. FIG. 10 is a diagram illustrating an example of assigning operations to the arrow keys of the cross key when recording a moving image and when not recording a moving image. FIG. 11 is a diagram illustrating an operation assignment example (second example) to each arrow key of the cross key when recording a moving image and when not recording a moving image. FIG. 12 is a timing chart illustrating an example of synchronous communication between the lens control unit and the control unit included in the imaging apparatus according to Embodiment 1 of the present invention. FIG. 13 is a flowchart illustrating an outline of processing performed by the imaging apparatus according to Embodiment 1 of the present invention. FIG. 14 is a diagram showing a moving image screen display example on the display unit of the imaging apparatus according to Embodiment 1 of the present invention. FIG. 15 is a flowchart showing an overview of the moving image special effect control process performed by the imaging apparatus according to Embodiment 1 of the present invention. FIG. 16 is a flowchart showing an overview of image processing performed by the imaging apparatus according to Embodiment 1 of the present invention. FIG. 17 is a diagram showing user interface assignments when a moving image is recorded and when a moving image is not recorded in the imaging apparatus according to Modification 1-1 of Embodiment 1 of the present invention. FIG. 18 is a diagram showing user interface assignments when a moving image is recorded and when a moving image is not recorded in the imaging apparatus according to Modification 1-2 of Embodiment 1 of the present invention. FIG. 19 is a diagram showing user interface assignments when a moving image is recorded and when a moving image is not recorded in the imaging apparatus according to Modification 1-3 of Embodiment 1 of the present invention. FIG. 20 is a flowchart showing an overview of the moving image special effect control process performed by the imaging apparatus according to Modification 1-4 of Embodiment 1 of the present invention. FIG. 21 is a block diagram showing a configuration of an imaging apparatus according to Embodiment 2 of the present invention. FIG. 22 is a diagram showing user interface assignment in Embodiment 2 of the present invention. FIG. 23 is a diagram showing an overview of state transitions during moving image recording of the imaging apparatus according to Embodiment 2 of the present invention. FIG. 24 is a diagram showing user interface assignments during moving image recording and still image recording of the imaging apparatus according to Modification 2-1 of Embodiment 2 of the present invention. FIG. 25 is a diagram illustrating a screen display example on the display unit when the imaging apparatus according to the modification 2-2 of the second embodiment of the present invention is in a still image shooting standby state. FIG. 26 is a diagram illustrating a screen display example on the display unit when the imaging apparatus according to the modification 2-2 of the second embodiment of the present invention is in the moving image shooting standby state. FIG. 27 is a diagram illustrating a screen display example on the display unit when transit is selected as the special effect in the moving image. FIG. 28 is a diagram showing a screen display example after the moving image button is pressed on the screen shown in FIG. FIG. 29 is a diagram showing a screen display example on the display unit after the confirmation icon is selected on the screen shown in FIG. FIG. 30 is a diagram illustrating a screen display example of the display unit when the test-on icon is selected on the screen illustrated in FIG. 26 and transition to the test-on state is performed. FIG. 31 is a block diagram showing a configuration of an imaging apparatus according to Embodiment 3 of the present invention. FIG. 32 is a diagram illustrating an example of key assignment when the imaging apparatus according to Embodiment 3 of the present invention is set to the still image shooting mode and the moving image shooting mode, respectively. FIG. 33 is a flowchart showing an outline of processing performed by the imaging apparatus according to Embodiment 3 of the present invention. FIG. 34 is a diagram illustrating an example of key assignment when the imaging apparatus according to the modified example 3-1 of the third embodiment of the present invention is set to the still image shooting mode and the moving image shooting mode, respectively. FIG. 35 is a diagram illustrating a screen display example on the display unit when the imaging apparatus according to the modification 3-2 of the third embodiment of the present invention is in a still image shooting standby state. FIG. 36 is a diagram showing a screen display example displayed by the display unit when the shooting mode icon is selected on the screen shown in FIG. FIG. 37 is a diagram illustrating a screen display example of the display unit in the moving image shooting standby state. FIG. 38 is a flowchart showing an outline of processing performed by the imaging apparatus according to Embodiment 4 of the present invention. FIG. 39 is a block diagram showing a configuration of an imaging apparatus according to Embodiment 5 of the present invention. FIG. 40 is a flowchart showing details of image processing performed by the imaging apparatus according to Embodiment 5 of the present invention. FIG. 41 is a diagram schematically showing the resizing process performed by the resizing processing unit of the imaging apparatus according to Embodiment 5 of the present invention. FIG. 42 is a diagram for schematically explaining the synthesis ratio c in the still image mode and the previous frame image signal. FIG. 43 is a diagram schematically showing resizing processing performed by the imaging apparatus according to Modification 5-1 of Embodiment 5 of the present invention. FIG. 44 is a flowchart showing details of image processing performed by the imaging apparatus according to the embodiment of the present invention. FIG. 45 is a diagram schematically showing an outline of image processing performed by the imaging apparatus according to Embodiment 7 of the present invention. FIG. 46 is a flowchart showing an outline of image processing performed by the imaging apparatus according to Embodiment 7 of the present invention. FIG. 47 is a diagram showing the relationship between Bayer data and exposure dose. FIG. 48 is a diagram schematically showing the main part of the data structure stored in the SDRAM of the imaging apparatus according to Embodiment 7 of the present invention. FIG. 49 is a flowchart showing an overview of multi-echo processing. FIG. 50 is a diagram illustrating the relationship between the image gain value applied when the acquired image is a still image and the number of repetitions. FIG. 51 is a diagram illustrating the relationship between the image gain value and the number of repetitions applied when the acquired image is a still image. FIG. 52 is a diagram schematically showing the main part of the data structure stored in the SDRAM. FIG. 53 is a diagram illustrating a mode of managing a ring buffer using a queue.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the accompanying drawings. In the description of the drawings, the same portions will be described with the same reference numerals.

(Embodiment 1)
In Embodiment 1 of the present invention, when recording of a moving image is started using an imaging device capable of capturing still images and moving images, the function of the user interface for operation input assigned for still images is switched to that for moving image special effects. It is characterized by that.

  The imaging apparatus according to the first embodiment has a function of shooting a still image during moving image shooting. Here, still image shooting during moving image shooting includes shooting a still image while shooting a moving image and shooting a still image immediately after moving image shooting is finished. In addition, when taking a still image while shooting a moving image, there are a case where moving image shooting is temporarily stopped during still image shooting and a case where still image shooting is performed in parallel with moving image shooting.

  FIG. 1 is a block diagram illustrating a configuration of the imaging apparatus according to the first embodiment. FIG. 2 is a perspective view showing the configuration of the imaging device according to Embodiment 1 of the present invention on the side facing the user (front side). An imaging apparatus 1 shown in FIGS. 1 and 2 includes a main body unit 2 and a lens unit 3 that is detachable from the main body unit 2.

  The main body 2 includes a shutter 10, a shutter driving unit 11, an image sensor 12, an image sensor driving unit 13, a signal processing unit 14, an A / D conversion unit 15, an image processing unit 16, and an AE processing unit. 17, AF processing unit 18, image compression / decompression unit 19, input unit 20, display unit 21, display drive unit 22, recording medium 23, memory I / F 24, SDRAM (Synchronous Dynamic Random Access Memory) ) 25, a flash memory 26, a main body communication unit 27, a bus 28, and a control unit 29.

  The shutter 10 sets the state of the image sensor 12 to an exposure state or a light shielding state. The shutter drive unit 11 is configured using a stepping motor or the like, and drives the shutter 10 in accordance with an instruction signal input from the control unit 29.

  The imaging device 12 is configured using a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like that receives the light collected by the lens unit 3 and converts it into an electrical signal. The image sensor drive unit 13 causes the signal processing unit 14 to output image data (analog signal) from the image sensor 12 at a predetermined timing. In this sense, the image sensor driving unit 13 functions as an electronic shutter.

  The signal processing unit 14 performs analog processing on the analog signal input from the image sensor 12 and outputs the analog signal to the A / D conversion unit 15. Specifically, the signal processing unit 14 performs noise reduction processing, gain increase processing, and the like on the analog signal. For example, the signal processing unit 14 performs waveform shaping on the analog signal after reducing reset noise and the like, and further increases the gain so that the target brightness is obtained.

  The A / D conversion unit 15 generates digital image data by performing A / D conversion on the analog signal input from the signal processing unit 14, and outputs the digital image data to the SDRAM 25 via the bus 28.

  The image processing unit 16 acquires image data from the SDRAM 25 via the bus 28, performs various image processing on the acquired image data (RAW data), and generates processed image data. This processed image data is output to the SDRAM 25 via the bus 28. The image processing unit 16 includes a basic image processing unit 161, an art effect image processing unit 162, and a moving image special effect image processing unit 163.

  The basic image processing unit 161 performs at least optical black subtraction processing, white balance (WB) adjustment processing on image data, image data synchronization processing, color matrix calculation processing, gamma when the image sensor is a Bayer array. Basic image processing including correction processing, color reproduction processing, edge enhancement processing, and the like is performed. In addition, the basic image processing unit 161 performs finish effect processing for reproducing a natural image based on preset image processing parameters to generate finish effect image data. Here, the parameters of each image processing are values of contrast, sharpness, saturation, white balance, and gradation.

  The art effect image processing unit 162 performs art effect processing for generating a visual effect by combining a plurality of image processings with respect to one image data to process image data (hereinafter referred to as “art effect image data”). ) Is generated.

  FIG. 3 is a diagram showing an outline of art effect image processing performed by the art effect image processing unit 162. In FIG. 3, as art effect image processing, Fantastic Focus, Fantastic Focus + Starlight, Fantastic Focus + White Edge, Pop Art, Pop Art + Starlight, Pop Art + Pinhole, Pop Art + White Edge, Toy Photo, Rough Monochrome Ten types of diorama are described. Hereinafter, the art effect image processing will be described.

Fantastic focus is a process that gives a soft focus effect in which the entire image is subjected to a blurring process and synthesized at a certain ratio with the image before blurring. Fantastic focus is a tone curve process that brightens the intermediate brightness, leaving the details of the subject in a soft tone and creating an image with a beautiful and fantastic atmosphere as if wrapped in a happy light. Image or produce. The fantastic focus is realized by combining image processing such as tone curve processing, blur processing, alpha blend processing, and image composition processing.
Fantastic focus + starlight is a process of applying a cross filter effect that draws a cross pattern to a high-luminance portion in an image in addition to the fantastic focus.
Fantastic focus + white edge is a process in which, in addition to the phantom focus, an effect of gradually becoming whiter is given from the center of the image to the periphery. Such a whiteness effect can be obtained by changing the pixel value so that the peripheral portion becomes whiter as the distance from the center of the image increases.

Pop art is a process that emphasizes colors colorfully and expresses a bright and fun atmosphere. Pop art is realized by, for example, combining saturation enhancement processing and contrast enhancement processing. The overall effect is high contrast and high saturation.
Pop art + starlight is a process of applying pop art and starlight in layers. In this case, the effect of applying a cross filter to a colorful image can be obtained.
In addition to pop art, pop art + pinhole is a process of applying toy photo (pinhole) that darkens the periphery of an image by shading and gives an effect of looking through a hole. Details of the toy photo will be described later.
Pop art + white edge is a process in which pop art and white edge are overlapped.

  Toy photo is a process in which the brightness is reduced (darker) as the distance from the center of the image increases, and the effect is as if looking into a different space from a hole. Toy photo is realized by combining image processing such as low-pass filter processing, white balance processing, contrast processing, hue / saturation processing, and shading processing that multiplies the luminance signal by a smaller coefficient toward the periphery (toy photo). For details of photo and shading, see, for example, Japanese Patent Application Laid-Open No. 2010-74244.

  Rough monochrome is a process of expressing the strength and roughness of a monochrome image by adding high contrast and grainy noise of the film. Rough monochrome is realized by combining, for example, edge enhancement processing, level correction optimization processing, noise pattern superimposition processing, synthesis processing, contrast processing, and the like (for details of rough monochrome, for example, Japanese Patent Application Laid-Open No. 2010-62836). See the publication). Among these, the noise pattern superimposing process (noise adding process) is a process of adding a noise pattern image created in advance to the original image. The noise pattern image may be generated based on, for example, a random number generated.

  Diorama is a process that creates a high-contrast, high-saturation image on the screen by creating an atmosphere that looks like a miniature model or toy by blurring the periphery of the image. The diorama is realized by combining, for example, hue / saturation processing, contrast processing, peripheral blur processing, synthesis processing, and the like. Among these, the peripheral blur processing performs low-pass filter processing while changing the low-pass coefficient according to the position of the image so that the degree of blurring in the peripheral portion increases according to the distance from the center of the image. Note that as the peripheral blur processing, only the upper and lower sides of the image or only the left and right sides of the image may be blurred.

  The moving image special effect image processing unit 163 performs image processing for adding a special effect to an image when the moving image is recorded. Examples of the special effect during moving image performed by the special effect image processing unit 163 during moving image include multi-echo, one-shot echo, transit, and fluctuation. Hereinafter, these special effects during moving images will be described.

  FIG. 4 is a diagram for explaining the outline of multi-echo. Multi-echo is an effect in which an afterimage remains in an image by repeating the synthesis of the immediately previous recording image and the image just taken for a predetermined period. Specifically, as shown in FIG. 4, the trajectory of movement of the ball 101 can be displayed as an afterimage.

  When the multi-echo is set as the moving image special effect, the moving image special effect image processing unit 163 receives an image of the previous frame with respect to the image generated immediately after the start trigger is input. Is processed at a predetermined ratio (multi-echo processing).

In the case shown in FIG. 4, the moving image special effect image processing unit 163 combines the captured image P1 immediately after the start trigger is input with the recorded image R0 corresponding to the captured image P0 of the previous frame, thereby generating a multi-echo image. R1 is generated. At the time of this synthesis, in each pixel, the signal of the captured image P1 is multiplied by a coefficient of 0.6, while the signal of the recorded image R0 is multiplied by a coefficient of 0.4.
Subsequently, the moving image special effect image processing unit 163 generates a multi-echo image R2 by combining the captured image P2 of the next frame and the combined image R1. When generating the multi-echo image R2, in each pixel, the signal of the captured image P2 is multiplied by a coefficient of 0.6, while the signal of the composite image R1 is multiplied by a coefficient of 0.4.

  The moving image special effect image processing unit 163 sequentially generates the multi-echo images by repeatedly performing the above-described synthesis processing until an end trigger is input. When the end trigger is input, a recording image R5 corresponding to the captured image P5 is recorded on the recording medium 23.

  FIG. 5 is a diagram for explaining the outline of the one-shot echo. One-shot echo is an effect in which an image of a specific frame (instantaneous image) disappears while fading gradually. Specifically, as shown in FIG. 5, the effect is such that the ball 101 photographed at a specific time remains as an afterimage in the photographed image for a while.

  When a one-shot echo is set as a moving image special effect, the moving image special effect image processing unit 163 temporarily stores image data captured and recorded immediately after that in the SDRAM 25 when a start trigger is input. Then, a process (one-shot echo process) is performed in which the image data is synthesized so that the weight gradually decreases with time with respect to the image data captured thereafter.

  In the case shown in FIG. 5, the captured image P1 captured immediately after the start trigger is input is stored in the SDRAM 25 (hereinafter referred to as SDRAM image S1). The moving image special effect image processing unit 163 combines the SDRAM image S1 stored in the SDRAM 25 and the latest photographed image at a predetermined ratio.

In the case shown in FIG. 5, a one-shot echo image R11 corresponding to the captured image P1 is displayed immediately after the start trigger is input.
Thereafter, at time t = t ₂ , the moving image special effect image processing unit 163 generates the one-shot echo image R12 by synthesizing the SDRAM image S1 and the captured image P2. When this synthesis is performed, in each pixel, the signal of the SDRAM image S1 is multiplied by a coefficient a ₁ = 0.8, while the signal of the captured image P2 is multiplied by a coefficient 1-a ₁ = 0.2.
After that, the moving image special effect image processing unit 163, at time t = t ₃ , a = 0.4 is a coefficient that is multiplied by the signal of the SDRAM image S1, and 1−a = 0.6 is a coefficient that is multiplied by the signal of the captured image P3. Is generated as a one-shot echo image R13.
After that, the moving image special effect image processing unit 163, at time t = t ₄ , a = 0.2 is a coefficient to be multiplied by the signal of the SDRAM image S1, and 1−a = 0.8 is a coefficient to be multiplied by the signal of the captured image P4. Is generated as a one-shot echo image R14.
Thereafter, since the coefficient a = 0 at time t = t ₅ , the captured image P5 becomes the recorded image R5.

FIG. 6 is a diagram showing a temporal change in the composition ratio of the SDRAM image synthesized with the latest photographed image. In FIG. 6, the horizontal axis t is the elapsed time from the start trigger input time (t = 0), and the vertical axis a is a coefficient to be multiplied by the signal of each pixel of the SDRAM image S1. As shown in FIG. 6, the coefficient a is a ₁ at t = 0, and decreases smoothly with time, and becomes 0 when a predetermined time t _{5 has} elapsed from the start trigger input. That is, the proportion of the SDRAM image S1 in the composite image is set to gradually decrease with time. As a result, it is possible to create an image in which the SDRAM image S1 gradually disappears with time.

  Note that the curve shown in FIG. 6 is merely an example, and any curve may be used as long as the coefficient a attenuates with time so that the coefficient a smoothly changes so that the coefficient a becomes 0 in a certain time. A curve including a period in which the coefficient a takes a constant value may be used.

  The coefficient a may be determined according to the number of frames from the start trigger. In this case, the coefficient may be reduced to 0 for a predetermined number of frames (for example, 120 frames) while gradually decreasing the value of the coefficient a in units of frames.

  FIG. 7 is a diagram for explaining the outline of transit. Transit is an effect in which an art effect applied to one image is gradually changed to another art effect while changing the ratio. FIG. 7 schematically shows a transit from art effect A to art effect B. In FIG. 7, an art effect image A0 obtained by applying an art effect A to the photographed image P0 is generated immediately before the transit start trigger is input. The time required from the start of art effect switching to the end of switching in transit can be set as appropriate.

  In the case shown in FIG. 7, it is assumed that the art effect A is set before the start trigger is input. That is, immediately before the start trigger is input, the art effect image processing unit 162 forms an art effect image R20 obtained by applying the art effect A to the captured image P0.

When the start trigger is input, the moving image special effect image processing unit 163 multiplies the art effect image A1 obtained by applying the art effect A to the photographed image P1 by a coefficient b (= b ₀ ) = 0.8, while the photographed image A transit image R21 is generated by combining two images obtained by multiplying the art effect image B1 obtained by applying the art effect B to P1 by a coefficient 1-b (= 1-b ₀ ) = 0.2.
Thereafter, the special effect image processing section 163 in the video, at the time t = t _12, the coefficient to be multiplied to the signal of the artistic effect image A2 of the captured image P2 were subjected to artistic effect A and b = 0.6, a captured image P2 A transit image R22 is generated by combining the coefficients of the art effect image B2 subjected to the art effect B with a coefficient 1-b = 0.4.
Thereafter, the special effect image processing section 163 in the video, at the time t = t _13, the coefficient to be multiplied to the signal of the artistic effect image A3 of the captured image P3 subjected to artistic effect A and b = 0.4, the captured image P3 A transit image R23 is generated by combining the coefficients of the art effect image B3 subjected to the art effect B with a coefficient 1-b = 0.6.
Thereafter, the special effect image processing section 163 in the video, at the time t = t _14, the coefficient to be multiplied to the signal of the artistic effect image A4 to the captured image P4 subjected to the artistic effect A and b = 0.2, the captured image P4 A transit image R24 is generated by combining the coefficient of the art effect image B4 subjected to the art effect B with a coefficient 1-b = 0.8.
Then, during moving special effect image processor 163, at time t = t _15, it generates the subjected only artistic effect B in the captured image P5 (b = 0) transit images R25.

FIG. 8 is a diagram showing a temporal change in the art effect synthesis ratio (coefficient) b given before the start trigger is input in the transit process. As shown in FIG. 8, the coefficient b is b ₀ at t = 0, and decreases smoothly with time, and becomes 0 when a predetermined time t _{15 has} elapsed from the start trigger input.

  Note that the curve shown in FIG. 8 is merely an example, and any curve may be used as long as the coefficient b is smoothly changed so that the coefficient b becomes 0 in a certain time, for example, the coefficient b attenuates with time. A curve including a period in which the coefficient b takes a constant value may be used.

  The coefficient b may be determined according to the number of frames from the start trigger. In this case, the coefficient b may be reduced to 0 in a predetermined number of frames (for example, 120 frames) while smoothly decreasing the value of the coefficient b in units of frames.

  FIG. 9 is a diagram showing an outline of fluctuation. Fluctuation is an effect obtained by changing the degree of art effect applied to each frame in a moving image at random. FIG. 9 shows a case where the art effect is a cross filter as an example. In this case, the moving image special effect image processing unit 163 randomly fluctuates the cross 102 with time and gives fluctuation by randomly changing the size of the cross 102 with time.

Next, the configuration of the imaging device 1 will be described.
The AE processing unit 17 acquires image data recorded in the SDRAM 25 via the bus 28, and sets an exposure condition for performing still image shooting or moving image shooting based on the acquired image data. Specifically, the AE processing unit 17 calculates the luminance from the image data, and based on the calculated luminance, for example, determines the setting value of the aperture value (F value), the shutter speed, etc. Perform exposure.

  The AF processing unit 18 acquires image data recorded in the SDRAM 25 via the bus 28, and adjusts the automatic focus of the imaging device 1 based on the acquired image data. For example, the AF processing unit 18 extracts a high-frequency component signal from the image data, performs AF (Auto Focus) calculation processing on the high-frequency component signal, and determines the focus evaluation of the imaging device 1 to perform imaging. The automatic focus of the apparatus 1 is adjusted.

  The image compression / decompression unit 19 acquires image data from the SDRAM 25 via the bus 28, compresses the acquired image data according to a predetermined format, and outputs the compressed image data to the SDRAM 25. Here, the predetermined format includes a JPEG (Joint Photographic Experts Group) system, a Motion JPEG system, and an MP4 (H.264) system. The image compression / decompression unit 19 acquires image data (compressed image data) recorded on the recording medium 23 via the bus 28 and the memory I / F 24, expands (decompresses) the acquired image data, and stores it in the SDRAM 25. Output. Note that a storage unit may be provided inside the imaging apparatus 1 instead of the recording medium 23.

  The input unit 20 includes a setting signal input unit 201 that receives input of various setting signals including a still image shooting condition setting signal that sets shooting conditions in still image shooting and moving image shooting, and starts moving image shooting that instructs at least the start of moving image shooting. A moving image shooting signal input unit 202 that receives a signal input.

  The input unit 20 is realized using an operation signal input user interface provided on the surface of the main body unit 2. Hereinafter, the configuration of the user interface that forms part of the input unit 20 will be described.

  The imaging apparatus 1 has, as a user interface for operation input, a power button 41 that switches the power state of the imaging apparatus 1 to an on state or an off state, and a release button 42 that receives an input of a still image release signal that gives a still image shooting instruction. A mode dial 43 for switching various shooting modes set in the imaging apparatus 1, an operation button 44 for switching various settings of the imaging apparatus 1, a menu button 45 for displaying various settings of the imaging apparatus 1 on the display unit 21, and The playback button 46 for displaying an image corresponding to the image data recorded on the recording medium 23 on the display unit 21, the moving image button 47 for receiving input of a moving image release signal for giving a moving image shooting instruction, and various functions of the imaging device 1. Function key 48 to be set, erase button 49 for erasing data, and display screen of display unit 21 Again it provided, and a touch panel 50 that receives an input signal corresponding to the contact position from the outside.

  The release button 42 can be advanced and retracted by pressing from the outside. When the release button 42 is pressed halfway, a 1st release signal that instructs a shooting preparation operation is input. On the other hand, when the release button 42 is fully pressed, a 2nd release signal instructing still image shooting is input.

  The operation button 44 includes a cross key 441 that has a cross shape in the up / down / left / right directions in order to perform selection setting input on a menu screen or the like, and a determination button 442 for confirming selection by the cross key 441. The cross key 441 includes an up arrow key 443, a down arrow key 444, a left arrow key 445, and a right arrow key 446.

  Of the user interfaces described above, buttons other than the moving image button 47 form part of the setting signal input unit 201. The moving image button 47 forms a part of the moving image shooting signal input unit 202.

  FIG. 10 is a diagram showing an example of assigning operations to the arrow keys of the cross key 441 when the moving image is not being recorded (when the moving image is not recorded) and when the moving image is being recorded (when the moving image is recorded). When a moving image is not being recorded, an exposure correction operation is assigned to the up arrow key 443. The down arrow key 444 is assigned continuous shooting / single shooting operation. An AF target operation is assigned to the left arrow key 445. A flash setting operation is assigned to the right arrow key 446.

  Next, a case where a moving image is being recorded will be described. In this case, a one-shot echo start operation is assigned to the up arrow key 443. The down arrow key 444 is assigned a transit start operation. The left arrow key 445 alternately assigns start and stop operations of multi-echo and functions as a toggle key. A fluctuation start operation is assigned to the right arrow key 446. Note that when setting the end of fluctuation to be arbitrarily selected, the right arrow key 446 may be made to function as a toggle key capable of alternately operating the start and end operations of fluctuation.

  The assignment of input buttons at the time of moving image recording is not limited to that shown in FIG. For example, as shown in FIG. 11, an effect start operation may be assigned to the up arrow key 443, an effect stop operation may be assigned to the down arrow key 444, and an effect switching operation may be assigned to the left arrow key 445 and the right arrow key 446. . In this case, it is more preferable to display the special effect being set on the display unit 21.

  Also, the operation of the cross key 441 may be assigned according to the ease of use or the frequency of use of the operation, or may be set by the user independently. Further, when two adjacent keys (for example, the up arrow key 443 and the right arrow key 446) are both pressed, another operation may be performed.

  The display part 21 is comprised using the display panel which consists of a liquid crystal or organic EL (Electro Luminescence). The display driving unit 22 acquires image data stored in the SDRAM 25 or image data stored in the recording medium 23 via the bus 28 and causes the display unit 21 to display an image corresponding to the acquired image data. Here, for image display, a rec view display that displays image data immediately after shooting for a predetermined time (for example, 3 seconds), a reproduction display that reproduces image data recorded on the recording medium 23, and an image sensor 12 are continuously displayed. Live view display that sequentially displays live view images corresponding to image data to be generated in time series. The display unit 21 appropriately displays operation information of the imaging device 1 and information related to shooting.

  The recording medium 23 is configured using a memory card or the like mounted from the outside of the imaging device 1. The recording medium 23 is detachably attached to the imaging device 1 via the memory I / F 24. Image data processed by the image processing unit 16 and the image compression / decompression unit 19 by a read / write device (not shown) corresponding to the type is written on the recording medium 23, or image data recorded on the recording medium 23 by the read / write device Is read out. The recording medium 23 may output the imaging program and various types of information to the flash memory 26 via the memory I / F 24 and the bus 28 under the control of the control unit 29.

  The SDRAM 25 is configured using a volatile memory. The SDRAM 25 temporarily stores image data input from the A / D converter 15 via the bus 28, processed image data input from the image processor 16, and information being processed by the imaging device 1. As a function. For example, the SDRAM 25 temporarily stores image data that the image sensor 12 sequentially outputs for each frame via the signal processing unit 14, the A / D conversion unit 15, and the bus 28.

  The flash memory 26 is configured using a nonvolatile memory. The flash memory 26 includes a program recording unit 261, a special effect processing information recording unit 262, and an image processing information recording unit 263. The program recording unit 261 records various programs for operating the imaging apparatus 1, imaging programs, various data used during execution of the programs, various parameters necessary for image processing operations by the image processing unit 16, and the like. The special effect processing information recording unit 262 records image processing combination information in each art effect processing performed by the art effect image processing unit 162. The image processing information recording unit 263 records image processing information in which processing time is associated with image processing that can be executed by the image processing unit 16. Further, the flash memory 26 records a manufacturing number for specifying the imaging device 1.

  The main body communication unit 27 is a communication interface for performing communication with the lens unit 3 attached to the main body unit 2. The main body communication unit 27 also includes an electrical contact with the lens unit 3.

  The bus 28 is configured using a transmission path or the like that connects each component of the imaging device 1. The bus 28 transfers various data generated inside the imaging apparatus 1 to each component of the imaging apparatus 1.

  The control unit 29 is configured using a CPU (Central Processing Unit) or the like. The control unit 29 includes an image processing control unit 291 and a display control unit 292.

  The image processing control unit 291 sets the content of image processing to be executed by the image processing unit 16 in accordance with an instruction signal from the input unit 20 input via the bus 28, and performs image processing according to the set content. Is executed by any one of the basic image processing unit 161, the art effect image processing unit 162, and the moving image special effect image processing unit 163.

  The display control unit 292 controls the display mode of the display unit 21. Specifically, the display control unit 292 drives the display driving unit 22 and causes the display unit 21 to display images corresponding to various image data processed by the image processing unit 16.

  In response to the instruction signal transmitted from the input unit 20 via the bus 28, the control unit 29 transmits the control signal and various data to each unit constituting the imaging device 1, thereby operating the imaging device 1. Overall control.

  When a 2nd release signal is input via the release button 42, the control unit 29 performs control to start a still image shooting operation in the imaging device 1. In addition, when a moving image shooting start signal is input via the moving image button 47, the control unit 29 performs control to start a moving image shooting operation in the imaging device 1. Here, the imaging operation in the imaging apparatus 1 refers to the signal processing unit 14, the A / D conversion unit 15, and the image processing for the image data output from the imaging device 12 by driving the shutter driving unit 11 and the imaging device driving unit 13. An operation in which the unit 16 performs a predetermined process. The image data thus processed is compressed in accordance with a predetermined format by the image compression / expansion unit 19 under the control of the image processing control unit 291, and is recorded via the bus 28 and the memory I / F 24. To be recorded. In the first embodiment, the recording medium 23 forms a part of the storage unit, but a storage area having the function of the storage unit is secured inside the imaging apparatus 1 separately from the recording medium 23, and this storage area The compressed image data may be stored.

  For the main body 2 having the above-described configuration, an audio input / output unit, an auxiliary light emitting unit that emits auxiliary light (flash) to the subject, and a function of bidirectionally communicating with an external device via the Internet You may provide further the communication part etc. which have.

  Next, the configuration of the lens unit 3 will be described. The lens unit 3 includes an optical system 31, a lens driving unit 32, a diaphragm 33, a diaphragm driving unit 34, a lens operation unit 35, a lens flash memory 36, a lens communication unit 37, a lens control unit 38, Is provided.

  The optical system 31 is configured using one or a plurality of lenses. The optical system 31 collects light from a predetermined visual field region. The optical system 31 has an optical zoom function for changing the angle of view and a focus function for changing the focus.

  The lens driving unit 32 is configured using a DC motor, a stepping motor, or the like, and changes the focus position, the angle of view, and the like of the optical system 31 by moving the lens of the optical system 31 on the optical axis L.

The diaphragm 33 adjusts the exposure by limiting the amount of incident light collected by the optical system 31.
The aperture drive unit 34 is configured using a stepping motor or the like, and drives the aperture 33.

  As shown in FIG. 2, the lens operation unit 35 is a ring provided around the lens barrel of the lens unit 3. The lens operation unit 35 receives an operation signal for starting an optical zoom operation in the lens unit 3 or in the lens unit 3. An instruction signal for instructing adjustment of the focus position is received. The lens operation unit 35 may be a push switch or the like.

  The lens flash memory 36 records a control program for determining the position and movement of the optical system 31, the lens characteristics of the optical system 31, and various parameters.

  The lens communication unit 37 is a communication interface for communicating with the main body communication unit 27 of the main body unit 2 when the lens unit 3 is attached to the main body unit 2. The lens communication unit 37 includes an electrical contact with the main body unit 2.

  The lens control unit 38 is configured using a CPU (Central Processing Unit) or the like. The lens control unit 38 controls the operation of the lens unit 3 in accordance with an operation signal from the lens operation unit 35 or an instruction signal from the main body unit 2. Specifically, the lens control unit 38 drives the lens driving unit 32 in accordance with an operation signal from the lens operation unit 35 to focus the lens unit 3 and change the zoom, and also drives the aperture driving unit 34. To change the aperture value. When the lens unit 3 is attached to the main body unit 2, the lens control unit 38 transmits the focus position information of the lens unit 3, the focal length, unique information for identifying the lens unit 3, and the like to the main body unit 2. It may be.

  The lens control unit 38 transmits and receives a lens communication signal to and from the control unit 29 of the main body unit 2 at a predetermined cycle so as to coordinate the operation with the main body unit 2. FIG. 12 is a timing chart illustrating an example of synchronous communication between the lens control unit 38 and the control unit 29. FIG. 12A shows processing in the main body 2. FIG. 12B shows a vertical synchronization signal. FIG. 12C shows the timing of imaging and reading. FIG. 12D shows lens communication. FIG. 12E shows a lens communication synchronization signal. FIG. 12F shows the lens position acquisition signal. FIG. 12G shows processing in the lens unit 3.

  First, the control unit 29 causes the image processing unit 16 to perform image processing of the live view image, calculation of the AF evaluation value, and the like based on the image data acquired in the previous frame, and also causes the lens control unit 38 to acquire lens state data. The lens state data request command is transmitted (B1, BL). At this time, during the synchronous communication mode, the control unit 29 transmits a lens position acquisition signal instructing the timing for acquiring the lens communication synchronization signal and the position information of the optical system 31 at the same cycle as the vertical synchronization signal. This lens position acquisition signal is a signal whose state changes when half of the accumulation time at the center of the image sensor 12 has elapsed, as shown in FIG.

  The lens control unit 38 acquires the position information of the optical system 31 at the timing when the state of the lens position acquisition signal changes, and detects the operation state of the lens operation unit 35 at the reception timing of the lens communication synchronization signal (L1).

  Subsequently, as a response to the lens state data request command received from the control unit 29, the lens control unit 38 obtains lens state data including the positional information of the optical system 31 and the search state of the lens operation unit 35 acquired in step L1. It transmits to the control part 29 (L2).

  Thereafter, the control unit 29 performs various setting changes such as calculation of the AF evaluation value and change of the exposure value based on the lens state data sent from the lens control unit 38 (B2).

  The control unit 29 and the lens control unit 38 periodically repeat the processing described above.

  FIG. 13 is a flowchart illustrating an outline of processing performed by the imaging apparatus 1 having the above configuration. In FIG. 13, first, when the power button 41 is operated by the user to turn on the power of the imaging apparatus 1 (step S1: Yes), the control unit 29 initializes the imaging apparatus 1 (step S2). ). In this initialization process, for example, the control unit 29 resets a recording flag indicating that a moving image is being recorded to an off state, resets a special effect flag indicating application relating to a special effect in the moving image to an off state, Processing for starting lens communication (see FIG. 12) with the control unit 38 is performed. If the power of the imaging device 1 is not on (step S1: No), the imaging device 1 repeats step S1.

  Subsequently, when the playback button 46 is not operated (step S3: No) and the menu button 45 is operated (step S4: Yes), the imaging apparatus 1 displays a menu screen for changing the setting. Then, a setting process for setting various conditions of the imaging device 1 in accordance with the user's selection operation is executed (step S5). After step S5, the imaging apparatus 1 proceeds to step S7 described later.

  The contents set here are finish effect processing, art effect processing, still image recording mode, moving image recording mode, moving image special effect processing, and the like. Finishing effect processing includes, for example, natural processing that finishes an image in a natural color, vivid processing that finishes an image vividly, flat processing that focuses on the subject material, and finishes the image in monochrome. Monotone that is processing is included. The still image recording mode is determined according to the type of still image to be recorded, and includes, for example, a JPEG recording mode, a JPEG + RAW recording mode, and a RAW recording mode. The moving image shooting mode is a mode determined according to the moving image compression format, and includes, for example, a Motion-JPEG mode, an MP4 (H.264) mode, and the like. What is set in the special effect processing during moving image is, for example, the destination of the art effect switching due to transit or fluctuation.

  When the playback button 46 is operated in step S3 (step S3: Yes), the imaging apparatus 1 performs a playback process (step S6). In step S6, the display control unit 292 causes the display unit 21 to display a list of files recorded on the recording medium 23. Thereafter, when a reproduction image is selected and input by the input unit 20, image data is acquired from the recording medium 23, and the acquired image data is expanded by the image compression / decompression unit 19 and displayed on the display unit 21. Thereafter, the imaging apparatus 1 proceeds to step S18.

  When the playback button 46 is not operated in step S3 (step S3: No), and the movie button 47 is operated when the menu button 45 is not operated (step S4: No) (step S7: Yes). The control unit 29 inverts the recording flag indicating that the moving image is being recorded (step S8). Specifically, for example, when the recording flag is in an on state, the control unit 29 inverts the recording flag to an off state.

  Subsequently, the control unit 29 determines whether or not the recording flag recorded in the SDRAM 25 is in an ON state (step S9). When it is determined that the recording flag is in the on state (step S9: Yes), the control unit 29 generates a moving image file for recording the image data in time series on the recording medium 23 and stores the moving image file on the recording medium 23. Store (step S10).

  Thereafter, the control unit 29 sets a user interface (UI) for special moving images (step S11). With this setting, for example, assignment at the time of moving image recording as shown in FIG. 10 is executed. The control unit 29 recognizes a signal that is subsequently received by the user interface set in step S11 as a special moving image signal based on FIG.

  Subsequently, the display control unit 292 switches to a screen for moving images by switching settings such as on-screen display (OSD) to be displayed on the display unit 21 (step S12). Specifically, the display control unit 292 displays, for example, a remaining time or an icon indicating that a special effect can be applied during moving image shooting. Thereafter, the imaging apparatus 1 proceeds to step S15 described later.

  FIG. 14 is a diagram illustrating a moving image screen display example on the display unit 21. As shown in FIG. 14, on the moving image screen Q, a moving image icon 111 indicating that the moving image special effect is applicable, an on-screen display 112 indicating moving image key assignment, and the remaining time for displaying the remaining time of moving image shooting. Time 113 is displayed. Among these, the on-screen display 112 may be automatically displayed after being displayed for a few seconds, or may be always displayed. Further, the display on the screen 112 may be switched between display and non-display by an input from the setting signal input unit 201.

  If it is determined in step S9 that the recording flag is off (step S9: No), the control unit 29 sets the still image user interface (step S13).

  Subsequently, the display control unit 292 switches settings such as on-screen display on the display unit 21 to still images (step S14). By this switching, the display unit 21 displays, for example, the remaining number of recorded sheets, an icon indicating that a special effect can be applied during still image shooting, and the like. Thereafter, the imaging apparatus 1 proceeds to step S15 described later.

  In step S7, when the moving image button 47 is not operated (step S7: No), the image processing control unit 291 causes the moving image special effect image processing unit 163 to perform moving image special effect processing (step S15). .

  FIG. 15 is a flowchart showing an outline of the special effect control process during moving images. In FIG. 15, when the key for starting the special effect during moving image is operated (step S31: Yes), the image processing control unit 291 turns on the special effect flag during moving image (step S32). Thereafter, the image processing control unit 291 performs effect setting (step S33).

  When the key for starting the special effect during moving image is not operated (step S31: No), when the end instruction is input (step S34: Yes), the image processing control unit 291 turns off the special effect flag during moving image. Control is performed (step S35). Thereafter, the imaging apparatus 1 returns to the main routine.

  On the other hand, when the key for starting the special effect during moving image is not operated (step S31: No), when the end instruction is not input (step S34: No), the imaging device 1 returns to the main routine.

  When the first release signal is input from the release button 42 after the special effect control process during moving image in step S15 (step S16: Yes), the control unit 29 causes the AE processing unit 17 to execute the AE process for adjusting the exposure. At the same time, the AF processing unit 18 is caused to execute AF processing for adjusting the focus (step S17).

  Subsequently, the control unit 29 determines whether or not the power of the imaging device 1 is turned off by operating the power button 41 (step S18). When the control unit 29 determines that the power of the imaging device 1 has been turned off (step S18: Yes), the imaging device 1 ends this process. On the other hand, when the control unit 29 determines that the power of the imaging device 1 is not turned off (step S18: No), the imaging device 1 returns to step S3.

  When the 1st release signal is not input from the release button 42 (step S16: No), when the 2nd release signal is input from the release button 42 (step S19: Yes), the control unit 29 drives the shutter drive unit 11 and the image sensor. Each unit 13 is driven to perform photographing with a mechanical shutter (step S20).

  Subsequently, the image processing unit 16 performs predetermined image processing on the captured still image (step S21). Details of the image processing will be described later.

  Thereafter, the control unit 29 causes the image compression / expansion unit 19 to compress the image data in the JPEG format, and records the compressed image data on the recording medium 23 (step S22). In step S22, the control unit 29 records the RAW data that has not been subjected to image processing by the image processing unit 16 in association with the image data compressed by the image compression / decompression unit 19 in the JPEG format, and records the image data on the recording medium 23. May be. After step S22, the imaging device 1 proceeds to step S18.

  In step S19, when the 2nd release signal is not input from the release button 42 (step S19: No), the control unit 29 causes the AE processing unit 17 to execute the AE process for adjusting the exposure, and the AF processing unit 18 is focused. The AF process to be adjusted is executed (step S23).

  Subsequently, the control unit 29 drives the image sensor driving unit 13 to execute photographing with the electronic shutter (step S24).

  Thereafter, the image processing unit 16 performs image processing based on the setting information of the imaging device 1 (step S25). Details of the image processing will be described later.

  The display control unit 292 causes the display unit 21 to display a live view image corresponding to the image data processed by the image processing unit 16 (step S26).

  Subsequently, if the imaging apparatus 1 is recording a moving image (step S27: Yes), the control unit 29 causes the image compression / expansion unit 19 to compress the image data, and the compressed image data is created on the recording medium 23. The moving image file is recorded as a moving image (step S28). Thereafter, the imaging apparatus 1 proceeds to step S18. On the other hand, if the moving image is not being recorded in step S27 (step S27: No), the imaging device 1 proceeds to step S18.

  FIG. 16 is a flowchart showing an overview of image processing. In FIG. 16, the basic image processing unit 161 performs basic image processing (step S41). The basic image processing here includes processing such as subtraction of OB (Optical Black) values, WB correction, synchronization, color matrix calculation, gamma conversion color correction, edge enhancement, and NR (Noise Reduction).

Here, in the WB correction, the Bayer array image data is multiplied by the R gain and the B gain corresponding to the WB mode set in advance by the user, and the WB is read from the flash memory of the imaging apparatus main body and multiplied by the value. This is a process of correcting by this.
Synchronization is a process of converting each pixel into RGB data by interpolating data that does not exist in that pixel when the image sensor 12 is a Bayer array.
The color matrix calculation is a process of reading and multiplying the color matrix coefficient corresponding to the set WB mode from the flash memory of the main body.
In the gamma conversion color correction process, a gamma table designed in advance according to the finish setting is read from the flash memory of the main body, and the image data is gamma converted. At this time, the gamma conversion applied to the RGB data, and the RGB color space are converted into the color space represented by the luminance signal Y and the two color difference signals Cb and Cr, and then the gamma conversion is performed only on the luminance signal Y. May be. Further, in order to obtain appropriate color reproducibility, the color may be corrected using side parameters designed in advance according to the setting of the finish. The gamma curve may be changed depending on the type of art effect.
In the edge enhancement process, an edge component is extracted by a band pass filter, and is multiplied by a coefficient corresponding to the degree of edge enhancement and added to image data for enhancement.
In NR processing, noise is reduced by frequency-decomposing an image and performing coring processing or the like according to the frequency.

  Subsequently, the art effect image processing unit 162 performs art effect processing (step S42). Here, processing such as the above-described cross filter, soft focus, noise addition, shading, peripheral brightness increase, peripheral blur, and the like are performed.

  Thereafter, when the imaging apparatus 1 performs still image shooting (step S43: Yes), the control unit 29 applies a special effect (second special effect) corresponding to the special effect during the moving image (first special effect) to the still image. After performing control for prohibiting image data from being added, the process returns to the main routine.

Here, the reason why the special effect corresponding to the special effect during moving image is not provided when the imaging apparatus 1 performs still image shooting will be described. Response speed is important for still image shooting during movie shooting. Since the number of pixels of a still image is about several times larger than the number of pixels of a moving image, if a special effect during moving image is applied to a still image, there is a possibility of affecting the resumption timing of moving image shooting after still image shooting. Therefore, in the first embodiment, application of special effects during moving images is prohibited in the case of still images. Note that it is possible to apply to still images as long as the response is not affected at high speed .

  On the other hand, when the imaging device 1 performs moving image shooting (step S43: No), the control unit 29 determines whether or not a moving image special effect is set (step S44). When the special effect during moving image is set (step S44: Yes), the process proceeds to step S45. On the other hand, when the special effect during moving images is not set (step S44: No), the imaging apparatus 1 returns to the main routine.

  When the special effect during moving image is set in step S44 (step S44: Yes), and the effect to be applied is multi-echo (step S45: Yes), the special effect image processing unit 163 during moving image For the processing result (previous frame), the current frame is synthesized at a predetermined ratio as the above-described multi-echo processing (see FIG. 4) (step S46). On the other hand, when the special effect to be applied is not multi-echo (step S45: No), the imaging device 1 proceeds to step S47.

  In step S47, the control unit 29 determines whether or not the effect to be applied is a one-shot echo. When the effect to be applied is the one-shot echo (step S47: Yes), the moving image special effect image processing unit 163 determines whether the release frame that is the specific image data stored in the SDRAM 25 is used to obtain the one-shot echo effect. A synthesis process is performed (step S48). Here, in the case of the first frame after the special effect flag is turned on, the moving image special effect image processing unit 163 performs a process of storing the image of the current frame in the SDRAM 25. On the other hand, when the special effect flag is turned on and after two frames, the moving image special effect image processing unit 163 performs a composition process with the release frame stored in the SDRAM 25.

  In step S47, when the moving image special effect to be applied is not a one-shot echo (step S47: No), the imaging apparatus 1 proceeds to step S49.

  In step S49, the control unit 29 determines whether or not the effect to be applied is fluctuation. If the effect to be applied is fluctuation (step S49: Yes), the moving image special effect image processing unit 163 performs processing for adding the fluctuation effect (step S50).

  Specific processing of the moving image special effect image processing unit 163 in step S50 will be described. The moving image special effect image processing unit 163 adds an effect in which fluctuation is given to the image processing parameter in the art effect processing such as shading processing and cross filter processing. For example, in the case of shading processing, the attenuation characteristic from the center of the image is changed with time. If it is a peripheral blur, the blur amount and blur shape are changed. If it is a cross filter, the length and angle of the cross pattern are changed with time. Further, saturation, contrast, and white balance may be changed with time. When art effects such as shading and shading overlap, both may be given, or only the fluctuation may be given.

  In step S49, when the effect to be applied is not fluctuation (step S49: No), the imaging device 1 proceeds to step S51.

  In step S51, the control part 29 determines whether the effect to apply is a transit (step S51). When the effect to be applied is transit (step S51: Yes), the basic image processing unit 161 and the art effect image processing unit 162 respectively execute basic image processing and art effect processing according to the setting of the finish / switching destination ( Steps S52 and S53). After that, the moving image special effect image processing unit 163 generates a transit image by performing synthesis processing of the two images for transit (step S54). After step S54, the imaging apparatus 1 returns to the main routine.

  In step S51, when the result of determination by the control unit 29 is that the effect to be applied is not transit (step S51: No), the imaging apparatus 1 returns to the main routine.

  According to Embodiment 1 of the present invention described above, when moving image recording is started, the setting signal input unit is switched to the special effect during moving image, and the control unit recognizes that the setting signal of the special effect for moving image is input. To do. Therefore, the user can easily apply the special effect to the moving image by performing a simple operation at the time of shooting.

  In addition, according to the first embodiment, since the user interface constituting the setting signal input unit can have both video and still image input functions, the user has excellent operability even when shooting video. An interface can be realized. In addition, since the number of user interfaces can also be suppressed, layout restrictions are reduced, and an imaging device suitable for downsizing can be realized.

  Further, according to the first embodiment, special effects equivalent to those that can be realized on an editing device or a PC can be executed by the imaging apparatus itself. Therefore, a moving image reflecting the user's drawing intention can be created without requiring high-level specialized knowledge and without subsequent editing.

  Further, according to the first embodiment, by performing control for prohibiting the application of the special effect during moving image to the still image during moving image shooting, the influence on the restart timing of moving image shooting after the still image shooting is performed. Can be prevented.

  In general, an imaging apparatus has a small memory and inferior processing capability as compared with a PC or the like, so that it is difficult to realize a moving image data editing process equivalent to that of a PC or the like. Also, in imaging devices that can shoot still images in a movie or that can be shot immediately after the movie ends, memory shortages and memory management issues are decisive. There is also a possibility that problems such as responsiveness at the time of shooting and deterioration of still image quality may occur. In the first embodiment, in view of this point, it is possible to shoot a moving image to which a photographer's drawing intention is given by a special effect of temporal transition over a plurality of frames at the time of shooting without editing the shot moving image. Realized.

(Modification 1-1)
FIG. 17 is a diagram illustrating assignment of user interfaces when a moving image is recorded and when a moving image is not recorded in the imaging apparatus according to Modification 1-1 of the first embodiment. In the case shown in FIG. 17, when the moving image is not recorded, the AE / AF operation is assigned to the first release operation of the release button 42, the shooting operation is assigned to the 2nd release operation of the release button 42, and the focus operation is assigned to the lens operation unit 35. On the other hand, at the time of moving image recording, the release button 42 (1st release operation) is caused to function as a toggle key capable of alternately starting and stopping the effect, and an effect switching operation is assigned to the lens operation unit 35. Here, it is troublesome if AF or AE corresponding to the input from the release button 42 is performed during moving image recording, or a still image is taken at the start of the effect. Therefore, still image shooting is not performed during moving image recording.

(Modification 1-2)
FIG. 18 is a diagram showing user interface assignments when a moving image is recorded and when a moving image is not recorded in the imaging apparatus according to Modification Example 1-2 of the first embodiment. In this case, when the moving image is not recorded, an AF operation is assigned to the function key 48 and a focus operation is assigned to the lens operation unit 35. On the other hand, at the time of moving image recording, the function key 48 functions as a toggle key that can be operated alternately between start and stop of the effect, and the lens operation unit 35 is assigned to the effect switching operation.

(Modification 1-3)
FIG. 19 is a diagram illustrating assignment of user interfaces when a moving image is recorded and when a moving image is not recorded in the imaging apparatus according to Modification 1-3 of Embodiment 1. In Modification 1-3, the effect is turned on / off and switched using the touch panel 50. When the moving image is not recorded, the touch operation on the touch panel 50 is assigned to the still image shooting operation. On the other hand, at the time of moving image recording, a touch on the touch panel 50 is alternately assigned to the effect start and end operations, while a horizontal slide of the touch panel 50 is assigned to the effect switching operation.
Thus, by using the touch panel 50, the space of a user interface can be suppressed.

(Modification 1-4)
FIG. 20 is a flowchart illustrating an outline of the moving image special effect control process performed by the imaging apparatus according to Modification 1-4 of Embodiment 1. In FIG. 20, when the key for starting the special effect process during moving image is operated (step S61: Yes), the image processing control unit 291 turns on the moving image special effect flag (step S62). Thereafter, the imaging apparatus 1 returns to the main routine.

  On the other hand, when the key for starting the special effect during moving image is not operated (step S61: No), when the end instruction is input (step S63: Yes), the image processing control unit 291 sets the moving image special effect flag. Control to turn off is performed (step S64). Thereafter, the imaging apparatus 1 returns to the main routine.

Further, when the key for starting the special effect in the moving image is not operated (step S61: No), the end instruction is not input (step S63: No), and the effect switching instruction is input (step S65: Yes). ), The image processing control unit 291 switches the special effect (step S66). Thereafter, the imaging apparatus 1 returns to the main routine.
In step S65, when the effect switching instruction is not input (step S65: No), the imaging apparatus 1 returns to the main routine.

  According to the modified examples 1-1 to 1-4 of the first embodiment described above, the same effects as those of the first embodiment can be obtained.

(Embodiment 2)
The imaging apparatus according to the second embodiment of the present invention actually gives a special effect to the imaging apparatus according to the first embodiment after the user confirms the desired effect while displaying the moving image special effect in live view. A function that can be used for shooting is added.

  FIG. 21 is a block diagram illustrating a configuration of the imaging apparatus according to the second embodiment. The imaging apparatus 51 shown in the figure has the same configuration as that of the imaging apparatus 1 described in the first embodiment except for the input unit 52. Hereinafter, the configuration of the input unit 52 will be described.

  The input unit 52 includes a simulation signal input unit 521, an effect recording start signal input unit 522, and an effect stop signal input unit 523 in addition to the setting signal input unit 201 and the moving image shooting signal input unit 202.

  The simulation signal input unit 521 receives an input of a simulation signal that gives a moving image special effect only to the live view display. The effect recording start signal input unit 522 receives an input of an effect recording start signal for recording an image subjected to a special effect during moving images on the SDRAM 25 and the recording medium 23. The effect stop signal input unit 523 receives an input of an effect stop signal for stopping the moving image special effect applied in live view display and image recording.

  FIG. 22 is a diagram showing user interface assignment in the second embodiment. First, allocation at the time of moving image non-recording will be described. In this case, an exposure correction operation is assigned to the up arrow key 443 of the cross key 441. The down arrow key 444 is assigned continuous shooting / single shooting operation. An AF target operation is assigned to the left arrow key 445. A flash setting operation is assigned to the right arrow key 446. When the moving image is not recorded, a camera setting operation is assigned to the enter button 442, an AE / AF operation is assigned to the first release operation, and a shooting operation is assigned to the 2nd release operation.

Next, allocation at the time of moving image recording will be described. In this case, an effect simulation start operation is assigned to the up arrow key 443. Therefore, the up arrow key 443 forms part of the simulation signal input unit 521.
An effect stop operation is assigned to the down arrow key 444. Therefore, the down arrow key 444 forms a part of the effect stop signal input unit 523. Of the special effects in the moving image, those that require a stop instruction are multi-echo and fluctuation.
An effect switching operation is assigned to the left arrow key 445 and the right arrow key 446.
An effect recording start function is assigned to the 1st release operation and the 2nd release operation of the determination button 442 and the release button 42. Accordingly, the enter button 442 and the release button 42 form part of the effect recording start signal input unit 522.

  FIG. 23 is a diagram illustrating an overview of state transitions during moving image recording of the imaging apparatus 51. When a simulation signal is input by the simulation signal input unit 521 in a state where the special effect during the moving image is not set for the live view display and the moving image recording display after the start of the moving image recording (state I), the image processing control unit 291 While moving image special effects are applied to live view display, transition to state II is performed in which moving image recording is controlled so that moving image special effects are not applied.

  When the effect recording start signal is input by the effect recording start signal input unit 522 in the state II, the image processing control unit 291 applies the special effect during moving image to the image when recording to the SDRAM 25 in addition to the live view display. Is started (state III).

  In the state III, when the effect stop signal is input by the effect stop signal input unit 523, the image processing control unit 291 stops the application of the special effect during moving image to the live view display and moving image recording. Thereby, the imaging device 1 transits to the state I.

  According to the second embodiment of the present invention described above, the imaging apparatus includes the simulation signal input unit, the effect start signal input unit, and the effect stop signal input unit, so that the user can perform a trial before recording a moving image. You can apply special effects to and check the effects on the screen. Therefore, the user can easily shoot a more creative moving image to which the effect expected at the intended timing is applied.

  In the second embodiment, the recording of the image to which the special effect during the moving image is added at the time when the input of the effect recording start signal is received. If the above operation is not performed, recording of an image to which a special effect during moving images is automatically added may be started.

(Modification 2-1)
FIG. 24 is a diagram showing user interface assignments during moving image recording and still image recording of the imaging apparatus according to Modification Example 2-1 of the second embodiment. In FIG. 24, the assignment when the moving image is not recorded is the same as that shown in FIG. Hereinafter, allocation at the time of moving image recording will be described. A one-shot start function is assigned to the up arrow key 443. The down arrow key 444 is assigned a transit effect start function. The left arrow key 445 is assigned a multi-echo effect simulation start function. The right arrow key 446 is assigned a fluctuation effect simulation start function. An effect recording start function and an effect stop function are assigned to the 1st release operation and the 2nd release operation of the determination button 442 and the release button 42.

  Therefore, in the modification 2-1, the left arrow key 445 and the right arrow key 446 form part of the simulation signal input unit 521. Further, in the present modification 2-1, the decision button 442 and the release button 42 form part of the effect recording start signal input unit 522 and the effect stop signal input unit 523.

(Modification 2-2)
Modification 2-2 of the second embodiment is characterized in that the application mode of the special effect during moving image is switched by the touch panel 50. FIG. 25 is a diagram illustrating a screen display example on the display unit 21 when the imaging device 51 is in a still image shooting standby state. A shooting mode icon I1 (displayed as “P”) is displayed on the upper left of the screen Q1. Further, a menu selection icon I2 (displayed as “STILL MENU”) for shooting a still image and a menu selection icon I3 (displayed as “MOVIE MENU”) for shooting a moving image are provided on the upper right of the screen Q1. Hereinafter, when a portion corresponding to an icon display area is touched on the touch panel 50, the expression “icon is selected” may be used.

  When the menu selection icon I2 is selected while the screen Q1 is displayed, the display control unit 292 displays an icon for selecting white balance, AF, and photometry as a still image shooting menu, An icon for returning to the operation display screen is displayed on the display unit 21 (not shown).

  On the other hand, when the menu selection icon I3 is selected while the screen Q1 is displayed, the display control unit 292 causes the display unit 21 to display an image in the moving image shooting standby state. FIG. 26 is a diagram illustrating a screen display example on the display unit 21 when the imaging device 51 is in the moving image shooting standby state. In the screen Q2 shown in FIG. 26, the display unit 21 displays a one-shot echo icon I4 (displayed as “1 Shot Echo”), a multi-echo icon I5 (displayed as “Multi Echo”), and a transit icon I6 (displayed as “Transit”). ), A test-on icon I7 (displayed as “TEST ON”), and a return icon I8 (displayed as “RET”).

  In the moving image shooting standby state shown in FIG. 26, the aspect ratio of the image at the time of still image shooting is changed, and the image is longer than the still image. For this reason, the display unit 21 displays various icons in a non-display area of an image having a horizontally long strip shape at the top and bottom of the screen.

  Of the icons displayed on the screen Q2, the one-shot echo icon I4, the multi-echo icon I5, and the transit icon I6 are icons for selecting one-shot echo, multi-echo, and transit as special effects in the moving image, respectively. . When any one of these icons is selected, the display unit 21 displays a live view image to which the selected special effect during moving images is applied. Therefore, the one-shot echo icon I4, the multi-echo icon I5, and the transit icon I6 form part of the simulation signal input unit 521.

  The test-on icon I7 is an icon indicating a state in which the selected special effect during moving image is reflected in the live view display, but the special effect during moving image is not reflected in the moving image recording.

  The return icon I8 is an icon for returning to the previous image display.

  FIG. 27 is a diagram showing a screen display example on the display unit 21 when the transit is selected as the special effect during moving image while the display unit 21 displays the screen Q2. In the screen Q3 shown in FIG. 27, the display unit 21 displays a selectable finish list of switching destinations at the time of transit. The display order of the finished items in the finished list display icon I9 can be changed as appropriate.

  At the upper and lower ends of the finished list display icon I9, an up scroll button I91 for receiving an input of a scroll signal in the upward direction and a down scroll button I92 for receiving an input of a scroll signal in the downward direction are provided. For example, when the up scroll button I91 is selected, the display is scrolled upward, the item “Vivid” displayed at the top disappears, the item “Fantastic focus” becomes the top, and the item “Fantastic focus” is displayed at the bottom. The finished items are displayed.

  In the finish list display icon I9, the currently selected finish item is displayed differently from the other finishes. The different display here is a generic term for displays that can be distinguished from other finished items such as gray display and highlight display. FIG. 27 shows a case where the item “Toy Photo” is selected. When the switching destination finish is selected, the display control unit 292 erases the finish list display icon I9. Thereafter, the image processing control unit 291 causes the moving image special effect image processing unit 163 to start transit processing.

  When the item highlighted on the finished list display icon I9 is selected again, the art effect selected before that may be returned. Specifically, for example, if natural is selected before the toy photo, when the item “toy photo” is selected again, it may be returned to natural again.

  FIG. 28 is a diagram showing a screen display example after the moving image button 47 is pressed on the screen Q2 shown in FIG. On the screen Q4 shown in FIG. 28, in addition to the one-shot echo icon I4, the multi-echo icon I5, and the transit icon I6, a confirmation icon I10 (displayed as “OK”) is displayed. The confirmation icon I10 is an icon for starting recording of the image to which the displayed special effect during moving images is added. Therefore, the confirmation icon I10 forms part of the effect recording start signal input unit 522.

  When the moving image button 47 is pressed while the screen Q4 is being displayed and the moving image recording is ended, the display control unit 292 performs control to return the display on the display unit 21 to the screen Q2.

  FIG. 29 is a diagram showing a screen display example on the display unit 21 after the confirmation icon I10 is selected on the screen Q4 shown in FIG. On the screen Q5 shown in FIG. 29, in addition to the one-shot echo icon I4, the multi-echo icon I5, and the transit icon I6, an end icon I11 (displayed as “END”) is displayed. Of these, the one-shot echo icon I4 is highlighted. This means that the one-shot echo is selected.

  The end icon I11 is an icon for inputting an instruction signal for ending the application of the special effect during moving image to the moving image during recording. When the end icon I11 is selected while the screen Q5 is displayed, the image processing control unit 291 causes the moving image special effect image processing unit 163 to end the application of the moving image special effect. In this case, the display control unit 292 causes the display unit 21 to display a screen in which the end icon I11 is deleted from the screen Q5. Needless to say, the special effect during the moving image is not given to the live view image shown at that time.

  Even when the moving image button 47 is pressed during the display of the screen Q5 and the moving image recording is ended, the display control unit 292 performs control to return the display on the display unit 21 to the screen Q2.

  FIG. 30 is a diagram showing a screen display example of the display unit 21 when the test-on icon I7 is selected on the screen Q2 shown in FIG. On the screen Q6 shown in FIG. 30, a test off icon I12 (displayed as “TEST OFF”) is displayed instead of the test on icon I7. The test-off icon I12 is an icon indicating a state in which the selected moving image special effect is reflected in the live view display and moving image recording.

  When the test-off icon I12 is selected while the screen Q6 is displayed, the display control unit 292 causes the display unit 21 to display the screen Q2. That is, when the test-off icon I12 is selected, the position of the test-off icon I12 changes to the display of the test-on icon I7.

  When the moving image button 47 is pressed and the moving image recording is started while the display unit 21 is displaying the screen Q6, the display control unit 292 performs control to display the screen Q5.

  According to the modified examples 2-1 and 2-2 of the second embodiment described above, the same effects as those of the second embodiment can be obtained.

(Embodiment 3)
The imaging apparatus according to Embodiment 3 of the present invention can set a moving image shooting mode and a still image shooting mode, and when set to the moving image shooting mode, the user interface is switched for moving image shooting.

  FIG. 31 is a block diagram illustrating a configuration of the imaging apparatus according to the third embodiment. The imaging apparatus 61 shown in the figure has the same configuration as that of the imaging apparatus 1 described in Embodiment 1 except for the input unit 62. Hereinafter, the configuration of the input unit 62 will be described.

  The input unit 62 includes a setting signal input unit 621 that receives input of various setting signals including a still image shooting condition setting signal for setting shooting conditions in still image shooting and moving image shooting, and a moving image shooting signal input unit 202.

  The setting signal input unit 621 includes a mode setting signal input unit 622 that receives an input of a mode setting signal that instructs setting of a mode. The mode setting signal input unit 622 is realized by the mode dial 43, for example.

  FIG. 32 is a diagram illustrating key assignment when the imaging device 61 is set to the still image shooting mode and the moving image shooting mode, respectively. When the imaging device 61 is set to the still image shooting mode, an exposure correction operation is assigned to the up arrow key 443. The down arrow key 444 is assigned continuous shooting / single car operation. An AF target operation is assigned to the left arrow key 445. A flash setting operation is assigned to the right arrow key 446. A playback operation is assigned to the playback button 46. An erase operation is assigned to the erase button 49.

  Next, the case where the imaging device 61 is set to the moving image shooting mode will be described. The up arrow key 443 and the left arrow key 445 are assigned the same operation as in the still image mode setting, that is, the exposure correction operation and the AF target operation, respectively. The down arrow key 444 is assigned a transit effect start operation. The right arrow key 446 is assigned a fluctuation effect start / stop operation. A one-shot echo start operation is assigned to the playback button 46. A multi-echo start / stop operation is assigned to the erase button 49.

  In the third embodiment, regarding the fluctuation effect, it is possible to arbitrarily set not only the start but also the stop. However, as in the first embodiment, the fluctuation effect is obtained when a predetermined time has elapsed after the start of the effect. In order to stop, a fluctuation effect start operation may be assigned to the right arrow key 446.

  FIG. 33 is a flowchart illustrating an overview of processing performed by the imaging device 61. The processing in steps S71 to S76 in FIG. 33 sequentially corresponds to the processing in steps S1 to S6 in FIG.

  In step S77, when the moving image button 47 is operated (step S77: Yes), the control unit 29 inverts the recording flag indicating that the moving image is being recorded (step S78).

  Subsequently, the control unit 29 determines whether or not the recording flag recorded in the SDRAM 25 is on (step S79). If it is determined that the recording flag is on (step S79: Yes), the control unit 29 generates a moving image file for recording the image data in time series on the recording medium 23, and stores the moving image file on the recording medium 23. Store (step S80). Thereafter, the imaging apparatus 1 proceeds to step S81. If it is determined in step S79 that the recording flag is not on (step S79: No), the imaging apparatus proceeds to step S81.

  When the mode setting is changed in step S81 (step S81: Yes) and the moving image mode is set (step S82: Yes), the control unit 29 performs a special moving image user interface setting process (step S83). By this setting process, for example, assignment for the moving image mode as shown in FIG. 32 is executed. As a result, the control unit 29 recognizes a signal that is subsequently received by the user interface set in step S83 as a special moving image signal based on FIG.

  On the other hand, when the mode setting is changed in step S81 (step S81: Yes) and the still image mode is set (step S82: No), the control unit 29 performs a still image user interface setting process (step S85). ). Also in this case, assignment of keys for the still image mode as shown in FIG. 32 is performed.

  The processes in steps S85 to S100 sequentially correspond to the processes in steps S15 to S28 described in the first embodiment.

  According to the third embodiment of the present invention described above, when the moving image shooting mode is set, the setting signal input unit is switched to the special effect during moving image, and the control unit receives the setting signal of the special effect for moving image. recognize. Therefore, the user can easily apply the special effect to the moving image by performing a simple operation at the time of shooting. The user interface setting is switched according to the mode setting, and shooting can be performed after confirming the special effect during the moving image with the live view image.

  Further, according to the third embodiment, since the user interface constituting the setting signal input unit can have both video and still image input functions, the number of user interfaces can be reduced. Therefore, it is suitable for downsizing of the apparatus.

  Further, according to the third embodiment, the user can clearly grasp the application of the moving image special effect before being recorded on the moving image during the moving image shooting standby or the still image shooting standby. Therefore, the user can image a moving image with a special effect to be recorded and photographed in advance, or can consider the timing of applying the special effect in advance.

(Modification 3-1)
FIG. 34 is a diagram illustrating an example of key assignment when the imaging apparatus according to the modified example 3-1 of the third embodiment is set to the still image shooting mode and the moving image shooting mode, respectively. The key assignment of the cross key 441 when the imaging apparatus according to the modified example 3-1 is set to the still image shooting mode is the same as that of the third embodiment.

  Hereinafter, an example of key assignment when the imaging apparatus according to Modification 3-1 is set in the moving image shooting mode will be described. A one-shot echo start operation is assigned to the up arrow key 443. The down arrow key 444 is assigned a transit start operation. A multi-echo start / stop operation is assigned to the left arrow key 445. The right arrow key 446 is assigned a fluctuation start / stop operation.

(Modification 3-2)
FIG. 35 is a diagram illustrating a screen display example on the display unit 21 when the imaging apparatus according to the modified example 3-2 of the third embodiment is in a still image shooting standby state. In Modification 3-2, various signals are input using the touch panel 50. On the screen Q7 shown in FIG. 35, in addition to the menu selection icon I2 for still image shooting, a shooting mode icon I1 ′ can also be touch-input, and forms a part of the mode setting signal input unit 622.

  FIG. 36 is a diagram showing a screen display example displayed on the display unit 21 when the shooting mode icon I1 ′ is selected on the screen Q7. In the screen Q8 shown in FIG. 36, at the bottom of the screen, a P mode icon I13 (displayed as “P”), an A mode icon I14 (displayed as “A”), an S mode icon I15 (displayed as “S”), M Six types of icons are displayed: a mode icon I16 (displayed as “M”), a moving image icon I17 (displayed as “MOVIE”), and a confirmation icon I10. Among these, the P mode icon I13, the A mode icon I14, the S mode icon I15, and the M mode icon I16 are icons for setting the shooting mode (exposure mode) and have the same functions as the mode dial 43.

  When the moving image icon I17 is selected on the screen Q8, the imaging apparatus 1 shifts to the moving image mode and enters a moving image shooting standby state.

  FIG. 37 is a diagram illustrating a screen display example of the display unit 21 in the moving image shooting standby state. On the screen Q9 shown in FIG. 37, a one-shot echo icon I4, a multi-echo icon I5, a transit icon I6, and a return icon I8 are displayed.

  When any one of the one-shot echo icon I4, the multi-echo icon I5, and the transit icon I6 is selected in the state shown in FIG. 37, the display control unit 292 applies a special effect corresponding to the selected moving image special effect. To display the Live View image. When the transit icon I6 is selected, a screen Q3 shown in FIG. 27 is displayed. When the moving image button 47 is pressed in a state where the moving image special effect is selected, the control unit 29 starts recording the moving image including the moving image special effect displayed as the live view image.

  According to the modified examples 3-1 and 3-2 of the third embodiment described above, the same effects as those of the third embodiment can be obtained.

(Embodiment 4)
In Embodiment 4 of the present invention, in an imaging apparatus capable of shooting a moving image, it is possible to set a moving image special effect application mode in which a moving image special effect is applied as one of the shooting modes. It is characterized by.

  FIG. 38 is a flowchart showing an outline of processing performed by the imaging apparatus according to Embodiment 4 of the present invention. The configuration of the imaging apparatus according to the fourth embodiment is the same as the configuration of the imaging apparatus 61 described in the third embodiment. In addition, the processes in steps S111 to S114 and S116 in FIG. 38 sequentially correspond to the processes in steps S71 to S74 and S76 in FIG.

  In step S115, camera settings are made (step S115). The camera settings here include finishing, still image recording mode, moving image recording mode special effect setting, transit switching destination setting, fluctuation effect setting, and special effect selection. Therefore, in the fourth embodiment, the special effect during moving image is selected in advance. This special effect may be selected with the mode dial 43.

  In step S117, when the moving image button 47 is operated (step S117: Yes), the control unit 29 inverts the recording flag indicating that the moving image is being recorded (step S118).

  Subsequently, the control unit 29 determines whether or not the recording flag recorded in the SDRAM 25 is on (step S119). When it is determined that the recording flag is in the on state (step S119: Yes), the control unit 29 generates a moving image file for recording the image data in time series on the recording medium 23 and stores the moving image file on the recording medium 23. Store (step S120). Thereafter, the imaging apparatus 1 proceeds to step S121. If it is determined in step S119 that the recording flag is not on (step S119: No), the moving image special effect image processing unit 163 proceeds to step S121.

  In step S121, the control unit 29 determines whether or not the imaging device 61 is set to the moving image special effect mode. As a result of the determination, when the imaging device 61 is set to the moving image special effect mode (step S121: Yes), the control unit 29 turns on the moving image special effect flag (step S122). On the other hand, if the result of determination by the control unit 29 in step S121 is that the imaging device 61 is not set to the moving image special effect mode (step S121: No), the control unit 29 turns off the moving image special effect flag (step S123). ).

  The processing in steps S124 to S136 sequentially corresponds to the processing in steps S88 to S100 described in the third embodiment.

  According to the fourth embodiment of the present invention described above, since the mode setting for the special effect during moving image can be performed, it is possible to easily shoot a moving image with the special effect during moving image simply by switching the mode. Can do.

  Needless to say, in the imaging apparatus according to the fourth embodiment, the still image mode may be set.

(Embodiment 5)
The fifth embodiment of the present invention is characterized in that, even when a still image is shot during a moving image, a moving image special effect is imparted using moving image data recorded before that.

  FIG. 39 is a block diagram illustrating a configuration of the imaging apparatus according to the fifth embodiment. The imaging apparatus 71 shown in the figure has the same configuration as that of the imaging apparatus 1 described in Embodiment 1 except for the image processing unit 72. Hereinafter, the configuration of the image processing unit 72 will be described.

  The image processing unit 72 includes a basic image processing unit 161, an art effect image processing unit 162, and a moving image special effect image processing unit 721. The moving image special effect image processing unit 721 includes a resizing processing unit 722 that resizes the number of pixels of moving image data by interpolating the number of pixels of moving image data.

  FIG. 40 is a flowchart illustrating details of image processing performed by the imaging device 71. The outline of the processing of the imaging device 71 excluding image processing is the same as that of the first embodiment (see FIG. 13). In FIG. 40, the basic image processing unit 161 performs basic image processing (step S141), and the art effect image processing unit 163 performs art effect processing (step S142). The basic image processing and art effect processing here are the same as those described in the first embodiment.

  Thereafter, the control unit 29 determines whether or not the moving image special effect is set (step S143). When the special effect during moving image is set (step S143: Yes), the imaging device 71 proceeds to step S144. On the other hand, when the special effect during moving images is not set (step S143: No), the imaging device 71 returns to the main routine (see FIG. 13).

  In step S144, the control unit 29 determines whether or not the set special effect is multi-echo. When the set special effect is multi-echo (step S144: Yes), the imaging apparatus 1 proceeds to step S145. On the other hand, when the set special effect is not multi-echo (step S144: No), the imaging apparatus 1 proceeds to step S149 described later.

  In step S145, when the imaging device 1 is set to the still image mode (step S145: Yes), the resizing processing unit 722 resizes the previous frame for moving images (step S146). This process is because the number of pixels of image data differs between a moving image and a still image.

  FIG. 41 is a diagram schematically illustrating an outline of the resizing process performed by the resizing processing unit 722. In FIG. 41, the size of the frame corresponds to the number of pixels of the image data. When the resizing processing unit 722 resizes the moving image data, the number of pixels in the horizontal direction of the moving image frame 301 is substantially equal to the number of pixels in the horizontal direction of the still image frame 302 while maintaining the aspect ratio of the moving image frame 301. In addition, a resized frame 301 ′ is generated by increasing the number of pixels by interpolation.

Subsequently, the moving image special effect image processing unit 163 combines the resized moving image frame and the still image frame (step S147). Specifically, the moving image special effect image processing unit 163 generates a composite image signal by adding a moving image frame signal and a still image frame signal at a predetermined ratio for each pixel color data. If the ratio of the previous frame image signal is c (<1),
c × previous frame image signal + (1−c) × still image frame signal.

FIG. 42 is a diagram for schematically explaining the synthesis ratio c in the still image mode and the previous frame image signal. In Figure 42, between the resized previous frame and the still image, in the region D1 where the image is present in common, the ratio c of the image signal is a previous frame substantially takes a constant value c _0. The value of the constant value c _{0 is} a value smaller than 0.5, for example. On the other hand, in the vicinity of the boundary between the region D2 and the region D1 where no video frame signal exists, the ratio c gradually decreases from the region D1 to the region D2, and c = 0 in the region D2.

  If the imaging device 1 is set to the moving image mode in step S145 (step S145: No), the moving image special effect image processing unit 163 combines the previous frame and the moving image frame as they are (step S148).

  Subsequent to step S147 or S148, the control unit 29 determines whether the effect to be applied is a one-shot echo (step S149). When the effect to be applied is the one-shot echo (step S149: Yes), when the still image shooting mode is set (step S150: Yes), the moving image special effect image processing unit 163 resizes the previous frame. (Step S151). When the effect to be applied is the one-shot echo (step S149: Yes), when the still image shooting mode is not set (step S150: No), the imaging apparatus 1 proceeds to step S152.

  Thereafter, the moving image special effect image processing unit 163 combines the previous frame and the current frame at a predetermined combining ratio (step S152). This composition ratio is preferably set so that the ratio of the current frame is high.

  In step S149, when the moving image special effect to be applied is not a one-shot echo (step S149: No), the imaging device 71 proceeds to step S153.

  In step S153, the control unit 29 determines whether or not the effect to be applied is fluctuation. When the applied effect is fluctuation (step S153: Yes), the moving image special effect image processing unit 163 adds fluctuation (step S154). On the other hand, when the effect to apply is not fluctuation (step S153: No), the imaging device 71 proceeds to step S155.

  In step S155, the control unit 29 determines whether the effect to be applied is a transit (step S155). When the applied effect is transit (step S155: Yes), when the imaging device 71 is not in a state of shooting a still image (step S156: No), the basic image processing unit 161 and the art effect image processing unit 162 are finished. / Basic image processing (step S157) and art effect processing (step S158) according to the setting of the switching destination are executed.

  Thereafter, the moving image special effect image processing unit 163 performs a process of combining the two images for transit (step S159). After step S159, the imaging device 71 returns to the main routine.

  In step S155, when the effect to apply is not a transit (step S155: No), the imaging device 71 returns to the main routine without applying the transit to the still image.

  In step S156, when the imaging device 71 is in a state of taking a still image (step S156: Yes), the imaging device 71 returns to the main routine.

  According to Embodiment 5 of the present invention described above, special effects such as multi-echo and one-shot echo are given to still images, but since resizing processing is performed at that time, moving images and still images are There is no sense of incompatibility even if it is synthesized. Therefore, according to the fifth embodiment, an appropriate afterimage effect utilizing the respective characteristics can be applied to a moving image and a still image.

  In the fifth embodiment, only the previous frame is synthesized for both moving images and still images, but a synthesized image may be generated using a plurality of previous frames. In that case, it is more preferable to increase the afterimage effect by using a larger number of previous frames in the case of a still image than in the case of a moving image.

(Modification 5-1)
FIG. 43 is a diagram schematically illustrating an outline of the resizing process performed by the imaging apparatus according to Modification 5-1 of Embodiment 5. Also in FIG. 43, the size of the frame corresponds to the number of pixels of the image data. In Modification 5-1, when image data is recorded, image data 303 having the same aspect ratio as that of a still image is recorded in the SDRAM 25 even in the case of a moving image. A portion of the image data 303 having a moving image aspect ratio is compressed and recorded as moving image data 304 on the recording medium 23.

  In this modified example 5-1, when a still image is shot, the moving image special effect image processing unit 163 uses the image data 303 stored in the SDRAM 25 as the previous frame, and resizes the same pixel as the still image frame. Resize image data 303 ′ having a number is generated. Therefore, even when still image data and moving image data are combined, image data having the same aspect ratio can be combined.

  According to the modified example 5-1 of the fifth embodiment described above, it is possible to combine the aspect ratio of the previous frame with the aspect ratio of the still image. It is possible to give a natural afterimage effect to a subject that is outside the area of the moving image aspect ratio of the frame image.

(Embodiment 6)
In the sixth embodiment of the present invention, as in the fifth embodiment, even when a still image is shot during a moving image, a special effect during moving image is provided by using moving image data acquired earlier in time. Further, the present invention is also characterized in that still images themselves that do not give special effects during moving images are also recorded. The configuration of the imaging apparatus according to the sixth embodiment is the same as the configuration of the imaging apparatus 71 described in the fifth embodiment.

  FIG. 44 is a flowchart illustrating details of image processing performed by the imaging device 71 according to the sixth embodiment. In FIG. 44, the basic image processing unit 161 performs basic image processing (step S161). The art effect image processing unit 162 performs art effect processing (step S162).

  Thereafter, the control unit 29 determines whether or not the moving image special effect is set (step S163). When the special effect during moving image is set (step S163: Yes), the imaging device 71 proceeds to step S164. On the other hand, when the moving image special effect is not set (step S163: No), the imaging device 71 returns to the main routine.

  In step S164, when the imaging device 1 is set to the still image shooting mode (step S164: Yes), the control unit 29 performs control to record the still image on the recording medium 23 (step S165). On the other hand, when the imaging device 1 is not set to the still image shooting mode (step S164: No), the imaging device 1 proceeds to step S166.

  The processing in steps S166 to S181 sequentially corresponds to the processing in steps S144 to S159 described in the fifth embodiment (see FIG. 40).

  According to the sixth embodiment of the present invention described above, special effects such as multi-echo and one-shot echo are also given to still images. There is no sense of incompatibility even if it is synthesized. Therefore, according to the sixth embodiment, it is possible to apply an appropriate afterimage effect utilizing each characteristic to a moving image and a still image.

  Further, according to the sixth embodiment, a still image to which a special effect during moving images is to be added is automatically recorded, so that the user can select his / her favorite image when reproducing the still image.

(Embodiment 7)
FIG. 45 is a diagram schematically showing an outline of image processing performed by the imaging apparatus according to Embodiment 7 of the present invention. In the seventh embodiment, when multi-echo is applied as a special effect during moving images, the number of moving image data of the previous frame to be synthesized differs between moving images and still images. Specifically, in the case of a moving image, three pieces of moving image data are combined, whereas in the case of a still image, five pieces of moving image data are combined. Note that the configuration of the imaging apparatus according to the seventh embodiment is the same as the configuration of the imaging apparatus 71 described in the fifth embodiment.

  FIG. 46 is a flowchart illustrating an overview of image processing performed by the imaging device 71 according to the seventh embodiment. In FIG. 46, the control unit 29 first manages the RAW image data (Bayer data) acquired by the image sensor 12 with a ring buffer secured in the SDRAM 25 (step S191).

  FIG. 47 is a diagram showing the relationship between Bayer data and exposure dose. As is clear from the curve L shown in the figure, the numerical value of the Bayer data has a knee characteristic in which the rise is abrupt in the dark part and the rise is gradual in the bright part. The curve L having such a characteristic can be obtained by making the quantization step finer for the dark portion and coarser for the bright portion. As described above, in the seventh embodiment, the Bayer data is quantized in a different quantization step from the normal quantization step that is constant regardless of the exposure amount, so that the numerical characteristic of the Bayer data becomes close to the gamma characteristic. The image quality is less affected and the data can be easily compressed. As a result, smaller image data can be stored in the SDRAM 25.

  FIG. 48 is a diagram schematically showing the main part of the data structure stored in the SDRAM 25. As shown in FIG. In the data structure 401 shown in the figure, buffers Bu1 to Bu5 corresponding to the number of sheets used for image composition (five sheets in the figure) are secured as ring buffers. The buffer Bui (i = 1 to 5) is provided with a region Bui1 for storing Bayer data and a region Bui2 for storing the address of the next buffer. Hereinafter, the address of the buffer Bui is assumed to be Adi.

  When the Bayer data is stored for the first time, the initial storage destination information is “storage destination address = Ad1, end address = NULL (0)”. Thereafter, when Bayer data is stored, the storage location information becomes “storage location address = Ad2, end address = Ad1”. This means that there is data from the address Ad1 to the buffer immediately before the address Ad2 in the oldest order. That is, there is one stored Bayer data.

  Thereafter, when the second Bayer data is stored, the storage destination information becomes “storage destination address = Ad3, end address = Ad1”. In this case, Bayer data is stored in the two buffers Bu1 and Bu2.

  Thereafter, similarly, when the fifth Bayer data is stored, the storage destination information becomes “storage destination address = Ad1, end address = Ad1”. In this case, Bayer data is stored in the five buffers Bu1 to Bu5.

  Thereafter, when the storage of the Bayer data is continued, since the oldest Bayer data is stored in the buffer Bu1, the Bayer data is updated to the latest data, and the Bayer data stored in the buffer Bu1 becomes the oldest data. Therefore, the storage destination information is “storage destination address = Ad2, end address = Ad2”.

  Thereafter, by repeating the same processing, the SDRAM 25 manages a certain number of Bayer data while replacing the oldest Bayer data with the latest Bayer data.

  Returning to FIG. 46, the processing after step S192 will be described. The basic image processing unit 161 performs basic image processing (step S192). The art effect image processing unit 162 performs art effect image processing (step S193). Image data (Bayer data) that has been subjected to basic image processing and art effect image processing is stored in a buffer of the SDRAM 25.

  Thereafter, the control unit 29 determines whether or not the moving image special effect is set (step S194). When the special effect during moving image is set (step S194: Yes), the imaging device 71 proceeds to step S195. On the other hand, when the moving image special effect is not set (step S194: No), the imaging device 71 returns to the main routine.

  In step S195, if multi-echo is set as the special effect in the moving image (step S195: Yes), the imaging device 71 performs multi-echo processing (step S196). Details of the multi-echo processing will be described later.

  The subsequent processes in steps S197 to S207 correspond to the processes in steps S171 to S181 in FIG.

FIG. 49 is a flowchart showing an overview of multi-echo processing. In FIG. 49, the moving image special effect image processing unit 163 multiplies the acquired image signal by a predetermined coefficient (gain) for each pixel (step S211). The value of this coefficient is d ₀ described later.

  Thereafter, the control unit 29 sets the value of the counter I indicating the number of repetitions to 0 (step S212).

  Subsequently, the moving image special effect image processing unit 163 acquires data that is I + 1 frames before (step S213), and performs linear conversion (step S214). The linear transformation here is for eliminating the difference in characteristics at the quantization step for each frame, and has a characteristic (deknee characteristic) opposite to the characteristic in the quantization step described above. By performing such linear conversion, the Bayer data has a numerical value proportional to the exposure amount.

  Thereafter, the basic image processing unit 161 performs basic image processing on the linearly converted image data (step S215). The art effect image processing unit 162 performs art effect image processing on the image data that has undergone the basic image processing in step S215 (step S216).

The processing following step S216 differs depending on whether the image acquired by the imaging device 71 is a still image or a moving image. First, the case where the acquired image is a still image (step S217: Yes) will be described. In this case, the resizing processing unit 722 resizes the image data (step S218), and performs composition using the resized image data (step S219). The compositing process here is
It is expressed as frame buffer image data + d × image data.

FIG. 50 is a diagram illustrating the relationship between the value of the moving image gain d and the number of repetitions I. In the case shown in FIG. 50, as the number of repetitions I increases, the image gain d decreases, and the sum of all the I corresponding coefficients corresponding to all possible I is 1.0. It is set (d ₀ + d ₁ + d ₂ + d ₃ + d ₄ = 1.0). Here, the image gain d ₀ at I = 0 is the value of the image gain applied in step S211 described above.

Subsequently, the control unit 29 increases the counter I by 1 to I + 1 (step S220). Thereafter, if the counter I is smaller than a predetermined value I ₀ (here, I ₀ = 5) (step S221: Yes), the imaging device 71 returns to step S213. On the other hand, if the counter I is greater than or equal to the predetermined value I ₀ (step S221: No), the imaging device 71 returns to the main routine.

Next, a case where the acquired image is a moving image (step S217: No) will be described. In this case, the moving image special effect image processing unit 163 combines the two frames (step S222). The compositing process here is the same as for still images.
It is represented by frame buffer image data + e × image data.

FIG. 51 is a diagram illustrating the relationship between the value of the image gain e and the number of repetitions I applied when the acquired image is a still image. In the case shown in FIG. 51, as the number of repetitions I increases, the coefficient decreases, and the coefficient corresponding to all possible I is set to 1.0 when the sum of all I is added. The (e ₀ + e ₂ + e ₄ = 1.0) point is the same as the still image. However, in the case of a moving image, since the increment amount is larger than that of a still image, it is more preferable that the coefficient applied to the moving image is larger when compared with the same value of I. In order to make the image gain value the same in step S211 between the still image and the moving image, d ₀ = e ₀ must be satisfied.

  Subsequently, the control unit 29 increases the counter I by 2 to I + 2 (step S223). Thereafter, the imaging apparatus 1 proceeds to step S221.

  According to the seventh embodiment of the present invention described above, it is possible to realize appropriate afterimage effects for moving images and still images, respectively, and to create images with a minimum of processing.

  Further, according to the seventh embodiment, since the coefficient characteristics can be set arbitrarily, the degree of freedom in design is great.

  In the seventh embodiment, settings such as the image gains d and e, the number of ring buffers, and the interval between frames used for composition can be changed by an operation input from the lens operation unit 35 or the like. May be. By changing various settings in this way, it is possible to create an afterimage effect that suits the user's preference.

  The management mode of the ring buffer in the seventh embodiment is not limited to the method described above. For example, the ring buffer can be managed using a queue. Hereinafter, a ring buffer management method using a queue will be described.

  FIG. 52 is a diagram schematically showing the main part of the data structure stored in the SDRAM 25. In the data structure 402 shown in the figure, buffers bu1 to bu5 corresponding to the number of sheets used for image composition (five sheets in the figure) are secured as ring buffers. The buffer bui (i = 1 to 5) stores Bayer data.

  FIG. 53 is a diagram illustrating a mode of managing a ring buffer using a queue. First, when there is an element in the empty queue, the head is taken out, corresponding Bayer data is stored, and added to the end of the use queue. In the case of FIG. 53 (a), the head buffer bu1 of the empty queue is taken out, the corresponding Bayer data 1 is stored, and the buffer bu1 is added to the end of the use queue (FIG. 53 (b)). If this process is repeated, as shown in FIG. 53A, the empty queue becomes empty at the fifth storage, and all buffers are added to the use queue. Thereafter, the storage of the Bayer data is continued while moving the head of the use queue to the end (FIG. 53 (d)).

  Thus, when managing moving image data using a ring buffer, it is possible to apply any of known techniques.

  In the seventh embodiment, the extraction interval of image data to be combined may be changed, or the number of image data to be combined may be changed. In the eighth embodiment, the number of Bayer data stored as a ring buffer may be changed. These setting changes may be executed by inputting a setting signal from the setting signal input unit 201.

(Other embodiments)
Up to this point, the mode for carrying out the present invention has been described. However, the present invention should not be limited only by the above-described first to seventh embodiments.

  For example, in the present invention, an electronic viewfinder may be provided in the main body unit separately from the display unit, and the present invention may be applied to this electronic viewfinder. In this case, it is more preferable that the special effect in the moving image is made different between the display unit and the electronic viewfinder.

  In the present invention, the main body portion and the lens portion may be integrally formed.

  In addition to a digital single-lens reflex camera, the imaging apparatus according to the present invention is also applicable to, for example, digital cameras that can be equipped with accessories and the like, digital video cameras, and electronic devices such as mobile phones and tablet mobile devices having a shooting function. can do.

  In the description of the flowchart in the present specification, the context of the processing between steps is clearly indicated using expressions such as “first”, “after”, “follow”, etc., in order to implement the present invention. The order of processing required is not uniquely determined by their representation. That is, the order of processing in the flowcharts described in this specification can be changed within a consistent range.

  As described above, the present invention can include various embodiments not described herein, and various design changes and the like can be made within the scope of the technical idea specified by the claims. Is possible.

DESCRIPTION OF SYMBOLS 1, 51, 61, 71 Image pick-up device 2 Main body part 3 Lens part 12 Image pick-up element 16, 72 Image processing part 19 Image compression expansion | deployment part 20, 52, 62 Input part 21 Display part 22 Display drive part 23 Recording medium 26 Flash memory 27 Main unit communication unit 28 Bus 29 Control unit 31 Optical system 35 Lens operation unit 36 Lens flash memory 37 Lens communication unit 38 Lens control unit 41 Power button 42 Release button 43 Mode dial 44 Operation button 45 Menu button 46 Playback button 47 Movie button 48 Function Key 49 Delete button 50 Touch panel 161 Basic image processing unit 162 Art effect image processing unit 163, 721 Moving image special effect image processing unit 201, 621 Setting signal input unit 202 Moving image shooting signal input unit 261 Program recording unit 262 Special Effect processing information recording unit 263 Image processing information recording unit 291 Image processing control unit 292 Display control unit 301 Movie frame 301 ′ Frame after resize 302 Still image frame 303 Image data 303 ′ Resized image data 304 Movie data 401, 402 Data structure 441 Cross Key 442 Enter button 443 Up arrow key 444 Down arrow key 445 Left arrow key 446 Right arrow key 521 Simulation signal input unit 522 Effect recording start signal input unit 523 Effect stop signal input unit 622 Mode setting signal input unit 722 Resize processing unit A1, A2, A3, A4, B1, B2, B3, B4, B5, R20 Art effect image I1 Shooting mode icon I2, I3 Menu selection icon I4 One-shot echo icon I5 Multi-echo icon I6 Ranjit icon I7 Test-on icon I8 Return icon I9 Finished list display icon I10 Confirmation icon I11 Exit icon I12 Test-off icon I17 Movie icon I91 Up scroll button I92 Down scroll button R1, R2, R3, R4 Multi-echo image R11, R12, R13 , R14 One-shot echo image R21, R22, R23, R24, R25 Transit image S1 SDRAM image

Claims (6)

An imaging device capable of capturing a subject and generating image data of the subject to capture a moving image and capturing a still image during moving image capturing including immediately after the end of moving image capturing,
It is possible to perform image processing to give a first special effect that causes a visual effect over a plurality of frames corresponding to moving image data, and for still images taken during moving image shooting, A moving image special effect image processing unit capable of performing image processing to give a second special effect corresponding to the first special effect using image data of a moving image taken before the still image;
A control unit for controlling to vary the applied embodiments involving applying prohibited even before Symbol first and second grant embodiment of special effects in the special effect image processing unit in the moving,
An imaging apparatus comprising: The controller is
Causing the moving image special effect image processing unit to apply the first special effect to the plurality of frames and to apply the second special effect to a still image included between the plurality of frames. The imaging apparatus according to claim 1, wherein prohibition control is performed. A storage unit for storing the image data;
The controller is
Control that causes the moving image special effect image processing unit to apply the first special effect to the plurality of frames and to apply the second special effect to a still image included between the plurality of frames. performed, the imaging apparatus according to claim 1, wherein the image data without applying the second special effect and the second image data assigned with special effects be controlled to be stored in the storage unit. The special effect image processing unit in the moving image is
A resizing processing unit that performs a resizing process for bringing the number of pixels of image data of a moving image captured before the still image closer to the number of pixels of the image data of the still image;
The imaging apparatus according to claim 3 , wherein the resize processing unit synthesizes the image data of the moving image subjected to the resizing process and the image data of the still image. Image processing performed by the special effect image processing unit in the moving image
Including multi-echo processing that continuously performs processing to synthesize the image data of the previous frame and the latest image data at a predetermined ratio,
In the case where the image processing is a multi-echo processing, when the latest image data is image data of a still image, and wherein the resizing section performs a resizing process on the preceding image data The imaging device according to claim 4 . Image processing performed by the special effect image processing unit in the moving image
Specific image data and the latest image data taken after this image data are sequentially combined at a predetermined ratio, including one-shot echo processing in which the combination ratio of the specific image data decreases with time,
In the case where the image processing is a one-shot echo processing, when the latest image data is image data of a still image, wherein the resizing section performs a resizing process on the specific image data The imaging device according to claim 4 .