JP2006340070A - Imaging apparatus and imaging method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus and an imaging method for applying a special effect to digitally photographed moving images. <P>SOLUTION: In the imaging apparatus and imaging method of the present invention, a frame rate conversion process for converting the frame rate of picked-up moving images when applying the special effect to the picked-up moving images is provided. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and an imaging method.

  In digital still image capturing, a technique of applying a special effect called a cross filter has been performed. For example, in Patent Document 1 below, instead of using a method of providing an optical cross filter member on the lens unit of the imaging apparatus, a normal still image is taken, and a portion with high luminance is extracted from the taken image. A cross filter is added by applying a light streak (hereinafter referred to as “light stripe”) to the center of high luminance by image processing.

  FIG. 4 is a diagram illustrating an example in which a cross filter is applied to an image. FIG. 4A is an image captured in a normal mode, and FIG. 4B is an image illustrated in FIG. The image of the state which gave the cross filter to is shown. When a cross filter is applied to an image, the brilliant area K is extracted from the image shown in FIG. 4A captured by a digital camera or the like, and the brightness, size, and color of the extracted brilliant area K are extracted. Light stripe data D to be added to each glitter region is generated according to taste and the like. Then, by synthesizing the generated light stripe data D with the image data, an image subjected to the cross filter can be obtained.

JP-A-6-30373

  By the way, as an image pickup apparatus such as a digital camera, a device having a moving image shooting function is generally used. As for a moving image, like a still image, there is a demand for performing image processing for applying a special effect such as a cross filter.

  However, in the normal video shooting mode, video processing is performed at a predetermined frame rate (for example, about 30 fps (frame-per-second)). To apply a special effect such as a cross filter to an image, the special video rate is used. There is room for improvement in that the processing load of moving images increases by the amount of image processing for applying the effect.

  An object of the present invention is to provide an imaging apparatus and an imaging method capable of applying a special effect to a moving image that is digitally photographed.

  The above object of the present invention is an image pickup apparatus capable of taking a digital image, in which a moving image pickup unit that takes a moving image and a moving image captured by the moving image pickup unit are subjected to special effects. This is achieved by an imaging apparatus comprising special effect applying means for processing and frame rate converting means for converting a frame rate of moving image capturing when the special effect is applied during moving image capturing.

  The above-described objects of the present invention include a moving image capturing step for capturing a moving image, a special effect applying step for processing the moving image to apply a special effect to the moving image captured by the moving image capturing means, and a moving image capturing. This is achieved by an imaging method characterized by having a frame rate conversion step of converting the frame rate of moving image imaging when giving the special effect sometimes.

  The present invention converts the frame rate of moving image shooting when the special effect is applied during moving image shooting. Then, by converting the frame rate to an appropriate value, it is possible to perform both moving image capturing processing and processing for applying a special effect to the captured moving image. For example, in order to apply a cross filter as a special effect to a moving image, the frame rate of moving image capturing is converted to a small value, and a cross-shaped light streak extending around a bright area is added to the captured moving image by image processing. Process. In this way, it is possible to perform cross filter image processing on a moving image by reducing the processing load of moving image capturing by converting the frame rate of moving image capturing to a small value.

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device and imaging method which can give a special effect to the moving image image imaged digitally can be provided.

  Hereinafter, an example of an imaging apparatus to which a moving image capturing apparatus and a moving image reproducing apparatus according to an embodiment of the present invention are applied will be described in detail with reference to the drawings. First, an example of an imaging device will be described with reference to FIG. This imaging apparatus 100 is a digital camera that stores single-shot or continuous-shot still image information and moving image information in a memory card 42, and the operation of the entire camera is centrally controlled by a central processing unit (CPU) 24. ing.

  The operation unit 26 of the digital camera includes a power switch, a shutter button, a mode switching switch for switching between a photographing mode and a reproduction mode, a multi-function cross key for outputting various command signals such as zoom and frame advance. Various operation signals from the operation unit 26 are applied to the CPU 24.

  In addition to the still image shooting mode for shooting a still image every time the shutter button is turned on, this digital camera performs continuous shooting mode and moving image shooting for continuously shooting at a predetermined interval while the shutter button is turned on. There are modes, and these modes can be appropriately selected by an operation on the operation unit 26.

  When the shutter button is turned on in the normal shooting mode, the image light indicating the subject is imaged on the light receiving surface of the image sensor (CCD) 14 through the lens optical system 10 including the focus lens and the diaphragm 12. The signal charge accumulated in the CCD 14 is sequentially read out as a voltage signal corresponding to the signal charge by a transfer pulse applied from the CCD driver 16. The CCD 14 has a so-called electronic shutter function that controls the charge accumulation time (shutter speed) of each photosensor according to the timing of the shutter gate pulse.

The voltage signal sequentially read from the CCD 14 is applied to the analog processing unit 18. The analog processing unit 18 includes a signal processing circuit such as a sampling hold circuit, a color separation circuit, and a gain adjustment circuit. The analog processing unit 18 performs correlated double sampling (CDS) processing and color separation processing into R, G, and B color signals. Signal level adjustment (pre-white balance processing) is performed.
The signal output from the analog processing unit 18 is converted into a digital signal by the A / D converter 20 and then stored in a temporary storage device 32 such as an SDRAM.

  The temporary storage device 32 has a storage capacity capable of temporarily storing digital data of a predetermined number of frames (for example, 30 frames) when capturing a moving image. The storage capacity of the temporary storage device 32 is not limited to these.

  The timing generator (TG) 22 provides timing signals to the CCD driver 16, the analog processing unit 18 and the A / D converter 20 in accordance with instructions from the CPU 24. The circuits are synchronized by this timing signal. ing.

  The ROM 34 stores programs and adjustment values for single shooting, continuous shooting, moving image shooting, image processing, and the like in advance, and these programs and adjustment values are read as appropriate.

Although not shown, the signal processing unit 36 adjusts the gains of the R, G, and B signals to perform white balance (WB) correction, and performs WB correction on each of the R, G, and B signals. A gamma correction unit that performs gamma correction in accordance with a ROM table in which predetermined gamma characteristics are stored, a color interpolation processing unit that performs color interpolation processing corresponding to the color filter array of the CCD 14, luminance data Y and color difference data C _r , C Noise reduction processing that performs noise reduction processing such as smoothing processing and median filter processing, a YC processing unit that performs _b generation processing (YC conversion), a contour enhancement unit that adds an aperture signal to the luminance data Y and performs contour enhancement a processing unit, the color difference data C _r, and the saturation enhancement unit to increase or decrease the gain of the C _b, has a luminance extraction portion or the like, to the digital data stored in the temporary storage device 32 Sequentially performing signal processing in each processing unit and.

  The image data processed by the signal processing unit 36 is encoded by the video encoder 28 and output to a liquid crystal monitor (LCD) 30 provided on the back of the camera, whereby a subject image is displayed on the display screen of the LCD 30. .

  The digital data stored in the temporary storage device 32 is rewritten with image data (YC data) processed by the signal processing unit 36. The YC data stored in the temporary storage device 32 is output to a compression / decompression processing unit (not shown), predetermined compression processing such as JPEG (Joint Photographic Experts Group) or Motion JPEG is executed, and the temporary storage device 32 again. Is remembered.

  The media controller 38 records the compressed data temporarily stored in the temporary storage device 32 on the memory card 42 via the card interface 40.

  The CPU 24 is connected to special effect function mode selection means 50 for selecting the cross filter mode. When the photographer wishes to perform photographing for obtaining the effect of the cross filter, the photographer operates the special effect function mode selection means 50 to select the cross filter mode.

  Thereafter, when the shutter button of the operation unit 26 is pressed, the CPU 24 causes the media controller 38 to store the image data in the temporary storage device 32 in the memory card 42 with appropriate exposure.

  Further, the CPU 24 determines the level of the image data with a preset threshold value, and separates and extracts the high luminance data from the appropriate exposure data by the luminance extraction unit of the signal processing circuit 36. The extracted high brightness data is written in the auxiliary memory 52 connected to the CPU.

  The high-intensity data written in the auxiliary memory 52 is converted into cross pattern data as will be described later, and is written in the memory card 42 by the media controller 38 in association with the image data photographed and recorded with appropriate exposure. It is.

Next, the operation of moving image capturing will be described.
First, the normal moving image capturing mode will be described. In moving image shooting, at the beginning of each frame at a moving image processing frame rate of, for example, 30 fps, image light indicating a subject is incident on the light receiving surface of an image sensor (CCD) 14 via a lens optical system 10 including a focus lens and a diaphragm 12. Imaged.

  At this time, the signal charge is accumulated in the CCD 14 over a predetermined exposure time, and the signal charge accumulated in the CCD 14 is transferred by the transfer pulse applied from the CCD driver 16 within a predetermined non-accumulation time thereafter. Are sequentially read out as voltage signals corresponding to.

  The voltage signal is supplied to the A / D converter 20 through the analog processing unit 18 and converted into a digital signal, and then stored in the temporary storage device 32. During the moving image capturing period, digital data for 30 frames per second is stored in the temporary storage device 32.

After capturing the moving image, the digital data stored in the temporary storage device 32 is rewritten with the image data processed by the signal processing unit 36. The image data stored in the temporary storage device 32 is output to a compression / decompression processing unit (not shown), Motion JPEG moving image compression processing is executed, and stored again in the temporary storage device 32.
The media controller 38 stores the compressed data temporarily stored in the temporary storage device 32 as a moving image file in the memory card 42.

  The CPU 24 also functions as a special function providing unit for adding a special effect to the moving image. The CPU 24 applies special effects such as the cross filter to the moving image captured digitally. In this case, the processing load of the moving image is increased as compared with the normal moving image shooting mode, and processing time is delayed. To do.

  For this reason, the CPU 24 functions as a frame rate conversion (adjustment) unit that adjusts the frame rate so that the timing for reading a moving image matches the timing of the moving image processing with a special function added. After adjusting the frame rate, the high luminance data is converted into cross pattern data as described above, and is combined with image data with appropriate exposure under the control of the media controller 38, and the memory card 42 is combined as composite image data. Write on top. The adjustment of the frame rate is performed so as to be as small as 20 fps in the normal moving image shooting mode, for example, when it is set to 30 fps.

  The composite image data written in the memory card 42 is read by the CPU 24 through the media controller 38, converted into a predetermined output signal by the video encoder 28, and displayed on the LCD 30.

FIG. 2 is a flowchart showing a moving image shooting procedure according to the present invention.
First, in the moving image shooting mode, whether or not a special effect function is to be inserted before moving image shooting is selected by a switch operation of the special effect function mode selection means 50 (step S101). With this switch-on operation, the shooting of the special effect moving image is started (step S102). In the switch-off state, the process proceeds to normal movie shooting start.

  If a special effect is added as described above, it takes time for image processing to give this special effect. Therefore, the timing for reading a captured image of a normal moving image is delayed, and the timing of the image processing signal obtained after the special effect processing is delayed. The frame rate is adjusted in the matching direction (step S103).

  The adjustment of the frame rate is performed by the CCD driver 16 driving the CCD 14 at a predetermined frame timing under the control of the CPU 24.

  Next, when normal moving image shooting by the shutter button operation is started (step S104), an optical image of a proper exposure of the subject is formed on the image sensor 14 from the lens optical system 10 through the diaphragm 12. The optical image signal is stored in the temporary storage device 32 as digital data for 30 frames per second via the analog processing unit 18 and the A / D conversion unit 20 as described above. At this time, the CPU 24 compares the signal of the optical image with a preset threshold value and determines a portion exceeding the threshold value as high luminance data, while determining a portion below the threshold value as appropriate exposure data ( Step S105).

  The high luminance data has position information on a frame where high luminance can be obtained. If the high luminance data is determined to be high luminance data (step S106), the high luminance data is converted into cross pattern data (step S107). On the other hand, if it is determined that the exposure data is appropriate, the appropriate exposure data is output (step S108), and the cross pattern data is superimposed on the corresponding position where the high brightness data is obtained on the frame of the appropriate exposure data. Together (step S109).

  The superimposed composite image data is written to the memory card 42 by the media controller 38 and displayed on the LCD 30 via the video encoder 28 (step S110). Further, it is checked whether or not to continue shooting (step S111). When the shooting is to be continued, the processing after step S104 is repeatedly executed, and when the shooting is ended, the moving image shooting mode is ended.

  On the other hand, if it is not the special effect function mode but the normal moving image shooting mode in step S101, shooting is started (step S112), and shooting is performed by normal shutter button operation (step S113). The moving image data of the subject imaged on 14 is written to the memory card by the media controller 38 at a frame rate of 30 fps and displayed on the LCD 30 via the video encoder 28 (step S114).

  Further, it is checked whether or not to continue shooting (step S115). When the shooting is to be continued, the processing after step S113 is repeatedly executed. When the shooting is not continued, the moving image shooting mode is ended.

  Note that such a moving image shooting process can be applied not only when shooting a moving image but also when previewing the moving image. In this case, it is possible to confirm the state of the captured image due to the special effect.

  FIG. 3 shows the cross pattern stored in advance in the auxiliary memory 52 or the like. FIG. 3A shows a light stripe 62 with a sharp tip centered on a bright area 61 having a high luminance in a part of the image, and FIG. 3B shows a twisted thread shape centered on the bright area 63. It is a light stripe 64. FIG. 3C shows a light strip 66 in which a plurality of large and small turtle shells are arranged on an echo centering on the bright region 65. In addition to this, various light stripes such as a wavy pattern centered on the bright area and a fireworks pattern can be applied to the moving image.

  According to such an embodiment of the present invention, when moving image capturing means for capturing moving images is provided, and special effect imparting means performs image processing for applying a special effect to the moving image captured by the moving image capturing means. In addition, by converting the frame rate of the moving image capturing by the frame rate conversion means, it is possible to match the read timing of the moving image and the timing at which an image signal obtained by applying a special effect to the moving image is obtained. In addition, when converting the frame rate of moving image capturing to a small value for providing a special effect, the processing load of moving image capturing can be reduced.

  As described above, the imaging apparatus and imaging method of the present invention have an effect that a special effect can be applied to a digitally captured moving image, and are useful for an imaging apparatus and an imaging method.

It is a block diagram which shows an example of the imaging device which concerns on this invention. It is a flowchart which shows the procedure which gives a special effect to a moving image using the imaging device which concerns on this invention. It is a figure which shows a cross pattern. It is a figure explaining the example which performs a cross filter.

Explanation of symbols

10 Lens optical system 12 Shutter 14 CCD
36 Signal Processing Unit 100 Imaging Device

Claims (4)

An imaging device capable of taking digital images,
Moving image capturing means for capturing moving images;
In order to apply a special effect to the moving image captured by the moving image capturing unit, a special effect applying unit that performs image processing on the moving image,
An image pickup apparatus comprising: frame rate conversion means for converting a frame rate of moving image shooting when the special effect is applied during moving image shooting.   The imaging apparatus according to claim 1, further comprising display means capable of displaying a moving image with a special effect.   The imaging apparatus according to claim 1, wherein the special effect applying unit is a cross filter unit that applies a cross filter to a moving image. A video imaging process for imaging video;
In order to apply a special effect to the moving image captured by the moving image capturing means, a special effect applying step for image processing the moving image,
A frame rate conversion step of converting a frame rate of moving image capturing when the special effect is applied during moving image capturing.

Images