JP6202238B2 - Image processing apparatus, image processing method, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

  2. Description of the Related Art Conventionally, a technique is known in which a parameter that exhibits special effects is set and filter processing is performed on the entire original image, for example, fading expression in the case of printing is performed and a retro-processed image is generated ( For example, see Patent Document 1 below).

Paragraph “0029” of JP2010-268217A

  However, in the case of the image processing technique described above, a parameter that exhibits a special effect is set and the entire original image is subjected to filter processing, so that a special effect that is actually lacking in reality is given.

  The present invention has been made in view of such a conventional problem, and an object of the present invention is to provide an image with a texture actually printed as a photograph, that is, a special effect that leaves a sense of reality.

In order to solve the above problems, the present invention is generated by an input unit for inputting an image, a first image generation unit for generating a luminance image of an image input by the input unit, and the first image generation unit. A second image generating means for generating a luminance image in which the brightness is enhanced to express a fading state, and the input image and the second image generation. And a first combining means for combining the luminance images generated by the means so as to change the transmission intensity between the central area and the peripheral area in these images.

  According to the present invention, it is possible to provide different special effects for each image area without providing a uniform special effect such as uniformly fading the entire image. As a result, it is possible to give the image a texture that is actually printed as a photograph, that is, a special effect that leaves a sense of reality.

It is a circuit block diagram of an imaging device to which an embodiment of the present invention is applied. It is a flowchart which shows the process sequence in the imaging device. It is a transition diagram corresponding to the processing procedure.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a circuit configuration diagram of an imaging apparatus including an image processing apparatus according to an embodiment of the present invention. The imaging apparatus includes an imaging unit 1, a drive control unit 2, a unit circuit 3, a key input unit 4, a display unit 5, an image recording unit 6, a program memory 7, a RAM 8, a control unit 9, and an image processing unit 10. Yes. These are connected via a bus line. The key input unit 4 includes a shutter key 41 for detecting a photographer's recording instruction, and the image processing unit 10 includes an image composition unit 12.

  The imaging unit 1 holds a light intensity as a charge accumulation for a certain period of time under the control of an image sensor such as a CMOS, an RGB color filter provided on the image sensor, and the drive control unit 2, and a unit circuit 3 has a built-in driver for outputting these as analog imaging signals. Then, an image (color image) is acquired by detecting a photographing instruction of the photographer via the shutter key provided in the key input unit 4, the control unit 9, and the drive control unit 2.

  The unit circuit 3 is a circuit to which an analog imaging signal corresponding to the optical image of the subject output from the imaging unit 1 is input, and a CDS that holds the input imaging signal and a gain adjustment that amplifies the imaging signal. An amplifier (AGC), an A / D converter (ADC) that converts the amplified imaging signal into a digital imaging signal, and the like are configured. Note that control related to the adjustment of the gain adjustment amplifier is also performed based on an instruction from the drive control unit 2.

  In the present embodiment, the drive control unit 2 performs control related to the gain adjustment amplifier. However, the present invention is not limited to this. For example, the above control may be performed by the control unit 9.

  In addition to the shutter key described above, the key input unit 4 includes various keys for detecting switching to a shooting mode, switching to an image processing mode for the purpose of image processing according to the present invention, switching of display, and the like.

  The display unit 5 has a selection screen display for displaying a list of images recorded in the image recording unit 6 when the user selects an image to be processed, and a function for displaying a synthesized image. The image recording unit 6 stores and stores image data (image file) encoded by the JPEG method after the composition processing according to the present invention is executed. The program memory 7 stores a program executed by the control unit 9 and the image processing unit 10, and this program is read by the control unit 9 as necessary. The RAM 8 has a function of temporarily holding data being processed generated by each process. The control unit 9 is composed of a CPU and its peripheral circuits, and controls the processing operation of the entire imaging apparatus.

  The image processing unit 10 is, for example, a DSP (Digital Signal Processor), which performs processing such as pedestal clamping on the Bayer data sent from the unit circuit 3, converts it into RGB data, and further converts the RGB data into luminance (Y ) Signal and color difference (UV) signal. One frame of YUV data converted by the image processing unit 10 is sent to the display unit 5, where it is converted into a video signal, and then displayed as a live view image.

  Further, when a shutter key operation by the user is detected in the still image shooting mode, the drive control unit 2 causes the image pickup unit 1 and the unit circuit 3 to be different from those at the time of shooting the live view image and the driving method and drive timing for still image shooting. After the still image shooting process is executed, the YUV data for one frame obtained by the still image shooting process is encoded and compressed into a file after being compressed by the image processing unit 10 using the JPEG method or the like. The still image data (still image file) is recorded in the image recording unit 6 via the bus line.

  The image processing unit 10 includes an image generation unit 11 and an image synthesis unit 12 corresponding to the characteristic configuration of the present invention, in addition to processing for such image data. That is, the image generation unit 11 generates a luminance image from an image selected by the user as will be described later, and further changes the characteristics relating to the brightness of the generated luminance image to generate an image with enhanced brightness. . Further, the image composition unit 12 has a function of compositing the images shown in the flowchart of FIG. 2 and the example of FIG.

  Next, the operation of the present embodiment will be described. When the user operates the mode button provided in the key input unit 4 to set the image processing mode according to the present embodiment, the control unit 9 reads the program from the program memory 7 and is shown in the flowchart of FIG. The process is started.

  That is, the control unit 9 controls the display unit 5 to display an image selection screen for displaying a list of images recorded in the image recording unit 6 (step S1). Then, it is determined whether or not selection for any of the images displayed on the image selection screen has been detected (step S2).

  If a selection for any image is detected, for example, if a selection for the image shown in FIG. 3 is detected, the image is read out from the image recording unit 6 as an original image PA, and input to the image processing unit 10. Then, a full screen is displayed on the display unit 5 (step S3).

  The original image PA is YUV data composed of a luminance (Y) component and a color difference (UV) component as described above. Therefore, the control unit 9 controls the image processing unit 10 to analyze the original image PA, generate a luminance / color difference (Y, U, V) image, and separates a luminance (Y) component image among these ( Step S4). Further, the luminance (Y) component image is colored into a sepia color (step S5). Therefore, a Y component sepia image PB obtained by coloring the luminance (Y) component image shown in FIG. 3B into a sepia color is generated by the processing in steps S4 and S5.

  Next, with respect to this image (Y component sepia image PB) colored and processed in sepia, the γ curve is corrected and the brightness is enhanced (step S6). As a result of the process in step S6, as shown in FIG. 3D, a brightness-enhanced sepia image PD in which the Y component sepia image PB shown in FIG. The

  Further, the original image and the sepia-colored image are synthesized by α blending at a composition ratio of 1: 1 (step S7). As a result, as shown in FIG. 3, the original image PA of FIG. 3A and the Y component sepia image PB of FIG. 3B are blended and synthesized 1: 1, and as a result, α in FIG. A blending image PC is generated.

  Then, the ratio of the image obtained by correcting the γ curve and adjusting the brightness in step S6 first is high for the left and right peripheral areas so that the ratio of the image previously blended with α blending in step S7 is high for the central area. In this way, α blending synthesis is performed (step S8). That is, as shown in FIG. 3, the ratio of the alpha blended image PC of FIG. 3C is high for the central area, and the ratio of the brightness-enhanced sepia image PD of FIG. Are blended with each other so that becomes high. As a result, the sepia tone image PE shown in FIG.

  Next, the generated sepia tone image PE is encoded by the JPEG method to generate an image file, which is recorded in the image recording unit 6 and displayed on the display unit 5 (step S9). In this sepia tone image PE, the ratio of the α blending image PC is high for the central area PE1, and the ratio of the emphasized sepia image PD is high for the left area PE2 and the right area PE3. Accordingly, the left area PE2 and the right area PE3 have a sepia tone degree higher than that of the central area PE1 and exhibit a fading effect, so that the entire image does not fade uniformly. Therefore, it is possible to obtain a retro-processed image PE as if the printed original image PA faded due to actual aging, and the texture printed as a photograph, that is, the reality A special effect with a feeling can be imparted to the image.

  Further, the sepia tone image PE has a high sepia tone degree with respect to the left region PE2 and the right region PE3, and has a feeling of fading than the central region PE1, so that it is an image of a size that is held by hand when viewing. If this is the case, it is possible to generate a fading pattern in accordance with the reality that the peripheral area is likely to fade.

  In the embodiment, for example, in the playback mode, the process is performed by the process of separating the single-shot image (original image PA) already stored in the image recording unit 6 into the luminance image. As the lower processing, it may be performed immediately after the imaging processing. In the processing in the shooting mode, a plurality of images may be shot by continuous shooting, and the luminance image may be separated from an image arbitrarily selected from one of them. In this case, if it is determined that shooting with flash firing is necessary, shooting with flash firing is included in continuous shooting, and the resulting image is converted into a luminance image. Good. In this way, an image necessary for composition can be generated without correcting the γ curve.

  In step S7, the original image and the sepia-toned image are synthesized by α blending at a composition ratio of 1: 1. However, the composition ratio is not limited to this, and the composition ratio can be arbitrarily set by a user operation. It may be possible to change to For example, to enhance the fading effect, the sepia tone composition ratio is increased. In this way, it is possible to generate an image that provides the degree of fading effect desired by the user.

  Further, the composition ratio of the central area and the peripheral area in step S8 is reversed, and the ratio of the image blended in the previous step S7 is lowered for the central area so that the ratio of the left and right areas is the previous step S6. The γ curve may be corrected by adjusting the brightness to reduce the ratio of the image. In such a case, it is possible to generate an image that exhibits a fading effect only in the central region. In addition, for the peripheral area, a fading direction such as a horizontal direction, a vertical direction, or the general surroundings may be arbitrarily selected by a user operation. Thereby, the image which gave the fading effect with the realistic feeling according to all the preservation | save environments of the image which a user assumes can be produced | generated.

  In step S5, the luminance (Y) component image is colored to sepia, but may be colored to a color other than sepia. Thereby, it is possible to generate an image having a special effect other than the fading effect.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to these, The invention described in the claim and its equal range are included.

The invention described in the scope of claims of the present application will be added below.
(Appendix)

<Claim 1>
An input means for inputting an image;
First image generation means for generating a luminance image from an image input by the input means;
A second image generating means for changing the characteristics relating to the brightness of the luminance image generated by the first image generating means and generating an image with enhanced brightness;
First combining means for combining the image generated by the second image generating means with the input image so as to change the transmission intensity between one region of these images and another region;
An image processing apparatus comprising:

<Claim 2>
2. The image processing apparatus according to claim 1, wherein the one area and the other area of the image are a central area and a peripheral area of the image.

<Claim 3>
Processing means for processing the luminance image generated by the first image generation means so as to enhance the sepia color;
The image processing apparatus according to claim 1, wherein the second image generation unit generates the image with the brightness enhanced from the image processed by the processing unit.

<Claim 4>
The first combining means enhances the transmission intensity so that the input image is emphasized for the central area of the image, while the image generated by the second image generating means is emphasized for the peripheral area. The image processing apparatus according to claim 1, wherein the image processing apparatus combines the images with different colors.

<Claim 5>
A second image synthesizing unit that transparently synthesizes the image generated by the first image generating unit with the input image;
The first synthesizing unit synthesizes the image generated by the second image synthesizing unit with the image transparently synthesized by the second synthesizing unit instead of the input image. The image processing apparatus according to claim 1.

<Claim 6>
A first image generation step of generating a luminance image from the input image;
A second image generation step for changing the characteristics relating to the brightness of the luminance image generated in the first image generation step, and generating an image with enhanced brightness;
A synthesis step of synthesizing the image generated in the second image generation step with the input image so as to change the transmission intensity between one region of these images and another region;
An image processing method comprising:

<Claim 7>
The computer that the device has
Input means for inputting images,
First image generation means for generating a luminance image from an image input by the input means;
A second image generating means for changing the characteristics relating to the brightness of the luminance image generated by the first image generating means and generating an image with enhanced brightness;
First combining means for combining the image generated by the second image generating means with the input image so as to change the transmission intensity between one region of these images and another region;
A program characterized by functioning as

DESCRIPTION OF SYMBOLS 1 Image pick-up part 2 Drive control part 3 Unit circuit 4 Key input part 5 Display part 6 Image recording part 7 Program memory 8 RAM
9 Control unit 10 Image processing unit 11 Image generation unit 12 Image composition unit

Claims (10)

An input means for inputting an image;
First image generation means for generating a luminance image of the image input by the input means;
A second image generating unit that changes a characteristic relating to the brightness of the luminance image generated by the first image generating unit and generates a luminance image in which the brightness is enhanced to express a fading state;
First combining means for combining the input image and the luminance image generated by the second image generating means so as to change the transmission intensity between the central area and the peripheral area in these images;
An image processing apparatus comprising: The first synthesizing unit is configured such that the input image is enhanced for the central region, while the luminance image generated by the second image generating unit is enhanced for the peripheral region. The image processing apparatus according to claim 1 , wherein the image is synthesized by changing the transmission intensity. An input means for inputting an image;
First image generation means for generating a luminance image of the image input by the input means;
A second image generating unit that changes a characteristic relating to the brightness of the luminance image generated by the first image generating unit and generates a luminance image in which the brightness is enhanced to express a fading state;
First combining means for combining the input image and the luminance image generated by the second image generating means so as to change the transmission intensity between one region and another region in these images;
Processing means for processing the luminance image so as to emphasize a sepia color;
An image processing apparatus comprising:   The first combining means emphasizes the input image for the one area, while enhancing the luminance image generated by the second image generating means for the other area. The image processing apparatus according to claim 3, wherein the image processing apparatus combines the transmission intensities as described above.   5. The input image synthesized by the first synthesizing unit is an image before being generated into a luminance image by the first image generating unit. Image processing apparatus. A second image synthesizing unit that transparently synthesizes the input image and the luminance image generated by the first image generating unit;
6. The first synthesis unit according to claim 1, wherein the first synthesis unit synthesizes the image that has been transmitted and synthesized by the second image synthesis unit and the luminance image that has been generated by the second image generation unit. Any one of the image processing apparatuses. A first image generation step for generating a luminance image of the input image;
A second image generation step of generating a luminance image in which the brightness is enhanced to the extent that the fading state is expressed by changing the characteristics relating to the brightness of the luminance image generated in the first image generation step;
A synthesis step of synthesizing the input image and the luminance image generated in the second image generation step so as to change the transmission intensity between the central region and the peripheral region in these images;
An image processing method comprising: A first image generation step for generating a luminance image of the input image;
A second image generation step of generating a luminance image in which the brightness is enhanced to the extent that the fading state is expressed by changing the characteristics relating to the brightness of the luminance image generated in the first image generation step;
Combining the input image and the luminance image generated in the second image generation step so as to change the transmission intensity between one region and another region in these images;
A processing step of processing the luminance image so as to emphasize a sepia color;
An image processing method comprising: The computer that the device has
Input means for inputting images,
First image generation means for generating a luminance image of the image input by the input means;
A second image generating unit that changes a characteristic relating to the brightness of the luminance image generated by the first image generating unit, and generates a luminance image in which the brightness is enhanced to express a fading state;
A synthesizing unit that synthesizes the input image and the luminance image generated by the second image generating unit so as to change the transmission intensity between the central region and the peripheral region in these images;
A program characterized by functioning as The computer that the device has
Input means for inputting images,
First image generation means for generating a luminance image of the image input by the input means;
A second image generating unit that changes a characteristic relating to the brightness of the luminance image generated by the first image generating unit, and generates a luminance image in which the brightness is enhanced to express a fading state;
A synthesizing unit that synthesizes the input image and the luminance image generated by the second image generating unit so as to change the transmission intensity between one region and another region in these images;
Processing means for processing the luminance image so as to enhance the sepia color,
A program characterized by functioning as

Images