US9635331B2 - Image processing apparatus that performs tone correction and edge enhancement, control method therefor, and storage medium - Google Patents

Image processing apparatus that performs tone correction and edge enhancement, control method therefor, and storage medium Download PDF

Info

Publication number
US9635331B2
US9635331B2 US14/689,506 US201514689506A US9635331B2 US 9635331 B2 US9635331 B2 US 9635331B2 US 201514689506 A US201514689506 A US 201514689506A US 9635331 B2 US9635331 B2 US 9635331B2
Authority
US
United States
Prior art keywords
signal
gain
target pixel
image data
edge
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US14/689,506
Other languages
English (en)
Other versions
US20150312538A1 (en
Inventor
Hiroaki Nashizawa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Assigned to CANON KABUSHIKI KAISHA reassignment CANON KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: NASHIZAWA, HIROAKI
Publication of US20150312538A1 publication Critical patent/US20150312538A1/en
Application granted granted Critical
Publication of US9635331B2 publication Critical patent/US9635331B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • H04N9/68—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits
    • H04N9/69—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits for modifying the colour signals by gamma correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/82—Camera processing pipelines; Components thereof for controlling camera response irrespective of the scene brightness, e.g. gamma correction
    • H04N23/83—Camera processing pipelines; Components thereof for controlling camera response irrespective of the scene brightness, e.g. gamma correction specially adapted for colour signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/20—Circuitry for controlling amplitude response
    • H04N5/202—Gamma control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/20—Circuitry for controlling amplitude response
    • H04N5/205—Circuitry for controlling amplitude response for correcting amplitude versus frequency characteristic
    • H04N5/208—Circuitry for controlling amplitude response for correcting amplitude versus frequency characteristic for compensating for attenuation of high frequency components, e.g. crispening, aperture distortion correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters

Definitions

  • the present invention relates to an image processing technique for image pickup apparatuses such as digital cameras and video cameras, cellular phones, personal computers (such as laptop, desktop, and tablet computers), and game machines, and in particular to an image processing apparatus using combined techniques of tone correction and edge enhancement, a control method therefor, and a storage medium.
  • Some image processing techniques correct a dark part of blocked-up shadows and a bright part of blown-out highlights in an image to favorable brightness by performing tone correction through gamma conversion or histogram equalization using a tone curve.
  • tone correction through gamma conversion or histogram equalization using a tone curve.
  • using one tone conversion table for one screen will present a problem of tone in a halftone area being sacrificed by producing tone of a dark part and a bright part.
  • the Retinex model is drawing attention.
  • the Retinex model focuses on the property of human vision that is insensitive to a low-frequency component such as illumination light shed on an overall scene but is sensitive to a high-frequency component such as a contrast between an area being watched and an area surrounding it. Examples of methods for tone correction complying with this model include local contrast correction.
  • tone correction is performed on only a low-frequency component, and this enables natural correction of overall tone while maintaining a local contrast which is a high-frequency component.
  • tone correction is performed on only a low-frequency component, and this enables natural correction of overall tone while maintaining a local contrast which is a high-frequency component.
  • this Retinex model since a high-frequency component is individually handled, and this changes reproduction of an edge, the amount of edge enhancement may not be appropriate when local contrast correction is performed in combination with conventional sharpness processing.
  • a filter size of an illumination component extraction filter is taken as an example of area size.
  • edge enhancement is performed with bold sharpness
  • edge enhancement is performed with relatively fine sharpness.
  • edge enhancement suited to a thickness of an extracted reflectance component is enabled by controlling the amount of sharpness according to a filter size for an illumination component, but edge enhancement is not always suited to a frequency band of a subject because no consideration is given to an actual input image.
  • the present invention provides an image processing apparatus and a control method therefor which enable natural edge enchantment suited to a frequency band of a subject even when performing local contrast correction in combination with an edge enhancement process, as well as a storage medium.
  • the present invention provides an image processing apparatus comprising a first correction unit configured to multiply signal of a target pixel in image data by a gain based on values obtained by reflecting signals of pixels around the target pixel, a gamma conversion unit configured to, for a signal of the target pixel output from the first correction unit, carry out gamma conversion based on the signal of the target pixels, an edge extraction unit configured to extract an edge signal from the image data, a second correction unit configured to multiply the edge signal corresponding to the target pixel by a gain based on a signal output from the first correction unit, and an adding unit configured to add the edge signal output from the second correction unit to a signal output from the gamma conversion unit.
  • a signal which has been subjected to a local contrast correction process is used as a luminance signal for reference to a luminance-by-luminance gain table, and a signal which has not been subjected to the local contrast correction process is used as a luminance signal for edge extraction.
  • FIG. 1 is a block diagram schematically showing a digital camera which is a first embodiment of an image processing apparatus according to the present invention.
  • FIG. 2 is a control block diagram of a luminance adjustment unit.
  • FIG. 3 is a graph showing a gamma curve determined by a black point and a white point.
  • FIG. 4 is a view showing an exemplary luminance-by-luminance gain table.
  • FIG. 5 is a control block diagram of a local contrast correction unit.
  • FIGS. 6A to 6C are graphs showing exemplary adjustment tables for local contrast correction.
  • FIG. 7 is a view showing a tone correction parameter setting menu which is an exemplary GUI in a digital camera which is a second embodiment of the image processing apparatus according to the present invention.
  • FIG. 8 is a control block diagram of a luminance adjustment unit.
  • FIG. 9 is a flowchart showing an exemplary process in which user settings on the tone correction parameter setting menu are reflected on parameters for use in D range adjustment and local contrast correction.
  • FIG. 10 is a graph showing a ⁇ curve before and after D range adjustment.
  • FIG. 11 is a graph showing types of adjustment tables for local contrast correction.
  • FIG. 12 is a control block diagram of a luminance adjustment unit in a digital camera which is a third embodiment of the image processing apparatus according to the present invention.
  • FIG. 13 is a flowchart showing a concrete process in which a luminance-by-luminance gain table is modified by the luminance adjustment unit.
  • FIG. 14 is a graph showing an exemplary luminance-by-luminance gain table before and after modification.
  • FIG. 15 is a control block diagram of a luminance adjustment unit in a digital camera which is a fourth embodiment of the image processing apparatus according to the present invention.
  • FIG. 1 is a block diagram schematically showing a digital camera which is a first embodiment of an image processing apparatus according to the present invention.
  • an image pickup device 102 performs photoelectric conversion of a subject image formed through an imaging optical system (lens) 101 .
  • the image pickup device 102 is, for example, a single plate color image pickup device having a typical primary color filter.
  • the primary color filter has three types of color filters with ranges of transparent dominant wavelengths near 650 nm, 550 nm, and 450 nm, respectively, and shoots color planes corresponding to R (red), G (green), and B (blue) bands, respectively.
  • these three types of color filters are spatially arrayed on a pixel-by-pixel basis, and in each pixel, only a strength of a single color plane is obtained. For this reason, a color mosaic image is output from the image pickup device 102 .
  • An A/D conversion unit 103 converts a color mosaic image, which is output as an analog voltage from the image pickup device 102 , into digital data suitable for subsequent image processing.
  • a white balance unit 104 specifically multiplies each of R, G, and B by gains which make R, G, and B isochromatic in an area supposed to be white.
  • a color interpolation unit 106 interpolates a color mosaic image to generate a color image with all pixels having all of R, G, and B color information.
  • the color image generated by the color interpolation unit 105 is generated into a basic color image by way of a matrix conversion unit 106 and a luminance adjustment unit 107 .
  • a color adjustment unit 108 performs image correction such as noise reduction, chroma enhancement, hue correction, or edge enhancement.
  • a resizing unit 109 resizes an image which has been subjected to a desired color adjustment by the color adjustment unit 108 into a desired recording size, and the image with high resolution is compressed using a compression method such as JPEG by a compression unit 110 and recorded in a recording medium such as a memory card by a recording unit 111 .
  • a control unit 120 is comprised of, for example, a CPU and controls the overall operation of the camera.
  • a memory 121 is a storage device for temporarily storing image data read out from the recording unit 111 and has a storage capacity enough to store image data for a predetermined time period.
  • the memory 121 is also usable as a work area for the control unit 120 or the like.
  • An I/F 122 establishes connection with and carries out communications with external devices under the control of the control unit 120 .
  • FIG. 2 is a control block diagram of the luminance adjustment unit 107 .
  • FIG. 3 is a graph showing a gamma curve determined by a black point Bk and a white point Wt.
  • FIG. 4 is a view showing an exemplary luminance-by-luminance gain table 1078 .
  • a D range adjustment unit 1070 converts a dynamic range of an input signal into a signal range determined by the black point Bk and the white point Wt as shown in FIG. 3 .
  • the black point Bk is a point at which output after gamma conversion using the curve shown in FIG. 3 becomes zero
  • the white point Wt is a point at which output becomes a maximum value of an output D range.
  • This dynamic range conversion adjusts an input signal Y to an output signal Ys using an equation (1) below.
  • Ys ( Y ⁇ Bk )*Max/( Wt ⁇ Bk ) (1)
  • Max is set to a maximum value for bits to be processed, for example, 4095 for 12 bits.
  • an output signal from the D range adjustment unit 1070 is subjected as a signal for the luminance mainline system to a local contrast correction process by a local contrast correction unit 1071 .
  • a local contrast correction unit 1071 Detailed description of the local contrast correction process will be given later.
  • the signal subjected to the local contrast correction process is subjected to gamma conversion on a pixel-by-pixel basis based on values of signals thereof by a gamma conversion unit 1072 , and an edge signal generated by the process in the edge signal generation system is added to the signal by an edge adding unit 1080 .
  • the output signal from the D range adjustment unit 1070 is additionally subjected to processing for edge component extraction by an edge extraction unit 1073 .
  • a method for edge component extraction is not particularly limited, but for example, a method using an edge extraction filter such as a high-pass filter and a method using a difference between a signal obtained by blurring an input signal and the input signal.
  • An extracted edge signal is subjected to fine adjustment by a lower limit/upper limit clipping unit 1074 .
  • a lower limit clipping unit determines and clips a noise signal included in the edge signal using a lower limit threshold value
  • an upper limit clipping unit determines and clips a noise signal included in the edge signal using an upper limit threshold value so as to prevent excessive edge enhancement.
  • the upper limit and lower limit threshold values should be set based on the noise level of the input signal, the allowable amount of overshooting, or the like.
  • the edge signal subjected to fine adjustment by the lower limit/upper limit clipping unit 1074 is further controlled by a luminance-by-luminance gain adjustment unit 1075 so that the amount of gain can be appropriate on a luminance-by-luminance basis.
  • An output signal from the local contrast correction unit 1071 is additionally subjected to a process in which it is blurred by a low-pass filter processing unit 1076 . Then, the signal with a lowered frequency band is assumed as a luminance signal for reference to a luminance-by-luminance gain table 1078 in FIG. 4 to generate luminance-by-luminance gains for respective pixels using a luminance-by-luminance gain generation unit 1077 .
  • the luminance-by-luminance gain table 1078 needs to be associated with gamma characteristics used by the gamma conversion unit 1072 . This is because an edge is actually added to a nonlinear signal after gamma conversion although edge extraction is performed on a linear signal before gamma conversion. This luminance-by-luminance gain adjustment enables the amount of edge to be appropriate in any luminance range.
  • the edge signal output from the lower limit/upper limit clipping unit 1074 is multiplied by a plane based on gains determined for respective pixels obtained as a result of the process described above, that is, a luminance-by-luminance gain plane by the luminance-by-luminance gain adjustment unit 1075 .
  • an overall gain adjustment unit 1079 finally adjusts the total gain and determines an edge signal which is to be added to the luminance signal in the mainline system.
  • FIG. 5 is a control block diagram of the local contrast correction unit 1071 .
  • the low-pass filter processing unit 201 carries out a process in which it cuts a high frequency component for an output signal from the D range adjustment unit 1070 in FIG. 2 . This is intended to reduce a frequency range in advance so as to prevent aliasing from occurring in a subsequent process by a reduction processing unit 202 .
  • the signal subjected to the low-pass filtering process is passed through the reduction processing unit 202 and an enlargement processing unit 203 to become a blurred luminance signal.
  • luminance signals corresponding to respective pixels input to the low-pass filter processing unit 201 are mixed with luminance signals corresponding to pixels around the respective pixels, and resultant signals are output from the enlargement processing unit 203 .
  • a luminance signal corresponding to each pixel output from the enlargement processing unit 203 represents a typical luminance signal in an area centered on the pixel.
  • a gain table generation unit 204 generates a local contrast correction gain table in FIG. 6B using an adjustment table 1081 in FIG. 6A as an input. Specifically, a correction gain table is obtained by dividing an output of the adjustment table 1081 by an input. It is assumed here that the adjustment table 1081 is designed in a nonlinear space after gamma conversion, and hence an inverted gamma conversion unit 205 converts the adjustment table 1081 into a correction gain table in a linear space as shown in FIG. 6C .
  • An adjustment gain calculation unit 206 calculates gains for respective pixels using an output signal from the enlargement processing unit 203 as a reference luminance using the correction gain table obtained as a result of the process described above.
  • the local contrast correction process is carried out by the gain multiplying unit 207 multiplying an output signal from the D range adjustment unit 1070 in FIG. 2 by the gains calculated by the adjustment gain calculation unit 206 .
  • local contrast correction is performed which, for each pixel, reflects not only a luminance signal of this pixel but also values of luminance signals of peripheral pixels around the pixel.
  • the adjustment table 1081 is set in a nonlinear space so as to be easily designed through intuition, the adjustment table 1081 may be set in a linear space in advance. In this case, processing by the inverse gamma conversion unit 205 in FIG. 5 is dispensed with.
  • the luminance adjustment unit 107 uses, in the edge signal generation system, a signal which has been subjected to the local contrast correction process as a luminance signal for reference to the luminance-by-luminance gain table and uses a signal which has not been subjected to the local contrast correction process as a luminance signal for edge extraction.
  • the reason why a signal which has been subjected to the local contrast correction process is used as a luminance signal for reference to the luminance-by-luminance gain table is to match the signal level of the edge signal generation system to that of a luminance signal in the luminance main line system.
  • the luminance-by-luminance gain adjustment is based on the assumption that the signal level of a luminance signal in the luminance main line system is consistent with the signal level of a luminance signal in the edge signal generation system from the viewpoint of adding an appropriate amount of edge according to luminance.
  • the reason why a luminance signal for edge extraction is not subjected to the local contrast correction process is that if edge extraction is performed on a luminance signal which has been subjected to the local contrast correction process, an edge is detected to an excessive degree as compared with a case where the luminance signal is not subjected to the local contrast correction process.
  • the local contrast correction process will relatively intensify a high-frequency component because only a low-frequency component is subjected to D range compression, that is, the local contrast process itself has such an effect as unsharp masking.
  • a signal which has been subjected to the local contrast correction process is used as a luminance signal for reference to the luminance-by-luminance gain table, and a signal which has not been subjected to the local contrast correction process is used as a luminance signal for edge extraction.
  • FIGS. 7 to 11 a description will be given of a digital camera which is a second embodiment of the image processing apparatus according to the present invention. It should be noted that portions overlapping or equivalent to those in the first embodiment described above will be described using the same reference numerals in the figures, and description thereof will be simplified or omitted.
  • D range adjustment and local contrast correction are performed based on parameters (amounts of correction) and adjustment tables for D range adjustment set in advance.
  • a suitable amount of sharpness is adjusted based on parameters for D range adjustment and local contrast corrections specified by user operation on a GUI.
  • FIG. 7 is a view showing a tone correction parameter setting menu 301 which is an exemplary GUI.
  • a black point bk, a midpoint Mid, and a white point Wt which are allowed to be adjusted through user operation are placed on the tone correction parameter setting menu 301 in FIG. 7 . By adjusting these points, the user is allowed to change characteristics of a gamma 302 .
  • a highlight slider 306 and a shadow slider 307 are placed on the tone correction parameter setting menu 301 .
  • a highlight function is to adjust only a high-luminance side in luminance tone. When the highlight slider 306 is slid leftward as viewed in the figure, luminance on a high-luminance side in an image decreases, and when the highlight slider 306 is slid rightward as viewed in the figure, luminance on a high-luminance side in an image increases.
  • a shadow function is to adjust only a low-luminance side in luminance tone.
  • FIG. 8 is a block diagram of the luminance adjustment unit 107 .
  • the luminance adjustment unit 107 according to the present embodiment is constructed by adding a GUI parameter obtainment unit 1082 , a D range adjustment LUT generation unit 1083 , and an adjustment table selection unit 1084 to the first embodiment ( FIG. 2 ) described above.
  • FIG. 9 is a flowchart showing an exemplary process in which user settings on the tone correction parameter setting menu 301 are reflected on parameters for D range adjustment and local contrast correction.
  • Each process in FIG. 9 is carried out by a CPU or the like of the control unit 120 expanding a control program stored in a ROM, not shown, into the memory 121 .
  • step S 11 the control unit 120 obtains the black point Bk, the midpoint Mid, and the white point Wt which are parameters for D range adjustment set by the user on the tone correction parameter setting menu 301 , and the process proceeds to step S 12 .
  • the control unit 120 causes the GUI parameter obtainment unit 1082 to obtain information on each point via the I/F 122 in FIG. 1 .
  • step S 12 based on the parameters for D range adjustment obtained in the step S 11 , the control unit 120 causes the D range adjustment LUT generation unit 1083 to generate a D range adjustment LUT (look-up table), and the process proceeds to step S 13 .
  • a broken line ⁇ in FIG. 10 is a ⁇ curve before adjustment.
  • a solid line ⁇ mod is a ⁇ curve after adjustment which is determined by adjusting the black point Bk, the midpoint Mid, and the white point Wt.
  • the number of elements is, for example, 1024 for a 10-bit accuracy.
  • step S 13 the control unit 120 obtains slider values of the respective highlight and shadow sliders set by user operation on the tone correction parameter setting menu 301 , and the process proceeds to step S 14 .
  • the control unit 120 causes the GUI parameter obtainment unit 1082 to obtain slider values of the respective highlight and shadow sliders via the I/F 122 in FIG. 1 .
  • the control unit 120 causes the adjustment table selection unit 1084 to select a corresponding adjustment table from among multiple types of adjustment tables prepared in advance as shown in FIG. 11 .
  • a corresponding adjustment table For example, when the slider values of the highlight and shadow sliders are set at ⁇ 1, an adjustment table represented by a dashed-dotted line in FIG. 11 is selected.
  • an adjustment table represented by a chain double-dashed line is selected, and when the slider values of the highlight and shadow sliders are set at ⁇ 3, an adjustment table represented by a solid line is selected.
  • parameters for D range adjustment and an adjustment table for local contrast correction are determined based on setting values set on the GUI by the user, and this enables more accurate edge enhancement.
  • the other constitution and operational advantages are the same as those of the first embodiment described above.
  • FIGS. 12 to 14 a description will be given of a digital camera which is a third embodiment of the image processing apparatus according to the present invention. It should be noted that portions overlapping or equivalent to those in the first embodiment described above will be described using the same reference numerals in the figures, and description thereof will be simplified or omitted.
  • FIG. 12 is a control block diagram of the luminance adjustment unit 107 .
  • the luminance adjustment unit 107 according to the present embodiment is constructed by adding the GUI parameter obtainment unit 1082 , the adjustment table selection unit 1084 , a table combining unit 1085 , and a modified gain table 1086 to the first embodiment ( FIG. 2 ) described above.
  • the luminance-by-luminance gain generation unit 1077 generates luminance-by-luminance gains from a blurred signal obtained by causing the low-pass filtering processing unit 1076 to perform low-pass filtering on a signal which has been subjected to the local contrast correction process by the local contrast correction unit 1071 .
  • a luminance-by-luminance gain table is modified by combining the luminance-by-luminance gain table and an adjustment table together in luminance adjustment, and luminance-by-luminance gains are generated based on the modified luminance-by-luminance gain table.
  • a signal input to the low-pass filtering processing unit 1076 is not an output signal from the local contrast correction signal 1071 but an output signal from the D range adjustment unit 1070 .
  • FIG. 13 a concrete description will be given of how the luminance adjustment unit 107 modifies a luminance-by-luminance gain table.
  • Each process in FIG. 13 is carried out by a CPU or the like of the control unit 120 expanding a control program stored in a ROM, not shown, into the memory 121 .
  • step S 21 the control unit 120 obtains slider values of the respective highlight and shadow sliders set by user operation on the tone correction parameter setting menu 301 , and the process proceeds to step S 22 .
  • the control unit 120 causes the GUI parameter obtainment unit 1082 to obtain slider values of the respective highlight and shadow sliders via the I/F 122 in FIG. 1 .
  • step S 22 the control unit 120 causes the adjustment table selection unit 1084 to select an adjustment table based on the obtained GUI parameters, and the process proceeds to step S 23 .
  • the process here is similar to that in the step S 14 of the second embodiment described above, and a corresponding adjustment table is selected from among multiple types of adjustment tables prepared in advance as shown in FIG. 11 .
  • the control unit 120 uses the adjustment table, which was selected in the step S 22 , in the local contrast correction process in the luminance mainline system and also uses the adjustment table, which was selected in the step S 22 , for combination with the luminance-by-luminance gain table 1078 by the table combining unit 1085 .
  • a modified luminance-by-luminance gain table 1086 (APCGainMod [Y]) is represented by an equation (5) below.
  • APC GainMod[ Y] APC Gain[ Ohy[Y]] (5)
  • FIG. 14 is a graph showing the modified luminance-by-luminance gain table 1086 (APCGainMod [Y]), and in FIG. 14 , a broken line shows pre-modification, and a solid line indicates post-modification.
  • APCGainMod [Y] modified luminance-by-luminance gain table 1086
  • the same process as in the first embodiment described above is carried out, that is, D range adjustment, local contrast correction, gamma conversion, and addition of a generated edge signal are performed in this order.
  • FIG. 15 a description will be given of a digital camera which is a fourth embodiment of the image processing apparatus according to the present invention. It should be noted that portions overlapping or equivalent to those in the first embodiment described above will be described using the same reference numerals in the figures, and description thereof will be simplified or omitted.
  • FIG. 15 is a control block diagram of the luminance adjustment unit 107 .
  • the luminance adjustment unit 107 is constructed by adding a reduction processing unit 1087 and adding a local contrast correction unit 1088 and an enlargement processing unit 1089 to the edge signal generation system as compared with the first embodiment ( FIG. 2 ) described above.
  • the low-pass filter processing unit 1076 is omitted from the edge signal generation system.
  • an output from the local contrast correction unit 1071 in the luminance mainline system is also used as an input signal for a process in the edge signal generation system.
  • the local contrast correction process is carried out at a resolution different from that in the luminance mainline system.
  • the luminance-by-luminance gain adjustment aims at adjusting the appropriate amount of edge to be added according to luminance of each pixel with consideration given to gamma characteristics.
  • luminance-by-luminance gains will flap, resulting in inappropriate gain enhancement.
  • the process in which a luminance signal for reference to the luminance-by-luminance gain table is subjected to low-pass filtering to lower a frequency band is carried out. This means that there is nothing wrong with cutting a high-frequency component of an output signal in the local contrast correction process.
  • the local contrast correction process is carried out at low resolution in advance.
  • an output signal from the D range adjustment unit 1070 is reduced by the reduction processing unit 1087 .
  • the rate of reduction should be consistent with the degree of blurring in low-pass filtering performed by the low-pass filter processing unit 1076 in the first embodiment described above. For example, when the filter coefficient is [121], it is preferred that the rate of reduction is set at 1 ⁇ 2 with consideration given to aliasing.
  • the local contrast correction unit 1088 carries out the local contrast correction process.
  • the enlargement processing unit 1089 returns the signal to a size before reduction. Luminance-by-luminance gains are generated from the signal thus obtained, which has been subjected to the local contrast correction process and of which a high-frequency component has been cut, to make a luminance-by-luminance gain adjustment and obtain an edge-adding signal.
  • Embodiment(s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s).
  • computer executable instructions e.g., one or more programs
  • a storage medium which may also be referred to more fully as a
  • the computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions.
  • the computer executable instructions may be provided to the computer, for example, from a network or the storage medium.
  • the storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)TM), a flash memory device, a memory card, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Picture Signal Circuits (AREA)
  • Image Processing (AREA)
  • Facsimile Image Signal Circuits (AREA)
US14/689,506 2014-04-25 2015-04-17 Image processing apparatus that performs tone correction and edge enhancement, control method therefor, and storage medium Active US9635331B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014-091350 2014-04-25
JP2014091350A JP6335614B2 (ja) 2014-04-25 2014-04-25 画像処理装置、その制御方法、及びプログラム

Publications (2)

Publication Number Publication Date
US20150312538A1 US20150312538A1 (en) 2015-10-29
US9635331B2 true US9635331B2 (en) 2017-04-25

Family

ID=54261841

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/689,506 Active US9635331B2 (en) 2014-04-25 2015-04-17 Image processing apparatus that performs tone correction and edge enhancement, control method therefor, and storage medium

Country Status (4)

Country Link
US (1) US9635331B2 (sl)
JP (1) JP6335614B2 (sl)
CN (1) CN105007473B (sl)
DE (1) DE102015005149A1 (sl)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11308589B2 (en) * 2018-05-03 2022-04-19 Canon Virginia, Inc. Devices, systems, and methods for enhancing images
JP6067950B2 (ja) * 2014-09-30 2017-01-25 富士フイルム株式会社 画像処理装置、画像処理方法、プログラム及び記録媒体
US9881364B2 (en) * 2015-08-10 2018-01-30 Fuji Xerox Co., Ltd. Image processing apparatus, image processing method and computer readable medium for image enhancement

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050275732A1 (en) * 2004-06-15 2005-12-15 Yoshitaka Takeuchi Image capturing apparatus, image capturing method, and program
JP2007228451A (ja) 2006-02-27 2007-09-06 Konica Minolta Holdings Inc 撮像装置
US7843493B2 (en) 2006-01-31 2010-11-30 Konica Minolta Holdings, Inc. Image sensing apparatus and image processing method
US20120105627A1 (en) * 2010-10-28 2012-05-03 Canon Kabushiki Kaisha Image processing apparatus and image processing method
CN102833471A (zh) 2011-06-15 2012-12-19 奥林巴斯映像株式会社 摄像装置和摄像方法

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0831971B2 (ja) * 1986-11-10 1996-03-27 松下電器産業株式会社 信号処理装置
JPH1013854A (ja) * 1996-06-18 1998-01-16 Mitsubishi Electric Corp 映像強調装置
JP3080019B2 (ja) * 1996-12-13 2000-08-21 日本電気株式会社 映像信号処理装置
JP4013699B2 (ja) * 2002-08-20 2007-11-28 松下電器産業株式会社 画像処理装置および画像処理方法
KR101089426B1 (ko) * 2003-09-11 2011-12-07 파나소닉 주식회사 시각 처리 장치, 시각 처리 방법, 시각 처리 프로그램 및 반도체 장치
JP2005285071A (ja) * 2004-03-31 2005-10-13 Sanyo Electric Co Ltd 画像処理装置
JP4437149B2 (ja) * 2006-04-28 2010-03-24 パナソニック株式会社 視覚処理装置、視覚処理方法、プログラム、記録媒体、表示装置および集積回路
JP5034436B2 (ja) * 2006-10-19 2012-09-26 ソニー株式会社 画像処理装置および画像処理方法、並びにカメラシステム
JP5557635B2 (ja) * 2010-07-21 2014-07-23 Ｈｏｙａ株式会社 輪郭強調装置
JP5743918B2 (ja) * 2012-01-31 2015-07-01 株式会社東芝 画像処理装置
JP5958280B2 (ja) 2012-10-31 2016-07-27 トヨタ自動車株式会社 運転支援装置

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050275732A1 (en) * 2004-06-15 2005-12-15 Yoshitaka Takeuchi Image capturing apparatus, image capturing method, and program
US7843493B2 (en) 2006-01-31 2010-11-30 Konica Minolta Holdings, Inc. Image sensing apparatus and image processing method
US8228397B2 (en) 2006-01-31 2012-07-24 Konica Minolta Holdings, Inc. Image sensing apparatus and image processing method
JP2007228451A (ja) 2006-02-27 2007-09-06 Konica Minolta Holdings Inc 撮像装置
US20120105627A1 (en) * 2010-10-28 2012-05-03 Canon Kabushiki Kaisha Image processing apparatus and image processing method
CN102833471A (zh) 2011-06-15 2012-12-19 奥林巴斯映像株式会社 摄像装置和摄像方法
US20120320236A1 (en) * 2011-06-15 2012-12-20 Tetsuya Toyoda Imaging device and imaging method
US8982242B2 (en) 2011-06-15 2015-03-17 Olympus Imaging Corp. Imaging device and imaging method
US9357131B2 (en) 2011-06-15 2016-05-31 Olympus Corporation Imaging device and imaging method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Nov. 2, 2016 Chinese Office Action corresponding to Chinese Patent Application No. 201510205462.1.

Also Published As

Publication number Publication date
DE102015005149A1 (de) 2015-10-29
JP2015211320A (ja) 2015-11-24
CN105007473B (zh) 2017-07-07
US20150312538A1 (en) 2015-10-29
JP6335614B2 (ja) 2018-05-30
CN105007473A (zh) 2015-10-28

Similar Documents

Publication Publication Date Title
US10063743B2 (en) Image processing apparatus, image processing method, and non-transitory computer-readable storage medium
US8144985B2 (en) Method of high dynamic range compression with detail preservation and noise constraints
CN101322416B (zh) 图像信号处理装置及图像信号处理方法
US8472713B2 (en) Image processor, image processing method, and computer-readable medium
JP6415062B2 (ja) 画像処理装置、画像処理方法、制御プログラム、および記録媒体
US9177396B2 (en) Image processing apparatus and image processing method
JP4894907B2 (ja) 撮像装置、撮像処理方法及びプログラム
JP2010056774A (ja) 画像処理装置、画像処理方法、画像処理プログラム
US10297230B2 (en) Image processing apparatus
CN104954771A (zh) 进行色阶校正的图像处理设备和图像处理方法
US9712797B2 (en) Image processing apparatus, image pickup apparatus, image processing method, and non-transitory computer-readable medium
JP5873380B2 (ja) 画像処理装置およびその制御方法
US9635331B2 (en) Image processing apparatus that performs tone correction and edge enhancement, control method therefor, and storage medium
US9294685B2 (en) Image processing apparatus, electronic camera, and medium storing image processing program
JP4212741B2 (ja) 画像処理装置
JP6092690B2 (ja) 撮像装置およびその制御方法
US11503215B2 (en) Image processing apparatus, image processing method, and non-transitory computer-readable storage medium that notify a user of a region in which tone characteristics can be restored
US10235742B2 (en) Image processing apparatus, image capturing apparatus, image processing method, and non-transitory computer-readable storage medium for adjustment of intensity of edge signal
US11303869B2 (en) Image processing apparatus and image processing method
US9531956B2 (en) Image display apparatus that adjusts pixel gradation values using a lower limit value and control method thereof
US9055232B2 (en) Image processing apparatus capable of adding soft focus effects, image processing method, and storage medium
US8854256B2 (en) Image capture apparatus and method of controlling the same
JP6627418B2 (ja) 画像処理装置、画像処理方法及びプログラム
JP2014220626A (ja) 撮像装置及びその制御方法、プログラム、記憶媒体
JP5881350B2 (ja) 画像処理装置、画像処理方法、および画像処理プログラム

Legal Events

Date Code Title Description
AS Assignment

Owner name: CANON KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NASHIZAWA, HIROAKI;REEL/FRAME:036180/0270

Effective date: 20150409

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4