WO2015129259A1 - 画像処理装置及び画像処理方法 - Google Patents

画像処理装置及び画像処理方法 Download PDF

Info

Publication number
WO2015129259A1
WO2015129259A1 PCT/JP2015/000945 JP2015000945W WO2015129259A1 WO 2015129259 A1 WO2015129259 A1 WO 2015129259A1 JP 2015000945 W JP2015000945 W JP 2015000945W WO 2015129259 A1 WO2015129259 A1 WO 2015129259A1
Authority
WO
WIPO (PCT)
Prior art keywords
correction
image processing
image
input
input parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2015/000945
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
祐 長谷川
暁広 古田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Management Co Ltd
Original Assignee
Panasonic Intellectual Property Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Management Co Ltd filed Critical Panasonic Intellectual Property Management Co Ltd
Priority to US15/120,564 priority Critical patent/US10297057B2/en
Priority to CN201580009962.6A priority patent/CN106030662B/zh
Publication of WO2015129259A1 publication Critical patent/WO2015129259A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/40—Image enhancement or restoration using histogram techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/40—Picture signal circuits
    • H04N1/407—Control or modification of tonal gradation or of extreme levels, e.g. background level
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image

Definitions

  • the present invention relates to an image processing apparatus and an image processing method for performing image processing based on histogram data for each gradation in image data.
  • a region with high brightness (bright region) and a region with low brightness (dark region) may be mixed. For example, if an area where a bright outdoor area is reflected by sunlight and an area where a dark indoor area is captured, a sufficient contrast between the bright area and the dark area can be obtained, but there is contrast within each area. There is a problem that the subject is not uniformly determined and the subject becomes unclear.
  • tone correction processing by a so-called local histogram equalization method is known in which a tone conversion curve (tone curve) to be obtained is obtained and tone correction processing is performed using the tone conversion curve.
  • tone conversion curve tone curve
  • the image data is divided into a plurality of blocks, the representative values of each block included in the local area centered on each block are aggregated, histogram data for each block is generated, and gradation conversion is performed based on the histogram data.
  • a technique for obtaining a curve and performing gradation correction processing is known (see, for example, Patent Document 1). According to the image processing apparatus disclosed in Patent Document 1, the amount of calculation can be reduced.
  • the present invention provides an image processing apparatus and an image processing method that perform gradation correction processing easily and efficiently even if the user is not skilled in gradation correction processing. With the goal.
  • the present invention is an image processing apparatus having image data, a display unit that displays an operation screen for a first input parameter related to gradation correction processing, and an operation for changing the first input parameter for the operation screen. And converting the first input parameter after the change into a second input parameter related to the gradation correction process, and performing the gradation correction process on the image data using the second input parameter. And an image processing unit.
  • the operation screen of the first input parameter related to the gradation correction process is displayed on the display unit.
  • the conversion unit converts the changed first input parameter into a second input parameter related to the gradation correction process in response to an operation of changing the first input parameter on the operation screen.
  • the image processing unit performs gradation correction processing on the image data using the second input parameter.
  • the image processing apparatus displays the operation screen of the first input parameter that can be understood relatively easily even if the user is not familiar with the gradation correction processing, and the first input parameter for the operation screen is displayed.
  • the first input parameter can be converted into a second input parameter that is difficult for a user who is not familiar with the gradation correction process, and the gradation correction process is performed using the second input parameter.
  • the gradation correction process can be performed simply and efficiently.
  • the present invention is an image processing method in an image processing apparatus having image data, the step of displaying an operation screen for a first input parameter relating to gradation correction processing, and a change of the first input parameter for the operation screen.
  • the operation screen for the first input parameter related to the gradation correction processing is displayed on the display unit.
  • the changed first input parameter is converted into the second input parameter related to the gradation correction processing.
  • the image data is subjected to gradation correction processing using the second input parameter.
  • the image processing apparatus displays the operation screen of the first input parameter that can be understood relatively easily even if the user is not familiar with the gradation correction processing, and the first input parameter for the operation screen is displayed.
  • the first input parameter can be converted into a second input parameter that is difficult for a user who is not familiar with the gradation correction process, and the gradation correction process is performed using the second input parameter.
  • the gradation correction process can be performed simply and efficiently.
  • the gradation correction process can be performed efficiently.
  • FIG. 1 is a block diagram showing an internal configuration of the image processing apparatus according to the present embodiment.
  • FIG. 2 is a diagram illustrating a GUI as an operation screen displayed on the display unit.
  • FIG. 3 is a diagram illustrating an example of the relationship between the input parameter, the parameter conversion unit, the internal parameter, and the operation in the gradation conversion processing unit.
  • FIG. 4 is an explanatory diagram showing a procedure of local histogram generation processing when the correction range is changed.
  • FIG. 5A is a diagram showing a correction range set for a thumbnail image.
  • FIG. 5B is a diagram showing the correction range set for the thumbnail image.
  • FIG. 6 is a flowchart for explaining the operation procedure of the gradation correction processing of the image processing apparatus of this embodiment.
  • FIG. 1 is a block diagram showing an internal configuration of the image processing apparatus according to the present embodiment.
  • FIG. 2 is a diagram illustrating a GUI as an operation screen displayed on the display unit.
  • FIG. 3 is a diagram illustrating an example
  • FIG. 7 is a diagram illustrating a display example of a moving image immediately before reproduction, in which the moving image viewer display area and the image processing menu display area are displayed on the same screen.
  • FIG. 8 is a diagram illustrating a display example of a moving image immediately after reproduction, in which the moving image viewer display area and the image processing menu display area are displayed on the same screen.
  • FIG. 9 is a diagram illustrating a display example of a moving image after the spatial gradation correction is performed, in which the moving image viewer display area and the image processing menu display area are displayed on the same screen.
  • FIG. 10 is a diagram showing an example in which the display area of the moving image viewer and the display area of the image processing menu are displayed on the same screen, and the details of the spatial gradation correction menu are shown.
  • FIG. 10 is a diagram showing an example in which the display area of the moving image viewer and the display area of the image processing menu are displayed on the same screen, and the details of the spatial gradation correction menu are shown.
  • FIG. 11 is a diagram showing an example in which the display area of the moving image viewer and the display area of the image processing menu are displayed on the same screen, and the details of the spatial gradation correction menu are shown.
  • FIG. 12 is a diagram showing an example in which the display area of the moving image viewer and the display area of the image processing menu are displayed on the same screen, and the details of the spatial gradation correction menu are shown.
  • FIG. 13 is a diagram showing an example in which the display area of the moving image viewer and the display area of the image processing menu are displayed on the same screen, and the details of the spatial gradation correction menu are shown.
  • FIG. 14 shows a moving image viewer display area and a display area for each image processing menu on the same screen, and a moving image table after each image processing for spatial gradation correction, multiple image composition NR, and snow and rain removal. It is a figure which shows an example.
  • the image processing apparatus is an electronic apparatus that can input or store image data captured by an imaging apparatus such as a camera and can be configured using, for example, a PC (Personal Computer).
  • an imaging apparatus such as a camera
  • PC Personal Computer
  • the image processing apparatus of the present embodiment is not limited to a PC.
  • the image data input or stored in the image processing apparatus is referred to as “input image data”.
  • the present invention is not limited to the image processing apparatus and the image processing method, and causes a computer to execute an operation specified by the image processing method and a program for causing the computer to execute an operation specified by the image processing method.
  • You may express as a computer-readable recording medium with which the program was recorded.
  • FIG. 1 is a block diagram showing an internal configuration of the image processing apparatus 1 of the present embodiment.
  • the image processing apparatus 1 illustrated in FIG. 1 includes a control unit 11, an operation input unit 12, a display unit 13, a display control unit 14, a gradation correction processing unit 15, an input image storage unit 16, and an output image storage unit 17.
  • the control unit 11 is configured using, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory), and comprehensively controls the operation of each unit of the image processing apparatus 1.
  • a CPU Central Processing Unit
  • ROM Read Only Memory
  • RAM Random Access Memory
  • MPU Micro Processing Unit
  • DSP Digital Signal Processor
  • the operation input unit 12 is an input device such as a mouse and a keyboard that can be input by the user.
  • the display unit 13 is a monitor that displays various information or data on the screen.
  • the operation input part 12 and the display part 13 may be comprised using the touch panel formed integrally.
  • the display control unit 14 controls a graphical user interface (GUI), accepts an input operation by the user from the operation input unit 12, and controls the screen display of the display unit 13.
  • GUI graphical user interface
  • the gradation correction processing unit 15 receives input image data, performs spatial gradation correction processing (hereinafter simply referred to as “gradation correction processing”), and outputs output image data obtained as a result of the gradation correction processing. Output. Details of the gradation correction processing unit 15 will be described later.
  • the input image storage unit 16 is configured by using, for example, a RAM or a flash memory, and stores input image data.
  • the output image storage unit 17 is configured using, for example, a RAM or a flash memory, and stores output image data obtained by gradation correction processing.
  • FIG. 2 is a diagram showing a GUI 20 as an operation screen displayed on the display unit 13.
  • the GUI 20 as an operation screen is a control window for accepting a change in the input parameter (first input parameter) of the spatial gradation correction process, and allows the user to change any one or more of the five input parameters.
  • a correction method, correction intensity, color enhancement degree, brightness, and correction range can be set as, for example, five first input parameters.
  • These first input parameters are parameters that can be understood relatively easily even if the user is not familiar with the tone correction processing.
  • tone correction processing is not performed, “None” developed by the pull-down menu 21 may be selected.
  • the correction strength, color enhancement level, brightness, and correction range shown in FIG. 2 are designated by slide bars 22, 23, 24, and 25, respectively.
  • the sliders 22a, 23a, 24a, 25a on the slide bars 22, 23, 24, 25 in the left-right direction the value of each first parameter is set.
  • the numerical value display units 26, 27, 28, and 29 arranged on the right side of the slide bars 22, 23, 24, and 25 display the specified correction intensity, color enhancement degree, brightness, and correction range values, respectively. .
  • the values of the correction intensity, the color enhancement degree, the brightness, and the correction range are set to “192”, “16”, “55”, and “255” with the value 255 as the maximum value. Details of the correction strength, color enhancement degree, brightness, and correction range will be described later.
  • the GUI 20 is provided with a “parameter initialization” button 32 for returning all parameters to initial values.
  • all parameters are set to initial values.
  • the initial value may be a value set in advance by the user, or may be set to a value 0, a value 255, or an intermediate value.
  • FIG. 3 is a diagram illustrating an example of a relationship between an input parameter (first input parameter), a parameter conversion unit, an internal parameter (second input parameter), and an operation in the gradation conversion processing unit 43.
  • the gradation correction processing unit 15 illustrated in FIG. 3 includes a parameter conversion unit 41 that converts five input parameters (first input parameters) designated by a user input operation into internal parameters (second input parameters). And a tone conversion processing unit 43 that performs tone correction processing on input image data using internal parameters (second input parameters) and outputs output image data obtained by the tone correction processing.
  • the internal parameter (second input parameter) is a parameter that is difficult for a user who is not proficient in the gradation correction process, and is a parameter necessary for performing the gradation correction process. Details will be described later. To do.
  • the parameter conversion unit 41 uses the table (not shown) prepared in advance to select the selected correction. “Hist upper limit clip amount” and “hist lower limit clip amount”, which are internal parameters (second input parameters) of 32 gradations corresponding to the method, are set.
  • the correction method is an input parameter (first input parameter) for selecting any one of four of contrast enhancement, backlight correction, dark part correction, and bright part correction.
  • Contrast enhancement is a correction method selected when the low contrast of input image data is increased due to the influence of cloudy weather or the like.
  • Backlight correction is a correction method that is selected when the dynamic range that is lacking due to overexposure or underexposure is increased.
  • Dark part correction is a correction method selected when an image having many dark parts is brightened due to underexposure or the like.
  • Bright part correction is a correction method selected when an image having many bright parts is darkened due to overexposure or the like.
  • the hist upper limit clip amount is an amount (upper limit value) set for truncating a value equal to or higher than the upper limit value when the local histogram in the local region of the input image data exceeds a predetermined upper limit value.
  • the lower limit clip amount is an amount (lower limit value) set to raise the lower limit value when the local histogram in the local region of the input image data is equal to or lower than a predetermined lower limit. In this way, the local histogram is shaped by setting the upper limit clip amount and the lower limit clip amount.
  • the parameter conversion unit 41 converts the “brightness” that is the input parameter (first input parameter) into the “hist distribution coefficient setting value” and the “distribution start / end position” that are internal parameters (second input parameter). Convert. Brightness is a parameter for moving the gravity center position of the local histogram to the low gradation side or the high gradation side.
  • the parameter conversion unit 41 converts “correction strength” that is an input parameter (first input parameter) into “hist distribution coefficient setting value” and “image blend ratio” that are internal parameters (second input parameters). .
  • the correction strength is a parameter for setting the blend rate ⁇ between the output image data and the input image data, and the distribution width (the number of gradations to be distributed) to the peripheral gradation of the local histogram.
  • the histogram distribution coefficient setting value and distribution start / end positions are used to set the distribution width and distribution ratio (weighting coefficient) when distributing the local histogram. If the distribution ratio is small and the distribution width is small, the corrected image Increase the degree of contrast enhancement. When the distribution ratio is large and the distribution width is large, the degree of contrast enhancement of the corrected image is relaxed.
  • the histogram distribution coefficient setting value and the distribution start / end positions are used for shaping the local histogram together with the histogram upper limit clip amount and the histogram lower limit clip amount.
  • the image blend ratio is a blend ratio ⁇ (0 to 1) of the corrected image with respect to the input image.
  • the output image is obtained by adding the input image ⁇ (1 ⁇ ) and the corrected image ⁇ ⁇ . Accordingly, the larger the blend rate ⁇ , the larger the usage ratio of the corrected image (output image data).
  • the parameter conversion unit 41 converts the “color enhancement degree” that is an input parameter (first input parameter) into “color gain” that is an internal parameter (second input parameter).
  • the color enhancement degree is a parameter for adjusting the degree of color enhancement of the output image, and corresponds to color gain.
  • the parameter conversion unit 41 uses the “correction range” that is the input parameter (first input parameter) and the “image size” of the input image data, and the “weighting coefficient” that is the internal parameter (second input parameter). And “weighting range”.
  • FIG. 4 is an explanatory diagram showing a procedure of local histogram generation processing when the correction range is changed.
  • the correction range is a parameter for setting a range for generating a local histogram.
  • the image size is a size represented by the number of horizontal pixels and the number of vertical pixels of the input image.
  • the parameter converter 41 When the correction range is changed within the range of values 0 to 255, the parameter converter 41 generates a weighting range and a weighting coefficient. The generated weighting range and weighting coefficient are used for processing of local histogram generation (step T3 shown in FIG. 3) described later.
  • the parameter converter 41 generates four weighting ranges ws1, ws2, ws3, and ws4 and weighting coefficients wc1, wc2, wc3, and wc4, respectively.
  • FIG. 5A and 5B are diagrams showing the correction range 53 set in the thumbnail image 50.
  • the thumbnail image 50 is a reduced image obtained by converting the input image data so that 8 ⁇ 8 pixels constitute one block.
  • 5A and 5B four weighting ranges ws1, ws2, ws3, and ws4 are set for the thumbnail image 50 in accordance with the distance from the center (x 0 , y 0 ) of the specified correction range 53. .
  • weighting coefficients wc1, wc2, wc3, and wc4 are set for the four weighting ranges ws1, ws2, ws3, and ws4, respectively.
  • These weighting ranges and weighting coefficients are examples, and can be changed as appropriate.
  • the local histogram When the local histogram is generated when the local histogram calculation position (x, y) is in the weighting range ws3, the number of elements in the weighting range ws3 is added to the weighting coefficient wc3 times and counted. Similarly, when the local hysteresis calculation position is in the weighting range ws2, the number of elements in the weighting range ws2 is added to the weighting coefficient wc2 and counted. As a result, the influence on the generation of the local histogram can be reduced as the distance from the center of the correction range 53 increases. Note that all the elements in the correction range may be added uniformly without weighting.
  • the correction range 53 when the correction range 53 is set large, the local histogram is calculated over a wide range on the thumbnail image 50. As a result, the tone curve is optimized for the entire image.
  • the gradation conversion processing unit 43 performs gradation correction processing on the input image data using the internal parameter (second input parameter), and outputs the output image data obtained as a result of the gradation correction processing. Output.
  • the gradation conversion processing unit 43 performs YC conversion for separating input image data into lightness (luminance) and color difference (T1), and a thumbnail image having 8 ⁇ 8 pixels as one block. Is generated (T2). Although 8 ⁇ 8 pixels are used as one block here, in order to reduce the amount of calculation, a block having a larger number of pixels such as 16 ⁇ 16 pixels may be used as one block.
  • the gradation conversion processing unit 43 generates a local histogram for the thumbnail image using the weighting range and weighting coefficient that are internal parameters (second input parameters) (T3).
  • the gradation conversion processing unit 43 shapes the local histogram using the internal parameter (second input parameter), ie, the upper limit clip amount, the lower limit clip amount, the histogram distribution coefficient setting value, and the distribution start / end positions (second input parameter). T4).
  • the gradation conversion processing unit 43 generates a tone curve (gradation conversion curve) from the shaped histogram (T5).
  • the gradation conversion processing unit 43 performs gradation conversion of the input image using the generated tone curve, the image blend ratio that is an internal parameter (second input parameter), and the luminance data obtained in step T1. (T6).
  • the gradation conversion processing unit 43 performs color enhancement on the input image after gradation conversion using a color gain that is an internal parameter (T7), and obtains output image data.
  • FIG. 6 is a flowchart for explaining the operation procedure of the gradation correction processing of the image processing apparatus 1 of this embodiment.
  • the display control unit 14 displays the input image data stored in the input image storage unit 16 and the GUI 20 as an operation screen on the display unit 13 (S1).
  • the operation input unit 12 accepts a user input operation on the GUI 20 displayed on the display unit 13 (S2).
  • the gradation correction processing unit 15 converts the five parameters of the GUI 20 set by the input operation into internal parameters (S3), and further uses the converted internal parameters to perform gradation correction processing (see FIG. 3) (S4).
  • the gradation correction processing unit 15 stores the output image data obtained by the gradation correction processing in the output image storage unit 17 (S5). Further, the display control unit 14 displays the output image data stored in the output image storage unit 17 on the display unit 13.
  • the display control unit 14 determines whether or not an input for completion of the gradation correction processing has been input from the operation input unit 12 (S6). If there is no input for completion of the gradation correction process (S6, NO), the process returns to step S2 and the same operation is repeated. On the other hand, when there is an input for completion of the gradation correction processing, this operation ends.
  • the image processing apparatus 1 allows the user to change the input parameter (first input parameter) based on the operation of the pull-down menu 21 and the slide bars 22 to 25 included in the GUI 20 displayed on the display unit 13. Accept the change operation.
  • the image processing apparatus 1 converts one or a plurality of input parameters (first input parameters) into internal parameters (second input parameters) according to a change operation by the user.
  • the image processing apparatus 1 uses the internal parameter (second input parameter) in response to such a simple input parameter (first input parameter) change operation to locally or wholly input image data.
  • Gradation correction processing is performed, and output image data is displayed on the display unit 13.
  • the user looks at the output image data displayed on the display unit 13 and determines that the result of the local gradation correction processing is not good, the user can input the input parameter (first input parameter) as many times as necessary.
  • the change operation can be redone.
  • the image processing apparatus 1 has a correction method, a correction strength, a relatively easy understanding even for a user who does not know the contents of difficult parameters such as internal parameters (second input parameters).
  • the gradation correction process can be easily performed in accordance with the changing operation of the five input parameters (first input parameters) including the color enhancement degree, the brightness, and the correction range.
  • the image processing apparatus 1 can be simplified by a simple change operation of the input parameter (first input parameter) of the GUI 20 displayed on the display unit 13 as an operation screen, even if the user is not familiar with the gradation correction process.
  • the image processing apparatus 1 of the present embodiment may display the image data of the moving image read from the input image storage unit 16 and the menu screen for spatial gradation correction on the same screen of the display unit 13 (FIG. 7). To FIG. 14).
  • screen examples displayed on the same screens WD1 to WD8 of the display unit 13 will be described with reference to FIGS.
  • FIG. 7 is a diagram showing a display example of a moving image immediately before reproduction, in which the moving image viewer display area VIW and the image processing menu display area MNU are displayed on the same screen WD1.
  • FIG. 8 is a diagram showing a display example of a moving image immediately after reproduction, with the moving image viewer display area VIW and the image processing menu display area MNU displayed on the same screen WD2.
  • FIG. 9 is a diagram showing a display example of a moving image after the spatial gradation correction is performed, in which the moving image viewer display area VIW and the image processing menu display area MNU are displayed on the same screen WD3.
  • FIG. 7 shows a viewer display area VIW of moving image data at the time of reading from the input image storage unit 16 and immediately before reproduction, and image processing that can be executed by the image processing apparatus 1 (specifically, A display area MNU of a menu (image processing menu) of spatial gradation correction, multi-image composition NR (Noise Reduction), snowfall / rain removal) is shown as the same screen WD1.
  • a display area MNU of a menu (image processing menu) of spatial gradation correction, multi-image composition NR (Noise Reduction), snowfall / rain removal) is shown as the same screen WD1.
  • FIG. 7 the detailed contents of each of these image processing menus are not displayed, only the names of the respective image processing menus are displayed, and image data of a moving image to be subjected to image processing in the image processing apparatus 1;
  • the relationship with the list of image processing menus that can be executed by the image processing apparatus 1 is visible to the user at a glance. Therefore, the user can confirm the image data of the moving image to be
  • the operation button set ST related to the playback, pause, stop, fast forward, rewind, recording, and return operation of the video and the video playback timing are visually displayed.
  • the gradation correction unit 15 of the image processing apparatus 1 performs the above-described operation.
  • spatial gradation correction is performed on the image data of the moving image displayed in the display area VIW.
  • the gradation correction unit 15 of the image processing apparatus 1 performs spatial gradation correction on the image data of the moving image displayed in the display area VIW. Interrupt.
  • the image processing apparatus 1 is displayed in the display area MNU by a simple user operation (that is, whether or not the menu bar MNU1 is pressed) in a state in which the moving image data displayed in the display area VIW is reproduced.
  • the image processing corresponding to any one of the image processing menus can be executed accurately or can be interrupted, and the processing result before and after the image processing can be easily confirmed by the user.
  • the control unit 11 of the image processing apparatus 1 may display a cursor CSR1 having a different shape when the cursor CSR is on or near any menu bar of the image processing menu, or may display the original cursor.
  • a CSR may be displayed.
  • the control unit 11 of the image processing apparatus 1 displays a screen similar to the detailed operation screen (see FIG. 2) for setting the input parameters related to the spatial gradation correction in the display area MNU1D. indicate.
  • the display area MNU1D shown in FIG. 10 to FIG. 13 automatically set check boxes in which the correction method, the correction intensity, the color enhancement degree, the brightness, and the correction range, which are input parameters related to the spatial gradation correction, are predetermined values.
  • An ATC (see FIG. 13) is additionally displayed.
  • the predetermined values of the correction method, correction intensity, color enhancement, brightness, and correction range at the time of automatic setting are not limited to the initial values, but are dynamically based on, for example, the result of image processing in the gradation correction unit 15. It may be set, and so on.
  • the “parameter initialization” button 32 for returning all input parameters to the initial values is not shown in FIGS.
  • the user operates the cursor CSR on the seek bar SKB (see the sliders 22 a, 23 a, 24 a, and 25 a shown in FIG. 2) provided for each correction intensity, color enhancement degree, brightness, and correction range.
  • the image processing apparatus 1 uses the internal parameters changed with the input parameters after the moving operation on the image data of the moving image being reproduced in the display area VIW. Adjust the tone.
  • numerical values for example, up to 0-255
  • the image processing apparatus 1 performs spatial gradation correction on the image data of the moving image being reproduced in the display area VIW, using the internal parameter changed in accordance with the input parameter after the input.
  • the correction strength is “212” in FIG. 10, the correction strength is changed to “80” in FIG. 11, so the degree of clarity of the image data of the moving image shown in FIG. 10 is the image of the moving image shown in FIG. 11. Although it is deteriorated as compared with the degree of sharpness of data, the processing load of the image processing apparatus 1 can be reduced and the user can sufficiently grasp the contents of the moving image.
  • the brightness is “143” in FIG. 10, the brightness is changed to “250” in FIG. 12, so the moving image data shown in FIG. 12 is the brightness of the moving image data shown in FIG. 10. Since the image data of the operation shown in FIG. 10 has deteriorated (that is, the contrast is low), the processing of the image processing apparatus 1 in the correction method “contrast correction” is performed. In addition to reducing the load, the user can fully grasp the content of the moving image.
  • a check box ATC for automatically setting an input parameter related to spatial gradation correction shown in FIG. 13 to a default value (for example, an initial value) for each input parameter is pressed by the user's operation with the cursor CSR, image processing is performed.
  • the apparatus 1 performs spatial gradation correction on the image data of the moving image being reproduced in the display area VIW, using the internal parameters converted using the default values for each input parameter.
  • the image processing apparatus 1 uses, for example, a typical initial value at the time of spatial gradation correction as a default value for a user who does not know what value should be input as an input parameter related to spatial gradation correction.
  • the image processing apparatus 1 of the present embodiment displays the moving image image data read from the input image storage unit 16 and a plurality of image processing menu screens including spatial gradation correction on the same screen of the display unit 13. (See FIG. 14).
  • screen examples displayed on the same screens WD8 to WD10 of the display unit 13 will be described with reference to FIG.
  • FIG. 14 shows the display area VIW of the moving image viewer and the display areas MNU1, MNU2, and MNU3 of each image processing menu on the same screen WD8, and each of spatial gradation correction, multi-sheet composite NR, and snowfall removal. It is a figure which shows the example of a display of the moving image after image processing.
  • the image processing apparatus 1 is displayed by pressing the menu bar MNU 1 for spatial tone correction, the menu bar MNU 2 for combining multiple NRs, and the menu bar MNU 3 for removing snow and rain with the cursor CSR 1.
  • the image data of the moving image that has been subjected to the image processing corresponding to each menu bar is displayed in the display area VIW.
  • the image processing apparatus 1 is not limited to the single image processing (for example, spatial gradation correction) described with reference to FIGS. 7 to 13, and displays moving image data in the display area VIW.
  • a plurality of image processing can be executed according to a simple operation by the user, and a plurality of image processing results can be intuitively and visually shown to the user.
  • the multi-sheet composite NR is an image of the current frame and the frame input immediately before (previous frame) according to the contrast of the image of the input frame (current frame) and a preset motion detection level.
  • This is an image processing for reducing the noise component appearing in the image of the current frame by further calculating the synthesis ratio and synthesizing the image according to the synthesis ratio.
  • Snowfall / rain removal is whether or not a moving area (that is, a moving area) in an input frame image is a specified size or more according to a correction parameter for removing snow or rain. Accordingly, the image processing uses the image at the corresponding position in the image after the filtering process or the image of the current frame as the moving area image.
  • a spatial tone correction menu bar MNU 1 a multi-image composite NR menu bar MNU 2 corresponding to the marker DT 1 shown in FIG.
  • the control unit 11 of the image processing apparatus 1 is configured to set a plurality of input parameters related to spatial gradation correction, a plurality of composite NRs, and snow and rain removal.
  • the display area MNU1D of the operation screen is expanded and displayed on the screen.
  • illustration of the display area of the detailed operation screen for setting each of the plurality of input parameters relating to the multiple-sheet composite NR and the snow and rain removal is omitted.
  • a parameter that is, NR level
  • Parameters for specifying the motion detection level for example, the detection accuracy and detection range of the camera when the image processing apparatus 1 is a camera (that is, detection accuracy and detection range) are respectively input or specified.
  • a correction parameter that is, correction strength for removing snow or rain is input or designated.
  • the image processing apparatus 1 reproduces the moving image data displayed in the display area VIW while the user performs a simple operation (that is, whether or not the menu bars MNU1, MNU2, and MNU3 related to a plurality of image processing have been pressed). ),
  • the image processing corresponding to the pressing operation of the display areas MNU1, MNU2, and MNU3 can be accurately executed or the execution can be interrupted, and the user can easily check the processing results before and after the image processing.
  • the image processing apparatus 1 appropriately performs image processing according to an operation for changing any one of the parameters displayed in the display areas MNU1D, MNU2D, and MNU3D of detailed operation screens for setting each parameter in a plurality of image processing. Or the execution can be interrupted, and the user can easily check the processing results before and after the image processing.
  • a tone curve (gradation conversion curve) that is applied to the entire input image is generated.
  • the user specifies a desired processing area included in the input image data, and the specified processing is performed.
  • a tone curve for the region may be generated, and the tone correction processing may be performed only in this processing region. Thereby, it is possible to perform gradation correction processing for only a part of the region included in the input image.
  • the gradation correction processing is performed by the user performing an input parameter changing operation via the GUI 20 .
  • the gradation correction processing is performed without the user performing the changing operation. You may do it.
  • the gradation conversion processing unit 43 in the gradation correction processing unit 15 determines the characteristics of the histogram (including the local histogram) and notifies the parameter conversion unit 41, and the parameter conversion unit 41 includes the histogram (including the local histogram).
  • a correction method may be selected according to the shape.
  • the present invention is useful as an image processing apparatus and an image processing method for performing gradation correction processing simply and efficiently even if the user is not familiar with the gradation correction processing.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Picture Signal Circuits (AREA)
  • Studio Devices (AREA)
PCT/JP2015/000945 2014-02-28 2015-02-25 画像処理装置及び画像処理方法 Ceased WO2015129259A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15/120,564 US10297057B2 (en) 2014-02-28 2015-02-25 Image processing device and image processing method which process an image based on histogram data in the image
CN201580009962.6A CN106030662B (zh) 2014-02-28 2015-02-25 图像处理装置以及图像处理方法

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2014-039447 2014-02-28
JP2014039447 2014-02-28
JP2015019493A JP6593675B2 (ja) 2014-02-28 2015-02-03 画像処理装置及び画像処理方法
JP2015-019493 2015-02-03

Publications (1)

Publication Number Publication Date
WO2015129259A1 true WO2015129259A1 (ja) 2015-09-03

Family

ID=54008593

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/000945 Ceased WO2015129259A1 (ja) 2014-02-28 2015-02-25 画像処理装置及び画像処理方法

Country Status (4)

Country Link
US (1) US10297057B2 (enExample)
JP (1) JP6593675B2 (enExample)
CN (1) CN106030662B (enExample)
WO (1) WO2015129259A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114463237A (zh) * 2022-01-30 2022-05-10 武汉大学 基于全局运动补偿和帧间时域关联性的实时视频去雨方法

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6506580B2 (ja) * 2015-03-23 2019-04-24 キヤノン株式会社 画像処理装置およびその方法、並びに、画像表示装置
KR102544245B1 (ko) 2016-02-19 2023-06-16 삼성전자주식회사 그래픽 효과 적용 방법 및 이를 수행하는 전자 장치
KR102615070B1 (ko) * 2016-10-12 2023-12-19 삼성전자주식회사 디스플레이 장치, 및 그 제어방법
US10419197B2 (en) * 2017-04-27 2019-09-17 Qualcomm Incorporated Sharing of long-term evolution (LTE) uplink spectrum
JP2020127068A (ja) * 2019-02-01 2020-08-20 キヤノン株式会社 制御装置および制御方法
EP3937162A4 (en) * 2019-03-29 2022-05-11 Sony Group Corporation VIDEO SIGNAL PROCESSING DEVICE, VIDEO SIGNAL PROCESSING METHOD AND IMAGE RECORDING DEVICE
EP4057270A4 (en) * 2019-11-07 2022-12-28 Sony Group Corporation IMAGE PROCESSING SYSTEM, INFORMATION PROCESSING DEVICE, IMAGING DEVICE AND IMAGE PROCESSING DEVICE
US11373391B2 (en) * 2020-03-16 2022-06-28 Novatek Microelectronics Corp. Image processing device, image processing system and image processing method
JP2023019828A (ja) * 2021-07-29 2023-02-09 株式会社ユピテル 情報処理装置、画像処理装置、及びプログラム等
JP7726170B2 (ja) * 2022-09-30 2025-08-20 セイコーエプソン株式会社 表示方法、及び表示装置
CN116501233B (zh) * 2023-04-19 2024-12-27 广州致远仪器有限公司 软键盘交互方法、设备及存储介质

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006093757A (ja) * 2004-09-21 2006-04-06 Olympus Corp 画像処理装置と撮像装置、および画像処理プログラム

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SG75190A1 (en) * 1998-12-14 2000-09-19 Canon Kk Image processing method and apparatus image processing system and storage medium
JP4403397B2 (ja) 2004-07-21 2010-01-27 ソニー株式会社 ユーザインタフェース提供装置
US8014034B2 (en) * 2005-04-13 2011-09-06 Acd Systems International Inc. Image contrast enhancement
JP2006338377A (ja) * 2005-06-02 2006-12-14 Fujifilm Holdings Corp 画像補正方法および装置並びにプログラム
JP2008092052A (ja) 2006-09-29 2008-04-17 Matsushita Electric Ind Co Ltd 階調補正装置および撮像装置
JP5082776B2 (ja) * 2007-10-31 2012-11-28 オムロン株式会社 画像処理装置
WO2009078862A1 (en) * 2007-12-17 2009-06-25 Hewlett-Packard Development Company, L.P. Image processing using target values
JP5408053B2 (ja) * 2009-10-20 2014-02-05 株式会社ニコン 画像処理装置、画像処理方法
JP2011171807A (ja) * 2010-02-16 2011-09-01 Canon Inc 画像処理装置、およびプログラム
US8792743B2 (en) 2010-02-03 2014-07-29 Canon Kabushiki Kaisha Image processing apparatus and program
JP5418791B2 (ja) * 2011-03-02 2014-02-19 カシオ計算機株式会社 画像加工装置、画像加工方法及びプログラム

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006093757A (ja) * 2004-09-21 2006-04-06 Olympus Corp 画像処理装置と撮像装置、および画像処理プログラム

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114463237A (zh) * 2022-01-30 2022-05-10 武汉大学 基于全局运动补偿和帧间时域关联性的实时视频去雨方法
CN114463237B (zh) * 2022-01-30 2024-04-19 武汉大学 基于全局运动补偿和帧间时域关联性的实时视频去雨方法

Also Published As

Publication number Publication date
US10297057B2 (en) 2019-05-21
JP6593675B2 (ja) 2019-10-23
CN106030662A (zh) 2016-10-12
CN106030662B (zh) 2019-11-08
US20170018105A1 (en) 2017-01-19
JP2015179502A (ja) 2015-10-08

Similar Documents

Publication Publication Date Title
JP6593675B2 (ja) 画像処理装置及び画像処理方法
JP5436020B2 (ja) 画像処理装置および画像処理方法
JP6493855B2 (ja) 画像処理装置及び画像処理方法
KR101198320B1 (ko) 2차원에서 3차원으로의 영상 변환 방법 및 장치
JP6921886B2 (ja) 情報処理装置および情報処理方法
JP5243833B2 (ja) 画像信号処理回路、画像表示装置、および画像信号処理方法
JP6891882B2 (ja) 画像処理装置、および画像処理方法、並びにプログラム
JP2016213809A (ja) 表示方法および表示装置
JPWO2008016149A1 (ja) 画像表示制御装置、および、画像表示制御方法
US11831991B2 (en) Device, control method, and storage medium
JP2015180048A (ja) 画像処理装置及び画像処理方法
EP3296985A1 (en) Image-processing device, image-processing method, and program
JPWO2018025474A1 (ja) 情報処理装置、情報処理方法、及びプログラム
KR20070081947A (ko) 콘트라스트 조절 방법 및 장치
JP4829905B2 (ja) 表示装置及び光学階調特性の調整方法
JP2011155449A (ja) 画質調整装置および画質調整方法
JP2006502643A (ja) 画像変換ユニット及び方法
JP4575501B2 (ja) 映像信号処理装置及びその制御方法及びテレビジョン信号受信装置
WO2016181584A1 (ja) 表示方法および表示装置
WO2011067869A1 (ja) 画像処理装置及び画像処理方法
JP2006093757A (ja) 画像処理装置と撮像装置、および画像処理プログラム
JP2021097374A (ja) 映像信号処理装置及び映像信号処理方法
JP2016178498A5 (enExample)
JP2010130643A (ja) 画像処理装置および画像処理方法
JP6155119B2 (ja) 画像処理装置及び画像処理方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15754481

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15120564

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15754481

Country of ref document: EP

Kind code of ref document: A1