JP2006222563A - Image processing apparatus and image correction method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform correction jobs compatible with types of a plurality of correction processes without omission even when an operator for designating correction differs from an operational amplifier for actually performing the correction processes. <P>SOLUTION: One or multiple correction regions in image data and types of correction processes applied to each correction region are set on a correction region designation menu (step S201), and an image for the correction processing corresponding to each correction region is displayed on a display means (step S204) on the basis of setting contents. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing apparatus and an image correction method that enable image data correction processing.

  When performing image correction in a store or the like, an operator who specifies a correction area may be different from an operator who performs correction and an operator who performs confirmation. In such a case, it is important to prevent the correction process from leaking work. In a normal correction operation, it is designed on the assumption that a single operator selects, removes, and confirms a correction area, and thus it is difficult to perform such a division work.

  Further, in Patent Document 1, a screen for performing image correction area designation with a single correction function and a screen for performing correction processing are separated, and image correction is performed according to the image correction area designation, thereby corresponding to division work. There is a proposal for an apparatus that performs correction processing without omission.

JP 2000-57362 A

  However, the invention disclosed in Patent Document 1 is limited to one image correction function, and does not support correction work for a plurality of image correction functions at a time.

  Therefore, an object of the present invention is to perform leak-free correction work corresponding to a plurality of correction processing types even when an operator who designates correction is different from an operator who actually performs correction processing. There is to do.

The image processing apparatus of the present invention is set by the setting means for setting one or a plurality of correction areas in the image data and the type of correction processing for each correction area according to the designation operation, and the setting means Recording means for recording the association between each correction area and the type of the correction process, and a screen for correction processing corresponding to each correction area is displayed on the display means based on the recorded contents in the recording means. Display control means.
The image correction method of the present invention is an image correction method by an image processing apparatus, and sets one or a plurality of correction areas in image data and the type of correction processing for each correction area in accordance with a designation operation. A step of recording on the recording medium a correspondence between each correction area set in the setting step and the type of the correction process, and each correction area based on the recording content in the recording medium And a display control step for displaying a correction processing screen corresponding to the above on the display means.
A program according to the present invention causes a computer to execute the image correction method.
The computer-readable recording medium of the present invention is characterized in that the program is recorded.

  According to the present invention, one or a plurality of correction areas in the image data and the type of correction processing for each correction area are set according to the designation operation, and the correction corresponding to each correction area is performed based on the setting content. Since the screen for processing is displayed, even if the operator who designates the correction is different from the operator who actually performs the correction processing, correction work without omission corresponding to a plurality of correction processing types can be performed. Can be done.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments to which the invention is applied will be described in detail with reference to the accompanying drawings.

<First Embodiment>
First, a first embodiment of the present invention will be described. The image correction system according to the present embodiment has red-eye removal, dust removal, and wrinkle removal functions. FIG. 1 is a diagram illustrating an overall configuration of an image correction system according to the present embodiment.

  In FIG. 1, reference numeral 101 denotes an image input device that reads an image as digital data. This includes scanners, PC cards, flexible disks, MO, ZIP drives, and the like.

  Reference numeral 102 denotes a computer that executes the application program for performing image correction. This includes a RAM that temporarily stores image data, image information, and other calculation results during operation, and an external storage such as a hard disk. Including equipment.

  Reference numeral 103 denotes an input device for inputting commands such as image processing and screen operation. For example, a keyboard, a mouse (both not shown), and the like are applied.

  Reference numeral 104 denotes a display device that displays an image processing result and an application screen, and includes a display.

  Reference numeral 105 denotes an output device for outputting an image after correction by this application, and an output device such as an ink jet printer or LBP is applicable.

  FIG. 2 is a flowchart showing the flow of screen transition of the image correction application according to the first embodiment of the present invention.

  Step S201 is a correction area designation screen, and areas for a plurality of types of correction functions can be set using this screen. The loop from step S202 to step S205 is repeated for the number of correction processes specified in step S201. Step S204 is a removal process screen, and removal is performed for one of the correction processes specified in step S201. The removal processing screen is unique to each correction function, and the removal processing screen of the current correction type is displayed. In step S205, a shift is made to the next correction process. If there is no correction process (step S202 / yes), the process moves to the print screen in step S206, and the process ends when printing is performed.

  FIG. 3 is a diagram showing an application display screen according to the first embodiment of the present invention. A correction target display area 301 displays an image to be corrected. Reference numerals 302, 303, and 304 denote correction menu buttons of this application, which are a red-eye removal menu button 302, a dust removal menu button 303, and a wrinkle removal menu button 304, respectively. Reference numeral 305 denotes an edit box for inputting a comment for each correction. For example, remarks relating to correction such as “customer instruction” and “find by operator” are input. Reference numeral 306 denotes a next screen button. When all the correction areas have been designated, the screen moves to a removal screen.

FIG. 4 is a diagram showing a removal processing screen when the correction processing is dust removal processing.
Reference numeral 401 denotes a correction menu button. At present, the dust removal menu button is selected and highlighted. Reference numeral 402 denotes a window for enlarging and displaying an area to be corrected, and an area designated on the correction area designating screen is enlarged and displayed. A dust removal function menu 403 includes three brush buttons 404 (thick, medium, and thin). Reference numeral 405 denotes a comment edit box, which displays a comment relating to the current correction. Reference numeral 406 denotes a next processing button. When this button is selected, the current correction is confirmed and the screen changes to the next processing.

FIG. 5 is a diagram showing a removal processing screen when the correction processing is red-eye removal.
Reference numeral 501 denotes a menu button for a correction function. Currently, the red-eye removal menu button is selected and highlighted. Reference numeral 502 denotes a window for enlarging and displaying the area to be corrected, and the area designated on the correction area designating screen is enlarged and displayed. Reference numeral 503 denotes a red-eye removal function menu, which includes three brush buttons (thick, medium, and thin) 504 and a slider bar 505 that adjusts the color after removal. Reference numeral 506 denotes a comment edit box, which displays a comment relating to the current correction. Reference numeral 507 denotes a next processing button. When this button is selected, the current correction is confirmed and the screen changes to the next processing.

FIG. 6 is a diagram illustrating a removal process screen when the correction process is wrinkle removal.
Reference numeral 601 denotes a correction function menu button, and the wrinkle removal menu button is currently selected and highlighted. Reference numeral 602 denotes a window for enlarging and displaying the area to be corrected, and the area designated on the correction area setting screen is enlarged and displayed. Reference numeral 603 denotes a wrinkle removal function menu, which includes a line designation button 604 and a slider bar 605 for adjusting the removal strength. Reference numeral 606 denotes a comment edit box, which displays a comment relating to the current correction. Reference numeral 607 denotes a next processing button. When this button is selected, the current correction is confirmed and the screen changes to the next processing.

Next, the flow of application operations will be described with reference to FIGS.
When the application is activated, an image to be corrected is read and a correction area designation screen (step S201) is displayed. In this state, the correction target image is displayed in the correction target display area 301 in FIG. On this screen, the operator who designates the correction area inputs the type of correction processing, the area to be enlarged at the time of correction, and a comment for the correction.

Next, an operation for specifying a correction area will be described with reference to FIG.
First, the operator selects a correction function from the correction menu buttons 701 to 703. For example, when the dust removal menu button 702 is selected, a cursor (not shown) is moved onto the correction target image display area 704 and clicked on a portion where the dust 706 is present. Then, the algorithm shown in FIG. 8 calculates the dust area and the area to be enlarged and displays the rectangle 705, and the correction type marker 707 is displayed near the rectangle so that the type of the correction process can be immediately understood.

Next, the algorithm of FIG. 8 will be described.
It is assumed that the dust here has a difference in the luminance direction with respect to the background pixels. In step S801, a rectangle having a predetermined number of pixels is cut out around the selected position. The partial image is decomposed into a color space of luminance and color difference components, for example, a Lab space (step S802). A histogram is stretched for the decomposed luminance L channel to increase the contrast between the dust portion and the background portion (step S803). With respect to this image, assuming that the selected position is clearly a dust part, the pixel value of this position is acquired (step S804), the region is extracted with a predetermined threshold value from the selected position as a starting point, and mask data Is created (step S805). Next, the rectangular size of the correction area is determined by scanning the mask data (step S806). A margin is further added to this area to form a display area (step S807). In addition, correction areas are set by the same operation for red-eye removal and wrinkle removal.

  The red-eye removal is shown in FIG. A pixel in a predetermined region near the selected point is acquired (step S901), and detection is performed on this. The cut out area is separated into HSL (step S902). A threshold is set by hue and saturation, candidate areas for red eyes are extracted (step S903), these candidate areas are binarized (step S904), and circularity is evaluated (step S905), and finally A mask for the red-eye portion is generated (step S906). Next, the rectangular size of the correction area is determined by scanning the mask data (step S907). A margin is further added to this area to make an enlarged display area (step S908).

  The wrinkle removal is shown in FIG. Pixels in a predetermined region near the selected point are acquired (step S1001), and detection is performed on this. The cut out region is separated into Lab space (step S1002). The contrast and gamma of the L channel are adjusted to emphasize the wrinkle portion (step S1003), and binarization is performed to create a mask for removing wrinkles (step S1004).

  Next, the rectangular area is determined by scanning the mask data for the rectangular size of the correction area (step S1005). A margin is further added to this area to make an enlarged display area (step S1006).

  Detection is performed by the algorithm described above, and the enlarged region and the type of processing are displayed on the image. This is repeated as many times as necessary for each process.

  For example, FIG. 7 shows the result when selecting dust removal, red-eye removal, and wrinkle removal one by one. The data structure in this state is shown in FIG. As the correction processes 1, 2, and 3 in FIG. 7, dust removal, red-eye removal, and wrinkle removal are set. For one correction process, an enlargement position, a removal function type, a comment, and a status are held.

  When all the correction areas have been designated, the next screen button (306 in FIG. 3) is selected, the correction area designation screen (FIG. 3) is terminated, and the process proceeds to the removal processing screen (step S204 in FIG. 2). At this point, the processing when the correction area designation data is as shown in FIGS. 7 and 11 will be described.

  Since the structure of the correction processing data in FIG. 11 is managed in the order of dust removal, red-eye removal, and wrinkle removal, the dust removal screen of FIG. 4 is displayed. At this time, the enlarged display area is enlarged and displayed on the window 402 according to the correction processing data.

  Since the type of correction is dust removal, dust removal is highlighted by the correction menu button 401 and a dust removal function menu 403 is displayed at the same time to enable dust removal. Here, the operator selects one of the brush buttons 404 and drags the garbage portion to start the selection. When the selection is completed, the removal process is started.

  In the removal processing algorithm, first, a mask of an area selected by the brush button 404 is created. Then, within the mask, a median filter such as 5 * 5 is applied to remove dust. When the removal of dust is completed in this way, the next process button 406 is selected, and the next process is started.

  In the correction process data of FIG. 11, since the red-eye removal is managed as the next process, the red-eye removal screen of FIG. 5 is displayed. The screen of FIG. 5 is a screen for removing dust. In 501, the menu button for red eye function is highlighted and a function menu 503 for red eye removal is displayed. The image is enlarged in accordance with the red-eye removal enlargement area of the correction processing data shown in FIG.

  In this screen, the operator selects the brush button 504 and drags the red-eye portion on 502 to fill it. Then, the red eye is removed by reducing the saturation of the filled portion and changing the hue. The hue can be changed by adjusting the color adjustment slider bar 505. When the red-eye removal process is completed, the next process button 507 is selected to perform the next process.

  In the correction processing data of FIG. 11, wrinkle removal is managed as the next processing, so the wrinkle removal screen of FIG. 6 is displayed. In this screen as well, the wrinkle removal menu button is highlighted at 601 and the function menu 603 for wrinkle removal is displayed as in the case of red eye removal.

  The image is enlarged according to the wrinkle removal enlargement area of the correction processing data in FIG. 11 and displayed in the correction target display area 602. On this screen, the operator removes wrinkles by clicking the start point and end point using the straight line tool 604.

  The wrinkle removal algorithm is the same as that for dust scratches. A mask for the area selected by the straight line tool 604 is created, and a median filter is applied to the selected area. However, if wrinkles are completely removed, it may be too exaggerated, so that the degree of removal can be adjusted by performing alpha blending with the image before correction using the slider bar 605 for intensity adjustment.

  In this flow, the process is repeated for the number of correction areas, and when there are no correction areas, when the next process button 607 is selected, the screen moves to a print screen (step S206), print settings are performed, and printing is executed.

  By performing the operations as described above, even if the operators on the correction area designation screen (step S201) and the removal processing screen (step S204) are different, the correction type and the enlargement are performed one by one according to the correction processing data. In accordance with the display position, the display is enlarged and the processing function is changed, so that all correction processes can be performed easily and without omission of processing.

  In the present embodiment, the case where only the dust scratches, red-eye removal, and wrinkle removal are implemented as the correction function has been described. Functions may be added. Further, instead of correction processing for selecting an area, color adjustment for the entire image can be handled in the same manner by adding a correction marker to the lower right of the screen with the display area as the entire screen.

  In this embodiment, the correction data is arranged in the order of setting regarding red eye, dust scratches, and wrinkle removal. However, this can be sorted for each process. In some correction processes, the correction order may be important. For example, the order of color noise removal, dust removal, red-eye removal, and color correction may be used.

  Further, other algorithms may be used for the detection part and the removal part of red-eye removal, wrinkle removal, and dust removal described in the present embodiment. In the present embodiment, the area detection is used for calculating the display area. However, for example, after selecting the correction function button, an operation for surrounding the rectangular area can be performed with the mouse to specify the area.

  Furthermore, the configuration is further simplified, an enlargement / reduction function is provided on the correction area designation screen, the correction type is selected, and the displayed area when the screen is selected is used as an enlarged display area for correction processing. Also good.

  Next, a second embodiment of the present invention will be described. In the second embodiment of the present invention, the screen configuration of the removal processing screen (step S204) is changed so that the correction processing can be performed while displaying the entire image to be corrected.

  FIG. 12 shows the configuration of the removal processing screen. A removal processing target image display area 1201 displays a removal processing target image. This display is similar to the correction area designation screen in step S201 of FIG.

  Reference numeral 1202 displays an enlarged area that is currently the target of processing. Reference numeral 1203 denotes a comment field for processing, and 1204 displays a correction function for correction data currently being processed. Since it is currently debris removal, a debris removal tool is displayed.

  The operator can perform the correction process while enlarging the processing area while looking at the entire screen, and can proceed smoothly. When the next processing button 1205 is selected, the corrected rectangle may be hidden and the remaining removal work may be displayed. Further, the processing area currently being corrected may be highlighted in the display area 1201 so that it can be understood which part is currently being corrected. In addition, when a plurality of correction areas are specified, the rectangles may overlap each other. In such a case, in order to simplify the display, it is effective to synthesize the rectangle of the enlarged region.

  In FIG. 12, the enlarged region for removing wrinkles and the enlarged region for removing red eyes overlap. Therefore, as shown in FIG. 13, the images are combined into an area including two rectangles, and two markers are displayed side by side. This makes it easy to understand the display, and during the processing work, the enlarged display area is completely different for each process, so it is possible to prevent the area from changing frequently and to perform correction processing without stress on the operator. Can proceed.

  As for what has been removed, if other processes remain as shown in FIG. 14, only the marker of the finished process may be deleted to make it easier to grasp the processing status.

  As described above, multiple correction types and enlarged display areas can be processed and specified on the correction area designation screen, and the correction data can be enlarged and displayed in the correction mode based on the correction type on the removal processing screen for each process. By performing the removal process and repeating this process for the number of pieces of information, even if the operator who designates correction differs from the operator who performs the removal process, the removal process can be performed easily and without omission.

  In addition, the image to be corrected and the area currently being processed are enlarged on the removal screen at the same time, the currently removed area is highlighted, and the marker and rectangle of the removed process are hidden so that any part can be displayed. You can see at a glance how much work remains.

  In addition, when the rectangles of a plurality of correction areas are close, by combining the rectangles and displaying a plurality of processing markers in the vicinity of the rectangle, the number of enlargement processes can be reduced and the process can be smoothly performed. Can be prevented from changing frequently, and the operator can be prevented from being burdened with work.

  Another object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the storage medium. Needless to say, this can also be achieved by reading and executing the program code stored in.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code itself and the storage medium storing the program code constitute the present invention.

  As a storage medium for supplying the program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (basic system or operating system) running on the computer based on the instruction of the program code. Needless to say, a case where the functions of the above-described embodiment are realized by performing part or all of the actual processing and the processing is included.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function is determined based on the instruction of the program code. It goes without saying that the CPU or the like provided in the expansion board or function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

1 is a diagram illustrating an overall configuration of an image correction system according to an embodiment of the present invention. It is a flowchart which shows the flow of the screen transition of the image correction application in the 1st Embodiment of this invention. It is a figure which shows the display screen of the application in the 1st Embodiment of this invention. It is a figure which shows the removal process screen in case correction | amendment processing is a dust removal process. It is a figure which shows the removal process screen in case correction processing is red-eye removal. It is a figure which shows the removal process screen in case correction processing is wrinkle removal. It is a figure which shows the result at the time of selecting dust removal, red-eye removal, and wrinkle removal one by one. It is a figure which shows the algorithm for displaying the area | region for a garbage area | region and an enlarged display. It is a figure which shows the algorithm for displaying the area | region for red-eye removal and enlarged display. It is a figure which shows the algorithm for displaying the area | region for wrinkle removal and enlarged display. It is a figure which shows the management data structure at the time of selecting dust removal, red-eye removal, and wrinkle removal one by one. It is a figure which shows the structure of the removal process screen in the 2nd Embodiment of this invention. It is a figure which shows the example of a synthetic | combination of a rectangle. It is a figure which shows the example which deleted the marker of the process which complete | finished.

Explanation of symbols

101 Image Input Device 102 Computer 103 Input Device 104 Display Device 105 Output Device 301, 402, 502, 602, 704 Correction Target Image Display Areas 302-304, 401, 501, 601, 701-703 Correction Menu Buttons 305, 405, 506 , 606, 712 Edit box 306, 406, 507, 607, 713 Next screen button 403 Dust removal function menu 404, 504 Brush button 503 Red-eye removal function menu 505, 605 Slider bar 603 Wrinkle removal function menu 604 Line designation button 705, 709, 711 Rectangle 706 Garbage 707, 708, 710 Correction type marker

Claims (15)

Setting means for setting one or a plurality of correction areas in the image data and the type of correction processing for each of the correction areas according to the designation operation;
Recording means for recording the association between each correction area set by the setting means and the type of the correction process;
An image processing apparatus comprising: display control means for displaying a correction processing screen corresponding to each correction area on the display means based on the recording contents of the recording means.   The image processing apparatus according to claim 1, wherein the correction processing screen includes an enlarged display screen of a corresponding correction area.   The image processing apparatus according to claim 1, wherein the display control unit sequentially displays the correction processing screens corresponding to the correction regions.   The image processing apparatus according to claim 1, wherein the display control unit displays a setting screen indicating a setting result by the setting unit on the display unit.   The image processing apparatus according to claim 4, wherein information indicating each correction area is displayed on the setting screen.   The image processing apparatus according to claim 5, wherein information indicating a type of correction processing of each correction area is further displayed on the setting screen.   The image processing apparatus according to claim 4, wherein the display control unit displays the setting screen together with the correction processing screen.   8. The image processing apparatus according to claim 7, wherein on the setting screen, the correction area currently being corrected is displayed differently from the other correction areas.   The image processing apparatus according to claim 7, wherein the display control unit hides the correction area for which the correction process has been completed.   10. The image processing according to claim 7, wherein when the plurality of correction areas are superimposed on each other on the setting screen, a combined correction area obtained by combining the plurality of correction areas is displayed. apparatus.   The image processing apparatus according to claim 10, wherein information indicating a type of each correction process corresponding to the plurality of correction areas is displayed for the composite correction area.   The information indicating the type of each correction process displayed for the composite correction area is deleted every time the correction process corresponding to the plurality of correction areas is completed. The image processing apparatus according to claim 11, wherein the image processing apparatus is an image processing apparatus. An image correction method by an image processing apparatus,
A setting step for setting one or a plurality of correction areas in the image data and the type of correction processing for each of the correction areas in accordance with the designation operation;
A recording step of recording a correspondence between each correction area set in the setting step and the type of the correction process on a recording medium;
And a display control step of displaying on the display means a screen for correction processing corresponding to each of the correction areas based on the content recorded in the recording medium.   A program for causing a computer to execute the image correction method according to claim 13.   The computer-readable recording medium which recorded the program of Claim 14.

Images