JP2019133352A - Image processing device, image processing method and image processing program - Google Patents

Abstract

To provide a technique for accomplishing a user interface for image processing that executes retouch processing.SOLUTION: An image processing device that executes retouch processing on an image in accordance with a user input includes: an image data obtaining unit that obtains image data representing an image; a color correcting unit that executes the retouch processing on the obtained image; an operation display unit that displays images by multiple display regions which contain a first display region that displays the obtained image, and a second display region that displays the image having undergone the retouch processing; and a color managing unit which manages a color database, and causes the operation display unit to display a pallet region which utilizes colors registered in the color database and provides the colors available for the retouch processing.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing technique for processing and correcting an image.

  Image processing includes retouch processing that processes and modifies photographs and illustrations according to user input. In the retouch process, the user may change the color of the specific object in the original image or the overall color tone to a color desired by the user (also referred to as a user desired color in this specification). The user-desired color is acquired from various images and real objects and is often used after adjustment. As a technique related to the retouching process, for example, Patent Document 1 proposes an image color correction apparatus that corrects an input image and supplies an output image to an image display unit. The image color correction apparatus selects an object or a target color that is a color correction target from an output image of the image display unit, calculates a center color of the selected target or target color, and sets it as a correction center color. By correcting the center color, the output image can be corrected to a desired color.

JP 2004-118442 A

  However, the inventor of the present application has found that there is much room for improvement in the user interface in the image processing for executing the retouching process.

  The present invention has been made in view of such a situation, and an object thereof is to provide a technique for realizing a user interface for image processing that executes retouch processing.

  The present invention provides an image processing apparatus for executing an image retouching process in response to a user input. The image processing device includes an image data acquisition unit that acquires image data representing the image, a color correction unit that executes a retouch process on the acquired image, and a first that displays the acquired image. An operation display unit that displays the image in a plurality of display areas including a display area and a second display area that displays the image on which the retouch processing has been performed, and a color database are managed and registered in the color database A color management unit that causes the operation display unit to display a palette area that provides a color that can be used for the retouching process using the selected color.

  The present invention provides an image processing method for executing an image retouching process in response to a user input. The image processing method includes an image data acquisition step of acquiring image data representing the image, a color correction step of executing a retouch process on the acquired image, and a first display of the acquired image. An operation display for displaying the image in a plurality of display areas including a display area, a first display area for displaying the acquired image, and a second display area for displaying the image on which the retouch processing has been executed. And a color management step of managing a color database and displaying a palette area that provides colors usable in the retouching process using the colors registered in the color database in the operation display step.

  The present invention provides an image processing program for controlling an image processing apparatus for executing an image retouching process in response to a user input. The image processing program includes an image data acquisition unit that acquires image data representing the image, a color correction unit that executes a retouch process on the acquired image, and a first display area that displays the acquired image And an operation display unit that displays the image in a plurality of display areas including a second display area that displays the image on which the retouch processing has been performed, and a color database, and the color registered in the color database The image processing apparatus is caused to function as a color management unit that displays on the operation display unit a palette area that provides colors that can be used for the retouching process.

  ADVANTAGE OF THE INVENTION According to this invention, the technique for implement | achieving the user interface for image processing which performs a retouch process can be provided.

It is a block diagram which shows the function structure of the image processing apparatus 100 which concerns on one Embodiment of this invention. It is a flowchart which shows the content of the color correction processing procedure which concerns on one Embodiment. It is explanatory drawing which shows the user interface screen of the image processing apparatus 100 which concerns on one Embodiment. It is explanatory drawing which shows the content of the color database 143 which concerns on one Embodiment. It is explanatory drawing which shows the content of the palette color production | generation process which concerns on one Embodiment in a Lab color space. It is explanatory drawing which shows the content of the color correction process which concerns on one Embodiment on a user interface screen. It is explanatory drawing which shows the registration content of the color database which concerns on one Embodiment. It is a conceptual diagram which shows an example of the color management method which concerns on one Embodiment.

  Hereinafter, modes for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a functional configuration of an image processing apparatus 100 according to an embodiment of the present invention. The image processing apparatus 100 can execute an image retouching process in response to a user input. The image processing apparatus 100 includes a control unit 110, an operation display unit 130, a storage unit 140, and a communication interface unit (communication I / F unit) 150. The control unit 110 includes an image analysis unit 111, a color correction unit 112, a color management unit 113, and a display control unit 114. The image processing apparatus 100 can be configured, for example, by installing an application program (also called an image processing program) in a personal computer.

  The operation display unit 130 includes a display 131 that functions as a touch panel and an operation input unit 132. The display 131 can display an image based on RGB data in the sRGB color space. The operation input unit 132 includes a mouse and a keyboard, and can accept an operation input from a user. The operation input unit 132 may include a handy scanner or a color acquisition pen for acquiring colors.

  The control unit 110 includes main storage means such as RAM and ROM, and control means such as MPU (Micro Processing Unit) and CPU (Central Processing Unit). The control unit 110 also has a controller function related to various I / O, USB (Universal Serial Bus), bus, and other hardware interfaces. The control unit 110 controls the entire image processing apparatus 100.

  The storage unit 140 is a storage device including a hard disk drive or a flash memory that is a non-temporary recording medium, and stores a control program and data for processing executed by the control unit 110. The storage unit 140 includes gamma data 141 used for color management of the display 131 and an ICC profile 142. The storage unit 140 further stores a color database 143 that manages user-managed colors and color data that is managed in association with the color database 143.

  FIG. 2 is a flowchart showing the contents of the color correction processing procedure according to the embodiment. In step S10, the user acquires image data to be subjected to the retouch process. The image data can be acquired via the LAN via the communication interface unit 150, for example. In this example, the communication interface unit 150 functions as an image data acquisition unit together with the control unit 110.

  The display control unit 114 converts the color space of the image data into RGB data of the sRGB color space that can be displayed on the display 131, corrects it using the ICC profile 142, and executes gamma correction using the gamma data 141. . Thereby, the display 131 can faithfully display the image represented in the image data.

  FIG. 3 is an explanatory diagram illustrating a user interface screen of the image processing apparatus 100 according to an embodiment. FIG. 3A displays an image P represented by image data to be subjected to retouch processing. The user can check the image P to be retouched and can switch to the retouch screen by clicking an OK icon (not shown), for example.

  In step S20, the display control unit 114 executes split display processing. In this example, the display control unit 114 divides the display area of the display 131 and displays a fixed area ZF that displays an original image P1 (also referred to as an original image) before the retouching process, and a processed image during the retouching process (FIG. 3). In the example of (b), a display including a change area ZV for displaying the original image P1), a search window SW, a palette window PW, and a file selection window FW is performed. The change area ZV is an area for displaying an image to be retouched using the color acquired in the palette window PW or the file selection window FW. The palette window PW provides colors that can be used for retouching processing, and is also called a palette area.

  FIG. 4 is an explanatory diagram showing the contents of the color database 143 according to an embodiment. The column of the color database 143 includes a record number, an object, a related number, a registration date, a last use date, and a use frequency in order. In the color database 143, nine records from record number 01 to record number 09 are registered in the order of registration. The color database 143 is used in order to make it possible to effectively reuse the colors used by the user in the past.

  The record number corresponds to the order in which colors are registered by the color management unit 113. The object indicates a keyword in which the color of the record indicates the drawing target used in the retouching process. Thereby, a keyword can be registered in each record. The relation number indicates the color relation between the records, and indicates that records having the same relation number are related to each other. The registration date / time represents the date / time when each record was registered. The last use date and time represents the date and time when the color of each record or its correction color was last used. The usage frequency is a value classified into A (high usage frequency) to C (non-use) using a value obtained by dividing the number of times of use within the period from the registration date and time to the present of each record by the period from the registration date and time to the present. It is. In each record, a URL of image data representing each color is registered (not shown).

  As shown in FIG. 3B, when the user moves the cursor C onto the apple image and designates it, the image analysis unit 111 recognizes the apple image as a target image for the retouch process. The image analysis unit 111 analyzes the target image and automatically generates a character string “apple”, and inputs the character string “apple” as a search keyword to the search window SW. When the user clicks on the search icon SC in the search window SW, the color management unit 113 refers to the color database 143 stored in the storage unit 140 and displays a color related to the character string “apple” in the palette window PW. Display. The user can also input an arbitrary character string as a search keyword in the search window SW using a keyboard or the like.

  In this example, the color management unit 113 detects the record number 01 and the record number 06 in the color database 143 using the character string “apple”, and displays two sample colors in the palette window PW ( (Refer FIG.3 (b)). The user clicks and selects a color close to a desired color from the two sample colors as color samples. In this example, it is assumed that the two sample colors are colors represented by RGB image data, for example, and record number 01 is selected.

  FIG. 5 is an explanatory diagram showing the contents of palette color generation processing according to an embodiment in the Lab color space. The color management unit 113 converts the color space of the image data representing the selected color from the RGB color space to the Lab color space. The Lab value has an L value that is a lightness index and a * b * that is a chromaticness index (see FIG. 5A). The L value can also be calculated as a luminance value (calculation formula: Y = (0.298912 × R + 0.586611 × G + 0.114478 × B)) The hue angle θ is a vector composed of an a value and a b value. Indicates the direction.

  The Lab color space is a uniform color space that can be said to be a scale (unit) close to human visual sense. The uniform color space is a color solid (corresponding to a color space) in which the distances between colors that appear to be the same color difference in the human visual system (the psychological distance is also called the psychological distance) are equalized. Space. Accordingly, the image analysis unit 111 can easily execute an analysis assuming a human visual system by using the Lab color space.

  In step S30, the color management unit 113 displays the 15 sample colors on the palette window PW two-dimensionally using the brightness index (density direction) and the chromaticness index (hue angle direction). The central sample color is a color associated with the record number 01 (also called a registered color). The brightness index is set so that the density of the sample color above the central sample color is higher by a predetermined psychological distance. The lightness index is set so that the lower sample color of the central sample color is lower in density by a predetermined psychological distance. On the other hand, the chromaticness index is set so that the right and left sample colors of the central sample color change the hue angle θ by a predetermined psychological distance. The palette window PW is configured to be scrollable in the density direction and the hue angle direction.

  Note that the color management unit 113 of this embodiment uses the Lab color space to generate a plurality of sample colors by changing the density and hue angle by a predetermined psychological distance, but other methods may be used. The plurality of samples may be generated by changing at least one of hue, brightness, and saturation.

  In step S40, the user can advance the process to step S60 if the desired color is found. On the other hand, when the desired color is not found, the user clicks the file selection window FW (see FIG. 3B), and advances the process to step S50.

  In step S50, the color management unit 113 executes a new color acquisition process. In the new color acquisition process, the user can select any image data in the storage area (including the storage unit 140) of the image processing apparatus 100 using the file selection window FW. The color management unit 113 displays an image represented by the image data in the color extraction target window EW according to the selection of the image data (see FIG. 5B).

  The color extraction target window EW includes a left scroll icon SL, a right scroll icon SR, and an upper icon ST. The left scroll icon SL and the right scroll icon SR are icons used for switching images in the selected folder. The upper icon ST is an icon used for displaying thumbnail images of all images in the selected folder.

  As shown in FIG. 5B, the user can place the cursor C on the image in the color extraction target window EW and click to acquire the color at the position of the cursor C. The color management unit 113 displays 15 sample colors in the palette window PW with the acquired color as the center (step S30). The fifteen sample colors are the colors selected in the Lab color space. The user can search for a desired color by repeating such processing (steps S30 to S50).

  FIG. 6 is an explanatory diagram showing the contents of color correction processing according to an embodiment on a user interface screen. In step S60, the user executes a color selection process. In the color selection process, the user can select a sample color as a desired color by clicking the sample color patch in the palette window PW using the cursor C (see FIG. 6A). The user can also fine-tune the selected sample color by inputting numerical values such as RGB, brightness index, and chromaticness index.

  In step S70, the user executes a retouch process. In the retouching process, the color correction unit 112 changes the color inside the outline of the apple acquired by the image analysis unit 111 in the variation region ZV by filling it with the selected color (see FIG. 6B). In the retouch process, reference and comparison can always be made as a reference area of the original image in which the fixed area ZF is fixed, and the processed image P2 after the retouch process can be confirmed in the fluctuation area ZV. In the retouch process, the color correction unit 112 can also use the selected color as the pen color.

  As a result, the user can perform the retouching process while comparing and referring to the original image P1 displayed in the fixed area ZF and comparing the processed image P2 after the retouching process in the change area ZV. In this example, the user further changes the color of the text “ABC” as the retouching process.

  In step S80, the user executes a save process. In the saving process, the user operates the operation input unit 132 to save image data representing the retouched image P2 in the storage unit 140. In step S90, the color management unit 113 registers the color used in the retouch process in the color database 143. The color management unit 113 registers the color used in the retouching process of the apple and the color used in the retouching process of the text “ABC” in the color database 143 using the same related number.

  FIG. 7 is an explanatory diagram illustrating registration contents of a color database according to an embodiment. In step S90, the color management unit 113 records the record number 10 (the color used in the apple retouch process) and the record number 11 record (text retouch) according to the storage of the image data representing the retouched image P2. The color used in the process) is registered at the same time using the same relation number 007. As a result, the color management unit 113 can automatically manage the records of record number 10 and record number 11 in association with each other.

  FIG. 8 is a conceptual diagram illustrating an example of a color management method according to an embodiment. The color management unit 113 can delete a color that has not been used for a long time. In FIG. 8, R, Y, LB, P, and E indicate red, yellow, light blue, pink, and blank areas (no color data), respectively. FIG. 8A shows an example in which the light blue color has not been used for a long time. In this example, the color management unit 113 deletes a light blue record from the color database 143 as a predetermined non-use period elapses from the last use.

  FIG. 8B shows an example in which yellow and light blue in the dotted frame have the same associated number, and yellow is used within a predetermined long period. In this example, the color management unit 113 performs management so that all of a plurality of colors having the same related number are deleted after a predetermined long period. As a result, the color management unit 113 further deletes the pink record before the light blue color after a predetermined period. As described above, the color management unit 113 can also be configured to delete the plurality of mutually related records from the color database 143 when the non-use period has elapsed. In this example, the same relation number is assigned to a plurality of color records used for the same image file.

  As described above, the image processing apparatus 100 according to the present embodiment facilitates the acquisition of a desired color and supports the reuse of the desired color when the user executes the retouch process with the desired color. A user interface can be provided. Thereby, the image processing apparatus 100 can be made easier to use as the user uses it.

  The present invention can be implemented not only in the above embodiments but also in the following modifications.

  Modification 1: In the above embodiment, the display control unit divides the display area to display a fixed area (also referred to as a first display area) and a variable area (also referred to as a second display area). However, for example, a third display area for displaying a slightly thin image assumed in the toner save mode may be displayed. The display control unit only needs to display an image in a plurality of areas including the fixed area and the variable area.

  Modification 2: In the above embodiment, the color database can be shared and used by anyone, but for example, a login function may be added and managed for each user. In this way, when the image processing apparatus is used by a plurality of users, it is possible to provide detailed support for color reuse that suits each user's preference.

  Modified example 3: In the above embodiment, the plurality of records that are related to each other are records of the same registration with the same association number. For example, a time zone that falls within a preset range (for example, the same day) ) May be related to each other (including registration). This is because there is a high possibility that the related retouching work is performed in the approximate time zone or the same day.

  Modification 4: In the above embodiment, a personal computer is used. However, the present invention is applicable to a mobile terminal such as a smartphone or a tablet as long as image processing is possible.

DESCRIPTION OF SYMBOLS 100 Image processing apparatus 110 Control part 130 Operation display part 131 Display 132 Operation input part 140 Storage part 150 Communication interface part

Claims (9)

An image processing apparatus for executing an image retouching process in response to a user input,
An image data acquisition unit for acquiring image data representing the image;
A color correction unit that performs a retouching process on the acquired image;
An operation display unit for displaying the image in a plurality of display areas including a first display area for displaying the acquired image and a second display area for displaying the image on which the retouch processing has been performed;
A color management unit that manages a color database and causes the operation display unit to display a palette area that provides colors that can be used for the retouching process using colors registered in the color database;
An image processing apparatus comprising: The image processing apparatus according to claim 1, further comprising:
An image analysis unit that analyzes the target image of the retouch process specified by the operation display unit and automatically generates a search keyword related to the target image;
The color database can register a keyword in each record,
The color management unit is an image processing apparatus that causes a color that can be reused for the retouching process of the target image to be displayed in the palette area using the search keyword. The image processing apparatus according to claim 2,
The color management unit is an image processing apparatus that displays each color of the plurality of records in the palette area when any of a plurality of records associated with each other is detected by the search keyword. The image processing apparatus according to any one of claims 1 to 3,
The color management unit deletes records registered in the color database in accordance with the elapse of a preset non-use period, and for a plurality of records related to each other, all of the plurality of records Is deleted from the color database when the non-use period has elapsed. The image processing apparatus according to claim 3 or 4,
The color management unit is an image processing apparatus that manages a plurality of colors used in a time zone within a predetermined range with each other as the plurality of records associated with each other in the color database. An image processing apparatus according to any one of claims 1 to 5,
The color management unit generates a plurality of sample colors in which at least one of a registered color that is a color of a record registered in the color database and a hue, brightness, and saturation of the registered color are changed,
The operation display unit is an image processing apparatus that displays the generated plurality of sample colors in the palette area. The image processing apparatus according to claim 5, wherein
The color management unit generates the plurality of sample colors using a psychological distance in a Lab color space, and two-dimensionally displays the sample color in the palette area using a brightness index and a chromaticness index . An image processing method for executing image retouching processing in response to user input,
An image data acquisition step of acquiring image data representing the image;
A color correction step of performing a retouching process on the acquired image;
An operation display step for displaying the image in a plurality of display areas including a first display area for displaying the acquired image and a second display area for displaying the image on which the retouch processing has been performed;
A color management step of managing a color database and displaying a palette area that provides colors usable in the retouching process using colors registered in the color database in the operation display step;
An image processing method comprising: An image processing program for controlling an image processing apparatus for executing an image retouching process in response to a user input,
An image data acquisition unit for acquiring image data representing the image;
A color correction unit that performs a retouching process on the acquired image;
An operation display unit for displaying the image in a plurality of display areas including a first display area for displaying the acquired image and a second display area for displaying the image on which the retouch processing has been performed; An image that manages the database and causes the image processing device to function as a color management unit that causes the operation display unit to display a palette area that provides colors that can be used for the retouching process using colors registered in the color database. Processing program.