JP2022114876A - Image processing device, image processing system and image processing program - Google Patents

Abstract

To provide an image processing device, an image processing system and an image processing program capable of changing the reflection level of the impression of a coloration image so as to correspond to a natural language when the impression of the coloration image is reflected on a subjected image.SOLUTION: A CPU of an image processing device executes processing as: an impression adjustment level determination unit 18 which accepts an adverb representing an impression level when a coloration reproduction image obtained by reflecting the coloration of a coloration image on the coloration of a subjected image is generated, and which determines an adjustment level of the impression corresponding to the adverb representing the accepted impression level; and a coloration transfer level adjustment unit 20 that adjusts a coloration transfer level on the basis of the impression adjustment level to generate a coloration level adjustment reproduction image.SELECTED DRAWING: Figure 3

Description

The present invention relates to an image processing device, an image processing system, and an image processing program.

The color scheme of the image content arouses the willingness to buy and influences the sales of products. Therefore, for example, how to combine colors in Web design, package design, leaflets, and actual products is an important issue. In recent years, in order to meet such needs, services that analyze and quantify color schemes used in image content have increased. Attempts have been made to analyze color histograms and distributions of hue/saturation of images.

Patent Document 1 discloses a model image database storing model image data, a plurality of coloration area data for the model image data, and each representative color data of each coloration area data, and a model image display unit for displaying the model image data. , a color solid display section for displaying a predetermined color solid to which each representative color data is pasted, an instruction section for instructing to change each representative color data by a sensitivity word, and display on the model image display section according to the change instruction. and a control section for changing the display of each representative color data of the color stereoscopic display section.

In Patent Document 2, the distribution of color schemes on an acquired image is analyzed, a color characteristic database having information on the definition of colors is provided, and color differences are analyzed for the analyzed color schemes to obtain the above-analyzed color schemes. A color difference analysis information database having information for classifying the color scheme type and analyzing the color difference is provided, and the color scheme on the obtained image is converted by changing the color difference according to the classified color scheme type. A color scheme conversion apparatus is disclosed which provides a conversion rule database having rules for changing the color difference and outputs the result of color scheme conversion.

JP 2011-248641 A JP 2011-86092 A

The present invention provides an image processing device, an image processing system, and an image processing program that can change the degree of reflection of the impression of the color sample in correspondence with natural language when the impression of the color sample is reflected in the image to be processed. intended to provide

In order to achieve the above object, an image processing apparatus according to a first aspect includes a processor, and the processor uses the relationship between the color distribution of an image to be processed and the color distribution of a color sample different from the image to be processed. When changing the color of the image to be processed, a color adjustment degree indicated by a predetermined adverb expression is received, and the color change degree of the image to be processed is adjusted according to the received adjustment degree.

Further, the image processing apparatus according to a second aspect is the image processing apparatus according to the first aspect, wherein the processor displays the image to be processed, the color sample, and the selection image for selecting the degree of adjustment on a display unit. , and the processing is performed using the color sample and the selection image selected by the user.

Further, the image processing apparatus according to a third aspect is the image processing apparatus according to the second aspect, wherein the processor selects the adverbial expression patterns to be used from among a plurality of adverbial expression patterns each having a different degree of adjustment. An adverb expression pattern is received, and the selection image corresponding to the received adverb expression pattern is displayed on the display unit.

Further, the image processing apparatus according to a fourth aspect is the image processing apparatus according to the second aspect or the third aspect, wherein the selection image includes a plurality of predetermined types of adverb expressions, and any of the adverb expressions is arranged. It is an image for which expression can be selected.

Further, the image processing device according to a fifth aspect is the image processing device according to any one of the first to fourth aspects, wherein the processor adjusts the impression adjustment degree corresponding to the adverb expression to the subject It is changed according to the degree of similarity between the processed image and the color sample.

Further, an image processing apparatus according to a sixth aspect is the image processing apparatus according to any one of the first to fifth aspects, wherein the processor further receives an area reflecting the received adjustment degree, Adjusting the degree of color change of the image to be processed for the accepted area according to the degree of adjustment.

Further, an image processing device according to a seventh aspect is the image processing device according to any one of the first to sixth aspects, wherein the processor is adjusted to correspond to a plurality of types of adverbial expressions. Further processing is performed to display the image.

Further, the image processing apparatus according to an eighth aspect is the image processing apparatus according to the seventh aspect, wherein when displaying each adjusted image, the processor reduces the adjusted image and at the same time indicate.

Further, the image processing device according to the ninth aspect is the image processing device according to the seventh aspect or the eighth aspect, wherein the processor receives a plurality of types of adverbial expressions and corresponds to the received plurality of types of adverbial expressions. display the image after the adjustment has been made.

Further, an image processing system according to a tenth aspect includes the image processing apparatus according to any one of the first to ninth aspects, and the image processing apparatus for processing the image to be processed, the color sample, and the degree of adjustment. and a client terminal that directs to.

Further, the image processing program according to the eleventh aspect causes the computer to change the color of the image to be processed using the relationship between the color distribution of the image to be processed and the color distribution of a color sample different from the image to be processed. In this case, a color adjustment degree indicated by a predetermined adverb expression is received, and a process of adjusting the color change degree of the image to be processed according to the received adjustment degree is executed.

According to the first aspect, it is possible to provide an image processing apparatus capable of changing the degree of reflection of the impression of the color sample in accordance with natural language when reflecting the impression of the color sample on the image to be processed.

According to the second aspect, it is possible to select the adjustment degree of the color indicated by the adverbial expression while visually confirming the adverbial expression.

According to the third aspect, it is possible to adjust the degree of color change using the adverb expression pattern selected by Yu.

According to the fourth aspect, it is possible to select an adverbial expression while viewing a plurality of types of adverbial expressions.

According to the fifth aspect, the adjustment result when the coloration of the image to be processed and the coloration image is close to each other is easier to understand than the case where the adjustment degree of the same impression is uniformly used regardless of the similarity between the image to be processed and the color of the sample. It becomes possible to

According to the sixth aspect, it is possible to partially adjust the degree of color change of the image to be processed.

According to the seventh aspect, it becomes easier for the user to select the adjustment result of the degree of change in the color of the image to be processed, which is intended by the user, compared to the case where the image adjusted corresponding to one adverb expression is displayed. .

According to the eighth aspect, when adjusting the degree of color change of the image to be processed, it is possible to check the rough adjustment result.

According to the ninth aspect, it is possible to reduce the processing load compared to the case of displaying images adjusted to correspond to all adverb expressions.

According to the tenth aspect, it is possible to provide an image processing system that can change the degree of reflection of the impression of the color sample in accordance with natural language when the impression of the color sample is reflected in the image to be processed.

According to the eleventh aspect, it is possible to provide an image processing program capable of changing the degree of reflection of the impression of the color sample in accordance with natural language when the impression of the color sample is reflected in the image to be processed.

1 is a diagram illustrating a configuration example of an image processing apparatus according to an embodiment; FIG. 2 is a block diagram showing the main configuration of the electrical system of the image processing apparatus according to the embodiment; FIG. 2 is a functional block diagram showing the functional configuration of the image processing apparatus according to the first embodiment; FIG. It is a figure which shows an example of a target image. It is a figure which shows an example of a color scheme image. FIG. 10 is a diagram showing an example of an interface for determining the degree of impression adjustment corresponding to an adverb; FIG. 11 is a diagram for explaining an example in which color scheme transfer is performed with a slightly stronger impression adjustment degree for a color scheme reproduction image; FIG. 10 is a diagram for explaining an example in which color scheme transfer with a weak adjustment degree of impression is performed on a target image; FIG. 10 is a diagram showing an example of setting the impression adjustment degree α corresponding to “slightly”, “slightly”, “fairly”, and “considerably”. FIG. 10 is a diagram showing an example of setting an impression adjustment degree α corresponding to “slightly”, “slightly”, “relatively”, and “slightly”. 4 is a flow chart showing an example of the flow of processing performed by the image processing apparatus according to the first embodiment; FIG. 10 is a diagram showing an example in which the degree of adjustment α is increased when the degree of similarity is high, and the degree of adjustment α is decreased when the degree of similarity is low; FIG. 10 is a diagram showing an example of a function applied as K that increases as the degree of similarity increases. 9 is a flow chart showing an example of the flow of processing performed by the image processing apparatus according to the second embodiment; FIG. 11 is a functional block diagram showing the functional configuration of an image processing apparatus according to a third embodiment; FIG. FIG. 10 is a diagram for explaining a case where only the glass changes the degree of adverbs; 1 is a diagram showing a schematic configuration of an image processing system according to this embodiment; FIG. It is a figure which shows the example which applied the picked-up image as a coloration image. FIG. 10 is a diagram showing an example of displaying an image in which impressions corresponding to a plurality of types of adverbs are adjusted;

An example of an embodiment of the present invention will be described in detail below with reference to the drawings. FIG. 1 is a diagram showing a configuration example of an image processing apparatus according to this embodiment.

The image processing apparatus 10 according to this embodiment is a so-called general-purpose personal computer (PC) including a display section 10F and an operation section 10E such as a keyboard and a mouse. The image processing device 10 performs image processing on image information representing an image displayed on the display unit 10F.

FIG. 2 is a block diagram showing the essential configuration of the electrical system of the image processing apparatus 10 according to this embodiment.

The image processing apparatus 10 includes a CPU (Central Processing Unit) 10A as an example of a processor, a ROM (Read Only Memory) 10B, a RAM (Random Access Memory) 10C, a storage 10D, an operation section 10E, a display section 10F, and a communication I/ It has an F (interface) section 10G. The CPU 10A controls the overall operation of the image processing apparatus 10. FIG. Various control programs, various parameters, and the like are stored in advance in the ROM 10B. The RAM 10C is used as a work area or the like when various programs are executed by the CPU 10A. The storage 10D stores various data, application programs, and the like. The operation unit 10E is used to input various information. The display unit 10F is used to display various information. The communication I/F unit 10G can be connected to an external device, and transmits and receives various data to and from the external device. Each part of the image processing apparatus 10 described above is electrically connected to each other by a system bus 10H. In the image processing apparatus 10 according to the present embodiment, the storage 10D is applied as a storage unit, but the storage unit is not limited to this, and other non-volatile storage units such as a hard disk and flash memory may be applied. .

With the above configuration, the image processing apparatus 10 according to the present embodiment uses the CPU 10A to access the ROM 10B, the RAM 10C, and the storage 10D, acquire various data via the operation unit 10E, and display various information on the display unit 10F. Execute each. Further, the image processing apparatus 10 controls transmission and reception of various data via the communication I/F section 10G by the CPU 10A.

(First embodiment)
The image processing apparatus 10 according to the present embodiment prepares a coloration image as a target of color adjustment in advance, and when the user selects the coloration image, performs processing to reflect the coloration of the coloration image to the coloration of the target image. Further, when the color scheme of the color scheme image is reflected in the color scheme of the target image, a process of accepting a color adjustment degree indicated by a predetermined adverb expression and adjusting the degree of change of the color of the target image according to the accepted adjustment degree is performed. . Note that in this embodiment, the image of the color sample that is the target of color adjustment is the coloration image, the image to be processed for color adjustment is the target image, and the image in which the coloration of the coloration image is reflected in the coloration of the target image is the coloration reproduction image. , the image obtained by adjusting the impression of the coloration when the coloration of the coloration image is reflected in the coloration of the target image is referred to as a coloration degree adjustment reproduction image. In addition, the adverbial expression includes an adverbial phrase expression. Also, hereinafter, adverb expressions may be simply referred to as adverbs for short.

Here, a functional configuration realized by executing a program stored in the ROM 10B by the CPU 10A of the image processing apparatus 10 will be described. FIG. 3 is a functional block diagram showing the functional configuration of the image processing apparatus 10 according to this embodiment.

The image processing apparatus 10 according to this embodiment has functions of a target color distribution analysis unit 12 , a target color distribution analysis unit 14 , a coloration transfer unit 16 , an impression adjustment degree determination unit 18 , and a coloration transfer degree adjustment unit 20 .

The target color distribution analysis unit 12 calculates information representing the color distribution of the target image whose color arrangement is to be changed. For example, the target color distribution analysis unit 12 calculates information such as an average value, a variance, a standard deviation, a histogram, etc. for each color component forming an image. In addition, any other information may be used as long as it represents the characteristics of the color distribution.

In addition, the target color distribution analysis unit 14 calculates information representing the color distribution of the target color scheme image when changing the color scheme of the target image. For example, similarly to the target color distribution analysis unit 12, the target color distribution analysis unit 14 calculates information such as average values, variances, standard deviations, and histograms for each color component forming the image. In addition, any other information may be used as long as it represents the characteristics of the color distribution.

The coloration transfer unit 16 generates a coloration reproduction image in which the coloration of the coloration image is reflected in the coloration of the target image based on the analysis results of the target color distribution analysis unit 12 and the target color distribution analysis unit 14 .

Here, it is assumed that the target image is, for example, a color image as shown in FIG. FIG. 4 is a diagram showing an example of a target image. The target image in FIG. 4 shows an example in which a tray on which glasses and bottles are placed is placed on a table. In order to change the color scheme of the target image, target color scheme information is required. In this embodiment, for example, as shown in FIG. An example of using as is explained as an example. The example of the color scheme image in FIG. 5 shows a plurality (three in FIG. 5) of sample colors arranged in order facing one direction. Also, in the example of the color arrangement image in FIG. 5, three types of color arrangement patterns 1 to 3 are shown.

The following references are available for the basic principle of transferring the impression of the target color scheme image to the target image. According to the principle of the reference, the impression of the color scheme image is transferred to the target image based on the respective color distributions to obtain a match of perceptual impressions. At this time, any color component other than RGB may be used, and for example, Lαβ, which is a color space devised based on human perception, is often used.

(References)
Reference 3: Reubhard, E., Ashikhmin, M., Gooch, B., And Shirley, P. 2001. Color transfer between images. IEEE Computer Graphics and Applications 21, 34-41

Here, the description will be made assuming that the image is converted from RGB to Lαβ, but the chromaticity data is not limited to this as long as it is chromaticity data in a color space that can be separated into chromaticity components and luminance components. For example, the Lαβ data may be converted into CIEL*a*b* data, IPT data, CAMO2 data, HSV data, or the like.

Assume that one pixel value of the target image is (L _s , α _s , β _s ), and the pixel after coloration conversion is (L ₀ , α ₀ , β ₀ ). Since the colored image as shown in FIG. 5 can also be regarded as an image, one pixel value of the colored image at this time is assumed to be (L _t , α _t , β _t ) for conversion from RGB to Lαβ.

The pixel averages of Lαβ of the target image and the color scheme image are calculated as follows, and the standard deviation representing the spread of each color distribution is calculated as follows.

Accordingly, the pixels of the target image after color scheme conversion can be represented by the following equation.

Of course, the color scheme image may be provided only with color combination information. In that case, if it is a bar of three colors, for example, 100, 0) may be given to generate a coloration image, or the above calculation formula may be applied assuming that there is a coloration image.

The impression adjustment degree determination unit 18 determines the impression adjustment degree corresponding to each adverb by designating an adverb representing the degree of impression as a predetermined adverb expression. That is, the impression adjustment degree determining unit 18 determines the degree of reflecting the coloration of the target image on the coloration of the coloration image. Adverbs are set by a user interface that displays various patterns of selection images such as pull-down menus, radio buttons, and slide bars to select adverbs, as shown in FIG. By accepting these user interface operations, it is possible to increase or decrease the intensity of the impression, and the adjustment degree α, which is information for changing the color arrangement of the target image to the color arrangement of the color arrangement image, is determined.

A coloration transfer degree adjustment unit 20 generates a coloration degree adjustment reproduction image reflecting the impression adjustment degree using the adjustment degree α determined by the impression adjustment degree determination unit 18, the coloration reproduction image, and the target image.

Here, as shown in the following formula, it is assumed that the image is generated by adding the color reproduction image to the target image. The impression adjustment degree α is calculated according to the selected adverb. The degree of adjustment α shall follow the average preference scale used in the sensory evaluation.

For example, FIG. 7 is one form of determining the degree of impression. An example of adjusting the impression intensity using the pull-down menu, radio buttons, or slide bar shown in FIG. 6 will be described. For example, as shown in the slide bar of FIG. 6, selecting "warito" returns the value α corresponding to the specified adverb. At this time, α corresponds to the specified adverb "warito", and the color scheme transfer is performed by multiplying the color scheme limited image by the adjustment degree of a slightly strong impression, and as shown in FIG. 7, the color scheme degree adjustment reproduction Generate an image. Further, when "slightly" is selected on the slide bar shown in FIG. 6, the impression adjustment degree α corresponding to the adverb "slightly" is returned, and as shown in FIG. Coloration transfer is performed to generate a coloration degree-adjusted reproduction image. If the degree of adjustment of the impression of the adverb specified in this way is weak, an image close to the target image will be generated, and if it is strong, an image close to the color scheme image will be generated. Note that the slide bar in FIG. 6, the target image in FIGS. 7 and 8, the coloration image, the coloration reproduction image, and the coloration degree reproduction image may be displayed on one screen.

Here, the intensity that determines the impression is determined according to the adverbs used in the scale, and the adverbs and scales may conform to the sensory test handbook. 9 and 10 show an example of the difference in impression strength depending on terms. The example of FIG. 9 shows an example of setting the impression adjustment degree α corresponding to “slightly”, “slightly”, “fairly”, and “remarkably”, and FIG. An example of setting the impression adjustment degree α corresponding to "relatively" and "somewhat" is shown.

As shown in FIGS. 9 and 10, a plurality of adverbial expression patterns having different degrees of adjustment α may be prepared, and the user may select an adverbial expression pattern to be used.

Next, specific processing performed by the image processing apparatus 10 according to this embodiment configured as described above will be described. FIG. 11 is a flowchart showing an example of the flow of processing performed by the image processing apparatus 10 according to this embodiment. Note that the processing in FIG. 11 is started, for example, when the user operates the operation unit 10E to instruct the start.

At step 100, the CPU 10A obtains a target image whose color scheme is to be changed, and proceeds to step 102. FIG. That is, the target color distribution analysis unit 12 acquires the target image. Acquisition of the target image acquires the image specified by the user as the target image.

At step 102, the CPU 10A analyzes the color distribution of the target image and proceeds to step 104. FIG. That is, the target color distribution analysis unit 12 calculates information representing the color distribution of the target image. For example, information such as the average value, variance, standard deviation, and histogram for each color component forming the image is calculated as information representing the color distribution of the target image.

At step 104, the CPU 10A obtains a target coloration image for changing the coloration of the target image, and proceeds to step 106. FIG. That is, the target color distribution analysis unit 14 acquires the color scheme image. Acquisition of the color arrangement image acquires, for example, one selected by the user from among a plurality of types of predetermined color arrangement bars.

At step 106, the CPU 10A analyzes the color distribution of the color scheme image and proceeds to step 108. FIG. That is, the target color distribution analysis unit 14 calculates information representing the color distribution of the color scheme image. For example, similarly to the target color distribution analysis unit 12, information such as the average value, variance, standard deviation, histogram, etc. for each color component forming the image is calculated.

Note that the processing order of steps 100 to 106 is not limited to this, and may be any order that enables image acquisition and analysis. For example, steps 104, 106, 100, and 102 may be processed in this order. Alternatively, steps 100, 104, 102, and 106 may be performed in order. Alternatively, step 104, step 100, step 106, and step 102 may be performed in order.

At step 108, the CPU 10A reflects the color scheme of the color scheme image to the color scheme of the target image, and proceeds to step 110. FIG. That is, the coloration transfer unit 16 reflects the coloration of the coloration image to the coloration of the target image based on the analysis results of the target color distribution analysis unit 12 and the target color distribution analysis unit 14 .

At step 110, the CPU 10A determines whether or not an adverb representing the degree of impression has been accepted. The determination is made by determining whether or not the impression adjustment degree determination unit 18 has received an operation to select an adverb representing the degree of impression. For example, it is determined whether or not the impression strength has been selected using the slide bar or the like shown in FIG. It waits until the determination is affirmative and proceeds to step 112 .

At step 112, the CPU 10A determines the degree of impression adjustment and proceeds to step 114. FIG. That is, the impression adjustment degree determination unit 18 determines the impression adjustment degree corresponding to the adverb representing the impression degree received in step 110 .

At step 114, the CPU 10A adjusts the coloration transfer degree based on the impression adjustment degree, and ends the series of processing. That is, the coloration transfer degree adjustment unit 20 uses the adjustment degree determined by the impression adjustment degree determination unit 18, the coloration reproduction image, and the target image to generate the coloration degree adjustment reproduction image reflecting the impression adjustment degree.

Through the above processing, the color scheme of the color scheme image is reflected in the color scheme of the target image. Accordingly, color adjustment is performed to change the impression of the target image to the impression based on the color arrangement image. Also, the degree of adjustment of the impression is adjusted by an adverb representing the degree of impression.

(Second embodiment)
Next, an image processing apparatus according to the second embodiment will be described. This embodiment is a modification of the first embodiment, and since the basic configuration is the same as that of the first embodiment, only the differences will be described.

In the first embodiment, when the coloration of the target image and the coloration image are close to each other, the coloration of the coloration degree reproduction image does not change much in the first place.

Therefore, in the present embodiment, the impression adjustment degree determination unit 18 changes the value of the adjustment degree α according to the similarity between the target image and the color scheme image when determining the impression adjustment degree corresponding to the adverb. As the degree of similarity, for example, the average color difference between the target image and the color scheme image, the difference in brightness, and the like are used.

Specifically, the value of the degree of adjustment α is increased or decreased according to the degree of similarity, as shown by the following formula.

For example, as shown in FIG. 12, if the degree of similarity is high, the degree of adjustment α to be adjusted is increased, and if the degree of similarity is low, the degree of adjustment α is decreased. As shown in FIG. 13, K in the above formula may be defined by a function that increases as the degree of similarity increases. Note that the function is not limited to a linear function as shown in FIG. 13, and may be a nonlinear function.

Next, specific processing performed by the image processing apparatus according to this embodiment will be described. FIG. 14 is a flowchart showing an example of the flow of processing performed by the image processing apparatus according to this embodiment. Note that the processing in FIG. 14 is started, for example, when the user operates the operation unit 10E to instruct the start. Also, the same processing as in FIG. 11 will be omitted, and only differences will be described.

That is, in step 110, when the impression adjustment degree determination unit 18 receives an operation of selecting an adverb representing the degree of impression, the process proceeds to step 112A.

At step 112A, the CPU 10A calculates the degree of similarity between the target image and the color scheme image, and proceeds to step 112B. That is, the impression adjustment degree determination unit 18 calculates the degree of similarity between the target image and the color scheme image. For example, a similarity such as an average color difference or a difference in brightness between the target image and the color scheme image is calculated.

At step 112B, the CPU 10A determines the degree of impression adjustment according to the degree of similarity, and proceeds to step 114. FIG. That is, the impression adjustment degree determination unit 18 calculates the impression adjustment degree α corresponding to the adverb representing the impression degree received in step 110, and obtains the adjustment degree α according to the similarity between the target image and the color arrangement image.

As a result, even when the target image and the coloration image are close to each other, it becomes easy to understand the coloration change of the coloration degree reproduction image.

(Third embodiment)
Next, an image processing apparatus according to the third embodiment will be described. FIG. 15 is a functional block diagram showing the functional configuration of the image processing apparatus according to this embodiment.

In each of the above embodiments, an example was described in which the adjustment degree α when the color scheme of the color scheme image is reflected in the color scheme of the target image is uniformly reflected in the entire image. It is possible to specify the area to be reflected.

As shown in FIG. 15, the present embodiment differs from the first embodiment only in that it further includes the function of an area designation unit 22, and only the differences from the first embodiment will be described below.

The area specifying unit 22 receives an area to which the impression adjustment degree determined by the impression adjustment degree determining unit 18 is applied. That is, the area specifying unit 22 allows the user to specify an area to be emphasized instead of the entire image, and accepts the specified area. For example, as shown in FIG. 16, when the degree of adverbs is changed only for the glass, the region of the glass is accepted as the region to which the impression degree is applied.

The color scheme transfer degree adjustment unit 20 reflects the impression adjustment degree determined by the impression adjustment degree determination unit 18 on the area specified by the area specification unit 22 using the following formula.

For example, let f(x, y)=1 for areas to be emphasized, such as glasses, and f(x, y)=0 for other areas that are not to be emphasized. As a result, the impression adjustment degree is adjusted with respect to the designated area.

(Fourth embodiment)
In each of the above-described embodiments, an example in which a PC is used as the image processing apparatus 10 and all processing is performed by the PC has been described. there is In the present embodiment, the client terminal performs the portion related to the user's operation, and the cloud server performs the portion related to the image processing.

FIG. 17 is a diagram showing a schematic configuration of an image processing system according to this embodiment. An image processing system 50 according to this embodiment includes a cloud server 52 and a plurality of client terminals 54a and 54b. In this embodiment, an example of providing a plurality of client terminals 54 (two in FIG. 17) is shown, but the number of client terminals 54 may be one or three or more. Also, the client terminal 54 may be a personal computer, or may be a mobile terminal such as a tablet terminal or a smart phone.

The cloud server 52 and the client terminal 54 are each connected via a communication line 56 such as a LAN (Local Area Network), WAN (Wide Area Network), Internet, intranet, or the like. Each of the cloud server 52 and the client terminal 54 can mutually transmit and receive various data via the communication line 56 . The configuration of the cloud server 52 and the client terminal 54 is the configuration of a general computer, and the basic configuration is the same as that of the image processing apparatus 10 described above. That is, each of the cloud server 52 and the client terminal 54 includes a CPU, ROM, RAM, storage, operation unit, display unit, and communication I/F unit, similar to the configuration of the image processing apparatus 10 shown in FIG. .

By configuring the image processing system 50 in this way and operating the client terminal 54, the target image and the color scheme image can be selected, and the degree of impression when determining the degree of adjustment of the impression in the impression adjustment degree determination unit 18. Accepts operations such as designation of The cloud server 52 then executes a service that executes the functions of FIGS.

The functions shown in FIGS. 3 and 15 may be provided in a single cloud server 52, or the functions shown in FIGS. 3 and 15 may be shared by a plurality of servers.

Further, in the above-described embodiment, the coloration bar and the coloration block are given as examples of the coloration image, but the coloration image is not limited to this. For example, a captured image captured in advance may be applied as the color scheme image. FIG. 18 is a diagram showing an example of applying a photographed image as a color scheme image. When a photographed image is used as a colored image, the impression of the colored image is transferred to the target image according to the following formula.

Here, I is each pixel value of the target image, μs is the average of the target image, _σt is the standard deviation of the coloration image, _σs is the standard deviation of the target image, and _μt is the average of the _coloration image. When μ _s <μ _t , the overall brightness increases, and when σ _t <σ _s , the contrast increases.

In the example of FIG. 18, when the target image has an average value of 44 and a standard deviation of 22, and the coloration image has an average value of 57 and a standard deviation of 30, the coloration reproduction image has an average value of 57 and a standard deviation of 30. It's becoming When the target image has a pixel value of 65, the color reproduction image is (65−44)×30/22+57=85.

It should be noted that in the above-described embodiment, an image in which impressions corresponding to a plurality of types of adverbs have been adjusted may be displayed. For example, as shown in FIG. 19, adjustment results corresponding to a plurality of types of adverbs such as "slightly", "moderately", and "pretty much" may be displayed. In this case, as shown in FIG. 19, the adjusted image may be reduced and displayed as a thumbnail image. Also, at this time, the images to be displayed may be selected by the user and displayed, or images corresponding to all adverbs may be displayed.

In the above embodiment, instead of adjusting the degree of impression using a user interface that displays a selection image and selects adverbs, an interface that accepts user's voice is used to select adverbs by voice. good too. For example, it is possible to adopt a form in which a voice such as "just a little more" is received, and the value of the adjustment degree α is increased stepwise each time "just a little more" is received.

In the above-described embodiment, the procedure for generating and displaying the coloration degree adjusted reproduction image is to generate and display the coloration reproduction image by reflecting the coloration of the coloration image in the coloration of the target image, and then adjust the degree of adjustment α. A procedure of adjusting and generating and displaying a reproduction image having the degree of color combination adjustment may be employed. Alternatively, instead of generating the coloration reproduction image, a procedure may be adopted in which the coloration degree adjustment reproduction image is directly generated and displayed by designating the adjustment degree α by an adverb using a slide bar or the like.

Further, in the above-described embodiment, a color scheme image in which three sample colors are arranged in order facing one direction is shown as an example, but the present invention is not limited to this. For example, four swatch colors may be arranged in a 2×2 block.

In the above-described embodiment, when the color scheme of the color scheme image is reflected in the color scheme of the target image, each of the plurality of sample colors forming the color scheme image may be weighted for color adjustment. For example, among a plurality of sample colors, by weighting the color closest to the color most frequently included in the target image more than other colors, the image after color adjustment tends to become more natural. When weighting the sample colors of the color scheme image, the areas of the sample colors may be changed according to the weights. Alternatively, the area of the sample color may be changed by the user, and the weight may be changed according to the changed area.

Further, in each of the above-described embodiments, the user may be allowed to select a predetermined sensibility term expressing the impression of the image, and the color scheme image may be selected based on the selected sensibility term. For example, colored images corresponding to emotional terms such as "pretty", "romantic", and "cute" are associated in advance, and the user selects the emotional terms to select the corresponding colored images.

Moreover, although the first to fourth embodiments have been described individually, two or more embodiments may be combined.

Further, in the above embodiments, the CPU was described as an example of a processor, but the processor refers to a processor in a broad sense, such as a general-purpose processor (such as a CPU) or a dedicated processor (such as a GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

Further, the operations of the processors in the above embodiments may be performed not only by one processor but also by cooperation of a plurality of physically separated processors. Moreover, the order of each operation of the processor is not limited to the order described in each of the above embodiments, and may be changed as appropriate.

Further, the processing performed by the image processing apparatus 10 according to the above embodiment may be processing performed by software, may be performed by hardware, or may be a combination of both. Further, the processing performed by the image processing apparatus 10 may be stored as a program in a storage medium and distributed.

In addition, the present invention is not limited to the above, and it goes without saying that various modifications can be made without departing from the spirit of the present invention.

10 image processing device 10A CPU
10F display unit 12 target color distribution analysis unit 14 target color distribution analysis unit 16 coloration transfer unit 18 impression adjustment degree determination unit 20 coloration transfer degree adjustment unit 22 area designation unit 50 image processing system 52 cloud server 54 client terminal

Claims (11)

a processor, said processor comprising:
Using the relationship between the color distribution of the image to be processed and the color distribution of a color sample different from that of the image to be processed, when changing the color of the image to be processed, the degree of color adjustment indicated by a predetermined adverb expression is determined. reception,
An image processing apparatus that adjusts the degree of color change of the image to be processed according to the received adjustment degree. The processor further performs a process of displaying the image to be processed, the color sample, and a selection image for selecting the degree of adjustment on a display unit, and uses the color sample and the selection image selected by the user. 2. The image processing apparatus according to claim 1, wherein said processing is performed by The processor receives the adverbial expression pattern to be used from among a plurality of adverbial expression patterns obtained by combining a plurality of adverbial expressions with different degrees of adjustment, and displays the selection image corresponding to the received adverbial expression pattern. 3. The image processing apparatus according to claim 2, wherein the image is displayed in the section. 4. The image processing apparatus according to claim 2, wherein the selection image is an image in which a plurality of predetermined types of adverbial expressions are arranged and any one of the adverbial expressions can be selected. The image processing apparatus according to any one of claims 1 to 4, wherein the processor changes the degree of impression adjustment corresponding to the adverbial expression according to the degree of similarity between the image to be processed and the color sample. 6. The processor further receives an area that reflects the received degree of adjustment, and adjusts the degree of color change of the image to be processed for the received area according to the degree of adjustment. 10. The image processing device according to claim 1. The image processing apparatus according to any one of claims 1 to 6, wherein the processor further performs a process of displaying an image that has been adjusted to correspond to a plurality of types of adverbial expressions. 8. The image processing apparatus according to claim 7, wherein when displaying the adjusted images, the processor reduces the adjusted images and simultaneously displays them. 9. The image processing apparatus according to claim 7, wherein said processor receives a plurality of types of said adverbial expressions and displays an image adjusted corresponding to said plurality of types of received adverbial expressions. The image processing device according to any one of claims 1 to 9,
and a client terminal that instructs the image processing apparatus about the image to be processed, the color sample, and the degree of adjustment. to the computer,
Using the relationship between the color distribution of the image to be processed and the color distribution of a color sample different from that of the image to be processed, when changing the color of the image to be processed, the degree of color adjustment indicated by a predetermined adverb expression is determined. reception,
An image processing program for executing a process of adjusting the degree of color change of the image to be processed according to the received adjustment degree.

Images