JP2020101459A - Information processing device, control method and control program - Google Patents

Abstract

To provide an information processing device, control method, and control program that highly accurately identify a compounding ratio of an ink corresponding to a color of an object.SOLUTION: An information processing device according to the present invention comprises: an output unit; a first image acquisition unit that acquires a first image having a reference object and object photographed; a compounding information acquisition unit that acquires compounding information on an ink corresponding to a color of the reference object; a first identification unit that identifies a color component value of the reference object and a color component value of the object from the first image; a differential information calculation unit that calculates differential information indicative of a differential between the identified color component value of the reference object and the identified color component value of the object; a first compounding information identification unit that identifies the compounding information on the ink corresponding to the color of the object on the basis of the compounding information and differential information; and a first output control unit that outputs the identified compounding information on the object from the output unit.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing device, a control method, and a control program.

In recent years, an ink color matching service has been developed in which ink of a user's favorite color is generated at a store and sold to the user. In such a service, the user mixes the inks of a plurality of colors provided in the store at an arbitrary mixing ratio to adjust various colors. Then, the user selects a desired color from the toned colors, and orders the ink in which the inks of the respective colors are blended at the blending ratio of the inks when the color is toned.

Among users who use such services, there is a user who decides a desired color in advance and then comes to the store. In particular, there is a demand for purchasing ink of the same color as the color of the user's carry-on item in order to give the user's carry-on item a sense of unity. In order to purchase an ink of a desired color, such a user needs to repeat trial and error to find out the mixing ratio of the ink of the same color as the color of the carrying object. However, it is difficult for a user who is not very experienced in color matching to adjust a desired color by blending ink.

Patent Document 1 shows a plurality of color candidates having different color components from the reference color, and provides a mixing ratio that realizes the color of the color candidate designated by the user, whereby the ink of the color desired by the user can be obtained. A toning support device that presents a blending ratio is disclosed.

JP, 2003-270044, A

However, in the color matching support device described in Patent Document 1, the user is forced to select a color close to the desired color from the color candidates indicated by the color matching support device, and the target of the user's carry-on item or the like. It was not possible to provide an ink composition ratio of the same color as the product color. In the ink color matching service, it is desired to provide blending information indicating the blending ratio of ink of a color closer to the color of the target.

The present invention has been made to solve such a problem, and provides an information processing apparatus, a control method, and a control program that can specify the ink combination information corresponding to the color of an object with high accuracy. The purpose is to

An information processing apparatus according to the present invention includes an output unit, a first image acquisition unit that acquires a first image of a reference object and an object, and a combination that acquires ink combination information corresponding to the color of the reference object. An information acquisition unit; a first specifying unit that specifies the color component value of the reference object and the color component value of the target object from the first image; and the color component value of the specified reference object and the color component value of the target object A difference information calculation unit that calculates difference information indicating a difference between the two, and a first combination information specifying unit that specifies combination information of the ink corresponding to the color of the object based on the combination information and the difference information. A first output control unit that outputs the combination information of the target object from the output unit.

Further, the information processing apparatus according to the present invention includes a second image acquisition unit that acquires at least a second image of an object, a second specification unit that specifies a color component value of the object from the second image, From the output unit, the second combination information specifying unit that specifies the second combination information of the ink corresponding to the color component value of the object specified from the two images and the second combination information specified by the second combination information specifying unit are output. And a second output control unit for outputting, wherein the first image acquisition unit is a first image obtained by capturing an image of the reference object and the target object created based on the second combination information output from the output unit. It is preferable that the combination information acquisition unit acquires the second combination information output by the output unit.

Further, the information processing apparatus according to the present invention includes ink combination information corresponding to the color of the sample reference object, and difference information indicating a difference between the color component value of the sample reference object and the color component value of the sample target object. Further includes a discriminator pre-learned so as to output the ink composition information corresponding to the color of the sample target, and the first composition information identifying unit is configured to provide the reference composition information and the reference composition information. It is possible to specify the mixture information of the target object by acquiring the mixture information output when the color component value of the object and the color component value of the target object are input to the discriminator as the combination information of the target object. preferable.

A control method according to the present invention is a control method for an information processing apparatus, which acquires a first image of a reference object and an object, and acquires ink composition information corresponding to the color of the reference object. , The color component value of the reference object and the color component value of the target object are specified from the first image, and color difference information representing the difference between the color component value of the specified reference object and the color component value of the target object is obtained. And calculating the combination information of the ink corresponding to the color of the object based on the combination information and the color difference information, and outputting the specified combination information.

Further, the control program according to the present invention is a control program for an information processing apparatus, and acquires a first image of a reference object and an object imaged, and acquires ink composition information corresponding to the color of the reference object. , The color component value of the reference object and the color component value of the target object are specified from the first image, and color difference information representing the difference between the color component value of the specified reference object and the color component value of the target object is obtained. The information processing apparatus is caused to perform the calculation, specify the ink combination information corresponding to the color of the object based on the combination information and the color difference information, and output the specified combination information.

The information processing apparatus, the control method, and the control program according to the present invention can specify the ink combination information corresponding to the color of the object with high accuracy.

It is a schematic diagram for explaining an outline of processing by the combination information presentation system. It is a figure which shows an example of a schematic structure of the combination information presentation system 1. It is a figure which shows an example of a schematic structure of the terminal device 2. It is a figure which shows an example of a schematic structure of the server apparatus 3. (A) is a figure which shows an example of a data structure of the initial combination information table 500, and (b) is a figure which shows an example of a data structure of a corrected combination information table 510. It is a sequence diagram which shows an example of the flow of a process by the combination information presentation system 1. It is a sequence diagram which shows an example of the flow of a process by the combination information presentation system 1. (A) is a figure showing an example of the 2nd position specific screen 800, and (b) is a figure showing an example of the 1st position specific screen 810.

Hereinafter, various embodiments of the present invention will be described with reference to the drawings. However, it should be noted that the technical scope of the present invention is not limited to those embodiments, and extends to the inventions described in the claims and their equivalents.

(System overview)
FIG. 1 is a schematic diagram for explaining an outline of processing by the combination information presentation system according to the present invention.

First, the composition information presentation system acquires a first image of a reference object and an object. The object is an object for which the user desires ink of the same color as that of the object, and is, for example, a user's carrying object. In the example shown in FIG. 1, the target object is a bag carried by the user. The reference product is a product including a color toned by mixing inks of a plurality of colors based on predetermined combination information. The reference item is, for example, a Pantone color sample book.

Subsequently, the composition information presentation system acquires the composition information of the ink corresponding to the color of the reference material. The ink composition information corresponding to the color of the reference material is, for example, information indicating the volume or composition ratio of each of the plurality of reference inks used when the color of the reference material is toned. The ink composition information corresponding to the color of the reference material is stored in advance in, for example, the composition information presentation system. The reference ink is a plurality of inks of different predetermined colors.

Then, the combination information presentation system specifies the color component value of the reference object and the color component value of the target object from the first image. The combination information presentation system receives, for example, the user's designation of the position of the reference object and the position of the target object in the first image, and acquires the color component value of the pixel corresponding to the designated position in the first image. Then, the color component value of the reference object and the color component value of the object are specified. The color component value is information that can uniquely identify the color of the pixel, and is, for example, the gradation value of each color of RGB.

Then, the combination information presentation system calculates difference information indicating a difference between the color component value of the specified reference object and the color component value of the target object. The combination information presentation system calculates a subtraction value obtained by subtracting the gradation value corresponding to the color of the reference object from the gradation value corresponding to the color of the target object as the difference information for each color of RGB.

Then, the composition information presentation system specifies the composition information of the ink corresponding to the color of the target object based on the acquired combination information of the ink corresponding to the color of the reference object and the calculated difference information, and specifies the combination information. The combined information is output. The composition information presentation system specifies the composition information of the ink corresponding to the color of the target object from the composition information of the ink corresponding to the color of the acquired reference object, in consideration of the difference indicated by the calculated difference information. To do.

The above description of FIG. 1 is merely for the purpose of deepening the understanding of the content of the present invention. The present invention is specifically implemented in each of the embodiments described below, and may be implemented by various modifications without substantially exceeding the principles of the present invention. All such modifications are within the scope of the invention and the disclosure herein.

(System configuration)
FIG. 2 is a diagram showing an example of a schematic configuration of the combination information presentation system 1. The combination information presentation system 1 includes a terminal device 2 and a server device 3.

The terminal device 2 is, for example, a multifunctional mobile phone (a so-called “smartphone”) owned by a user and having an imaging device such as a camera. The terminal device 2 is a mobile phone (so-called “feature phone”) having an imaging device such as a camera, a personal digital assistant (PDA), a tablet terminal, a tablet PC (Personal Computer), a portable game machine, a portable music player. Alternatively, it may be a notebook PC or the like.

The server device 3 is an information processing device such as a workstation or a PC. The server device 3 may be a multifunctional mobile phone, a tablet terminal or the like that can perform predetermined information processing. The server device 3 is communicatively connected to the terminal device 2 via the network 4. The network 4 is, for example, the Internet. The network 4 may include other networks such as an intranet and a LAN (Local Area Network). The server device 3 is an example of an information processing device.

(Configuration of terminal device)
FIG. 3 is a diagram showing an example of a schematic configuration of the terminal device 2. The terminal device 2 includes a terminal communication unit 21, a terminal storage unit 22, an operation unit 23, a display unit 24, an imaging unit 25, and a terminal processing unit 26.

The terminal communication unit 21 includes a communication interface circuit that enables the terminal device 2 to communicate with the server device 3 via the network 4. The communication interface circuit included in the terminal communication unit 21 is an LTE (Long Term Evolution) or wireless LAN communication interface circuit or the like. The terminal communication unit 21 transmits the data supplied from the terminal processing unit 26 to the server device 3, receives the data transmitted from the server device 3, and supplies the data to the terminal processing unit 26.

The terminal storage unit 22 is a device for storing programs or data, and includes, for example, a semiconductor memory device. The terminal storage unit 22 stores an operating system program, a driver program, an application program, data and the like used for the processing by the terminal processing unit 26. The program is installed in the terminal storage unit 22 from a computer-readable portable storage medium such as a CD-ROM or a DVD-ROM using a known setup program or the like.

The operation unit 23 is a device for accepting an operation of the terminal device 2 by a user, and is, for example, a keypad or the like. The operation unit 23 may be a touch panel integrated with a display unit 24 described below. The operation unit 23 receives an input operation of characters, numbers, symbols and the like by the user. When the operation unit 23 receives an operation by the user, the operation unit 23 generates a signal corresponding to the operation and supplies the signal to the terminal processing unit 26.

The display unit 24 is a device that displays an image or the like to the user of the terminal device 2, and is, for example, a liquid crystal display or an organic EL display. The display unit 24 displays an image or the like according to the data supplied from the terminal processing unit 26.

The image pickup unit 25 includes an image forming optical system, an image pickup element, an image processing unit, and the like. The image forming optical system is, for example, an optical lens, and forms an image of the light flux from the subject on the image pickup surface of the image pickup element. The image pickup device is, for example, a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and outputs an image signal of a subject image formed on the image pickup surface. The image processing unit generates image data in a predetermined file format from the image signal generated by the image sensor and outputs the image data.

The terminal processing unit 26 includes one or more processors and their peripheral circuits. The terminal processing unit 26 is, for example, a CPU (Central Processing Unit), and comprehensively controls the operation of the terminal device 2. The terminal processing unit 26 may be a DSP (Digital Signal Processor), an LSI (Large-Scaled IC), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like. The terminal processing unit 26 causes the display unit 24 and the terminal communication unit 21 to execute various processes of the terminal device 2 in an appropriate procedure based on a program stored in the terminal storage unit 22 and an operation of the operation unit 23. Control the behavior of. The terminal processing unit 26 executes processing based on the program stored in the terminal storage unit 22. Moreover, the terminal processing unit 26 can execute a plurality of programs in parallel.

The terminal processing unit 26 includes an imaging processing unit 261, a position specifying unit 262, and a display control unit 263 as functional blocks. The imaging processing unit 261, the position specifying unit 262, and the display control unit 263 are functional modules realized by the program executed by the terminal processing unit 26. Further, the image pickup processing unit 261, the position specifying unit 262, and the display control unit 263 may be implemented in the terminal device 2 as firmware.

(Configuration of server device)
FIG. 4 is a diagram showing an example of a schematic configuration of the server device 3. The server device 3 includes a server communication unit 31, a server storage unit 32, and a server processing unit 33.

The server communication unit 31 includes a communication interface circuit that enables the server device 3 to communicate with the terminal device 2 via the network 4. The communication interface circuit included in the server communication unit 31 is a wired LAN communication interface circuit or the like. The server communication unit 31 transmits the data supplied from the server processing unit 33 to the terminal device 2, receives the data transmitted from the terminal device 2, and supplies the data to the server processing unit 33. The server communication unit 31 is an example of an output unit.

The server storage unit 32 is a device for storing programs or data, and includes, for example, a semiconductor memory device. The server storage unit 32 stores an operating system program, a driver program, an application program, data and the like used for the processing by the server processing unit 33. The program is installed in the server storage unit 32 from a computer-readable portable storage medium such as a CD-ROM or a DVD-ROM using a known setup program or the like.

The server processing unit 33 includes one or more processors and their peripheral circuits. The server processing unit 33 is, for example, a CPU, and integrally controls the operation of the server device 3. The server processing unit 33 may be a DSP, LSI, ASIC, FPGA, or the like. The server processing unit 33 controls the operation of the server communication unit 31 so that various processes of the server device 3 are executed in an appropriate procedure based on the program stored in the server storage unit 32. The server processing unit 33 executes processing based on the program stored in the server storage unit 32. Further, the server processing unit 33 can execute a plurality of programs in parallel.

The server processing unit 33 includes a second image acquisition unit 331, a second identification unit 332, a second combination information identification unit 333, and a second output control unit 334 as functional blocks. The server processing unit 33 also includes a first image acquisition unit 335, a combination information acquisition unit 336, a first specification unit 337, a difference information calculation unit 338, a first combination information specification unit 339, and a first output control. And a unit 340 as a functional block. Each of these units is a functional module realized by a program executed by the server processing unit 33. Also, each of these units may be implemented in the server device 3 as firmware.

(data structure)
FIG. 5A is a diagram showing an example of the data structure of the initial combination information table 500 stored in the server storage unit 32 of the server device 3. The initial combination information table 500 stores the color component value 501 and the initial combination information 502 in association with each other.

The color component value 501 is information that can uniquely identify the color of a pixel in an image. In the example shown in FIG. 5A, the color component value 501 is a gradation value of each color of RGB. The color component value 501 may be a gradation value in another color space such as CMY, Yuv, L*a*b*, or the like that can uniquely identify the pixel color.

The initial combination information 502 is predetermined combination information of reference inks of a plurality of different colors for mixing inks of the colors identified by the associated color component values. In the example shown in FIG. 5A, the initial combination information 502 is the volume of each reference ink of ink 1, ink 2, and ink 3. That is, the user can adjust the color of the ink identified by the associated color component value 501 by mixing the respective reference inks by the volume indicated by the initial formulation information 502. The initial combination information 502 may be not the respective volumes of the reference inks of a plurality of colors but other indexes such as a mixing ratio or a weight. The reference ink may be four or more different color inks. The initial combination information 502 is an example of second combination information.

The initial combination information 502 is information that is appropriately determined in advance for each color component value 501 by the administrator of the combination information presentation system 1.

FIG. 5B is a diagram showing an example of the data structure of the modified combination information table 510 stored in the server storage unit 32 of the server device 3. The corrected combination information table 510 stores the initial combination information 511, the difference information 512, and the corrected combination information 513 in association with each other.

The initial combination information 511 is information corresponding to the initial combination information 502 in the initial combination information table 500. The difference information 512 is information indicating the difference between the color component value of the reference object and the color component value of the target object. In the example shown in FIG. 5B, the difference information 512 is a value obtained by subtracting the gradation value, which is the color component value of the reference object, from the gradation value, which is the color component value of the target object, for each of the RGB colors. .. The modified combination information 513 is reference ink combination information for mixing ink of a color defined by the initial combination information 511 and the difference information 512. The corrected combination information 513 is an example of the first combination information.

The corrected combination information 513 is information that has been appropriately determined in advance by the administrator of the combination information presentation system 1 for each initial combination information 511 and each difference information 512. The corrected combination information 513 is, for example, information obtained by correcting the initial combination information 511 so as to fill the difference between the color component value of the reference object and the color component value of the target object indicated by the difference information 512.

(Process flow)
6 and 7 are sequence diagrams showing an example of the flow of processing by the combination information presentation system 1. First, the flow of processing by the combination information presentation system 1 will be described with reference to FIG.

First, the image pickup processing unit 261 of the terminal device 2 controls the image pickup unit 25 to generate at least a second image obtained by picking up an object (S601). The image capturing processing unit 261 generates the second image by capturing an image of the target object, for example, in accordance with the user's operation on the operation unit 23. The object is an object for which the user desires ink of the same color as that of the object, and is, for example, a user's carrying object.

Subsequently, the position specifying unit 262 specifies the position of the target object in the second image (S602). The position specifying unit 262 specifies the position of the target object, for example, by displaying a second position specifying screen including the second image on the display unit 24 and accepting the designation of the specific position in the second image by the user. To do.

FIG. 8A is a diagram showing an example of the second position specifying screen 800 displayed on the display unit 24 by the position specifying unit 262. The second position specifying screen 800 includes a second image 801, a position designation object 802, a text display area 803, and a position determination button 804. The position designation object 802 is an object that indicates the position designated by the user as the position of the target object in the second image 801. The text display area 803 is an area in which a text prompting the user to specify a position is displayed. The position determination button 804 is a button for determining the position of the target object at the position indicated by the position designation object 802.

The position specifying unit 262 accepts the designation of the position of the target object in the second image 801 by the user while the second position specifying screen 800 is displayed on the display unit 24. For example, when the operation unit 23 is a touch panel integrated with the display unit 24, the user touches the position of the target object in the second image 801 displayed on the display unit 24 to determine the position of the target object. Can be specified. The position specifying unit 262 displays the position designation object 802 at the designated position in response to the designation of the position of the target object being received. Then, the user confirms that the position where the position designation object 802 is displayed is the position of the target object, and touches the position determination button 804. When the user touches the position determination button 804, the position specifying unit 262 specifies the designated position as the position of the target object. Note that the position identifying unit 262 may identify a region that is not a point in the second image as a region that includes the object.

Returning to FIG. 6, the terminal device 2 transmits the generated second image and the target object position information indicating the position of the specified target object to the server device 3 via the terminal communication unit 21.

Subsequently, the second image acquisition unit 331 of the server device 3 acquires the second image and the object position information (S603). The second image acquisition unit 331 acquires the second image and the target object position information by receiving the second image and the target object position information via the server communication unit 31.

Subsequently, the second specifying unit 332 specifies the color component value of the target object from the second image (S604). The second specifying unit 332 specifies the color component value of the target object, for example, by acquiring the color component value of the pixel at the position specified by the target position information among the pixels in the second image. When the predetermined area is specified by the object position information, the second specifying unit 332 determines the median value or the average value of the color component values of the plurality of pixels included in the specified area as the color component value of the object. Good as

Subsequently, the second combination information specifying unit 333 specifies initial combination information which is the combination information of the ink corresponding to the color component value of the target specified from the second image (S605). The second combination information identification unit 333 refers to the initial combination information table 500 of the server storage unit 32, and specifies the initial combination information 502 associated with the color component value 501 that matches the color component value of the object. At this time, the second combination information identification unit 333 may store the identified initial combination information in the server storage unit 32.

Then, the 2nd output control part 334 outputs by transmitting the specified initial combination information via the server communication part 31 (S606).

Subsequently, the display control unit 263 of the terminal device 2 displays the initial combination information on the display unit 24 (S607). The display control unit 263 receives the initial combination information from the server device 3 via the terminal communication unit 21. Subsequently, the display control unit 263 causes the display unit 24 to display the type of ink included in the received initial combination information and the information about the volume of each ink.

Subsequently, proceeding to FIG. 7, the image capturing processing unit 261 of the terminal device 2 controls the image capturing unit 25 to generate a first image obtained by capturing the reference object and the target object (S701). The image capturing processing unit 261 generates the first image by capturing an image of the reference object and the target object, for example, according to the operation of the operation unit 23 by the user. The reference object is an object corresponding to the color toned by the initial combination information. The reference item is, for example, a color selected by the user as a color toned by the initial combination information in the Pantone color sample book.

Subsequently, the position specifying unit 262 specifies the positions of the reference object and the target object in the first image (S702). The position specifying unit 262 displays, for example, a first position specifying screen including the first image on the display unit 24, and accepts designation of a specific position in the first image by the user, whereby the reference object and the object are identified. Specify the position of.

FIG. 8B is a diagram showing an example of the first position specifying screen 810 displayed on the display unit 24 by the position specifying unit 262. The first position specification screen 810 includes a first image 811, a reference object position designation object 812, an object position designation object 813, a text display area 814, and a position determination button 815. The reference object position designation object 812 is an object that indicates the position or area designated by the user as the position or area of the reference object in the first image 811. The object position designation object 813 is an object that indicates the position or area designated by the user as the position or area of the object in the first image 811. The text display area 814 and the position determination button 815 are the same as those in the second position specifying screen 800.

The position specifying unit 262 receives the designation of the positions of the reference object and the target object in the first image by the user when the first position specifying screen 810 is displayed on the display unit 24. For example, when the operation unit 23 is a touch panel integrated with the display unit 24, the user touches the positions of the reference object and the target object in the first image 811 displayed on the display unit 24, respectively, It is possible to specify the positions of the reference object and the object. The position identifying unit 262 displays the reference object position designation object 812 at the designated position in response to the designation of the position of the reference object being received. Further, the position identifying unit 262 displays the target object position designation object 813 at the designated position in response to the designation of the position of the target object being received. Subsequently, the user confirms that the position at which the reference object position designation object 812 is displayed is the position of the reference object and the position at which the target object position designation object 813 is displayed is the position of the target object, and determines the position. Touch the display area of the button 815. The position specifying unit 262 specifies the specified positions as the positions of the reference object and the target object in response to the user touching the display area of the position determination button 815.

Returning to FIG. 7, the terminal device 2 via the terminal communication unit 21 generates the first image, reference object position information indicating the position of the specified reference object, and object position information indicating the position of the object. And are transmitted to the server device 3.

Subsequently, the first image acquisition unit 335 of the server device 3 acquires the first image, the reference object position information, and the target object position information (S703). The first image acquisition unit 335 acquires the first image and the target object position information by receiving the first image, the reference object position information, and the target object position information via the server communication unit 31.

Subsequently, the combination information acquisition unit 336 acquires the initial combination information of the reference item (S704). The combination information acquisition unit 336 may acquire the initial combination information stored in the server storage unit 32 by the second combination information identification unit 333, for example. The combination information acquisition unit 336 may also acquire the initial combination information from the terminal device 2. In this case, the terminal device 2 accepts the input of the initial combination information by the user via the operation unit 23, and transmits the input initial combination information to the server device 3 via the terminal communication unit 21.

Subsequently, the first specifying unit 337 specifies the color component value of the reference object and the color component value of the target object from the first image (S705). For example, the first specifying unit 337 specifies the color component value of the reference object by acquiring the color component value of the pixel at the position specified by the reference object position information among the pixels in the first image. Further, the first specifying unit 337 specifies the color component value of the object by acquiring the color component value of the pixel at the position specified by the object position information among the pixels in the first image. When the predetermined area is specified by the reference object position information, the first specifying unit 337 determines the median value or the average value of the color component values of the plurality of pixels included in the specified area as the color component value of the object. Good as

Subsequently, the difference information calculation unit 338 calculates difference information indicating a difference between the color component value of the identified reference object and the color component value of the target object (S706). When the color component value is a gradation value of RGB, the difference information calculation unit 338 calculates subtraction values obtained by subtracting the gradation value of the reference object from the gradation value of the object for each color of RGB as difference information. To do.

Subsequently, the first combination information identifying unit 339 identifies the corrected combination information, which is the composition information of the ink corresponding to the color of the target object, based on the initial combination information and the difference information (S707). The first combination information identification unit 339 refers to the corrected combination information table 510 stored in the server storage unit 32 and specifies the corrected combination information 513 associated with the combination of the initial combination information and the difference information.

Then, the 1st output control part 340 outputs by transmitting the pinpointed correction combination information to the terminal device 2 via the server communication part 31 (S708).

Subsequently, the display control unit 263 of the terminal device 2 displays the modified combination information on the display unit 24 (S709). The display control unit 263 receives the modified combination information from the server device 3 via the terminal communication unit 21. Subsequently, the display control unit 263 displays on the display unit 24 the type of ink included in the received correction combination information and the information about the volume of each ink.

As a result, the combination information presentation system 1 ends the series of processes.

In addition, in the combination information presentation system 1, S601 to S607 may be omitted. In this case, in S704, the combination information acquisition unit 336 acquires the initial combination information from the terminal device 2. By doing so, the composition information presentation system 1 can more easily output the composition information of the ink corresponding to the color of the target object.

Moreover, S701 to S709 may be repeatedly executed. In this case, in S704, the combination information acquisition unit 336 acquires the corrected combination information specified by the first combination information specifying unit 339 as the initial combination information. By doing so, the combination information presentation system 1 newly identifies the corrected combination information based on the corrected combination information and the difference information, so that it is possible to present the corrected combination information closer to the color of the object. Becomes

As described above, the server device 3 according to the present invention provides the initial combination information and the difference information between the color component value of the reference object and the color component value of the target object in the first image obtained by capturing the reference object and the target object. Based on this, the modified combination information is specified and output. As a result, the server device 3 can specify the ink combination information corresponding to the color of the target object with high accuracy.

That is, the specifications of the imaging unit 25 of the terminal device 2 and the external environment when the terminal device 2 images the object are determined by the administrator of the composition information presentation system 1 of the imaging device used when the initial combination information was determined. It is different from the specifications and the external environment when the sample reference material is imaged. Therefore, if the server device 3 tries to specify the combination information based on the image in which only the object is imaged, the server device 3 corresponds to the color of the object due to the specifications of the imaging unit 25 and the influence of the external environment at the time of imaging. Ink composition information cannot be specified with high accuracy. The server device 3 according to the present invention calculates the difference information from the first image in which both the reference object and the target object are captured. By doing so, the server device 3 can calculate the difference between the color of the reference object and the color of the object without being affected by the specifications of the imaging unit 25 or the external environment at the time of imaging. It is possible to specify formulation information that represents a color closer to the color of the object.

Further, the server device 3 according to the present invention identifies the initial combination information based on the second image obtained by capturing the object. Thereby, the server device 3 according to the present invention can easily present the user with the initial combination information for generating the reference object having a color close to the color of the object.

(Modification 1)
In the above description, the first combination information specifying unit 339 specifies the correction combination information by referring to the correction combination information table 510 stored in the server storage unit 32, but is not limited to this. For example, the first combination information specifying unit 339 may specify the corrected combination information using a pre-learned discriminator.

In this case, the server storage unit 32 further stores a first discriminator that is a neural network that has been pre-learned so as to output the first learning combination information when the first learning input information is input.

The pre-learning of the first discriminator is performed by learning the relationship between the first learning input information and the first learning combination information using a known machine learning technique such as deep learning. The first learning input information is, for a plurality of sample reference objects and a plurality of sample objects, ink combination information corresponding to the color of each sample reference object, the color component value of each sample reference object, and each sample object. It is sample difference information indicating a difference from the color component value. Further, the first learning combination information is ink combination information corresponding to the color of each sample object.

The first classifier, which is a neural network, has a multi-layer structure including an input layer, an intermediate layer, and an output layer. To each node of the input layer, for example, ink combination information corresponding to the color of the sample reference material and sample difference information are input, respectively. A weighted sum based on a predetermined weight of the values output from each node of the input layer is input to each node of the intermediate layer. A weighted sum based on a predetermined weight of the values output from each node of the intermediate layer is input to each node of the output layer. The output layer outputs the input value as it is, for example.

In the first discriminator, each weight is set so that the difference between the value output by the output layer and the learning combination information is small. The weight can be set by a known method such as an error back propagation method.

In S707 of FIG. 7, the first combination information identifying unit 339 acquires the first discriminator from the server storage unit 32. Then, the first combination information identifying unit 339 outputs the combination information of the reference product and the difference information between the color component value of the reference product and the color component value of the target object when input to the first discriminator. The corrected combination information is specified by acquiring the item as the combination information of the object.

By doing so, the server storage unit 32 does not need to store the modified combination information table 510, and thus the combination information presentation system 1 reduces the storage capacity of the server storage unit 32 necessary for implementing the present invention. can do. Further, since it is not necessary to create the modified combination information table 510 in advance, the workload of the administrator of the combination information presentation system 1 is reduced.

In addition, similarly, the second combination information specifying unit 333 may be configured to calculate the initial combination information using a discriminator learned in advance. In this case, the server storage unit 32 further stores a second discriminator, which is a neural network pre-learned so as to output the second learning combination information when the second learning input information is input.

The pre-learning of the second discriminator is performed by learning the relationship between the second learning input information and the second learning combination information using the known machine learning technique as described above. The second learning input information is color component values of a plurality of sample objects. The second learning mixture information is ink mixture information corresponding to the color of each sample object.

In this case, in S605 of FIG. 6, the second combination information identification unit 333 acquires the second discriminator from the server storage unit 32. Then, the second combination information specifying unit 333 specifies the initial combination information by acquiring the combination information output when the color component value of the object is input to the second discriminator as the initial combination information.

(Modification 2)
The process in the server device 3 according to the present invention may be executed in the terminal device 2. In this case, the programs and data stored in the server storage unit 32 are stored in the terminal storage unit 22. In addition, each functional block included in the server processing unit 33 is included in the terminal processing unit 26. By doing so, the present invention can be implemented even in the terminal device 2 that does not have the terminal communication unit 21.

It will be appreciated by those skilled in the art that various changes, substitutions and modifications can be made thereto without departing from the spirit and scope of the invention. For example, the processing of each unit described above may be appropriately executed in a different order within the scope of the present invention. Further, the above-described embodiments and modified examples may be implemented in an appropriate combination within the scope of the present invention.

1 Combination Information Presentation System 3 Server Device 31 Server Communication Unit 32 Server Storage Unit 331 Second Image Acquisition Unit 332 Second Identification Unit 333 Second Combination Information Identification Unit 334 Second Output Control Unit 335 First Image Acquisition Unit 336 Acquisition of Combination Information Part 337 First specifying part 338 Difference information calculating part 339 First combination information specifying part 340 First output control part

Claims (5)

Output part,
A first image acquisition unit that acquires a first image of a reference object and an object,
A combination information acquisition unit for acquiring ink combination information corresponding to the color of the reference material,
A first specifying unit that specifies a color component value of the reference object and a color component value of the object from the first image;
A difference information calculation unit that calculates difference information indicating a difference between the identified color component value of the reference object and the color component value of the target object;
A first combination information specifying unit that specifies the combination information of the ink corresponding to the color of the target object based on the combination information and the difference information;
A first output control unit that outputs the combination information of the specified target from the output unit;
An information processing device comprising: A second image acquisition unit that acquires at least a second image of the object,
A second specifying unit that specifies a color component value of the object from the second image;
A second combination information specifying unit that specifies second combination information of the ink corresponding to the color component value of the object specified from the second image;
A second output control unit for outputting the second combination information specified by the second combination information specifying unit from the output unit;
Further equipped with,
The first image acquisition unit acquires, as the first image, an image obtained by capturing an image of the reference object and the target object created based on the second combination information output from the output unit,
The combination information acquisition unit acquires the second combination information output by the output unit,
The information processing apparatus according to claim 1. When the combination information of the ink corresponding to the color of the sample reference object and the difference information indicating the difference between the color component value of the sample reference object and the color component value of the sample object are input, the sample object Further comprising a discriminator pre-learned to output ink formulation information corresponding to the color of the object,
The first combination information identification unit outputs the combination information output when the combination information of the reference product and the difference information between the color component value of the reference product and the color component value of the target object is input to the discriminator. By specifying as the combination information of the target object, specify the combination information of the target object,
The information processing apparatus according to claim 1. A method for controlling an information processing apparatus including an output unit, comprising:
Obtaining a first image of the reference object and the object,
Obtaining ink formulation information corresponding to the color of the reference material,
Specifying a color component value of the reference object and a color component value of the object from the first image,
Calculating difference information indicating a difference between the color component value of the specified reference object and the color component value of the object,
Based on the combination information and the difference information, specify the combination information of the ink corresponding to the color of the object,
Outputting the specified combination information from the output unit,
A control method including: A control program for an information processing apparatus having an output unit,
Obtaining a first image of the reference object and the object,
Obtaining ink formulation information corresponding to the color of the reference material,
Specifying a color component value of the reference object and a color component value of the object from the first image,
Calculating difference information indicating a difference between the color component value of the specified reference object and the color component value of the object,
Based on the combination information and the difference information, specify the combination information of the ink corresponding to the color of the object,
Outputting the specified combination information from the output unit,
A control program that causes the information processing device to execute the following.

Images