CN117640841A - Color measuring system, terminal device, and information processing device - Google Patents

Abstract

The invention provides a color measurement system, a terminal device and an information processing device, which can easily determine areas to which color measurement values are applied even when a plurality of color measurement values for application to a plurality of areas exist. The color measurement system includes a terminal device including a transmitting unit that transmits a color measurement value indicating a color of a color measurement object measured by the color measurement device in association with incidental information including at least one of a captured image of the color measurement object and position information of the color measurement object, and an information processing device including: a receiving unit that receives the color measurement value and the incidental information; and a display unit that displays the color measurement value and the incidental information in a manner that associates them with each other.

Description

Color measuring system, terminal device, and information processing device

Technical Field

The invention relates to a color measurement system, a terminal device, an information processing device, and a program.

Background

Conventionally, a technique for printing with a measured color has been known. As a technique related to color measurement, patent document 1 discloses a technique of storing a reference value as a color set value of each color patch of a color chart and history information of a color measurement value of the color patch, and calculating a success rate of color reproduction by comparing the reference value and the color measurement value.

However, in the related art, it is difficult to determine a colorimetric value corresponding to a predetermined area.

Patent document 1: japanese patent laid-open publication 2016-39421

Disclosure of Invention

The present invention provides a color measurement system for solving the above-described problems, the color measurement system including a terminal device including a transmitting unit that transmits a color measurement value indicating a color of a color measurement object measured by a color measurement device and incidental information including at least one of a captured image of the color measurement object and positional information of the color measurement object, the terminal device including: a receiving unit that receives the colorimetric value and the incidental information; and a display unit that displays the color measurement value and the incidental information in a manner that associates them with each other.

The terminal device for solving the above-described problems further includes a transmitting unit that associates and transmits a color measurement value indicating a color of a color measurement object measured by the color measurement device with incidental information including at least one of a captured image of the color measurement object and position information of the color measurement object.

The information processing device for solving the above problems is provided with: a receiving unit that receives a color measurement value indicating a color of a color measurement object measured by a color measurement device and incidental information including at least one of a captured image of the color measurement object and positional information of the color measurement object; and a display unit that displays the color measurement value and the incidental information in a manner that associates them with each other.

Further, a program for solving the above-described problem causes a computer to execute a step of transmitting a color measurement value indicating a color of a color measurement object measured by a color measurement device in association with incidental information including at least one of a captured image of the color measurement object and position information of the color measurement object.

Further, a program for solving the above-described problems causes a computer to execute the steps of: that is, a receiving step of receiving a color measurement value indicating a color of a color measurement object measured by a color measurement device and incidental information including at least one of a captured image of the color measurement object and positional information of the color measurement object; and a display step of displaying the color measurement value and the incidental information in a manner of establishing a corresponding relationship.

Drawings

Fig. 1 is a schematic explanatory diagram of the color measurement system.

Fig. 2 is a block diagram of a color measurement system.

Fig. 3 is a flowchart showing the color measurement process.

Fig. 4 is a flowchart showing the color adjustment process.

Fig. 5 is a diagram showing a display example of the print data setting screen.

Fig. 6 is a diagram showing a display example of the color measurement value selection screen.

Detailed Description

Description of the embodiments

Fig. 1 is a diagram for explaining an outline of a process of a color measuring system according to an embodiment of the present invention. The color measuring system 1 performs printing of the color measuring object a based on the color measuring value of the color measuring object a. The color measuring object a is, for example, a poster, a sign, a logo, or the like, and the color measuring system is used to reproduce the color of an existing poster or the like. Specifically, first, an operator such as a management person performs color measurement of the color measurement object a using the color measurement device 10 (1). The color measurement value is transmitted to a server device 30 (2) such as a cloud server via a terminal device 20 held by the management responsible person. Then, the print manager selects, from among the color measurement values stored in the server device 30, a color measurement value (3) used for printing the printed matter corresponding to the color measurement object a in the information processing device 40. The printing device 50 prints the color measurement object a based on the color measurement value selected by the printing person in charge (4).

Fig. 2 is a schematic configuration diagram of the color measuring system 1. The color measuring system 1 includes a color measuring device 10, a terminal device 20, a server device 30, an information processing device 40, and a printing device 50. The color measuring device 10 obtains a color measurement value (Lab value). The terminal device 20 is a portable information processing device, for example, a smart phone. The color measuring device 10 and the terminal device 20 are held by a manager who performs color measurement, such as a management person. The server device 30 obtains and stores the color value and the like via the terminal device 20. The information processing device 40 acquires the colorimetric values stored in the server device 30, and instructs the printing device 50 to perform printing with the specified colorimetric values. The color measuring device 10 and the terminal device 20 perform short-range wireless communication such as bluetooth (registered trademark). The terminal device 20, the server device 30, the information processing device 40, and the printing device 50 communicate with each other via the network N. The mode of the network N is not particularly limited, and examples thereof include the internet and a home network.

The color measuring device 10 includes a communication unit 100 and a color measuring unit 102. The communication unit 100 performs short-range wireless communication with the terminal device 20. The color measuring unit 102 performs color measurement and obtains a color measurement value.

The terminal device 20 includes a communication unit 200, a processor 202, a nonvolatile memory 204, an input unit 206, a display unit 208, an imaging unit 210, a GNSS reception unit 212, and a timer unit 214. The communication unit 200 communicates with an external device according to various communication protocols, wired or wireless. The communication unit 200 performs short-range wireless communication with the color measuring device 10, and communicates with other devices such as the server device 30 via the network N. The communication unit 200 is an example of a transmitting unit and a receiving unit.

The processor 202 includes a not-shown memory CPU, ROM, RAM, etc., executes various programs recorded in the nonvolatile memory 204, and controls the respective units of the terminal device 20. The processor 202 may be configured by a single chip or a plurality of chips. For example, an ASIC may be used instead of the CPU, or the CPU and the ASIC may cooperate with each other. The nonvolatile memory 204 stores various information and various programs. The input unit 206 is a device for receiving input from a user, and is an operation button, a touch panel, or the like. The display unit 208 displays various information. The imaging unit 210 acquires an imaging image. The GNSS receiver 212 is a device for receiving a signal Global Navigation Satellite System (global navigation satellite system). The GNSS receiver 212 receives radio waves from navigation satellites and outputs signals for calculating the position of the operator. The timer 214 counts the date and time.

The information processing apparatus 40 includes a communication unit 400, a processor 402, a nonvolatile memory 404, an input unit 406, and a display unit 408. The communication unit 400 communicates with other devices such as the server device 30 and the printing device 50 via the network N. The processor 402, the nonvolatile memory 404, the input unit 406, and the display unit 408 are the same as the processor 202, the nonvolatile memory 204, the input unit 206, and the display unit 208 of the terminal device 20, respectively. The input unit 206 may be a keyboard or the like.

The printing apparatus 50 includes a communication unit 500, a processor 502, a nonvolatile memory 504, an input unit 506, a display unit 508, and a printing unit 510. The communication unit 500 communicates with other devices such as the information processing device 40 via the network N. The processor 502, the nonvolatile memory 504, the input unit 506, and the display unit 508 are the same as the processor 202, the nonvolatile memory 204, the input unit 206, and the display unit 208 of the terminal device 20, respectively. The printing unit 510 performs printing by various printing methods such as an inkjet method and an electrophotographic method.

Fig. 3 is a flowchart showing the color measurement process performed by the terminal device 20. The color measurement process is a process performed when the management person performs color measurement of the color measurement object a. The color measurement process is a process corresponding to (1) and (2) in fig. 1.

The color measurement process is started, for example, when a start button (not shown) of the color measurement process is pressed by a management responsible person. In the color measurement process, first, the processor 202 causes the display unit 208 to display an execution instruction for executing color measurement and photographing performed by the color measurement device 10 (step S100). Specifically, the display unit 208 causes the display unit 208 to display text information such as "please perform color measurement by the color measuring device, and take an image including the color measuring device and the color measuring object in the color measurement". Here, the display unit 208 is an example of an output unit, and this process is an example of a process of outputting an instruction of execution of the color measurement by the color measurement device 10 and the photographing by the photographing unit 210.

Next, the processor 202 acquires the colorimetric value from the colorimetric device 10 via the communication unit 200 (step S102). The management person sets the color measuring device 10 on the color measuring object a, and performs an operation of starting color measurement. In response, the colorimetric value obtained by the colorimetric device 10 is transmitted to the terminal device 20 via the short-range wireless communication.

Next, the processor 202 acquires a captured image obtained by the capturing unit 210 according to an operation of the input unit 206 by the management person (step S104). Further, the management person uses the terminal device 20, and when the color measuring device 10 is placed on the color measuring object a, the image including the color measuring device 10 and the color measuring object a is captured. In step S104, a captured image captured at this time is acquired.

Next, the processor 202 generates incidental information (step S106). The incidental information is information incidental to the colorimetric value and includes information associated with the colorimetric value. In the present embodiment, the incidental information includes the shooting date and time and the position information (color measurement point) in addition to the shooting image acquired in step S104. The shooting date and time is a measurement value measured by the timer 214. The position information is determined based on the received signal of the GNSS receiver 212.

Next, the processor 202 associates the colorimetric values with the incidental information, and transmits the associated relationship to the server apparatus 30 via the communication unit 200 (step S108). Thereby, the colorimetric values and the incidental information are stored in the server apparatus 30 in a corresponding relationship. In this way, the processor 202 associates and transmits the color measurement value received from the color measurement device after the execution instruction is displayed with the incidental information included in the captured image captured by the capturing section 210 after the execution instruction is output. Thus, the color measurement process is completed.

When there are a plurality of areas of different colors on the color measurement object a, the manager performs color measurement for each area. Then, the color measurement process is performed for each region. Further, the management person performs color measurement on a plurality of color measurement objects, and performs color measurement processing corresponding to the plurality of color measurement objects. By the above processing, the server device 30 stores the color measurement values and the incidental information in association with each other for each of the plurality of color measurement objects. When there are a plurality of areas of different colors on the color measurement target, the color measurement value and the incidental information are associated with each other and stored for each area.

As described above, since a plurality of colorimetric values are stored in the server device 30, there is a possibility that the colorimetric values of different areas may be erroneously applied when printing a colorimetric object. In the present embodiment, the following processing can prevent the erroneous application as described above.

Fig. 4 is a flowchart showing the color adjustment process performed by the information processing apparatus 40. The color adjustment process is a process performed when the print person in charge performs printing corresponding to the color measurement object a. The color adjustment process is a process corresponding to (3) and (4) of fig. 1.

In the color adjustment process, first, the processor 402 displays map information on the display section 408 (step S200). In addition, map information is stored in advance in the nonvolatile memory 404 of the information processing apparatus 40. The processor 402 refers to the position information indicated by the incidental information corresponding to the color measurement values stored in the server apparatus 30, and displays map information including the range of the color measurement positions corresponding to the plurality of color measurement values, respectively.

Next, when the print manager designates a range including a predetermined color measurement object a to be printed next on the map displayed on the display unit 408, the processor 402 receives the range designated by the print manager via the input unit 406. Then, the processor 402 sets the range as the colorimetric value specification range (step S202).

For example, the server device 30 stores therein a color measurement value corresponding to a color measurement location in the region X and a color measurement value corresponding to a color measurement location in the region Y, which are measured on the same day. In this case, in step S200, map information of the range including the region X and the region Y is displayed. Then, when the print manager reserves to print a color measurement object corresponding to a color measurement value obtained at a color measurement point in the region X, the print manager designates a range including the region X but not including the region Y through the input unit 406. In response to this, in step S202, the range including the region X and not including the region Y is set as the color measurement value specification range.

Next, the processor 402 displays the print data setting screen on the display unit 408 (step S204). The print data setting screen is a screen for setting the size of the color measurement object a at the time of printing, the print position on the print medium (for example, web), and the color information by the print person through the operation of the input unit 406. The shape of the color measurement object a and the color information (initial value) of each region included in the color measurement object a are provided by, for example, a printing client, and registered in the information processing device 40 in advance.

Fig. 5 is a diagram showing an example of a print data setting screen. On the print data setting screen 600, a schematic image of print data corresponding to the color measurement object a is displayed. For example, when the object a is a rectangle composed of two upper and lower colors, as shown in fig. 5, a schematic image 610 of print data of a rectangular shape of two upper and lower colors is displayed. The upper region 610a and the lower region 610b of the schematic image 610 are displayed in colors corresponding to initial values of color information. However, the color indicated by the initial value of the color information may be different from the color of each region of the actual color measurement object a. This is because, for example, the initial value of the color information is a color value in the captured image of the color measurement object a, and is different from the actual color value depending on the amount of light. The color deviation is corrected by the processing in step S206 and the following.

After the process of step S204, the processor 402 stands by until the printing person selects a partial region of the color measurement target via the input unit 406 (no in step S206), and when the partial region is selected (yes in step S206), the process proceeds to step S208. Here, the partial region is a partial range within the color measurement object, and is a range expressed by the same color. In the schematic image 610 shown in fig. 6, the upper region 610a and the lower region 610b become partial regions, respectively. For example, when the print manager selects the color selection button 620 in a state where the lower area 610b is selected, the processor 402 determines that the lower area 610b is selected.

Then, in step S208, the processor 402 acquires (receives) the colorimetric values included in the colorimetric value specification range and the incidental information corresponding thereto from the server apparatus 30 via the communication unit 400. For example, as the color measurement value specification range, when the region X is specified, the color measurement value in which the color measurement point is included in the region X is obtained.

Next, the processor 402 displays the colorimetric value selection screen on the display section 408 (step S210). Here, the color measurement value selection screen is a screen for selecting a color measurement value to be applied to a selected partial region by the print person in charge through an operation of the input unit 406. In the color measurement value selection screen, color patches indicating colors corresponding to the color measurement values acquired in step S208 are displayed. That is, in the color measurement value selection screen, color patches of color measurement values corresponding to the color measurement points within the range specified on the map information are displayed.

Fig. 6 is a diagram showing an example of a colorimetric value selection screen. In the left column of the color measurement value selection screen 700, color patches 710a to 710d corresponding to the color measurement values set as the color measurement points within the color measurement value specification range acquired in step S208 are displayed. Here, when the color patch 710b is selected, the accompanying information corresponding to the selected color patch 710b is displayed in the right column. Specifically, in the right column, the color measurement value 721 and the shooting date and time 722 corresponding to the selected color patch 710b are displayed. In the right column, a map image 723 and a photographed image 724 representing a color measurement point corresponding to the selected color patch 710b are displayed. In this way, the color measurement value and the incidental information are displayed in a manner of establishing a correspondence.

In this way, not only the information of the color shown in the color patch 710b but also the information in which the color measurement value is associated as the incidental information are displayed, and therefore the print manager can select the color measurement value in the partial area to be selected based on these information. In the case where only the information of the color is selected, and in the case where there are a plurality of colorimetric values whose hues are similar, there is a possibility that an erroneous colorimetric value is selected. In contrast, in the present embodiment, since the color measurement points are shown as described above, the color measurement values in, for example, S hospitals and T beauty parlors can be clearly distinguished.

As shown in the photographed image 724 of fig. 6, the photographed image includes an image of the color measuring device 10 and an image of the color measuring object a. Therefore, the print person in charge can accurately grasp which partial region of the color measurement object a the color measurement value corresponds to by confirming the positional relationship between the color measurement device 10 and the color measurement object a in the captured image 724. For example, in the example shown in fig. 6, in the captured image 724, it can be visually confirmed that the color measuring device 10 is placed below the color measuring object a, and thus the color measuring value (color patch 710 b) in the selection is the color measuring value of the lower region of the color measuring object a.

The printing person in charge determines the color measurement value to be applied by selecting the color scale and confirming the incidental information thereof. Then, when the color measurement value is determined, the print manager selects the "apply color" button 730 in a state where the color patch is selected. In response to this, an application instruction is input to the information processing apparatus 40.

In fig. 6, after the processing of step S210, the processor 402 stands by before an application instruction is input in step S212 (no in step S212), and when an application instruction is input (yes in step S212), the processing proceeds to step S214. In step S214, the processor 402 converts the display screen into the print data setting screen 600, and displays the schematic image 610 colored with the color measurement value related to the application instruction on the print data setting screen 600. In this way, the print manager can confirm the state of being colored with the selected colorimetric value in the schematic image 610.

Next, the processor 402 confirms whether or not a print instruction is input via the input unit 406 (step S216). If the print instruction is not input (no in step S216), the processor 402 advances the process to step S206. In this way, by repeating the processing of step S206 to step S216, the colorimetric values are applied to all the partial areas included in the colorimetric object a. When a print instruction is input (yes in step S216), the processor 402 advances the process to step S218. In step S218, the processor 402 transmits a print request to the printing apparatus 50 together with print data using the color measurement values applied to the partial areas as color information of the partial areas. In response to this, the printing device 50 performs printing based on the print data, and obtains a print corresponding to the color measurement object. Thus, the color adjustment process is completed.

As described above, in the color measuring system 1 according to the present embodiment, the incidental information is recorded together with the color measurement value, and the color measurement value and the incidental information are displayed in association with each other at the time of printing. Therefore, even in the case where there are a plurality of colorimetric values for application to a plurality of areas, the print manager can easily determine the area to which each colorimetric value is applied.

Additional note

The above embodiment is an example for implementing the present invention, and various other embodiments can be adopted.

As a first modification of this, in the above-described embodiment, the colorimetric values and the incidental information are stored in the server apparatus 30, but the location where these pieces of information are stored is not limited to the location of the embodiment. As other examples, the colorimetric values and incidental information may also be stored in the information processing apparatus 40. Further, the color measuring device and the terminal device may be integrally provided, and the imaging unit 210 may be provided as a device independent of the integrated device.

As a second modification, the color measurement value selection screen displays the color measurement value and the incidental information so as to be associated with each other, and the specific display mode for realizing the same is not limited to the embodiment mode. For example, the color measurement value, the color measurement place, and the shooting date and time may be displayed in a list, and when the color measurement value is selected, the shooting image may be displayed.

As a third modification, the incidental information may include at least one of a captured image of the color measurement object and position information. For example, even if only an image is captured and only position information is obtained, a colorimetric value to be applied to a predetermined region can be extracted from among a plurality of colorimetric values based on the information. On the other hand, the incidental information may include text information inputted by the management responsible person. For example, when the management responsible person performs color measurement on each of a plurality of floors in the same building, information on the floor on which the color measurement is performed is input as text information. Thus, the printing manager can also refer to the information input by the management manager to determine the measured value.

A fourth modification will be described. In the present embodiment, in the color measurement process shown in fig. 3, the execution instruction of the color measurement by the color measurement device 10 and the image capturing by the image capturing unit 210 is displayed on the display unit 208, but the execution instruction may be output from the output unit, and the mode is not limited to the mode of the embodiment. As another example, in the case where the terminal device 20 is provided with a speaker, the execution instruction may be output by voice.

As a fifth modification, the information processing apparatus 40 may automatically extract a color measurement value to be applied to the selected partial region and display a schematic image reflecting the color measurement value when the partial region is selected on the print data setting screen 600. Specifically, in the information processing device 40, when the colorimetric value is stored in the server device 30, the processor 402 determines a partial image of the colorimetric object in the print data corresponding to the colorimetric value. The processor 402 then associates the color measurement values with the partial areas in the print data and stores the associated color measurement values in the nonvolatile memory 404. Thus, when a partial region is selected, the processor 402 can display a schematic image to which a color measurement value corresponding to the selected partial region is applied.

In this way, the process of associating the partial area with the colorimetric value can also be realized in the following manner. That is, first, the processor 402 extracts an image of the color measuring device from the image feature amount in the captured image, and determines an area within the color measuring object corresponding to the color measuring device as an area corresponding to the color measuring value based on the positional relationship between the image of the color measuring device and the image of the color measuring object. Then, the processor 402 performs matching of a partial region in the print data and a region in the captured image corresponding to the partial region based on the feature amount of the region. Then, the processor 402 establishes a correspondence between the partial area in the print data of the same area and the color measurement value of the area in the captured image. The extraction of the color measuring device may be realized by using a deep learning technique.

As another example, the information processing device 40 may automatically extract the color measurement value to be applied to each partial region included in the print data corresponding to the color measurement object and display a schematic image reflecting the color measurement value when the print data setting screen 600 is displayed. The processing in this case may be realized by using a technique of matching and deep learning performed by the feature values of the image, similarly to the above.

The present invention can also be applied as a program and a method executed by a computer. In addition, the system, program, and method described above may be implemented as a single device, or may be implemented by means of components provided in a plurality of devices, and various modes are included. Further, the present invention can be appropriately modified so that a part is software and a part is hardware. Furthermore, the present invention is also applicable to a recording medium that is a program for controlling a system. Of course, the recording medium of the program may be a magnetic recording medium or a semiconductor memory, and any recording medium developed in the future may be considered in the same manner.

The above-described embodiments are not intended to limit the invention. In the embodiment, since a plurality of inventions having different effects are included, one problem or effect read from the embodiment is not a problem or effect for all inventions included in the embodiment.

Symbol description

1 … color measurement system; 10 … color measuring device; 20 … terminal device; 30 … server means; 40 … information processing means; 50 … printing means; 100. 200, 400, 500 … communication units; 102 … color measuring part; 202. 402, 502 … processor; 204. 404, 504 … non-volatile memory; 206. 406, 506 … inputs; 208. 408, 508 … displays; 210 … shooting unit; 212 … GNSS receiver; 214 … timing part; 510 … printing.

Claims (8)

1. A color measuring system includes a terminal device and an information processing device,

the terminal device includes a transmitting unit that associates and transmits a color measurement value indicating a color of a color measurement object measured by a color measurement device with incidental information including at least one of a captured image of the color measurement object and position information of the color measurement object,

the information processing device is provided with:

a receiving unit that receives the colorimetric value and the incidental information;

and a display unit that displays the color measurement value and the incidental information in a manner that associates them with each other.

2. The color measurement system of claim 1, wherein,

the incidental information includes the captured image,

the terminal device further comprises an output unit,

the output section outputs an execution instruction of the color measurement device and the photographing of the photographing section,

the transmitting unit of the terminal device associates and transmits the colorimetric value acquired from the color measuring device after the execution instruction is output with the incidental information included in the captured image captured by the capturing unit after the execution instruction is output.

3. The color measuring system according to claim 1 or 2, wherein,

the incidental information includes the captured image,

the captured image includes an image of the color measuring device representing the color measuring object among the colors measured by the color measuring device,

the display unit of the information processing apparatus displays, when a part of the color measurement target is selected in accordance with a user operation, the color measurement value corresponding to the part determined based on a positional relationship between the image of the color measurement apparatus and the image of the color measurement target included in the captured image.

4. The color measuring system according to claim 1 or 2, wherein,

the incidental information includes the captured image,

the captured image includes an image of the color measuring device representing the color measuring object among the colors measured by the color measuring device,

the display unit of the information processing device displays the color measurement values of the respective areas in the color measurement object, which are determined based on the positional relationship between the image of the color measurement device and the image of the color measurement object included in the captured image, in association with the respective areas.

5. The color measurement system of claim 1, wherein,

the incidental information includes the positional information,

the display unit of the information processing apparatus displays map information, and

when a range on the map information is specified according to a user operation, the color measurement value corresponding to the position information within the specified range is displayed.

6. A terminal device, wherein,

the color measuring device is provided with a transmitting unit which associates and transmits a color measurement value indicating a color of a color measuring object measured by a color measuring device with incidental information including at least one of a captured image of the color measuring object and position information of the color measuring object.

7. The terminal device of claim 6, wherein,

the incidental information includes the captured image,

the terminal device further includes an output unit that outputs an instruction to execute the color measurement by the color measuring device and the photographing by the photographing unit,

the transmitting unit associates and transmits the colorimetric value received from the color measuring device after the execution instruction is output with the incidental information included in the captured image captured by the capturing unit after the execution instruction is output.

8. An information processing device is provided with:

a receiving unit that receives a color measurement value indicating a color of a color measurement object measured by a color measurement device and incidental information including at least one of a captured image of the color measurement object and positional information of the color measurement object;

and a display unit that displays the color measurement value and the incidental information in a manner that associates them with each other.