TW201936113A - Information processing device and program - Google Patents

Abstract

An information processing device comprising: a means for acquiring colorimetric data that includes first through third color component values representing the skin pigment of a test subject; a means for acquiring from a camera an image of the skin of the test subject; a means for generating a display image for display on a display device on the basis of the image data; a means for converting the first through third color component values respectively to first through third pigment parameters related to a substance quantity representing an optical characteristic of the skin; a means for changing at least one of the first through third pigment parameters in accordance with an instruction from an operator; a means for converting the changed first through third pigment parameters respectively to first through third color component values; and a means for changing the display image on the basis of the converted first through third color component values.

Description

Information processing device, program

The present invention relates to information processing apparatus and programs.

In recent years, consumers who choose cosmetics that correspond to the state of the skin have an increasing tendency. In order to recommend products suitable for such consumers, it is more effective to recommend cosmetics that conform to the state of the individual's skin. Therefore, a technique for quantifying the skin condition of a consumer and estimating the state of the skin after using the cosmetic is sought.

For example, Japanese Patent No. 3727807 discloses a model for estimating the amount of components (melanin and hemoglobin) in the skin based on the color measurement values of the skin.

Japanese Patent No. 3798550 discloses a model for estimating the apparent absorbance of components (melanin, oxidized hemoglobin, reduced hemoglobin, and dermis) in the skin based on the skin reflection spectrum.

[The problem that the invention wants to solve]

The consumer's desire to purchase can be promoted by prompting the consumer who selects the cosmetic product to change the composition of the skin after using the recommended cosmetic and the color of the skin resulting from the change. In particular, in order to promote the consumer's desire to purchase, it is effective to display a simulated image of the color reproduction of the skin corresponding to the change in the composition of the skin after the recommended cosmetic.

However, the general colorimetric value is represented by at least three parameters (for example, the color component values of the XYZ color system). Since the model of Japanese Patent No. 3727807 has two parameters (melanin and hemoglobin) corresponding to the components in the skin, the color measurement value cannot be calculated from the components in the skin. Therefore, the above simulated image cannot be produced.

In Japanese Patent No. 3798550, the relationship between the color measurement value and the components in the skin is not specified in the model. Therefore, the above simulated image cannot be produced.

It is an object of the present invention to provide a simulated image that reproduces the skin tone corresponding to the components in the skin.
[Technical means to solve the problem]

One aspect of the present invention is an information processing apparatus having:
Obtaining a mechanism for measuring color data including a first color component value to a third color component value of a pigment of a skin of a subject;
a mechanism for obtaining image data of the above-mentioned subject's skin from a camera;
Generating a display image displayed on the display based on the image data;
Converting the first color component value to the third color component value into a mechanism corresponding to the first coloring parameter to the third coloring parameter relating to the mass of the light characteristic of the skin;
a mechanism for changing at least one of the first coloring parameter to the third coloring parameter according to an operator's instruction;
a mechanism for converting the first coloring parameter to the third coloring parameter after the change into the first color component value to the third color component value; and the first color component value to the third color component after the conversion The value is the mechanism for changing the above displayed image.
[Effects of the Invention]

According to the present invention, it is possible to provide a simulated image of the skin color corresponding to the components in the skin.

Hereinafter, an embodiment of the present invention will be described in detail based on the drawings. In the drawings for explaining the embodiments, the same components are denoted by the same reference numerals, and the description thereof will not be repeated.

(1) The composition of the information processing system explains the composition of the information processing system. Fig. 1 is a block diagram showing the configuration of an information processing system of the present embodiment.

As shown in FIG. 1, the information processing system 1 includes a client device 10 and a color measuring device 20.
The client device 10 and the colorimetric device 20 are connected to each other by wire or wirelessly.

The client device 10 is an example of an information processing device that performs information processing using the measurement result of the color measuring device 20. The client device 10 is, for example, a smart phone, a tablet terminal, or a personal computer.

The color measuring device 20 is configured to measure skin color.

(1-1) Configuration of Client Device The configuration of the client device 10 will be described. 2 is a block diagram showing the construction of the client device 10.

As shown in FIG. 2, the client device 10 includes a memory device 11, a processor 12, an input/output interface 13, a communication interface 14, a camera 15, and a display 16.

The memory device 11 is configured to memorize programs and materials. The memory device 11 is, for example, a combination of a ROM (Read Only Memory), a RAM (Random Access Memory), and a storage device (for example, a flash memory or a hard disk).

The program includes, for example, the following programs.
・OS (Operating System) program and application (for example, web browser) that executes information processing

The information includes, for example, the following information.
・Database for reference in information processing ・Information obtained by performing information processing (ie, execution results of information processing)

The processor 12 is configured to implement the functions of the client device 10 by activating a program stored in the memory device 11. The processor 12 is an example of a computer.

The input/output interface 13 is configured to acquire an instruction from a user connected to the input device of the client device 10, and output the information to an output device connected to the client device 10.
The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof.

The communication interface 14 is configured to control communication between the client device 10 and the colorimetric device 20.

The camera 15 is configured to acquire image data (for example, image data corresponding to an image of an subject who is a subject of color measurement by the color measuring device 20).

Display 16 is configured to display a display image produced by processor 12. The display 16 is, for example, an LCD (Liquid-Crystal-Display) or an OEL (Organic Electro Luminescence) display.

(2) Outline of the present embodiment The outline of this embodiment will be described. Fig. 3 is an explanatory view showing an outline of the embodiment.

As shown in FIG. 3, the color measuring device 20 obtains colorimetric data by measuring the color of the skin of the subject OBJ. The color measurement data includes a first color component value to a third color component value indicating the color of the skin of the subject OBJ.

The client device 10 acquires image data of an image of the skin of the subject OBJ and colorimetric data obtained by the color measuring device 20.
The client device 10 displays the display image IMG0 of the skin of the subject OBJ based on the image data.

The client device 10 calculates, based on the first color component value to the third color component value included in the colorimetric data, a mass quality related to the light characteristic (for example, at least one of light reflection characteristics and light absorption characteristics) of the skin. The first pigment parameter to the third pigment parameter.

The operator of the client device 10 gives an instruction to the client device 10 to change at least one of the first coloring parameter to the third coloring parameter.
The client device 10 changes at least one of the first coloring parameter to the third coloring parameter in accordance with an instruction from the operator. The client device 10 converts the changed first to third color parameter parameters to the third color component value to the third color component value. The client device 10 displays the display image IMG1 corresponding to the converted first color component value to third color component value based on the converted first color component value to third color component value.

As described above, the operator of the client device 10 can change the color of the skin of the subject OBJ by giving only the instruction to change at least one of the first coloring parameter to the third coloring parameter to the client device 10. Corresponding display image IMG1.

(3) Information Processing The information processing of this embodiment will be described. Fig. 4 is a flow chart showing the information processing of this embodiment. Fig. 5 is a view showing an outline of information processed in the information processing of the embodiment. Fig. 6 is a view showing an example of a screen displayed in the information processing of the embodiment.

As shown in FIG. 4, the client device 10 performs acquisition of colorimetric data (S100).
Specifically, the processor 12 obtains colorimetric data from the colorimetric device 20. The color measurement data includes a first color component value to a third color component value indicating the color of the skin of the subject OBJ. The first color component value to the third color component value are, for example, color component values (X0, Y0, Z0) of the XYZ color system (FIG. 5).
The processor 12 memorizes the acquired colorimetric data in the memory device 11.

After step S100, the client device 10 performs acquisition of image data (S101).
Specifically, the camera 15 produces image data of the skin of the subject OBJ by photographing the skin of the subject OBJ. The image data includes, for example, color component values of the RGB color space (hereinafter referred to as "display color information").
The processor 12 memorizes the image data generated by the camera 15 in the memory device 11.

After step S101, the client device 10 performs generation of a display image (S102).
Specifically, the processor 12 converts the first color component value to the third color component value (X0, Y0, Z0) included in the color measurement data stored in the memory device 11 into the display color of the RGB color space in step S101. Information (R0, G0, B0) (Figure 5).

The processor 12 converts the first color component value to the third color component value (X0, Y0, Z0) included in the colorimetric data into the first coloring parameter to the third coloring parameter (Pa0, Pb0, Pc0) using Equation 1. (Figure 5).
[Number 1]

・k _ax , k _bx , k _cx : coefficient based on the density and _{modification of} collagen fibers · k _ay , k _by , k _cy : coefficient based on the amount of melanin in the skin · k _az , k _bz , k _cz : based on skin The coefficient of the amount of hemoglobin, j _a , j _b , j _c : fixed number

The first coloring parameter Pa is a parameter relating to the light scattering level of the dermis of the skin of the subject OBJ.
The second pigment parameter Pb is a parameter relating to the light absorption level of the skin of the subject OBJ.
The third pigment parameter Pc is a parameter relating to the light absorption level of the dermis of the skin of the subject OBJ.

An image based on the image data stored in the memory device 11 in step S101 and the display color information (R0, G0, B0) of the converted RGB color space (ie, the image of the skin of the subject OBJ) is generated ( Figure 5).
Processor 12 displays picture P100 (FIG. 6) on display 16.

As shown in FIG. 6, the screen P100 includes a display object A100, key objects B100a to B100c, and an image object IMG100.
In the display object A100, the first color component value to the third color component value (X0, Y0, Z0) included in the color measurement data are displayed. The value displayed by the display object A100 corresponds to the display color information (R0, G0, B0) of the converted RGB color space in step S102.
The button object B100a receives an object for changing the user's instruction of the first coloring parameter Pa related to the light scattering level of the dermis. The value of the first color element parameter Pa is determined according to the position of the button object B100a.
The button object B100b receives an object for instructing a user to change the second color element parameter Pb related to the light absorption level of the skin. The value of the second color element parameter Pb is determined based on the position of the button object B100b.
The button object B100c receives an object for changing the user's instruction of the third color element parameter Pc related to the light absorption level of the dermis. The value of the third color element parameter Pc is determined according to the position of the button object B100c.
The image object IMG 100 displays an image of the skin of the subject OBJ generated in step S102. The color of the image of the skin of the subject OBJ is determined based on the display color information (R0, G0, B0) of the converted RGB color space in step S102.

After step S102, the client device 10 performs a change of parameters (S103).
Specifically, when the operator operates the button object B 100a, the processor 12 changes the first color element parameter Pa to a value corresponding to the position of the button object B 100a.
When the operator operates the button object B100b, the processor 12 changes the second color element parameter Pb to a value corresponding to the position of the button object B100b.
When the operator operates the button object B100c, the processor 12 changes the third color element parameter Pc to a value corresponding to the position of the button object B100c.
Thereby, the values of the first coloring matter parameter to the third coloring matter parameter are corrected from (Pa0, Pb0, Pc0) to (Pa1, Pb1, Pc1) (FIG. 5).

After step S103, the client device 10 performs a change of the display image (S104).
Specifically, the processor 12 converts the changed first to third color parameter values to the third color component value (X1, Y1, Z1) in the first coloring parameter to the third coloring parameter in the step S103 using Equation 1 (FIG. 5). ).
The processor 12 converts the first color component value to the third color component value (X1, Y1, Z1) into display color information (R1, G1, B1) of the RGB color space (FIG. 5).
An image based on the image data stored in the memory device 11 in step S101 and the display color information (R1, G1, B1) of the converted RGB color space (that is, an image corresponding to the changed pigment parameter) is generated. (Figure 5).
Processor 12 displays picture P102 (FIG. 6) on display 16.

As shown in FIG. 6, the screen P102 includes a display object A102, key objects B100a to B100c, and an image object IMG102.
In the display object A102, the first color component value to the third color component value (X1, Y1, Z1) corresponding to the changed coloring parameter in step S103 are displayed. The value displayed on the display object A102 corresponds to the display color information (R1, G1, B1) of the RGB color space converted in step S104.
The image object IMG 102 corresponds to the coloring parameter changed in step S103.

According to the present embodiment, three kinds of color component values (for example, color component values of the XYZ color system) and three kinds of pigment parameters (for example, skin reflection characteristics (for example, parameters regarding light scattering level of the dermis) are used. The model (Formula 1) of the relationship between the absorption characteristics of the skin (for example, the combination of the parameters of the light absorption level of the epidermis and the parameters of the light absorption level of the dermis), the operator only gives three changes. The color component value corresponding to the changed pigment parameter can be obtained by instructing at least one of the pigment parameters (steps S103 to S104). Thereby, a simulated image of the skin color corresponding to the components in the skin (for example, the image object IMG 102 of FIG. 6) can be provided.

(4) Modification A modification of this embodiment will be described. The same description as in the embodiment is omitted.

(4-1) Change 1
Modification 1 of the present embodiment will be described.

In the first modification, in step S103 (FIG. 4), the operator gives an instruction to change at least one of the first color component value to the third color component value (X0, Y0, Z0) displayed on the display object A100. Then, the processor 12 calculates the first color element parameter Pa to the third color element parameter Pc corresponding to the changed first color component value to third color component value (X0, Y0, Z0) using Equation 1.

According to the first modification, when the operator of the client device 10 gives an instruction to change at least one of the first color component value to the third color component value, the pigment of the skin of the subject OBJ can be provided. The display object A102 of the first coloring matter parameter Pa to the third coloring matter parameter Pc corresponding to the change is displayed.

(4-2) Variation Example 2 of the second embodiment will be described. The variation example 2 is a modification example of the first coloring parameter to the third coloring parameter regarding the mass of the skin which is the absorption property of the skin. Fig. 7 is a view showing an example of a screen displayed in the information processing of Modification 2.

The first coloring parameter Pa of the second modification is a parameter regarding the amount of oxidized hemoglobin in the skin of the subject OBJ.
The second pigment parameter Pb is a parameter relating to the light absorption level of the skin of the subject OBJ.
The third pigment parameter Pc is a parameter relating to the amount of reduced hemoglobin in the skin of the subject OBJ.

The processor 12 displays the picture P110 (FIG. 7) on the display 16 in step S102 (FIG. 4).

As shown in FIG. 7, the screen P110 includes a display object A100, key objects B110a to B110c, and an image object IMG100.
The button object B110a receives an object for changing the user's instruction of the first coloring parameter Pa related to the amount of oxidized hemoglobin. The value of the first color element parameter Pa is determined based on the position of the button object B110a.
The button object B110b receives an object for changing the user's instruction of the second color element parameter Pb related to the light absorption level of the skin. The value of the second color element parameter Pb is determined based on the position of the button object B110b.
The button object B110c receives an object for changing the user's instruction of the third color element parameter Pc related to the amount of reduced hemoglobin. The value of the third color element parameter Pc is determined based on the position of the button object B110c.

According to Modification 2, three kinds of color component values (for example, color component values of the XYZ color system) are used, and three kinds of pigment parameters (for example, parameters related to the amount of oxidized hemoglobin and light absorption levels of the epidermis are used). A model for the relationship between parameters and parameters related to the amount of reduced hemoglobin. Thereby, the operator can obtain the color component value corresponding to the changed coloring parameter only by giving an instruction to change at least one of the three kinds of pigment parameters (steps S103 to S104). Thereby, a simulated image of the skin color corresponding to the components in the skin (for example, the image object IMG 102 of FIG. 7) can be provided.

(5) Summary of the present embodiment This embodiment is summarized.

The first aspect of the present embodiment is an information processing device (for example, client device 10) having:
Obtaining a mechanism including colorimetric data indicating a first color component value to a third color component value of a pigment of the skin of the subject OBJ (for example, the processor 12 performing the process of step S100);
a mechanism for acquiring image data of the skin of the subject OBJ from the camera 15 (for example, the processor 12 performing the processing of step S101);
Generating a display image displayed on the display 16 based on the image data (for example, the processor 12 performing the processing of step S102);
The first color component value to the third color component value are respectively converted into a first coloring matter parameter Pa and a second coloring matter parameter Pb related to light characteristics (for example, at least one of light reflection characteristics and light absorption characteristics) of the skin. And a mechanism of the third coloring parameter Pc (for example, the program 12 for performing the processing of step S102);
a mechanism for changing at least one of the first coloring parameter Pa to the third coloring parameter Pc (for example, the program 12 for performing the processing of step S103) according to an instruction of the operator;
a mechanism for converting the changed first coloring parameter Pa to third coloring parameter Pc into a first color component value to a third color component value (for example, a program 12 for performing the process of step S104); and based on the converted The one color component value to the third color component value are used to change the display image (for example, the program 12 for executing the process of step S104).

According to the first aspect, the three color component values (the first color component value to the third color component value) are converted into three kinds of pigment parameters related to the mass of the light indicating the light characteristics of the skin (the first coloring parameter Pa ~ Model of the third pigment parameter Pc). The operator only needs to give an instruction to change at least one of the three pigment parameters to obtain a color component value corresponding to the changed pigment parameter. Thereby, a simulated image of the skin color corresponding to the components in the skin can be provided.

A second aspect of the present embodiment is an information processing apparatus, wherein the first coloring parameter parameter is a parameter relating to a light scattering level of the dermis, and the second coloring parameter parameter is a parameter relating to a light absorption level of the epidermis, The third pigment parameter is a parameter related to the light absorption level of the dermis.

According to the second aspect, the operator only needs to change the reflective properties of the skin (for example, the light scattering level of the dermis) and the absorption characteristics of the skin (for example, the light absorption level of the epidermis and the light absorption level of the dermis). The color component value corresponding to the changed pigment parameter can be obtained by the instruction of one.

In the third aspect of the present embodiment, the first coloring matter parameter Pa includes an information processing device based on the density of the collagen fibers and the coefficient of the modification.

According to the third aspect, when the operator gives an instruction to change the light characteristics, the color component values corresponding to the density and the modification of the collagen fibers can be obtained.

A fourth aspect of the present embodiment is an information processing apparatus, wherein the first pigment parameter is a parameter relating to the amount of oxidized hemoglobin in the skin, and the second pigment parameter is a parameter relating to the light absorption level of the epidermis; The pigment parameter is a parameter related to the amount of reduced hemoglobin in the skin.

According to the fourth aspect, the operator only needs to give an instruction to change the absorption characteristics of the skin (for example, the amount of oxidized hemoglobin in the skin, the light absorption level of the epidermis, and the amount of reduced hemoglobin in the skin). A color component value corresponding to the changed pigment parameter can be obtained.

The fifth aspect of the present embodiment is an information processing device in which the first color component value to the third color component value respectively include an X color component value, a Y color component value, and a Z color component value of the XYZ color system.

According to the fifth aspect, when the operator gives an instruction to change the light characteristics, the X color component value, the Y color component value, and the Z color component value of the XYZ color system corresponding to the instruction can be obtained.

In the sixth aspect of the present embodiment, the information processing apparatus that changes the display image by converting the X color component value, the Y color component value, and the Z color component value into image signals of the RGB color space.

According to the sixth aspect, if the operator gives an instruction to change the light characteristic, the display image corresponding to the instruction can be presented.

The seventh aspect of the present embodiment is an information processing device that acquires colorimetric data from a colorimetric device that performs colorimetric measurement on the skin of the subject OBJ.

According to the seventh aspect, the color component value corresponding to the instruction of the colorimetric data obtained by the self-coloring device 20 can be obtained.

The eighth aspect of the present embodiment is a program for causing a computer (for example, the processor 12) to function as each of the above-described mechanisms.

(6) Other variations

The memory device 11 can also be connected to the client device 10 via a network (not shown).

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited to the above embodiments. Further, various modifications and changes can be made without departing from the spirit and scope of the invention. Further, the above embodiment and each modification can be arbitrarily combined.

1‧‧‧Information Processing System

10‧‧‧Client device

11‧‧‧ memory device

12‧‧‧ Processor

13‧‧‧Input and output interface

14‧‧‧Communication interface

15‧‧‧ camera

16‧‧‧ display

20‧‧‧ Color measuring device

A100‧‧‧Display objects

A102‧‧‧Display objects

B100a～B100c‧‧‧ button object

B110a～B110c‧‧‧ button object

IMG0‧‧‧Display image

IMG1‧‧‧ display image

IMG100‧‧‧Image objects

IMG102‧‧‧Image objects

OBJ‧‧‧ Subjects

P100‧‧‧ screen

P102‧‧‧ screen

P110‧‧‧ screen

S100～S104‧‧‧Steps

Fig. 1 is a block diagram showing the configuration of an information processing system of the present embodiment.

2 is a block diagram showing the construction of the client device 10.

Fig. 3 is an explanatory view showing an outline of the embodiment.

Fig. 4 is a flow chart showing the information processing of this embodiment.

Fig. 5 is a view showing an outline of information processed in the information processing of the embodiment.

Fig. 6 is a view showing an example of a screen displayed in the information processing of the embodiment.

Fig. 7 is a view showing an example of a screen displayed in the information processing of Modification 2.

Claims (8)

An information processing device having: Obtaining a mechanism for measuring color data including a first color component value to a third color component value of a pigment of a skin of a subject; a mechanism for obtaining image data of the above-mentioned subject's skin from a camera; Generating a display image displayed on the display based on the image data; Converting the first color component value to the third color component value into a mechanism corresponding to the first coloring parameter to the third coloring parameter relating to the mass of the light characteristic of the skin; a mechanism for changing at least one of the first coloring parameter to the third coloring parameter according to an instruction of an operator; a mechanism for converting the first coloring parameter to the third coloring parameter after the change into the first color component value to the third color component value; The mechanism for changing the display image based on the converted first to third color component values. The information processing device of claim 1, wherein The first pigment parameter is a parameter related to the light scattering level of the dermis; The second pigment parameter is a parameter related to the light absorption level of the epidermis; The third pigment parameter is a parameter related to the light absorption level of the dermis. The information processing device of claim 2, wherein The first coloring parameter includes a coefficient based on the density and modification of the collagen fiber. The information processing device of claim 1, wherein The first pigment parameter is a parameter related to the amount of oxidized hemoglobin in the skin, The second pigment parameter is a parameter related to the light absorption level of the epidermis; The third pigment parameter is a parameter related to the amount of reduced hemoglobin in the skin. The information processing apparatus of any one of claims 1 to 4, wherein Each of the first color component value to the third color component value includes an X color component value, a Y color component value, and a Z color component value of the XYZ color system. The information processing device of claim 5, wherein The changing means changes the display image by converting the X color component value, the Y color component value, and the Z color component value into image signals of an RGB color space. The information processing device of any one of claims 1 to 6, wherein The mechanism for obtaining the above color measurement data obtains the above color measurement data from a color measurement device that performs color measurement on the skin of the above-mentioned subject. A program for causing a computer to function as each of the items of any one of claims 1 to 7.