WO2019131013A1 - 情報処理装置、プログラム - Google Patents

情報処理装置、プログラム Download PDF

Info

Publication number
WO2019131013A1
WO2019131013A1 PCT/JP2018/044592 JP2018044592W WO2019131013A1 WO 2019131013 A1 WO2019131013 A1 WO 2019131013A1 JP 2018044592 W JP2018044592 W JP 2018044592W WO 2019131013 A1 WO2019131013 A1 WO 2019131013A1
Authority
WO
WIPO (PCT)
Prior art keywords
color component
parameter
skin
component value
pigment
Prior art date
Application number
PCT/JP2018/044592
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
勇二 舛田
Original Assignee
株式会社 資生堂
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社 資生堂 filed Critical 株式会社 資生堂
Priority to CN201880072286.0A priority Critical patent/CN111316329A/zh
Priority to JP2019562908A priority patent/JP7173989B2/ja
Publication of WO2019131013A1 publication Critical patent/WO2019131013A1/ja

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/80—Creating or modifying a manually drawn or painted image using a manual input device, e.g. mouse, light pen, direction keys on keyboard

Definitions

  • the present invention relates to an information processing apparatus and a program.
  • Japanese Patent No. 3727807 discloses a model for estimating the amount of components (melanin and hemoglobin) in the skin from colorimetric values of the skin.
  • Japanese Patent No. 3798550 discloses a model for estimating components in skin (melanin, oxygenated hemoglobin, reduced hemoglobin, and apparent absorbance of dermis) from the reflectance spectrum of skin.
  • colorimetric values are represented by at least three parameters (for example, color component values in the XYZ color system).
  • parameters for example, color component values in the XYZ color system.
  • colorimetric values can not be calculated from the components in the skin. Therefore, the simulation image can not be generated.
  • the model does not define the relationship between the colorimetric value and the component in the skin. Therefore, the simulation image can not be generated.
  • An object of the present invention is to provide a simulation image in which the color of the skin corresponding to the component in the skin is reproduced.
  • One aspect of the present invention is Means for acquiring colorimetric data including first to third color component values representing a pigment of the subject's skin; Means for acquiring image data of the skin of the subject from a camera, A means for generating a display image to be displayed on a display based on the image data; Means for converting the first color component value to the third color component value into a first pigment parameter to a third pigment parameter related to an object mass representing the light characteristic of the skin, respectively; Means for changing at least one of the first dye parameter to the third dye parameter according to the instruction of the operator; Means for converting the changed first dye parameter to third dye parameter into the first color component value to the third color component value, respectively; Means for changing the display image based on the converted first color component value to third color component value It is an information processing apparatus.
  • FIG. 2 is a block diagram showing the configuration of a client device 10. It is explanatory drawing of the outline
  • FIG. 16 is a diagram showing an example of a screen displayed in the information processing of the modification 2;
  • FIG. 1 is a block diagram showing the configuration of the information processing system of this embodiment.
  • the information processing system 1 includes a client device 10 and a color measurement device 20.
  • the client device 10 and the color measurement device 20 are connected to each other by wire or wirelessly.
  • the client device 10 is an example of an information processing device that executes information processing using the measurement result of the color measurement device 20.
  • the client device 10 is, for example, a smartphone, a tablet terminal, or a personal computer.
  • the color measurement device 20 is configured to measure the color of the skin.
  • FIG. 2 is a block diagram showing the configuration of the client device 10. As shown in FIG.
  • the client device 10 includes a storage device 11, a processor 12, an input / output interface 13, a communication interface 14, a camera 15, and a display 16.
  • the storage device 11 is configured to store programs and data.
  • the storage device 11 is, for example, a combination of a read only memory (ROM), a random access memory (RAM), and a storage (for example, a flash memory or a hard disk).
  • ROM read only memory
  • RAM random access memory
  • storage for example, a flash memory or a hard disk
  • the programs include, for example, the following programs.
  • Program of OS Operating System
  • Program of application for example, web browser
  • the data includes, for example, the following data.
  • ⁇ Database referenced in information processing ⁇ Data obtained by executing information processing (that is, execution result of information processing)
  • the processor 12 is configured to realize the function of the client device 10 by activating a program stored in the storage device 11.
  • the processor 12 is an example of a computer.
  • the input / output interface 13 is configured to obtain a user's instruction from an input device connected to the client device 10 and to output information to an output device connected to the client device 10.
  • the input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof.
  • the communication interface 14 is configured to control communication between the client device 10 and the color measurement device 20.
  • the camera 15 is configured to obtain image data (for example, image data corresponding to an image of a subject to be subjected to color measurement by the color measurement device 20).
  • the display 16 is configured to display the display image generated by the processor 12.
  • the display 16 is, for example, an LCD (Liquid-Crystal-Display) or an OEL (Organic-Electro-Luminescence) display.
  • FIG. 3 is an explanatory view of the outline of the present embodiment.
  • the colorimetric device 20 measures colorimetric data by measuring the skin of the subject OBJ.
  • the colorimetric data includes first to third color component values representing the pigment of the skin of the subject OBJ.
  • the client device 10 acquires image data of a skin image of the subject OBJ and colorimetric data obtained by the colorimetric device 20.
  • the client device 10 displays the display image IMG0 of the skin of the subject OBJ based on the image data.
  • the client device 10 determines the light characteristic (for example, at least one of the light reflection characteristic and the light absorption characteristic) of the skin based on the first color component value to the third color component value included in the colorimetric data. Calculate the first to third dye parameters with respect to the amount of substance to be expressed.
  • the light characteristic for example, at least one of the light reflection characteristic and the light absorption characteristic
  • the operator of the client device 10 instructs the client device 10 to change at least one of the first dye parameter to the third dye parameter.
  • the client device 10 changes at least one of the first dye parameter to the third dye parameter according to the instruction of the operator.
  • the client device 10 converts the changed first dye parameter to third dye parameter into first color component value to third color component value, respectively.
  • the client device 10 displays the display image IMG1 corresponding to the converted first to third color component values based on the converted first to third color component values.
  • the operator of the client device 10 changes the pigment of the subject OBJ's skin simply by giving the client device 10 an instruction to change at least one of the first pigment parameter to the third pigment parameter.
  • the display image IMG1 according to is obtained.
  • FIG. 4 is a flowchart of the information processing of the present embodiment.
  • FIG. 5 is a diagram showing an outline of data handled in the information processing of the present embodiment.
  • FIG. 6 is a view showing an example of a screen displayed in the information processing of the present embodiment.
  • the client device 10 executes acquisition of colorimetric data (S100). Specifically, the processor 12 acquires colorimetric data from the colorimetric device 20.
  • the colorimetric data includes first to third color component values representing the pigment of the skin of the subject OBJ.
  • the first to third color component values are, for example, color component values (X0, Y0, Z0) of the XYZ color system (FIG. 5).
  • the processor 12 stores the acquired colorimetric data in the storage device 11.
  • the client device 10 executes acquisition of image data (S101). Specifically, the camera 15 generates image data of the skin of the subject OBJ by imaging the skin of the subject OBJ.
  • the image data includes, for example, color component values in the RGB color space (hereinafter referred to as “display color information”).
  • the processor 12 stores the image data generated by the camera 15 in the storage device 11.
  • the client device 10 executes generation of a display image (S102). Specifically, the processor 12 displays the RGB color space from the first color component value to the third color component value (X0, Y0, Z0) included in the colorimetric data stored in the storage device 11 in step S101. Convert to color information (R0, G0, B0) (FIG. 5).
  • the processor 12 uses the equation 1 to calculate the first to third color component values (X0, Y0, Z0) contained in the colorimetric data into the first to third dye parameters (Pa0, Pb0, Pb0). Convert to Pc0) (FIG. 5).
  • K ax , k bx , k cx coefficient based on density and degeneration of collagen fiber k ay , k by , k cy : coefficient based on the amount of melanin in the skin k az , k bz , k cz : amount of hemoglobin in the skin
  • Coefficients based on x j a , j b , j c constants
  • the first pigment parameter Pa is a parameter related to the light scattering level of the dermis of the skin of the subject OBJ.
  • the second pigment parameter Pb is a parameter regarding the light absorption level of the epidermis of the skin of the subject OBJ.
  • the third pigment parameter Pc is a parameter regarding the light absorption level of the dermis of the subject OBJ's skin.
  • An image based on the image data stored in the storage device 11 in step S101 and the display color information (R0, G0, B0) of the converted RGB color space (that is, the image of the skin of the subject OBJ) is generated ( Figure 5).
  • the processor 12 displays the screen P100 (FIG. 6) on the display 16.
  • the screen P100 includes a display object A100, button objects B100a to B100c, and an image object IMG100.
  • the display object A100 displays the first to third color component values (X0, Y0, Z0) included in the colorimetric data.
  • the values displayed on the display object A100 correspond to the display color information (R0, G0, B0) of the RGB color space converted in step S102.
  • the button object B100a is an object that receives a user instruction to change the first pigment parameter Pa related to the light scattering level of the dermis.
  • the value of the first pigment parameter Pa is determined according to the position of the button object B 100 a.
  • the button object B100b is an object that receives a user instruction to change the second pigment parameter Pb related to the light absorption level of the epidermis.
  • the value of the second pigment parameter Pb depends on the position of the button object B 100 b.
  • the button object B100c is an object that receives a user instruction to change the third pigment parameter Pc related to the light absorption level of the dermis.
  • the value of the third pigment parameter Pc is determined in accordance with the position of the button object B100c.
  • the image object IMG100 displays the image of the skin of the subject OBJ generated in step S102.
  • the color of the skin image of the subject OBJ is determined by the display color information (R0, G0, B0) of the RGB color space converted in step S102.
  • the client device 10 executes parameter change (S103). Specifically, when the operator operates the button object B100a, the processor 12 changes the first pigment parameter Pa to a value according to the position of the button object B100a. When the operator operates the button object B100b, the processor 12 changes the second pigment parameter Pb to a value corresponding to the position of the button object B100b. When the operator operates the button object B100c, the processor 12 changes the third dye parameter Pc to a value corresponding to the position of the button object B100c. As a result, the values of the first dye parameter to the third dye parameter are corrected from (Pa0, Pb0, Pc0) to (Pa1, Pb1, Pc1) (FIG. 5).
  • the client device 10 executes the change of the display image (S104). Specifically, the processor 12 converts the first dye parameter to the third dye parameter changed in step S103 into the first color component value to the third color component value (X1, Y1, Z1) using Expression 1 Convert ( Figure 5). The processor 12 converts the first to third color component values (X1, Y1, Z1) into display color information (R1, G1, B1) in the RGB color space (FIG. 5). An image based on the image data stored in the storage device 11 in step S101 and the display color information (R1, G1, B1) of the converted RGB color space (that is, an image corresponding to the changed pigment parameter) Generate (Figure 5). The processor 12 displays the screen P102 (FIG. 6) on the display 16.
  • the screen P102 includes a display object A102, button objects B100a to B100c, and an image object IMG102.
  • the display object A 102 displays the first color component value to the third color component value (X1, Y1, Z1) corresponding to the pigment parameter changed in step S103.
  • the values displayed on the display object A 102 correspond to the display color information (R1, G1, B1) of the RGB color space converted in step S104.
  • the image object IMG 102 corresponds to the pigment parameter changed in step S103.
  • three types of color component values for example, color component values of the XYZ color system
  • three types of pigment parameters for example, reflection characteristics of the skin (for example, parameters related to the light scattering level of the dermis)
  • the model which specified the relation between the absorption characteristics of the skin and the combination of the absorption characteristics of the skin (for example, the parameters regarding the light absorption level of the epidermis and the light absorption levels of the dermis)
  • color component values corresponding to the changed dye parameters can be obtained (steps S103 to S104).
  • a simulation image for example, the image object IMG102 in FIG. 6) in which the color of the skin corresponding to the component in the skin is reproduced.
  • step S103 the operator instructs to change at least one of the first color component value to the third color component value (X0, Y0, Z0) displayed on the display object A100.
  • the processor 12 calculates the first to third dye parameters Pa to Pc corresponding to the first to third color component values (X0, Y0, Z0) after the change using Equation 1 Do.
  • the operator of the client apparatus 10 when the operator of the client apparatus 10 gives an instruction to change at least one of the first color component value to the third color component value, the operator responds to the change in the pigment of the skin of the subject OBJ.
  • a display object A 102 of the first pigment parameter Pa to the third pigment parameter Pc can be provided.
  • Variation 2 is a variation of the first to third dye parameters with respect to the amount of substance representing the absorption characteristics of the skin.
  • FIG. 7 is a view showing an example of a screen displayed in the information processing of the second modification.
  • the first pigment parameter Pa of Modification 2 is a parameter related to the amount of oxyhemoglobin in the skin of the subject OBJ.
  • the second pigment parameter Pb is a parameter regarding the light absorption level of the epidermis of the skin of the subject OBJ.
  • the third pigment parameter Pc is a parameter related to the amount of reduced hemoglobin in the skin of the subject OBJ.
  • the processor 12 displays the screen P110 (FIG. 7) on the display 16 in step S102 (FIG. 4).
  • the screen P110 includes a display object A100, button objects B110a to B110c, and an image object IMG100.
  • the button object B 110 a is an object that receives a user instruction to change the first pigment parameter Pa related to the amount of oxygenated hemoglobin.
  • the value of the first pigment parameter Pa depends on the position of the button object B 110 a.
  • the button object B 110 b is an object that receives a user instruction to change the second pigment parameter Pb related to the light absorption level of the epidermis.
  • the value of the second pigment parameter Pb depends on the position of the button object B 110 b.
  • the button object B110c is an object that receives a user instruction to change the third dye parameter Pc related to the amount of reduced hemoglobin.
  • the value of the third pigment parameter Pc is determined according to the position of the button object B 110 c.
  • three color component values for example, color component values in the XYZ color system
  • three dye parameters for example, a parameter related to the amount of oxygenated hemoglobin, light absorption level of the epidermis, , A parameter related to the amount of reduced hemoglobin
  • a defined model for example, only by the operator giving an instruction to change at least one of the three types of dye parameters, color component values corresponding to the changed dye parameters can be obtained (steps S103 to S104).
  • a simulation image for example, the image object IMG102 in FIG. 7 in which the color of the skin corresponding to the component in the skin is reproduced.
  • the first aspect of the present embodiment is Means for acquiring colorimetric data including first to third color component values representing the pigment of the skin of the subject OBJ (for example, the processor 12 for executing the process of step S100); A unit for acquiring image data of the skin of the subject OBJ from the camera 15 (for example, a processor 12 that executes the process of step S101); A unit that generates a display image to be displayed on the display 16 based on the image data (for example, the processor 12 that executes the process of step S102); The first dye parameter Pa, the second dye parameter Pb, and the second dye parameter Pb related to the light characteristics of the skin (for example, at least one of light reflection characteristics and light absorption characteristics) of the first color component value to the third color component value And means for converting into a third dye parameter Pc (for example, the processor 12 that executes the process of step S102), Means for changing at least one of the first dye parameter Pa to the third dye parameter Pc according to the instruction of the operator (for example, the processor 12 which executes
  • the three color parameter values are used as the three dye parameters (the first dye parameter Pa to A model is used that converts to three dye parameters Pc). Only when the operator instructs to change at least one of the three dye parameters, color component values corresponding to the changed dye parameters can be obtained. As a result, it is possible to provide a simulation image in which the color of the skin corresponding to the component in the skin is reproduced.
  • the second aspect of the present embodiment is
  • the first pigment parameter is a parameter related to the light scattering level of the dermis
  • the second dye parameter is a parameter related to the light absorption level of the epidermis
  • the third pigment parameter is a parameter related to the light absorption level of dermis. It is an information processing apparatus.
  • the operator is adapted to at least one of the reflective properties of the skin (e.g. the light scattering level of the dermis) and the absorption properties of the skin (e.g. the light absorbing level of the epidermis and the light absorbing level of the dermis) Only by instructing to change one color component value corresponding to the changed dye parameter can be obtained.
  • the reflective properties of the skin e.g. the light scattering level of the dermis
  • the absorption properties of the skin e.g. the light absorbing level of the epidermis and the light absorbing level of the dermis
  • the third aspect of the present embodiment is
  • the first pigment parameter Pa comprises a factor based on the density and denaturation of collagen fibers, It is an information processing apparatus.
  • the fourth aspect of the present embodiment is
  • the first pigment parameter is a parameter related to the amount of oxygenated hemoglobin in the skin
  • the second dye parameter is a parameter related to the light absorption level of the epidermis
  • the third pigment parameter is an information processing apparatus that is a parameter related to the amount of reduced hemoglobin in the skin.
  • the operator is instructed to change the absorption properties of the skin (eg, at least one of the amount of oxygenated hemoglobin in the skin, the level of light absorption in the epidermis, and the amount of reduced hemoglobin in the skin)
  • the absorption properties of the skin eg, at least one of the amount of oxygenated hemoglobin in the skin, the level of light absorption in the epidermis, and the amount of reduced hemoglobin in the skin
  • the fifth aspect of the present embodiment is
  • the first to third color component values include an X color component value, a Y color component value, and a Z color component value in the XYZ color system, respectively. It is an information processing apparatus.
  • the X color component value, the Y color component value, and the Z color component value of the XYZ color system corresponding to the instruction are obtained.
  • the sixth aspect of the present embodiment is The changing means changes the display image by converting the X color component value, the Y color component value, and the Z color component value into an image signal in the RGB color space. It is an information processing apparatus.
  • a display image corresponding to the instruction can be presented.
  • the seventh aspect of the present embodiment is The means for acquiring colorimetric data acquires colorimetric data from the colorimetric device 20 that measures the skin of the subject OBJ. It is an information processing apparatus.
  • color component values corresponding to the instruction of the operator for the colorimetric data acquired from the colorimetric device 20 can be obtained.
  • the eighth aspect of the present embodiment is It is a program for functioning a computer (for example, processor 12) as each above-mentioned means.
  • the storage device 11 may be connected to the client device 10 via a network (not shown).
  • Information processing system 10 Client device 11: Storage device 12: Processor 13: Input / output interface 14: Communication interface 15: Camera 16: Display 20: Color measurement device

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
PCT/JP2018/044592 2017-12-26 2018-12-04 情報処理装置、プログラム WO2019131013A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201880072286.0A CN111316329A (zh) 2017-12-26 2018-12-04 信息处理装置、程序
JP2019562908A JP7173989B2 (ja) 2017-12-26 2018-12-04 情報処理装置、プログラム、及び、情報処理方法

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2017248934 2017-12-26
JP2017-248934 2017-12-26
JP2018081276 2018-04-20
JP2018-081276 2018-04-20

Publications (1)

Publication Number Publication Date
WO2019131013A1 true WO2019131013A1 (ja) 2019-07-04

Family

ID=67067152

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/044592 WO2019131013A1 (ja) 2017-12-26 2018-12-04 情報処理装置、プログラム

Country Status (4)

Country Link
JP (1) JP7173989B2 (zh)
CN (1) CN111316329A (zh)
TW (1) TW201936113A (zh)
WO (1) WO2019131013A1 (zh)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002200050A (ja) * 2000-12-28 2002-07-16 Kao Corp 肌色測定装置および肌色診断装置ならびに顔画像処理装置
JP2010515489A (ja) * 2007-01-05 2010-05-13 マイスキン インコーポレイテッド 皮膚を撮像するためのシステム、装置、及び方法
JP2013043017A (ja) * 2011-08-25 2013-03-04 Shiseido Co Ltd 皮膚評価装置、皮膚評価方法、及び皮膚評価プログラム

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101523169A (zh) * 2006-10-02 2009-09-02 强生消费者公司 用于使用L*a*b*色空间来分析皮肤的装置和方法
JP5290585B2 (ja) * 2008-01-17 2013-09-18 株式会社 資生堂 肌色評価方法、肌色評価装置、肌色評価プログラム、及び該プログラムが記録された記録媒体

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002200050A (ja) * 2000-12-28 2002-07-16 Kao Corp 肌色測定装置および肌色診断装置ならびに顔画像処理装置
JP2010515489A (ja) * 2007-01-05 2010-05-13 マイスキン インコーポレイテッド 皮膚を撮像するためのシステム、装置、及び方法
JP2013043017A (ja) * 2011-08-25 2013-03-04 Shiseido Co Ltd 皮膚評価装置、皮膚評価方法、及び皮膚評価プログラム

Also Published As

Publication number Publication date
JPWO2019131013A1 (ja) 2021-01-14
TW201936113A (zh) 2019-09-16
JP7173989B2 (ja) 2022-11-17
CN111316329A (zh) 2020-06-19

Similar Documents

Publication Publication Date Title
KR101799174B1 (ko) 피부 진단 및 화상 처리 시스템, 장치 및 물품
KR101800102B1 (ko) 피부 진단 및 화상 처리 방법
JP2003333355A (ja) 色評価装置及び方法
JP2011248476A (ja) 画像処理装置、画像処理方法
US20150145884A1 (en) Makeup color simulation apparatus and method
JP6323097B2 (ja) 色測定装置、色測定システム、色測定方法、および、プログラム
TW201933234A (zh) 用以評價對於使用表情分析技術之商品的監視器的反應之資訊處理裝置、資訊處理系統及程式
WO2019131013A1 (ja) 情報処理装置、プログラム
JP2020526756A (ja) 髪の状態の情報を管理するシステムと、美容コンサルテーションを最適化する方法
JP2007105457A (ja) 肌のシミュレーション画像の形成方法
US20080144143A1 (en) Method for color characterization and related systems
Kravchenko et al. High‐fidelity iridal light transport simulations at interactive rates
CN107430743B (zh) 个人定制型化妆品的提案方法
JP2021010652A (ja) 情報処理装置、評価方法、および情報処理プログラム
JP6564660B2 (ja) 計算装置、計算方法、計算システム及びプログラム
KR20200008484A (ko) 피부 진단을 통한 화장품 추천 시스템
JP7305517B2 (ja) プログラム、情報処理装置、シミュレート方法及び情報処理システム
JP2005037256A (ja) 調色用データベース作成装置、調色用データベース作成方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18895954

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019562908

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18895954

Country of ref document: EP

Kind code of ref document: A1