JP4717595B2 - Skin condition analysis method, skin condition analysis apparatus, skin condition analysis program, and recording medium on which the program is recorded - Google Patents

Description

  The present invention relates to a skin condition analysis method, a skin condition analysis apparatus, a skin condition analysis program, and a recording medium on which the program is recorded, and in particular, a skin condition analysis method for performing multi-dimensional analysis of skin conditions with high accuracy. The present invention relates to a skin condition analysis apparatus, a skin condition analysis program, and a recording medium on which the program is recorded.

  Conventionally, various methods for analyzing skin conditions have been proposed in the fields of cosmetic counseling and medicine. For example, there is a method of photographing a local surface condition of skin such as fine lines of skin (skin), pores, spots, freckles, etc. with a microscope and analyzing the photographed contents (for example, Patent Document 1, Patent Document 2, etc.) See).

In the technique disclosed in Patent Document 1 or Patent Document 2, a local image is acquired using a microscope having a function of irradiating light to an observation site of the skin and capturing an image of the irradiated local skin. Then, the surface condition of the skin is analyzed from the acquired image.
JP 2003-24283 A JP-A-7-323013

  However, using the skin information of the subject acquired from the measuring instrument equipped with a microscope as described above, the texture and pores, stains, skin color, sebum amount necessary for highly accurate skin evaluation are analyzed, There was no analysis device to digitize. In addition, there has been no proposal for a method for performing multi-faceted analysis / diagnosis by displaying the analysis results in an easy-to-understand manner for subjects, counselors, doctors and the like.

  The present invention has been made in view of the above-described problems, and is a skin condition analysis method, a skin condition analysis apparatus, a skin condition analysis program, and a program for performing multifaceted analysis of skin conditions with high accuracy. An object of the present invention is to provide a recording medium on which is recorded.

  In order to solve the above problems, the present invention employs means for solving the problems having the following characteristics.

The invention described in claim 1 is a skin condition analysis method for analyzing a skin condition using a photographed skin image of a subject. All of skin texture / pores, spots, skin color, and sebum amount are obtained from the image. An analysis step that enables simultaneous analysis, an accumulation step for accumulating the image and an analysis result obtained from the analysis step in correspondence with the measurement date and subject information of the subject's skin, and the accumulation step The image for each subject, subject information corresponding to the image, analysis results for skin texture / pores, stains, skin color, and sebum amount obtained by the analysis step, skin texture / pores, stain A selection screen for selecting a screen for displaying any one of the analysis results of the skin color and the amount of sebum. Includes a-up, and an output step of outputting the information generated by the display screen generating step, the analyzing step, as the analysis result of the texture-pores, represents the characteristics of texture "fineness of skin bumps" , "Skin shape", "skin clearness" and "pore size" at least one of the information is digitized, and the measurement result of the stain is displayed on the screen, As an analysis result, at least one of hue, brightness, melanin amount and hemoglobin amount is calculated from the RGB values of the image calibrated using the calibration plate, and as a result of the analysis of the sebum amount, digitizing discolored area, the display screen generating step, the 1 screen, as an analysis result of the texture-pores, and measure the image of the texture-pores, fineness of texture, texture width, shape of texture The size of the texture is displayed, the measurement image of the spot portion is displayed as the analysis result of the stain, the measurement result corresponding to the lightness and hue, the melanin amount, and the hemoglobin amount as the skin color analysis result Is displayed by graphing, and as the analysis result of the sebum amount , a screen for displaying the sebum amount by numerical value and / or graphing is generated, and the display screen generating step stores the measurement result of the subject in advance. Display in association with the evaluation results in the age-specific distribution, set a plurality of evaluation ranges for classifying the skin states by age in the age-specific distribution, and display the set evaluation ranges and analysis results It is characterized by that.

According to the first aspect of the invention, it is possible to perform a multifaceted analysis of the skin state with high accuracy from the analysis results of skin texture / pores, spots, skin color, and sebum amount. Further, by displaying the measurement result of the subject in comparison with other data of the same age (same generation), it is possible to make a multifaceted diagnosis in accordance with the subject. In addition, the skin condition can be grasped with high accuracy.

According to a second aspect of the present invention, the display screen generating step displays a plurality of measurement results over time from the latest measurement results of the subject and the past measurement results accumulated by the accumulation step. It is characterized by that.

According to invention of Claim 2, the change of a state with time can be grasped correctly. Thereby, the multilateral diagnosis according to the test subject can be performed.

The invention described in claim 3 is characterized in that the display screen generating step displays the time interval of the time axis to be displayed in correspondence with the number of measurements or the actual date and time.

According to the invention of claim 3 , various time displays can be realized. In addition, since the actual progress of the date and time can be accurately grasped, it is possible to easily estimate the skin condition other than the measurement date.

The invention described in claim 4 is a skin condition analysis apparatus that analyzes a skin condition using a photographed skin image of a subject. From the image, all of skin texture / pores, spots, skin color, and sebum amount are obtained. Analyzing means that can simultaneously analyze the image and the analysis result obtained from the analyzing means in correspondence with the measurement date and subject information of the subject's skin, and the storage means The image for each subject, subject information corresponding to the image, analysis results for skin texture / pores, spots, skin color, and amount of sebum obtained by the analysis means, skin texture / pores, and spots A selection screen that selects a screen for displaying one of the analysis results of the skin color and the amount of sebum, a display screen generating unit that generates a screen to be displayed on one screen, and the display screen Living And an output means for outputting the information generated by the means, the analyzing means, as the analysis result of the texture-pores, "fineness of skin bumps" representing the characteristics of texture, "the shape of the skin bumps" Quantify at least one piece of information among “clearness of skin groove” and “size of pores”, display the measurement result of the stain on the screen, and use a calibration plate as the analysis result of the skin color From the RGB value of the calibrated image, at least one of hue, brightness, melanin amount, hemoglobin amount is calculated, and as an analysis result of the sebum amount, the area discolored by sebum with a repeat marker is quantified, The display screen generation means displays the measurement image of the texture / pores and the fineness of the texture, the width of the texture, the shape of the texture, and the size of the texture as the analysis result of the texture / pores on the one screen. Of the stain As a result of analysis, a measurement image of the spot portion is displayed, and as a result of analysis of the skin color, a measurement result corresponding to lightness and hue, a melanin amount, and a hemoglobin amount are displayed in a graph, and the analysis of the sebum amount is performed. As a result, a screen on which the sebum amount is displayed by numerical value and / or graphing is generated, and the display screen generating means displays the measurement result of the subject in association with the evaluation result in the age-specific distribution accumulated in advance. In the distribution by age, a plurality of evaluation ranges for classifying skin states by age are set, and the set evaluation ranges and analysis results are displayed .

According to the fourth aspect of the invention, it is possible to perform a multifaceted analysis of the skin state with high accuracy from the analysis results of skin texture / pores, spots, skin color, and sebum amount. Further, by displaying the measurement result of the subject in comparison with other data of the same age (same generation), it is possible to make a multifaceted diagnosis in accordance with the subject. In addition, the skin condition can be grasped with high accuracy.

In the invention described in claim 5 , the display screen generation means displays a plurality of measurement results over time from the latest measurement results of the subject and the past measurement results accumulated by the accumulation step. It is characterized by that.

According to invention of Claim 5, the change of a state with time can be grasped correctly. Thereby, the multilateral diagnosis according to the test subject can be performed.

The invention described in claim 6 is characterized in that the display screen generating means displays a time interval of a time axis to be displayed in correspondence with the number of times of measurement or an actual date and time.

According to the sixth aspect of the invention, various time displays can be realized. In addition, since the actual progress of the date and time can be accurately grasped, it is possible to easily estimate the skin condition other than the measurement date.

The invention described in claim 7 is a skin condition analysis program that causes a computer to operate so as to execute the skin condition analysis method according to any one of claims 1 to 3 .

According to the seventh aspect of the invention, a multifaceted analysis of the skin condition can be performed with high accuracy. Further, by installing the program, the skin condition analysis in the present invention can be easily realized by a general-purpose personal computer or the like.

The invention described in claim 8 is a computer-readable recording medium on which the skin condition analysis program according to claim 7 is recorded.

According to the eighth aspect of the present invention, the skin condition analysis program can be easily installed on a plurality of other computers by the recording medium. Further, by installing the program, the skin condition analysis in the present invention can be easily realized by a general-purpose personal computer or the like.

  According to the present invention, a multifaceted analysis of the skin condition can be performed with high accuracy.

  Hereinafter, embodiments of a skin condition analyzing method, a skin condition analyzing apparatus, a skin condition analyzing program, and a recording medium on which the program is recorded according to the present invention will be described with reference to the drawings.

<System configuration>
FIG. 1 is a diagram illustrating an example of a schematic configuration of a skin condition analysis system according to the present invention. A skin condition analysis system 10 shown in FIG. 1 is configured to include a skin observation apparatus 11 and a skin condition analysis apparatus 12. The skin observation apparatus 11 and the skin condition analysis apparatus 12 may be connected to the Internet or a LAN (Local Area Network). ) Etc., and is connected in a state where data can be transmitted and received.

  The skin observation apparatus 11 captures an image of a subject using, for example, a CCD (Charge Coupled Device) camera, and acquires an image of the skin area of the subject or an enlarged image enlarged to a predetermined size. As a method for photographing the face and skin in the present invention, for example, an SMA (Skin Micro Analyzer) skin enlargement microscope system can be used, and the above-described Patent Document 1 (Japanese Patent Laid-Open No. 2003-24283). However, the present invention is not limited to this.

  The skin observation apparatus 11 measures at least one piece of information among texture, pores, spots, skin color, and sebum amount. In addition, the skin observation apparatus 11 transmits information on measurement results such as captured images to the skin condition analysis apparatus 12 via the communication network 13.

  The skin condition analysis device 12 analyzes at least one of skin texture, stains, skin color, and sebum amount based on the image transmitted from the skin observation device 11, and not only observes the analysis result and the photographed image. Analyzing the age distribution and changes over time and displaying it on the display screen.

  The system configuration shown in FIG. 1 is roughly configured to have one skin observation device 11 and one skin condition analysis device 12, but the present invention is not limited to this. A plurality of observation devices 11 and / or skin condition analysis devices 12 may be provided. In addition, each structure for imaging the skin of the subject in the skin observation device 11 may be provided in the skin state analysis device 12, and when image information or the like that is a basis for analyzing the skin state already exists, The observation device 11 need not be provided.

  In the skin condition analysis system 10 as shown in FIG. 1, the process in the skin observation device 11 is a preprocess in the actual skin diagnosis, and therefore, for example, a person who assists a doctor such as a medical staff may perform the process. The process in the skin observation apparatus 12 is a process that can be performed by a doctor who actually performs skin diagnosis.

<Skin Observation Device 11>
Next, a functional configuration example of the skin observation apparatus 11 will be described with reference to the drawings. FIG. 2 is a diagram illustrating an example of a functional configuration of the skin observation apparatus. The skin observation apparatus 11 shown in FIG. 2 includes input means 21, output means 22, member management means 23, transmission / reception means 24, storage means 25, texture / pore measurement means 26, spot measurement means 27, The skin color measuring means 28, the sebum amount measuring means 29, and the control means 30 are provided.

  The input means 21 accepts input of various data when registering a member (subject) who performs counseling or the like from a user or the like, registration of a measurement date and time, and the like. The input unit 21 receives a measurement execution instruction from the user, a data transmission instruction to the skin condition analysis apparatus 12, and the like. Note that the input unit 21 includes, for example, a keyboard and a pointing device such as a mouse.

  The output unit 22 displays / outputs the content input by the input unit 21 and the content executed based on the input content. Note that the output means 22 includes a display, a speaker, and the like. Further, the output means 22 may have a function of a printer or the like. In that case, a simple measurement result can be printed on a print medium such as paper and provided to the user.

  The member management means 23 manages member personal information, the number of times of measurement, and the like. Specifically, the member management unit 23 registers members, calls member information already registered and stored in the storage unit 25, measurement (photographing) results, etc., and performs reference, correction, deletion, etc. Can do.

  The contents registered as member information include, for example, “medical chart No.”, “name”, “date of birth”, “sex”, “measurement site” for identifying each member and measurement content, etc. "Memo (remarks)" etc. The member information to be registered is not particularly limited in the present invention. For example, the setting may be such that “age” is registered instead of “birth date”. Further, when calling a member, the above-mentioned “medical chart No.”, “name”, and the like are used.

  The transmission / reception means 24 is a communication interface for transmitting and receiving data between the skin observation apparatus 11 and the skin condition analysis apparatus 12 via the communication network 13. Therefore, in the skin observation apparatus 11, the transmission / reception means 24 receives an acquisition request for various information such as member information and measurement contents from the skin condition analysis apparatus 12, or transmits various information to the skin condition analysis apparatus 12 by the input means 21. When an instruction is accepted, information is transmitted to the skin condition analysis device 12 by the transmission / reception means 24 via the communication network 13.

  The storage means 25 stores various information such as member information and measurement contents obtained by the member management means 23 described above. The accumulating unit 25 accumulates each measurement result obtained from the texture / pore measuring unit 26, the stain measuring unit 27, the skin color measuring unit 28, and the sebum amount measuring unit 29 in association with the measurement date information and member information.

  Next, the texture / pore measurement means 26 captures the image data of the texture / pores by photographing the surface reflected light of the light incident on the local area of the skin to be observed with an optical system. Specifically, for example, using a microscope, specular reflection light (light having the same polarization as the irradiation light) can be acquired so that the unevenness of the skin surface can be clearly seen for photographing textures and pores. A polarizing filter or the like is installed in front of the LED (Light Emitting Diode) and the CCD (Charge-Coupled Devices). Thereby, surface reflected light can be actively acquired. The texture / pore measurement means 26 causes the accumulation means 25 to accumulate the measured image data.

  Further, the spot measurement means 27 captures the image data of the spot by photographing with an optical system that positively acquires the internally diffused light of the light incident on the local area of the skin to be observed. Specifically, for example, a microscope is used to capture the internal diffused light (light polarized perpendicular to the light to be irradiated) in order to capture the light from the inside for photographing a spot as a configuration thereof. Install a polarizing filter in front of the CCD. Thereby, internal diffused light can be actively acquired. Note that the spot measuring unit 27 causes the storage unit 25 to store the measured image data.

  The texture / pore measurement means 26 and the spot measurement means 27 are provided with individual polarizing filters, but a mechanism that can switch the polarizing filters may be provided in the microscope. As a technique relating to the switching of the polarizing filter, for example, the technique disclosed in Patent Document 2 (Japanese Patent Laid-Open No. 7-323013) described above can be used.

  The skin color measuring means 28 captures the skin color image data by photographing with an optical system that acquires all the light that can be acquired with respect to the light incident on the local area of the skin to be observed. Note that “acquiring all the light” means using the optical system that actively acquires specular reflection and internal diffused light in the above-mentioned photographing of textures and spots, but in the case of skin color, it returns from the skin without passing through the filter. An optical system that receives all incoming light is used. Further, the skin color measuring means 28 shoots a skin for skin and also shoots a calibration plate for calibrating the color of the image after shooting. Here, the calibration plate is for calibrating the color every time skin color is measured, and the RGB values of the calibration plate are preset. In other words, by using the calibration plate, the RGB value obtained by receiving the light with the CCD is converted into the RGB value obtained by measuring the color, so that the calibration plate is obtained from the RGB value obtained by photographing the calibration plate and receiving the light with the CCD. A relational expression with the original RGB value is created, and the original RGB value of the skin color is calibrated with the expression. The order of photographing the skin and the calibration plate in the skin color measuring means 28 may be any. Further, the skin color measuring means 28 causes the accumulation means 25 to accumulate the measured image data.

  Further, the sebum amount measuring means 29 measures the sebum amount by, for example, pressing a repeat marker against the measurement site for a certain period of time and photographing the pressed repeat marker. The repeat marker is a substance that adsorbs sebum on the skin when adhered to a measurement site and changes the color of the adsorbed portion. In this way, based on the change in the color of the repeat marker obtained by the sebum amount measuring means 29, the skin analysis device 12 (to be described later) analyzes from the image photographed with the microscope, and the sebum adsorption amount is digitized. Done. The sebum amount measuring means 29 causes the accumulation means 25 to accumulate the measured image data.

  In addition, the control unit 30 controls the entire components of the skin observation apparatus 11. Specifically, for example, based on an instruction from the input means 21 or the like, based on a measurement start instruction from a user or the like, the measurement means corresponding to the setting of the measurement date and time or the part determination instruction is used to perform measurement. Then, the contents are registered in the storage means 25, and various measured data are transmitted to the skin condition analyzer 12.

<Skin condition analyzer 12>
Next, a functional configuration example of the skin condition analysis device 12 will be described with reference to the drawings. FIG. 3 is a diagram illustrating an example of a functional configuration of the skin condition analysis apparatus. The skin condition analysis apparatus 12 shown in FIG. 3 includes an input unit 41, an output unit 42, a member management unit 43, a transmission / reception unit 44, a storage unit 45, an analysis unit 46, a display screen generation unit 47, and a control. And means 48.

  The input means 41 gives an instruction for calling up member information acquired by the skin observation apparatus 11 and stored in the storage means 45, and for analyzing and evaluating various data obtained from the skin observation apparatus 11, and is evaluated. The input of various data at the time of giving an instruction or the like for displaying the result is received. Note that the input unit 41 includes, for example, a keyboard and a pointing device such as a mouse.

  The output unit 42 displays the content input by the input unit 41 and the content executed based on the input content. Note that the output means 42 includes a display, a speaker, and the like. Further, the output unit 42 may have a function of a printer or the like. In this case, a simple measurement result can be printed on a print medium such as paper and provided to the user.

  Also, the member management means 43 manages the member's personal information and the number of measurements. Specifically, the member management unit 43 can register a member, call member information already registered and stored in the storage unit 45, and refer to, modify, and delete the member information. The member information stored in the storage unit 45 is substantially the same as the content registered in the above-described skin observation apparatus 11.

  The transmission / reception means 44 is a communication interface for transmitting / receiving data between the skin condition analysis device 12 and the skin observation device 11 via the communication network 13. Therefore, the skin condition analysis apparatus 12 receives various information measured by the skin observation apparatus 11 from the transmission / reception means 44 via the communication network 13. Further, the skin observation apparatus 11 is requested to acquire various information, and if there is information that has not been transmitted yet, the information is acquired.

  Further, the storage means 45 displays various information such as member information and various measurement contents acquired from the skin observation apparatus 11, the analysis result analyzed by the analysis means 46, and the analysis result displayed on the display screen generation means 47. Accumulate the results of diagnosis (evaluation) by doctors. The storage unit 45 stores measurement data, analysis results, evaluation results, and the like in association with measurement date information and member information.

  Further, the analysis means 46 performs at least one analysis on each measurement result of the texture / pores, spots, skin color, and sebum amount measured by the skin observation apparatus 11. Specifically, the analysis means 46 receives the measurement result of the texture / pores from the input, such as “detail of the skin”, “shape of the skin”, “sharpness of the skin groove”, Of the “pore size”, at least one piece of information is digitized. In addition, about the specific method of numerical conversion, the method described in Japanese Patent Application No. 2005-133275 for which it applied by this applicant can be used, for example.

  In the method described in Japanese Patent Application No. 2005-133275, R component, G component, and B component are extracted from an image of the skin of a subject, and pores are extracted from the extracted R component and B component or G component. Extract images. Also, the pore size is digitized from the pore image. Further, the skin groove image is extracted from the G component, and the clearness of the skin groove is digitized from the extracted skin groove image. Further, the skin image is extracted from the pore image and the skin groove image, and the fineness of the skin and / or the shape of the skin are digitized from the extracted skin image.

  Further, the analysis means 46 does not perform the above-described processing such as digitization on the measurement result of the stain, and causes the display screen generation means 47 to display the measurement result of the stain on the screen and observe it by a counselor or a doctor. Let me evaluate.

The analysis unit 46 calculates at least one of hue, brightness, melanin amount, and hemoglobin amount from the RGB values of the image calibrated using the calibration plate with respect to the skin color measurement result.
For example, with respect to hue and lightness, RGB values are converted into HLS (H: hue, L: lightness :, S: saturation) values by a general method, and H (hue) and V (lightness) are calculated. be able to. As for the amount of melanin and the amount of hemoglobin, for example, the amount of melanin and the amount of hemoglobin can be calculated based on the mathematical formula described in Patent Document 1 (Japanese Patent Laid-Open No. 2003-24283) described above.

  Moreover, the analysis means 46 quantifies the area discolored by the sebum by the repeat marker with respect to the measurement result of the sebum amount. The analysis unit 46 stores the above-described analysis result in the storage unit 45.

  The display screen generation means 47 generates a screen for displaying the analysis result based on each of the above-mentioned texture / pores, stains, skin color, and sebum amount, and causes the output means 42 to output the result to evaluate the skin condition to a counselor or doctor. To do. Specifically, the display screen generation unit 47 generates a screen so as to display a list of the numerical results of the texture, pores, the stain image, the numerical result of the skin color, and the numerical result of the amount of sebum, and displays the screen by the output unit 42. . In addition to the latest image and the analysis result thereof, the display screen generation unit 47 includes, for the texture / pores, skin color, and sebum amount, in the measurement history of the same part of the same member accumulated in the accumulation unit 45. A screen for displaying at least one image and its analysis result is generated. In addition, for example, the display screen generation unit 47 generates a screen for displaying at least one image of the measurement history of the same location of the same member stored in the storage unit 45 in addition to the latest image for a stain. .

  In addition, the display screen generation means 47 creates distribution data for each age that has been accumulated in advance for the texture / pores, spots, skin color, and sebum amount, and also displays the measurement data of the subject on the distribution data. be able to. Thereby, relative evaluation for every age (age, generation) can be performed. Furthermore, the display screen generation means 47 generates a screen that displays past measurement results as time-lapse data (in time series). Thereby, a change with time of skin condition and prediction of future skin condition can be performed with high accuracy.

  The display screen generation unit 47 causes the counselor or the like to select an area to be evaluated from the displayed result using the input unit 41 or the like, and causes the analysis unit 46 to analyze the RGB value or the HLS value in the selected area. It can also be displayed.

  For example, in the case of spot analysis, first, an analysis region is set from an image, so that an R value (red), a G value (green), a B value (blue), and an H value (hue) in the region are set. ), L value (lightness), S value (saturation) are measured, and the contents are displayed together with past measurement results, so that changes in color and brightness can be grasped. It can be performed with high accuracy. An example of the output screen obtained by the display screen generation unit 47 will be described later.

  Further, the control means 48 controls the entire components of the skin condition analysis apparatus 12. Specifically, for example, based on an instruction from the input means 41, various information such as member information and measurement content from the skin observation apparatus 11 is received from the transmission / reception means 44, and various information is accumulated in the accumulation means 45, It also controls each process such as measurement content analysis and display output.

  Here, the skin condition analysis apparatus 12 described above can be controlled by a dedicated apparatus configuration having the functions described above, but generates an execution program that can cause a computer to execute each function. By installing the execution program in a personal computer, a server, etc., the skin condition analysis process in the present invention can be realized.

<Hardware configuration>
Here, a hardware configuration example of a computer capable of realizing the skin condition analysis in the present invention will be described with reference to the drawings. FIG. 4 is a diagram illustrating an example of a hardware configuration capable of realizing skin condition analysis according to the present invention.

  4 includes an input device 51, an output device 52, a drive device 53, an auxiliary storage device 54, a memory device 55, a CPU (Central Processing Unit) 56 that performs various controls, and a network connection device. 57 are connected to each other by a system bus B.

  The input device 51 has a pointing device such as a keyboard and a mouse operated by a user, and inputs various operation signals such as execution of a program from the user. The output device 52 has a monitor for displaying various windows and data necessary for operating the computer main body for performing the processing according to the present invention, and displays the program execution progress and results by the control program of the CPU 56. can do.

  Here, in the present invention, the execution program installed in the computer main body is provided by, for example, a recording medium 58 such as a CD-ROM. The recording medium 58 on which the program is recorded can be set in the drive device 53, and the execution program included in the recording medium 58 is installed in the auxiliary storage device 54 from the recording medium 58 via the drive device 53.

  The auxiliary storage device 54 is a storage means such as a hard disk, and can store an execution program according to the present invention, a control program provided in a computer, etc., and perform input / output as necessary.

  Based on a control program such as an OS (Operating System) and an execution program read and stored by the memory device 55, the CPU 56 performs various operations and input / output of data with each hardware component, etc. Each process in skin condition analysis etc. can be realized by controlling the process. Various information such as skin measurement results necessary during the execution of the program can be acquired from the auxiliary storage device 54, and the execution results and the like can also be stored.

  The network connection device 57 obtains an execution program from another terminal connected to the communication network 13 by connecting to a communication network or the like, or an execution result obtained by executing the program or the present invention. The execution program itself can be provided to other terminals. With the hardware configuration as described above, the skin condition analysis process according to the present invention can be executed. Further, by installing the program, the analysis of the skin image in the present invention can be easily realized by a general-purpose personal computer or the like. Next, specific contents of the skin condition analysis process will be described.

<Skin condition analysis processing procedure>
Next, an example of a processing procedure of the skin condition analysis system according to the present invention will be described using a flowchart. FIG. 5 is a flowchart showing an example of a skin condition analysis processing procedure in the present invention. In addition, the flowchart shown in FIG. 5 is a processing procedure for the skin condition analysis system in the skin observation apparatus 11 and the skin condition analysis apparatus 12 described above.

  In the flowchart shown in FIG. 5, first, when performing skin analysis, it is determined whether or not the subject is registered as a member (S01). If the member is not registered (NO in S01), the member is registered (S02). As member information to be registered, as shown in the member management means 23 described above, “medical record No.”, “name”, “date of birth”, “gender” for identifying each measurement content , “Measurement site”, “memo (remarks)” and the like. The member information to be registered is not particularly limited in the present invention. For example, the setting may be such that “age” is registered instead of “birth date”.

  Further, in the process of S01, when determining whether or not a member is registered, by searching for “membership number” or “name” from information stored in the storage means, You can check the registration status.

  Further, after the member is registered by the process of S02 or when the member information has already been registered (YES in S01), the measurement content is set (S03). Specifically, as described above, information in which at least one of measurement of skin texture / pores, spots, skin color, and sebum amount is set is acquired.

  Next, in the process of S03, measurement based on the acquired measurement content is performed (S04). In addition, a measurement method implements the measurement shown with the skin observation apparatus 11 mentioned above. When measuring, the measurement date and time is acquired, and the measurement result is stored together with the date information and member information (S05). By accumulating the date and time information, the measurement results of the members can be displayed over time in an evaluation process described later. Thereby, the multilateral analysis and evaluation of a skin state are realizable.

  Next, based on the measured result, at least one of skin texture / pores, spots, and skin color is analyzed (S06), and an image of the analysis result and the measurement result is displayed on the basis of a predetermined condition. Generate (S07). Further, in the process of S07, the generated screen is displayed by an output means such as a display and presented to a doctor or a subject (S08). Further, the analysis result and the evaluation result are accumulated (S09), and the process is terminated. In the above-described processing of S01 to S09, S01 to S05 may be installed as individual programs as skin observation processing, and S06 to S09 may be installed as separate programs, or may be installed in the same device. Also good. That is, when only skin measurement is performed, the processing from S01 to S05 may be executed, and when the measurement result is already registered, the processing from S06 to S09 may be performed.

  As described above, the skin condition analysis processing according to the present invention can perform not only calculation of result values and observation of captured images, but also highly accurate multilateral analysis of skin conditions such as age distribution and time distribution results. it can.

<Example of display screen>
Next, display screen examples according to the present invention will be described with reference to the drawings. Note that the screen examples shown below can be selected from the information provided, for example, by providing a main menu. Further, the types of display items and the display layout on each screen are not limited in the present invention.

<Member management screen>
FIG. 6 is a diagram illustrating an example of the member management screen. The member management screen 60 shown in FIG. 6 is configured to include a member selection area 61, a member list display area 62, and a remark content display area 63. In the member selection area 61, it is possible to input “medical chart No.”, “name”, “sex”, “birth date”, “measurement site”, “previous measurement date”, and the like. In the member selection area, “search button”, “clear button”, “measurement / analysis button”, “new registration button”, “correction button”, “replacement button” and the like are provided.

  First, when confirming whether or not the member information of the subject is included, for example, a “medical chart No.” or “name” shown in FIG. If registered, other items (“gender”, “birth date”, “measurement site”, “previous measurement date”, etc.) are displayed, so it is possible to confirm whether or not a member is registered. Note that the “clear button” clears the data of the “medical record No.” and “name” entered during the search. The “measurement / analysis button” is selected when actually measuring the skin.

  In addition, as a result of the search as described above, if the subject is not registered as a member, or if there is no corresponding member information as a result of the search, a message to that effect is displayed. In this case, for example, the above-mentioned “medical record No.”, “name”, “gender”, “birth date”, “measurement site”, “previous measurement date”, and remarks content in the remarks content display area 63 Then, new member registration is performed, and member information registered in the member list display area 62 is displayed. The registered member information can be changed by selecting a “correct button” after changing a predetermined item.

  Note that the “Replace button” moves the member information stored in the storage means to a CD-ROM, DVD, etc. when the registered member has not been diagnosed for a while since the last measurement. It is a button for changing. Further, the member management screen 60 may be provided with a registration number display area 64 for displaying the number of registered members, and if there is a main menu or the like, a main menu button 65 for returning to the main menu may be provided. Good.

<Measurement history list display screen>
FIG. 7 is a diagram illustrating an example of a measurement history list display screen. The measurement history list display screen 70 shown in FIG. 7 is configured to have a member information display area 71 and a measurement history display area 72. The member information display area 71 displays member information corresponding to the measurement history ("karte No.", "name", "date of birth", "sex", "measurement site", etc.). Further, in the measurement history display area 72, the measurement history, pores, spots, skin color, and sebum are measured in correspondence with the “history number” and the “measurement date” given numbers based on the measurement date and time. “●” is displayed in the measured content. As a result, it is possible to easily grasp when and which measurement was performed, and the setting of the current measurement content can be accurately performed with reference to the history information. The number of histories stored for each member is not particularly limited, but a predetermined number (for example, a maximum of 12 histories) may be set.

<Overall result display screen>
FIG. 8 is a diagram illustrating an example of the total result display screen. Here, the total result display screen 80 shown in FIG. 8 displays each analysis result of the measured texture, pores (Skin Texture), spots (Brown Spots), skin color (Skin Tone), and sebum amount (Sebum). is there. Specifically, for example, the comprehensive result display screen 80 includes a member information display area 81, a texture / pore analysis result display area 82, a stain analysis result display area 83, a skin color analysis result display area 84, and a sebum analysis result display. The region 85 is configured. In the member information display area, “result display date”, “medical chart No.”, “name”, “measurement date”, “remarks”, “measurement site”, and the like are displayed. The texture / pore analysis result display area 82 displays a texture / pore measurement image, texture fineness, texture width, texture shape, texture size, and the like.

  The spot analysis result display area 83 displays a spot measurement image (such as a local image or a local enlarged image). In the skin color analysis result display area 84, the measurement result corresponding to the brightness and the hue, the amount of melanin, and the amount of hemoglobin are displayed in a graph. Further, the sebum analysis result display area 85 displays the amount of sebum numerically and / or graphed. Here, when there are items that are not measured and are measured on the measurement date, the total result display screen 80 is displayed as blank.

  The overall result display screen 80 is provided with a tab 86. Specifically, the overall result tab 86-1, the Skin Texture tab 86-2, the Brown Spots tab 86-3, the Skin Tone tab 86-4, and the amount of sebum (Sebum) Tabs 86-5 are provided, and by selecting each tab, detailed information corresponding to each measurement and analysis result is displayed. Further, the total result display screen 80 may be provided with a measurement history selection screen button for changing the screen to the measurement history list display screen 70 as shown in FIG. 7 and a main menu button for changing the screen to the main menu. Good.

<Texture / pore display screen>
FIG. 9 is a diagram illustrating an example of a texture / pore display screen. The texture / pore display screen 90 shown in FIG. 9 includes a measurement date selection unit 91, an image display area 92, an analysis result display area 93, and age distribution display areas 94-1 to 94-4 corresponding to the respective analysis results. It is comprised so that it may have. The measurement date selection unit 91 includes a combo box or the like, and can select a texture / pore analysis result based on a desired measurement date result from the history measured so far including the current measurement.

  When the measurement date is set by the measurement selection unit 91, the corresponding measurement image is displayed in the image display area 92, and the fineness of the texture, the sharpness of the texture, the shape of the texture, and the size of the pores are analyzed and numerical values are obtained. The converted analysis result is displayed in the analysis result display area 93.

  Further, the texture / pore age distribution display screen 90 displays an analysis result corresponding to the age of the subject for each of the fineness of the texture, the sharpness of the texture, the shape of the texture, and the size of the pores. Display in correspondence with -1 to 94-4. In the age distribution display areas 94-1 to 94-4, the horizontal axis indicates the age, and the vertical axis indicates the corresponding evaluation value. Here, in the age distribution display areas 94-1 to 94-4, zones indicating at least one evaluation range for classifying the evaluation results are displayed. This zone indicates the range of the set evaluation results based on the age-based evaluation results accumulated in advance. For example, “good zone”, “normal zone”, “one more step zone”, “good work” It is displayed in a predetermined classification such as “Let's zone”, “Red zone”, “Yellow zone” and the like. Therefore, it is possible to accurately grasp in which state the subject is in comparison with the same age.

  This zone may be displayed with different colors, or may be displayed with diagonal lines, mesh lines, or the like. The zone is preferably set using a predetermined function or the like. Thereby, a highly accurate zone can be set. For example, as the setting of this zone, the zone of the average value ± standard deviation with 67% of people for each age and the zone of average value ± 1.95 × standard deviation with 95% of people are displayed separately. Can do.

  The texture / pore age distribution display screen 90 is displayed on the tabs 86-1 to 86-5 without selecting the tabs 86-1 to 86-5 by providing the back button 95 and the next button 96. It is possible to transition to each analysis result display screen.

<Texture / pore display screen: other examples>
FIG. 10 is a diagram showing another example of the texture / pore progress display screen. As shown in FIG. 10, other history information can be browsed by providing measurement progress display areas 97-1 to 97-4 instead of the age distribution display areas 94-1 to 94-4. Here, the horizontal axis of the measurement progress display area indicates the date, and the vertical axis is set corresponding to the value of each analysis result. Further, the memory width of the date on the horizontal axis shown in FIG. 10 is divided into equal widths by the number of times of measurement, but in the present invention, this is not limited to this, and the measurement is performed by setting the width to the date reference It can be estimated from the result of measurement of the skin condition on the day when it is not performed on the measurement days before and after that. As a result, it is possible to perform the state of the skin over time and the future prediction with high accuracy. The display example of the screen is not limited to this. For example, both the age distribution display area 94 and the measurement progress display area 97 may be displayed on one screen.

<Stain display screen>
FIG. 11 is a diagram illustrating an example of a spot display screen. The stain display screen 100 shown in FIG. 11 includes a measurement date selection unit 101, an image display region 102, an RGB value display unit 103, and an HLS value display unit 104. Here, by selecting a predetermined position such as a spot in the image display area 102, the RGB value and the HLS value for the circular area 105 having a predetermined diameter centered on that part are respectively displayed in the RGB value display section. 103 and the HLS value display unit 104. In addition, the area | region mentioned above is not limited to a perfect circle, An ellipse and a polygon may be sufficient.

  The stain display screen 100 can display a plurality of evaluation results from the measurement history. As a result, it is possible to evaluate the stain over time on one screen.

<Skin color display screen>
FIG. 12 is a diagram illustrating an example of a skin color display screen. The skin color display screen 110 shown in FIG.
The measurement date selection unit 111, the brightness / hue correlation display area 112, the analysis result display area 113, and the age distribution display areas 114-1 to 114-4 corresponding to the respective analysis results are configured. The measurement date selection unit 111 includes a combo box or the like, and selects a skin color analysis result based on a desired measurement date result from the history measured so far.

  When the measurement date is set by the measurement selection unit 111, the corresponding brightness / hue correlation is displayed in the brightness / hue correlation display area 112. In the brightness / hue correlation display area 112, a good area 115 in which the correlation between brightness and hue is good is displayed by being distinguished by color coding or diagonal lines, so that the analysis result 116 of the subject is located at any position. It is possible to accurately grasp whether it belongs. In addition, the evaluation results of hue (YR), brightness, melanin, and hemoglobin are displayed in the analysis result display area 113.

  Furthermore, the skin color display screen 110 displays the evaluation result 116 corresponding to the age of the subject corresponding to the age distribution display areas 114-1 to 114-4 for the evaluation results of hue, brightness, melanin, and hemoglobin. To do. In the age distribution display regions 114-1 to 114-4, the horizontal axis indicates the age, and the vertical axis indicates the value of the corresponding evaluation result. Here, as described above, zones for classifying the evaluation results are displayed in the age distribution display areas 114-1 to 114-4. Therefore, it is possible to accurately grasp in which state the subject is in comparison with the same age.

  FIG. 13 is a diagram showing another example of the skin color display screen. As shown in FIG. 13, a plurality (two or more) of measurement date selection units 111 and analysis result display areas 113 are provided based on history information, and the evaluation results 116-1 and 116-2 are displayed as brightness / hue correlation display areas 112. May be displayed. Further, a correlation display area 117 for melanin / hemoglobin may be provided, and the evaluation results 116-1 and 116-2 may be displayed in the correlation display area 117 for melanin / hemoglobin. Note that these evaluation results are displayed by being distinguished by color coding or diagonal lines. Thereby, skin color evaluation with time can be performed.

<Sebum amount display screen>
FIG. 14 is a diagram illustrating an example of a sebum amount display screen. The sebum amount display screen 120 shown in FIG. 14 includes a measurement date selection unit 121 for selecting at least one measurement date, a sebum amount display unit 122, a sebum amount display region 123, an age distribution display region 124, and a measurement progress display. And a region 125. As shown in the sebum amount display screen 120, the above-described age distribution display area 124 and the measurement progress display area 125 can both be displayed simultaneously. The sebum amount display area 123 can display the sebum amount.

  As shown in FIG. 14, with respect to the amount of sebum, highly accurate skin diagnosis can be performed by displaying information over time.

  The screen example described above is an example, and other screen configurations may be formed by combining the items on each screen described above. Thus, highly accurate skin diagnosis can be performed by clearly displaying information over time.

  As described above, according to the present invention, a multifaceted analysis of the skin condition can be performed with high accuracy.

  The above-described skin condition analysis system analyzes and evaluates skin texture, pores, spots, skin color, and sebum amount, but in the method of analyzing and displaying evaluation results over time as described above. Further, skin dullness and wrinkles, skin elasticity, pigmentation state, etc. may be analyzed, and these analysis results may be combined with the skin condition analysis results of the present invention to diagnose skin conditions.

  Thus, by applying the present invention, for example, in medical and cosmetic sales, etc., not only experts, but also using analysis results expressed by numerical values in the present invention and contents displayed over time Uniform and highly accurate skin diagnosis or beauty counseling can be realized. In addition, the skin condition analysis method according to the present invention can be applied to a device or the like in which the subject himself performs a self-check.

  The preferred embodiments of the present invention have been described in detail above, but the present invention is not limited to such specific embodiments, and various modifications, within the scope of the gist of the present invention described in the claims, It can be changed.

It is a figure which shows an example of schematic structure of the skin condition analysis system in this invention. It is a figure which shows an example of a function structure of a skin observation apparatus. It is a figure which shows an example of a function structure of a skin condition analyzer. It is a figure which shows an example of the hardware constitutions which can implement | achieve the skin condition analysis in this invention. It is a flowchart which shows an example of the skin condition analysis processing procedure in this invention. It is a figure which shows an example of a member management screen. It is a figure which shows an example of a measurement history list display screen. It is a figure which shows an example of a comprehensive result display screen. It is a figure which shows an example of a texture and pore display screen. It is a figure which shows the other example of a texture and pore progress display screen. It is a figure which shows an example of a spot display screen. It is a figure which shows an example of a skin color display screen. It is a figure which shows the other example of a skin color display screen. It is a figure which shows an example of a sebum amount display screen.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Skin condition analysis system 11 Skin observation apparatus 12 Skin condition analysis apparatus 13 Communication network 21,41 Input means 22,42 Output means 23,43 Member management means 24,44 Transmission / reception means 25,45 Accumulation means 26 Texture / pore measurement means 27 Blemish measuring means 28 Skin color measuring means 29 Sebum amount measuring means 30, 48 Control means 46 Analyzing means 47 Display screen generating means 51 Input device 52 Output device 53 Drive device 54 Auxiliary storage device 55 Memory device 56 CPU
57 Network connection device 58 Recording medium 60 Member management screen 61 Member selection area 62 Member list display area 63 Remarks content display area 64 Registration number display area 65 Main menu button 70 Measurement history list display screen 71, 81 Member information display area 72 Measurement history Display area 80 Total result display screen 82 Texture / pore analysis result display area 83 Spot analysis result display area 84 Skin color analysis result display area 85 Sebum analysis result display area 86 Tab 90 Texture / pore display screen 91 Measurement date selection section 92 Image display area 93, 113 Analysis result display area 94, 114, 124 Age distribution display area 95 Back button 96 Next button 97, 125 Measurement progress display area 100 Spot display screen 101, 111, 121 Measurement date selection unit 102 Image display area 103 RGB value Display section 04 HLS value display unit 105 the round region 110 skin color display screen 112 brightness and hue correlation display area 115 correlation display area 120 sebum amount display screen 122 sebum amount display part 123 sebum amount display area of good regions 116 analysis result 117 melanin Hemoglobin

Claims (8)

In the skin condition analysis method for analyzing the skin condition using the photographed skin image of the subject,
An analysis step that enables simultaneous analysis of skin texture / pores, spots, skin color, sebum amount from the image,
An accumulation step for accumulating the image and the analysis result obtained from the analysis step in correspondence with the measurement date and time of the subject's skin and the subject information;
The image for each subject accumulated by the accumulation step, the subject information corresponding to the image, the analysis result for skin texture / pores, spots, skin color, and sebum amount obtained by the analysis step, and the skin Display screen for generating a screen for displaying on one screen a selection unit that selects a screen for displaying any one of the analysis results of the texture / pores of the skin, the stain, the skin color, and the sebum amount Generation step;
An output step of outputting the information generated by the display screen generation step,
The analysis step includes
As an analysis result of the texture / pores, at least one of “fineness of the skin”, “shape of the skin”, “sharpness of the skin groove”, and “size of the pore” representing the characteristics of the texture The information is digitized, the measurement result of the stain is displayed on the screen, and the analysis result of the skin color is based on the RGB value of the image calibrated using the calibration plate, from the hue, brightness, melanin amount, hemoglobin amount Calculate at least one, as a result of the analysis of the amount of sebum, digitize the area discolored by sebum with a repeat marker,
The display screen generation step includes:
On the one screen, as an analysis result of the texture / pores, the measurement image of the texture / pores and the fineness of the texture, the width of the texture, the shape of the texture, the size of the texture are displayed, and the analysis result of the stain As a result of displaying the measurement image of the spot portion, as the analysis result of the skin color, the measurement result corresponding to the brightness and the hue, the melanin amount, and the hemoglobin amount are displayed in a graph, and the analysis result of the sebum amount , Generate a screen to display the amount of sebum by numerical value and / or graphing,
Further, the display screen generating step includes:
The measurement results of the subject are displayed in association with the evaluation results in the age-specific distribution accumulated in advance, and in the age-specific distribution, a plurality of evaluation ranges for classifying the skin state by age are set and set A skin condition analysis method characterized by displaying an evaluation range and an analysis result . The display screen generation step includes:
The skin condition analysis method according to claim 1 , wherein a plurality of measurement results are displayed over time from the latest measurement results of the subject and the past measurement results accumulated by the accumulation step. The display screen generation step includes:
3. The skin condition analysis method according to claim 2 , wherein the time interval of the displayed time axis is displayed in correspondence with the number of measurements or the actual date and time. In the skin condition analysis device that analyzes the skin condition using the photographed skin image of the subject,
Analyzing means capable of simultaneously analyzing skin texture / pores, spots, skin color, sebum amount from the image,
Accumulation means for accumulating the image and the analysis result obtained from the analysis means in correspondence with the measurement date and time of the subject's skin and subject information;
The image for each subject accumulated by the accumulation means, the subject information corresponding to the image, the analysis result for skin texture / pores, spots, skin color, and sebum amount obtained by the analysis means, and the skin Display screen for generating a screen for displaying on one screen a selection unit that selects a screen for displaying any one of the analysis results of the texture / pores of the skin, the stain, the skin color, and the sebum amount Generating means;
Output means for outputting information generated by the display screen generating means,
The analysis means includes
As an analysis result of the texture / pores, at least one of “fineness of the skin”, “shape of the skin”, “sharpness of the skin groove”, and “size of the pore” representing the characteristics of the texture The information is digitized, the measurement result of the stain is displayed on the screen, and the analysis result of the skin color is based on the RGB value of the image calibrated using the calibration plate, from the hue, brightness, melanin amount, hemoglobin amount Calculate at least one, as a result of the analysis of the amount of sebum, digitize the area discolored by sebum with a repeat marker,
The display screen generating means includes
On the one screen, as an analysis result of the texture / pores, the measurement image of the texture / pores and the fineness of the texture, the width of the texture, the shape of the texture, the size of the texture are displayed, and the analysis result of the stain As a result of displaying the measurement image of the spot portion, as the analysis result of the skin color, the measurement result corresponding to the brightness and the hue, the melanin amount, and the hemoglobin amount are displayed in a graph, and the analysis result of the sebum amount , Generate a screen to display the amount of sebum by numerical value and / or graphing,
Furthermore, the display screen generating means includes
The measurement results of the subject are displayed in association with the evaluation results in the age-specific distribution accumulated in advance, and in the age-specific distribution, a plurality of evaluation ranges for classifying the skin state by age are set and set A skin condition analyzing apparatus characterized by displaying an evaluation range and an analysis result . The display screen generating means includes
5. The skin condition analysis apparatus according to claim 4, wherein a plurality of measurement results are displayed over time from the latest measurement results of the subject and the past measurement results accumulated by the accumulation step. The display screen generating means includes
6. The skin condition analysis apparatus according to claim 5 , wherein a time interval of the displayed time axis is displayed in correspondence with the number of times of measurement or actual date and time. A skin condition analysis program for operating a computer to execute the skin condition analysis method according to any one of claims 1 to 3 . A computer-readable recording medium on which the skin condition analysis program according to claim 7 is recorded.