JP2006142005A - Skin condition diagnostic system and beauty counseling system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a system enabling even a beginner to diagnose the skin condition of a customer by simplifying the operation of diagnosis at a shop, and enhancing the accuracy of a diagnosis result. <P>SOLUTION: A data collecting system 1 is connected through a communication means to a data analyzing system 11 making an analysis based on data collected by the data collecting system 1. The data collecting system 1 comprises a collecting side communication means 7, an image capturing means 2 for capturing a super-high definition digital image allowing an analysis of the texture condition of the skin, a collecting side image data compressing means 6 for compressing an image by a high compression method suppressing a block noise, and a collecting side data display means 3. The data analyzing system 11 comprises an analyzing side communication mens 12, a data analyzing means 13 for analyzing image data, and an analyzing side data compressing means 13 for compressing an image by the high compression method suppressing the block noise. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a system for diagnosing a skin condition of a customer who is a subject at a store such as a cosmetics store.

2. Description of the Related Art Conventionally, a customer's skin is enlarged and observed by using a microscope at a store of a store that sells cosmetics, and the skin condition is diagnosed.
A microscope connected to an image processing device such as a personal computer is placed on a specific part of the face and the enlarged image is displayed on the display. Further, the image processing device analyzes the image captured from the microscope. For example, a skin condition such as a textured condition has been quantitatively evaluated.
In a store having such facilities, a salesperson uses the diagnosis result of the skin condition to select a product that suits the customer and to instruct how to use it.

  However, since the area on the face that can be captured at a time with a microscope is small, the diagnosis result based on the captured image is also local. For example, even when measuring the state of cheek stains, only a small portion of the entire cheek area can be captured, so if the location does not represent the entire cheek, the cheek condition is diagnosed. It doesn't mean that For example, if there is a stain only at the place where the microscope is applied, a diagnostic result indicating the state of the entire cheek cannot be obtained.

Therefore, in order to obtain highly reliable results, it is necessary to capture and analyze images of as many parts as possible. For example, in order to capture images of the entire cheek or the entire forehead, how many times the microscope is used. However, it takes time and effort to capture the image on the customer's face.
Even if the range such as the cheek or forehead is limited to a certain extent, it is not practical to use a microscope to capture a large number of locations and diagnose the state of the entire face.

In addition, it takes processing time to capture a large amount of information and analyze all of it. It takes a few minutes for the customer to wait without doing anything after inputting all the images and other customer information at the store until the analysis result comes out. During this time, a large computer with a high processing speed is required to produce results. It is almost impossible to install such a large computer in each store.
However, there is a problem that it is only possible to acquire an image capturing point that represents the state of a part having a certain size and to capture an image by applying a microscope to the point.

In addition, a diagnostic device using a microscope can display an enlarged image of the captured part, but it can identify which part of the customer's face the enlarged image, that is, the exact position on the face. Can not. For this reason, there is a problem that even if the customer is presented with the diagnosis result, it is not clear which part of his / her face it is and cannot be realized.
Moreover, in order to capture an image that can be analyzed by placing the microscope on the face, there is a problem that it is difficult for beginners who are not used to it.

  An object of the present invention is to provide a system for diagnosing the skin condition of the face of a customer who is an examinee at a store, simplifying the operation at the time of diagnosis, and enabling even a beginner to make a diagnosis, and moreover, the diagnosis result is more accurate. It is to provide a system to make things.

According to a first aspect of the present invention, a data collection system and a data analysis system that performs an analysis process based on data collected by the data collection system are connected via communication means, and the data collection system is connected to the data analysis system. Communication means for transmitting and receiving data between the two, image capturing means for capturing an ultra-high-definition digital image at a level capable of analyzing the texture of the skin, and image data by a high compression method that suppresses block noise The data analysis system includes a collection-side image data compression unit that compresses and a collection-side data display unit, and the data analysis system includes an analysis-side communication unit that transmits and receives data to and from the data collection unit and data that analyzes image data Analysis means and analysis-side image data compression means for compressing image data by a high compression method with reduced block noise An analysis-side data storage means for storing an analysis result by the data analysis means, wherein the image capture means captures the entire face image of the subject as an ultra-high-definition digital image, and the collection-side image data compression means The whole face image is compressed to generate compressed image data, and this is sent to the data analysis system via the collection side communication means. The data analysis means receives the compressed image data via the analysis side communication means. A function of analyzing the skin condition of the subject based on the received compressed image data, generating visual information reflecting the analysis result in the whole face image, and outputting the visual information as a diagnostic result. The analysis-side image data compression unit compresses the diagnosis result output from the data analysis unit to generate compressed image data, and the compressed image data is converted into data via the analysis-side communication unit. Transmitted to current systems, the collection-side data display means has a feature in that a function of displaying the diagnosis result transmitted from the analysis-side communication means.
In the system that receives the compressed image data transmitted between the data collection system and the data analysis system, the compressed image data is decompressed when the data is processed.

  A second invention is based on the first claim, wherein the data analysis system includes storage means for storing a plurality of diagnosis items relating to skin conditions, and the data analysis means is configured to detect the diagnosis from whole face image data. It is characterized in that it has a function of calculating an evaluation score for each item and reflecting an evaluation result corresponding to the evaluation score in the entire face image.

  3rd invention presupposes the said 2nd invention, and the said memory | storage means classify | categorizes and stores the said several diagnostic item in at least 2 or more types of middle items, respectively, and each of the said middle item and diagnostic item The coefficient value is stored in association with each other, and the data analysis means calculates the score for each diagnostic item obtained by multiplying the calculated evaluation score for each diagnostic item by the coefficient value corresponding to the diagnostic item for each medium item. A function to calculate the score of the skin condition by calculating the intermediate item evaluation score, multiplying the intermediate item evaluation score by the coefficient value corresponding to the intermediate item, and totaling the multiplied score It is characterized by the points provided.

4th invention presupposes the said 3rd invention, The said coefficient value is the relationship between the visual evaluation score of the skin state visually determined, and the evaluation score for every diagnostic item which the said data analysis means computed It is characterized in that it is a value calculated by analyzing.
The fifth invention is based on the third and fourth inventions, and the data analysis means displays display data for displaying the calculated evaluation score and the coefficient value corresponding to the item on the same screen. It is characterized in that it has a function to generate.

  6th invention presupposes the said 1st-5th invention, The said data analysis means specifies the morphological element of a face, and a diagnostic item from all the face images received from the data collection system A process, a process for identifying a diagnostic part on the whole face image according to the identified diagnostic item based on the facial morphological element, and an image that appears according to a skin condition corresponding to the diagnostic item at the diagnostic part It is characterized in that the process of analyzing the features is executed.

  According to a seventh aspect of the present invention, a data collection system and a data analysis system that performs an analysis process based on data collected by the data collection system are connected via communication means, and the data collection system is connected to the data analysis system. A communication means for transmitting and receiving data between them, an image capturing means for capturing an ultra-high-definition digital image capable of analyzing the texture of the skin, and compressing the image data by a high compression method that suppresses block noise The data analysis system includes a collection-side image data compression unit and a collection-side data display unit, and the data analysis system includes an analysis-side communication unit that transmits and receives data to and from the data collection unit, and a data analysis unit that analyzes image data Analysis-side image data compression means for compressing the image data by a high compression method that suppresses block noise; Analysis side data storage means for storing the analysis result by the data analysis means, and change trend storage means for storing a time-dependent change tendency corresponding to a predetermined skin condition and face shape pattern classification. The entire face image of the examiner is captured as an ultra-high-definition digital image, and the collection-side image data compression means compresses the entire face image to generate compressed image data, which is converted into a data analysis system via the collection-side communication means The data analysis means receives the compressed image data via the analysis-side communication means, analyzes the skin condition of the subject based on the received compressed image data, and sends the analysis result to all the above The visual information reflected in the face image is generated, the visual information is output as a diagnosis result, and the pattern is specified from the skin condition and face shape of the subject. A function that identifies the change trend corresponding to the target from the data stored in the change trend storage means, and predicts the future skin condition and face shape of the subject based on the identified change trend, and the prediction The analysis side image data compression means compresses the future prediction face image output from the data analysis means and generates compressed image data. This is transmitted to the data collection system via the analysis side communication means, and the collection side data display means is characterized in that it has a function of displaying a future predicted face image transmitted from the analysis side communication means.

  According to an eighth aspect of the present invention, there is provided a beauty counseling system, in which a data collection system and a data analysis system that performs an analysis process based on data collected by the data collection system are connected via communication means. The system includes a collection-side communication unit that transmits / receives data to / from the data analysis system, an image capturing unit that captures an ultra-high-definition digital image that is capable of analyzing the texture of the skin, and block image data. An analysis-side communication unit that includes a collection-side image data compression unit that compresses by a high-compression method that suppresses noise, and a collection-side data display unit, and the data analysis system transmits and receives data to and from the data collection unit And a data analysis means for analyzing the image data and a high compression method that suppresses the block noise of the image data. Analysis-side image data compression means for compressing, analysis-side data storage means for storing an analysis result by the data analysis means, and beauty information storage means for storing beauty information such as cosmetic information, and the image capturing means The entire face image of the subject is captured as an ultra-high-definition digital image, and the collection-side image data compression means compresses the entire face image to generate compressed image data, which is analyzed by the collection-side communication means. The data analyzing means receives the compressed image data via the analysis-side communication means, analyzes the skin condition of the subject based on the received compressed image data, and sends the analysis result to the above Suitable for the subject from the beauty information storage means based on the function of generating visual information reflected in the whole face image and outputting the visual information as a diagnostic result and the analysis result A function of extracting and outputting beauty information, and the analysis-side image data compression means compresses the diagnosis result output from the data analysis means to generate compressed image data, which is combined with the extracted beauty information The data is transmitted to the data collection system via the analysis side communication means, and the collection side data display means is characterized in that it has a function of displaying the diagnosis result and the beauty information transmitted from the analysis side communication means.

According to the first to eighth aspects of the invention, since it is possible to communicate ultra-high-definition full-face images in a short time, a data analysis system capable of highly accurate diagnosis can be provided separately from the data collection system. Became.
In this way, by separating a large processing apparatus for performing highly accurate analysis from a data collection system, a small data collection system can be installed in many stores.
In addition, since data collection systems such as stores can capture full-face images with a simple operation of using a camera, even beginners can capture full-face images of customers compared to the case of using a conventional microscope. It became so.
As a result, a more accurate diagnosis result can be easily obtained.
In addition, since the diagnosis result is visually expressed on the whole face image, the diagnosis result can be easily understood by the subject such as a customer of a cosmetic store.

  Furthermore, since the data relating to the skin state of the entire face can be simultaneously captured by the entire face image, the skin state of the entire face can also be comprehensively evaluated. If the data for the entire face cannot be captured at the same time, the time for capturing the data differs depending on the location. On the other hand, since the skin state changes with time, if there is a time difference in taking in data depending on the place, the entire face cannot be evaluated at the same time. Therefore, when the skin condition of the entire face is comprehensively evaluated, an accurate evaluation result may not be obtained. However, if the entire face image is captured at a time as in the present invention, such a concern is caused. There is no.

According to the 2nd-4th invention, a skin state can be evaluated comprehensively and it can be displayed.
In particular, according to the fourth aspect, the appearance, that is, the visual skin condition evaluation result can be calculated.
According to the fifth aspect, the degree of contribution of each item to the comprehensive skin condition evaluation result is known. Therefore, in order to improve the comprehensive evaluation result of the skin condition, it can be seen at a glance which diagnostic items are efficiently improved.

According to the sixth aspect of the invention, it is possible to specify a site on the image to be analyzed according to the diagnosis item.
According to the seventh aspect, it is possible to output a future predicted face image in which the future is predicted based on the skin condition of the subject. By using the predicted face image in the future, more appropriate advice on beauty can be given.
According to the eighth invention, even a person who has no experience in a store or the like can perform beauty counseling.

A first embodiment of the present invention will be described with reference to FIGS.
In the system according to the first embodiment, a data collection system 1 installed in each of a plurality of stores and a data analysis system 11 installed in a management center are connected via a communication network N such as the Internet. In addition, although the installation place of the said data collection system 1 is not restricted to a store, in the following embodiment, it shall install in stores, such as a cosmetics store.
In this skin condition diagnosis system, data necessary for diagnosis is transmitted from the data collection system 1 to the data analysis system 11, and a result analyzed by the data analysis system 11 is transmitted to the data collection system 1. The analysis result is displayed.

As shown in FIG. 1, the data collection system 1 includes an image capturing unit 2 that is an image capturing unit that captures an ultra-high-definition digital image according to the present invention, a display unit 3 that displays data, a keyboard that inputs customer information, An input unit 4 such as a card reader, a storage unit 5 for storing data, a processing unit 6, an output unit 8 for outputting data, and a data analysis system 11 via a communication network N. And a transmission / reception unit 7 which is a collection-side communication means.
In addition, all the data collection systems 1 installed in each store have the same configuration.

The photographing unit 2 is a digital camera that photographs an entire face of a customer who is a subject as an ultra-high-definition digital image that can analyze the texture of the skin. Ultra-high definition that can analyze the texture of the skin mentioned above means that it has a resolution that can read a thin line with a width of 30 μm. For example, it is equivalent to a microscope level of 50 times on a current 14-inch monitor. It is the above level. The larger the number of pixels of the image to be captured, the easier the analysis of the textured state. Specifically, 20 million pixels or more are necessary, and 40 million pixels or more are preferable.
The display unit 3 is a display capable of displaying an ultra-high-definition digital image, and the output unit 8 is a printer for outputting analysis results returned from the data analysis system 11 and other data.

The processing unit 6 processes customer data input from the input unit 4 and image data input from the photographing unit 2, stores the data in the storage unit 5, and transmits data via the transmission / reception unit 7. A function of transmitting to the analysis system 11 is provided.
As a data processing function of the processing unit 6, there is a function of compressing an ultra-high definition image input from the photographing unit 2. This compression method is a high compression method in which block noise is suppressed.
The compression method that suppresses block noise is a method that does not impair the continuity of the lines that existed in the original image even when the compressed image data is decompressed, and is an optimal method for analyzing the texture of the skin. is there. As software that realizes such a compression method, for example, there is “MrSID” of Sellertem Technology Co., Ltd.

In addition, the compression rate of high compression is a compression rate for realizing a communication speed in which the analysis result is returned from the data analysis system 11 within a few minutes after inputting necessary data on the store side. It is about 1/20.
As the compression method, various commercially available software can be used. The collection-side processing unit 6 is set with these software programs so as to compress the image data.
That is, the collection side processing unit 6 constitutes the collection side image data compression means of the present invention.

On the other hand, the data analysis system 11 includes a transmission / reception unit 12 that is an analysis-side communication unit that communicates with the data collection system 1, a central processing unit 13 that corresponds to the data analysis unit and the analysis-side image data compression unit, a storage unit 14, Various databases 15 to 19 are provided.
The storage unit 14 is a storage unit that stores data transmitted from the data collection system 1 and stores analysis results analyzed by the central processing unit 13. The databases 15 to 19 are central units that will be described in detail later. This is a database that stores data necessary for the analysis processing when the processing unit 13 performs data analysis.

The database includes, for example, a customer database 15 storing customer information transmitted from a plurality of data collection systems 1 connected to the management center, a face image database 16 storing customer face images, and a skin condition determination. A skin determination reference database 17 storing the reference data, a care database 18 storing a skin care method corresponding to the skin characteristics, a product information database 19 storing product information sold at each store, and the like.
The reference data stored in the skin determination reference database 17 is a reference for replacing the result of image analysis for each diagnosis item with the level value of each skin condition. For example, in order to evaluate the brightness (whiteness) of the entire face, the brightness is measured from the face image, and the brightness level of the skin is determined based on the measured value. The brightness of the skin associated with the brightness of the image is determined. The level is the reference data.
Further, the image data compression function of the central processing unit 13 is the same as the compression function of the collecting side processing unit 6, and the image data can be compressed by a high compression method that suppresses block noise. .

The procedure for diagnosing the skin condition of a customer who has visited the store where the data collection system 1 is installed will be described below.
Here, an example will be described in which an overall diagnosis is made as to how the skin condition of the customer's face is, for example, whether there is a problem such as roughness.

  First, the person in charge at the store uses the photographing unit 2 to capture the customer's full face data. Specifically, the customer's face is photographed with a digital camera for ultra-high definition images. When shooting, it is necessary to capture the entire image so that the entire face is in focus, but since anyone can take a photo using a digital camera, the customer's location, lighting conditions, etc. If devised, it is not particularly difficult to capture an image that can be analyzed. Compared to capturing data with a microscope, it is simpler and even a beginner for skin diagnosis.

As described above, when the entire face image is captured from the photographing unit 2, the processing unit 6 compresses it and transmits it as compressed image data to the data analysis system 11 via the transmission / reception unit 7.
In the data analysis system 11, the compressed image data is received by the central processing unit 13 via the transmission / reception unit 12, decompressed, and then analyzed.

Below, this analysis procedure is demonstrated using FIGS.
The central processing unit 13 decompresses the received compressed image data to generate a full face image. FIG. 2 shows the generated full face image 21. Skin diagnosis is performed based on the whole face image 21.
First, the central processing unit 13 recognizes the skin color of the whole face image 21 and identifies the face outline based on the skin color, and the eyes, nose, mouth, and the like, which are facial shape elements stored in advance in the outline. The feature point data of each face part is applied, and the position of the face part in the whole face image 21 is specified.

Next, based on the face part information, the analysis site 22 is determined as shown in FIG. The analysis part 22 may be set for the entire face, or may be set at a specific location, for example, a position such as a cheek or an eye corner, depending on the diagnosis item. A diagnostic item is an item of skin condition analyzed and determined from an image in this system. Specifically, items such as wrinkles and bulkiness are included.
For example, for the diagnosis of bulkiness, a cheek that is easy to be bulky is used as the analysis site, and for the diagnosis of wrinkles, the analysis site is used as the analysis site.
In the first embodiment, in order to diagnose the skin condition of the entire face, a plurality of diagnosis items are set in advance, and all of them are diagnosed. And about the determined analysis site | part, data analysis is performed for every diagnostic item, and an analysis result is taken out.

For each diagnostic item such as wrinkles, roughness, and stains, there are items to be analyzed and analysis procedures, such as texture state and pore shape / size. These analysis items and procedures are set in advance in the analysis program of the central processing unit 13. The above analysis is an image analysis process such as brightness, hue, and color distribution of necessary portions according to the diagnosis item in the whole face image data captured on the data collection system 1 side. For example, when evaluating the brightness (whiteness) of the skin, the brightness is measured from the entire image data, and when evaluating the hue, the hue is measured from the entire image data, and each is compared with the reference data. Then, an evaluation point or level value of skin brightness is determined.
In addition, the analysis of spots and freckles is performed based on the analysis data such as density and area where the density is higher than the standard value, and for the texture and wrinkles, the area where the dark part is connected in a line is specified. In this way, texture and wrinkles are identified, and the measurement results such as the density, size, and distribution are compared with the reference data, and the evaluation result is output.

Further, among the diagnostic items, there are diagnostic items related to other diagnostic items. For example, skin roughness is greatly related to the textured condition. In the case of the diagnosis, the textured state of the analysis part corresponding to the textured diagnosis is analyzed to obtain a numerical value of the textured condition. . Then, the value is compared with the reference data for the bulkiness in the skin judgment reference database 17 to determine the customer's bulkiness state.
For any diagnostic item, the central processing unit 13 performs image analysis such as brightness, color, density, and line arrangement of the necessary portions according to the analysis item for each diagnostic item, and analyzes each analysis item. The result is compared with the reference data in the skin determination reference database 17 to determine the skin condition of the customer for each diagnosis item.

When the skin state is determined from the analysis results of all the items to be diagnosed, the central processing unit 13 displays the diagnosis results on the image information reflecting the diagnosis results on the whole face image 21, as shown in FIG. Generate.
That is, as shown in FIG. 4, the central processing unit 13 displays diagnostic result image data for displaying the wrinkle occurrence part 23 of the outer corner of the eye and the cheek occurrence part 24 on the whole face image 21 in different colors. Generate.
The central processing unit 13 highly compresses the diagnostic result image data representing the diagnostic result using a compression method that suppresses block noise, and transmits the compressed data to the data collection system 1 via the transmission / reception unit 12.

In the data collection system 1, the received data is displayed on the display unit 3. As shown in FIG. 4, the display unit 3 displays a screen in which the skin condition is color-coded on the full face image 21 of the customer.
In addition, as shown in FIG. 5, the skin condition level obtained by the central processing unit 13 can be displayed on the display unit 3 together with the full face image 21 by the graph 30. In addition, the said graph 30 is a graph showing the grade for every diagnostic item, such as wrinkles, as shown in FIG.
However, the skin condition level may be displayed in color on the whole face image 21 instead of the graph 30. For example, the level of shading can be expressed by the density of the color added to indicate the shading site.
As described above, the skin diagnosis result is visually displayed on the full-face image 21, so that the customer can feel the state of his / her skin and the shop side can easily convince the customer. .

Furthermore, as shown in FIG. 7, in the data collection system 1, when a specific position in the displayed whole face image 21 is selected with the mouse pointer 31 or the like, the enlarged image may be displayed in the enlarged image display area 32. I can do it.
Note that the image displayed in the enlarged image display area 32 is an image based on an ultra-high-definition image taken in from the photographing unit 2 and has a level at which the texture state can be clearly understood.

As described above, the skin diagnosis based on the super-high-definition full-face image can be performed at a realistic speed because the actual analysis process is performed at the management center data analysis system 11 with high processing capability. This is because the processing time is shortened by performing the above and further the communication time is shortened by transmitting and receiving the image data with high compression.
There is no point in compressing the image data if the image data is deteriorated and the analysis accuracy of the skin state is lowered. However, in the system of the present invention, by adopting a compression method that suppresses block noise, the compression can be performed while preserving the continuity of the line, which is important for skin analysis. Absent.

In the first embodiment, the skin condition of the entire customer's face is checked. However, for example, only a diagnostic item of interest such as a customer's skin problem may be analyzed.
In this case, the customer's skin trouble is input from the input unit 4 of the data collection system 1 and transmitted to the data analysis system 11. In the data analysis system 11, the central processing unit 13 specifies a diagnosis item corresponding to the received skin trouble, performs data analysis according to the same procedure as in the first embodiment, and outputs a diagnosis result.
In this case as well, the display unit 3 of the data collection system 1 can display a part of the entire face image of the customer corresponding to the skin problem with a specific color. In addition, the degree of skin damage can be indicated by a graph or a score.

Moreover, 2nd Embodiment shown in FIGS. 8-10 not only displays the skin state regarding each diagnostic item on the whole face image of the customer who is a subject like the said 1st Embodiment, Furthermore, it is an example which calculates | requires the comprehensive evaluation score of a skin state combining these analysis results.
However, the overall configuration of the second embodiment is the same as that of the first embodiment shown in FIG. Therefore, FIG. 1 is also used to explain the second embodiment.
The comprehensive skin state evaluated in the second embodiment is a skin state that affects the appearance and is the beauty of the skin.

In the system of the second embodiment, the procedure for outputting the diagnosis result from the image analysis for each diagnosis item and the function of displaying the diagnosis result on the entire face image of the customer are the same as in the first embodiment. Here, the description is omitted, and a description will be given focusing on the function of calculating a comprehensive skin condition evaluation score.
In this system, as shown in FIG. 8, a table in which diagnostic items B1 to B28 are classified into three middle items, color C1, unevenness C2, and vitality C3, and coefficient values are associated with the respective items is shown in FIG. 1 is stored. That is, coefficient values b1 to b28 correspond to the diagnostic items B1 to B28, respectively, and coefficient values c1 to c3 correspond to the middle items C1 to C3, respectively.

  The middle items C1 to C3 are elements related to the skin condition A, and a combination of these is referred to as a comprehensive skin condition A. In addition, each of the middle items C1 to C3 is obtained by integrating the diagnostic results of the diagnostic items B1 to B28 classified into the middle items. Therefore, the middle item color C1 is associated with diagnostic items related to skin color such as face color, and the unevenness C2 is associated with diagnostic items related to skin surface unevenness. The vitality C3 is also an item relating to the surface condition of the skin, but mainly associates diagnostic items that change due to aging.

  The coefficient values b1 to b28 of the diagnostic items B1 to B28 are numerical values indicating the degree to which each diagnostic item B1 to B28 contributes to the middle item into which the diagnostic item is classified. The coefficient values c1 to c3 of C3 are numerical values indicating the degree to which these middle items C1 to C3 contribute to the skin condition A. The degree to which brightness (whiteness) B1 contributes to the color C1 of the middle item is the coefficient value b1, and the contribution degree of the color B2 is the coefficient value b2. For example, the coefficient value b1 is more than the coefficient value b2. If it is larger, it means that the brightness (whiteness) B1 contributes more to the apparent skin condition A than the color B2.

Further, as described in the first embodiment, the central processing unit 13 can diagnose each of the diagnostic items B1 to B28 by analyzing the entire face image data of the customer who is the subject. The evaluation result can be scored. In the first embodiment, the level is specified by comparing the skin condition with the reference data for each diagnostic item. Here, a value representing the level is used as an evaluation point.
Therefore, if the evaluation points related to the diagnostic items B1 to B28 are represented as {B1} to {B28}, the evaluation points of the middle items C1 to C3 and the evaluation points of the skin condition A are represented with {}, respectively. The evaluation points {C1}, {C2}, {C3} of the middle items and the evaluation point {A} of the skin state are expressed by the equations (1) to (4) in FIG.
Therefore, the central processing unit 13 obtains the evaluation points {B1} to {B28} of the diagnostic items B1 to B28, and uses the arithmetic expressions (1) to (4) shown in FIG. The evaluation score {A} can be calculated.

  In addition, each coefficient value included in the arithmetic expressions (1) to (4) shown in FIG. 9 is a value that differs depending on the age of the subject. This is because the factors that affect the appearance of the skin are different depending on the age. For example, in younger age, there is generally skin gloss and skin irritation, but in such age, graininess and wrinkles around the eyes may be more noticeable than in older age groups. . That is, in the twenties, the fineness B9 and the wrinkles B24 around the eyes are more likely to contribute to the middle items that are elements of the beauty of the skin than the other diagnostic items. Also, in the forties, if there are wrinkles in the cheeks, it will seem like you are suddenly getting older, but if you are over 50, you will be worried about other items more than cheeks. . Thus, when evaluating the beauty of the skin, there are differences in the parts and items to which attention is paid. Therefore, in this system, each coefficient value is determined by age and stored.

The coefficient value can be determined as follows, for example.
First, it is assumed that the data structure in which the above-described arithmetic expressions (1) to (4) hold is as shown in FIG. And while calculating | requiring the score {B1}-{B28} of a diagnostic item from the measurement data of the customer according to an actual age group, the customer's appearance, ie, a skin condition, is evaluated visually, and evaluation score {A} is determined. Then, a covariance structure analysis or the like is performed using the visually evaluated evaluation score {A} and the scores {B1} to {B28} of the diagnostic items. And coefficient value b1-b28 which is the contribution degree of diagnostic item B1-B28 with respect to each middle item C1-C3, and c1-c3 which is the contribution degree of each middle item C1-C3 with respect to the evaluation score {A} of a skin state Is calculated.

In this way, the calculated coefficient values are stored in the skin determination reference database 17 in association with the diagnosis items B1 to B28 and the middle items C1 to C3.
In order to calculate the coefficient value, a coefficient value that is more realistic when there are a large number of combinations of visual evaluation points {A} and points {B1} to {B28} based on measurement data is obtained. Can be sought. The visual skin condition can be evaluated by an expert who is accustomed to diagnosing the skin condition, or statistically processing the results of many amateurs.

As described above, the visually evaluated evaluation score {A} used when determining the coefficient value is the visual evaluation score of the present invention. The coefficient value is converted into the central processing unit 13 of this system. , The central processing unit 13 can calculate the evaluation point {A} of the skin condition close to that visually evaluated.
As described above, the central processing unit 13 analyzes the whole face image data transmitted from the data collection system 1 for each diagnosis item, scores the diagnosis result, and based on the score, evaluates the evaluation score { C1} to {C3} are calculated, and further, an evaluation score {A} of the skin state is calculated.

  And if the evaluation score {A} of a customer's skin condition is calculated, the said central processing part 13 will transmit the result to the data collection system 1 via the transmission / reception part 12, and will make it display on the display part 3. To do. However, as the display data to be displayed by the display unit 3, the central processing unit 13 creates display data for displaying the calculated evaluation score of each item and the coefficient value corresponding to the item on the same screen. I have to. The display screen by this display data is a graph shown in FIG. 11 and FIG. 12, for example.

  FIG. 11 represents the overall skin condition A with two stars, “☆☆”, and the evaluation points and coefficient values of the intermediate items C1 to C3 corresponding to the skin condition A. The evaluation point {A} of the skin condition is indicated by an asterisk, and the greater the number, the better the condition and the more beautiful it looks. This evaluation score {A} is a value calculated by the equation (4) in FIG. 9, and here, the number of asterisks “☆” is determined according to the evaluation score.

Further, in FIG. 11, the horizontal axis represents each of the middle items C1, C2, and C3, the vertical axis represents the evaluation point of each item, and the size of the evaluation points {C1}, {C2}, and {C3} is the length of the dotted line. The coefficient values c1, c2, and c3 are represented by circle diameters. However, the center position of each circle is the value of the evaluation score of each of the middle items C1 to C3.
Therefore, a value obtained by multiplying the evaluation points {C1}, {C2}, {C3} corresponding to the lengths of the respective dotted lines by c1, c2, c3 corresponding to the diameters of the circles is a skin condition evaluation score { A}.

From FIG. 11, it is possible to grasp where there is a factor that the evaluation point {A} of the skin state is two stars “☆☆”. In the case of FIG. 11, it can be seen that the evaluation point of the color C1 is the lowest and the evaluation point of the unevenness C2 is high. Further, the coefficient value of the color C1 is larger than the coefficient value of the unevenness C2.
In such a case, it is considered that improving the color C1 and raising the evaluation score can improve the overall evaluation score {A} more efficiently than improving the unevenness C2 that is currently at a good level. It is done.

  FIG. 12 is a graph in which the evaluation points of the diagnostic items constituting the color C1, which is the middle item, are represented on the vertical axis, and the coefficient values of the diagnostic items B1 to B8 are represented by circles. From this graph, not only the advantages and disadvantages of the customer are clarified, but it is possible to grasp which items are effective for improving the evaluation score of the color C1. For example, it can be seen from FIG. 12 that the evaluation result of the dull B3 of the entire face is low and the coefficient value is large in this customer diagnosis result. Thus, it can be seen that improving the dullness of the entire face is effective for improving the overall skin condition.

  Then, when the middle item evaluation point shown in FIG. 11 is displayed on the screen in the display unit 3 on the data collection system 1 side, when the item name is clicked to select the middle item color C1, the graph shown in FIG. Is displayed on the screen. However, here, an example is shown in which the color C1 is selected from the three middle items, but even when another middle item is selected, a graph of the evaluation points of the diagnostic items corresponding to the middle item is displayed. I have to.

In the system of the second embodiment, the comprehensive skin state as the beauty of the appearance skin can be quantitatively evaluated. In addition, points to be improved are clarified by showing the evaluation points of middle items and diagnosis items for deriving the evaluation points of the overall skin condition.
Furthermore, if the coefficient value of each item is displayed, the customer or the store clerk of the cosmetic store can know the item that can efficiently raise the evaluation point of the skin condition.

In the second embodiment, the diagnostic items are classified into the middle items, and the evaluation points and coefficient values of the middle items are displayed as shown in FIG. 11 to improve the skin condition more efficiently. This is to make it possible.
If only the evaluation points of all the diagnosis items are displayed without providing the middle item, it can be considered that the diagnosis item having the lowest evaluation point needs to be improved.

For example, among all diagnostic items B1 to B28, if the lowest diagnostic item is acne / acne scars B15 (see FIG. 8), the acne / acne scars are the best if the evaluation score for the middle item is unknown. I think it must be improved.
However, actually, the middle item is set, and the evaluation points are as shown in FIG. The middle item including the acne / acne mark B15 is unevenness C2, but as shown in FIG. 11, the evaluation point of unevenness C2 is high and the evaluation point of color C1 is lower. This means that the evaluation score of each diagnostic item included in the color C1 of the middle item is not the lowest point, but is low overall.

  Moreover, the coefficient value c1 of the color C1 is larger than the coefficient value c2 of the unevenness C2. In this case, it is more effective to raise the evaluation score of the color C1 than to improve the acne / acne mark B15 and raise the evaluation score of the unevenness C2, in order to raise the evaluation score of the overall skin condition. Specifically, in order to raise the evaluation point of the color C1, it is necessary to execute a care method for improving the dull B3 of the entire face, the dull B4 of the lips, the brightness B1, and the like. However, if the middle item is not set, it is difficult to understand that improving the items included in the color C1 is effective for raising the overall score of the skin condition. In the system of the second embodiment, there is no such thing and it is easy to clarify effective improvement items.

Furthermore, if the middle item is set so that diagnostic items improved by the same care method are classified into the same middle item, a method of improving the skin condition more efficiently by the evaluation score of the middle item. Can be revealed.
An example of the middle item based on such a care method is shown in FIG.
The middle items shown in FIG. 13 are whitening C1, blood circulation C2, moisturizing C3, astringent C4, sebum / square plug C5, sagging C6, dry wrinkle C7, and aging wrinkle C8. The whitening C1 classifies brightness B1, tint B2, dullness B3 of the entire face, stain / sobacus B5, and the like as diagnostic items corresponding to the skin condition changed by the whitening makeup method.

Similarly, the blood circulation C2 is a diagnosis item for a skin condition that changes depending on whether the blood circulation is good, the moisture retention C3 is a diagnosis item for a skin condition that changes due to moisture retention, and the convergence C4 is a diagnosis of a skin condition that changes according to a convergent makeup method. The item, sebum / square plug C5, classifies diagnostic items of skin condition related to sebum / square plug. In addition, the sagging C6, the dry wrinkle C7, and the aging wrinkle C8 are classified into diagnostic items for skin conditions related to sagging skin, dry wrinkles, and aging wrinkles, respectively.
In FIG. 13, the diagnosis item names classified into the middle items are omitted and only the reference numerals are shown, but the reference numerals used here are the same reference numerals B1 to B28 as those used in FIG. 8. Each diagnosis item is associated with a coefficient value that is a degree of contribution to the middle item.

However, in the classification method shown in FIG. 13, the same diagnostic item may correspond to a plurality of middle items. For example, the bear B8 of the diagnostic item is classified into the middle item of both the whitening C1 of the middle item and the blood circulation C2. This is because the cause of the bear may be melanin bias or poor circulation.
As described above, the coefficient value of the diagnostic item classified into a plurality of middle items is a degree of contribution to the middle item to which the diagnostic item is classified, and therefore may have a different value for each middle item.
Moreover, when calculating the evaluation score of the skin condition A by associating the coefficient values with the intermediate items C1 to C8 and combining them together, each evaluation score is similar to the arithmetic expression shown in FIG. The coefficient values corresponding to are multiplied and summed.

In addition, since the system of the present invention can connect a plurality of data collection systems 1 to the data analysis system 11 via communication, the customer database 15 and the face image database 16 are collected at a plurality of stores. Customer information and face images can be registered. Moreover, the analysis results in the central processing unit 13 can be accumulated.
In this way, if customer data nationwide, facial images collected from customers, etc. are accumulated in the management center, it is possible to analyze the data and grasp regional differences in the customer's skin condition.

Further, since data of a large number of customers that cannot be collected can be accumulated in only one store, a pattern of face shape and skin characteristics can be created from these data, and the data can be divided into patterns.
Furthermore, if a large amount of data is accumulated and the standard and tendency of the skin condition according to the age can be grasped, the data can be used for the future prediction of the face shape and the skin condition.
For example, changes in face shape and skin condition can be predicted based on logic as shown in FIGS.

That is, as shown in FIG. 14, the customer's full-face image is enlarged, the skin's skin is estimated from the shape and flow of the mouth texture, and is classified into the “having” type or “having no” type. To do. In the case of “having a beam” type, the face shape can be further classified into “fluff type” and “slender type”, and the change tendency can be specified.
Further, as shown in the example of FIG. 15, the customer's full face image is enlarged, the moisture level of the skin is estimated from the degree of cheek texture and the flow condition, and the pore size and square plugs are estimated. Estimate sebum level from condition and age. Then, it is classified into “high water” type or “low water” type, and “low water” type is further divided into “high sebum” type and “low sebum” type, and each change Trends can be identified.

If a future predicted face image that predicts the future of the customer based on the change trend specified as described above is created and output, the future predicted face image can be displayed on the data collection system 1 side. .
Specifically, as shown in FIG. 16, according to age, there are four types according to the presence or absence of a beam, “fluffy type” and “slender type”, and each type has an average with an average value of the skin condition. Match face data.

  The average face data is a value calculated for each type of customer data collected in the past, classified by age, face type, and presence / absence of the beam. The average value of the diagnostic item is associated with each type. Yes. Such average face data is stored in advance in, for example, the skin determination reference database 17 on the data analysis system 11 side. In the implementation, four types of data are associated with all ages, but in FIG. 16, “slender type” data is partially omitted.

  In addition, for example, the evaluation point of the diagnostic item beam B16 described in the second embodiment and the vitality C3 of the middle item are set for each age as to whether the above type is “having a beam” or “no beam”. It can be specified by whether it is above or below the standard value. And here, as shown in FIG. 16, the presence or absence of a beam is classified by the vitality level based on the evaluation score of the vitality C3. This vitality level represents that the vitality is lost in the order of level 1 to level 8.

When the future face image of the customer who actually visits the data collection system 1 is predicted, the entire face image of the customer is taken as in the first and second embodiments described above. Then, the data analysis system 11 analyzes the skin state and analyzes the contour of the customer's face from the whole face image, and specifies whether the customer's face type is “fluffy” or “sloppy”. .
Thereafter, from the skin diagnosis result, the presence or absence of a beam is specified from the evaluation point of vitality C3, and the customer belongs to any of the above four types.
For example, in the case of a 40-year-old, “fluffy type” and no beam type, the customer enters type T1 in FIG. And this type T1 becomes type T2 after 10 years.

Therefore, when predicting the face of the customer after 10 years, the predicted face image is created in the future by applying the average value regarding the type T2 skin condition to the face image of the customer. For example, the wrinkle state corresponding to the evaluation score of the forehead wrinkles in the average face is expressed on the customer's face image.
However, when the customer is in a skin state far from the average face of the type corresponding to his / her age, it may be corrected.

For example, the average vitality level of type T1 is 4, but the vitality level of the customer may be 3. On average, in the case of the above-mentioned customer, it changes from 40 to 50 years old to vitality level 4-5, but since the above customer is 40 years old and vitality level 3, the 50-year-old thinks that the vitality level is 4 plus 1. Try to express skin condition corresponding to vitality level.
In this way, the created future predicted face image can be transmitted from the central processing unit 13 to the data collection system 1 and displayed on the display unit 3.

As described above, it is immeasurable that various analyzes can be accurately performed by accumulating a large number of data in the data analysis system 11 of the management center.
In addition, separating large data processing equipment for high-precision analysis from data collection systems increases the number of stores where small data collection systems can be installed, allowing more data to be collected at the management center. Become.

Further, the central processing unit 13 of the data analysis system 11 selects a skin care method from the care database 18 or selects a product from the product information database 19 according to the skin diagnosis result, and the data. May be transmitted to the data collection system 1.
For example, the maintenance database 18 stores a table in which reference points corresponding to the diagnostic items are associated with various maintenance methods. Then, when there is an item that does not satisfy the reference point in the skin condition diagnosis result, the central processing unit 13 extracts a care method corresponding to the item.

The product information database 19 stores product information, but each product is stored in association with a care method using the product. For example, moisturizing lotions and beauty liquids are classified as “moisturizing”, and whitening products are classified as “whitening”. Further, the diagnostic items and the middle items are associated with each care method, and products are extracted based on the evaluation points of the items.
For example, when the middle items described in the second embodiment are set from the viewpoint of care as shown in FIG. 13, products are associated with the respective middle items, and the correspondence table is stored in the product information database 19. If stored, products necessary for improving the skin condition can be automatically extracted based on the evaluation score of the middle item. However, since product brands are often prepared by age, in this case, the correspondence table must be prepared by age.

  In this way, the central processing unit 13 can extract the beauty information of the present invention such as a care method according to the customer's skin condition and product information, and display it on the display unit 3 of the data collection system 1. it can. Even if the store clerk is a new employee, like a veteran, you can explain how to care and products that match your customers.

1 is an overall configuration diagram of a system in a first embodiment of the present invention. It is a schematic diagram of all face image data to be analyzed by the data analysis system. It is explanatory drawing of an analysis site | part. It is the figure which showed the whole face image in which the diagnostic result was reflected. It is the figure which showed the example of a display of a diagnostic result, and is an example which displays a skin state level with a full face image. It is a graph showing the level of the skin condition. It is the figure which showed the example of a display of the diagnostic result of 1st Embodiment, and is an example which displays an enlarged image with a full face image. It is the table | surface which showed the relationship of the diagnostic item of 2nd Embodiment, a middle item, and each coefficient value. It is an arithmetic expression for calculating the evaluation score of the middle item and the evaluation score of the skin condition. It is a figure which shows the data structure of 2nd Embodiment. It is the diagnostic result display screen of 2nd Embodiment, and is the figure which showed the evaluation score of the middle item. It is a diagnostic result display screen of a 2nd embodiment, and is a figure showing an evaluation point of a diagnostic item. It is the table | surface which showed the example of a setting of the middle item. It is the figure which showed the example of the aging simulation logic of a face shape. It is the figure which showed the example of the aging simulation logic of a skin state. It is the figure which showed the example of the reference data of future face prediction.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Data collection system 2 Imaging | photography part 3 Display part 6 Processing part 7 Transmission / reception part 11 Data analysis system 12 Transmission / reception part 13 Central processing part

Claims (8)

  A data collection system and a data analysis system that performs analysis processing based on data collected by the data collection system are connected via communication means, and the data collection system transmits and receives data to and from the data analysis system. Collecting-side communication means for performing image capturing, image capturing means for capturing an ultra-high-definition digital image capable of analyzing the texture of the skin, and collecting-side image data for compressing the image data by a high compression method that suppresses block noise The data analysis system includes a compression unit and a collection side data display unit, and the data analysis system includes an analysis side communication unit that transmits and receives data to and from the data collection unit, a data analysis unit that analyzes image data, and image data The image data compression means on the analysis side for compressing the image data by a high compression method that suppresses block noise, and the data Analyzing-side data storage means for storing the analysis result by the analyzing means, wherein the image capturing means captures the entire face image of the subject as an ultra-high-definition digital image, and the collecting-side image data compressing means comprises the all-face image The compressed image data is generated, and the compressed image data is generated and transmitted to the data analysis system via the collecting communication means. The data analyzing means receives the compressed image data via the analyzing communication means, and receives the compressed image data. Analyzes the skin condition of the subject based on the compressed image data, generates visual information reflecting the analysis result in the whole face image, and outputs the visual information as a diagnostic result. The image data compression means compresses the diagnosis result output from the data analysis means to generate compressed image data, and sends the compressed image data to the data collection system via the analysis side communication means. Shin, and the collected side data display means, the skin condition diagnosis system comprising the function of displaying the diagnosis result transmitted from the analysis-side communication means.   The data analysis system includes a storage unit that stores a plurality of diagnosis items related to the skin condition, and the data analysis unit analyzes the skin condition for each diagnosis item from all face image data, and based on the analysis result The skin condition diagnosis system according to claim 1, further comprising a function of calculating an evaluation score and reflecting an evaluation result corresponding to the evaluation score on the entire face image.   The storage means classifies and stores the plurality of diagnostic items into at least two or more types of intermediate items, and stores coefficient values in association with the intermediate items and the diagnostic items, respectively, and the data analysis means Calculates the score for each diagnostic item obtained by multiplying the calculated score for each diagnostic item by the coefficient value corresponding to that diagnostic item to calculate the middle item evaluation score for each middle item. The skin condition diagnosis system according to claim 2, further comprising a function of multiplying the evaluation score by a coefficient value corresponding to the middle item and calculating the score of the skin condition by counting the multiplied scores.   4. The coefficient value is a value calculated by analyzing a relationship between a visual evaluation point of a visually determined skin condition and an evaluation point for each diagnosis item calculated by the data analysis unit. Skin condition diagnosis system.   The skin condition diagnosis system according to claim 3, wherein the data analysis means has a function of generating display data for displaying the calculated evaluation score and the coefficient value corresponding to the calculated item on the same screen.   The data analysis means includes: a process for identifying facial morphological elements from a whole face image received from a data collection system; a process for identifying a diagnostic item; and a diagnostic part on the whole face image according to the identified diagnostic item And a process for analyzing a feature on an image that appears in accordance with a skin condition corresponding to a diagnostic item in the diagnostic part. The skin condition diagnosis system according to any one of 5.   A data collection system and a data analysis system that performs analysis processing based on data collected by the data collection system are connected via communication means, and the data collection system transmits and receives data to and from the data analysis system. Collecting-side communication means for performing image capturing, image capturing means for capturing an ultra-high-definition digital image capable of analyzing the texture of the skin, and collecting-side image data compressing means for compressing image data by a high compression method that suppresses block noise And a collection-side data display means, the data analysis system comprising: an analysis-side communication means for transmitting / receiving data to / from the data collection means; a data analysis means for analyzing image data; and blocking image data Analysis side image data compression means for compressing by a high compression method with suppressed noise, and the data analysis means Analysis-side data storage means for storing the analysis results, and change tendency storage means for storing a time-dependent change tendency corresponding to a predetermined skin condition and face shape pattern classification, wherein the image capturing means is the subject's The entire face image is captured as an ultra-high-definition digital image, and the collection-side image data compression unit compresses the entire face image to generate compressed image data, and transmits this to the data analysis system via the collection-side communication unit. A data analysis unit that receives the compressed image data via the analysis-side communication unit, analyzes the skin condition of the subject based on the received compressed image data, and converts the analysis result into the full-face image. Generates reflected visual information, outputs the visual information as a diagnostic result, and identifies the pattern from the subject's skin condition and face shape, and corresponds to this pattern A function to identify the tendency to change from the data stored in the change trend storage means and the future prediction of the skin condition and face shape of the subject based on the specified change trend, and the prediction results for all faces The analysis side image data compression means compresses the future prediction face image output from the data analysis means, generates compressed image data, and analyzes it. A skin condition diagnosis system comprising a function of displaying a future predicted face image transmitted from the analysis side communication means, which is transmitted to the data collection system via the side communication means.   A data collection system and a data analysis system that performs analysis processing based on data collected by the data collection system are connected via communication means, and the data collection system transmits and receives data to and from the data analysis system. Collecting-side communication means for performing image capturing, image capturing means for capturing an ultra-high-definition digital image capable of analyzing the texture of the skin, and collecting-side image data for compressing the image data by a high compression method that suppresses block noise The data analysis system includes a compression unit and a collection side data display unit, and the data analysis system includes an analysis side communication unit that transmits and receives data to and from the data collection unit, a data analysis unit that analyzes image data, and image data Image data compression means for compressing the image data by a high compression method that suppresses block noise, and the data solution An analysis-side data storage means for storing the analysis result by the means, and a beauty information storage means for storing beauty information such as cosmetic information, and the image capturing means converts the entire face image of the subject as an ultra-high-definition digital image. The capture and collection-side image data compression means has a function of compressing the whole face image to generate compressed image data and transmitting it to the data analysis system via the collection-side communication means. Receiving the compressed image data via the side communication means, analyzing the skin condition of the subject based on the received compressed image data, generating visual information reflecting the analysis result on the whole face image, A function of outputting visual information as a diagnosis result, and a function of extracting and outputting beauty information suitable for the subject from the beauty information storage means based on the analysis result, The data compression means compresses the diagnosis result output from the data analysis means to generate compressed image data, transmits this together with the extracted beauty information to the data collection system via the analysis side communication means, The collection-side data display means has a function of displaying the diagnosis result and beauty information transmitted from the analysis-side communication means.

Images