JP7264959B2 - Information output system for skin condition care - Google Patents

Description

TECHNICAL FIELD The present invention relates to an information output system relating to skin condition care.

Conventionally, various tools are known for the care of skin conditions.

For example, Patent Literature 1 describes a skin condition explanation part for explaining typical patterns of skin condition as a counseling tool used for users by cosmetics salespersons, etc. describes a counseling tool provided with an explanation display part of a skin care method necessary for skin care.

The skin condition explanation part has a subheading of "a condition that tends to be dehydrated" as a typical pattern of skin conditions, and a subheading of the skin condition in question, "The barrier function that protects the skin from external stimuli is also likely to decrease, … is considered.” Here, "W moisturizing" and "lotion mask/cream" respectively indicate types of skin care methods or products used for skin care.

The description display portion of the skin care method includes the headings "Somewhat insufficient W moisturizing" and "Insufficient W moisturizing + lotion mask/cream" as skin care methods for the relevant skin condition.

For example, when judging that the customer's skin condition is slightly lacking in moisture, the cosmetics salesperson recommends that the customer perform "double moisturizing" displayed in the explanation display part of the skin care method. By comparing the condition with the counseling tool, it is possible to immediately present the user with measures according to the skin pattern.

Japanese Patent No. 4299080

In recent years, when the use of mobile terminals such as smartphones has developed, it is conceivable to provide users with information that supports skin condition care via mobile terminals. However, users do not always have sufficient knowledge about the physical condition of their skin. For users who do not have sufficient knowledge about the physical condition of the skin, support for skin condition care for people who are familiar with the physical condition of the skin to some extent, such as cosmetics salespeople, like the technology of Patent Document 1. Even if the tool is used, care for a skin condition contrary to the user's wishes may be recommended.

Therefore, the present invention appropriately outputs information to support the realization of the impression or state of mind indicated by the user's request, even if the user does not have sufficient knowledge about the physical state of the skin. It is an object of the present invention to provide an information output system, an information output program, and an information output method that can

The information output system of the present invention is
an output unit that outputs information;
Acquisition of subjective evaluation result data of the user's skin condition by the user himself or objective evaluation result data of the user's skin condition obtained based on the image of the user's skin, and the acquisition a user skin condition recognition unit that recognizes the score of the user's skin condition based on the data of the skin condition evaluation results obtained ;
a request recognition unit that receives input of information by the user and recognizes a request regarding the user's impression or state of mind based on the input information;
a replacement unit that replaces the user's skin condition score with a score indicating the user's impression or the user's mental state;
an output control unit that outputs to the output unit the impression of the user or the score indicating the state of mind of the user that has been replaced by the replacement unit;
The user's skin condition score is represented by a set of scores of a plurality of items indicating the user's skin condition,
The replacement unit recognizes an item corresponding to a request regarding the user's impression or state of mind recognized by the request recognition unit from among a plurality of items indicating the user's skin condition, and corresponds to the recognized item. by recognizing a predetermined coefficient and the score of the recognized item, and calculating a weighted average of the scores of the item according to the coefficient, so that the score of the user's skin condition is expressed as the user's impression or the user's mind is replaced with a score that indicates the state of

According to the information output system having this configuration, the user's skin condition recognizing unit provides data of subjective evaluation results of the user's skin condition by the user himself/herself, or data of the user's skin obtained based on the image of the user's skin. Objective skin condition evaluation result data is acquired, and a skin condition score of the user's skin condition is recognized based on the acquired skin condition evaluation result data . Then, the replacing unit replaces the score of the user's skin condition recognized by the user's skin condition recognizing unit with a score indicating the user's impression or the user's state of mind. Note that the replacing unit recognizes an item corresponding to the user's impression or desire regarding the state of mind recognized by the request recognizing unit from a plurality of items indicating the user's skin condition, and determines a predetermined item corresponding to the recognized item. The score of the user's skin condition indicates the user's impression or the user's state of mind by recognizing the coefficient and the score of the recognized item, and calculating the weighted average of the score of the item according to the coefficient. Replace with score. Then, the score indicating the impression of the user or the state of mind of the user is output to the output unit by the information output unit. This allows the user to recognize the user's impression or the user's state of mind according to the user's skin condition . Even if the user does not have sufficient knowledge about the skin condition, it is easy for the user to understand if the score is in line with the user's impression or the user's state of mind.

In the information output system with this configuration,
There are a plurality of types of requests regarding the user's impression or the user's state of mind,
The output control unit is configured to output to the output unit a product or service selection screen associated with the user's impression or the type of request regarding the user's state of mind,
The request recognition unit receives an input of selection of the product or service by the user, and generates information indicating a correspondence relationship between the product or service selected from the selection screen and a request regarding the user's impression or state of mind. to recognize the user's impression or state of mind desire associated with the selected product or service among the plurality of types of the user's impression or state of mind desire. preferably configured.

Or in the information output system of the configuration,
There are a plurality of types of requests regarding the user's impression,
The output control unit is configured to output to the output unit a selection screen of words representing the user's impression, which is associated with the type of request related to the user's impression,
The request recognizing unit receives an input of a selection of words expressing the impression of the user by the user, and indicates a correspondence relationship between the words expressing the impression of the user selected from the selection screen and a request related to the impression of the user. By referring to the information, it is configured to recognize the user's impression-related request associated with the selected word expressing the user's impression among the plurality of types of the user's impression-related requests. preferable.

Or in the information output system with such configuration,
There are multiple types of requests regarding the state of mind of the user,
The output control unit is configured to output to the output unit a selection screen of words expressing the user's self-confidence associated with the type of request regarding the user's state of mind,
The request recognizing unit receives an input of selection of a word expressing the user's confidence by the user, and a correspondence relationship between the word expressing the user's confidence selected from the selection screen and a request regarding the state of mind of the user. by referring to the information indicating the state of mind of the user, and recognizing a request regarding the user's state of mind associated with the selected words expressing the user's confidence among the plurality of types of requests regarding the user's state of mind. preferably configured.

Or in the information output system of the configuration,
There are a plurality of types of requests regarding the user's impression or the user's state of mind,
The request recognition unit is configured to provide information about the user's age, gender, occupation, area of residence, or personality, which is associated with the user's impression of the user or the type of request regarding the user's state of mind. Receiving input of attribute data, referring to information indicating a correspondence relationship between the input attribute and a request regarding the user's impression or state of mind, and making a request regarding the user's impression or state of mind Preferably, it is configured to recognize the user's impression or desire regarding the state of mind associated with the attribute among the plurality of types of the attribute.

Explanatory drawing of the utilization form of a skin support server. FIG. 2 is a configuration diagram of a skin support server and user terminals; Explanatory drawing of a series of skin support processing by a skin support server. The first flowchart of processing in the skin support server. A second flowchart of processing in the skin support server. 4 is a first flowchart of processing in a user terminal; The second flowchart of processing in the user terminal. Explanatory drawing of the analysis processing of the initial data of the skin, the mind, and the body based on the subjective data and the objective data. Explanatory drawing of digitization of a body state. Explanatory drawing of digitization of the state of mind. FIG. 11A is a diagram showing the relationship between each measure and its improvement trend, etc., FIG. 11B is a diagram showing the schedule of each process, and FIG. illustration. Explanatory diagram of a progress table based on daily monitoring during the period of image display. Explanatory drawing of the influence on the skin condition by a special case. FIG. 10 is an explanatory diagram of a display screen of a skin condition improvement degree on a user terminal; 15A is an explanatory diagram of an evaluation method of measures, FIG. 15A shows evaluation criteria of measures, and FIG. 15B shows an example of evaluation of measures. It is explanatory drawing of the evaluation method of a living and a special case, FIG. 16A shows the evaluation criteria of a living and a special case, and FIG. 16B shows the evaluation example of a living and a special case. Explanatory drawing of the determination method of a goal achievement level. Explanatory drawing of secondary data. An example of a flowchart of request realization measure recognition processing. An example of a flowchart of request recognition processing. FIG. 11 shows a product or service selection screen; FIG. 22A is a table that associates product or service names with impressions or state of mind desires, and FIG. 22B is a table that associates impressions or confidence designations with impressions or state of mind desires. An example of a flowchart of request recognition processing. An example of a flowchart of request recognition processing. An example of a flowchart of policy recognition processing. FIG. 26A is a table that associates user IDs, user attributes, lifestyle habits, and constitutions, and FIG. 26B is a table that associates user IDs, user requests, user measures, and their evaluations. The figure which shows an example of a measure recommendation screen. An example of a flowchart of policy recognition processing. FIG. 29A is a table that associates requests, objective response items, and target states; FIG. 29B is a table that associates objective response items, subjective response items, and coefficients; FIG. 29C is a table that associates objective response items, target states, and measures. FIG. 29D is a table in which measures and priorities are associated. . An example of a flowchart of policy recognition processing. An example of a flowchart of skin condition corresponding information output processing. FIG. 32A is a table that associates corresponding objective items, previous scores, and current scores, and FIG. 32B is a table that associates requests, corresponding objective items, and coefficients. An example of the display screen of the score corresponding to the request. An example of a flowchart of alternative measure recommendation processing.

An example of an embodiment of the present invention will be described with reference to FIGS. 1 to 18. FIG.

[A. Usage form of skin support server]
The configuration of the skin support server 10 and its positioning with respect to the system constituting the present invention will be described with reference to FIG. The skin support server 10 is configured by a computer system including a CPU, memory, various interface circuits, and the like. The skin support server 10 executes an image display program held in a memory by a CPU to improve or maintain the skin condition of a plurality of users U (Ua, Ub, and Uc are exemplified in FIG. 1). A function to execute processing (image display processing) is realized.

The skin support server 10 performs data communication with communication terminals (user terminals) 30 (30a, 30b, and 30c are illustrated in FIG. 1) of a plurality of users U via a communication network 1 such as the Internet. , to support the improvement or maintenance of the user U's skin condition. A system configured by the skin support server 10 and the user terminal 30 corresponds to an example of the "information output system" of the present invention.

Communication terminals 50 (50a and 50b are exemplified in FIG. 1) of persons in charge T (Ta and Tb are exemplified in FIG. 1) are also connected to the communication network 1. FIG. The person in charge T sends data including information such as appropriate skin care methods considering the characteristics of the user U's skin, hobbies and tastes, lifestyle, etc. to the skin support server 10 and the user terminal 30 via the communication terminal 50. By transmitting the information, advice on improvement of the user U's skin condition is given. The communication terminal 50 of the person in charge T and the user terminal 30 of the user U do not necessarily have to be one-to-one. It is only necessary to provide the user terminal 30 of the user U with advice on improving U's skin condition. For example, a method of providing advice to one or a plurality of user terminals 30 of a user U by a plurality of persons in charge T via respective communication terminals 50 may be used.

Furthermore, the skin support server 10 has a function of analyzing unique data of each user transmitted from the user terminals 30 of a plurality of users U and generating secondary data that can be used for general purposes. Services that provide data to other systems 60 via the communications network 1 may also be provided.

[B. Configuration of skin support server and user terminal]
The configurations of the skin support server 10 and the user terminal 30 will be described with reference to FIG. The skin support server 10 functions as a skin condition recognition unit 11, a measure group selection unit 12, a measure information transmission unit 13, and a secondary data generation unit 19 by executing the information output program held in the memory by the CPU. . Processing by these configurations will be described later. The skin support server 10 also includes a support DB (database) 20 that holds various data used for user U's image display processing. This support DB 20 is developed, for example, on a RAM, and can be rewritten by updating subjective and objective data, which will be described later.

Next, the user terminal 30 of this embodiment includes a display 31, a touch panel 32, a camera 33, a microphone 34, a CPU 35, a memory 36, and the like. The display 31 corresponds to the "output section" of the present invention. The touch panel 32 corresponds to the "input section" of the present invention. Instead of or in addition to this, by recognizing the designation of the user based on the image of the user U captured by the camera 33 or the voice of the user U input from the microphone 34, the camera 33 or the microphone 34 can be used as the " It may function as an "input unit".

It should be noted that the fact that one device "recognizes" information means that one device receives the information from another device, and that one device recognizes information stored in a storage medium connected to the one device. reading, obtaining information by a device based on a signal output from a sensor connected to the device, or obtaining information received by a device or information stored in a storage medium or from a sensor Derivation of the information by executing predetermined arithmetic processing (calculation processing, search processing, etc.) based on the information obtained, one device passing the information as a result of arithmetic processing by another device to the other device It means that any arithmetic processing for obtaining the information is performed, such as receiving from, or reading the information from an internal storage device or an external storage device according to the received signal.

In the present embodiment, the user terminal 30 is, for example, a smart phone, and is equipped with a camera 33, a microphone 34, and the like. Alternatively, a specialized imaging device may be used. The CPU 35 executes a program of an image display application 35a (hereinafter referred to as a skin support application 35a) held in the memory 36 so that the user U can receive support from the skin support server 10 via the skin support application 35a. make it possible. The CPU 35 executing the skin support application 35a executes the "request recognition unit", the "measure recognition unit", the "output control unit", the "other user evaluation recognition unit", the "user information recognition unit", the "other user information recognition unit", and the "matching ``skin condition recognition part'', ``user behavior recognition part'', ``action evaluation part'', ``corresponding skin condition recognition part'', ``user skin condition recognition part'', and ``replacement part''.

In addition, the user U separately has a keratin collecting tape 37 (37a, 37b, and 37c are illustrated in FIG. 1) for obtaining skin cells. The keratin collecting tape 37 may be provided to the user U in advance by the person in charge T, or the user U may purchase a commercially available keratin collecting tape 37 .

In the following description, for convenience of explanation, the user who is the target of the support process for improving or maintaining the skin condition is referred to as user Ua, and users different from "user Ua" are referred to as "other users Ub and Uc". .

[C. Series of processing by skin support server]
Next, a series of processes by the skin support server will be described with reference to FIG. The skin support server 10 performs "1. goal setting", "2. schedule determination", "3. monitoring", "4. schedule correction", and [5. goal determination] and “6. Secondary data generation” are executed according to the flowcharts shown in FIGS. Further, the user terminal 30 executes the processing according to the flowcharts shown in FIGS. 6 and 7 according to the processing by the skin support server 10 in each step. The processing of the skin support server 10 and the CPU 35 of the user terminal 30 in each step will be described below with reference to the flowcharts shown in FIGS.

In STEP 50 of FIG. 6, the user Ua downloads the program of the skin support application 35a to the user terminal 30 and activates the skin support application 35a. Then, the user Ua applies for registration with the skin support application 35a.

When the skin support server 10 receives the registration application from the user Ua in STEP10 of FIG. Then, image display processing after STEP 11 is started.

[D. Goal setting process]
Goal setting” shown in FIG. 3 is executed by the skin condition recognition unit 11 and the measure group selection unit 12 . In STEP 11 of FIG. 4, the measure group selection unit 12 prompts the user terminal 30 to input information for grasping the current skin, body, and mental conditions of the user Ua and the skin condition desired by the user Ua. Send data.

In the user terminal 30 that has received this initial information request data, the skin support application 35a, in STEP 51 of FIG. is displayed on the display 31 to prompt the input of . In response, the user terminal 30 transmits initial user information data including the information input by the user Ua to the skin support server 10 .

The skin condition recognition unit 11 receives the initial user information data in STEP 11 of FIG. Based on this, a target score (goal) for the skin condition is set.

Here, the initial user information data includes subjective data and objective data regarding skin condition, body condition, and mental condition. Although detailed definitions will be described later, subjective data is an item determined subjectively by the user, and objective data is data based on inspection results, image analysis, and factual information. The subjective data of the skin condition includes data of the user's evaluation of the user's skin. The subjective data of the skin condition is data indicating the satisfaction level of the user Ua with respect to the current skin condition, for example, in 10 stages. The objective skin condition data includes evaluation data of the user's skin according to certain criteria or rules by a person other than the user, and data obtained from the user's skin through instruments or devices. For example, the skin condition objective data is skin image data of the user Ua. In addition to the objective skin condition data included in the initial user information data, the objective skin condition data may include analysis data of the stratum corneum cells of the user Ua collected by the horny material collecting tape 37 .

The user's evaluation of the skin of the user Ua is obtained by inputting a questionnaire in the skin support application 35a. Evaluation of user Ua's skin by user Ua himself includes, for example, oiliness, acne, pimples, conspicuous pores, dryness, dryness, firmness, tightness, transparency, fine wrinkles, dullness, dark circles, and redness of the skin. , whiteness of the skin, spots, freckles, stiffness, wrinkles, sensitivity, sagging, degree of skin aging, amount of sebum by palpation, skin feel by palpation, skin temperature by palpation, and the like. Each of these evaluations can be indicated, for example, on a scale of 10.

The skin of the user Ua is evaluated by a person different from the user Ua according to a certain standard or rule, and includes greasyness, acne, pimples, conspicuous pores, dryness, dryness, firmness, tightness, transparency, and fine wrinkles. , dullness, dark circles, skin redness, skin whiteness, blemishes, freckles, stiffness, wrinkled feeling, sensitivity, sagging, sebum amount by palpation, skin feel by palpation, skin temperature by palpation, and the like. Each of these evaluations can be indicated, for example, on a scale of 10. The evaluation can be determined, for example, by comparing the skin image data with a comparison image for each score.

A person who is different from the user Ua for the skin of the user Ua is, for example, a person in charge T, a skin expert such as an advisor of a cosmetics store. A person different from the user for the skin of the user Ua can, for example, obtain skin image data via the communication terminal 50 and make the above evaluation based on the skin image data and comparison image data.

A classifier for the evaluation may be created by machine learning such as supervised machine learning or reinforcement learning, and the evaluation may be performed using the classifier.

The data obtained through the tool or device is, for example, an image captured by the camera 33 of the user terminal 30 or an external camera connected to the connection terminal 40, and data obtained by the keratin collecting tape 37.

The skin support server 10 analyzes the data obtained by these according to certain criteria or rules to determine the amount of sebum (eligibility for sebum), water retention (water retention capacity), amount of ceramide, elasticity, blood circulation, amount of melanin, Moisture content, angle of the corners of the mouth, angle of the corners of the eyes, number of wrinkles, color of the lips, complexion of the face, etc. are evaluated. The skin support server 10 may express these in physical quantities such as 100 μg of sebum. The skin support server 10 may score these on a scale of ten, for example. Also, the skin support server 10 may represent the color of the lips, the complexion of the face, etc. with a code indicating the color.

The skin image data is image data obtained by the user Ua capturing an image of the user Ua's face using the camera 33 of the user terminal 30 or an external camera connected to the connection terminal 40 .

In addition, the skin support application 35a displays the usage of the keratin collecting tape 37 on the display 31 to the user Ua, and prompts the user Ua to use the keratin collecting tape 37 and mail it separately. The skin support application 35 a may prompt the user Ua to use the keratin collecting tape 37 and take a skin image, and the taken image may be transmitted to the skin support server 10 .

Specifically, the analytical data of stratum corneum cells are, for example, data relating to water retention capacity and sebum suitability. In this case, the stratum corneum cells are analyzed by, for example, a measuring device 45 connected to the user terminal 30 , or the image data of the keratin sampling tape 37 is transmitted from the user terminal 30 to the skin support server 10 .

The skin support server 10 may analyze the image of the exfoliating tape 37 on the skin support server 10 side to measure water retention capacity, sebum suitability, and the like.

As shown in FIG. 8, the skin condition recognition unit 11 sets the initial value of the skin condition to a subjective score of 3, a skin image score of 3, a water retention ability score of 2, and a sebum suitability score of 1. , and the total value is used as the skin condition score. The score may be represented by a decimal number instead of a positive integer, or may be represented by a negative number.

Recognition of the water retention capacity score and sebum suitability score by analysis of stratum corneum cells is called the first recognition method. Alternatively or additionally, the first recognition method is at least one of a method of measuring the moisture content of the user's skin with a stratum corneum moisture meter and a method of measuring the sebum content of the user's skin with a sebum meter. including. Further, in order to periodically recognize the user's skin by the first recognition method, the skin condition recognition unit 11 may periodically send a message to the user terminal 30 prompting the user to use the keratin collecting tape 37 or the like. prompts the user to take action. In this case, "regularly" does not have to be strictly at regular time intervals, and may be at regular intervals as long as the skin condition is not affected. For example, when the first recognition method is performed every three months, if the first recognition method is performed on January 1st, not only April 1st, which is exactly three months later, but also March, for example, one week before The message may be sent to the user terminal 30 around the 24th, or may be sent to the user terminal 30 around April 8, one week later, for example. In addition, when providing a long-term service, for example, if you want to check detailed improvements, set the first recognition method every month, and check the effect of seasonal changes on the skin condition every three months. The timing of recognition can be changed, such as by setting the first recognition method.

Recognition of a subjective score (e.g., an evaluation based on a user's book) based on subjective data on skin condition entered in a questionnaire and recognition of a skin image score based on the skin image data of the user Ua are each referred to as a second recognition method. The second recognition method may recognize the skin condition of the user Ua by either recognizing a subjective score based on subjective data of the skin condition obtained by inputting a questionnaire or recognizing a skin image score based on the skin image data of the user Ua. , may include methods different from these. Also, the second recognition method is performed more frequently than the first recognition method. This is because the use and mailing of the keratin collecting tape 37 is time-consuming, complicated, and expensive. In addition, frequent use of the keratin collecting tape 37 may adversely affect the skin of the user Ua.

For example, the first recognition method is performed every three months, and the second recognition method is performed every day. Further, when the timing of performing the first recognition method and the timing of performing the second recognition method overlap, it is preferable that they are performed at the same timing, so that accurate data can be obtained.

Note that the subjective score may be a score recognized based on subjective data.

The subjective data and objective data of body condition are separated as shown in FIG. Although detailed definitions will be described later, subjective data is an item determined subjectively by the user Ua, and objective data is data based on test results, image analysis, and factual information, similar to the subjective data and objective data of the skin. The body condition subjective data includes the user's evaluation of the user's body. The subjective data on the body condition is obtained by the user Ua inputting a questionnaire through the skin support application 35a. Objective data of the body condition is obtained by evaluating the user's body by a person other than the user (physician, etc.) according to certain standards or rules of medicine, etc., and obtained from the user's body through instruments or devices. Contains data. For example, the objective data includes image data of the tongue and lips of the user Ua captured by the user Ua using the camera 33 of the user terminal 30, user Ua measured by the measuring device 45 connected to the connection terminal 40 of the user terminal 30, and Measurement data such as Ua blood pressure, arrhythmia, urinary components, blood components, etc., and data such as the number of times of poor physical condition such as headache or stiff neck acquired by inputting a questionnaire in the skin support application 35a, fatigue level determination, etc. In preparation for future development of services other than skin care, information on the occurrence of various diseases may be included in the initial user information data.

The subjective and objective data of the state of mind are separated as shown in FIG. Although detailed definitions will be described later, subjective data is an item determined subjectively by the user Ua, and objective data is data based on test results, image analysis, and factual information, similar to the subjective data and objective data of the skin. . The subjective state of mind data includes the user's own assessment of the user's mind. The subjective data is acquired by inputting a questionnaire in the skin support application 35a. Objective data of the state of mind is data of actions related to the user's mind, which is performed on the user's mind by a person different from the user (such as a counselor or a psychiatrist) according to certain standards or rules such as psychiatry Includes evaluation and data obtained from the user's body via an instrument or device. For example, the objective data is acquired by inputting a questionnaire in the skin support application 35a (frequency of laughter per day, etc.) and measurement by a measuring device (estimation of psychological state from pulse monitoring, etc.). In preparation for future development of services other than skin care, the initial user information data may include information on the occurrence of various mental disorders.

The skin condition recognition unit 11 stores the recognized subjective data and objective data of the skin, body, and mental conditions of the user Ua in the support DB 20 .

Based on the subjective data and objective data of the user Ua's skin condition, body condition, and mental condition recognized from the initial user information data in this way, the skin condition recognition unit 11 recognizes as indicated by the triangles on the right side of FIG. , the initial values of the three axes are set, which are represented by scores of 1 to 9 for skin conditions, 1 to 6 for body conditions, and 1 to 6 for mental conditions. Similar to the skin condition score, the subjective score and objective score of the physical condition or mental condition are calculated from the subjective data and objective data of the physical condition or mental condition, and based on these, the physical condition score and the mental condition score are calculated. may be treated as

Further, the measure group selection unit 12 acquires the "desired skin score", "category, desire and frequency of measures" and "current measures" included in the initial user information data. The "desired skin score", "category, desire and frequency of measures" and "current measures" are input by the user Ua through the skin support application 35a.

Here, in the "desired skin score", "desired skin" means improvement of dryness, improvement of stiffness, improvement of sensitive skin, improvement of acne, improvement of wrinkles, improvement of spots, improvement of wrinkles, improvement of sagging, improvement of dullness, improvement of dark circles, It is a skin condition improvement target selected from complexion improvement and firmness improvement. The “score” is the degree of satisfaction of the user Ua with respect to the skin condition of each target, and is the score selected by the user on a scale of 1 to 10 in the skin support application.

The support DB 20 stores the improvement tendency of the subjective state and the improvement tendency of the objective state of the skin condition associated with each improvement target. For example, as shown in FIG. 11C , “improvement of dryness” includes subjective skin condition “improvement of dryness” and objective criterion of skin condition “minimize difference between water retention capacity and sebum suitability”. ” is associated with.

For example, when the “desired skin” is “improved dryness” and the satisfaction score for the dryness of the current skin condition is 3, it is associated with “improved dryness” according to the selection of the user Ua. A satisfaction level of 5 with respect to the subjective skin condition “improved dryness” of the user Ua is set as a subjective target score.

In addition, the measure group selection unit 12 sets an objective skin condition improvement target associated with "improvement of dryness". For example, the measure group selection unit 12 determines that the user Ua's skin condition is lower than the water retention ability based on the criterion 'minimize the difference between the water retention ability and the sebum suitability' associated with the 'dryness improvement'. A sebum suitability value of 2 is set as an objective target score.

In addition, regarding the category of policy, preference, and frequency, categories include dietary habits, activities at home, exercise, and how to use cosmetics. , "the number of times advice is received per day" or the like is selected as the frequency.

The “measure currently being taken” is a measure that the user Ua has already taken, and is represented by the content and frequency or degree of “soaking in the bathtub” or the like.

[E. Schedule decision process]
The process of “2. Determination of schedule” shown in FIG. The measure group selection unit 12 selects a measure group for achieving the goal (subjective target score and objective target score) in STEP 12 of FIG. This selection is made in consideration of the improvement tendency of the subjective skin condition, the improvement tendency of the objective skin condition, and the suitable surrounding environment, which are associated with each improvement target described above. The measure group selection unit 12 determines the temperature, humidity, etc. of the surrounding environment of the user Ua during the schedule period based on the location information detected by the GPS sensor or the like registered in advance and the date and time acquired from the clock function of the terminal. to predict.

For example, the policy group selection unit 12 selects the desired category as "activity at home, eating habits, exercise", the season when the humidity is expected to be 50% on average, such as the rainy season, and the subjective goal. If the score is 5 or more in satisfaction for "dryness" and the objective target score is 2 or more in sebum suitability, the subjective condition improvement tendency includes "dryness improvement", and the objective condition improvement tendency is "sebum eligible Select measures that include "enhancement of sexuality" and that the category is any of "home activities, eating habits, and exercise", and that the suitable surrounding environment does not contradict 50% humidity.

Here, the improvement tendency of the subjective state and the improvement tendency of the objective state may be determined in advance by an expert such as the person in charge T, or may be implemented by other users Ub and Uc stored in the support DB 20. It may be an improvement tendency of the subjective state and an improvement tendency of the objective state estimated based on the time-series change of the skin condition of the other users Ub and Uc, or the implemented measure and the skin condition of the user Ua. is stored in the support DB 20, it may be the improvement tendency of the subjective state and the improvement tendency of the objective state estimated based on the information.

For example, the support DB 20 stores measures implemented by each of the other users Ub and Uc, chronological changes in the subjective data of the skin condition of each of the other users Ub and Uc before and after implementation of the measures, and other data. One or both of chronological changes in objective skin condition data for each of users Ub and Uc are stored.

In addition, for example, the support DB 20 stores information on the measure "soaking in the bathtub" implemented by each of the other users Ub and Uc, and subjective skin conditions of each of the other users Ub and Uc before and after implementing the measure. It is assumed that "satisfaction with dry feeling" is stored as a time-series change.

At this time, for each of the other users Ub and Uc, the measure group selection unit 12 selects, for example, the subjective data of the skin condition (dry feeling) on the day before the bath and on the day of the bath for the measure “soak in the bathtub”. Calculate the amount of change in the degree of satisfaction for Then, the measure group selection unit 12 obtains the average value of the amount of change in the degree of satisfaction with respect to dryness for each of the other users Ub and Uc. For example, when the average value of the amount of change in "satisfaction with dryness" is equal to or greater than a predetermined value, the measure group selection unit 12 sets the improvement tendency of the subjective state of the measure "soak in the bathtub" to "improved dryness". Recognize. The improvement tendency of the objective state can also be recognized in the same way as the improvement tendency of the subjective state.

Based on the age and skin condition of the user Ua, the measure group selection unit 12 may narrow down the range of other users Ub and Uc to be processed, such as the same age and the same skin condition.

Further, when the implemented measures and the chronological changes in the skin condition of the user Ua are stored in the support DB, the measure group selection unit 12 estimates based on the information calculated in the same manner as described above. The improvement tendency of the subjective state and the improvement tendency of the objective state may be recognized.

In the first schedule determination process for user Ua, the measure group selection unit 12 recognizes the improvement tendency of the subjective condition and the improvement tendency of the objective condition from the subjective data and objective data of the skin conditions of the other users Ub and Uc. However, in the user Ua's second schedule determination process, the improvement tendency of the subjective condition and the improvement tendency of the objective condition may be recognized from the subjective data and the objective data of the skin condition of the user Ua.

The measure group selection unit 12 recognizes not only the skin condition but also the subjective state improvement tendency and the objective state improvement tendency for the mental state and the physical state. Measures may be selected in consideration of the improvement tendency of the objective state.

The measure group selection unit 12 may exclude measures having the same content and the same frequency or degree as the “current measures” from the measure group. This is because it is considered unnecessary to propose measures that the user has already taken.

In the example of FIG. 11A, the measure group selection unit 12 selects a measure group that is a combination of a plurality of measures so as to include "soak in the bathtub", "vitamin C intake", "vegetable intake", and "walk 10,000 steps or more". .

Furthermore, in order to select a measure according to the user's request, the skin support application 35a may proceed to STEP71 in FIG. 6 and execute the measure request process in FIG. The details of the processing of the policy request will be described later.

The policy information transmission unit 13 evaluates the priority of the policy among the policy group according to the user Ua's "policy category, desire, and frequency", and determines the initial policy according to the priority. FIG. 12 shows an example of a schedule in which "soak in a bathtub," "eat vegetables," and "walk 10,000 steps or more" are selected as initial measures. The policy information transmission unit 13 transmits schedule data indicating the details of the schedule thus determined to the user terminal 30 .

The policy information transmission unit 13 also creates a plan for implementing each process for a certain period based on the designation of the user Ua. In FIG. 11B, goals are set and a schedule is determined at the start, daily monitoring is performed, schedules are revised weekly, a progress graph is created after one month, and goals are determined and new goals are set in the third month. A series of events of setting up are planned. In addition to or in place of the user Ua's specification, the policy information transmission unit 13 may use a predetermined plan for performing each step for a certain period of time.

When the user terminal 30 receives the schedule data from the skin support server 10 in STEP 52 of FIG. 6, the skin support application 35a displays a schedule execution table as shown in FIG. The plan is made displayable to prompt the user Ua to implement each measure. In the execution table of the schedule in FIG. 12, the contents of each measure (“Soak in a hot tub”, “Eat vegetables”, “Walk 10,000 steps or more”) are displayed.

[F. Monitoring process]
The step of "3. Monitoring" shown in FIG. 3 is executed by the skin condition recognition unit 11 and the measure information transmission unit 13 for each period set by the user Ua on the skin support application 35a (every day in FIG. 11B). . The user Ua, who has started using the skin support application 35a, uses the user terminal 30 to check the daily skin, body, and mental conditions, the implementation status of the measures specified by the schedule, and the measures other than the measures specified by the schedule. The implementation status of Ua's voluntary action (action outside the policy) is entered. The implementation status of the measures includes information indicating whether or not each of the measures, "soak in the bathtub,""eatvegetables," and "walk more than 10,000 steps," has been implemented, as well as "30 minutes,""soak in the bathtub,""300 g and "eating vegetables", "15,000 steps", and "walking".

In STEP53 of FIG. 6, the skin support application 35a advances the process to STEP60 when the state of the skin, body, and mind is input by the user Ua. Current user information data including subjective data and objective data regarding the state of mind is transmitted to the skin support server 10, and the process proceeds to STEP54. It should be noted that the skin support application 35a directly advances the processing to STEP54 when the user Ua does not input the state of the skin, body, and mind in STEP53 of FIG. The data transmitted here does not include the data on the stratum corneum cells collected by the keratin collecting tape 37 .

Further, in STEP 54 of FIG. 6, the skin support application 35a advances the process to STEP 61 when the schedule execution status (execution status of each measure) is input by the user Ua, and outputs execution status data indicating the schedule execution status. The data is transmitted to the skin support server 10, and the process proceeds to STEP55 in FIG. When the user Ua does not input the execution status of the schedule (execution status of each measure) in STEP54 of FIG. 6, the skin support application 35a directly proceeds to STEP55.

Furthermore, in STEP55 of FIG. 7, the skin support application 35a advances the process to STEP62 when the user Ua inputs the implementation status of the non-policy action, and performs non-policy action execution data indicating the details of the non-policy action that has been performed. is transmitted to the skin support server 10, and the process proceeds to STEP56. It should be noted that the skin support application 35a advances the processing to STEP56 as it is when the user Ua does not input the implementation status of the action outside the policy in STEP55 of FIG.

STEP 13 in FIG. 4 to STEP 16 in FIG. 5 and STEP 20 to STEP 22 in FIG. When the skin condition recognition unit 11 receives the current user information data from the user terminal 30 in STEP 13, the process proceeds to STEP 20, accumulates the current user information data in the support DB 20, and proceeds to STEP 14. When the skin condition recognition unit 11 does not receive the current user information data from the user terminal 30 in STEP 13, the process proceeds to STEP 14 as it is.

Also, when the policy information transmitting unit 13 receives the execution status data from the user terminal 30 in STEP 14 , it advances the process to STEP 21 , accumulates the execution status data in the support DB 20 , and advances the process to STEP 15 . On the other hand, if it is determined in STEP14 that the execution status data has not been received from the user terminal 30, the process proceeds directly to STEP15.

Furthermore, when the policy information transmission unit 13 receives the non-policy action execution data from the user terminal 30 in STEP 15, it advances the process to STEP 22, accumulates the non-policy action execution data in the support DB 20, and proceeds to STEP 16 in FIG. proceed. On the other hand, when the policy information transmitting unit 13 does not receive the non-policy action execution data from the user terminal 30 in STEP15, the process proceeds to STEP16 in FIG. 5 as it is.

5, in STEP 16, the policy information transmission unit 13, based on the user Ua's initial user information data, current user information data, execution status data, non-policy action execution data, etc., accumulated in the support DB 20, Progress table data indicating the progress of the schedule is created, and this progress table data is transmitted to the user terminal 30 .

Here, for example, as shown in FIG. 12, the progress table of the schedule includes, from top to bottom, a skin condition (here, dry skin) score, a physical condition score, a mental condition score, measures (soaking in a bathtub, vegetables, etc.). Intake, walking 10,000 steps or more), living information (vegetable intake, water intake), and living special cases are displayed on a daily basis.

The schedule progress table also includes the degree of implementation of measures (“30 minutes” soaking in a hot tub, “300g” eating vegetables, “15,000 steps” walking).

In the user terminal 30, the skin support application 35a advances the process to STEP 63 when receiving the progress table data transmitted from the skin support server 10 in STEP 56 of FIG. The skin support application 35 a uses the progress table data stored in the memory 36 to display the progress table shown in FIG. 12 on the display 31 of the user terminal 30 .

In addition to the progress table data, the skin support application 35a also includes the initial user information data, the current user information data, the execution status data, Information indicating transitions and changes in each state of the user Ua's skin, body, and mind is displayed on the display 31 of the user terminal 30 using the non-policy action execution data and the like.

For example, as shown in FIG. 13, the skin support application 35a can be used to determine user Ua's behavior (change in face washing method, receiving a massage, etc.) other than measures according to the schedule, and user's physical condition (physiology, lack of sleep, etc.). , the relationship of changes in the skin condition of the user Ua is displayed on the display 31 as a daily time-series graph.

In addition, as shown in FIG. 14, the skin support application 35a monitors, on a month-by-month basis, the user Ua's skin condition including keratin condition, psychological condition, skin care satisfaction, and cosmetic usage evaluation values. A radar chart for comparison is displayed on the display 31 .

The user Ua visually recognizes these displays by the skin support application 35a and confirms changes in the conditions of his/her own skin, body, and mind, thereby grasping the degree of improvement in the skin as well as changes in the conditions of the body and mind. Therefore, the target skin condition goal can be achieved while improving the condition of the skin, body, and mind in a well-balanced manner.

Further, the skin support application 35a proceeds to STEP72 and executes the skin condition corresponding information output process shown in FIG. The details of the skin condition corresponding information output process will be described later.

[G. schedule modification]
The process of "4. schedule modification" shown in FIG. 3 is executed by the measure information transmitting unit 13 for each period set by the user Ua on the skin support application 35a (every week in FIG. 11B). STEP 17 to STEP 20 and STEP 30 to STEP 33 in FIG.

In addition, the skin support application 35a advances to STEP73 in the step of "4. schedule correction" and executes the alternative measure recommendation process shown in FIG. Details of the alternative measure recommendation process will be described later.

In STEP 17, the policy information transmission unit 13 incorporates the user Ua's skin condition target achievement level and schedule into the user Ua's initial user information data, current user information data, execution status data, and the like accumulated in the support DB 20. Evaluate the degree of implementation of each measure and the effect of each measure.

The policy information transmission unit 13 extracts the correlation between the skin condition and the physical or mental condition using the policy evaluation criteria shown in FIG. continuation of the policy, exclusion from the policy group, cancellation of the policy, and change to another policy.

In the evaluation criteria of FIG. 15A, four items are used as judgment items: presence or absence of implementation, effect on skin, effect on body, and effect on mind. If there is, and there is no adverse effect on the body and mind, it will be evaluated as A and will be judged to be continued. Note that, in FIG. 15A, a measure whose implementation rate exceeds a predetermined implementation rate is indicated as "implemented", and a measure whose implementation rate is equal to or lower than the predetermined implementation rate is indicated as "non-implemented". The same applies to FIGS. 12 and 15B.

When the timing of the impact of the policy and the duration of the impact are determined for each policy, the policy information transmission unit 13 calculates the impact of each policy based on the timing of the impact of the policy and the duration of the impact of the policy. You can judge.

For example, if it is determined that the effect of the measure "soaking in the bathtub" on the skin, the body, and the mind will affect the next day and will continue for only one day, the measure information transmission unit 13 will: For example, it is determined that the effect of the measure "soak in the bathtub" on December 15th is reflected in each state on December 16th.

In addition, if the effect of the measure "vegetable intake" on the skin, the body, and the mind is set to occur after one week and continue for only three days, the measure information transmission unit 13 For example, it is determined that the influence of the measure "vegetable intake" on December 15th is reflected in each state from December 22nd to December 24th.

On the other hand, a measure that has a good effect on the skin but has a bad effect on either the body or the mind is given a B rating and is judged to be canceled or changed to another measure. In addition, since it is considered that a measure whose implementation rate is equal to or less than a predetermined implementation rate imposes a heavy burden on the user Ua, it is evaluated as C and canceled or another measure (for example, a measure that reduces the load on the user Ua or another measure is implemented). measures).

The measure information transmission unit 13 may evaluate whether each measure has a good or bad effect on the skin, body, and mind by implementing each measure for only one day, or for a certain period of time such as several days or weeks. Implementation of each measure may be evaluated to determine whether it has a positive or negative effect on the skin, body, or mind. When the evaluation is performed for a certain period of time, the measure information transmission unit 13, for example, gives a B rating when any state is adversely affected at a given rate, a C rating when the implementation rate is below a given rate, and otherwise. In the case of , it is good as A evaluation. Instead of this, the policy information transmitting unit 13 may, for example, give a B evaluation when the average value of satisfaction in any state during a certain period of time is below a predetermined value. In addition, if the satisfaction level of any state in one day is below a predetermined level, and the average value of the satisfaction level of any state over a certain period of time is below a predetermined level, it will be evaluated as C, and any of the evaluations for the day If the level of satisfaction in any state falls below a predetermined level, or if the average value of satisfaction levels in any one state over a certain period of time falls below a predetermined level, it will be evaluated as B, and the level of satisfaction in any state in a day will be a predetermined level. value, and the average value of satisfaction in any state in a certain period of time exceeds a predetermined value, such as A evaluation, such as a one-day evaluation and a certain period of time evaluation may be used in combination. .

In addition, when the degree of improvement of the skin condition score shown in FIG. It may be excluded from the policy group. When the degree of improvement in the score of the physical condition or the mental state is equal to or less than a predetermined degree of improvement, the measure information transmitting unit 13 selects the measures in which the degree of improvement in the score of the physical state or the mental state is equal to or less than the predetermined degree of improvement in the measure group. can be excluded from

FIG. 15B shows an example in which the evaluation criteria shown in FIG. 15A are applied to measures (soaking in a bathtub, eating vegetables, walking 10,000 steps or more) in this embodiment. According to FIG. 15B, the measure information transmission unit 13 gives an A rating for “soak in the bathtub” and determines to continue with the next schedule, and gives a B rating for “vegetable intake” and excludes it from the measure group. Decide to cancel the schedule or change to another measure, and give a C grade for "walking more than 10,000 steps", exclude from the measure group, cancel the next schedule or change to another measure. have decided.

The policy information transmission unit 13 determines the influence of a plurality of policies for each combination of the policies. For example, if the combination of "soaking in a hot tub" and "eating vegetables" is rated B or C, the measure information transmitting unit 13 determines whether only the single measures of "soaking in a hot tub" or "eating vegetables" are considered. , or may be changed to combine any of these measures with other measures.

The measure information transmission unit 13 performs such evaluation processing to determine whether schedule correction (mainly by changing the measure group to another measure) is necessary or not. to correct the schedule. Then, the user terminal 30 transmits schedule correction data, which is data of the corrected schedule, and the process proceeds to STEP19. On the other hand, when it is determined that the schedule need not be revised, the measure information transmitting section 13 advances the process from STEP 18 in FIG. 5 to STEP 19 in FIG. 5, and in this case the schedule is not revised.

Next, in STEP 19, the policy information transmission unit 13, based on the initial user information data, the current user information data, the data on the execution of the action outside the policy, etc., each non-policy action performed by the user Ua (included in the schedule In addition to measures, actions performed by users) are evaluated.

The policy information transmitting unit 13 uses the evaluation criteria for the behavior outside the policy shown in FIG. 16A to determine whether the behavior outside the policy is recommended or not. In the evaluation criteria of FIG. 16A, influences on each state of skin, body, and mind are used as judgment items.

If "there is a positive effect on the skin, body, or mind, and there is no negative effect on any of them," the evaluation is D, and implementation is recommended. On the other hand, if it "has a negative effect on the skin, body or mind," an E rating is given and a ban is proposed. In addition, if "there is no effect on the skin, body, or mind," the evaluation is F, and implementation is not recommended.

FIG. 16B shows an example in which the evaluation criteria shown in FIG. 16A are applied to behaviors outside the policy (receiving a massage, ingesting a large amount of chocolate) in this embodiment. According to FIG. 16B, the measure information transmitting unit 13 determines that “get a massage” is evaluated as D and is recommended to be implemented in the next schedule. In addition, regarding "a large amount of chocolate intake", it is evaluated as E, and it is decided to propose a measure to stop it in the next schedule (for example, an alternative to ingesting Japanese sweets).

When the measure information transmitting unit 13 decides to recommend or prohibit the execution of the measures incorporated in the schedule, or to propose to cancel or change the measures outside the measures, the process advances from STEP 20 to STEP 31 . Then, when the recommendation is determined, the process proceeds from STEP31 to STEP33, the non-policy action recommendation data recommending the execution of the non-policy action is transmitted to the user terminal 30, and the process proceeds to STEP13 in FIG.

On the other hand, when the policy information transmitting unit 13 decides to propose the prohibition, the process advances from STEP 31 to STEP 32, and transmits to the user terminal 30 non-policy action prohibition data proposing prohibition of the non-policy action. The process proceeds to STEP13.

If there is no non-policy action to be recommended or prohibited, the policy information transmitting unit 13 advances the process from STEP 20 to STEP 13 in FIG. If the non-policy action proposed to be prohibited includes an alternative action, non-policy action prohibition data proposing a change to the alternative action may be transmitted to the user terminal 30 instead of the prohibition proposal.

In the user terminal 30, when the schedule correction data is received from the skin support server 10 in STEP57 of FIG. 7, the skin support application 35a proceeds to STEP65 and corrects the schedule based on the schedule correction data. The skin support application 35a then updates the schedule data held in the memory 36 and advances the process to STEP58.

Further, when the skin support application 35a receives the non-policy action recommendation data or the non-policy action prohibition data from the skin support server 10 in STEP 58 of FIG. is displayed on the display device 31 of the user terminal 30 to inform the user of the recommendation or prohibition proposal. Note that this notification may be performed by displaying a notification message on the progress table shown in FIG. 12, for example. In addition, the recommended non-policy behavior may be used as a new policy to modify the schedule.

[H. Goal Judgment Process]
The process of "5. Goal determination" shown in FIG. It is executed by the selection unit 12 and the policy information transmission unit 13 .

The skin support application 35a displays on the display 31 of the user terminal 30 a message prompting the user to use the keratin collecting tape 37 and to send the keratin collecting tape 37 by mail.

The skin condition recognition unit 11 recognizes objective values of the skin condition (water retention capacity, sebum suitability, etc.) based on the information obtained from the mailed keratin collecting tape 37 . The objective value may be a value that indicates the physical state of the skin, such as a moisture content of 0-100 μS, or normalized by assigning each physical state to one of 1 to 10 according to the magnitude. can be a value.

In addition, the skin support application 35a displays on the display 31 of the user terminal 30 a message prompting the user to answer the questionnaire and use imaging of the skin, etc., and transmits the obtained information.

The skin condition recognition unit 11 recognizes the subjective value of skin dryness (subjective score) and the objective value of skin condition (skin image score) based on the information obtained from the skin support application 35a.

The measure group selection unit 12 and the measure information transmission unit 13 compare the evaluation values at the start of skin condition support and after 3 months based on the subjective value of skin dryness and the objective value of skin condition, Determine goal achievement.

In the example of FIG. 17, the subjective score of dryness increased from 3 to 5 in 3 months, so it was determined to be achieved (○). , the water retention capacity was maintained at 2, and the sebum suitability increased from 1 to 2, so it was determined to be achieved (○). Since both the subjective value and the objective value have achieved the goal, it is determined that the goal has been achieved as a whole.

In order to set a new goal when the goal is achieved, the skin condition recognition unit 11 and the measure group selection unit 12 repeat the process of "1. Goal setting" shown in FIG. The skin condition recognizing unit 11 and the measure group selecting unit 12 may perform the step of "2. Determine schedule" when the goal is not achieved, or perform the step of "1. Goal setting" according to the user's desire or progress. The process may be performed again.

[I. Secondary data generation]
The step of “6. Secondary data generation” shown in FIG. 3 is executed by the secondary data generator 19 . The secondary data generation unit 19 generates various data transmitted from a plurality of users U, such as initial user information data, stratum corneum analysis data, current user information data, execution status data, non-measure action execution data (hereinafter referred to as user-specific data). data) are sequentially stored in the support DB 20 for each user.

Then, the secondary data generation unit 19 analyzes the individual user data accumulated in the support DB 20, and, for example, as shown in FIG. ), support improvement targets (dryness, stiffness, sensitivity, acne, wrinkled feeling, etc.), measures proposed by the schedule (soaking in a bathtub, eating vegetables, walking more than 10,000 steps, etc.), and skin by implementing measures, Secondary data is generated that associates changes in each state of the body and mind.

18, the secondary data generation unit 19 also generates secondary data that associates each user's characteristics with the effects of each user's skin, body, and mental state due to the implementation of the non-policy action, as in FIG. Generate.

The secondary data generated in this manner is effectively used when selecting effective measures for improving the skin condition while having a positive effect on the body and mind of users with similar characteristics. be able to. For example, in the process of "2. schedule determination" in FIG. 3 described above, the measure group selection unit 12 can refer to the secondary data and select a measure suitable for the characteristics of the user Ua.

In addition, in the process of "4. Schedule correction" in FIG. can be referred to and the schedule can be changed to include more effective measures or actions outside the measures.

In addition, the secondary data can be effectively used to support skin conditions, and can be used for marketing purposes targeting users with certain characteristics (for example, outdoor-oriented women in their 30s living in Tokyo). can also be used. As such, the secondary data may be provided to other systems such as 60 shown in FIG.

[J. Recognition processing for request realization measures]
An example of request fulfillment policy recognition processing will be described with reference to FIG.

In STEP 101 of FIG. 19, the request recognition unit executes a request recognition process which will be described later. The request recognized in STEP 101 is transmitted to the skin support server 10 by the skin support application 35a and stored in the support DB. The request recognized in STEP 101 is recognized by the skin support application 35a at any time via communication.

In STEP 102 of FIG. 19, the policy recognition unit executes policy recognition processing, which will be described later.

In STEP 103 of FIG. 19 , the output control unit outputs information including the recognized measures to the display 31 . After that, the policy can be selected according to the operation of the user Ua. The selected measure is transmitted to the skin support server 10 by the skin support application 35a and stored in the support DB. The measures stored in the support DB are recognized by the skin support application 35a at any time through communication.

[K. Request Recognition Processing]
Next, an example of request recognition processing in STEP101 of FIG. 19 will be described with reference to FIGS. 20 to 22A.

In STEP 201 of FIG. 20 , the output control unit outputs a product selection screen to the display 31 . A service selection screen may be output to the display 31 instead of or in addition to the product.

The output control unit outputs the screen shown in FIG. 21 to the display 31, for example. The screen shown in FIG. 21 includes a first product display P01 including product names using words related to impressions such as "handsome kit", "gentleman's kit", and "healthy looking kit", and "I can do it! A second product display P02 containing a product name using words related to the state of mind, such as "kit!" P03, an address and name input field P04, and a purchase button P05 are included. Various information can be input via the touch panel 32 on this screen.

Note that the impression of the user Ua means that when the user Ua himself or someone other than the user Ua observes a relatively wide range of the user Ua including the skin of the user Ua, such as the entire face or the entire body of the user Ua, It is a direct feeling given to the mind of an observer (the user Ua himself or someone other than the user Ua). The impression of the user Ua differs from the evaluation of the skin of the user Ua by the user Ua himself and the evaluation of the skin of the user Ua by a person other than the user Ua according to certain criteria or rules, in that he observes a relatively wide range of parts. . In addition, since the impression of the user Ua is a direct feeling given to the observer's mind, the evaluation of the user Ua's skin by the user Ua himself and the evaluation of the user Ua's skin by a person different from the user Ua are based on a certain standard. or differ from evaluations made in accordance with the Regulations.

Examples of words that indicate the user's impression include handsome, masculine, gentlemanly, healthy, youthful, trustworthy, lively, energetic, reassuring, kind, and dependable. There is, can work, has a sense of responsibility, looks serious, looks strong, has a fulfilling life, gives a sense of security, mature, mature, good-looking, beautiful, cute, feminine, graceful , Refreshing, Tolerant, Cute, Popular, Charismatic, Aura, Attractive, Attractive.

Examples of words that indicate the user's state of mind include: self-confidence, wanting to recognize oneself, calmness, positiveness, honesty, fun, feeling happy, not being bothered by other people's behavior or facial expressions, and feeling envious of others. No, likes to act, is flexible, notices other people's strengths, carefree, wants to check the facts, wants to be considerate of others, can honestly appreciate, can overcome hardships, does not think pessimistically , not depressed, resistant to anxiety, quickly forgets unpleasant things, can control oneself, is full of motivation, has a desire to work, sharpened thinking, high concentration, high thinking ability, Less nervous, less irritable, less emotional, highly motivated to achieve, always have goals, want to do better than others, want to make the most of individuality, happy, fulfilled, excited, generous, bold, strong desire to achieve, give up No, Outgoing, Tolerant, Exciting, Peaceful, Compassionate, Courageous, Loving, Unfazed, Resilient.

The first product display P01 to the third product display P03 may include product images or the like instead of or in addition to the product names.

In STEP 202 of FIG. 20, when the request recognition unit recognizes the press operation of the purchase button P05 via the touch panel 32, it recognizes the selected product name and the address and name as the destination based on the input information. . For example, when the pressing operation of the purchase button P05 is recognized on the screen of FIG. ” and “△△ Taro” as a name. If a service is selected, the selected service and address, name may be recognized.

In STEP 203 of FIG. 20, the request recognizing unit executes processing such as sending an e-mail to the person in charge of shipping based on the selected product name and destination information (address and name). to the destination. When a service is selected, the request recognition unit stores the address and name in the support DB or the like as a recipient of the selected service.

In STEP 204 of FIG. 20 , the output control unit recognizes how to use the selected product by referring to a table (not shown) and outputs information indicating how to use the product to the display device 31 . When a service is selected, the request recognition unit recognizes how to enjoy the service and outputs information indicating the method of enjoying the service to the display device 31 .

In STEP205 of FIG. 20, the request recognition unit recognizes the user Ua's impression or desire regarding the state of mind based on the selected product. For example, when the "healthy-looking kit" is selected, the output control unit refers to the table in FIG. to recognize As for the service, similarly, the user Ua's impression or desire regarding the state of mind can be recognized. The table of FIG. 22A can be created by having the purchaser of the product enter a questionnaire about the purchased product and his/her impression or state of mind. A developer or the like of the skin support application 35a may create the table of FIG. 22A in advance based on their experience or knowledge.

[L. Request Recognition Processing]
Next, another example of the request recognition processing in STEP101 of FIG. 19 will be described with reference to FIGS. 22B and 23. FIG.

In STEP 301 of FIG. 23, the output control unit outputs to the display 31 a screen for selecting words expressing impression or self-confidence. Words expressing impressions are words expressing impressions of the user Ua, such as active, calm, cheerful, etc., that other people who have seen the user Ua or the user Ua himself/herself feel toward the user Ua. A word expressing confidence is a word expressing the user Ua's own confidence, such as "full of confidence". In addition to or instead of the words expressing the impression or confidence, a screen for selecting a figure expressing the impression or confidence may be output to the display 31 .

In STEP 302 of FIG. 23 , the request recognition unit recognizes the selected word via the touch panel 32 .

In STEP 303 of FIG. 23, the request recognition unit recognizes the impression or state of mind of the user Ua corresponding to the selected word. For example, when the word "bright" is selected, the desire recognition unit refers to the table in FIG. do. Additionally or alternatively, the request recognition unit may recognize the user Ua's request from the selected words themselves. Further, even when a graphic is selected, the user Ua's impression or state of mind corresponding to the graphic can be recognized through similar processing. The table of FIG. 22C can be created by asking randomly selected people to select words and inputting a questionnaire about the selected words and their desires regarding impressions or states of mind. A developer or the like of the skin support application 35a may create the table of FIG. 22B in advance based on their experience or knowledge.

[M. Request Recognition Processing]
Next, another example of the request recognition processing in STEP101 of FIG. 19 will be described with reference to FIGS. 22C and 24. FIG.

In STEP401 of FIG. 24, the output control unit outputs to the display 31 a screen for inputting attributes of the user Ua such as age, sex, occupation, area of residence, personality, and the like.

In STEP 402 of FIG. 24 , the request recognition unit recognizes attributes of the user Ua based on information input via the touch panel 32 .

In STEP403 of FIG. 24, the request recognition unit recognizes a request regarding the user Ua's impression or state of mind corresponding to the user Ua's attributes. For example, the request recognizing unit refers to the table shown in FIG. 22C to recognize the user Ua's impression of the attributes of the user Ua or the request regarding the state of mind. In addition to the attributes of the user Ua, the request recognition unit also takes into account the season, and refers to a table obtained by adding the period to the table shown in FIG. 22C. It may recognize the user Ua's impression or state of mind, such as "I want to be seen". The table of FIG. 22C can be created by having randomly selected people enter a questionnaire about their attributes, time period, and their impressions or their desires regarding their state of mind. A developer or the like of the skin support application 35a may create the table of FIG. 22C in advance based on their experience or knowledge.

[N. Policy Recognition Processing]
Next, an example of policy recognition processing in STEP 102 of FIG. 19 will be described with reference to FIGS. 25 and 26. FIG.

In STEP501 of FIG. 25, the user information recognition unit recognizes the user information of the user Ua.

The user information of the user Ua is information including attributes of the user Ua (age, sex, occupation, area of residence, hobbies, preferences, etc.), lifestyle behavior (habits) of the user Ua, and constitution of the user Ua.

The user information recognition unit may recognize the attributes of the user Ua, the lifestyle behavior of the user Ua, and the constitution of the user Ua based on information input via the touch panel 32 . The user information recognition unit searches an SNS site or the like based on the information input by the user Ua such as the email address of the user Ua, and based on the information described in the searched site, the attribute of the user Ua, the The living behavior and the constitution of the user Ua may be recognized. The recognized information can be stored in the support DB 20 together with the user ID for identifying the user.

In this embodiment, as shown in the table of FIG. 26A, "35 years old", "male", and "professional office worker" are recognized as attributes of user Ua, and "drinking habit" is recognized as habit of user Ua. A description will be made assuming that the user Ua has recognized "dry eye" as a constitution of the user Ua. The table of Figure 26A can be created from information contained in the initial user information data of the system.

In STEP502 of FIG. 25, the other user information recognition unit recognizes user information of other users different from user Ua. User information of other users can be collected in the same manner as user information of user Ua.

In STEP 503 of FIG. 25, the matching degree recognition unit recognizes the degree of matching between the user Ua and each other user. For example, the degree-of-match recognition unit may recognize the degree of match based on the number of common terms with the user Ua, as shown in FIG. 26A. At this time, with respect to age, a certain range of ages, such as 30's, may be recognized as the same generation. Further, the degree of matching may be recognized not only by the number of common terms but also by a weighted average using coefficients unique to each item.

In STEP504 of FIG. 25, the policy recognition unit extracts other users whose degree of matching with the user Ua is equal to or greater than a predetermined matching degree threshold. The matching degree threshold value may be a predetermined value stored in the support DB 20 and recognized through communication, or may be a value determined by the user Ua through the touch panel 32 as described later.

In this embodiment, it is assumed that the match threshold is two. In this case, the policy recognition unit extracts other users 2, 3, and 5 whose matching degree threshold is 2 or more from the table shown in FIG. 26A.

In STEP 505 of FIG. 25, the policy recognition unit recognizes, for each of the extracted other users, the other user's request, the other user's policy, and the evaluation by the other user.

For example, the measure recognition unit recognizes other users' requests, other users' measures, and other users' evaluations by referring to the table in FIG. 26B. In the above example, the policy recognition unit recognizes the other user 2's request "I want to look gentlemanly", the policy "use basic cosmetics", the evaluation "8", and the other user 3's request "I want to look healthy". , measure “running 1 km”, evaluation “7”, request of other user 5 “want to look healthy”, measure “use basic cosmetics”, evaluation “10”. Evaluations by other users can be collected in the skin condition correspondence information output process of FIG. 31, which will be described later.

Note that the table in FIG. 26B can be created when each other user is using this system.

In STEP506 of FIG. 25, the measure recognition unit recognizes measures that are the same as the request of the user Ua and that are evaluated by other users equal to or higher than a predetermined evaluation threshold. For example, the policy recognition unit recognizes, among the policies of the other users 3 and 5 having the same desire as the user Ua's desire "I want to have a healthy appearance", the policies evaluated by the other users above a predetermined evaluation threshold. do. When the evaluation threshold is 7.0, the policy "running 1 km" and the policy "use basic cosmetics" can be recognized.

Information including this recognized policy can be output in STEP 103 of FIG. 19 by the output control unit. The output control unit outputs the screen shown in FIG. 27 to the display 31, for example.

The screen shown in FIG. 27 includes a headline display P10, a policy selection box P11, an average matching degree display P12, an average evaluation display P13, a policy selection button P14, a link to browse other policies P15, It includes a search condition display P16 and a search condition change link P17.

Headline display P10 includes information indicating the request of user Ua, "Among users who want to look healthy, users who are similar to you are implementing the following measures."

The policy selection box P11 is a box for selecting which policy for the user Ua.

The matching degree average value display P12 is a display of the matching degree average value of other users who have executed the policy. Instead of or in addition to this, the maximum value, the median value, etc. of the degree of matching of other users who have executed the policy may be displayed.

The average evaluation display P13 is a display showing the average value of evaluations by other users for the policy. Instead of or in addition to this, the highest value, the median value, or the like of other users' evaluations of the policy may be displayed.

The policy selection button P14 is a button for determining the selected policy as the policy for the user Ua. When the pressing operation of the measure selection button P14 is detected via the touch panel 32, the output control unit transmits the measures whose measure selection boxes P11 are checked to the skin support server 10 as measures for the user Ua. The transmitted measures are incorporated into the user Ua's schedule.

The measure list viewing link P15 is a link for viewing a list of measures. When the output control unit detects that the link is pressed via the touch panel 32 , the output control unit outputs a list of measures to the display device 31 .

The search condition display P16 is a display showing search conditions for measures such as a matching degree threshold value and an evaluation threshold value.

The search condition change link P17 is a link for changing search conditions such as a match degree threshold value and an evaluation threshold value. When the output control unit detects the press operation of the link through the touch panel 32, it outputs to the display device 31 a screen for designating search conditions such as a match degree threshold value and an evaluation threshold value. Based on the information input via the touch panel 32, the policy recognition unit searches for policies again by executing the processing of STEP503 to STEP506 in FIG.

[O. Policy Recognition Processing]
Next, another example of the policy recognition processing in STEP 102 of FIG. 19 will be described with reference to FIGS. 28 to 29C.

In STEP 601 of FIG. 28, the corresponding skin condition recognizing unit recognizes an objective skin condition item (corresponding objective item) corresponding to the request of the user Ua. Alternatively, the corresponding skin condition recognizing unit refers to a table (not shown) to recognize the corresponding subjective item corresponding to the request of the user Ua, and further refers to a table (not shown) to recognize the corresponding subjective item. You may recognize the corresponding objective item of the skin condition corresponding to .

For example, the corresponding skin condition recognition unit recognizes the corresponding objective item and the target condition by referring to the table shown in FIG. 29A. For example, if the user Ua desires to have a "healthy appearance", then "moisture content", "sebum content", and "number of wrinkles" as corresponding objective items, and their target states of "increase" and "decrease". Recognize "decrease". The developer evaluates the impression or mental state of the person selected at random and evaluates the objective score of the skin condition, and evaluates the impression or mental state and the skin condition of a plurality of people. 29A may be created based on the relationship between the impression or state of mind and the objective score of the skin condition. Alternatively, the developer or the like of the skin support application 35a may create the table of FIG. 29A in advance based on their experience or knowledge.

The corresponding objective item may be an item in the evaluation of the skin of the user Ua made by a person other than the user Ua according to certain criteria or rules.

In STEP 602 of FIG. 28, the corresponding skin condition recognition unit recognizes the corresponding subjective item, which is the subjective item of the skin condition corresponding to the corresponding objective item. The corresponding skin condition recognition unit recognizes the corresponding subjective item corresponding to the corresponding objective item, for example, by referring to the table shown in FIG. 29B. For example, "dryness", "greasyness" and "ageing degree" are recognized for corresponding objective items "moisture content", "sebum content" and "number of wrinkles", respectively. Note that the coefficients in the table shown in FIG. 29B are coefficients that are multiplied when converting the score of the corresponding objective item into the score of the corresponding subjective item. Corresponding subjective items can be utilized in an alternative measure recommendation process, which will be described later. The developers asked randomly selected people to fill out a questionnaire regarding their subjective skin condition, measured their objective skin condition, and determined the relationship between their subjective skin condition and their objective skin condition. By analyzing the properties, the table shown in FIG. 29B can be generated. Alternatively, the developer of the skin support application 35a or the like may create the table of FIG. 29B in advance based on their experience or knowledge. When the corresponding objective item is an item in the evaluation of the skin of the user Ua by a person different from the user Ua according to a certain standard or rule, the corresponding skin condition recognizing unit regards the same item as the corresponding subjective item. can be recognized as

In STEP 603 of FIG. 28, the measure recognition unit recognizes measures for improving the corresponding objective items. The measure recognition unit recognizes measures for improving the corresponding objective items by referring to the table shown in FIG. 29C, for example. For example, the policy recognition unit recognizes "bathing for 10 minutes or more" as a policy for increasing the "moisture content". Also, for example, the policy recognition unit recognizes "running 1 km" and "use basic cosmetics" as policies for reducing "amount of sebum" and "number of wrinkles". The developers measured the objective skin condition of randomly selected people, then made them take specified measures, acquired the changes in the skin condition after that, and compared the changes in the objective skin condition with the measures. By analyzing the relationship of , the table shown in FIG. 29C can be created. Alternatively, the developer or the like of the skin support application 35a may create the table of FIG. 29C in advance based on their experience or knowledge.

In STEP 103 of FIG. 19, information including these recognized measures can be output to the display 31 by the output control unit.

[P. Policy Recognition Processing]
Next, another example of the policy recognition processing in STEP 102 of FIG. 19 will be described with reference to FIGS. 29D to 30. FIG.

In STEP701 of FIG. 30, the user behavior recognition unit recognizes behavior of the user Ua in a second period obtained by dividing the past first period.

For example, the user action recognition unit recognizes past data (execution status data, non-policy action execution data) of the user Ua by communicating with the skin support server 10 . The user behavior recognition unit divides a past first period (for example, one month) indicated in the recognized data into a plurality of second periods (for example, every week). Then, the measure recognition unit executes the processing of STEP701 to STEP704 in FIG. 30 for each second period. In STEP701 of FIG. 30, the user behavior recognition unit recognizes the behavior of the user Ua in the target second period.

In STEP702 of FIG. 30, the behavior evaluation unit recognizes changes in the user Ua's impression or state of mind during the second target period. For example, the behavior evaluation unit recognizes an evaluation of the impression or state of mind of the user Ua at the start of the second period and an evaluation of the impression or state of mind of the user Ua at the end of the second period. The evaluation of the user Ua's impression or state of mind can be recognized in the skin condition information output process described later. In this embodiment, the evaluation of the user Ua's impression or state of mind is expressed in stages such as dissatisfied, somewhat dissatisfied, somewhat satisfied, and satisfied.

In addition, the start and end times of the second period are not only the start and end times of the second period in a strict sense, but also the times that can be regarded as the start and end times of the second period (e.g., It also means the time point at which the user Ua's impression or state of mind is evaluated before the start or end or immediately after the start or end).

In STEP703 of FIG. 30, the behavior evaluation unit determines that the user Ua
It is determined whether or not the impression or state of mind of the user Ua is close to the desire of the user Ua. For example, the behavior evaluation unit determines whether or not the evaluation at the end point recognized in STEP702 of FIG. 30 is closer to the state that matches the desire of the user Ua than the evaluation at the start point. The behavior evaluation unit may determine whether or not the evaluation of the user Ua's impression or state of mind is close to satisfactory.

If the determination result is affirmative (YES in STEP703 of FIG. 30), it is determined that the impression or state of mind of user Ua is close to the desire of user Ua in the second target period, and in STEP704 of FIG. The evaluator adds a predetermined positive value to the priority of the action in the second period of interest.

If the determination result is negative (NO in STEP 703 in FIG. 30), it is determined that the user Ua's impression or state of mind is not close to the user Ua's desire during the target second period. If the determination result is negative or after the processing of STEP704 of FIG. 30, in STEP705 of FIG. is executed.

If the determination result is negative (NO in STEP 705 in FIG. 30), the user action recognition unit performs STEP 701 in FIG. 30 for the unprocessed second period because the unprocessed second period remains. Execute.

If the determination result is affirmative (YES in STEP705 in FIG. 30), in STEP706 in FIG. 30, the policy recognition unit recognizes policies having a predetermined priority threshold or more. The priority threshold may be a threshold stored in advance in the support DB of the skin support server 10 and recognized through communication, or may be a threshold designated by the user Ua.

By repeating the processing of STEP701 to STEP704 in FIG. 30, the priority for each action of the user Ua performed in the first period is calculated as shown in the table of FIG. 29D, for example. The higher the priority, the more positively the user Ua's evaluation of the impression or state of mind of the user Ua.

In STEP103 of FIG. 19, the measures recognized in STEP706 of FIG. 30 are output to the display 31 by the output control unit.

[Q. Skin Condition Corresponding Information Output Processing]
Next, an example of the skin condition information output process in STEP72 of FIG. 7 will be described with reference to FIGS. 31 to 33. FIG.

In STEP801 of FIG. 31, the user skin condition recognition unit recognizes a set of scores indicating the user's skin condition of the previous time and this time. For example, the user skin condition recognizing unit, like the table shown in FIG. , and the current set of scores "5," "4," "1," and "4."

In STEP802 of FIG. 31, the replacement unit recognizes the coefficient of each skin item corresponding to the impression or state of mind desired by the user Ua. For example, if the user Ua desires to "look healthy", in FIG. Recognize the coefficients "8", "-3" and "-2" corresponding to the amount and the number of wrinkles, respectively. The developers measured the objective condition of the skin condition and evaluated the impression or state of mind of randomly selected people, and evaluated the relationship between the objective condition items of the skin condition and the impression or state of mind. The parsing may produce the table shown in FIG. 32B. Alternatively, the developer or the like of the skin support application 35a may create the table of FIG. 32B in advance based on their experience or knowledge.

In STEP803 of FIG. 31, the replacement unit recognizes the previous or current impression or state of mind score based on the set of coefficients and scores. The previous impression or state of mind score is the impression or state of mind score of the user Ua measured at the previous activation. The current impression or state of mind score is the impression or state of mind score of the user Ua measured at the time of activation this time. Also, in place of or in addition to the previous score, the score from a predetermined period of time such as one month ago, the score at the time of inputting the request, or the like may be recognized.

The replacement unit includes a set of previous scores "2", "2", "2", and "3" for the objective items "moisture content", "sebum content", "number of wrinkles", and "angle of the corner of the eye" of the skin condition of the user Ua, From the coefficients "8", "-3", and "-2" corresponding to the objective items "moisture content", "sebum content", and "number of wrinkles" for each skin condition corresponding to "I want to look healthy", By taking the weighted average of only the objective items "moisture content", "sebum content", and "number of wrinkles" for each skin condition corresponding to "I want to look healthy", the previous impression or state of mind score was set to 6. calculate.

Similarly, the replacement unit calculates the current impression or state of mind score as 30.

In STEP804 of FIG. 31, the output control unit outputs information prompting evaluation of impressions and evaluation of measures and information including impressions or state of mind scores.

For example, the output control unit outputs the screen shown in FIG.

The screen shown in FIG. 33 includes a headline display P21 related to the request of the user Ua, a previous score display P22a, a word display P22b corresponding to the previous score, a graphic display P22c corresponding to the previous score, and a display P22c corresponding to the previous score. A score display P23a, a word display P23b corresponding to the current score, a graphic display P23c corresponding to the current score, a current impression evaluation input field P24a, a current policy evaluation input field P24b, and an evaluation transmission button P25. It is included.

Further, the screen shown in FIG. 33 includes a photograph of the user Ua taken last time and stored in the memory or the like and a photograph of the user Ua taken at the current time and stored in the memory or the like. good too. Further, this screen may include, in place of or in addition to the previous photo, a photo taken a predetermined period of time, such as one month ago, or a photo taken at the time of inputting the request.

When the output control unit detects that the evaluation transmission button P25 has been pressed via the touch panel 32, in STEP805 of FIG. and the information including the evaluation of the impression of this time and the evaluation of the current measure are transmitted to the skin support server 10 . The skin support server 10 stores information including the current impression evaluation and the current policy evaluation in the support DB 20 .

[R. Alternative measure recommendation process]
Next, an example of the alternative measure recommendation process in STEP73 of FIG. 7 will be described with reference to FIG.

In STEP 901 of FIG. 34, the corresponding skin condition recognition unit recognizes corresponding subjective items corresponding to user Ua's request. As described above in STEP 602 of FIG. 28, the corresponding skin condition recognizing unit refers to the tables shown in FIGS. A corresponding subjective item corresponding to the item may be recognized. Alternatively, the corresponding skin condition recognizing unit may recognize a corresponding subjective item corresponding to the request of the user Ua by referring to a table (not shown). Further, the corresponding skin condition recognition unit may recognize both the corresponding objective item and the corresponding subjective item corresponding to the request of the user Ua by referring to a table (not shown).

In STEP902 of FIG. 34, the user skin condition recognition unit recognizes the score of the corresponding subjective item of the user Ua. The score of the corresponding subjective item of the user Ua can be recognized by a questionnaire, for example, as described above.

In STEP903 of FIG. 34, the user skin condition recognition unit determines whether or not the score of the corresponding subjective item is equal to or less than the subjective threshold. The subjective threshold may be a value previously stored in the skin support server 10 and recognized through communication, or may be a value specified by the user via the touch panel 32 .

If the determination result is affirmative (YES in STEP903 in FIG. 34), the user Ua's request has not been met, so in STEP904 in FIG. recognize. For example, the policy recognition unit recognizes the policy associated with the corresponding subjective item by referring to a table (not shown).

In STEP 905 of FIG. 34, the output control unit outputs information including the recognized measures to the display device 31 .

If the determination result is negative (NO in STEP903 in FIG. 34), the user Ua's request is fully met. Therefore, if the determination result is negative (NO in STEP903 of FIG. 34) or after the process of STEP905 of FIG. 34, the skin support application 35a ends the alternative measure recommendation process.

(Modification mode)
In the above example, the CPU 35 that has executed the skin support application 35a uses the "request recognition unit", the "measure recognition unit", the "output control unit", the "other user evaluation recognition unit", the "user information recognition unit", and the "other user information Functioned as a recognition unit, matching degree recognition unit, user behavior recognition unit, behavior evaluation unit, corresponding skin condition recognition unit, user skin condition recognition unit, and replacement unit. The skin support server 10, which has read the program, reads the "request recognition unit", the "measure recognition unit", the "other user evaluation recognition unit", the "user information recognition unit", the "other user information recognition unit", the "match degree recognition unit", and the "user behavior recognition unit". , the action evaluation unit, the corresponding skin condition recognition unit, the user skin condition recognition unit, the replacement unit, and a part of the output control unit. In this case, the CPU 35 that has executed the skin support application 35a recognizes the execution result through communication, and the "request recognition unit", "measure recognition unit", "output control unit", "other user evaluation recognition unit", and "user information recognition unit". It can function as the remainder of the "other user information recognition unit", "match degree recognition unit", "user behavior recognition unit", "behavior evaluation unit", "corresponding skin condition recognition unit", "user skin condition recognition unit", and "replacement unit".

In the above example, the CPU 35 executing the skin support application 35a receives various necessary data by communicating with the skin support server 10. Alternatively or additionally, the CPU 35 executing the skin support application 35a may refer to the data stored in the storage device of the user terminal 30 and execute the process.

The tables shown in FIGS. 22A to 22C, 26A to 26B, 29A to 29D, and 32A to 32B are stored in the support DB of the skin support server 10 and downloaded by the skin support application 35a as necessary. Alternatively, the skin support server 10 may receive the search information from the skin support application 35a, search the table, and transmit the search result to the skin support application 35a.

In STEP 101 of FIG. 19 , words or graphics indicating the desired impression or state of mind of the user Ua may be displayed, and the user Ua may select the desired impression or state of mind of the user Ua via the touch panel 32 . In this case, words or graphics indicating each impression or state of mind may be accompanied by a specific description of the impression or state of mind. For example, a specific explanation such as "seems tolerant", "seems kind", "gives a sense of security", etc. may be added to the phrase "want to be seen as a gentleman". In addition, information relating to skin condition items related to the impression or state of mind may be output.

Also in this case, multiple impressions or states of mind may be selected.

When a plurality of selected impressions or states of mind are associated with corresponding objective items of mutually opposite skin conditions (for example, one impression or state of mind is associated with When other impressions or states of mind are associated with "slanted eyes"), the measure recognition unit selects a plurality of impressions or states of mind to improve corresponding objective items or corresponding subjective items. measures may be recognized.

Further, when the user Ua selects one impression or state of mind from among the desired impressions or states of mind of the user Ua via the touch panel 32, the output control unit responds to the one impression or state of mind. Other impression or state of mind options associated with the corresponding objective or subjective items that conflict with the objective item may be disabled.

Multiple impressions or states of mind may be associated with a product, service, impression or confidence word or graphic or user attribute.

1... communication network, 10... skin support server, 11... skin condition recognition unit, 12... measure group selection unit, 13... measure information transmission unit, 19... secondary data generation unit, 20... support DB (database), 30 ( 30a, 30b, 30c)...user terminal (smartphone), 31...display, 32...touch panel, 33...camera, 34...microphone, 35...CPU, 35
a... skin support application, 36... memory, 40... connection terminal, 45... measuring device.

Claims (5)

an output unit that outputs information;
Acquisition of subjective evaluation result data of the user's skin condition by the user himself or objective evaluation result data of the user's skin condition obtained based on the image of the user's skin, and the acquisition a user skin condition recognition unit that recognizes the score of the user's skin condition based on the data of the skin condition evaluation results obtained ;
a request recognition unit that receives input of information by the user and recognizes a request regarding the user's impression or state of mind based on the input information;
a replacement unit that replaces the user's skin condition score with a score indicating the user's impression or the user's mental state;
an output control unit that outputs to the output unit the impression of the user or the score indicating the state of mind of the user that has been replaced by the replacement unit;
The user's skin condition score is represented by a set of scores of a plurality of items indicating the user's skin condition,
The replacement unit recognizes an item corresponding to a request regarding the user's impression or state of mind recognized by the request recognition unit from among a plurality of items indicating the user's skin condition, and corresponds to the recognized item. by recognizing a predetermined coefficient and the score of the recognized item, and calculating a weighted average of the scores of the item according to the coefficient, so that the score of the user's skin condition is expressed as the user's impression or the user's mind An information output system characterized by replacing with a score indicating the state of . In the information output system according to claim 1,
There are a plurality of types of requests regarding the user's impression or the user's state of mind,
The output control unit is configured to output to the output unit a product or service selection screen associated with the user's impression or the type of request regarding the user's state of mind,
The request recognition unit receives an input of selection of the product or service by the user, and generates information indicating a correspondence relationship between the product or service selected from the selection screen and a request regarding the user's impression or state of mind. to recognize the user's impression or state of mind desire associated with the selected product or service among the plurality of types of the user's impression or state of mind desire. An information output system characterized by comprising: In the information output system according to claim 1,
There are a plurality of types of requests regarding the user's impression,
The output control unit is configured to output to the output unit a selection screen of words representing the user's impression, which is associated with the type of request related to the user's impression,
The request recognizing unit receives an input of a selection of words expressing the impression of the user by the user, and indicates a correspondence relationship between the words expressing the impression of the user selected from the selection screen and a request related to the impression of the user. By referring to the information, it is configured to recognize the user's impression-related request associated with the selected word representing the user's impression among the plurality of types of user's impression-related requests. An information output system characterized by: In the information output system according to claim 1,
There are multiple types of requests regarding the state of mind of the user,
The output control unit is configured to output to the output unit a selection screen of words expressing the user's self-confidence associated with the type of request regarding the user's state of mind,
The request recognizing unit receives an input of selection of a word expressing the user's confidence by the user, and a correspondence relationship between the word expressing the user's confidence selected from the selection screen and a request regarding the state of mind of the user. by referring to the information indicating the state of mind of the user, and recognizing a request regarding the user's state of mind associated with the selected words expressing the user's confidence among the plurality of types of requests regarding the user's state of mind. An information output system characterized by comprising: In the information output system according to claim 1,
There are a plurality of types of requests regarding the user's impression or the user's state of mind,
The request recognition unit is configured to provide information about the user's age, gender, occupation, area of residence, or personality, which is associated with the user's impression of the user or the type of request regarding the user's state of mind. Receiving input of attribute data, referring to information indicating a correspondence relationship between the input attribute and a request regarding the user's impression or state of mind, and making a request regarding the user's impression or state of mind an information output system configured to recognize a user's impression or desire regarding the state of mind associated with the attribute, among a plurality of types of .

Images