JP2018190176A - Image display device, skin-condition support system, image display program, and image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device for allowing a user to recognize the relationship between a measure execution degree and a skin condition.SOLUTION: An image display device 30 includes a designation recognition unit (skin support application 35a) and an output control unit (skin support application 35a). When the designation recognition unit recognizes a designation of a measure execution degree x, the output control unit recognizes first predicted scores P(x), Q(x), R(x) for at least one of the skin condition, the mind condition, and the physical condition of a user Ua to be obtained by execution of the measure at the designated measure execution degree x, on the basis of the outputs of first functions f(x), g(x), h(x), and causes an image display unit 31 to output display indicating the first predicted scores P(x), Q(x), R(x).SELECTED DRAWING: Figure 19

Description

  The present invention relates to an image display device, a skin condition support system, an image display program, and an image display method.

  Conventionally, various tools related to skin condition care are known.

  For example, in Patent Document 1, as a counseling tool used by a cosmetic salesperson or the like for a user, a skin condition explanation unit that explains the skin condition for a typical skin condition pattern, and the skin condition A counseling tool including an explanation display section for a necessary skin care method is described.

  The skin condition description section is a typical heading pattern of skin condition, “substance that tends to be deficient in moisture” and “smooth barrier function that protects the skin from external irritation” ……… I think. ”

  The explanation display section of the skin care method includes the headings "Slightly insufficient W moisturizing" and "Insufficient one W moisturizing + lotion mask cream" as skin care methods in the skin state.

  For example, if the cosmetic salesperson determines that the customer's skin condition is slightly deficient in moisture, he / she recommends “W moisturizing” displayed in the explanation section of the skin care method. By matching the state with the counseling tool, a measure according to the skin pattern can be immediately presented to the user.

Japanese Patent No. 4299080

  However, in the technique of Patent Document 1, the user knows what kind of skin condition will occur if the proposed measure is executed (time, amount, number of times per day, execution frequency, etc.) It was difficult to make it happen.

  Accordingly, an object of the present invention is to provide an image display device, a skin condition support system, an image display program, and an image display method that allow a user to recognize the relationship between the degree of execution of a measure and the skin condition.

The image display device of the present invention is
An image display unit for outputting information;
An input unit for detecting user input;
A score recognizing unit that recognizes at least one score among a skin state, a heart state, and a body state when the degree of execution of the group of measures as one or a plurality of measures is input. When,
An output control unit that causes the image display unit to output a display indicating the degree of execution of the user's measure group and a display indicating at least one score among the user's skin state, mind state, and body state;
A designation recognition unit for recognizing designation of the degree of execution of the measure group through the input unit,
When the designation recognition unit recognizes the designation of the degree of execution of the measure group,
The score recognition unit recognizes a first prediction score that is a prediction score of at least one of the user's skin state, heart state, and body state when the measure group is executed at the designated degree of execution. And
The output control unit causes the image display unit to output a display indicating the first prediction score.

  According to the image display apparatus having the configuration, the degree of execution of the measure designated by the user is recognized, the degree of execution of the designated measure is input, and the user when the measure is executed at the degree of execution. A first prediction score that is at least one prediction score of the skin state, the heart state, and the body state is recognized. And the display which shows a 1st prediction score is output to an image display part. Thereby, a user can be made to recognize the influence on at least one of a user's skin state, a mind state, and a body state when the degree of execution of a measure is changed.

In the image display device of the present invention,
Preferably, the score recognition unit recognizes a function for calculating the score and recognizes the score based on the function.

In the image display device of the present invention,
The score recognizing unit recognizes a skin score that is a score of a skin state when the measure group is executed with the degree of execution as an input of the degree of execution of the measure group; and
Recognizing a mental body score, which is at least one score among a mind state and a body state when the measure group is executed with the degree of execution, using the execution degree of the measure group as an input,
The output control unit causes the image display unit to output a display indicating a degree of execution of the user's measure group, a display indicating the user's skin score, and a display indicating the user's mind score,
The score recognition unit includes a second prediction score that is a predicted score of the user's skin score when the user executes the measure with the specified degree of execution, and the specified degree of execution of the measure. Recognizing a third predicted score that is a predicted score of the user's mind score when the user executes
The output control unit is preferably configured to cause the image display unit to output a display indicating the second prediction score and a display indicating the third prediction score.

  According to the image display device having the configuration, in accordance with the designation of the degree of execution of the measure, at least one prediction score (display indicating the prediction score of the skin state (second prediction score) and the body state and the heart state ( A display indicating the third prediction score is output to the image display unit. Thereby, in addition to the influence on a user's skin state when changing the execution degree of a measure, a user can be made to recognize the influence on at least one of a body state and a mind state.

In the image display device of the present invention,
The output control unit includes a first line display indicating a first line segment, and a first icon as a display displayed on the first line segment and indicating a degree of execution of the measure group of the user. A second line segment display showing a second line segment different from the first line segment, and displayed on the second line segment, and the skin state, body state and heart state of the user A second icon as a display indicating at least one score, and the image display unit is configured to output the second icon,
The designation recognizing unit recognizes the degree of execution of the measure group based on the position of the first icon designated by the user via the input unit,
The score recognizing unit recognizes the first predicted score when the designation recognizing unit recognizes the designation of the degree of execution and the degree of execution of the designated measure is input,
The output control unit preferably causes the image display unit to output the second icon so that the second icon is displayed at a position on the second line segment corresponding to the first prediction score. .

  According to the image display device having the configuration, the user's measure is executed based on the position of the first icon on the first line segment and the position of the second icon on the second line segment output to the image display unit. And at least one score among the user's skin state, body state, and heart state can be perceived by the user.

  Then, the degree of execution of the measure is recognized by the designation recognition unit based on the position of the first icon designated by the user via the input unit.

  Thereby, the user can specify the degree of execution of the measure sensuously.

  Then, the output control unit recognizes at least one score among the predicted skin state, body state, and heart state of the user when the user executes the measure at each specified degree of execution.

  The output control unit displays the second icon on the image so that the second icon is displayed on the second line segment corresponding to at least one prediction score among the recognized skin state, body state, and heart state. Output to the display.

  Thereby, a user can be made to recognize sensuously at least 1 prediction score among the skin state according to the execution degree of the designated measure, a body state, and a mind state.

  As described above, according to the image display device having the above configuration, a user's sensory operation and information recognition can be performed.

In the image display device of the present invention,
The first line segment display and the second line segment are extended so that the first line segment extends in a first direction and the second line segment extends in a second direction away from a position facing the first line segment. A line segment display is preferably arranged.

  According to the image display apparatus having the above configuration, the first line segment extends in the first direction, and the second line segment extends in the second direction away from the first line segment. By being non-parallel, the user can easily recognize that the two icons represented on these line segments show different values from each other.

In the image display apparatus having the configuration,
The first direction is preferably a direction orthogonal to the second direction.

  According to the image display device having the above configuration, the user can easily recognize that the second line segment and the two icons represented on the first line segment indicate different values from each other. At the same time, since the direction of the first line segment and the direction of the second line segment are orthogonal, the appearance of the screen can be made clear.

In the image display device of the present invention,
The output control unit includes a display indicating a degree of execution of the measure group of the user, a display indicating a variation score that is a score of the skin state, a body state, or a heart state of the user, the skin state of the user, The image display unit is configured to output a display showing a simulated score that is a score of the skin state, body state or heart state of the user different from the score of the body state or the heart state,
The designation recognizing unit recognizes the designation of the degree of execution of the measure group or the variation score via the input unit,
The score recognizing unit is a predicted score of a simulated score when the designation recognizing unit recognizes the designation of the degree of execution or the variation score, and the degree of execution of the designated measure or the variation score is input. Recognize mock prediction score,
The output control unit preferably outputs a display indicating the simulated prediction score to the image display unit.

  According to the image display device having the configuration, when the designation recognition unit recognizes the designation of the execution degree or the fluctuation score, the simulation prediction score when the execution degree or the fluctuation score of the designated measure is input is recognized. Then, a display indicating the simulated prediction score is output to the image display unit. Thereby, it is possible to make the user recognize not only the degree of execution of the measure but also the fluctuation of the target score (simulated score) according to the fluctuation of the score.

In the image display device of the present invention,
The output control unit displays a display indicating the degree of execution of the measure inside a predetermined area, and displays a display indicating a skin condition score, a display indicating a body condition score, and a heart condition score. It is preferable to display the display outside the predetermined area.

  According to the image display device having the configuration, a display indicating a skin condition score, a display indicating a body condition score, and a display indicating a heart condition score are displayed around a display indicating the degree or frequency of execution of the measure. This makes it easier for the user to understand the mutual relationship.

Explanatory drawing of the utilization form of a skin state recognition system. The block diagram of a skin condition recognition system and a user terminal. Explanatory drawing of a series of skin support processes by a skin state recognition system. The 1st flowchart of the process in a skin state recognition system. The 2nd flowchart of the process in a skin state recognition system. The 1st flowchart of the process in a user terminal. The 2nd flowchart of the process in a user terminal. Explanatory drawing of the analysis process of the initial data of the skin, mind, and body by subjective data and objective data. Explanatory drawing of quantification of a body state. Explanatory drawing of quantification of a heart state. FIG. 11A is a diagram showing the relationship between each measure and the improvement tendency of the measure, FIG. 11B is a diagram showing the schedule of each step, and FIG. 11C is the relationship between the desired skin, the subjective state of the skin state, and the objective state. FIG. Explanatory drawing of a progress table based on daily monitoring in the period which is implementing image display. Explanatory drawing of the influence on the skin condition by a special case. Explanatory drawing of the display screen of the improvement degree of the skin state in a user terminal. It is explanatory drawing of the evaluation method of a policy, FIG. 15A shows the evaluation criteria of a policy, and FIG. 15B has shown the example of evaluation of a policy. It is explanatory drawing of the evaluation method of a living and a special case, FIG. 16A shows the evaluation standard of a living and a special case, and FIG. 16B has shown the evaluation example of a living and a special case. Explanatory drawing of the determination method of a goal achievement degree. Explanatory drawing of secondary data. The flowchart of a simulation process. FIG. 20A is a diagram showing a user's skin condition score, a heart condition score, and a body condition score in a predetermined period, and FIG. FIG. 21A is a diagram illustrating the degree of execution of each measure of the user during a predetermined period, and FIG. 21B is a diagram illustrating the degree of execution of each category of the user during the predetermined period. The figure which shows a simulation screen. The figure which shows the simulation screen when a category bar is pressed. The graph which shows the execution degree of a measure, and the relationship with each score. The figure which shows an example of the simulation screen in other embodiment. The figure which shows another example of the simulation screen in other embodiment.

  An example of an embodiment of the present invention will be described with reference to FIGS.

[A. Usage of skin condition recognition system]
With reference to FIG. 1, the configuration of the skin condition recognition system 10 and the positioning of the system constituting the present invention will be described. The skin condition recognition system 10 is configured by a computer system including a CPU, a memory, various interface circuits, and the like. The skin condition recognition system 10 improves or maintains the skin condition of a plurality of users U (Ua, Ub, Uc are illustrated in FIG. 1) by executing an image display program stored in a memory by the CPU. The function of executing the process (image display process) is realized.

  The skin condition recognition system 10 performs data communication with a plurality of communication terminals (user terminals) 30 (user terminals 30a, 30c, and 30c in FIG. 1) via a communication network 1 such as the Internet. Thus, the improvement or maintenance of the skin condition of the user U is supported. The user terminal 30 corresponds to the “image display device” of the present invention.

  The communication network 1 is also connected with a communication terminal 50 (50a and 50b are illustrated in FIG. 1) of a person in charge T (Ta and Tb are illustrated in FIG. 1). The person in charge T receives, via the communication terminal 50, data including information such as an appropriate skin care method that takes into account the user's U skin characteristics, hobbies, lifestyles, and the like, and the skin condition recognition system 10 and the user terminal 30. To the user U for advice on improving the skin condition. Note that the communication terminal 50 of the person in charge T and the user terminal 30 of the user U do not necessarily have to be one-to-one, and the entire system including the skin condition recognition system 10, the communication terminal 50 of the person in charge T, and the communication network 1. The advice for improving the skin condition of the user U may be provided to the user terminal 30 of the user U. For example, a method of providing advice to each of the user terminals 30 of the user U by the plurality of persons in charge T via the respective communication terminals 50 may be used.

  Furthermore, the skin condition recognition system 10 has a function of analyzing unique data of each user transmitted from the user terminals 30 of a plurality of users U and generating secondary data that can be used for general purposes. A service of providing next data to another system 60 via the communication network 1 can also be performed.

[B. Structure of skin condition recognition system and user terminal]
With reference to FIG. 2, the structure of the skin condition recognition system 10 and the user terminal 30 is demonstrated. The skin condition recognition system 10 executes a program for image display held in a memory by a CPU, whereby a skin condition recognition unit 11, a measure group selection unit 12, a measure information transmission unit 13, and a secondary data generation unit 19. Function as. The processing by these configurations will be described later. The skin condition recognition system 10 also includes a support DB (database) 20 that holds various data used for the image display processing of the user U. This support DB 20 is developed on a RAM, for example, and can be rewritten by updating subjective and objective data described later.

  Next, the user terminal 30 of this embodiment includes a display 31, a touch panel 32, a camera 33, a microphone 34, a CPU 35, a memory 36, and the like. The display 31 corresponds to the “image display unit” of the present invention. The touch panel 32 corresponds to the “input unit” of the present invention. Instead of or in addition to this, by recognizing the user's designation based on the image of the user U imaged by the camera 33 or the voice of the user U input from the microphone 34, the camera 33 or the microphone 34 can be It may function as an “input unit”.

  Note that one device “recognizes” information means that one device receives the information from another device, and one device stores information stored in a storage medium connected to the one device. Reading, one device acquiring information based on a signal output from a sensor connected to the one device, one device acquiring from received information or information or sensor stored in a storage medium Based on the obtained information, a predetermined calculation process (calculation process or search process) is performed to derive the information, and one apparatus uses the information as a calculation process result of the other apparatus as the other apparatus. Means that any arithmetic processing for acquiring the information is executed, such as reading the information from the internal storage device or the external storage device in accordance with the received signal.

  In the present embodiment, since the user terminal 30 is a smartphone, for example, the user terminal 30 includes a camera 33, a microphone 34, and the like. Alternatively, a specialized imaging device may be used. The CPU 35 executes a program of an image display application 35a (hereinafter referred to as a skin support application 35a) held in the memory 36, whereby the user U supports the skin condition recognition system 10 via the skin support application 35a. It is assumed that it can be enjoyed. The CPU 35 executing the skin support application 35a corresponds to the “score recognition unit”, “output control unit”, and “designation recognition unit” of the present invention.

  In addition, the user U additionally has a keratin collection tape 37 (in FIG. 1, 37a, 37b, and 37c are illustrated) for acquiring skin cells. The keratin collection tape 37 may be provided to the user U by the person in charge T in advance, or the user U may purchase a commercially available keratin collection tape 37.

  In the following description, for convenience of explanation, a user who is a target of the skin condition improvement or maintenance support process is represented as a user Ua, and a user different from “user Ua” is represented as “other users Ub, Uc”. .

[C. A series of processes by the skin condition recognition system]
Next, a series of processes by the skin condition recognition system will be described with reference to FIG. The skin condition recognition system 10 includes “1. goal setting”, “2. schedule determination”, “3. monitoring”, “4. schedule correction”, “5. The process of each step of “goal determination” and “6.2 secondary data generation” is executed according to the flowcharts shown in FIGS. Moreover, the user terminal 30 performs the process by the flowchart shown to FIG.6, 7 according to the process by the skin state recognition system 10 in each process. Below, the process of CPU35 of the skin condition recognition system 10 and the user terminal 30 in each process is demonstrated, referring the flowchart shown to FIGS.

  The user Ua downloads the program of the skin support application 35a to the user terminal 30 and activates the skin support application 35a in STEP50 of FIG. Then, the user Ua applies for registration to the skin support application 35a.

  The skin condition recognition system 10 recognizes that “the registration application from the user Ua has been accepted” when accepting the registration application from the user Ua in STEP 10 of FIG. 4, and advances the processing to STEP 11. Then, the image display processing after STEP 11 is started.

[D. Goal setting process]
The process of “1. goal setting” shown in FIG. 3 is executed by the skin condition recognition unit 11 and the measure group selection unit 12. In step 11 of FIG. 4, the measure group selection unit 12 requests the user terminal 30 to input information for grasping the current skin, body, and heart states of the user Ua and the skin state desired by the user Ua. Send data.

  In the user terminal 30 that has received the initial information request data, the skin support application 35a determines the current skin, body, and heart states and the skin state desired by the user Ua from the user Ua in STEP 51 of FIG. Is displayed on the display 31. On the other hand, the user terminal 30 transmits initial user information data including information input by the user Ua to the skin condition recognition system 10. The skin state recognition unit 11 receives the initial user information data in STEP 11 of FIG. 4 and recognizes the skin, mind, and body states of the user Ua recognized from the initial user information data, and the skin state desired by the user Ua. The target level (goal) of the skin condition is set based on the above.

  Here, the initial user information data includes subjective data and objective data regarding the skin condition, the body condition, and the mind condition. Although detailed definition will be described later, subjective data is an item determined by the user's subjectivity, and objective data is data based on examination results, image analysis, and fact information. The skin condition subjective data is data indicating, for example, ten levels of satisfaction of the user Ua with respect to the current skin condition. The objective data of the skin state is the skin image data of the user Ua. The objective data of the skin condition may include analysis data of the stratum corneum cells of the user Ua collected by the keratin collection tape 37 in addition to the objective data of the skin condition included in the initial user information data. Specifically, the analysis data of the stratum corneum is, for example, data on water retention ability and sebum suitability. In this case, analysis of the stratum corneum is performed by, for example, the measuring device 45 connected to the user terminal 30, or the image data of the stratum corneum sampling tape 37 is transmitted from the user terminal 30 to the skin condition recognition system 10, The skin condition recognition system 10 side may analyze the image of the keratin collection tape 37 to measure the water retention capacity and sebum suitability.

The satisfaction level of the user Ua is acquired by a questionnaire input in the skin support application 35a. The skin image data is image data acquired by the user Ua taking an image of the face of the user Ua with an external camera connected to the camera 33 or the connection terminal 40 of the user terminal 30.

  Moreover, the skin support application 35a displays the usage method of the keratin collection tape 37 on the display device 31 to prompt the user Ua to use the keratin collection tape 37 and send it separately. The skin support application 35a may prompt the user Ua to use the keratin collection tape 37 and capture a skin image, and transmit the captured image to the skin condition recognition system 10.

  As shown in FIG. 8, the skin condition recognition unit 11 sets the initial value of the skin condition, for example, the subjective score is 3, the skin image score is 3, the water retention ability score is 2, and the sebum suitability score is 1. The total value is assigned as the score of the skin condition. Note that the score may be expressed as a decimal number instead of a positive integer, or may be expressed as a negative number.

  Recognition of a water retention ability score and a sebum suitability score by analysis of stratum corneum cells is referred to as a first recognition method. In place of or in addition to this, the first recognition method is at least one of a method for measuring the moisture content of the user's skin with a stratum corneum moisture meter and a method for measuring the sebum amount of the user's skin with a sebum meter. including. Further, in order to regularly recognize the user's skin by the first recognition method, the skin condition recognition unit 11 periodically transmits a message prompting the user terminal 30 to use the keratin collection tape 37 or the like. To prompt the user to take action. In this case, “periodic” does not need to be strictly equally spaced in time, and may be equally spaced within a range that does not affect the skin condition. For example, in the case where the first recognition method is performed every three months, when the first time is performed on January 1, not only April 1, which is three months later, but, for example, March one week before that A message may be transmitted to the user terminal 30 around 24 days, or a message may be sent to the user terminal 30 around April 8, for example, one week later. Also, when providing a service in the long term, for example, if you want to examine a fine improvement, set the first recognition method every month, and every three months to investigate the effect of seasonal changes on the skin condition The timing of recognition can be changed, such as setting the first recognition method.

  Each of recognition of the subjective score based on the subjective data of the skin state by the questionnaire input and recognition of the skin image score based on the skin image data of the user Ua is referred to as a second recognition method. The second recognition method may recognize the skin state of the user Ua by one of recognition of the subjective score based on the subjective data of the skin state by questionnaire input and recognition of the skin image score based on the skin image data of the user Ua. Different methods may be included. In addition, the second recognition method is performed more frequently than the first recognition method. This is because the use and mailing of the keratin sampling tape 37 is troublesome and expensive. Further, if the keratin collection tape 37 is frequently used, there is a possibility that the skin of the user Ua is adversely affected.

  For example, the first recognition method is performed every three months, and the second recognition method is performed every day. In addition, when the timings of the first recognition method and the second recognition method are overlapped, it is preferable that the timing is performed at the same timing if possible because accurate data can be obtained. However, even if the second recognition method is not performed when the first recognition method is performed, the present invention can be implemented and an effect can be obtained.

  The subjective score may be a score recognized based on subjective data.

The body state subjective data and objective data are divided as shown in FIG. Although detailed definition will be described later, like the subjective data and objective data of the skin, the subjective data is an item determined by the subjectivity of the user Ua, and the objective data is data based on examination results, image analysis, and fact information. The subjective data of the body state is acquired when the user Ua inputs a questionnaire through the skin support application 35a. The objective data includes image data of the tongue / lips of the user Ua captured by the user Ua using the camera 33 of the user terminal 30, and the user Ua measured by the measuring device 45 connected to the connection terminal 40 of the user terminal 30. Measurement data such as blood pressure, arrhythmia, urinary component, blood component, etc., and data such as the number of poor physical condition such as headache or stiff shoulder acquired by questionnaire input in the skin support application 35a, fatigue level determination, and the like. It should be noted that information on the occurrence of various diseases may be included in the initial user information data in preparation for future development of services other than skin care.

  The subjective data and the objective data of the mental state are divided as shown in FIG. Although the detailed definition will be described later, like the subjective data and objective data of the skin, the subjective data is an item determined by the subjectivity of the user Ua, and the objective data is data based on examination results, image analysis, and fact information. . Subjective data is acquired by questionnaire input in the skin support application 35a. The objective data is acquired by questionnaire input (frequency of laughing a day, etc.) in the skin support application 35a and measurement by a measuring device (psychological state estimation from pulse monitoring, etc.). In addition, in preparation for the development of services other than skin care in the future, occurrence information of various mental illnesses may be included in the initial user information data.

  The skin condition recognition unit 11 stores the subjective data and objective data of the recognized skin, body, and mind of the user Ua in the support DB 20.

  Based on the subjective data and objective data of the skin state, body state, and heart state of the user Ua thus recognized from the initial user information data, the skin state recognition unit 11 is indicated by the right triangle in FIG. In addition, initial values of three axes representing the skin state as 1 to 9, the body state as 1 to 6, and the heart state as 1 to 6 are set. Similarly to the skin condition score, the body condition or the mental condition subjective score and the objective score are calculated from the body condition or the mental condition subjective data and the objective data, and based on these, the body condition score and the mind condition score are calculated. May be treated as

  Further, the measure group selecting unit 12 acquires “skin level to be desired”, “measure category, hope, frequency” and “currently implemented measure” included in the initial user information data. The “satisfying skin level”, “measure category, hope, frequency” and “currently implemented measure” are input by the user Ua through the skin support application 35a.

    Here, in “Skin Level”, “Skin Level” refers to dryness improvement, wrinkle improvement, sensitive skin improvement, acne improvement, blurring improvement, spot improvement, wrinkle improvement, sagging improvement, dullness improvement, bear improvement, It is a skin condition improvement target selected from face color improvement and elasticity improvement. Further, the “level” is the level of satisfaction of the user Ua with respect to the skin condition of each target, and is a level selected by the user in 10 levels from 1 to 10 in the skin support application.

  The support DB 20 stores the improvement tendency of the subjective state of the skin state and the improvement tendency of the objective state associated with each improvement target. For example, as shown in FIG. 11C, “Dry feeling improvement” includes a skin condition subjective condition “dry feeling improvement” and a skin condition objective condition criterion “the difference between water retention ability and sebum suitability is minimized. ".

  For example, when “desired skin” is “improvement of dryness” and the satisfaction level of dryness in the current skin state is 3, it is associated with “improvement of dryness” according to the selection of the user Ua. Satisfaction level 5 about the subjective state “improvement of dryness” of the skin state of the user Ua is set as a subjective target level.

  In addition, the measure group selection unit 12 sets an objective improvement target of the skin condition associated with “dryness improvement”. For example, the measure group selection unit 12 is lower than the water retention capability among the skin states of the user Ua based on the criterion “minimize the difference between water retention capability and sebum suitability” associated with “improvement of dryness”. Sebum eligibility value 2 is set as an objective target level.

In addition, in “Category category, hope, frequency”, the category is “Eating habits, behavior at home, exercise, how to use cosmetics,” etc., and “hope, difficulty, time constraints, skin care scenes”, etc. As the frequency, “the number of times of receiving advice per day” or the like is selected.

  “Currently implemented measure” is a measure that the user Ua has already taken, and is represented by the content and frequency or degree of “use a bath”.

[E. Schedule determination process]
The step of “2. Schedule determination” shown in FIG. 3 is executed by the measure group selection unit 12 and the measure information transmission unit 13. The measure group selection unit 12 selects a measure group for achieving a goal (a subjective target level and an objective target level) in STEP 12 of FIG. This selection is performed in consideration of the improvement tendency of the subjective state of the skin state, the improvement tendency of the objective state of the skin state, and the suitable surrounding environment, which are associated with each improvement target described above. The measure group selection unit 12 determines the temperature, humidity, etc. of the surrounding environment of the user Ua during the schedule period based on the location information detected by a pre-registered region or GPS sensor and the date and time acquired from the clock function of the terminal. Predict.

  For example, the measure group selection unit 12 is a season in which the category hope is “behavior at home, eating habits, exercise” and the humidity is predicted to be an average of 50% as in the rainy season. If the level is “dryness” satisfaction level 5 or higher and the objective target level is sebum qualification level 2 or higher, the improvement tendency of the subjective condition includes “improvement of dryness” and the improvement tendency of the objective condition is “sebum qualification Select a measure that includes “improvement” and the category is “behavior, eating habits, exercise” at home, and the suitable surrounding environment is consistent with 50% humidity.

  Here, the improvement tendency of the subjective state and the improvement tendency of the objective state may be determined in advance by an expert such as the person in charge T or the like, and are implemented by other users Ub and Uc stored in the support DB 20. May be an improvement tendency of the subjective state and an improvement state of the objective state estimated based on a time-series change of the skin state of the other user Ub and Uc, and the implemented measure and the skin state of the user Ua When the time-series changes are stored in the support DB 20, the improvement tendency of the subjective state and the improvement tendency of the objective state estimated based on the information may be used.

  For example, in the support DB 20, the measures implemented by each of the other users Ub and Uc, the time-series changes in the subjective data of the skin condition for each of the other users Ub and Uc before and after the implementation of the measures, and other One or both of time-series changes in objective data of the skin state for each of the users Ub and Uc are stored.

  In addition, for example, in the support DB 20, the measure “used by the bathtub” performed by each of the other users Ub and Uc and the subjective state of the skin condition of each of the other users Ub and Uc before and after the implementation of the measure. It is assumed that “satisfaction with dryness” as a time series change is stored.

  At this time, for each of the other users Ub and Uc, the measure group selection unit 12 has, for example, the subjective data (dry feeling) of the skin condition on the day before using the bathtub and the day when using the bathtub. (Satisfaction level) is calculated. And the measure group selection part 12 takes the average value of the variation | change_quantity of satisfaction about the dry feeling for each other users Ub and Uc. For example, when the average value of the amount of change in “satisfaction with dryness” is equal to or greater than a predetermined value, the measure group selection unit 12 sets the improvement tendency of the subjective state of the measure “use a bathtub” as “improvement in dryness”. Recognize. The improvement tendency of the objective state can be recognized in the same manner as the improvement tendency of the subjective state.

The measure group selection unit 12 may narrow down the ranges of other users Ub and Uc to be processed, such as the same age and similar skin conditions, based on the age and skin condition of the user Ua.

  Further, the measure group selection unit 12 is estimated based on the information calculated in the same manner as described above when the measures implemented in the support DB and the time-series changes in the skin condition of the user Ua are stored. You may recognize the improvement tendency of a subjective state, and the improvement tendency of an objective state.

  In the first schedule determination step of the user Ua, the measure group selection unit 12 recognizes the improvement tendency of the subjective state and the improvement tendency of the objective state from the subjective data and objective data of the skin state of the other users Ub and Uc. And in the user's Ua 2nd schedule determination process, you may recognize the improvement tendency of a subjective state, and the improvement tendency of an objective state from the subjective data and objective data of the user's Ua skin state.

  The measure group selection unit 12 recognizes not only the skin state but also the mental state and the body state in the same manner, the improvement tendency of the subjective state and the improvement state of the objective state, A measure may be selected in consideration of an improvement tendency of the objective state.

  The measure group selection unit 12 may exclude the measure having the same content, the same frequency, or the same level as the “currently implemented measure” from the measure group. This is because it is considered that the measures that the user has already taken need not be proposed.

  In the example of FIG. 11A, the measure group selection unit 12 selects a measure group that is a combination of a plurality of measures so as to include “use a bathtub”, “vitamin C intake”, “vegetable intake”, and “walk more than 10,000 steps”. .

  The measure information transmission unit 13 evaluates the priority of the measure according to the “category category, hope, frequency” of the user Ua from the measure group, and determines the initial measure according to the priority. FIG. 12 illustrates an example of a schedule in which “use a bathtub”, “vegetable intake”, and “walk more than 10,000 steps” are selected as initial measures. The measure information transmission unit 13 transmits schedule data indicating the contents of the schedule determined in this way to the user terminal 30.

  The measure information transmission unit 13 also creates a plan for performing each process for a certain period based on the designation of the user Ua. In FIG. 11B, goal setting and schedule determination at START are performed, daily monitoring is performed, schedule is corrected every week, a progress graph is created after one month, goal determination and new goal are established at the third month The plan for a series of events to set up is shown. The measure information transmission unit 13 may use a predetermined execution plan for each process for a certain period in addition to or instead of designation by the user Ua.

  When the schedule data is received from the skin condition recognition system 10 in STEP 52 of FIG. 6 at the user terminal 30, the skin support application 35a displays the schedule execution table as shown in FIG. 12 and the work content as shown in FIG. 11B. The user Ua is encouraged to implement each measure. In the schedule execution table of FIG. 12, the contents of each measure (“use a bath”, “vegetable intake”, “walk more than 10,000 steps”) are displayed.

[F. Monitoring process]
The process of “3. monitoring” shown in FIG. 3 is executed by the skin condition recognition unit 11 and the measure information transmission unit 13 for each period set by the user Ua on the skin support application 35a (daily in FIG. 11B). . The user Ua who has started to use the skin support application 35a uses the user terminal 30 to make daily skin, body, and mind states, the implementation status of the measures instructed by the schedule, and users other than the measures instructed by the schedule. Enter the implementation status of Ua's voluntary action (action outside action). The implementation status of the measures includes “30 minutes”, “use on a bathtub”, “300 g” in addition to information indicating whether or not “use a bathtub”, “taken vegetables”, and “walk more than 10,000 steps”. ”And“ Vegetable intake ”,“ 15,000 steps ”,“ Walk ”, and the like, the degree of execution of measures represented by time, amount, and the like is included.

  The skin support application 35a proceeds to STEP 60 when the skin, body, and mind states are input by the user Ua in STEP 53 of FIG. 6, and the skin, body, Current user information data including subjective data and objective data regarding the state of the mind is transmitted to the skin condition recognition system 10, and the process proceeds to STEP54. In step 53 of FIG. 6, the skin support application 35a proceeds to step 54 as it is when the user Ua does not input the skin, body, and mind states. The data transmitted here does not include data relating to the stratum corneum cells collected by the keratin collection tape 37.

  The skin support application 35a advances the process to STEP 61 when the execution status of the schedule (execution status of each measure) is input by the user Ua in STEP 54 of FIG. 6, and executes execution status data indicating the execution status of the schedule. The data is transmitted to the skin condition recognition system 10 and the process proceeds to STEP 55 in FIG. The skin support application 35a proceeds to STEP 55 as it is when the execution status of the schedule (execution status of each measure) is not input by the user Ua in STEP 54 of FIG.

  Furthermore, the skin support application 35a advances the process to STEP 62 when the implementation status of the off-policy action is input by the user Ua in STEP 55 of FIG. 7, and the non-measure action execution data indicating the content of the off-measure action performed. Is transmitted to the skin condition recognition system 10, and the process proceeds to STEP56. The skin support application 35a proceeds to STEP 56 as it is when the implementation state of the action outside the measure is not input by the user Ua in STEP 55 of FIG.

  STEP 13 in FIG. 4 to STEP 16 in FIG. 5 and STEP 20 to STEP 22 in FIG. 4 are processes by the measure information transmitting unit 13. The skin condition recognition unit 11 advances the process to STEP 20 when receiving the current user information data from the user terminal 30 in STEP 13, accumulates the current user information data in the support DB 20, and advances the process to STEP 14. The skin condition recognition unit 11 proceeds to STEP 14 as it is when it does not receive the current user information data from the user terminal 30 at STEP 13.

  Further, the measure information transmission unit 13 proceeds to STEP 21 when receiving the execution status data from the user terminal 30 in STEP 14, accumulates the execution status data in the support DB 20, and proceeds to STEP 15. On the other hand, if it is determined in STEP 14 that execution status data has not been received from the user terminal 30, the process proceeds to STEP 15 as it is.

  Further, the measure information transmission unit 13 proceeds to STEP 22 when receiving the non-measure action execution data from the user terminal 30 in STEP 15, accumulates the non-measure action execution data in the support DB 20, and performs the process in STEP 16 of FIG. 5. Proceed. On the other hand, when the measure information transmitting unit 13 does not receive the non-measure action execution data from the user terminal 30 in STEP 15, the measure information transmitting unit 13 proceeds to STEP 16 in FIG.

  Moving to FIG. 5, in STEP 16, the measure information transmission unit 13 is based on the initial user information data, current user information data, execution status data, non-measure action execution data, and the like of the user Ua stored in the support DB 20. Progress table data indicating the progress status of the schedule is created, and this progress table data is transmitted to the user terminal 30.

  Here, for example, as shown in FIG. 12, the progress chart of the schedule includes, from the top, the level of the skin condition (here, dry skin), the level of the body condition, the level of the mental condition, and the measure (the vegetable used in the bathtub) The implementation status of ingestion (walking more than 10,000 steps), living information (vegetable intake, water intake), and living special cases are displayed on a daily basis.

  In addition, the schedule progress table includes the degree of execution of the measure (“30 minutes” used on a bathtub, “300 g” vegetable intake, “15,000 steps” walk).

  In the user terminal 30, the skin support application 35 a proceeds to STEP 63 when receiving the progress table data transmitted from the skin condition recognition system 10 in STEP 56 of FIG. 7, and stores the progress table data in the memory 36. The skin support application 35 a displays the progress table shown in FIG. 12 on the display 31 of the user terminal 30 using the progress table data stored in the memory 36.

  In addition to the progress table data, the skin support application 35a recognizes the initial user information data, current user information data, and execution status data of the user Ua, which is recognized through communication, and is stored in the support DB 20 of the skin condition recognition system 10. The information indicating the transition or change of each state of the skin, body, and mind of the user Ua is displayed on the display 31 of the user terminal 30 using the non-measure action execution data and the like.

  For example, as shown in FIG. 13, the skin support application 35 a is configured such that the user Ua's actions other than the measures based on the schedule (change of face washing method, massaged, etc.) and the user's physical condition (physiology, lack of sleep, etc.) The relationship between changes in the skin condition of the user Ua is displayed on the display 31 in a time series graph in units of days.

  Further, as shown in FIG. 14, the skin support application 35a changes the evaluation value of the skin condition including the horny condition of the user Ua, the psychological condition, the satisfaction degree of the skin care, and the usage value of the cosmetic product in units of one month. The contrasted radar chart is displayed on the display 31.

  The user Ua visually recognizes these displays by the skin support application 35a and confirms changes in the state of his / her skin, body and mind, thereby grasping changes in the state of the body and mind as well as the degree of improvement of the skin. Therefore, the goal of the target skin condition can be reached while improving the condition of the skin, body and mind in a well-balanced manner.

  The skin support application 35a proceeds to STEP 64 after STEP 63, and executes the simulator display process shown in FIG. Details of the simulator display process will be described later.

[G. Schedule correction]
The process of “4. Schedule correction” shown in FIG. 3 is executed by the measure information transmission unit 13 for each period set by the user Ua on the skin support application 35a (every week in FIG. 11B). STEP 17 to STEP 20 and STEP 30 to STEP 33 in FIG. 5 are processes by the measure information transmitting unit 13.

  The measure information transmission unit 13 is incorporated in the target achievement level and schedule of the user Ua skin state based on the initial user information data, current user information data, execution status data, and the like of the user Ua stored in the support DB 20 in STEP 17. The degree of execution of each measure and the effect of each measure are evaluated.

  The measure information transmission unit 13 extracts the correlation between the skin state and the body or mind state using the measure evaluation criteria shown in FIG. 15A, and each measure incorporated in the schedule based on this correlation Continuation, exclusion from the measure group, discontinuation of the measure, change to another measure.

  In the evaluation criteria of FIG. 15A, four items of presence / absence of execution, influence on the skin, influence on the body, influence on the mind are used as the determination items, and the implementation rate exceeds the predetermined implementation rate, which has a positive effect on the skin. A measure that does not have a bad influence on the body and mind is judged as A and is determined to continue. In FIG. 15A, a measure whose implementation rate exceeds a predetermined implementation rate is denoted as “implementation”, and a measure whose implementation rate is equal to or less than the predetermined implementation rate is denoted as “non-execution”. The same applies to FIGS. 12 and 15B.

When the timing of the impact of a measure and the period during which the impact continues are determined for each measure, the measure information transmission unit 13 determines the impact of each measure based on the timing of the impact of the measure and the duration of the impact of the measure. You may judge.

  For example, the effect on the skin, the influence on the body, the influence on the mind of the measure “use a bath” will affect the next day, and if it is determined to continue for one day, the measure information transmission unit 13 For example, it is determined that the influence of the measure “use a bathtub” on December 15 is reflected in each state on December 16.

  In addition, when it is determined that the effect of “vegetable intake” on the skin, the effect on the body, and the effect on the mind will be affected after one week and will continue for three days, the measure information transmission unit 13 For example, it is determined that the influence of the measure “vegetable intake” on December 15 is reflected in each state from December 22 to December 24.

  On the other hand, measures that are implemented and have a positive effect on the skin, but have a negative effect on either the body or the mind, are evaluated as B and are determined to be canceled or changed to another measure. In addition, since it is considered that a measure for which the implementation rate is equal to or less than the predetermined implementation rate has a large load on the user Ua, the evaluation becomes C evaluation and is canceled or another measure (for example, a measure that reduces the load on the user Ua or another measure) It is judged to be a change to measures.

  The measure information transmission unit 13 may evaluate whether there is a good or bad influence on the skin, body, and mind by implementing each measure for one day, or in a certain period such as several days or weeks. By implementing each measure, it may be evaluated whether there is a good or bad influence on the skin, body and mind. When evaluating in a certain period, for example, the measure information transmitting unit 13 sets B evaluation when any state is adversely affected at a certain rate, C evaluation when the implementation rate is below a certain rate, and otherwise In the case of A, it is good also as A evaluation. Instead of this, for example, the measure information transmission unit 13 may perform the B evaluation when the average value of the satisfaction degree in any state in a certain period is equal to or less than a predetermined value. In addition, if the satisfaction level of any state in one day is less than or equal to a predetermined value and the average value of the satisfaction level of any state in a certain period is less than or equal to a predetermined value, the C evaluation is used. If the satisfaction level of any state is less than or equal to a predetermined value, or the average value of the satisfaction level of any state in a certain period is less than or equal to a predetermined value, a B evaluation is made. If the average value of satisfaction in any state over a certain period exceeds a predetermined value, A evaluation may be used in combination with one-day evaluation and evaluation over a certain period. .

  Further, when the improvement degree of the skin condition score shown in FIG. 8 is equal to or less than a predetermined improvement degree, the measure information transmission unit 13 performs a measure in which the improvement degree of the skin condition score is equal to or less than the predetermined improvement degree. It may be excluded from the measure group. The measure information transmission unit 13 measures a measure in which the improvement level of the body state or the mental state score is equal to or lower than the predetermined improvement level when the improvement level of the body state or the mental state score is equal to or lower than the predetermined improvement level. May be excluded.

  FIG. 15B shows an example in which the evaluation standard shown in FIG. 15A is applied to a measure in the present embodiment (taken by a bathtub, ingesting vegetables, walking more than 10,000 steps). According to FIG. 15B, the measure information transmission unit 13 decides to continue on the next schedule as “A” for “use on a bathtub”, and exclude from the measure group as “B” for “vegetable intake”. Decided to cancel the schedule or change to other measures, and for “walk more than 10,000 steps” as C evaluation, exclude from the measure group, cancel the next schedule or change to other measures Has been decided.

  The measure information transmission unit 13 determines, for each combination of these measures, the influence of the plurality of measures being performed. For example, if the combination of “use a bath” and “vegetable intake” is B evaluation or C evaluation, the measure information transmission unit 13 should only use “use a bath” or “vegetable intake” alone. Or you may change so that it may be set as the combination of one of these measures and another measure.

The measure information transmitting unit 13 performs such an evaluation process to determine whether or not schedule correction (mainly correction by changing to another measure of the measure group) is necessary. To correct the schedule. Then, the schedule correction data, which is the corrected schedule data, is transmitted to the user terminal 30, and the ST
Proceed to EP19. On the other hand, when it is determined that the schedule need not be corrected, the measure information transmitting unit 13 proceeds from STEP 18 in FIG. 5 to STEP 19 in FIG. 5, and in this case, the schedule is not corrected.

  Next, in STEP 19, the measure information transmission unit 13 is incorporated in each action outside the measure (which is incorporated in the schedule) performed by the user Ua based on the initial user information data, the current user information data, the action-less action execution data, and the like. Evaluate actions taken by users in addition to measures.

  The measure information transmission unit 13 determines whether or not the non-measure action is recommended or forbidden using the evaluation standard for the non-measure action shown in FIG. 16A. In the evaluation criteria of FIG. 16A, the influence on each state of skin, body, and mind is used as a determination item.

  Then, when “there is a good effect on any of skin, body, and mind, and there is no adverse effect on any of them”, implementation is recommended as D evaluation. On the other hand, in the case of “there is a bad influence on any of skin, body and mind”, an E evaluation is given and a prohibition is proposed. In addition, in the case of “no effect on skin, body, or mind”, the evaluation is F and implementation is not recommended.

  FIG. 16B shows an example in which the evaluation standard shown in FIG. 16A is applied to the action outside the measure in the present embodiment (massage is received and a large amount of chocolate is ingested). As shown in FIG. 16B, the measure information transmission unit 13 determines the recommendation for the implementation on the next schedule as the D evaluation for “receiving massage”. In addition, regarding “a large amount of chocolate intake”, as an E evaluation, a proposal for a measure for stopping at the next schedule (for example, an alternative to ingest Japanese sweets) has been decided.

  When the measure information transmission unit 13 decides to cancel or change the measure incorporated in the schedule, or to decide to recommend or prohibit the implementation of the action outside the measure, the measure information transmitting unit 13 proceeds from STEP 20 to STEP 31. Then, when the recommendation is determined, the process proceeds from STEP 31 to STEP 33, the non-measure action recommendation data for recommending the execution of the non-measure action is transmitted to the user terminal 30, and the process proceeds to STEP 13 in FIG.

  On the other hand, when the measure information transmitting unit 13 determines the proposal of prohibition, the processing proceeds from STEP 31 to STEP 32, and transmits the non-measure action prohibition data for proposing prohibition of the non-measure action to the user terminal 30, and FIG. The process proceeds to STEP13.

  Further, when there is no action outside the measure for proposing recommendation or prohibition, the measure information transmission unit 13 proceeds from STEP 20 to STEP 13 in FIG. 4. In addition, when there is a substitute action in the action outside the measure for proposing prohibition, the action prohibition data outside the measure for proposing a change to the substitute action may be transmitted to the user terminal 30 instead of the proposal for the prohibition.

  In the user terminal 30, when receiving the schedule correction data from the skin condition recognition system 10 in STEP57 of FIG. 7, the skin support application 35a proceeds to STEP65 and corrects the schedule based on the schedule correction data. Then, the skin support application 35 a updates the schedule data held in the memory 36 and advances the process to STEP 58.

Also, in step 58 of FIG. 7, the skin support application 35 a proceeds to step 66 when receiving the non-measure action recommendation data or the non-measure action prohibition data from the skin condition recognition system 10, and proceeds with the process according to the received data. A screen for informing the user of the recommended or prohibited action is displayed on the display 31 of the user terminal 30. This notification may be performed, for example, by displaying a notification message on the progress table shown in FIG. Moreover, you may correct a schedule as a new measure for the recommended action outside the measure.

[H. Goal judging process]
The process of “5. goal determination” shown in FIG. 3 is performed for each period set by the user Ua on the skin support application 35a (three months after START in FIG. 11B), the skin condition recognition unit 11, and the measure group This is executed by the selection unit 12 and the measure information transmission unit 13.

  The skin support application 35 a displays on the display 31 of the user terminal 30 a message prompting the use of the keratin collection tape 37 and mailing of the keratin collection tape 37.

  The skin condition recognizing unit 11 recognizes an objective value (water retention ability, sebum suitability, etc.) of the skin condition based on information obtained from the keratin sampling tape 37 sent by mail.

  In addition, the skin support application 35a displays a message that prompts the use of imaging such as an answer to a questionnaire and skin on the display 31 of the user terminal 30, and transmits the obtained information.

  The skin condition recognition unit 11 recognizes the subjective value (subjective level) of the dryness of the skin and the objective value (skin image score) of the skin condition based on the information obtained from the skin support application 35a.

  The measure group selection unit 12 and the measure information transmission unit 13 compare the evaluation values at the start of support of the skin condition and after three months based on the subjective value of the dryness of the skin and the objective value of the skin condition. Determine the degree of goal achievement.

  In the example of FIG. 17, since the subjective value level of dryness has increased from 3 to 5 in 3 months, it is determined to be achieved (◯), and the objective image value is 3 to 4 in 3 months for the skin image score. Since the water retention capacity is maintained at 2 and the sebum suitability is increased from 1 to 2, it is determined to be achieved (◯). Since both the subjective value and the objective value have achieved the goal, it is determined that the goal has been achieved as a total.

  The skin condition recognition unit 11 and the measure group selection unit 12 re-execute the “1. goal setting” step shown in FIG. 3 in order to set a new goal when the goal is achieved. The skin condition recognizing unit 11 and the measure group selecting unit 12 may perform the “2. schedule determination” step when the goal is not reached, or “1. goal setting” according to the user's desire or progress. The process may be performed again.

[I. Secondary data generation]
The process of “6.2 secondary data generation” shown in FIG. 3 is executed by the secondary data generation unit 19. The secondary data generation unit 19 includes various types of data (hereinafter referred to as individual users) such as initial user information data, stratum corneum cell analysis data, current user information data, execution status data, non-measure action execution data transmitted from a plurality of users U. Data) is sequentially stored in the support DB 20 for each user.

  Then, the secondary data generation unit 19 analyzes the individual user data accumulated in the support DB 20 and, for example, as shown in FIG. 18, the characteristics of each user (gender, age, residence, preference, lifestyle, etc.) ), Targets for improvement of support (dryness, wrinkle, sensitivity, acne, sensation, etc.), measures proposed by the schedule (eg, use of a bathtub, ingestion of vegetables, walking more than 10,000 steps), and skin resulting from the implementation of the measures, Secondary data that correlates changes in each state of the body and mind is generated.

  The secondary data generation unit 19 also provides secondary data that associates the characteristics of each user with the influence of each state of the skin, body, and mind due to the implementation of the off-policy action, as in FIG. Generate.

  The secondary data generated in this way is effectively utilized when selecting effective measures for improving the skin condition while having a good influence on the body and mind for users having similar characteristics. be able to. For example, in the process of “2. Schedule determination” in FIG. 3 described above, the measure group selection unit 12 can select a measure that matches the characteristics of the user Ua with reference to the secondary data.

  In the process of “4. Schedule modification” in FIG. 3 described above, the measure information transmission unit 13 changes the secondary data when changing the schedule according to the transition of each state of the skin, body, and mind of the user Ua. The schedule can be changed to a plan that incorporates more effective measures or non-measure actions.

  In addition, secondary data can be used effectively to support skin conditions and for marketing purposes targeting users with certain characteristics (for example, women in their 30s living in Tokyo, etc.). Can also be used. Therefore, the secondary data may be provided to the other system 60 shown in FIG.

[J. Simulator display processing]
The details of the simulator display process (STEP 64 in FIG. 7) executed by the skin support application 35a will be described with reference to FIGS.

  In STEP 71 of FIG. 19, the skin support application 35 a recognizes “predetermined” based on the initial user information data and the current user information data of the user Ua accumulated in the support DB 20 of the skin condition recognition system 10 recognized through communication. The average value of each score of the skin state, the heart state, and the body state of “period” is recognized and stored in the memory 36. Here, the “predetermined period” is preferably a period in which the relationship between the skin state, the mind state, and the body state and the degree of execution of the measure is shown. 10 days, 1 month or 3 months. In the present embodiment, the execution time is assumed to be April 10, 2017, and 10 days from April 1, 2017, nine days before the execution time to the execution time, will be described as a “predetermined period”.

  For example, the skin support application 35a, as shown in FIG. 20A, based on the user Ua skin condition score, the heart condition score, and the body condition score for a predetermined period, the average value of the user Ua skin condition score The average value of the heart state score and the average value of the body state score are recognized and stored in the memory 36. Here, the average value of the skin condition score is 8.2, the average value of the heart condition score is 5.0, and the average value of the body condition score is 2.2.

  In STEP 72 of FIG. 19, the skin support application 35a recognizes each measure based on the initial user information data, the current user information data, and the execution status data accumulated in the support DB 20 of the skin condition recognition system 10 recognized through communication. The degree of execution of each measure for each category is recognized and stored in the memory 36. The “degree of execution of the measure” is a numerical value indicating the degree of execution of the measure determined for each measure. Examples of “degree of policy execution” include the time to execute the policy, the amount of consumption of the policy, the distance to execute the policy, the number of executions of the policy per day, the execution time per execution of the policy, The amount per execution of the measure and the frequency of execution of the measure in a predetermined period are included.

  For example, the skin support application 35a recognizes the degree of execution “intake” in the predetermined period of the measure “vegetable intake” of the category “meal” shown in FIG. Note that the degree of execution of “intake” or the like may be the actually acquired data (for example, vegetable intake data) itself, or may be an evaluation value of the actually acquired data. . For example, the evaluation value may be a value that increases continuously or intermittently as the value indicated in the data approaches a predetermined reference value (eg, vegetable intake 350 g). It may be a value that increases continuously or intermittently as the value shown is large, or may be a value that increases continuously or intermittently as the value shown in the data is small.

  As shown in FIG. 21A, the skin support application 35 a recognizes the average value and the maximum value of the degree of execution in a predetermined period for each measure, and stores them in the memory 36. The maximum value in the predetermined period may be the maximum value performed by the user Ua, the theoretically maximum value, or a predetermined value.

  The skin support application 35a calculates the degree of execution for each category by taking the ratio between the average value and the maximum value of the degree of execution of the measure for each category, and calculating these average values. Remember.

  For example, the skin support application 35a determines the execution degree of the category “meal” by the following formula (1) based on the average value and the maximum value of the execution degree in a predetermined period for each measure shown in FIG. 21A. evaluate. In the formula (1), three decimal places are rounded off.

  In STEP73 of FIG. 19, the skin support application 35a outputs the simulator whole screen P1 to the display 31 of the user terminal 30a as shown in FIG.

  On the entire simulator screen P1, a region P10 surrounded by a triangle is displayed at the center.

  A display P11 indicating a skin condition score, a display P12 indicating a heart condition score, and a display P13 indicating a body condition score are displayed outside the region P10 and around each vertex of the triangle.

  The region P10 corresponds to the “predetermined region” of the present invention.

  The displays P11, P12, and P13 indicating the scores include numerical displays P111, P121, and P131, score slide bars P112, P122, and P132, and score icons P113, P123, and P133.

  The score slide bars P112, P122, and P132 and the score icons P113, P123, and P133 correspond to the “display indicating at least one score among the user's skin state, heart state, and body state” of the present invention.

  The score slide bars P112, P122, and P132 correspond to the “second line segment display” of the present invention.

  The score icons P113, P123, and P133 correspond to the “second icon” of the present invention.

  The numerical value display P111, the score slide bar P112, and the score icon P113 correspond to the “display indicating the score of the user's skin condition” of the present invention.

  The numerical displays P121 and P131, the score slide bars P122 and P132, and the score icons P123 and P133 correspond to the “display indicating at least one score among the user's body state and mind state” of the present invention.

  Each numerical value display P111, P121, P131 displays the average value of the corresponding score recognized in STEP 71 of FIG.

  In each score slide bar P112, P122, P132, score icons P113, P123, P133 are displayed at positions corresponding to the average values of the corresponding scores recognized in STEP 71 of FIG. Moreover, each score slide bar P112, P122, P132 is a line segment extended in the horizontal direction (left-right direction on the paper surface) of the display 31 of the user terminal 30a. The horizontal direction of the display 31 corresponds to the “second direction” of the present invention.

  Inside the area P10, the categories “meal”, “behavior”, and “skin care” display P14, P15, and P16 of the measure are displayed. Inside the area P10, all category displays may be displayed, the category display of the category designated by the user may be displayed, or the category display of the category of the measure recommended to the user is displayed. Category display of a category of measures determined to have a high influence on at least one of the user's skin condition, mental condition, and body condition based on the initial user information data, the current user information data, and the execution status A predetermined number may be displayed.

  Each category “meal”, “behavior”, “skin care” display P14, P15, P16 includes category slide bars P141, P151, P161 and category icons P142, P152, P162.

  In each category slide bar P141, P151, and P161, category icons P142, P152, and P162 are displayed at positions corresponding to the degree of execution of each corresponding category recognized in STEP 72 of FIG. Moreover, each category slide bar P141, P151, P161 is a line segment extended in the up-down direction (up-down direction of the paper surface) of the display 31 of the user terminal 30a. The vertical direction of the display 31 corresponds to the “first direction” of the present invention.

  Each category slide bar P141, P151, P161 and each category icon P142, P152, P162 correspond to the “display indicating the degree of execution of the measure of the user” of the present invention. Each category slide bar P141, P151, P161 corresponds to the “first line segment display” of the present invention. Each category icon P142, P152, P162 corresponds to the “first icon” of the present invention.

  In STEP 74 of FIG. 19, the skin support application 35 a determines whether or not any category slide bar pressing operation has been detected via the touch panel 32. This operation has been described assuming that one of the category slide bars P141, P151, and P161 in FIG. 22 is operated as a typical usage scene, but a plurality of category slide bars are operated simultaneously. May be.

  When the determination result of STEP 74 in FIG. 19 is negative (STEP 74... NO in FIG. 19), the skin support application 35a executes the process of STEP 74 in FIG. 19 again.

  If the determination result of STEP 74 in FIG. 19 is affirmative (STEP 74... YES in FIG. 19), the skin support application 35a proceeds to STEP 75 in FIG. 19 and displays the measure in the area P10 as shown in FIG. P17, P18, and P19 are displayed.

  The measure displays P17, P18, and P19 are measures of a category (hereinafter referred to as a designated category) corresponding to the pressed slide bar. FIG. 23 shows the measure displays P17, P18, and P19 of the measures “vegetable intake”, “moisture intake”, and “three meals neat” when the pressing operation of the “meal” category slide bar P14 is detected.

The measure displays P17, P18, and P19 may be all measure displays, all the measures included in the designated category may be displayed, or the measure being executed by the user may be displayed. The measure recommended to the user may be displayed, and the influence on at least one of the user's skin state, mental state, and body state is high based on the initial user information data, the current user information data, and the execution state. A predetermined number of measure displays of measures determined to be may be displayed. The measure displays P17, P18, and P19 may be displayed in place of the category displays P14, P15, and P16, or displayed on the category displays P14, P15, and P16. It may be displayed in an added form (for example, in the downward direction of the category displays P14, P15, P16).

  In each measure slide bar P171, P181, and P191, measure icons P172, P182, and P192 are displayed at positions corresponding to the degree of execution of each corresponding measure recognized in STEP 72 of FIG. Each measure slide bar P171, P181, P191 is a line segment extending in the vertical direction (vertical direction on the paper surface) of the display 31 of the user terminal 30a.

  Each measure slide bar P171, P181, P191 and each measure icon P172, P182, P192 correspond to the “display indicating the degree of execution of the measure of the user” of the present invention. Each measure slide bar P171, P181, P191 corresponds to the “first line segment display” of the present invention. Each measure icon P172, P182, P192 corresponds to the “first icon” of the present invention.

  In STEP 76 of FIG. 19, the skin support application 35 a determines whether or not a pressing operation of any measure slide bar is detected via the touch panel 32.

  If the determination result is negative (NO in STEP 76 of FIG. 19), the skin support application 35a executes STEP 76 of FIG. 19 again.

  If the determination result is affirmative (YES in STEP 76 of FIG. 19), the skin support application 35a proceeds to STEP 77 of FIG. 19 and recognizes the pressed position on the pressed measure slide bar. The pressed position on the pressed measure slide bar corresponds to the “position of the first icon designated by the user via the input unit” of the present invention. The degree of execution of the measure corresponding to the pressed position on the pressed measure slide bar corresponds to the “degree of execution of the designated measure group” of the present invention. The measure corresponding to the pressed measure slide bar corresponds to the “measure group” of the present invention.

  In STEP78 of FIG. 19, the skin support application 35a predicts each score in the execution degree of the measure corresponding to the pressed position.

  Each score is represented by the following formulas (2) to (4).

  Here, P (x) is the score of the user Ua's skin condition, Q (x) is the score of the user Ua's heart condition, and R (x) is the score of the user Ua's body condition.

  i (i = 1,..., n) is a number for identifying each measure.

x _i (i = 1,..., n) is the degree of execution of each measure i by the user Ua. _{x i (i = 1, ...} , n) entire denoted a _{(x i (i = 1,} ..., vector comprising all of the n)) as x.

f _i (x _i ), g _i (x _i ), and h _i (x _i ) (i = 1,..., n) are the users when each measure _i is executed with the execution degree x _i of each measure, respectively. It is the amount of change in each score P (x), Q (x), R (x) of Ua. Each of f _i (x _i ), g _i (x _i ), and h _i (x _i ) (i = 1,..., n) corresponds to an example of the “first function” of the present invention.

  The line graph of FIG. 24 shows the relationship between each execution degree “intake amount” of the measure “vegetable intake” of the user Ua and each score P (x), Q (x), R (x) of the user Ua. It is a line graph. This line graph is, for example, the average of the scores P (x), Q (x), and R (x) of the user Ua shown in FIG. 20A for each execution degree of the measure of the user Ua shown in FIG. 20B. Can be created by taking

  In FIG. 24, the approximate curves of the respective line graphs are also displayed.

f _i (x _i ), g _i (x _i ), and h _i (x _i ) are, for example, the scores P (x), Q (x), and R ( x).

For example, when the intake of vegetable intake is 200 g, f _i (x _i ) is approximately 10.0, g _i (x _i ) is approximately 7.0, and h _i (x _i ) is approximately 2.0. Become.

f _i (x _i ), g _i (x _i ), and h _i (x _i ) take the average value of each score of the user Ua when the user Ua implements each measure. The impact of other measures implemented at the same time may be reflected.

For this reason, the influence degree of each measure is adjusted by the coefficients p _i , q _i , and r _i . The coefficients p _i , q _i , and r _i are obtained, for example, as a ratio of the degree of execution of the measure to the degree of execution of the measure. For example, when the skin condition score is improved by d when the measure s is executed with the execution degree a, the measure t is executed with the execution degree b, and the measure u is executed with the execution degree c, the following equation (5) ) To (7) represent the coefficients p _s , p _t , and _pu . In the present embodiment, the improvement in the skin condition score by the measure means that the average value of the skin condition score after the measure is increased by d from the average value of the skin condition score before the measure is executed. To do.

  k, l, and m are the scores when no measure is taken.

For each measure i, the skin support application 35a recognizes the measure xi of the measure corresponding to the position of the measure slide bar icon _xi , and uses each of the scores P (x ), Q (x), and R (x). For the measures included in the category corresponding to the category bar that is not pressed or the measures corresponding to the measure slide bar that is not pressed, the skin support application 35a displays the corresponding measures recognized in STEP 72 of FIG. the execution degree is used as the degree x _i execution measures. The predicted scores P (x), Q (x), and R (x) correspond to the “first predicted score” of the present invention. Each predicted score P (x) corresponds to the “second predicted score” of the present invention. The predicted scores Q (x) and R (x) correspond to the “third predicted score” of the present invention.

  In STEP 79 of FIG. 19, the skin support application 35 a is positioned at a position corresponding to each of the predicted scores P (x), Q (x), and R (x) of each of the score slide bars P 112, P 122, and P 132. The score icons P113, P123, and P133 are displayed on the display 31.

  After step 79 in FIG. 19 is completed, the skin support application 35a executes the processing from step 74 onward in FIG. Instead of this, after the end of STEP 79 in FIG. 19, the skin support application 35 a may execute the processing of STEP 76 and subsequent steps in FIG. 19.

By such processing, it is possible to make the user recognize the influence on each score when the degree of execution of the measure is changed.
(Other embodiments)
In this embodiment, Equations (2) to (7) are used to predict a score according to the degree of each execution. However, in order to predict a score according to the degree of each execution, these equations and It is not limited to parameters. In order to improve the accuracy of the simulator, those skilled in the art may appropriately make appropriate modifications such as changing the formula, changing the parameter calculation method, adding, deleting, and changing parameters.

  When the skin support application 35a detects the pressing of the category slide bar, it displays the measure slide bar of the measures included in the category corresponding to the category slide bar (STEP 74 and STEP 75 in FIG. 19). The skin support application 35a may change the position of the icon on the category slide bar to predict each score. In this case, the execution degree of each measure may be changed equally or at a predetermined rate so as to follow the change in the execution degree of the category. At this time, the skin support application 35a predicts each score according to the formulas (2) to (4) from the degree of execution of each measure after the change, and each icon is located at a position corresponding to each predicted score. It outputs to the indicator 31 so that it may be located. The measures included in the category corresponding to the pressed category slide bar correspond to the “measure group” of the present invention.

  In this case, when the skin support application 35a detects the pressing of the category slide bar via the touch panel 32 in a state where each icon is located at a position corresponding to each predicted score, the category slide bar is displayed. A measure slide bar for measures included in the corresponding category may be displayed. At this time, the position of the icon on each measure slide bar is preferably a position corresponding to the degree of execution of each measure after the change.

  Instead of displaying the category slide bar, the skin support application 35a may display measure displays P20, P21, and P22 as shown in FIG. 25 from the beginning.

  For example, as shown in FIG. 26, the skin support application 35a may include a simulation target score display P31, other score displays P32 to P33, and a living display P34. The living display P34 is a display showing, for example, an average value of the execution degree of each category or a value obtained by adding a coefficient for each category to the execution degree of each category. The skin support application 35a changes the degree of execution of each measure in accordance with the fluctuation of the icon on the life display P34, predicts the score of the simulation target according to formulas (2) to (4), and displays the score of the simulation target. The icon on P31 may be changed. The living display P34 corresponds to the “display indicating the degree of execution of the user's measure group” according to the present invention, and the other score displays P32 to P33 correspond to the “display indicating the fluctuation score” according to the present invention. The display P31 corresponds to the “display indicating the simulated score” of the present invention.

  In this case, the skin support application 35a is a graph similar to FIG. 24 based on the score data of the skin state, the heart state, and the body state of the user Ua according to the variation of the icons on the other score displays P32 to P33. May be used to predict the simulation target score and vary the icon on the simulation target score display P31. The score display P31 of the simulation target after the fluctuation corresponds to the “display indicating the simulated prediction score” of the present invention.

  In this embodiment, all the simulations of the skin state, the heart state, and the body state of the user Ua have been performed, but even if the simulation of the skin state and one of the heart state and the body state is performed by the same method. Alternatively, one simulation among the skin state, the heart state, and the body state may be performed. Moreover, the simulation regarding the other state of the user Ua may be performed.

  In the present embodiment, the first function to the third function indicating the relationship between the degree of execution of the past measure of the user Ua and the skin state, heart state, and body state of the user Ua are recognized. However, the present invention is not limited to this. The first function to the third function may be recognized based on the data of other users Ub and Uc. In addition, among other users Ub and Uc, user data having an attribute similar to that of the user Ua may be used. The attributes of the user Ua include, for example, the age, sex, region where the user Ua lives, preferences, skin characteristics, mind characteristics, body characteristics (gene information, etc.).

  In the present embodiment, the score slide bar, the category slide bar, and the measure slide bar extend in a direction orthogonal to each other. However, the present invention is not limited to this, and the score slide bar, the category slide bar, and the measure slide bar may extend in directions that are not parallel to each other. It may be.

  In the present embodiment, the execution degree of the measure is displayed by the category slide bar, the measure slide bar, the category icon, and the measure icon. However, instead of or in addition to this, a numerical value indicating the measure execution degree may be displayed. Moreover, a color, a figure, a character, etc. which change according to the execution degree of a measure may be displayed.

  Similarly, the color, figure, character, etc. which change according to the score of each state may be displayed also about the score of each state.

  In the present embodiment, the CPU 35 executes the skin support application 35a, thereby executing the processes of the “score recognition unit”, “output control unit”, and “designation recognition unit” of the present invention. The skin condition support system may execute some processes of the “score recognition unit”, “output control unit”, and “designation recognition unit” of the present invention by transmitting and receiving necessary data through communication.

In the present embodiment, the “function” is a function for outputting information such as a scalar value or a vector value by performing a certain operation on the input of information such as a scalar value or a vector value. Say what you have. In this embodiment, the functions f _i (x _i ), g _i (x _i ), and h _i (x _i ) are used for each measure i. However, instead of or in addition to this, a plurality of measures i, j Functions f _{(i, j)} (x _i , x _j ), g _{(i, j)} (x _i , x _j ) _, h _{(i, j)} (x _i , x _j ) for the combination of Also good. In the present embodiment, a function is used for each score of each state, but a common function may be used for a plurality of scores instead. The function may be one that performs classification by machine learning, for example. Each function in addition to the degree x _i of the execution of each measure i, numerical values representing the physical condition or mood of the user Ua, may enter a different numeric of the degree x _i of the execution of each measure i.

  The skin support application 35a may recognize the score of each state by referring to the table based on the input value.

  The skin support application 35a may recognize the score of each state by transmitting the input value to the skin state recognition system 10 and receiving the score of each state.

  In the present embodiment, the skin support application 35a predicts the score according to the designation of the degree of execution of the measure or category, but instead of or in addition to this, the degree of execution of the measure or category according to the designation of the score May be predicted. For example, the skin support application 35a may cause the user Ua to select one measure or category via the touch panel 32 and predict the degree of execution of the one measure according to the designation of the score. Further, the skin support application 35a causes the user Ua to input the rate of change of each measure or category via the touch panel 32, and varies the degree of execution of each measure at the rate input according to the designation of the score. Thus, the degree of execution of each measure may be predicted. For example, the skin support application 35a may change the sleeping time and the vegetable intake so as to realize the designated score at a rate that the vegetable intake increases by 100 g per hour of decrease in the sleeping time.

  The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

  DESCRIPTION OF SYMBOLS 1 ... Communication network, 10 ... Skin condition recognition system, 11 ... Skin condition recognition part, 12 ... Measure group selection part, 13 ... Measure information transmission part, 19 ... Secondary data generation part, 20 ... Support DB (database), 30 (30a, 30b, 30c) ... User terminal (smartphone), 31 ... Display, 32 ... Touch panel, 33 ... Camera, 34 ... Microphone, 35 ... CPU, 35a ... Skin support application, 36 ... Memory, 40 ... Connection terminal, 45: Measuring equipment.

Claims (10)

An image display unit for outputting information;
An input unit for detecting user input;
A score recognizing unit that recognizes at least one score among a skin state, a heart state, and a body state when the degree of execution of the group of measures as one or a plurality of measures is input. When,
An output control unit that causes the image display unit to output a display indicating the degree of execution of the user's measure group and a display indicating at least one score among the user's skin state, mind state, and body state;
A designation recognition unit for recognizing designation of the degree of execution of the measure group through the input unit,
When the designation recognition unit recognizes the designation of the degree of execution of the measure group,
The score recognition unit recognizes a first prediction score that is a prediction score of at least one of the user's skin state, heart state, and body state when the measure group is executed at the designated degree of execution. And
The output control unit causes the image display unit to output a display indicating the first prediction score. The image display device according to claim 1,
The image display device, wherein the score recognition unit recognizes a first function which is a function for calculating the score, and recognizes the score based on the first function. The image display device according to claim 1 or 2,
The score recognizing unit recognizes a skin score that is a score of a skin state when the measure group is executed with the degree of execution as an input of the degree of execution of the measure group; and
Recognizing a mental body score, which is at least one score among a mind state and a body state when the measure group is executed with the degree of execution, using the execution degree of the measure group as an input,
The output control unit causes the image display unit to output a display indicating a degree of execution of the user's measure group, a display indicating the user's skin score, and a display indicating the user's mind score,
The score recognition unit includes a second prediction score that is a predicted score of the user's skin score when the user executes the measure with the specified degree of execution, and the specified degree of execution of the measure. Recognizing a third predicted score that is a predicted score of the user's mind score when the user executes
The output control unit is configured to cause the image display unit to output a display indicating the second prediction score and a display indicating the third prediction score to the image display unit. The image display device according to any one of claims 1 to 3,
The output control unit includes a first line display indicating a first line segment, and a first icon as a display displayed on the first line segment and indicating a degree of execution of the measure group of the user. A second line segment display showing a second line segment different from the first line segment, and displayed on the second line segment, and the skin state, body state and heart state of the user A second icon as a display indicating at least one score, and the image display unit is configured to output the second icon,
The designation recognizing unit recognizes the degree of execution of the measure group based on the position of the first icon designated by the user via the input unit,
The score recognizing unit recognizes the first predicted score when the designation recognizing unit recognizes the designation of the degree of execution and the degree of execution of the designated measure is input,
The output control unit causes the image display unit to output the second icon so that the second icon is displayed at a position on the second line segment corresponding to the first prediction score. An image display device. The image display device according to claim 4.
The output control unit includes the first line so that the first line segment extends in a first direction, and the second line segment extends in a second direction away from a position facing the first line segment. An image display device, wherein a minute display and the second line segment display are arranged and displayed. The image display device according to claim 5,
The image display device according to claim 1, wherein the first direction is a direction orthogonal to the second direction. The image display device according to any one of claims 1 to 6,
The output control unit includes a first line display indicating a first line segment, and a first icon as a display displayed on the first line segment and indicating a degree of execution of the measure group of the user. And a third line segment indicating a third line segment different from the first line segment, and displayed on the third line segment, and the skin state, body state or heart state of the user A third icon as a display showing a variable score that is a score of
A fourth line segment indicating a fourth line segment different from the first line segment and the third line segment, and displayed on the fourth line segment and indicated by the third icon. A fourth icon as a display showing a simulated score that is a score of the user's skin state, body state or heart state different from the user's skin state, body state or heart state score; Is configured to output
The designation recognizing unit recognizes the degree of execution of the measure group based on the position of the first icon designated by the user via the input unit, or is designated by the user via the input unit. Recognizing the variation score based on the position of the third icon;
The score recognizing unit recognizes the fourth predicted score when the designation recognizing unit recognizes the execution degree or the designation of the variation score, when the execution degree or variation score of the designated measure is input.
The output control unit causes the image display unit to output the fourth icon so that the fourth icon is displayed at a position on the fourth line segment corresponding to the fourth prediction score. An image display device. The image display device according to any one of claims 1 to 7,
The output control unit displays a display indicating the degree of execution of the measure inside a predetermined area, and displays a display indicating a skin condition score, a display indicating a body condition score, and a heart condition score. An image display device that displays a display outside the predetermined area. An image display unit for outputting information;
The input unit that detects the user's input and the degree of execution of the measure group that is one or more measures are input, and at least of the skin state, the mind state, and the body state when the measure group is executed at the degree of execution A score recognition unit for recognizing one score;
A system comprising: an output control unit that outputs to the image display unit a display indicating a degree of execution of the user's measure group and a display indicating at least one score among the user's skin state, mind state, and body state. ,
Recognizing designation of the degree of execution of the measure group via the input unit;
The score recognition unit recognizes a first prediction score that is a prediction score of at least one of the user's skin state, heart state, and body state when the measure group is executed at the specified degree of execution. And steps to
And a step of outputting the display indicating the first prediction score to the image display unit. An image display unit for outputting information;
The input unit that detects the user's input and the degree of execution of the measure group that is one or more measures are input, and at least of the skin state, the mind state, and the body state when the measure group is executed at the degree of execution A score recognition unit for recognizing one score;
A system comprising: an output control unit that causes the image display unit to output a display indicating a degree of execution of the measure group of the user and a display indicating at least one score among the user's skin state, mind state, and body state. A method of performing,
Recognizing designation of the degree of execution of the measure group via the input unit;
The score recognition unit recognizes a first prediction score that is a prediction score of at least one of the user's skin state, heart state, and body state when the measure group is executed at the specified degree of execution. And steps to
The output control unit includes a step of outputting a display indicating the first prediction score to the image display unit.