JP2018190423A - Image display device, image display program, and image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device capable of making a user recognize a relationship between a measure and its effect.SOLUTION: An image display device 30 includes an information output control unit 35. The information output control unit 35 outputs a two-dimensional coordinate system defined by two axes representing effect of actions and burden of actions, and information P11 representing actions taken to an output unit 31 in such a way that the information P11 representing the actions is displayed at positions corresponding to effect and burden of the actions recognized by an action information recognition unit 35 on the two-dimensional coordinate system.SELECTED DRAWING: Figure 20

Description

  The present invention relates to an image display device, an image display program, and an image display method.

  Conventionally, various tools related to skin condition care are known.

  For example, in Patent Document 1, as a counseling tool used by a cosmetic salesperson or the like for a user, a skin condition explanation unit that explains the skin condition for a typical skin condition pattern, and the skin condition A counseling tool including an explanation display section for a necessary skin care method is described.

  The skin condition description section is a typical heading pattern of skin condition, “substance that tends to be deficient in moisture” and “smooth barrier function that protects the skin from external irritation” ……… I think. ”

  The explanation display section of the skin care method includes the headings "Slightly insufficient W moisturizing" and "Insufficient one W moisturizing + lotion mask cream" as skin care methods in the skin state.

  For example, if the cosmetic salesperson determines that the customer's skin condition is slightly deficient in moisture, he / she recommends “W moisturizing” displayed in the explanation section of the skin care method. By matching the state with the counseling tool, a measure according to the skin pattern can be immediately presented to the user.

Japanese Patent No. 4299080

  However, in the technique of Patent Document 1, uniform advice is only displayed for each skin condition. For this reason, it was not always possible to inform the user of the relationship between the action such as the measure and its influence.

  Therefore, an object of the present invention is to provide an image display device, an image display program, and an image display method that allow a user to recognize the relationship between an action and its influence.

The image display device of the present invention is
An output unit for outputting information;
A behavior information recognition unit for recognizing each behavior, the influence of each behavior on the state of the user, and the burden of each behavior;
While outputting the two-dimensional coordinate system represented by the two axes of the influence of the action and the burden of the action and the information indicating the respective actions to the output unit,
The information indicating each action is arranged at a position on the two-dimensional coordinate system corresponding to the influence of each action recognized by the action information recognition unit and the burden of each action. An information output control unit for outputting to the output unit.

  According to the image display device having the above configuration, the two-dimensional coordinate system represented by two axes of the influence of the action and the burden of the action, the influence of each action recognized by the action information recognition unit, and the action of each action Information indicating each action is output from the output unit at a position on the two-dimensional coordinate system corresponding to a burden.

  Thereby, about a some action, a user can be made to recognize sensuously the relationship between an action and its influence, and a user can be made to recognize which action is effective among several actions.

In the image display apparatus having the configuration,
An input unit that accepts input;
An action selection recognizing unit for recognizing designation of any one of a plurality of actions output from the output unit via the input unit;
A behavior information recognition unit for recognizing the designated behavior, the degree of execution of the designated behavior, and the influence of the designated behavior on the state of the user;
The degree of execution of the designated action recognized by the action information recognition unit and the influence of the designated action on a two-dimensional coordinate system represented by two axes of the degree of action execution and the influence of the action And an information output control unit that outputs information indicating the above to the output unit.

  According to the image display device having the configuration, when any of the plurality of actions output from the output unit is specified via the input unit, the degree of execution of the specified action and the specification are specified. Information indicating the effect of the action taken is output from the output unit.

  As a result, the user can sensuously recognize the relationship between the behavior and the influence of the plurality of behaviors. As a result, the user can recognize which of the plurality of behaviors is effective, and the user can It is possible to recognize the relationship between the degree of action execution and the influence of action, and in order to improve the user's state effectively, the user should determine how much action should be executed. Can be recognized.

The image display device of the present invention is
An output unit for outputting information;
A behavior information recognition unit for recognizing the behavior and the degree of execution of the behavior and the influence of the behavior on the user's skin, mind or body;
Information indicating the degree of execution of the action recognized by the action information recognition unit and the influence of the action on a two-dimensional coordinate system represented by two axes of the degree of action execution and the influence of the action You may provide the information output control part output to an output part.

  According to the image display device having the configuration, information indicating the degree of execution of an action and the influence of the action is output. This allows the user to recognize the relationship between the degree of execution of the action and the influence of the action, and in order to improve the user's state effectively, the degree of execution should be performed. It is possible to make the user recognize whether it should be performed.

In the image display apparatus having the configuration,
A threshold recognizing unit that recognizes the degree of execution in which the score of the user condition satisfies a predetermined condition as a threshold;
The information output control unit is preferably configured to output information indicating the threshold on the two-dimensional coordinate system to the output unit.

According to the image display device configured as described above, the information output control unit outputs information indicating the degree of execution of the behavior and the influence of the behavior, and information indicating the threshold recognized by the threshold recognition unit. This allows the user to recognize the degree of execution (threshold) in which the user's state score satisfies a predetermined condition as well as the relationship between the degree of action execution and the effect of the action. As a result, in order to improve a user's state effectively, it can be made to recognize a user how much action should be implemented.

In the image display device of the present invention,
The behavior information recognition unit recognizes the behavior and the influence of the behavior on the user and the influence of the behavior on other users,
It is preferable that the information output control unit outputs an influence of an action on a user and an influence of an action on another user to the output unit.

  According to the image display device having the configuration, the influence of the action on the user and the influence of the action on other users are output to the output unit. Thereby, it is possible to make the user recognize whether or not the action generally considered effective is effective.

In the image display device of the present invention,
The behavior information recognizing unit recognizes the influence when the one action is performed alone and the influence when the one action and the action different from the one action are combined,
The information output control unit, when the influence when the one action and the action different from the one action are performed together is larger than the influence when the one action is performed alone, It is preferable to output information recommending a combination of a different action and a different action to the output unit.

  According to the image display device having the configuration, it is possible to make the user recognize a combination of actions that can be more effective than performing the action alone.

Explanatory drawing of the utilization form of a skin state recognition system. The block diagram of a skin condition recognition system and a user terminal. Explanatory drawing of a series of skin support processes by a skin state recognition system. The 1st flowchart of the process in a skin state recognition system. The 2nd flowchart of the process in a skin state recognition system. The 1st flowchart of the process in a user terminal. The 2nd flowchart of the process in a user terminal. Explanatory drawing of the analysis process of the initial data of the skin, mind, and body by subjective data and objective data. Explanatory drawing of quantification of a body state. Explanatory drawing of quantification of a heart state. FIG. 11A is a diagram showing the relationship between each measure and the improvement tendency of the measure, FIG. 11B is a diagram showing the schedule of each step, and FIG. 11C is the relationship between the desired skin, the subjective state of the skin state, and the objective state. FIG. Explanatory drawing of a progress table based on daily monitoring in the period which is implementing image display. Explanatory drawing of the influence on the skin condition by a special case. Explanatory drawing of the display screen of the improvement degree of the skin state in a user terminal. It is explanatory drawing of the evaluation method of a measure, FIG. 15A shows the evaluation criteria of a measure, and FIG. 15B has shown the example of application of measure evaluation. It is explanatory drawing of the evaluation method of a living and a special case, FIG. 16A shows the evaluation standard of a living and a special case, and FIG. 16B has shown the application example of evaluation of a living and a special case. Explanatory drawing of the determination method of a goal achievement degree. Explanatory drawing of secondary data. The flowchart of the effect display process of a measure. 20A is a graph showing the effect of each measure and the burden of each measure, FIG. 20B is a graph showing the degree of execution of the measure and the effect of the measure, and FIG. 20C is the effect of the user and the effect of other users FIG. 20D is a screen for recommending a combination of measures. The flowchart of a measure graph output process. FIG. 22A is a diagram showing the data on the implementation status of the user's measures during a predetermined period, FIG. 22B is a diagram showing the data summed up the number of implementations and the number of improvements for each measure, and FIG. 22C is about the measure “vegetable intake” The figure which shows the average score for every degree of execution. The flowchart of an execution degree graph output process. The flowchart of a comparison graph output process with the effect of another user. The figure which shows the effect of the combination of a measure. The flowchart of a combination measure recommendation screen display process.

  An example of an embodiment of the present invention will be described with reference to FIGS.

[A. Usage of skin condition recognition system]
With reference to FIG. 1, the configuration of the skin condition recognition system 10 and the positioning of the system constituting the present invention will be described. The skin condition recognition system 10 is configured by a computer system including a CPU, a memory, various interface circuits, and the like. The skin condition recognition system 10 improves or maintains the skin condition of a plurality of users U (Ua, Ub, Uc are illustrated in FIG. 1) by executing an image display program stored in a memory by the CPU. The function of executing the process (image display process) is realized.

  The skin condition recognition system 10 performs data communication with a plurality of communication terminals (user terminals) 30 (user terminals 30a, 30c, and 30c in FIG. 1) via a communication network 1 such as the Internet. Thus, the improvement or maintenance of the skin condition of the user U is supported.

  The communication network 1 is also connected with a communication terminal 50 (50a and 50b are illustrated in FIG. 1) of a person in charge T (Ta and Tb are illustrated in FIG. 1). The person in charge T receives, via the communication terminal 50, data including information such as an appropriate skin care method that takes into account the user's U skin characteristics, hobbies, lifestyles, and the like, and the skin condition recognition system 10 and the user terminal 30. To the user U for advice on improving the skin condition. Note that the communication terminal 50 of the person in charge T and the user terminal 30 of the user U do not necessarily have to be one-to-one, and the entire system including the skin condition recognition system 10, the communication terminal 50 of the person in charge T, and the communication network 1. The advice for improving the skin condition of the user U may be provided to the user terminal 30 of the user U. For example, a method of providing advice to each of the user terminals 30 of the user U by the plurality of persons in charge T via the respective communication terminals 50 may be used.

  Furthermore, the skin condition recognition system 10 has a function of analyzing unique data of each user transmitted from the user terminals 30 of a plurality of users U and generating secondary data that can be used for general purposes. A service of providing next data to another system 60 via the communication network 1 can also be performed.

[B. Structure of skin condition recognition system and user terminal]
With reference to FIG. 2, the structure of the skin condition recognition system 10 and the user terminal 30 is demonstrated. The skin condition recognition system 10 executes a program for image display held in a memory by a CPU, whereby a skin condition recognition unit 11, a measure group selection unit 12, a measure information transmission unit 13, and a secondary data generation unit 19. Function as. The processing by these configurations will be described later. The skin condition recognition system 10 also includes a support DB (database) 20 that holds various data used for the image display processing of the user U. This support DB 20 is developed on a RAM, for example, and can be rewritten by updating subjective and objective data described later.

  Next, the user terminal 30 of this embodiment includes a display 31, a touch panel 32, a camera 33, a microphone 34, a CPU 35, a memory 36, and the like. The user terminal 30 corresponds to the “image display device” of the present invention. The display 31 corresponds to the “output unit” of the present invention.

  In the present embodiment, since the user terminal 30 is, for example, a smartphone, the camera is equipped with a camera 33, a microphone 34, and the like. Alternatively, a specialized imaging device may be used. The CPU 35 executes a program of an image display application 35a (hereinafter referred to as a skin support application 35a) held in the memory 36, whereby the user U supports the skin condition recognition system 10 via the skin support application 35a. It is assumed that it can be enjoyed. The CPU 35 that executes the skin support application 35a corresponds to the “information output control unit”, “behavior information recognition unit”, “behavior information selection unit”, and “threshold recognition unit” of the present invention.

  In addition, the user U additionally has a keratin collection tape 37 (in FIG. 1, 37a, 37b, and 37c are illustrated) for acquiring skin cells. The keratin collection tape 37 may be provided to the user U by the person in charge T in advance, or the user U may purchase a commercially available keratin collection tape 37.

  In the following description, for convenience of explanation, a user who is a target of the skin condition improvement or maintenance support process is represented as a user Ua, and a user different from “user Ua” is represented as “other users Ub, Uc”. .

[C. A series of processes by the skin condition recognition system]
Next, a series of processes by the skin condition recognition system will be described with reference to FIG. The skin condition recognition system 10 includes “1. goal setting”, “2. schedule determination”, “3. monitoring”, “4. schedule correction”, “5. The process of each step of “goal determination” and “6.2 secondary data generation” is executed according to the flowcharts shown in FIGS. Moreover, the user terminal 30 performs the process by the flowchart shown to FIG.6, 7 according to the process by the skin state recognition system 10 in each process. Below, the process of CPU35 of the skin condition recognition system 10 and the user terminal 30 in each process is demonstrated, referring the flowchart shown to FIGS.

  The user Ua downloads the program of the skin support application 35a to the user terminal 30 and activates the skin support application 35a in STEP50 of FIG. Then, the user Ua applies for registration to the skin support application 35a.

  The skin condition recognition system 10 recognizes that “the registration application from the user Ua has been accepted” when accepting the registration application from the user Ua in STEP 10 of FIG. 4, and advances the processing to STEP 11. Then, the image display processing after STEP 11 is started.

Note that one device “recognizes” information means that one device receives the information from another device, and one device stores information stored in a storage medium connected to the one device. Reading, one device acquiring information based on a signal output from a sensor connected to the one device, one device acquiring from received information or information or sensor stored in a storage medium Based on the obtained information, a predetermined calculation process (calculation process or search process) is performed to derive the information, and one apparatus uses the information as a calculation process result of the other apparatus as the other apparatus. Means that any arithmetic processing for acquiring the information is executed, such as reading the information from the internal storage device or the external storage device in accordance with the received signal.

[D. Goal setting process]
The process of “1. goal setting” shown in FIG. 3 is executed by the skin condition recognition unit 11 and the measure group selection unit 12. In step 11 of FIG. 4, the measure group selection unit 12 requests the user terminal 30 to input information for grasping the current skin, body, and heart states of the user Ua and the skin state desired by the user Ua. Send data.

  In the user terminal 30 that has received the initial information request data, the skin support application 35a determines the current skin, body, and heart states and the skin state desired by the user Ua from the user Ua in STEP 51 of FIG. Is displayed on the display 31. On the other hand, the user terminal 30 transmits initial user information data including information input by the user Ua to the skin condition recognition system 10.

  The skin state recognition unit 11 receives the initial user information data in STEP 11 of FIG. 4 and recognizes the skin, mind, and body states of the user Ua recognized from the initial user information data, and the skin state desired by the user Ua. The target level (goal) of the skin condition is set based on the above.

Here, the initial user information data includes subjective data and objective data regarding the skin condition, the body condition, and the mind condition.
Here, the skin condition is a condition related to the user's skin. For example, the skin condition includes water retention, sebum suitability, skin cell condition (cell area, amount of melanin, cell peeling, etc.), skin characteristics (acne index indicating the number of acne, skin sensitivity) Sensitivity etc.). The skin may be not only the skin of the face but also the extremities such as arms, the skin of the chest and the body.
The physical state is a change in the physical state of the user. The physical state includes, for example, a physical wound such as an injury or a burn, a state of muscle mass or a visceral function. In addition, the physical state includes a tendency of so-called physical strength such as stress tolerance, physical fatigue, or “easy to get tired”. The physical state (physical state of the user) may be represented by the results of physical measurements such as height, weight, body fat mass, waist circumference, etc. Or the like, and may be represented by a result of determination of constitution by oriental medicine. The body condition score may be determined based on these results.
The mental state represents a mental state, for example, an emotional state, as opposed to a physical state representing a physical state. For example, "feeling tired" or "mental fatigue" due to "feeling depressed" when something fails, forced to be nervous for a long time, etc. correspond to the mental state. The heart condition may also include symptoms of so-called depression such as insomnia, guilt, despair, abnormal appetite, and suicidal ideation.
The state of the user may include a state of “impression” or the like given to another person in addition to the above-described skin state, body state, and heart state. For example, a score such as an impression of the target user may be determined based on a questionnaire response regarding the impression of the target user received from another user.
Although detailed definition will be described later, subjective data is an item determined by the user's subjectivity, and objective data is data based on examination results, image analysis, and fact information. The skin condition subjective data is data indicating, for example, ten levels of satisfaction of the user Ua with respect to the current skin condition. The objective data of the skin state is the skin image data of the user Ua.
Note that the objective data of the skin condition may include analysis data of the stratum corneum cells of the user Ua collected by the keratin collection tape 37 in addition to the objective data of the skin condition included in the initial user information data. The stratum corneum cells of the user Ua collected by the stratum corneum sampling tape 37 may be stratum corneum cells of a predetermined portion (for example, cheek) of the user Ua face. Instead of or in addition to this, stratum corneum cells at positions other than the face of the user Ua such as the arm of the user Ua may be collected by the keratin collection tape 37.
Further, as the skin image data, for example, image data of a predetermined part (for example, cheek) of the face can be used. Instead of or in addition to this, image data of a predetermined portion (for example, an arm) other than the face may be used. Further, in addition to these, image data other than skin (for example, eyes or tongue) may be used.
Specifically, analysis data of stratum corneum include, for example, water retention ability, sebum suitability, cell condition (cell area, amount of melanin, cell peeling, etc.), and skin condition (eg, number of acne and skin) Data). In this case, analysis of the stratum corneum is performed by, for example, the measuring device 45 connected to the user terminal 30, or the image data of the stratum corneum sampling tape 37 is transmitted from the user terminal 30 to the skin condition recognition system 10, The skin condition recognition system 10 may analyze the image of the keratin sampling tape 37 to measure water retention capacity, sebum suitability, cell condition, skin condition, and the like.
In the following example, the skin state recognizing unit 11 will explain the case where the water retention ability score and the sebum suitability score are determined based on the analysis data, but instead of or in addition to these, the cell state, and A score may be determined according to specified criteria for each skin condition.
For example, the skin condition recognition unit 11 can determine a water retention ability score and a sebum suitability score according to the size or shape of each cell.
Moreover, the skin state recognition part 11 may recognize the area | region of the keratinocyte per unit area, the peeling state of a keratinocyte, or a nucleated cell rate, and may determine the score which shows the state of a cell based on these. The skin state recognition unit 11 can be said to be in a “good” state as the area of the keratinocytes is larger and the detachment state of the keratinocytes is smaller. The score indicating the state of the cells may be evaluated so as to increase.
Supplementally, skin cells have the following characteristics. That is, the skin cells always divide while the epidermal basal cells present in the lowest layer as viewed from the skin surface are pushed up to the skin surface side, and the cells that have lost their nuclei appear as keratin on the skin surface and peel off as plaque. In normal skin, this cell takes about 28 days to regenerate. However, when the skin is damaged by ultraviolet rays, cells with nuclei (nucleated cells) and immature cells with a small cell area are formed, and the water retention function of the skin and the protection function from ultraviolet rays etc. are incomplete. Or exfoliation of keratinocytes is not performed smoothly. In order to grasp what the skin condition is, it is useful to determine a score indicating the cell state based on the area of the keratinocytes or the detachment state of the keratinocytes.
Further, the skin condition recognition unit 11 analyzes the amount and distribution of melanin by staining the stratum corneum cells with Fontana-Masson so that the melanin can be easily seen, and calculates the melanin condition of the skin by applying a light beam having a short wavelength to the skin. It is also possible to determine the skin condition score by quantifying the unevenness of the surface form by applying visible light to the skin, and by analyzing the surface form of the skin from the state by attaching the replica to the skin. Furthermore, the skin state recognition unit 11 can perform evaluation using a digitized image of a stratum corneum cell itself or a digitized skin image.
The skin condition recognition unit 11 may use one or a plurality of scores according to one or a plurality of analysis results as the skin condition score, but obtains a comprehensive skin condition score based on the plurality of analysis results. You may decide. As described above, in the following example, the skin state recognizing unit 11 will describe a case where a water retention ability score and a sebum suitability score are determined as skin condition scores.

  The satisfaction level of the user Ua is acquired by a questionnaire input in the skin support application 35a. The skin image data is image data acquired by the user Ua taking an image of the face of the user Ua with an external camera connected to the camera 33 or the connection terminal 40 of the user terminal 30.

  Moreover, the skin support application 35a displays the usage method of the keratin collection tape 37 on the display device 31 to prompt the user Ua to use the keratin collection tape 37 and send it separately. The skin support application 35a may prompt the user Ua to use the keratin collection tape 37 and capture a skin image, and transmit the captured image to the skin condition recognition system 10.

  As shown in FIG. 8, the skin condition recognition unit 11 sets the initial value of the skin condition, for example, the subjective score is 3, the skin image score is 3, the water retention ability score is 2, and the sebum suitability score is 1. The total value is assigned as the score of the skin condition. Note that the score may be expressed as a decimal number instead of a positive integer, or may be expressed as a negative number.

Instead of or in addition to the method of recognizing the water retention ability score and sebum suitability score by analyzing stratum corneum cells (first recognition method), a method of measuring the moisture content of the user's skin with a stratum corneum moisture meter and the amount of sebum It includes at least one of methods for measuring the amount of sebum of the user's skin with a meter. Further, in order to regularly recognize the user's skin by the first recognition method, the skin condition recognition unit 11 periodically transmits a message prompting the user terminal 30 to use the keratin collection tape 37 or the like. To prompt the user to take action. In this case, “periodic” does not need to be strictly equally spaced in time, but may be equally spaced within a range that does not affect the skin condition. For example, in the case where the first recognition method is performed every three months, when the first time is performed on January 1, not only April 1, which is three months later, but, for example, March one week before that A message may be transmitted to the user terminal 30 around 24 days, or a message may be sent to the user terminal 30 around April 8, for example, one week later. Also, when providing a service for a long period of time, for example, when you want to investigate a fine improvement, set the first recognition method every month, and to investigate the effect of seasonal changes on the skin condition, The recognition timing can be changed, such as setting the first recognition method for each.

  Each of recognition of the subjective score based on the subjective data of the skin state by the questionnaire input and recognition of the skin image score based on the skin image data of the user Ua is referred to as a second recognition method. The second recognition method may recognize the skin state of the user Ua by one of recognition of the subjective score based on the subjective data of the skin state by questionnaire input and recognition of the skin image score based on the skin image data of the user Ua. Different methods may be included. In addition, the second recognition method is performed more frequently than the first recognition method. This is because the use and mailing of the keratin sampling tape 37 is troublesome and expensive. Further, if the keratin collection tape 37 is frequently used, there is a possibility that the skin of the user Ua is adversely affected.

  For example, the first recognition method is performed every three months, and the second recognition method is performed every day. In addition, when the timings of the first recognition method and the second recognition method are overlapped, it is preferable to perform the same recognition timing if possible because accurate data can be obtained. However, even if the second recognition method is not performed when the first recognition method is performed, the present invention can be implemented and an effect can be obtained.

  The subjective score may be a score determined based on subjective data.

The body state subjective data and objective data are divided as shown in FIG. Although detailed definition will be described later, like the subjective data and objective data of the skin, the subjective data is an item determined by the subjectivity of the user Ua, and the objective data is data based on examination results, image analysis, and fact information. The subjective data of the body state is acquired when the user Ua inputs a questionnaire through the skin support application 35a. The objective data includes image data of the tongue / lips of the user Ua captured by the user Ua using the camera 33 of the user terminal 30, and the user Ua measured by the measuring device 45 connected to the connection terminal 40 of the user terminal 30. Measurement data such as blood pressure, arrhythmia, urinary component, blood component, etc., and data such as the number of poor physical condition such as headache or stiff shoulder acquired by questionnaire input in the skin support application 35a, fatigue level determination, and the like. It should be noted that information on the occurrence of various diseases may be included in the initial user information data in preparation for future development of services other than skin care.

The subjective data and the objective data of the mental state are divided as shown in FIG. Although the detailed definition will be described later, like the subjective data and objective data of the skin, the subjective data is an item determined by the subjectivity of the user Ua, and the objective data is data based on examination results, image analysis, and fact information. . Subjective data is acquired by questionnaire input in the skin support application 35a. The objective data is acquired by questionnaire input (frequency of laughing a day, etc.) in the skin support application 35a and measurement by a measuring device (psychological state estimation from pulse monitoring, etc.). In addition, in preparation for the development of services other than skin care in the future, occurrence information of various mental illnesses may be included in the initial user information data.
Further supplementally, the subjective data of the mental state is what the user Ua, such as an answer to a questionnaire, determines himself or herself. For example, if the user Ua determines that the degree of heart depression is about 8 out of 10 in the questionnaire, “8” is the subjective data of the mental state. On the other hand, judgments using diagnostic tests used in psychosomatic medicine or psychiatry, such as WHO-5, are based on objective data, even if each option is the result of a user's subjective response. May be treated as This is because this psychological test was created for the purpose of assisting objective diagnosis. In this way, the evaluation results of a plurality of subjective data of the heart state may be handled as objective data of the heart state.

  The skin condition recognition unit 11 stores the subjective data and objective data of the recognized skin, body, and mind of the user Ua in the support DB 20.

  Based on the subjective data and objective data of the skin state, body state, and heart state of the user Ua thus recognized from the initial user information data, the skin state recognition unit 11 is indicated by the right triangle in FIG. In addition, initial values of three axes representing the skin state as 1 to 9, the body state as 1 to 6, and the heart state as 1 to 6 are set. Similarly to the skin condition score, the body condition or the mental condition subjective score and the objective score are calculated from the body condition or the mental condition subjective data and the objective data, and based on these, the body condition score and the mind condition score are calculated. May be treated as

  Further, the measure group selecting unit 12 acquires “skin level to be desired”, “measure category, hope, frequency” and “currently implemented measure” included in the initial user information data. The “satisfying skin level”, “measure category, hope, frequency” and “currently implemented measure” are input by the user Ua through the skin support application 35a.

  Here, in “Skin Level”, “Skin Level” refers to dryness improvement, wrinkle improvement, sensitive skin improvement, acne improvement, blurring improvement, spot improvement, wrinkle improvement, sagging improvement, dullness improvement, bear improvement, It is a skin condition improvement target selected from face color improvement and elasticity improvement. Further, the “level” is the level of satisfaction of the user Ua with respect to the skin condition of each target, and is a level selected by the user in 10 levels from 1 to 10 in the skin support application.

  The support DB 20 stores the improvement tendency of the subjective state of the skin state and the improvement tendency of the objective state associated with each improvement target. For example, as shown in FIG. 11C, “Dry feeling improvement” includes a skin condition subjective condition “dry feeling improvement” and a skin condition objective condition criterion “the difference between water retention ability and sebum suitability is minimized. ".

  For example, when “desired skin” is “improvement of dryness” and the satisfaction level of dryness in the current skin state is 3, it is associated with “improvement of dryness” according to the selection of the user Ua. Satisfaction level 5 about the subjective state “improvement of dryness” of the skin state of the user Ua is set as a subjective target level.

  In addition, the measure group selection unit 12 sets an objective improvement target of the skin condition associated with “dryness improvement”. For example, the measure group selection unit 12 is lower than the water retention capability among the skin states of the user Ua based on the criterion “minimize the difference between water retention capability and sebum suitability” associated with “improvement of dryness”. Sebum eligibility value 2 is set as an objective target level.

  In addition, in “Category category, hope, frequency”, the category is “Eating habits, behavior at home, exercise, how to use cosmetics,” etc., and “hope, difficulty, time constraints, skin care scenes”, etc. As the frequency, “the number of times of receiving advice per day” or the like is selected.

  “Currently implemented measure” is a measure that the user Ua has already taken, and is represented by the content and frequency or degree of “use a bath”.

[E. Schedule determination process]
The step of “2. Schedule determination” shown in FIG. 3 is executed by the measure group selection unit 12 and the measure information transmission unit 13. The measure group selection unit 12 selects a measure group for achieving a goal (a subjective target level and an objective target level) in STEP 12 of FIG. This selection is performed in consideration of the improvement tendency of the subjective state of the skin state, the improvement tendency of the objective state of the skin state, and the suitable surrounding environment, which are associated with each improvement target described above. The measure group selection unit 12 determines the temperature, humidity, etc. of the surrounding environment of the user Ua during the schedule period based on the location information detected by a pre-registered region or GPS sensor and the date and time acquired from the clock function of the terminal. Predict.

  For example, the measure group selection unit 12 is a season in which the category hope is “behavior at home, eating habits, exercise” and the humidity is predicted to be an average of 50% as in the rainy season. If the level is “dryness” satisfaction level 5 or higher and the objective target level is sebum qualification level 2 or higher, the improvement tendency of the subjective condition includes “improvement of dryness” and the improvement tendency of the objective condition is “sebum qualification Select a measure that includes “improvement” and the category is “behavior, eating habits, exercise” at home, and the suitable surrounding environment is consistent with 50% humidity.

  Here, the improvement tendency of the subjective state and the improvement tendency of the objective state may be determined in advance by an expert such as the person in charge T or the like, and are implemented by other users Ub and Uc stored in the support DB 20. May be an improvement tendency of the subjective state and an improvement state of the objective state estimated based on a time-series change of the skin state of the other user Ub and Uc, and the implemented measure and the skin state of the user Ua When the time-series changes are stored in the support DB 20, the improvement tendency of the subjective state and the improvement tendency of the objective state estimated based on the information may be used.

  For example, the support DB 20 includes a measure implemented by each of the other users Ub and Uc, a time-series change in subjective data of the skin condition of each of the other users Ub and Uc before and after the implementation of the measure, and other users. One or both of the time-series changes of the objective data of the skin states of Ub and Uc are stored.

  In addition, for example, in the support DB 20, the measure “used by the bathtub” performed by each of the other users Ub and Uc and the subjective state of the skin condition of each of the other users Ub and Uc before and after the implementation of the measure. It is assumed that “satisfaction with dryness” as a time series change is stored.

  At this time, the measure group selection unit 12 tells each of the other users Ub and Uc about the measure “use a bathtub”, for example, the subjective data of the skin condition of the day before the bath and the day when the bath was used (about dry feeling) (Satisfaction level) is calculated. And the measure group selection part 12 takes the average value of the variation | change_quantity of satisfaction about the dry feeling of each other user Ub and Uc. For example, when the average value of the amount of change in “satisfaction with dryness” is equal to or greater than a predetermined value, the measure group selection unit 12 sets the improvement tendency of the subjective state of the measure “use a bathtub” as “improvement in dryness”. Recognize. The improvement tendency of the objective state can be recognized in the same manner as the improvement tendency of the subjective state.

  The measure group selection unit 12 may narrow down the ranges of other users Ub and Uc to be processed, such as the same age and similar skin conditions, based on the age and skin condition of the user Ua.

  Further, the measure group selection unit 12 is estimated based on the information calculated in the same manner as described above when the measures implemented in the support DB and the time-series changes in the skin condition of the user Ua are stored. You may recognize the improvement tendency of a subjective state, and the improvement tendency of an objective state.

  In the first schedule determination step of the user Ua, the measure group selection unit 12 recognizes the improvement tendency of the subjective state and the improvement tendency of the objective state from the subjective data and objective data of the skin state of the other users Ub and Uc. And in the user's Ua 2nd schedule determination process, you may recognize the improvement tendency of a subjective state, and the improvement tendency of an objective state from the subjective data and objective data of the user's Ua skin state.

  The measure group selection unit 12 recognizes not only the skin state but also the mental state and the body state in the same manner, the improvement tendency of the subjective state and the improvement state of the objective state, A measure may be selected in consideration of an improvement tendency of the objective state.

  The measure group selection unit 12 may exclude the measure having the same content, the same frequency, or the same level as the “currently implemented measure” from the measure group. This is because it is considered that the measures that the user has already taken need not be proposed.

  In the example of FIG. 11A, the measure group selection unit 12 selects a measure group that is a combination of a plurality of measures so as to include “use a bathtub”, “vitamin C intake”, “vegetable intake”, and “walk more than 10,000 steps”. .

  The measure information transmission unit 13 evaluates the priority of the measure according to the “category category, hope, frequency” of the user Ua from the measure group, and determines the initial measure according to the priority. FIG. 12 illustrates an example of a schedule in which “use a bathtub”, “vegetable intake”, and “walk more than 10,000 steps” are selected as initial measures. The measure information transmission unit 13 transmits schedule data indicating the contents of the schedule determined in this way to the user terminal 30.

  The measure information transmission unit 13 also creates a plan for performing each process for a certain period based on the designation of the user Ua. In FIG. 11B, goal setting and schedule determination at START are performed, daily monitoring is performed, schedule is corrected every week, a progress graph is created after one month, goal determination and new goal are established at the third month The plan for a series of events to set up is shown. The measure information transmission unit 13 may use a predetermined execution plan for each process for a certain period in addition to or instead of designation by the user Ua.

  When the schedule data is received from the skin condition recognition system 10 in STEP 52 of FIG. 6 at the user terminal 30, the skin support application 35a displays the schedule execution table as shown in FIG. 12 and the work content as shown in FIG. 11B. The user Ua is encouraged to implement each measure. In the execution table of FIG. 12, the contents of each measure (“use a bathtub”, “vegetable intake”, “walk more than 10,000 steps”) are displayed.

[F. Monitoring process]
The process of “3. monitoring” shown in FIG. 3 is executed by the skin condition recognition unit 11 and the measure information transmission unit 13 for each period set by the user Ua on the skin support application 35a (daily in FIG. 11B). . The user Ua who has started to use the skin support application 35a uses the user terminal 30 to make daily skin, body, and mind states, the implementation status of the measures instructed by the schedule, and users other than the measures instructed by the schedule. Enter the implementation status of Ua's voluntary action (action outside action). The implementation status of the measures includes “30 minutes”, “use a bathtub”, “300 g”, as well as information indicating whether or not “use a bathtub”, “vegetable intake”, and “walk more than 10,000 steps” have been implemented. This includes the degree of execution of measures such as “taken vegetables”, “15,000 steps”, and “walks” expressed in terms of time and amount.

  The skin support application 35a proceeds to STEP 60 when the skin, body, and mind states are input by the user Ua in STEP 53 of FIG. 6, and the skin, body, Current user information data including subjective data and objective data regarding the state of the mind is transmitted to the skin condition recognition system 10, and the process proceeds to STEP54. In step 53 of FIG. 6, the skin support application 35a proceeds to step 54 as it is when the user Ua does not input the skin, body, and mind states. The data transmitted here does not include data relating to the stratum corneum cells collected by the keratin collection tape 37.

  The skin support application 35a advances the process to STEP 61 when the execution status of the schedule (execution status of each measure) is input by the user Ua in STEP 54 of FIG. 6, and executes execution status data indicating the execution status of the schedule. The data is transmitted to the skin condition recognition system 10 and the process proceeds to STEP 55 in FIG. The skin support application 35a proceeds to STEP 55 as it is when the execution status of the schedule (execution status of each measure) is not input by the user Ua in STEP 54 of FIG.

  Furthermore, the skin support application 35a advances the process to STEP 62 when the implementation status of the off-policy action is input by the user Ua in STEP 55 of FIG. 7, and the non-measure action execution data indicating the content of the off-measure action performed. Is transmitted to the skin condition recognition system 10, and the process proceeds to STEP56. The skin support application 35a proceeds to STEP 56 as it is when the implementation state of the action outside the measure is not input by the user Ua in STEP 55 of FIG.

  STEP 13 in FIG. 4 to STEP 16 in FIG. 5 and STEP 20 to STEP 22 in FIG. 4 are processes by the measure information transmitting unit 13. The skin condition recognition unit 11 advances the process to STEP 20 when receiving the current user information data from the user terminal 30 in STEP 13, accumulates the current user information data in the support DB 20, and advances the process to STEP 14. The skin condition recognition unit 11 proceeds to STEP 14 as it is when it does not receive the current user information data from the user terminal 30 at STEP 13.

  Further, the measure information transmission unit 13 proceeds to STEP 21 when receiving the execution status data from the user terminal 30 in STEP 14, accumulates the execution status data in the support DB 20, and proceeds to STEP 15. On the other hand, if it is determined in STEP 14 that execution status data has not been received from the user terminal 30, the process proceeds to STEP 15 as it is.

  Further, the measure information transmission unit 13 proceeds to STEP 22 when receiving the non-measure action execution data from the user terminal 30 in STEP 15, accumulates the non-measure action execution data in the support DB 20, and performs the process in STEP 16 of FIG. 5. Proceed. On the other hand, when the measure information transmitting unit 13 does not receive the non-measure action execution data from the user terminal 30 in STEP 15, the measure information transmitting unit 13 proceeds to STEP 16 in FIG.

  Moving to FIG. 5, in STEP 16, the measure information transmission unit 13 is based on the initial user information data, current user information data, execution status data, non-measure action execution data, and the like of the user Ua stored in the support DB 20. Progress table data indicating the progress status of the schedule is created, and this progress table data is transmitted to the user terminal 30.

  Here, for example, as shown in FIG. 12, the progress chart of the schedule includes, from the top, the level of the skin condition (here, dry skin), the level of the body condition, the level of the mental condition, and the measure (the vegetable used in the bathtub) The implementation status of ingestion (walking more than 10,000 steps), living information (vegetable intake, water intake), and living special cases are displayed on a daily basis.

  In addition, the schedule progress table includes the degree of execution of measures (“30 minutes” used on a bathtub, “30 g” vegetable intake, “15,000 steps” walk).

  In the user terminal 30, the skin support application 35 a proceeds to STEP 63 when receiving the progress table data transmitted from the skin condition recognition system 10 in STEP 56 of FIG. 7, and stores the progress table data in the memory 36. The skin support application 35 a displays the progress table shown in FIG. 12 on the display 31 of the user terminal 30 using the progress table data stored in the memory 36.

  In addition to the progress table data, the skin support application 35a recognizes the initial user information data, current user information data, and execution status data of the user Ua, which is recognized through communication, and is stored in the support DB 20 of the skin condition recognition system 10. The information indicating the transition or change of each state of the skin, body, and mind of the user Ua is displayed on the display 31 of the user terminal 30 using the non-measure action execution data and the like.

  For example, as shown in FIG. 13, the skin support application 35 a is configured such that the user Ua's actions other than the measures based on the schedule (change of face washing method, massaged, etc.) and the user's physical condition (physiology, lack of sleep, etc.) The relationship between changes in the skin condition of the user Ua is displayed on the display 31 in a time series graph in units of days.

  Further, as shown in FIG. 14, the skin support application 35a changes the evaluation value of the skin condition including the horny condition of the user Ua, the psychological condition, the satisfaction degree of the skin care, and the usage value of the cosmetic product in units of one month. The contrasted radar chart is displayed on the display 31.

  The user Ua visually recognizes these displays by the skin support application 35a and confirms changes in the state of his / her skin, body and mind, thereby grasping changes in the state of the body and mind as well as the degree of improvement of the skin. Therefore, the goal of the target skin condition can be reached while improving the condition of the skin, body and mind in a well-balanced manner.

  The skin support application 35a proceeds to STEP 64 after STEP 63, and executes the simulator display process shown in FIG. Details of the simulator display process will be described later.

[G. Schedule correction]
The process of “4. Schedule correction” shown in FIG. 3 is executed by the measure information transmission unit 13 for each period set by the user Ua on the skin support application 35a (every week in FIG. 11B). STEP 17 to STEP 20 and STEP 30 to STEP 33 in FIG. 5 are processes by the measure information transmitting unit 13.

  The measure information transmission unit 13 is incorporated in the target achievement level and schedule of the user Ua skin state based on the initial user information data, current user information data, execution status data, and the like of the user Ua stored in the support DB 20 in STEP 17. The degree of execution of each measure and the effect of each measure are evaluated.

  The measure information transmission unit 13 extracts the correlation between the skin state and the body or mind state using the measure judgment criteria shown in FIG. 15A, and each measure incorporated in the schedule based on this correlation Continuation, exclusion from the measure group, discontinuation of the measure, change to another measure.

  In the evaluation criteria of FIG. 15A, four items of presence / absence of execution, influence on the skin, influence on the body, influence on the mind are used as the determination items, and the implementation rate exceeds the predetermined implementation rate, which has a positive effect on the skin. A measure that does not have a bad influence on the body and mind is judged as A and is determined to continue. In FIG. 15A, a measure whose implementation rate exceeds a predetermined implementation rate is denoted as “implementation”, and a measure whose implementation rate is equal to or less than the predetermined implementation rate is denoted as “non-execution”. The same applies to FIGS. 12 and 15B.

  When the timing of the impact of a measure and the period during which the impact continues are determined for each measure, the measure information transmission unit 13 determines the impact of each measure based on the timing of the impact of the measure and the duration of the impact of the measure. You may judge.

  For example, the effect on the skin, the influence on the body, the influence on the mind of the measure “use a bath” will affect the next day, and if it is determined to continue for one day, the measure information transmission unit 13 For example, it is determined that the influence of the measure “use a bathtub” on December 15 is reflected in each state on December 16.

  In addition, when it is determined that the effect of “vegetable intake” on the skin, the effect on the body, and the effect on the mind will be affected after one week and will continue for three days, the measure information transmission unit 13 For example, it is determined that the influence of the measure “vegetable intake” on December 15 is reflected in each state from December 22 to December 24.

  On the other hand, measures that are implemented and have a positive effect on the skin, but have a negative effect on either the body or the mind, are evaluated as B and are determined to be canceled or changed to another measure. In addition, since it is considered that a measure for which the implementation rate is equal to or less than the predetermined implementation rate has a large load on the user Ua, the evaluation becomes C evaluation and is canceled or another measure (for example, a measure that reduces the load on the user Ua or another measure) It is judged to be a change to measures.

  The measure information transmission unit 13 may evaluate whether there is a good or bad influence on the skin, body, and mind by implementing each measure for only one day, and in a certain period such as several days or weeks By implementing each measure, it may be evaluated whether there is a good or bad influence on the skin, body and mind. When evaluating in a certain period, for example, the measure information transmitting unit 13 sets B evaluation when any state is adversely affected at a certain rate, C evaluation when the implementation rate is below a certain rate, and otherwise In the case of A, it is good also as A evaluation. Instead of this, for example, the measure information transmission unit 13 may perform the B evaluation when the average value of the satisfaction degree in any state in a certain period is equal to or less than a predetermined value. In addition, if the satisfaction level of any state in one day is less than or equal to a predetermined value and the average value of the satisfaction level of any state in a certain period is less than or equal to a predetermined value, the C evaluation is used. If the satisfaction level of any state is below a predetermined value, or the average value of the satisfaction level of any state in a certain period is below a predetermined level, the B evaluation is used, and the average satisfaction level of any state in one day Use a combination of one-day evaluation and evaluation over a certain period, such as A evaluation when the value exceeds a predetermined value and the average value of satisfaction in any state over a certain period exceeds a predetermined value. May be.

  Further, when the improvement degree of the skin condition score shown in FIG. 8 is equal to or less than a predetermined improvement degree, the measure information transmission unit 13 performs a measure in which the improvement degree of the skin condition score is equal to or less than the predetermined improvement degree. It may be excluded from the measure group. The measure information transmission unit 13 measures a measure in which the improvement level of the body state or the mental state score is equal to or lower than the predetermined improvement level when the improvement level of the body state or the mental state score is equal to or lower than the predetermined improvement level. May be excluded.

  FIG. 15B shows an example in which the evaluation standard shown in FIG. 15A is applied to a measure in the present embodiment (taken by a bathtub, ingesting vegetables, walking more than 10,000 steps). According to FIG. 15B, the measure information transmission unit 13 decides to continue on the next schedule as “A” for “use on a bathtub”, and exclude from the measure group as “B” for “vegetable intake”. Decided to cancel the schedule or change to other measures, and for “walk more than 10,000 steps” as C evaluation, exclude from the measure group, cancel the next schedule or change to other measures Has been decided.

The measure information transmission unit 13 determines, for each combination of these measures, the influence of the plurality of measures being performed. For example, if the combination of “use a bath” and “vegetable intake” is B evaluation or C evaluation, the measure information transmission unit 13 should only use “use a bath” or “vegetable intake” alone. Or you may change so that it may be set as the combination of one of these measures and another measure.

  The measure information transmitting unit 13 performs such an evaluation process to determine whether or not schedule correction (mainly correction by changing to another measure of the measure group) is necessary. To correct the schedule. Then, the schedule correction data, which is the corrected schedule data, is transmitted to the user terminal 30, and the process proceeds to STEP 19. On the other hand, when it is determined that the schedule need not be corrected, the measure information transmission unit 13 proceeds from STEP 18 to STEP 19 in FIG. 5, and in this case, the schedule is not corrected.

  Next, in STEP 19, the measure information transmission unit 13 is incorporated in each action outside the measure (which is incorporated in the schedule) performed by the user Ua based on the initial user information data, the current user information data, the action-less action execution data, and the like. Evaluate actions taken by users in addition to measures.

  The measure information transmission unit 13 determines whether or not the non-measure action is recommended or forbidden using the evaluation standard for the non-measure action shown in FIG. 16A. In the evaluation criteria of FIG. 16A, the influence on each state of skin, body, and mind is used as a determination item.

  Then, when “there is a good effect on any of skin, body, and mind, and there is no adverse effect on any of them”, implementation is recommended as D evaluation. On the other hand, in the case of “there is a bad influence on any of skin, body and mind”, an E evaluation is given and a prohibition is proposed. In addition, in the case of “no effect on skin, body, or mind”, the evaluation is F and implementation is not recommended.

  FIG. 16B shows an example in which the evaluation standard shown in FIG. 16A is applied to the action outside the measure in the present embodiment (massage is received and a large amount of chocolate is ingested). As shown in FIG. 16B, the measure information transmission unit 13 determines the recommendation for the implementation on the next schedule as the D evaluation for “receiving massage”. In addition, regarding “a large amount of chocolate intake”, as an E evaluation, a proposal for a measure for stopping at the next schedule (for example, an alternative to ingest Japanese sweets) has been decided.

  When the measure information transmission unit 13 decides to cancel or change the measure incorporated in the schedule, or to decide to recommend or prohibit the implementation of the action outside the measure, the measure information transmitting unit 13 proceeds from STEP 20 to STEP 31. Then, when the recommendation is determined, the process proceeds from STEP 31 to STEP 33, the non-measure action recommendation data for recommending the execution of the non-measure action is transmitted to the user terminal 30, and the process proceeds to STEP 13 in FIG.

  On the other hand, when the measure information transmitting unit 13 determines the proposal of prohibition, the processing proceeds from STEP 31 to STEP 32, and transmits the non-measure action prohibition data for proposing prohibition of the non-measure action to the user terminal 30, and FIG. The process proceeds to STEP13.

  Further, when there is no action outside the measure for proposing recommendation or prohibition, the measure information transmission unit 13 proceeds from STEP 20 to STEP 13 in FIG. 4. In addition, when there is a substitute action in the action outside the measure for proposing prohibition, the action prohibition data outside the measure for proposing a change to the substitute action may be transmitted to the user terminal 30 instead of the proposal for the prohibition.

  In the user terminal 30, when receiving the schedule correction data from the skin condition recognition system 10 in STEP57 of FIG. 7, the skin support application 35a proceeds to STEP65 and corrects the schedule based on the schedule correction data. Then, the skin support application 35 a updates the schedule data held in the memory 36 and advances the process to STEP 58.

  Also, in step 58 of FIG. 7, the skin support application 35 a proceeds to step 66 when receiving the non-measure action recommendation data or the non-measure action prohibition data from the skin condition recognition system 10, and proceeds with the process according to the received data. A screen for informing the user of the recommended or prohibited action is displayed on the display 31 of the user terminal 30. This notification may be performed, for example, by displaying a notification message on the progress table shown in FIG. Moreover, you may correct a schedule as a new measure for the recommended action outside the measure.

[H. Goal judging process]
The process of “5. goal determination” shown in FIG. 3 is performed for each period set by the user Ua on the skin support application 35a (three months after START in FIG. 11B), the skin condition recognition unit 11, and the measure group This is executed by the selection unit 12 and the measure information transmission unit 13.

  The skin support application 35 a displays on the display 31 of the user terminal 30 a message prompting the use of the keratin collection tape 37 and mailing of the keratin collection tape 37.

  The skin condition recognizing unit 11 recognizes an objective value (water retention ability, sebum suitability, etc.) of the skin condition based on information obtained from the keratin sampling tape 37 sent by mail.

  In addition, the skin support application 35a displays a message that prompts the use of imaging such as an answer to a questionnaire and skin on the display 31 of the user terminal 30, and transmits the obtained information.

  The skin condition recognition unit 11 recognizes the subjective value (subjective level) of the dryness of the skin and the objective value (skin image score) of the skin condition based on the information obtained from the skin support application 35a.

  The measure group selection unit 12 and the measure information transmission unit 13 compare the evaluation values at the start of support of the skin condition and after three months based on the subjective value of the dryness of the skin and the objective value of the skin condition. Determine the degree of goal achievement.

  In the example of FIG. 17, since the subjective value level of dryness has increased from 3 to 5 in 3 months, it is determined to be achieved (◯), and the objective image value is 3 to 4 in 3 months for the skin image score. Since the water retention capacity is maintained at 2 and the sebum suitability is increased from 1 to 2, it is determined to be achieved (◯). Since both the subjective value and the objective value have achieved the goal, it is determined that the goal has been achieved as a total.

  The skin condition recognition unit 11 and the measure group selection unit 12 re-execute the “1. goal setting” step shown in FIG. 3 in order to set a new goal when the goal is achieved. The skin condition recognizing unit 11 and the measure group selecting unit 12 may perform the “2. schedule determination” step when the goal is not reached, or “1. goal setting” according to the user's desire or progress. The process may be performed again.

[I. Secondary data generation]
The process of “6.2 secondary data generation” shown in FIG. 3 is executed by the secondary data generation unit 19. The secondary data generation unit 19 includes various types of data (hereinafter referred to as individual users) such as initial user information data, stratum corneum cell analysis data, current user information data, execution status data, non-measure action execution data transmitted from a plurality of users U. Data) is sequentially stored in the support DB 20 for each user.

Then, the secondary data generation unit 19 analyzes the individual user data stored in the support DB 20 and, for example, as shown in FIG. 18, the characteristics (gender, age, residence, preference,
Life style, etc.), support improvement targets (dryness, wrinkle, sensitivity, acne, deflation, etc.), measures proposed according to the schedule (using a bathtub, eating vegetables, walking more than 10,000 steps, etc.), and implementing measures Secondary data that correlates changes in skin, body, and heart states due to is generated.

  The secondary data generation unit 19 also provides secondary data that associates the characteristics of each user with the influence of each state of the skin, body, and mind due to the implementation of the off-policy action, as in FIG. Generate.

  The secondary data generated in this way is effectively utilized when selecting effective measures for improving the skin condition while having a good influence on the body and mind for users having similar characteristics. be able to. For example, in the process of “2. Schedule determination” in FIG. 3 described above, the measure group selection unit 12 can select a measure that matches the characteristics of the user Ua with reference to the secondary data.

  In the process of “4. Schedule modification” in FIG. 3 described above, the measure information transmission unit 13 changes the secondary data when changing the schedule according to the transition of each state of the skin, body, and mind of the user Ua. The schedule can be changed to a plan that incorporates more effective measures or non-measure actions.

  In addition, secondary data can be used effectively to support skin conditions and for marketing purposes targeting users with certain characteristics (for example, women in their 30s living in Tokyo, etc.). Can also be used. Therefore, the secondary data may be provided to the other system 60 shown in FIG.

[J. Measure effect display processing]
With reference to FIGS. 19 to 26, details of the effect display processing of the measure in STEP 64 of FIG. 7 will be described. In the present embodiment, a graph indicating the influence of each measure on the skin condition of the user Ua or the degree and influence of the execution of each measure is displayed, but instead of or in addition to this, the heart state or body state of the user Ua The graph which shows the influence of each measure with respect to or the execution degree and influence of each measure may be displayed. Instead of or in addition to this, a graph showing the influence on the skin condition, the mental state or the physical condition of the user Ua by the action including the measure and the action outside the measure, or the degree and the influence of each action and the action outside the measure May be displayed. Instead of or in addition to this, one graph that evaluates at least two states of the skin state, the heart state, and the body state of the user Ua may be displayed.

  In this embodiment, the score of the skin condition of the user Ua is the latest subjective data at the time of score calculation for the skin condition (for example, the subjective data of the day at the time of score calculation or the subjective data of the last week from the score calculation time). It is a score calculated based on this. Instead, the score calculated based on the latest objective data at the time of score calculation for the skin condition may be used as the score of the skin condition of the user Ua, or the latest objective data and score at the time of score calculation The score of the skin state evaluated from the latest subjective data at the time of calculation may be used.

  In STEP 71 of FIG. 19, the skin support application 35 a displays a screen P <b> 1 showing the influence of each measure and the burden of each measure on the skin state of the user Ua shown in FIG. 20A by executing each measure graph output process. To the device 31. Details of each measure graph output process will be described later.

  In the coordinate system included in the screen P1 showing the influence of the measures and the burden of each measure, the horizontal axis is the burden of each measure, and the vertical axis is the influence of each measure. The coordinate system included in the screen P1 corresponds to the “two-dimensional coordinate system represented by the two axes of the influence of action and the burden of action” of the present invention.

  The burden of each measure is represented by showing the price for the burden of executing each measure. For example, the burden of each measure is represented by the number of times each measure is implemented in a predetermined period. In addition to or instead of this, the amount, time, and psychological burden on each measure, the frequency of implementation of each measure, the technical difficulty of each measure, or a plurality of these measures are comprehensively evaluated. The value obtained may be used as a burden for each measure.

  Here, the “predetermined period” is preferably a period in which the relationship between the skin condition and the degree of execution of the measure is indicated. For example, for one week before the execution of the measure effect display process, 10 days, 1 month or 3 months. In this embodiment, it is assumed that the execution time of the effect display processing of the measure is April 10, 2017, and the execution time of the effect display processing of the measure from April 1, 2017 nine days before the execution time of the effect display processing of the measure. The ten days until will be described as a “predetermined period”.

  The impact of each measure is a numerical value indicating the magnitude of the effect on the user's skin condition score due to the execution of each measure. For example, the score of the skin state with respect to the number of times each measure has been implemented in a predetermined period has improved. It is the ratio of the number of times. In addition to or instead of these, the degree of improvement in the score of the skin condition when each measure is implemented may be the influence of each measure. Further, in addition to or instead of these, the number of times the skin condition score has been improved may be the influence of each measure. Moreover, it is good also considering the value which evaluated these values comprehensively as the influence of each measure.

  In addition, in this embodiment, the score of the skin condition when each measure is implemented is higher than the average score of the skin condition when each measure is not implemented. It is used to mean. Instead of or in addition to this, when the score of the subsequent skin condition is higher than the score of the skin condition at the time when each measure is implemented, the score of the skin condition may be evaluated as “improved”.

  The screen P1 showing the effect of the measure and the burden of each measure includes a circle P11 indicating each measure at a position corresponding to the effect and the load of each measure on the screen P1. The screen P1 showing the effect of the measure and the burden of each measure includes a measure name display P12 for some measures such as “vegetable intake”, “sleep improvement”, and “fruit intake”. The circle P11 indicating each measure and the display name P12 of the measure correspond to the “information indicating each action” of the present invention. Further, the measure name display P12 may be displayed in advance, or the measure name display P12 may be displayed when a predetermined operation of the user is detected via the touch panel 32.

  In STEP 72 of FIG. 19, the skin support application 35 a determines whether or not an operation of selecting the circle P <b> 11 indicating each measure or the display P <b> 12 of the measure name is detected via the touch panel 32.

  If the determination result is negative (NO in STEP 72 of FIG. 19), the skin support application 35a executes STEP 72 of FIG. 19 again.

  If the determination result is affirmative (YES in STEP 72 of FIG. 19), the skin support application 35a proceeds to STEP 73 of FIG. 19 and executes an execution degree graph output process. Although details of the execution degree graph output process will be described later, in the execution degree graph output process, the skin support application 35a outputs the graph P2 shown in FIG. The graph P2 corresponds to “information indicating the degree of action execution and the influence of the action” of the present invention.

The graph P2 is a graph with respect to one measure, with the degree of execution of the one measure as the horizontal axis and the influence of the one measure as the vertical axis. The “degree of execution of the measure” is a numerical value indicating the degree of execution of the measure determined for each measure. Examples of “degree of policy execution” include the time to execute the policy, the amount of consumption of the policy, the distance to execute the policy, the number of executions of the policy per day, the execution time per execution of the policy, The amount per execution of the measure and the frequency of execution of the measure in a predetermined period are included. The coordinate system of the graph P2 corresponds to the “two-dimensional coordinate system represented by two axes of the action execution degree and the action influence” of the present invention.

  In addition, the graph P2 includes a threshold value display P21 that indicates the degree of execution of an efficient measure for increasing the influence when the measure is executed.

  In STEP74 of FIG. 19, the skin support application 35a performs a comparison graph output process with the influence of other users. Although the details of the comparison graph output process with the influence of other users will be described later, in the comparison graph output process with the influence of other users, the skin support application 35a outputs the graph P3 shown in FIG. To do.

  Similarly to the graph P2, the graph P3 is a graph with the degree of execution of the one measure as the horizontal axis and the influence of the one measure as the vertical axis for one measure. The skin support application 35a may output the display P31 and the graph P3 so as to overlap the graph P2, the graph P2 and the graph P3 may be output as a separate graph, or the graph P2 may be output. During the display, the graph 3 may be output to the display 31 when a predetermined operation is detected by the touch panel 32.

  The graph P3 includes a graph (indicated by a solid line) that shows the effect of the measure for each degree of execution of the measure of the user Ua, a graph (indicated by a broken line) that shows the effect of the measure for each execution degree of the measure of another user, It is included. For example, the impact of the measure for each user's measure execution degree may be an effect obtained based on a value obtained from academic research or the like, or may be obtained from other users' implementation status data. May be an influence. Moreover, the influence of the measure for every execution degree of the measure by the other user who has the attribute similar to a user's attribute may be sufficient. The attributes of the user Ua include, for example, the age, sex, region where the user Ua lives, preferences, skin characteristics, mind characteristics, body characteristics (gene information, etc.).

  In addition, the solid line graph which shows the influence of the measure for every execution degree of the measure of the user Ua corresponds to “information indicating the influence of the action on the user” of the present invention. A broken line graph indicating the influence of a measure for each execution degree of the measure of another user corresponds to “information indicating the influence of an action on another user” of the present invention.

  In STEP 75 of FIG. 19, the skin support application 35a executes a combination measure recommendation screen display process. Although details of the combination measure recommendation screen display process will be described later, in the combination measure recommendation screen display process, the skin support application 35a outputs a combination measure recommendation screen P4 shown in FIG.

  The combination measure recommendation screen P4 includes an effect display P41, an image P42 of each recommended measure, a display name P43 of each measure, and an effect display P44 of each measure.

  The skin support application 35a may arrange the graph P2 or the graph P3 and the combination measure recommendation screen P4 side by side and simultaneously output them to the display 31. When the graph P2 or the graph P3 is displayed, the skin support application 35a The combination measure recommendation screen P <b> 4 may be output to the display device 31 when the operation is detected.

[K. Measure graph output processing]
Details of the measure graph output process of STEP 71 in FIG. 19 will be described with reference to FIGS.

  In STEP 81 of FIG. 21, the skin support application 35 a determines which measure based on the initial user information data, current user information data, and execution status data accumulated in the support DB 20 of the skin condition recognition system 10 recognized through communication. The average value of the score of the skin condition when not implemented is recognized as a reference score and stored in the memory 36. The skin support application 35a uses the median, mode, minimum value, maximum value, latest value, or the like of the score of the user Ua's skin condition as a reference score instead of the average value of the user Ua's skin condition score. You may recognize as. The skin support application 35a can also use the median value, mode value, minimum value, maximum value, latest value, etc. of the score instead of the average value of the score as appropriate in other processes.

  In FIG. 22A, taking the measure “vegetable intake” as an example, the date of execution of the measure, the name of the measure, the degree of execution of the measure, and the skin recognized from the initial user information data, the current user information data, and the execution status data Data including state scores are shown.

  For example, the skin support application 35a does not execute a measure based on this data (in this case, the amount of vegetable intake that is the execution degree of the measure is zero g), April 2, 2017, April 2017. The average value “2” of the score of the skin condition on 5th, April 7, 2017 is recognized as the reference score and stored in the memory 36. Note that the vegetable intake amount or the like may be actually acquired data (for example, vegetable intake data) itself, or may be an evaluation value of the actually acquired data. For example, the evaluation value may be a value that continuously or intermittently increases as the value indicated in the data approaches a predetermined standard (eg, vegetable intake 350 g, etc.), or is indicated in the data. The value may be a value that increases continuously or intermittently as the value is large, or may be a value that increases continuously or intermittently as the value indicated in the data is small.

  The state in which the measure is not executed may be a state in which the measure is not executed, but is a state in which the measure is executed less than a first predetermined value (for example, 150 g). Also good.

  After STEP 81 in FIG. 21, the skin support application 35a proceeds to STEP 82 in FIG. STEP 82 in FIG. 21 and STEP 83 in FIG. 21 are executed for each measure. In the following, processing when the measure “vegetable intake” is targeted will be described.

  In STEP 82 of FIG. 21, the skin support application 35 a recognizes the number of times the measure has been executed and stores it in the memory 36. For example, in the case shown in FIG. 22A, the number of times the measure has been executed (the number of times the intake is not 0 g) is seven. “The number of executions“ 7 times ”is stored in the memory 36. Note that the skin support application 35a may recognize that the measure has been implemented when the degree of execution of the measure is equal to or greater than the second predetermined value. The second predetermined value may be, for example, the same value (for example, 150 g) as the first predetermined value, or may be a value (for example, 200 g) larger than the first predetermined value.

  In STEP 83 of FIG. 21, the skin support application 35 a recognizes the number of times that the skin state score when each measure is performed exceeds the reference score as the number of improvements, and stores it in the memory 36.

For example, in the example of FIG. 22A, out of the measures, April 1, 2017, April 3, 2017, April 4, 2017, April 6, 2017, April 8, 2017, 2017. Six times on April 9, 2012 exceeded the standard score of “2”. For this reason, the skin support application 35a recognizes the improvement count of the measure “vegetable intake” as 6 times and stores it in the memory 36 as shown in FIG. 22B. Note that the skin support application 35a may recognize the number of times equal to or higher than the reference score as the number of improvements.

  The skin support application 35a executes the processing of STEP82 and STEP83 of FIG. 21 for each measure, and stores data as shown in FIG. 22B in the memory 36. The number of times of improvement corresponds to “the influence of the improvement of the skin state of each action on the user's skin” of the present invention. The number of times of execution corresponds to “the burden of each action” of the present invention.

  In STEP 84 of FIG. 21, the skin support application 35 a extracts measures that satisfy a predetermined condition based on the data stored in the memory 36, and stores the measures in the memory 36. Here, the predetermined condition is, for example, a first condition that the number of implementations of the measure by the user Ua is a predetermined number or more, and a second condition that a ratio of the number of improvements to the number of implementations of the measure by the user Ua is a predetermined value or more. The third condition that the ratio of the number of improvements to the number of implementations of the measure by the user Ua is less than a predetermined value, and the ratio of the number of improvements to the number of implementations of the measure by the user Ua is within a predetermined range (for example, 40% to 60%). It may be a fourth condition that there is a fifth condition, a fifth condition that the user Ua has implemented a measure during a recent period, or a combination of these conditions.

  Here, it is assumed that the skin support application 35 a extracts “vegetable intake”, “sleep improvement”, and “fruit intake” according to the first condition to the third condition, and stores them in the memory 36.

  In STEP85 of FIG. 21, the skin support application 35a displays the screen P1 and each measure shown in FIG. 20A based on the name of the measure, the number of implementations, and the number of improvements stored in the memory 36 as shown in FIG. 22B. Are created and output to the display 31. The skin support application 35a outputs a measure name display P12 to the display 31 simultaneously with the screen P1 for the measure extracted in STEP 84 of FIG.

[L. Execution degree graph output processing]
Next, with reference to FIG. 22C and FIG. 23, the detail of the execution degree graph output process of STEP73 of FIG. 19 is demonstrated.

  In STEP91 of FIG. 23, the skin support application 35a recognizes the average value of the score of the skin condition of the user Ua when the measure selected in STEP72 of FIG. .

  For example, the skin support application 35a determines, based on the execution status data shown in FIG. 22A, the average value “2” of the score of the user Ua's skin condition when the vegetable intake is 0 g, and the skin condition of the user Ua when 100 g. The average value “3” of the score of the user, the average value “4” of the score of the skin condition of the user Ua in the case of 200 g, the average value “4.5” of the score of the skin condition of the user Ua in the case of 300 g, Data as shown in FIG. 22C is stored in the memory 36. The amount of vegetable intake corresponds to the “degree of execution of the action” in the present invention. Moreover, the average value of the score of the skin condition of the user Ua at each intake amount corresponds to “the influence of the action on the user's skin” of the present invention.

  In STEP 92 of FIG. 23, the skin support application 35 a recognizes the degree of execution in which the score of the skin condition of the user Ua satisfies a predetermined condition as a threshold, and stores it in the memory 36.

  Here, the predetermined condition may be a condition that the average value of the score of the skin condition of the user Ua is a minimum execution degree that maximizes, or a change in the average value of the score of the skin condition of the user U It may be a condition that the amount is a minimum execution degree that is not more than a predetermined change amount, or a condition that the average value of the score of the skin condition of the user Ua is a minimum execution degree that is not less than a third predetermined value. It may be.

  In addition, the third predetermined value may be a value of a certain ratio (for example, 80% of the maximum value) of the maximum value of the average value of the skin condition score of the user Ua, or may have the same attribute as the user Ua. May be an average value of the user's skin condition score, or a value calculated based on the initial value of the user's Ua skin condition score (for example, 1. 2 times).

  In STEP93 of FIG. 23, the skin support application 35a outputs the graph P2 shown in FIG. 20B based on the degree of execution of each measure, the average of the skin condition score of the user, and the threshold value stored in the memory 36. . The threshold value display P21 displays the threshold value display P21 based on the threshold value recognized in STEP 92 of FIG.

[M. Comparison graph output processing with the influence of other users]
Next, with reference to FIG. 24, the details of the comparison graph output processing with the influence of other users of STEP 74 of FIG. 19 will be described.

  In STEP 101 of FIG. 24, the skin support application 35a recognizes the average value of the score of the skin condition of the user Ua when the measure selected in STEP 72 of FIG. . This process is the same as the process of STEP 91 in FIG. The skin support application 35a may recognize the ratio of the number of times the user Ua's skin condition score has been improved, not the average value of the user Ua's skin condition score, or the user Ua's skin condition score. The degree of improvement (increment from the reference score) may be recognized. The same applies to STEP 102 and STEP 103 in FIG. The average value of the skin condition score of the user Ua when the measure selected in STEP 72 of FIG. 19 is executed with each execution degree corresponds to “the influence of the action on the user” of the present invention.

  In STEP102 of FIG. 24, the skin support application 35a recognizes the average value of the scores of the skin conditions of other users Ub and Uc when the measure selected in STEP72 of FIG. 36. The skin support application 35a may calculate the average value of the skin condition score for each of the other users Ub and Uc, or may calculate the average value of the skin condition score for all the other users Ub and Uc. . This process is different from the process of STEP 91 of FIG. 23 in that it targets not the user Ua but other users Ub and Uc, but the other points are the same. The average value of the skin condition scores of the other users Ub and Uc when the measure selected in STEP 72 of FIG. 19 is executed at the respective execution degrees corresponds to the “effect of action on other users” of the present invention. .

  In STEP 103 of FIG. 24, the skin support application 35 a sets the average value of the skin condition score of the user Ua and the selected measure when the selected measure stored in the memory 36 is executed with each execution degree. A graph P3 shown in FIG. 20C is created based on the average value of the scores of the skin conditions of the other users Ub and Uc when executed at the execution degree, and is output to the display 31.

[N. Combination measure recommendation screen display processing]
Next, details of the combination measure recommendation screen display process of STEP 75 of FIG. 19 will be described with reference to FIGS.

In STEP 111 of FIG. 25, the skin support application 35a performs an average value (single measure score) of the skin condition score of the user Ua when the target measure is executed alone with the degree of execution of the threshold recognized in STEP 92 of FIG. Is stored in the memory 36. For example, the skin support application 35a, from FIG. 22A, the threshold “200g” of the target measure “vegetable intake”
The average value “4” of the user Ua's skin condition is recognized and stored in the memory 36 as a single measure score. Instead, the skin support application 35a may calculate the average value of the skin condition score of the user Ua when the degree of execution of the measure is equal to or greater than the threshold value, and the skin support application 35a is not related to the threshold value. In addition, the average value of the skin condition score of the user Ua when the measure is executed may be calculated. The single measure score corresponds to “the influence when one action is performed alone” of the present invention.

  In STEP112 of FIG. 25, the skin support application 35a executes the target measure with the degree of execution of the threshold on the same day, and the average value (combination measure) of the skin condition score of the user Ua when other measures are executed. (Score) is recognized and stored in the memory 36. The skin support application 35a is not executed on the same day, for example, even when another measure is executed within a predetermined period before and after the target measure is executed (for example, three days before and after), the process of STEP112 in FIG. It is good also as an object of. The combination measure score corresponds to “the influence when the one action and the action different from the one action are performed together” of the present invention.

  For example, as shown in FIG. 26, the skin support application 35 a creates data indicating a target measure, another measure, and a combined measure score, and stores the data in the memory 36.

  In STEP 113 of FIG. 25, the skin support application 35 a compares the single measure score and the combination score for each of the other measures, recognizes the magnification of the effect when combined, and stores it in the memory 36.

  For example, as shown in FIG. 26, the skin support application 35 a calculates the ratio between the single measure score and the combination score as the magnification for each of the other measures, and stores it in the memory 36.

  In STEP 114 of FIG. 25, the skin support application 35 a recognizes a predetermined number of measures for combination candidates in descending order of magnification and stores them in the memory 36. For example, the skin support application 35 a recognizes other measures “walk for 1 kilometer” and “laugh at least 3 times” as measures for combination candidates, and stores them in the memory 36.

In STEP114 of FIG. 25, the skin support application 35a indicates that the average value of the skin condition score when executed in combination is higher than the average value of the skin condition score when each measure is executed alone. It is good also as a condition of a measure of a combination candidate.
In STEP 115 of FIG. 25, the skin support application 35a outputs the combination measure recommendation screen P4 shown in FIG. 20D to the display 31 based on the recognized combination candidate measure and the magnification.

The skin support application 35a acquires an image corresponding to the recognized combination candidate measure from the skin state recognition system 10 through communication, for example, and outputs it as an image image P42. In addition, the skin support application 35a outputs a display P43 of the name of the measure of the recognized combination candidate stored in the memory 36. Further, the skin support application 35a outputs a magnification display P44 indicating the magnification of the recognized combination candidate stored in the memory 36. The image image P42 and the display name P43 of the combination candidate measures correspond to “information recommending a combination of the one measure and a different measure”.
(Other embodiments)
In the present embodiment, an example in which the skin support application 35a performs processing with the skin state as the “designated state” has been described. However, the present invention is not limited thereto, and the skin support application 35a performs processing with the heart state or body state as the “designated state”. You may go.

In the present embodiment, the combination candidate magnification is displayed, but instead of or in addition to this, the combination measure score shown in FIG. 26 may be displayed. Moreover, the color, figure, character, etc. which change according to a magnification or a union measure score may be displayed.

  In the present embodiment, the CPU 35 executes the skin support application 35a to execute each process of the “information output control unit” of the present invention. Instead, the CPU 35 performs communication via a network to transmit necessary data. By transmitting and receiving, the skin condition recognition system 10 may execute part of the processing of the “information output control unit” of the present invention.

The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.
In the present embodiment, an example has been described in which the skin support application 35a performs processing with the skin state as the “user state”. However, the skin support application 35a is not limited to this, and the skin support application 35a sets the heart state, body state, impression, or other state to “ The processing may be performed as “user state”. The calculation of the score of the heart state and the score of the body state can be calculated by the method described above. The impression score can be determined based on, for example, the evaluation of each impression for the user Ua received from the user terminal 30 of another user. For example, the skin condition recognition system 10 transmits a questionnaire that causes the user's user terminal 30 associated with the user ID of the user Ua to answer the user's Ua's reliable impression and the like in a plurality of stages, and has received the user terminal 30 Based on the answer, the score of each impression of the user Ua or the score of the entire impression may be determined. Other user state scores may be determined in the same manner as the impression, or may be determined according to a predetermined criterion.
Further, in the present embodiment, an example in which the skin support application 35a performs processing as a “behavior” of the present invention has been described. However, the present invention is not limited thereto. You may process as follows.

  DESCRIPTION OF SYMBOLS 1 ... Communication network, 10 ... Skin condition recognition system, 11 ... Skin condition recognition part, 12 ... Measure group selection part, 13 ... Measure information transmission part, 19 ... Secondary data generation part, 20 ... Support DB (database), 30 (30a, 30b, 30c) ... User terminal (smartphone), 31 ... Display, 32 ... Touch panel, 33 ... Camera, 34 ... Microphone, 35 ... CPU, 35a ... Skin support application, 36 ... Memory, 40 ... Connection terminal, 45: Measuring equipment.

Claims (8)

An output unit for outputting information;
A behavior information recognition unit for recognizing each behavior, the influence of each behavior on the state of the user, and the burden of each behavior;
While outputting the two-dimensional coordinate system represented by the two axes of the influence of the action and the burden of the action and the information indicating the respective actions to the output unit,
The information indicating each action is arranged at a position on the two-dimensional coordinate system corresponding to the influence of each action recognized by the action information recognition unit and the burden of each action. An image display device comprising: an information output control unit that outputs to an output unit. The image display device according to claim 1,
An input unit that accepts input;
An action selection recognizing unit for recognizing designation of any one of a plurality of actions output from the output unit via the input unit;
A behavior information recognition unit for recognizing the designated behavior, the degree of execution of the designated behavior, and the influence of the designated behavior on the state of the user;
The degree of execution of the designated action recognized by the action information recognition unit and the influence of the designated action on a two-dimensional coordinate system represented by two axes of the degree of action execution and the influence of the action And an information output control unit that outputs information indicating the above to the output unit. An output unit for outputting information;
A behavior information recognition unit for recognizing the behavior and the degree of execution of the behavior and the influence of the behavior on the user's skin, mind or body;
Information indicating the degree of execution of the action recognized by the action information recognition unit and the influence of the action on a two-dimensional coordinate system represented by two axes of the degree of action execution and the influence of the action An image display device comprising: an information output control unit that outputs to an output unit. The image display device according to claim 3.
A threshold recognizing unit that recognizes the degree of execution in which the score of the user condition satisfies a predetermined condition as a threshold;
The information output control unit is configured to output information indicating the threshold value on the two-dimensional coordinate system to the output unit. The image display device according to any one of claims 1 to 4,
The behavior information recognition unit recognizes the behavior and the influence of the behavior on the user and the influence of the behavior on other users,
The information output control unit is an image display device that outputs an influence of an action on a user and an influence of an action on another user to the output unit. The image display device according to any one of claims 1 to 5,
The behavior information recognizing unit recognizes the influence when the one action is performed alone and the influence when the one action and the action different from the one action are combined,
The information output control unit, when the influence when the one action and the action different from the one action are performed together is larger than the influence when the one action is performed alone, An image display device that outputs information recommending a combination of a different action and a different action to the output unit. In a system with an output unit that outputs information,
Recognizing each action, the impact of each action on the state of the user and the burden of each action;
At a position on the two-dimensional coordinate system corresponding to the two-dimensional coordinate system represented by two axes of the influence of the action and the burden of the action, and the recognized influence of each action and the burden of each action. And a step of outputting the information indicating each action to the output unit. A method executed by a system including an output unit that outputs information,
Recognizing each action, the impact of each action on the state of the user and the burden of each action;
At a position on the two-dimensional coordinate system corresponding to the two-dimensional coordinate system represented by two axes of the influence of the action and the burden of the action, and the recognized influence of each action and the burden of each action. And outputting the information indicating each action to the output unit.