WO2022118955A1 - Système de fourniture de solution - Google Patents

Système de fourniture de solution Download PDF

Info

Publication number
WO2022118955A1
WO2022118955A1 PCT/JP2021/044468 JP2021044468W WO2022118955A1 WO 2022118955 A1 WO2022118955 A1 WO 2022118955A1 JP 2021044468 W JP2021044468 W JP 2021044468W WO 2022118955 A1 WO2022118955 A1 WO 2022118955A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
information
state
unit
solution
Prior art date
Application number
PCT/JP2021/044468
Other languages
English (en)
Japanese (ja)
Inventor
智紀 本川
朋美 加藤
知彦 寺田
Original Assignee
ポーラ化成工業株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2020200827A external-priority patent/JP6963669B1/ja
Priority claimed from JP2020200823A external-priority patent/JP6963668B1/ja
Priority claimed from JP2021128933A external-priority patent/JP7095169B1/ja
Priority claimed from JP2021180720A external-priority patent/JP7024136B1/ja
Application filed by ポーラ化成工業株式会社 filed Critical ポーラ化成工業株式会社
Publication of WO2022118955A1 publication Critical patent/WO2022118955A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M21/02—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y10/00—Economic sectors
    • G16Y10/60—Healthcare; Welfare

Definitions

  • the present invention relates to a system for providing a solution for improving a user's emotional or fatigued state.
  • Patent Document 1 Conventionally, a biological measuring device and a mental and physical state guidance device are known (see Patent Document 1 and Patent Document 2).
  • the state of the user is determined based on the pulse wave information obtained from the face image of the user taken by using near-infrared light, and a predetermined alarm is issued according to the state of the user. be able to.
  • Patent Document 2 it is possible to specify the physical condition of the user from the biological information of the user and emit a stimulus for inducing a respiratory rhythm according to the physical condition.
  • the content of the solution that should be provided to the user in order to improve the user's condition greatly differs depending on the user's condition. Therefore, if a solution that is not suitable for the user's condition is provided, it may not be useful for improving the user's condition, but may even worsen it.
  • Patent Document 1 can only issue a predetermined alarm to the user, and the technique of Patent Document 2 can only issue a stimulus for adjusting the rhythm of breathing. Therefore, there is no mechanism that can provide an appropriate solution according to the user's emotions or fatigue.
  • an object of the present invention is to provide a solution providing system that can analyze a user's emotion or fatigue state and easily provide an appropriate solution according to the user's emotion or fatigue state.
  • the solution providing system of the present invention is A storage unit that stores information of multiple solutions that can be provided to the user to improve the user's emotional and / or fatigued state.
  • a user information acquisition unit that acquires user information including information obtained from the user's body or movement, and
  • a user state information generation unit that generates user state information indicating the user state of the user based on information acquired from the body or movement acquired by the user information acquisition unit.
  • a solution decision unit that determines a solution according to the user status information from the plurality of solutions, It is characterized by comprising a solution providing unit that provides the determined solution to the user.
  • the user information acquisition unit acquires user information including information obtained from the user's body or movement
  • the user state information generation unit obtains the user's information based on the information acquired from the body or movement.
  • User status information indicating the user status is generated.
  • the solution decision department decides the solution according to the user status information from multiple solutions, and the solution provision department provides the decided solution to the user.
  • a user can easily receive a solution according to his / her emotional or fatigue state only by having the system acquire information obtained from his / her body or movement.
  • the solution providing system consists of a mobile terminal that can be carried by the user.
  • the mobile terminal preferably includes the user information acquisition unit, the solution providing unit, the storage unit, the user state information generation unit, and the solution determination unit.
  • the user information acquisition unit of the mobile terminal acquires user information including information obtained from the user's body or movement, and the user state information generation unit obtains the information acquired from the body or movement.
  • User status information indicating the user status of the user is generated.
  • the solution determination department determines the solution according to the user status information from multiple solutions, and the solution provision department provides the determined solution to the user from the mobile terminal.
  • the solution providing system is configured to include a mobile terminal that can be carried by the user and a server.
  • the mobile terminal includes the user information acquisition unit and the solution providing unit.
  • the server includes the storage unit, the user state information generation unit, and the solution determination unit.
  • the user information acquisition unit acquires user information including information obtained from the user's body or movement, and transmits the user information to the server. It is preferable that the solution determination unit determines a solution according to the user state information from the plurality of solutions and transmits the solution to the mobile terminal.
  • the user information acquisition unit of the mobile terminal acquires user information including information obtained from the user's body or movement, and the user state information generation unit obtains the information acquired from the body or movement.
  • User status information indicating the user status of the user is generated.
  • the solution determination department determines the solution according to the user status information from multiple solutions, and the solution provision department provides the determined solution to the user from the mobile terminal.
  • the mobile terminal includes a history storage unit that stores the solution provided to the user for a predetermined period or a predetermined number of times.
  • the solution determination unit does not send the determined solution to the mobile terminal.
  • the solution providing unit acquires the determined solution from the history storage unit and provides the solution to the user. Is preferable.
  • the information of the solution provided to the user is stored in the history storage unit of the mobile terminal for a predetermined period or a predetermined number of times.
  • the solution determination unit does not send the solution to the mobile terminal, and the solution provider acquires the solution from the history storage unit. Since it is provided to the user, the amount of communication between the mobile terminal and the server is reduced, and the solution is promptly provided to the user.
  • the user information acquisition unit acquires the user information again after the solution is provided to the user.
  • the user state information generation unit regenerates the user state information based on the information including the user information acquired after the solution is provided to the user. It is preferable that the solution determination unit determines a solution according to the regenerated user state information.
  • the user information acquisition unit As a result of providing the solution, it is expected that the user's emotional or fatigued state will change due to other reasons such as the passage of time. According to the present invention, after the solution is provided to the user, the user information is acquired again by the user information acquisition unit.
  • the user state information is regenerated by the user state information generator based on the information including the user information acquired after the solution is provided to the user, and the solution decision unit responds to the regenerated user state information.
  • the solution is decided.
  • the mobile terminal includes a display unit and has a display unit.
  • the solution determined by the solution determination unit includes display information including information for promoting a predetermined operation or an image for improving the user state according to the user state information. It is preferable that the solution providing unit provides the display information to the user via the display unit.
  • Taking a predetermined action or viewing an image to improve the user's condition has the effect of relieving a person's tension and relieving fatigue, or activating the sympathetic nerve function to activate a person's tension. It has the effect of enhancing the feeling. It will be more effective if these are provided appropriately according to the user's condition.
  • the solution determined by the solution determination unit includes information that promotes a predetermined operation or display information including an image for improving the user state according to the user state information, and thus the user's emotions.
  • the fatigue state can be effectively improved.
  • the user information acquisition unit acquires user information including an image of the user's skin as information obtained from the user's body or movement, and obtains user information. It is equipped with a skin image analysis unit that analyzes the skin image included in the user information. It is preferable that the user state information generation unit generates user state information indicating the user state of the user based on the result of analysis by the skin image analysis unit.
  • a person's emotions or fatigue also affect the condition of the skin. Therefore, by acquiring and analyzing the skin condition, it is possible to know the emotional or fatigued state of a person.
  • a user can easily receive a solution according to his / her emotional or fatigue state simply by having the system acquire an image of the skin.
  • the solution providing system consists of a mobile terminal that can be carried by the user.
  • the mobile terminal is equipped with an imaging unit and has an imaging unit. It is preferable that the user information acquisition unit acquires user information including an image of the user's face via the imaging unit.
  • a user can easily receive a solution according to his / her emotional or fatigue state by having a mobile terminal acquire an image of his / her face.
  • the user information acquisition unit acquires the user information including the image of the skin of the finger of the user when the user is in the first situation, and the user when the user is in the second situation.
  • the skin image analysis unit analyzes the image of the finger included in the user information when the user is in the first situation, and includes the user information when the user is in the second situation. It is preferable to analyze the image of the face.
  • the user's emotion or fatigue state is accurately analyzed while changing the information to be acquired according to the user's situation, and the user's emotion or fatigue state is determined according to the user's emotion or fatigue state. It is possible to easily provide an appropriate solution.
  • the situational awareness unit recognizes whether the user is in the first situation or the second situation based on the current time zone.
  • a person who works in the daytime can use the image of the skin of the fingers at work during the daytime, and the image of the skin of the face at home during the nighttime before going to bed. You can know your feelings and fatigue.
  • the user's emotion or fatigue state is accurately analyzed while changing the information to be acquired according to the time zone, and an appropriate solution according to the user's emotion or fatigue state can be easily obtained. Can be provided.
  • the user information acquisition unit accepts input of user information including linguistic information which is one or both of characters and voice by the user as information obtained from the body or movement of the user. It is equipped with a language information analysis unit that analyzes the language information included in the user information. It is preferable that the user state information generation unit generates user state information indicating the user state of the user based on the result of analysis by the language information analysis unit.
  • a person's emotions or fatigue also affect their tendency to choose words. Therefore, the emotional or fatigued state of a person can be known by acquiring and analyzing the characters input by the person into the system and the voice emitted by the person.
  • a user can easily receive a solution according to his / her emotional or fatigue state simply by inputting linguistic information which is one or both of characters and voice.
  • the linguistic information analysis unit acquires information on the characteristics of the user information from the linguistic information, and obtains information about the characteristics of the user information. It is provided with an autonomic nerve balance acquisition unit that acquires autonomic nerve balance information indicating the autonomic nerve balance of the user based on the information regarding the feature acquired by the language information analysis unit. It is preferable that the user state information generation unit generates the user state information of the user based on the autonomic nerve balance information.
  • user state information indicating one or both of the user's emotional state and fatigue state is generated based on the autonomic nervous balance based on the information naturally generated by the user, such as characters or voices input by the user. Therefore, it is more likely that the user state information indicates the user's natural state.
  • a heartbeat information acquisition unit that acquires information on the user's heartbeat based on the results of analysis by the skin image analysis unit, and a heartbeat information acquisition unit.
  • An autonomic nerve balance acquisition unit that acquires autonomic nerve balance information indicating the user's autonomic nerve balance based on the information regarding the heartbeat acquired by the heartbeat information acquisition unit is provided. It is preferable that the user state information generation unit generates the user state information of the user based on the autonomic nerve balance information.
  • the reliability of the user state information is enhanced.
  • the linguistic information analysis unit acquires characteristic words and phrases contained in the linguistic information as information related to the characteristics of the user information.
  • the user state information generation unit uses one or both of a dictionary corresponding to the phrase and the user state acquired by the language information analysis unit and a determination model that inputs the phrase and outputs the user state. Therefore, it is preferable that the user state information is configured to generate the autonomic nerve balance information of the user.
  • characteristic words included in characters or voices input by the user are acquired by the language information analysis unit as information regarding the characteristics of the user information.
  • the language information analysis unit acquires the intonation of the voice as information regarding the characteristics of the user information.
  • the user state information generation unit uses one or both of a dictionary corresponding to the intonation and the user state acquired by the language information analysis unit and a determination model in which the intonation is input and the user state is output. Therefore, it is preferable that the user state information is configured to generate the autonomic nerve balance information of the user.
  • the intonation of the voice input by the user by the language information analysis unit is acquired as information regarding the characteristics of the user information.
  • User status information is generated using or both.
  • the user state information is generated by using the inflection of the voice emitted by the user himself, the correspondence dictionary between the inflection and the emotion, and / or the specific means of the judgment model of the emotion, etc. based on the inflection. Therefore, the accuracy of the user status information is improved.
  • the linguistic information analysis unit acquires negative words and phrases contained in the linguistic information as information regarding the characteristics of the user information.
  • the solution determination unit is a corresponding dictionary of the negative phrase acquired by the language information analysis unit and a positive paraphrase phrase of the phrase or a paraphrase phrase having a lower degree of negativeness than the phrase. And, using one or both of the conversion models that input the negative phrase and output the positive paraphrase phrase of the phrase or the paraphrase phrase with a lower degree of negativeness than the phrase, the negative It is preferable to determine as the solution a positive paraphrase corresponding to a certain phrase or a phrase candidate for a paraphrase having a lower degree of negativeness than the phrase.
  • negative words included in the linguistic information input by the user by the linguistic information analysis unit are acquired as information regarding the characteristics of the user information.
  • the solution determination unit inputs a corresponding dictionary of negative words and positive paraphrase words of words or paraphrase words with a lower degree of negativeness than the words, and positive words by inputting negative words.
  • Paraphrasing word candidates with a low degree of negativeness are determined as a solution.
  • the present invention it is possible to inform the user in a timely manner that the negative words uttered by the user himself include positive paraphrases or paraphrases that are less negative than the words. , The effect of improving the user's emotions or fatigue can be expected.
  • An autonomic nerve balance acquisition unit that acquires autonomic nerve balance information indicating the autonomic nerve balance of the user using the user information, and an autonomic nerve balance acquisition unit.
  • a fatigue state information acquisition unit that acquires fatigue state information indicating the fatigue state of the user using the user information, and a fatigue state information acquisition unit. Further prepare It is preferable that the user state information generation unit generates the user state information of the user based on the combination of the autonomic nerve balance information and the fatigue state information.
  • the user state information is generated based on the combination of the autonomic nerve balance information indicating the user's autonomic nerve balance and the fatigue state information indicating the user's fatigue state, so that the reliability of the user state information is reliable. Can be improved.
  • the user information includes an image of the user's skin.
  • a skin image analysis unit that analyzes the skin image included in the user information
  • a heartbeat information acquisition unit that acquires information on the user's heartbeat based on the results of analysis by the skin image analysis unit
  • a heartbeat information acquisition unit Further prepare
  • the autonomic nerve balance acquisition unit acquires the autonomic nerve balance information based on the information regarding the heartbeat acquired by the heartbeat information acquisition unit. It is preferable that the fatigue state information acquisition unit acquires the fatigue state information based on the information regarding the heartbeat acquired by the heartbeat information acquisition unit.
  • a person's fatigue condition also affects the condition of the skin. Therefore, by acquiring and analyzing the skin condition, it is possible to appropriately acquire information on the fatigue condition of a person. In addition, it is possible to acquire objective information called autonomic nerve balance based on the information on the user's heartbeat. Then, since the user state information is generated based on the combination of the autonomic nerve balance information and the fatigue state information, the reliability of the user state information can be further improved.
  • the user information includes linguistic information that is one or both of characters and voice by the user and an image of the user's skin.
  • a language information analysis unit that analyzes the language information included in the user information
  • a skin image analysis unit that analyzes the skin image included in the user information
  • a heartbeat information acquisition unit that acquires information on the user's heartbeat based on the results of analysis by the skin image analysis unit, and a heartbeat information acquisition unit. Further prepare
  • the autonomic nerve balance acquisition unit acquires autonomic nerve balance information indicating the autonomic nerve balance of the user based on the information regarding the feature acquired by the language information analysis unit. It is preferable that the fatigue state information acquisition unit acquires the fatigue state information based on the information regarding the heartbeat acquired by the heartbeat information acquisition unit.
  • the solution determination unit is configured to determine the solution that induces the user state into a relaxed state, a calm state, or an awakened state according to the user state information.
  • the solution determination unit determines a solution that guides the user state to a relaxed state, a calm state, or an awakened state according to the user state information.
  • the user can be effectively guided to a relaxed state, a calm state, or an awakened state.
  • a desired state reception unit that accepts input of desired state information indicating one or both of the user's emotions or fatigue states desired by the user is provided. It is preferable that the solution determination unit is configured to determine the solution that guides the user state toward the state indicated by the desired state information based on the user state information and the desired state information.
  • the solution determined by the solution determination unit includes a predetermined periodic vibration according to the user state. It is preferable that the solution determination unit is configured to determine the vibration cycle based on the user state information and the desired state information.
  • the predetermined periodic vibration has the effect of inducing a person's emotions to a calm state or in a direction of recovering from a fatigued state.
  • a desired state reception unit that accepts input of desired state information indicating one or both of the user's emotions or fatigue states desired by the user is provided.
  • the solution determined by the solution determination unit includes a predetermined periodic vibration.
  • the solution determination unit determines the cycle at the start of the vibration based on the information on the heartbeat, and the pattern of change of one or both of the cycle and the intensity after the start of the vibration based on the desired state information. It is preferable that it is configured to determine.
  • the predetermined periodic vibration has the effect of inducing a person's emotions to a calm state or in a direction of recovering from a fatigued state. In particular, it is more effective to change the cycle at the start of vibration and the cycle and intensity of vibration after the start of vibration according to the state of a person's heartbeat.
  • the present invention it is possible to effectively induce the emotion or fatigue state desired by the user according to the heartbeat of the user.
  • the storage unit stores reference state information indicating a reference of a state in which one or both of the user's emotional or fatigue states are improved. It is preferable that the solution determination unit is configured to determine the solution that guides the user state toward the state indicated by the reference state information based on the user state and the reference state information.
  • the user can be effectively guided to the emotional or fatigued state indicated by the reference state information.
  • the solution determined by the solution determination unit is preferably a passive stimulus to the user's sense of touch, hearing or smell.
  • the solution provided by the system is a solution that requires the user to take active action, it causes the effort associated with receiving the solution from the user, and rather causes emotional offense and accumulation of fatigue. It is not desirable because it will end up.
  • the solution determined by the solution determination unit is preferably a stimulus of music, reading voice, and vibration.
  • Reading voice and predetermined periodic vibration have the effect of activating the function of the parasympathetic nerve, relieving the tension of the person, and relieving fatigue.
  • music has the effect of relieving a person's tension or activating the function of the sympathetic nerve to increase the person's tension. Proper combination of these will be more effective.
  • the solution determined by the solution determination unit is a stimulus of music, reading voice, or any or a combination of vibrations.
  • the user's emotional or fatigued state can be more effectively improved.
  • the mobile terminal includes a vibration generating unit, and the solution determined by the solution determining unit includes vibration according to the user state information. It is preferable that the solution providing unit provides the vibration to the user via the vibration generating unit.
  • Vibration with a predetermined cycle has the effect of relieving a person's tension and relieving fatigue.
  • the solution determined by the solution determination unit includes a predetermined periodic vibration according to the user state of the user, the emotional or fatigue state of the user can be effectively improved. ..
  • the mobile terminal includes a scent generator and has a scent generator.
  • the solution determined by the solution determination unit contains a predetermined scent according to the user status information. It is preferable that the solution providing unit provides the predetermined scent to the user via the scent generating unit.
  • the prescribed scent has the effect of relieving a person's tension and relieving fatigue.
  • the solution determined by the solution determination unit contains a predetermined scent according to the user state of the user, so that the emotional state or fatigue state of the user can be effectively improved.
  • the mobile terminal includes an audio reproduction unit and has an audio reproduction unit.
  • the solution determined by the solution determination unit includes a human voice, a natural sound, or a voice including music according to the user state information. It is preferable that the solution providing unit provides the voice to the user via the voice reproducing unit.
  • the user information acquisition unit acquires information indicating the heartbeat of the user as the user information, and obtains information indicating the heartbeat of the user.
  • the user state information generation unit has a heartbeat recognition unit that recognizes the tempo of the user's heartbeat as the user state information from the information indicating the user's heartbeat.
  • the solution determination unit has a stimulus content determination unit that determines a tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit as the solution, which is the tempo of the stimulus provided to the user.
  • the solution providing unit preferably has a stimulus generating unit that generates the stimulus at a tempo determined by the stimulating content determining unit toward the user.
  • the effect of improving the physical and mental condition of the user is high by generating a stimulus consisting of a tempo vibration synchronized with the tempo of the user's heartbeat toward the user.
  • a stimulus consisting of a tempo vibration synchronized with the tempo of the user's heartbeat toward the user.
  • the effect of improving the work efficiency of the user, the fatigue state, and the ease of introducing sleep is high.
  • a stimulus consisting of a tempo vibration synchronized with the tempo of the user's heartbeat is generated toward the user, it is possible to effectively improve the physical and mental condition of the user.
  • the stimulus generated by the stimulus generator consists of a combination of vibration and sound.
  • the sound is a human voice, natural sound or music. It is preferable that the stimulus content determining unit determines the tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit as the tempo of the vibration and the sound included in the stimulus provided to the user. ..
  • the user condition can be improved more effectively by providing the combination of vibration and sound as a stimulus, which has a tempo synchronized with the tempo of the heartbeat.
  • the stimulus generated by the stimulus generator consists of a combination of vibration and sound, and the tempo of the vibration and sound is synchronized with the tempo of the heartbeat, so that the user state can be improved more effectively.
  • the user information acquisition unit has an autonomic nerve state recognition unit that recognizes the state of the user's autonomic nerve.
  • the stimulus content determination unit The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
  • the autonomic nerve state recognition unit recognizes that the state of the user's autonomic nerve is in the predominant state of the sympathetic nerve, the tempo changes so as to be delayed from the start time to the end time of the stimulus. It is preferable that it is configured to determine.
  • the user information acquisition unit has an autonomic nerve state recognition unit that recognizes the state of the user's autonomic nerve.
  • the stimulus content determination unit The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
  • the autonomic nerve state recognition unit recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve, the tempo changes so as to increase from the start time to the end time of the stimulus. It is preferable that it is configured to determine.
  • the stimulus is started at a tempo that is synchronized with the tempo of the user's heartbeat, and then the tempo of the stimulus is changed to slow down if the user is in a predominant state of the sympathetic nerve, or the user. It was found that when the sympathetic nerve is in a predominant state, changing the tempo of the stimulus so as to increase the tempo of the stimulus has a high effect of improving the user state.
  • the stimulus is started at a tempo synchronized with the tempo of the user's heartbeat, and then the tempo of the stimulus is changed to be slower when the user is in a predominant state of the sympathetic nerve, or the user When the parasympathetic nerve is in a predominant state, the tempo of the stimulus is changed to be faster, so that the user state can be effectively improved.
  • the user information acquisition unit has an autonomic nerve state recognition unit that recognizes the state of the user's autonomic nerve.
  • the stimulus content determination unit The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
  • the autonomic nerve state recognition unit recognizes that the state of the user's autonomic nerve is in a balanced state, it determines that the tempo is maintained from the start time to the end time of the stimulus. It is preferable that it is configured as such.
  • the stimulation is started at a tempo synchronized with the tempo of the user's heartbeat, and then the stimulation is continued at the same tempo. It turned out that the effect of improving the user condition is high.
  • the stimulation is started at a tempo synchronized with the tempo of the user's heartbeat, and then, if the state of the user's autonomic nerves is in a balanced state, the stimulation is continued at the same tempo.
  • the user condition can be effectively improved.
  • the user state information generation unit has a desired state reception unit that receives the designation of a desired state indicating the state desired by the user by the user.
  • the stimulus content determination unit The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
  • the desired state received by the desired state receiving unit is a predominant state of the parasympathetic nerve, it is configured to determine the change in tempo so as to be delayed from the start time to the end time of the stimulus. Is preferable.
  • the user state information generation unit has a desired state reception unit that receives the designation of a desired state indicating the state desired by the user by the user.
  • the stimulus content determination unit The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
  • the desired state received by the desired state receiving unit is a predominant state of the sympathetic nerve, it is configured to determine the change in tempo so as to be faster from the start time to the end time of the stimulus. Is preferable.
  • the stimulation is started at a tempo synchronized with the tempo of the user's heartbeat, and then the tempo is changed to be faster, so that the user is easily guided to the state where the sympathetic nerve is dominant, and the user state is improved. It turned out to be more effective.
  • the user can be easily guided to a state in which the parasympathetic nerve is dominant, and the effect of improving the user state is enhanced. I found out.
  • the desired state specified by the user is a state in which the sympathetic nerve is dominant
  • a stimulus that starts at a tempo synchronized with the tempo of the user's heartbeat and then changes so as to become faster is a stimulus. Since it is generated toward, the user can be effectively guided to a state in which the sympathetic nerve is dominant.
  • the desired state specified by the user is a state in which the parasympathetic nerve is dominant
  • a stimulus that changes so as to slow down the tempo after the start is generated toward the user, so that the user is in a state in which the parasympathetic nerve is dominant. It can be effectively induced.
  • the user status information generation unit is The desired state receiving unit that accepts the designation of the desired state indicating the state desired by the user by the user, and the desired state receiving unit.
  • the autonomic nerve state recognition unit that recognizes the state of the user's autonomic nerve, Have and
  • the stimulus content determination unit The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
  • the desired state received by the desired state receiving unit is a state in which work efficiency is high or fatigue is recovered.
  • the autonomic nerve state recognition unit recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve, the tempo changes so as to increase from the start time to the end time of the stimulus. Decide, When the state of the user's autonomic nerve is recognized as the predominant state of the sympathetic nerve, it is configured to determine the change in tempo so as to be delayed from the start time to the end time of the stimulus. It is preferable to have.
  • the stimulus is started at a tempo synchronized with the tempo of the user's heartbeat, and then the tempo of the stimulus is changed to be slower when the sympathetic nerve is dominant, so that the parasympathetic nerve is dominant.
  • changing the tempo of the stimulus to a higher speed was found to be highly effective in improving the physical and mental condition of the user, especially in improving work efficiency and fatigue.
  • stimulation is started at a tempo synchronized with the tempo of the user's heartbeat, and then the user has a predominance of sympathetic nerves.
  • the tempo of the stimulus is changed to be slower, and when the user is in a predominant state of the parasympathetic nerve, the tempo of the stimulus is changed to be faster. Can be improved.
  • the user state information generation unit has a desired state reception unit that receives the designation of a desired state indicating the state desired by the user by the user.
  • the stimulus content determination unit The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
  • the tempo change is determined so as to be delayed from the start time to the end time of the stimulus. It is preferable to have.
  • the inventor's research found that starting the stimulus at a tempo synchronized with the tempo of the user's heartbeat and then changing the stimulus tempo to slow down is highly effective in inducing sleep. ..
  • the stimulus when a state in which sleep is easily introduced is specified as a desired state, the stimulus is started at a tempo synchronized with the tempo of the user's heartbeat, and then the tempo of the stimulus is changed to be slower. It can effectively make it easier for users to introduce sleep.
  • the stimulus content determination unit When determining the change so that the tempo becomes slower from the start time to the end time of the stimulus, the change is made so that the tempo at a speed equal to or higher than the predetermined lower limit value is the tempo at the end time of the stimulus. It is preferably configured to determine.
  • the stimulus content determination unit When determining the change so that the tempo becomes faster from the start time to the end time of the stimulus, the change is made so that the tempo at a speed equal to or less than the predetermined upper limit value is the tempo at the end time of the stimulus. It is preferably configured to determine.
  • the tempo at a speed equal to or higher than the lower limit is set as the tempo at the end of the stimulus, or when the tempo is changed to be faster, the tempo is equal to or less than the upper limit. Since the tempo of speed is set as the tempo at the end of the stimulus, the user condition can be effectively improved.
  • the desired state includes a state in which sleep is easily introduced and a state in which work efficiency is high or fatigue is recovered.
  • the stimulus content determination unit The length of the stimulus when the desired state received by the desired state receiving unit is a state in which sleep is easily introduced, rather than the length of the stimulus when the desired state is a state with high work efficiency or a state in which fatigue is recovered. It is preferable to determine the length of the stimulus so that the stimulus is long.
  • the length of the stimulus to make the user work efficiently or recover from fatigue is effective in a relatively short time of about 2 minutes, and it is easy to introduce the user to sleep. It was found that it is more effective to give a stimulus for a longer period of time than the stimulus for achieving a state of high work efficiency or a state of recovery from fatigue.
  • the length of the stimulus when the desired state is a state where the work efficiency is high or the state where the fatigue is recovered is larger than the length of the stimulus when the state where sleep is easily introduced is determined by the stimulus content determining unit. Since the length of the stimulus is determined to be longer, it is possible to make the user more effective in introducing sleep.
  • the stimulus content determination unit The change in tempo was determined so as to be gradually delayed from the start time to the end time of the stimulus. Moreover, the length of time for generating the stimulus at the tempo at the end of the stimulus is longer than the length of the time for generating the stimulus at the tempo of each stage before changing to the tempo at the end of the stimulus. , It is preferable to determine the change in the tempo.
  • the tempo of the stimulus is gradually slowed down from the start point to the end point, and the stimulus is generated at the tempo of each stage before the tempo is changed to the tempo at the end point of the stimulus. It was found that increasing the length of time during which the stimulus is generated at the tempo at the end of the time rather than the length of each time makes it easier for the user to introduce sleep more effectively.
  • the stimulus content determination unit determines the tempo change so that the tempo gradually slows down from the start point to the end point of the stimulus, and before the tempo is changed to the tempo at the end point of the stimulus.
  • the tempo change is determined so that the length of time to generate the stimulus at the end tempo is longer than the length of each time to generate the stimulus at the step tempo. Therefore, it is possible to make the user more effective in introducing sleep.
  • the user information acquisition unit has an input unit that accepts information input by the user, and acquires the user information via the input unit. It is preferable that the user state information generation unit generates the user state information based on the user information acquired by the user information acquisition unit.
  • the user information is acquired as the information input by the user himself / herself, and the user status information is generated based on the user information, so that the user status can be appropriately grasped.
  • the user information acquisition unit A display unit that displays information and An image pickup unit that captures an image of the user's face, The image of the user's face captured by the imaging unit is displayed on the display unit, and information on a question regarding the state of a predetermined portion of the user's face displayed on the display unit and information on the user's face are displayed.
  • An output control unit that displays on the display unit information that prompts the input of emotional information indicating the content of the emotion that the user has for the image.
  • An input receiving unit that receives information on answers to the question and input of the emotional information via the input unit while the image of the user's face captured by the imaging unit is displayed on the display unit.
  • the user state information generation unit acquires, as the user state information, a value indicating the degree of subjective fatigue state felt by the user, which is calculated by a predetermined method from the information of the answer to the question and the emotion information. It is preferable to have a subjective fatigue state information acquisition unit.
  • Information on the answer to the question regarding the state of the part of the user and emotional information indicating the content of the emotion that the user has with respect to the image of the user's face are accepted.
  • the solution providing system effectively grasps the user's understanding of the fatigue state by letting the user input the answer to the question about the state of a predetermined part of the face while showing his / her face. be able to.
  • the subjective fatigue state information acquisition unit acquires a value indicating the degree of the subjective fatigue state felt by the user, which is calculated by a predetermined method from the information of the answer to the question and the emotional information.
  • these actions provide the user with an experience of getting a bird's-eye view of the fatigue state from various angles including self-awareness while looking at his / her face, which in turn improves the consciousness of taking care of himself (self-care consciousness). Can also be brought.
  • the output control unit is a word of encouragement or comfort that is suitable for improving the fatigue state that the user himself / herself is aware of for the user displayed on the display unit as information for prompting the input of the emotion information. It is preferable that the display unit is configured to display information prompting the input of information.
  • information of words of encouragement or comfort suitable for improving the fatigue state recognized by the user himself / herself to the user displayed on the display unit can be input.
  • the solution determination unit causes the user to recognize the information obtained by combining the value indicating the degree of the user's subjective fatigue state and the emotional information, and the user's subjective fatigue state, or the user's subjective state.
  • a decision unit that determines the fatigue recognition improvement information corresponding to the combined information as the solution by referring to the information indicating the correspondence between the fatigue recognition improvement information consisting of the information for improving the fatigue state and the information indicating the correspondence relationship.
  • the output control unit is configured to output the fatigue recognition improvement information to the user as the solution.
  • the determination unit determines fatigue recognition improvement information, which is information consisting of information for making the user recognize the user's subjective fatigue state or improving the user's subjective fatigue state.
  • the output control unit outputs the determined fatigue recognition improvement information to the user.
  • the degree of subjective fatigue is determined from the information of the question regarding the state of a predetermined part of the face and the emotional information indicating the content of the emotion that the user has with respect to the image of the user's face. Multifaceted analysis of the indicated values has the advantage of being able to accurately recognize the user's subjective fatigue state.
  • the determination unit is configured to combine emotional information with a value indicating the degree of the user's subjective fatigue state to determine fatigue recognition improvement information corresponding to the combination.
  • Improvement information can be determined.
  • the determination unit includes a first comment including information on a combination of a value indicating the degree of the user's subjective fatigue state and the emotional information, and verbal information indicating the user's subjective fatigue state.
  • the first comment corresponding to the information of the combination is determined as the fatigue recognition improvement information by referring to the information indicating the correspondence relationship of the above. It is preferable that the output control unit is configured to output the first comment determined by the determination unit to the user.
  • the determination unit determines the first comment indicating the user's subjective fatigue state, and the output control unit outputs the first comment to the user.
  • the emotional information cannot be directly reflected in the decision of the first comment only by increasing the accuracy of the user's recognition of the fatigue state, and the user is convinced of the first comment provided to the user. You may not get a good feeling.
  • the determination unit further combines emotional information with a value indicating the degree of subjective fatigue of the user, and determines the first comment according to the combination.
  • the user state information generation unit includes an objective fatigue state information acquisition unit that acquires a value indicating the degree of objective fatigue of the user as the user state information, which is calculated by a predetermined method.
  • the determination unit refers to information indicating a correspondence relationship between a value indicating the degree of objective fatigue of the user and a second comment consisting of verbal information indicating the objective fatigue state of the user.
  • the second comment corresponding to the value indicating the objective degree of fatigue of the user is configured to be determined as the fatigue recognition improvement information. It is preferable that the output control unit is configured to output the second comment determined by the determination unit to the user.
  • the subjective fatigue state can be analyzed and both analysis results can be presented to the user, so that the user can present his / her own subjective fatigue state.
  • an objective fatigue state can be recognized at the same time.
  • the state of the user's heart rate is closely related to the state of the user's objective fatigue, and in particular, the autonomic nervous balance obtained from the state of the heart rate is the state of the user's objective fatigue. It really appears.
  • the objective fatigue state information acquisition unit acquires information on the user's heart rate by a predetermined method, and the heart rate state information indicating the state of the user's heart rate derived from the information on the heart rate and the autonomic nerve of the user.
  • the autonomic nerve balance information indicating the balance is acquired, and the value indicating the objective degree of fatigue of the user is acquired based on the heart rate state information and the autonomic nerve balance information.
  • the determination unit includes a second comment consisting of information on a combination of a value indicating the degree of objective fatigue of the user and the autonomic nerve balance information, and information on words indicating the objective fatigue state of the user. It is configured to determine the second comment corresponding to the information of the combination as the fatigue recognition improvement information by referring to the information indicating the correspondence relationship of. It is preferable that the output control unit is configured to output the second comment determined by the determination unit to the user.
  • a second comment indicating an objective fatigue state of the user is determined by the determination unit, and is output to the user by the output control unit.
  • a plurality of information regarding the user's objective fatigue state such as heart rate state information indicating the user's heart rate state and autonomic nerve balance information indicating the user's autonomic nerve balance, is acquired from various angles.
  • the analysis has the advantage that the user's objective fatigue state can be accurately recognized.
  • the decision-making unit decides the second comment according to the combination of the value indicating the degree of objective fatigue of the user and the autonomic nervous balance.
  • the user state information generation unit includes an objective fatigue state information acquisition unit that acquires a value indicating the degree of the user's objective fatigue state as the user state information, which is calculated by a predetermined method.
  • the storage unit stores a plurality of improved contents, which are information for improving the subjective fatigue state and the objective fatigue state of the user, as the plurality of solutions.
  • the determination unit is information indicating a correspondence relationship between the combination information of a value indicating the degree of subjective fatigue state of the user and a value indicating the degree of objective fatigue state of the user and the improved content. With reference to, the improvement content corresponding to the information of the combination is determined as the fatigue recognition improvement information. It is preferable that the output control unit is configured to output the improved content determined by the determination unit to the user.
  • the determination unit determines the improvement content, which is information for improving the user's subjective and objective fatigue state, and outputs it to the user, so that the user's fatigue state is effective. Can be improved.
  • the improvement content acquires a plurality of information related to the user's subjectivity, such as question information regarding the state of a predetermined part of the face and emotional information indicating the content of the emotion that the user has with respect to the image of the user's face.
  • a value indicating the degree of the user's subjective fatigue state recognized by multifaceted analysis, heartbeat state information, and autonomic nerve balance information, which are multiple pieces of information regarding the user's objective fatigue state, are acquired. Since it is determined according to the combination with the value indicating the degree of the user's objective fatigue state recognized by the multifaceted analysis, it is possible to surely determine the improved content that gives the user a high sense of conviction. can.
  • the improved content consists of a combination of vibration and / or sound and verbal information.
  • the sound is a human voice, natural sound or music.
  • the decision-making part When the value indicating the degree of the user's subjective fatigue state indicates that the user's subjective fatigue state is worse than the predetermined first criterion, the user's subjective fatigue state. Determine the information of the above words to improve, When the value indicating the degree of the user's objective fatigue state indicates that the user's objective fatigue state is worse than the predetermined second criterion, the user's objective fatigue state. It is preferable that it is configured to determine the information of the above-mentioned words for improving.
  • the improved content determined according to the combination of the value indicating the degree of subjective fatigue state of the user and the value indicating the degree of objective fatigue state is one or both of vibration and sound. It consists of a combination with verbal information.
  • the improvement content consists of abundant information rather than the improvement content consisting of only one or both of the vibration and the sound. Therefore, it is possible to provide the user with the improvement content capable of more effectively improving the user's fatigue state. can.
  • the decision-making part By referring to the information indicating the correspondence between the emotional information and the information of words for improving the subjective fatigue state of the user, the subjective fatigue state of the user corresponding to the emotional information is improved.
  • Determine the verbal information to do Correspondence between the autonomic nerve balance information indicating the autonomic nerve balance of the user derived from the information on the heartbeat of the user acquired by a predetermined method and the information of words for improving the objective fatigue state of the user. It is preferable that the information indicating the relationship is referred to to determine the verbal information for improving the objective fatigue state of the user corresponding to the autonomic nerve balance information.
  • the determination unit determines the information of words that determine the user's fatigue state to be worse than a predetermined criterion, even if the degree of the user's fatigue state is the same.
  • Information in different words can be reliably determined according to the content of emotional information or autonomic nerve balance information.
  • the mobile terminal includes an image pickup unit, a display control unit, a display unit, a response reception unit, and an input unit.
  • the user information acquisition unit acquires user information including an image of the user's face via the imaging unit.
  • the display control unit displays an image of the user's face captured by the imaging unit on the display unit, and correlates with the emotion or fatigue state appearing on the user's face displayed on the display unit. Display a question about the condition of the face on the display,
  • the input unit is arranged at a position where the user can operate while looking at the image of the user's face displayed on the display unit and the question.
  • the answer receiving unit receives the input of the answer by the user to the question about the face condition of the user via the input unit in a state where the image of the face is displayed on the display unit. It is preferable that the user state information generation unit generates the user state information based on the information including the answer.
  • the question is a question that has a correlation with the emotion or fatigue state appearing on the user's face.
  • you will be promoted to be aware of the facial condition that is closely related to your emotions or fatigue, and you may be able to answer your facial condition accurately. It will increase.
  • the user can easily receive an individualized solution according to his / her emotional or fatigued state by getting the answer regarding the facial image and the facial condition.
  • test results The following shows the test results of the improvement effect of the user's mental and physical condition (work efficiency, fatigue state, ease of sleep introduction) when the solution providing system of the present invention is used.
  • Flow of the test The flow of actions on the day is as follows. (1) Visit the test site and spend 10 minutes at rest. (2) Perform mental work load for 45 minutes. (3) Collect 0.5 mL of saliva for cortisol measurement, respond to fatigue caused by VAS, and carry out work efficiency evaluation tasks. (4) Experience vibration under any of the conditions 1 to 4 for 2 minutes. The subjects are divided into 4 groups, and each group is made to experience one of the conditions 1 to 4. (5) After spending 10 minutes at rest, 0.5 mL of saliva for cortisol measurement was collected, and a response to fatigue caused by VAS and a task for evaluating work efficiency were carried out.
  • Condition 2 A bpm heartbeat-like vibration synchronized with the heartbeat is presented.
  • Condition 3 A bpm heartbeat-like vibration obtained by adding 50 bpm to the heartbeat is presented.
  • Condition 4 A bpm heartbeat-like vibration obtained by subtracting 20 bpm from the heartbeat is presented.
  • 2-back task 30 minutes + ATMT (R task) 15 minutes for a total of 45 minutes.
  • (2-back task) A short-term memory task in which alphabets are randomly displayed on the computer screen every 3 seconds, and if the currently displayed alphabet and the alphabet displayed two before are the same, right-click, and if they are different, left-click.
  • (ATTM (R task)) A simple visual search reaction task in which 25 letters of the alphabet from A to Z are randomly displayed on the computer screen, the arrangement is changed each time the "R" is clicked, and the "R" is quickly clicked.
  • Problem B The arrangement does not change, and when the target number is pressed, the number disappears and a new number appears at an arbitrary position (eg, when 11 is pressed, 11 disappears and 36 appears).
  • Task C The task of pressing the numbers in order, changing the arrangement of all the numbers each time the target number is pressed.
  • (Measurement of cortisol) Collect using a saliva collection kit (Saripet (Sarstedt Co., Ltd.). Put the sponge in the kit in your mouth, soak it in saliva, and collect the sponge in a tube. Collect saliva by centrifugation. The amount of cortisol collected from the collected saliva will be measured at the inspection contractor.
  • FIG. 13 is a graph comparing the average values of the changes in the fatigue scores under the conditions 1 to 4, and Table 1 shows the analysis results of the changes in the fatigue scores under the conditions 1 to 4. It was confirmed that the feeling of fatigue was significantly reduced under the condition 2 as compared with the condition 1. (The "*" on the side of the table indicates that *** p ⁇ 0.001, ** p ⁇ 0.01, * p ⁇ 0.05. The same shall apply hereinafter.)
  • FIG. 14 is a graph showing the average value of the change amount of the error number of the C task of the conditions 1 to 4, and Table 2 is the analysis result of the change amount of the error number of the C task of the conditions 1 to 4.
  • FIG. 15 is a graph showing the average value of changes in cortisol under conditions 1 to 4, and Table 3 shows the analysis results of changes in cortisol under conditions 1 to 4. A significant decrease in cortisol was observed under condition 2 as compared with condition 1, confirming the effect of reducing stress and fatigue.
  • Flow of the test The flow of actions on the day is as follows. (1) Visit the test site and measure for 2 minutes with an acceleration pulse wave meter to measure the autonomic nerve balance. (2) Collect 0.5 mL of saliva for cortisol measurement. (3) Answering fatigue by VAS and carrying out work efficiency evaluation tasks. (4) Experience the vibration of any of the conditions 1 to 4 for 2 minutes. The subjects are divided into 4 groups, and each group experiences one of the conditions 1 to 4. (5) After spending 10 minutes at rest, 0.5 mL of saliva for cortisol measurement was collected. Answering fatigue by VAS and implementing tasks for work efficiency evaluation.
  • LF low frequency component
  • HF high frequency component
  • Subjective fatigue is measured by the VAS (Visual Analog Scale) method. Check the current position of fatigue, with the left end as no fatigue (0) and the right end as the maximum fatigue (100) that you have never felt before. The checked position is measured as a numerical value from 0 to 100. (Measurement of work efficiency) Three sets (about 10 minutes) of ATMT (ABC task) are performed, and the number of errors in C task is used for evaluation.
  • VAS Visual Analog Scale
  • a task Pushing numbers 11 to 35 fixed on the screen in order
  • B task The arrangement does not change, and when you press the target number, that number disappears and a new number appears at any position ( Example: When you press 11, 11 disappears and 36 appears)
  • Task C Each time you press the target number, the arrangement of all the numbers changes, and the task of pressing the numbers in order (measurement of cortisol) Collect using a saliva collection kit (Saripet (Sarstedt Co., Ltd.). Put the sponge in the kit in your mouth, soak it in saliva, and collect the sponge in a tube. Collect saliva by centrifugation. The amount of cortisol collected from the collected saliva will be measured at the inspection contractor.
  • FIG. 16 is a graph comparing the average values of the changes in the fatigue scores under the conditions 1 to 4, and Table 4 shows the analysis results of the changes in the fatigue scores under the conditions 1 to 4. It was confirmed that the feeling of fatigue was significantly reduced under the vibration stimulation conditions 2, 3 and 4 according to each person's autonomic nervous state as compared with the state without vibration.
  • FIG. 17 is a graph with respect to the average value of the change amount of the error number of the C task of the conditions 1 to 4, and Table 5 is the analysis result of the change amount of the error number of the C task of the conditions 1 to 4.
  • FIG. 18 is a graph showing the average value of changes in cortisol under conditions 1 to 4, and Table 6 shows the analysis results of changes in cortisol under conditions 1 to 4. Compared with the state without vibration, a significant decrease in cortisol was observed under the vibration stimulation conditions 2, 3 and 4 according to each person's autonomic nervous state, and the effect of reducing stress and fatigue was confirmed.
  • Condition 2 A bpm heartbeat-like vibration synchronized with the heartbeat is presented.
  • Condition 3 A vibration is presented that starts with a heartbeat-like vibration of bpm synchronized with the heartbeat and decreases bpm over 2 minutes up to 50 bpm.
  • the vibration device is connected to the PC.
  • the subject experiences the vibration through the holding vibration device by operating the program such that the vibration according to the condition 2 or 3 is presented.
  • the heart rate required to present condition 2 or 3 is measured as follows. Wear a heart rate measuring device 10 minutes before the vibration experience, and measure the average heart rate (bpm) for 3 minutes after spending 5 minutes in a resting position.
  • FIG. 19 is a graph comparing the average values of the scores of the conditions 1 to 3, and Table 7 is the analysis result of the scores of the conditions 1 to 3.
  • the score was improved by the heart rate synchronization stimulus of the condition 2 with respect to the condition 1, and the stimulus decreased from the heart rate synchronization vibration of the condition 3 was the most effective. From these facts, it was confirmed that the stimulus synchronized with the heart rate, more preferably the stimulus synchronized with the heart rate and further lowering the frequency, has the effect of inducing sleep onset.
  • Condition 1 Music only (same music as condition 2)
  • Condition 2 Vibration that changes from heartbeat-like vibration synchronized with the subject's heartbeat to 50 bpm over 4 minutes + Music synchronized with the tempo of the frequency shown on the left Condition 3 No stimulation
  • VAS Vehicle Analog Scale
  • Table 8 shows the results of comparing the changes in VAS between groups before and after loading, and before and after resting. If the value is- (minus), it means that the condition has improved (the same applies hereinafter). In the former, a significant difference from condition 3 can be seen in both conditions 1 and 2. In the latter case, a significant difference was confirmed only in the comparison between condition 3 and condition 2 (shaded part). From this, it can be said that the effect of condition 2 on stress lasts longer than that of condition 1.
  • Table 9 shows the results of comparing the changes in the results of fatigue symptom examination before and after loading, and before and after resting between groups. A significant difference was confirmed only by comparing condition 3 and condition 2 (shaded part). Only condition 2 was able to confirm the effect of the fatigue symptom investigation.
  • Table 10 shows the results of comparing the changes in the amount of cortisol in saliva after loading and after resting between the groups. A significant difference was found only between condition 3 and condition 2.
  • the block diagram which shows the whole image of the solution providing system which concerns on 1st Embodiment of this invention The figure which shows the content of the data used for processing by the solution provision system of 1st Embodiment.
  • the flowchart which shows the processing content of the solution provision system of 1st Embodiment The flowchart which shows the processing content of the solution provision system of 1st Embodiment.
  • the figure which shows the content of the data used for processing by the solution provision system of 1st Embodiment The block diagram which shows the whole picture of the solution provision system of 2nd Embodiment.
  • the flowchart which shows the processing content of the solution provision system of 2nd Embodiment The flowchart which shows the processing content of the solution provision system of 2nd Embodiment.
  • the flowchart which shows the processing content of the solution provision system of 2nd Embodiment The flowchart which shows the processing content of the solution provision system of 2nd Embodiment.
  • the flowchart which shows the processing content of the solution provision system of 3rd Embodiment The flowchart which shows the solution provision system processing contents of 3rd Embodiment.
  • the flowchart which shows the solution provision system processing contents of 3rd Embodiment The figure which shows the content of the data used for processing by the solution provision system of 3rd Embodiment.
  • the flowchart which shows the solution provision system processing contents of 3rd Embodiment The flowchart which shows the solution provision system processing contents of 3rd Embodiment.
  • the flowchart which shows the solution provision system processing contents of 3rd Embodiment The flowchart which shows the solution provision system processing contents of 3rd Embodiment.
  • the solution providing system of the present embodiment includes a mobile terminal 10 and a server 30.
  • the mobile terminal 10 and the server 30 are connected to each other so as to be able to communicate with each other by a communication network 90 such as a mobile phone network.
  • the number of mobile terminals 10 and the number of servers 30 may be plural.
  • the mobile terminal 10 is a general-purpose terminal such as a smartphone or a tablet terminal, which includes a mobile terminal control unit 110, an input unit 130, and an output unit 150.
  • the mobile terminal 10 may be a dedicated terminal that can be carried by the user.
  • the mobile terminal control unit 110 is composed of an arithmetic processing unit such as a CPU (Central Processing Unit), a memory, an I / O (Input / Output) device, and the like.
  • the mobile terminal control unit 110 functions as, for example, a user information acquisition unit 111 and a solution provision unit 113 by reading and executing a predetermined program, or further, a desired state reception unit 115, a skin image analysis unit 117, and a situation recognition unit. Functions as 119.
  • the user information acquisition unit 111 acquires user information including information obtained from the user's body or movement.
  • the information obtained from the user's body or movement acquired by the user information acquisition unit 111 is, for example, at least one of information about the user's heartbeat, an image of the user's skin, and one or both of the characters and voices input by the user. Two pieces of information.
  • the user information acquisition unit 111 acquires the user's heartbeat via, for example, a heart rate monitor which is an input unit 130.
  • the user information acquisition unit 111 acquires a moving image of the user's skin or a still image in which the user's skin is continuously captured as user information via, for example, a camera which is an input unit 130.
  • the skin image is, for example, an image of the skin of the user's face or an image of the skin of the fingers, but may be an image of the skin of other parts.
  • the user information acquisition unit 111 accepts the input of user information including language information which is one or both of characters and voice by the user, for example, via a touch panel, a microphone, or the like which is an input unit 130.
  • the solution providing unit 113 provides the solution determined by the solution determining unit 313 to the user via the output unit 150.
  • the desired state receiving unit 115 receives input of desired state information indicating one or both of the user's desired emotional state or fatigue state via the input unit 130.
  • the skin image analysis unit 117 analyzes the skin image included in the user information.
  • the situational awareness unit 119 determines whether the user is in the first situation of having the user information acquisition unit 111 acquire the image of the skin of the user's finger or the second situation of causing the user information acquisition unit 111 to acquire the image of the skin of the user's face. recognize.
  • the situational awareness unit 119 accepts the input of the user's own selection of whether it is in the first situation or the second situation, and the user determines the first situation and the second situation according to the accepted selection content. Recognize which situation you are in.
  • the situational awareness unit 119 may recognize whether the user is in the first situation or the second situation based on the current time zone.
  • the input unit 130 is, for example, a video acquisition means such as a camera, an input mechanism for characters such as a touch panel and a keyboard, and a selection result, or a voice input mechanism such as a microphone.
  • the output unit 150 includes, for example, a vibration generation unit 151 such as a vibrator, a display unit 153 such as a liquid crystal display, a voice reproduction unit 155 such as a speaker, and a scent generation unit 157 that generates a scent.
  • a vibration generation unit 151 such as a vibrator
  • a display unit 153 such as a liquid crystal display
  • a voice reproduction unit 155 such as a speaker
  • a scent generation unit 157 that generates a scent.
  • a part of the output unit 150 may be an external device.
  • the vibration generating unit 151 when the vibration generating unit 151 is provided with an external device having a vibration generating function in place of or in addition to the vibrator provided in the mobile terminal 10, the mobile terminal 10 and the external device are provided.
  • the devices are communicably connected to each other, for example by wireless or wired communication.
  • the external device receives a signal for providing the vibration solution from, for example, the mobile terminal 10, and provides the vibration solution to the user according to the signal.
  • the server 30 is, for example, a computer configured to include a server control unit 310 and a server storage unit 330.
  • the server control unit 310 is composed of an arithmetic processing unit such as a CPU, a memory, an I / O device, and the like.
  • the server control unit 310 functions as, for example, a user state information generation unit 311 and a solution determination unit 313 by reading and executing a predetermined program, or further, a heart rate information acquisition unit 315, an autonomic nerve balance acquisition unit 317, and a language information analysis. It functions as a unit 319.
  • the user state information generation unit 311 generates user state information indicating the user state of the user based on the information acquired from the body or movement performed by the user information acquisition unit 111.
  • the user state information generation unit 311 is based on the information on the heartbeat included in the user information, the analysis result by the skin image analysis unit 117, the analysis result by the language information analysis unit 319, and the autonomic nerve balance information. To generate.
  • the solution determination unit 313 determines a solution according to user status information from a plurality of solutions.
  • the heart rate information acquisition unit 315 acquires information on the user's heart rate from the skin image.
  • the autonomic nerve balance acquisition unit 317 acquires autonomic nerve balance information indicating the user's autonomic nerve balance based on the information on the heartbeat included in the user information or the information on the heartbeat acquired by the heartbeat information acquisition unit 315.
  • the autonomic nerve balance acquisition unit 317 acquires the user's autonomic nerve balance information based on the information regarding the characteristics of the language information acquired by the language information analysis unit 319.
  • the language information analysis unit 319 analyzes the language information included in the user information. For example, the language information analysis unit 319 acquires information on the characteristics of user information from the language information.
  • the linguistic information analysis unit 319 uses characteristic words (negative words, etc.) contained in the linguistic information, or, for example, when the user information contains voice, the inflection of the voice is used for the user information. Obtained as information about features.
  • the server storage unit 330 is composed of storage devices such as a ROM (Read Only Memory), a RAM (Random Access Memory), and an HDD (Hard Disk Drive).
  • the server storage unit 330 stores information on a plurality of solutions for improving the user's emotional and / or fatigued states that can be provided to the user, or further, a corresponding dictionary 331, a determination model.
  • a corresponding dictionary 331, a determination model In addition to 333, the conversion model 335, and the reference state information 337, the processing result of the solution providing system of the present embodiment and the data necessary for the processing are stored.
  • the solution information stored in the server storage unit 330 may be digital data itself such as music, voice, video, a predetermined periodic vibration pattern, or code information such as an ID that identifies a predetermined scent. It may be there.
  • a solution that induces the user state to be relaxed, calm, or awake and a state in which the desired state information indicates the user state. It functions as a solution that guides the user state toward the state indicated by the reference state information 337, and the like.
  • the solution stored in the server storage unit 330 includes, for example, a passive stimulus to the user's sense of touch, hearing or smell, and more specifically, a predetermined periodic vibration, music, reading voice, a predetermined scent. , Positive paraphrases corresponding to negative words, or word candidates for paraphrases with a lower degree of negativeness than words.
  • the solution may be, for example, information that encourages the user to breathe or meditate in a predetermined manner.
  • the user's emotions include so-called psychological states such as emotions and negative states, as well as the state of autonomic nervous balance as one of the indicators of whether the person is in an excited state or a relaxed state, and awakening and rest. It is a concept that includes the state of self-awareness by the user such as, calmness, and liberation.
  • the corresponding dictionary 331 associates a characteristic phrase such as a negative phrase included in the linguistic information with, for example, the degree of the user state, which is one or both of the user's emotional and fatigue states, as shown in FIG. It may be a memorized correspondence table, or may be stored in association with a positive paraphrase of a phrase or a paraphrase with a lower degree of negativeness than the phrase.
  • the correspondence dictionary 331 is a correspondence table that stores the intonation of voice and the user state in association with each other.
  • corresponding dictionaries 331 are used when the user state information generation unit 311 generates the user state information or when the solution determination unit 313 determines the solution.
  • the determination model 333 is, for example, a determination model that inputs a characteristic phrase included in linguistic information and outputs a user state, or a determination model that inputs voice intonation and outputs a user state, and is a user state information generation unit 311. Is used to generate user state information.
  • the conversion model 335 is a conversion model in which a negative phrase is input and a positive paraphrase of the phrase or a paraphrase with a lower degree of negativeness than the phrase is output, and the solution determination unit 313 determines the solution. It is used when doing.
  • the reference state information 337 is information indicating a reference of a state in which one or both of the user's emotions or fatigue states are improved, and is, for example, a heartbeat as a reference of a state in which one or both of the user's emotions or fatigue states are improved.
  • the number, heart rate interval, autonomic balance, and emotional or fatigue index values obtained from these data are stored for each user characteristic such as age and gender, or for each time zone such as day and night. ..
  • ⁇ Desired state reception process> When a series of processes are started, first, if necessary, the desired state receiving unit 115 of the mobile terminal 10 accepts the input of desired state information indicating one or both of the user's desired emotional state or fatigue state, and the server 30 receives the input. (Fig. 3 / S110).
  • the desired state receiving unit 115 displays, for example, a plurality of emotion and / or fatigue state options desired by the user on the display of the mobile terminal 10, and allows the user to select the desired state information input.
  • the options displayed by the desired state reception unit 115 may be abstract ones such as "I want to improve my motivation for work” and “I want to improve my resilience and get rid of fatigue", “I want to feel cheerful”, and “Relax”. It may be more specific, such as “I want to feel good”, “I want to be calm”, “I want to be awake”, and “I want to balance the autonomic nerves”.
  • the server 30 receives the desired state information and stores it in the server storage unit 330 (FIG. 3 / S130).
  • the situation recognition unit 119 displays, for example, a selection button for selecting whether the user is in the first situation or the second situation on the display of the mobile terminal 10 and causes the user to select the user. Recognize whether the situation is in the first situation or the second situation.
  • the user information acquisition unit 111 of the mobile terminal 10 acquires the user information and transmits it to the server 30 (FIG. 3 / S150).
  • the user information acquisition unit 111 acquires an image of the user's skin via the camera included in the mobile terminal 10 (FIG. 4 / S151), and the touch panel included in the mobile terminal 10.
  • the input of the selection result of characters and options via the camera, or the input of the voice via the microphone is accepted as linguistic information (FIG. 4 / S153).
  • the user information acquisition unit 111 acquires the skin image
  • the user information acquisition unit 111 is in the first situation in which the user acquires the skin image of the user's fingers based on the recognition result by the situation recognition unit 119.
  • the image of the skin of the fingers is acquired, and the image of the skin of the user's face is acquired when the user is in the second situation of acquiring the image of the skin of the face.
  • the user information acquisition unit 111 acquires information necessary for acquiring information on the heartbeat from the skin image, for example, by using the function of the skin image analysis unit 117 (FIG. 4 / S155).
  • the skin image analysis unit 117 acquires the information necessary for acquiring the information related to the heartbeat
  • the skin image analysis unit 117 is based on the recognition result by the situation recognition unit 119, and when the user is in the first situation, the skin of the user's finger.
  • the image is analyzed to acquire the information necessary for acquiring the information related to the heartbeat
  • the image of the skin of the user's face is analyzed to acquire the information.
  • the skin image analysis unit 117 may be used as a method for the skin image analysis unit 117 to acquire information necessary for acquiring information on the heartbeat from the skin image, and the skin image analysis unit 117 is, for example, an image of the skin. Information on changes in the brightness of each color component of RGB is acquired from a moving image or a still image continuously captured.
  • the user information acquisition unit 111 transmits the information necessary for acquiring the language information and the heartbeat information acquired in this way to the server 30 as user information (FIG. 4 / S157).
  • the user status information generation unit 311 of the server 30 receives the user information (FIG. 3 / S210) and analyzes the information included in the user information such as the information necessary for acquiring the information related to the heartbeat and the language information. (FIG. 3 / S230).
  • the user state information generation unit 311 acquires heartbeat-related information from information necessary for acquiring heartbeat-related information via the heartbeat information acquisition unit 315 (FIG. 5 /. S231).
  • the heart rate information acquisition unit 315 may use, for example, each color of RGB.
  • the user's heartbeat is acquired by analyzing the change in the brightness of a specific color component (for example, G (green)) included in the information on the change in the brightness of the component using a predetermined algorithm.
  • the heart rate information acquisition unit 315 calculates and acquires index values such as CVR-R and CCVTP from the user's heart rate, for example, heart rate, heart rate interval, or these information.
  • the heart rate information acquisition unit 315 calculates a fatigue degree score indicating the user's fatigue state in 0.1 increments between 0 and 10 using a predetermined algorithm from index values such as CVR-R and CCVTP.
  • the heart rate information acquisition unit 315 corresponds to the fatigue state acquisition unit
  • the fatigue degree score corresponds to the fatigue state information.
  • the user status information generation unit 311 uses the function of the language information analysis unit 319 to acquire information on the characteristics of the language information included in the user information (FIG. 5 / S233).
  • the linguistic information analysis unit 319 acquires, for example, characteristic words and phrases (negative words and phrases, etc.) included in the linguistic information as information regarding the characteristics of the linguistic information.
  • the language information analysis unit 319 acquires the intonation of the voice as information regarding the characteristics of the user information.
  • the language information analysis unit 319 may be used as the method for the language information analysis unit 319 to acquire information regarding the characteristics of the language information. That is, for example, the language information analysis unit 319 refers to a dictionary of negative words and phrases stored in advance in the server storage unit 330, extracts negative words and phrases included in the words and phrases input or selected by the user, and extracts the negative words and phrases. Obtained as information on the characteristics of language information.
  • the language information analysis unit 319 divides the voice data included in the user information into syllables, analyzes each syllable, acquires the intonation pattern, and stores the voice data in the server storage unit 330 in advance.
  • characteristic (for example, frequently occurring) intonation patterns are extracted from the voice data included in the user information.
  • the intonation pattern is acquired as information related to the characteristics of linguistic information.
  • the user state information generation unit 311 acquires the autonomic nerve balance information based on the information on the heartbeat and / or the information on the feature acquired from the linguistic information by using the function of the autonomic nerve balance acquisition unit 317 (FIG. 5). / S235).
  • the autonomic nerve balance acquisition unit 317 analyzes the fluctuation of the heartbeat by frequency, and the ratio (LF / HF) of LF (Low Frequency), which is a low frequency component of the fluctuation of the heartbeat, and HF (High Frequency), which is a high frequency component. Value) is acquired as autonomic nerve balance information.
  • LF Low Frequency
  • HF High Frequency
  • the autonomic nerve balance acquisition unit 317 calculates an autonomic nerve balance score indicating the balance of the user's autonomic nerve in 0.1 increments between 0 and 10 using a predetermined algorithm from the autonomic nerve balance information.
  • the user state information generation unit 311 of the server 30 generates user state information indicating the user state of the user based on the analysis result in the user information analysis process (FIG. 3 / S250).
  • the user state information generation unit 311 generates user state information based on the fatigue degree score and the autonomic nerve balance score obtained above.
  • the user state information generation unit 311 uses a matrix table with the fatigue level as the vertical axis and the autonomic nerve balance as the horizontal axis, as shown in FIG. 6, for example, to combine the user fatigue level and the autonomic nerve balance.
  • Information indicating where the matrix table is located is acquired, and the acquired information is used as user status information.
  • the user state information generation unit 311 may use the information indicating where in the matrix table thus acquired and the information obtained by combining the fatigue degree score and the autonomic nerve balance score as the user state information.
  • the sympathetic nerve is dominant toward the right, that is, the autonomic nerve balance is in a state where the mind is tense, and the parasympathetic nerve is dominant toward the left, that is, the autonomic nerve balance is in a relaxed state.
  • the autonomic nerve score is 0 to 3.3, the parasympathetic nerve is predominant, and if the autonomic nerve score is 3.4 to 6.6, the autonomic nerve balance is in a well-balanced state, and 6.7. If it is ⁇ 10.0, the sympathetic nerve is in a dominant state. If the fatigue score is 0 to 3.3, the fatigue level is low, if it is 3.4 to 6.6, the fatigue level is medium, and if it is 6.7 to 10.0, the fatigue level is high. And.
  • the parasympathetic nerve When the parasympathetic nerve is dominant and the fatigue level is moderate to low, it is an excessively relaxed state (over-relax), and when the sympathetic nerve is dominant and the fatigue level is medium to low. If it is, it is an excessive-active state, and if the degree of fatigue is high, it is a dangerous state (dangerous). Among them, if the autonomic nerves are balanced, it is a state of caution (caution).
  • FIG. 6 shows that the user state is the “caution” state.
  • the solution determination unit 313 of the server 30 determines the solution according to the user state information and transmits it to the mobile terminal 10 (FIG. 3 / S270).
  • the combination of the degree of fatigue and the autonomic nerve balance and the correspondence table with the solution are stored in advance in the server storage unit 330, and the solution determination unit 313 performs the correspondence.
  • the solution determination unit 313 performs the correspondence.
  • a solution or a combination of solutions corresponding to the combination of the fatigue degree obtained as described above and the autonomic nerve balance is obtained.
  • the solution determination unit 313 is a combination of vibration and voice.
  • the voice the combination of the 6-minute solution in which the narration (reading voice) is played first and then the music is played is determined as the solution according to the user status information.
  • the solution determination unit 313 guides the user's emotional or fatigue state toward the state indicated by the desired state information. decide. That is, for example, if the user state is "caution” and the user's desired state information is "to improve resilience and relieve fatigue", the user state can be guided toward "me-normal” or "me-fullness".
  • the solution to be provided to the user is determined by selecting the solution from the solutions stored in the server storage unit 330.
  • the solution determination unit 313, moves the user state to a relaxed state, that is, a state in which the current autonomic nerve balance becomes more parasympathetic-dominant. It may be configured to determine the solution to guide.
  • the solution determination unit 313 induces the user state to move toward a calm state, that is, a state in which the current autonomic balance is more parasympathetic-dominant, at a speed higher than that of a solution that induces a relaxed state. It may be configured to determine the solution, or it may be configured to determine the solution that induces the user's state to be awake, that is, the current autonomic balance towards a more sympathetic predominant state. good.
  • the solution determination unit 313 uses the user state and reference state information. Based on 337, it may be configured to determine a solution that guides the user state towards the state indicated by the reference state information 337.
  • the solution determined by the solution determination unit 313 may be a positive paraphrase corresponding to a negative phrase or a paraphrase candidate having a lower degree of negativeness than the phrase.
  • the solution determination unit 313 uses a corresponding dictionary of negative words and phrases contained in linguistic information and words and phrases that are positive paraphrases of words and phrases or paraphrase words that are less negative than words and phrases.
  • a positive paraphrase corresponding to a common phrase or a paraphrase candidate with a lower degree of negativeness than the phrase is determined as a solution.
  • the solution determination unit 313 refers to the corresponding dictionary as shown in FIG. 2, and the degree of emotion of the phrase "sad". Recognizes that at the point "-99", the corresponding paraphrase phrase is "painful” or "inviting tears”. Then, the solution determination unit 313 recognizes that, for example, if the phrase "sad” appears multiple times in the linguistic information, it is highly necessary to lower the degree of emotion, and the "-28" point, which has a lower degree of emotion, is "-28". Select "Invite tears” as a paraphrase candidate with a low degree of negativeness, and decide it as a solution.
  • the solution determination unit 313 refers to the corresponding dictionary as shown in FIG. 2 and uses the positive paraphrase phrase “gutari” corresponding to "gutari” as “gutari”. Recognize that there are things such as “it is fulfilling” and “it is a place to show your arms”. Then, depending on the content of the linguistic information, words and phrases are appropriately selected from these and determined as a solution.
  • the solution determination unit 313 executes the above process each time a user inputs characters via the input unit 130 of the mobile terminal 10 and performs a character conversion operation, and transmits the selected phrase as a solution to the mobile terminal 10. do.
  • the solution providing unit 113 of the mobile terminal 10 displays, for example, the selected phrase at the top of the list of conversion candidates in the solution providing process described later.
  • the solution determination unit 313 inputs a negative phrase and outputs a positive paraphrase of the phrase or a paraphrase with a lower degree of negativeness than the phrase.
  • a transformation model may be used to determine paraphrase word candidates.
  • the solution providing unit 113 of the mobile terminal 10 receives the solution (FIG. 3 / S310) and provides the received solution to the user (FIG. 3 / S330).
  • the solution providing unit 113 has a predetermined periodic period via the vibration generating unit 151, the display unit 153, the voice reproduction unit 155, and the scent generating unit 157, depending on the content of the solution received from the server 30.
  • tactile stimuli such as vibration
  • auditory stimuli such as music, reading voice, natural sounds (bird's voice, babbling of streams, etc.)
  • passive stimuli such as olfactory stimuli such as predetermined scents, and negative phrases.
  • the solution providing unit 113 causes the voice reproduction unit 155 to play the music.
  • the solution providing unit 113 generates the scent corresponding to the ID in the scent generating unit 157.
  • the solution provided by the solution providing unit 113 may be configured to be a stimulus of any or a combination of music, reading voice, and vibration. Further, the solution providing system of the present embodiment may be configured to repeat these series of processes periodically or irregularly.
  • the user information acquisition unit 111 acquires user information again after the solution is provided to the user
  • the user status information generation unit 311 acquires the user information based on the information including the user information acquired after the solution is provided to the user.
  • the state information may be regenerated, and the solution determination unit 313 may be configured to determine a solution according to the regenerated user state information.
  • the solution providing system of the present invention may be mounted and used on a moving body such as an automobile.
  • the user information acquisition unit 111 relates to an image of the face of the driver or passenger of the automobile, an image of the skin of the fingers, and the heartbeat, for example, via one or both of a camera and a heart rate monitor installed in the automobile.
  • the user state information generation unit 311 generates user state information of the driver or a passenger based on the acquired information.
  • the solution determined by the solution determination unit 313 is information according to the user state, for example, information for urging the user to take a break, predetermined periodic vibration according to the user state, or a combination thereof.
  • the solution providing unit 113 provides the driver or a passenger with a predetermined periodic vibration according to the user state via, for example, a vibration generating unit installed on one or both of the steering wheel portion and the seat of the automobile. ..
  • the vibration generating portion may be built in the handle portion or the seat, or may be a retrofit device.
  • a scent according to the user's condition may be provided as a solution.
  • break instructions can be appropriately given according to emotional states such as stress and fatigue of the driver or passenger, and vibration is transmitted from the handle or seat during breaks to recover from stress and fatigue. Prompted. Especially for the driver, the decrease in concentration due to stress and fatigue associated with driving is prevented.
  • the solution providing system of the present invention may be used in a medical institution such as a hospital or a dental clinic.
  • the user information acquisition unit 111 relates to the image of the face of the user who is the patient, the image of the skin of the fingers, and the heartbeat, for example, via one or both of the camera and the heart rate monitor installed in the examination room of the medical institution. Get user information including information.
  • the user condition information generation unit 311 generates the patient user condition information based on the acquired information
  • the solution providing unit 113 uses the vibration generation unit installed on the examination table of the medical institution to generate the patient's user condition information. It provides the patient with a predetermined periodic vibration according to the user status information.
  • the cycle at the start of a predetermined periodic vibration according to the user state is, for example, substantially synchronized with the patient's heartbeat, and then the vibration of the vibration pattern in which the cycle is gradually lengthened is determined as a solution.
  • treatment in a medical institution becomes easier by reducing anxiety and tension. It can also be expected that the pain felt by the patient due to the treatment will be alleviated by reducing the tension.
  • the solution providing system of the present invention may be used in an educational institution such as a school.
  • the user information acquisition unit 111 may use one or both of the camera and the heart rate monitor provided in the tablet terminal used for school students, etc., to image the face of each student, the skin of the fingers, and the heart rate. Get user information, including information about.
  • the user status information generation unit 311 generates user status information of the student or the like based on the acquired information
  • the solution providing unit 113 uses the tablet terminal and the vibration generation unit installed in the seat where the student is seated. Through, a predetermined periodic vibration according to the user status information of the student or the like is provided to the patient.
  • the autonomic nerve balance acquisition unit may analyze the autonomic nerve state of each person based on the user information.
  • the solution determination unit 313 gives different stimuli to the sympathetic-dominant student and the parasympathetic-dominant student according to the analysis result of the autonomic nerve, and all the students have the sympathetic nerve and the parasympathetic nerve. Determine a predetermined periodic vibration solution to induce a balanced state of the.
  • the solution providing unit 113 provides the student with a predetermined periodic vibration according to the user status information of the student via the tablet terminal and the vibration generating unit installed in the seat where the student is seated.
  • the solution providing system of the present invention may be used in a rest spot of an office building or the like.
  • the user information acquisition unit 111 is provided in a terminal installed in a break spot of an office building, and acquires user information of a person who works in the office building.
  • the solution determination unit 313 determines the solution according to the user's condition and provides it to the user via the solution provision unit 113 installed in the rest spot of the office building.
  • the solution determined by the solution determination unit 313 includes, for example, music, audio, video, scent, vibration, brightness and color of lighting provided in the rest spot.
  • the user information acquired by the user information acquisition unit 111 and the user status information generated by the user status information generation unit 311 are accumulated and transmitted to the manager of the office of the person who works in the office building at any time. good.
  • the present invention it is possible to effectively improve the stress state and the fatigue state during the break time in the rest spot according to the stress state and the fatigue state of the person working in the office building, and these persons. It is convenient for the manager of our office because it can visualize the stress state and fatigue state of the worker.
  • ⁇ Application to electrical equipment with vibration function> For example, in order for office workers to refresh themselves during breaks, it is conceivable to relax the stiffness of facial muscles with a facial device having a vibration function. It is effective to relax once to maintain concentration, but it is even better if you can change your mind after using the facial equipment so that you can start working immediately.
  • the solution providing system of the present invention may be used together with an electric device such as a facial device having a vibration function.
  • the solution provision system is linked with the timer of the facial equipment, and provides a solution to guide the user to a relaxed state (a state in which the parasympathetic nerve is dominant) in the first half stage such as vibration for facial treatment.
  • a relaxed state a state in which the parasympathetic nerve is dominant
  • the first half stage such as vibration for facial treatment.
  • it is configured to provide a solution for guiding the user to an awake state (a state in which the sympathetic nerve is dominant).
  • the user can be temporarily relaxed, and at the same time, he / she can switch his / her feelings to the awake state for the work after the break so that he / she can start the work immediately.
  • the solution providing system of the present invention may be used together with services in accommodation facilities such as hotels and inns.
  • the user information acquisition unit 111 is provided in a terminal installed at the front of an accommodation facility such as a hotel or an inn, and acquires user information of the facility user such as a guest.
  • the solution determined by the solution determination unit 313 includes the scent provided in the guest room used by the user, the bath salt, the accommodation facility service content including the content of the meal, and the like.
  • the decision result of the solution decision unit 313 is sent to the person in charge of customer service at the hotel or inn, and is reflected in the service content to the user.
  • the present invention it is possible to provide a more comfortable stay experience to the user of the facility and effectively guide the user to a relaxed state, a calm state, an awake state, or a state of recovery from fatigue.
  • the solution providing system of the present invention may be used together with tourism and passenger services.
  • the user information acquisition unit 111 is provided with a means of transportation used by the traveler during the trip, and acquires the user information of the traveler.
  • the solution determined by the solution determination unit 313 includes, for example, music, audio, video, scent, vibration, brightness and color of lighting provided in the cabin of a means of transportation or in a seat.
  • the present invention it is possible to provide a more comfortable travel experience for the traveler and effectively guide the user to a relaxed state, a calm state, an awake state, or a state of recovery from fatigue.
  • the solution providing system of the present invention may be used at an indoor / outdoor event venue such as a planetarium, an aquarium, a movie theater, or a museum or an amusement park.
  • the user information acquisition unit 111 is provided, for example, via a camera and a heart rate monitor provided in a device installed in the event venue or a portable device, or a camera and a heart rate monitor provided in the user's mobile terminal 10.
  • Get user information including information about the user's face, skin images of fingers, and heartbeat.
  • the user state information generation unit 311 generates the user state information based on the acquired information, and the solution providing unit 113 is provided in, for example, a device installed in the event venue or a portable device, or a user.
  • the vibration generation unit included in the mobile terminal 10 of the above a predetermined periodic vibration according to the user state information is provided to the user.
  • the cycle at the start of a predetermined periodic vibration according to the user state is almost synchronized with the user's heartbeat, and then the vibration pattern vibration that gradually increases or decreases the cycle is solved. To be determined as.
  • This is intended to make the user more relaxed or activated by utilizing the pulling effect that the heartbeat cycle is synchronized with the vibration provided to the user.
  • This allows the user to watch with a more relaxed feeling, for example, in a planetarium or an aquarium, or can induce the user's feeling to be activated with the image of an action movie, for example, in a state including the user's mood. You can make changes. In this way, by enabling the solution providing system to be used in combination with a realistic experience, the user's condition can be relaxed, calm, excited, or recovered from fatigue. Can be effectively induced.
  • the experience of the event is made more impressive and good, and the user is effectively guided to a relaxed state, a calm state, an awake state, or a state of recovery from fatigue. be able to.
  • the autonomic nerve balance acquisition unit 317 refers to a correspondence table in which the above-mentioned pattern of intonation of a person's speech and the autonomic nerve balance are associated with each other, and a characteristic intonation pattern extracted from voice data included in user information.
  • the autonomic nerve balance associated with may be acquired as the autonomic nerve balance information.
  • the autonomic nerve balance acquisition unit 317 is output by inputting a characteristic phrase included in the linguistic information into a model that inputs a characteristic phrase included in the linguistic information and outputs the autonomic nervous balance.
  • the autonomic nerve balance may be acquired as the autonomic nerve balance information.
  • the user state information generation unit 311 may use one or both of a dictionary corresponding to a word and a user state and a determination model in which the word is input and the user state is output, based on the characteristic words and phrases contained in the language information. May be used to acquire the user's emotional or fatigued state.
  • the user state information generation unit 311 refers to, for example, a dictionary of correspondence between words and phrases and emotions or fatigue states, and sets an index value indicating the user's emotions or fatigue states corresponding to the characteristic words and phrases contained in the language information. get.
  • the user state information generation unit 311 may use one or both of a dictionary corresponding to the intonation and the user state and a determination model in which the intonation is input and the user state is output, based on the characteristic intonation contained in the linguistic information. May be used to obtain an index value indicating a user's emotional or fatigued state.
  • the user state information generation unit 311 inputs, for example, a characteristic intonation included in the language information into the determination model and acquires an index value indicating the user's emotional or fatigue state output.
  • a negative phrase and a user state are stored in association with each other in the corresponding dictionary 331
  • the present invention is not limited to this. That is, for example, a positive phrase indicating joy or enjoyment, or a phrase indicating relaxation or excitement may be stored in association with the user state.
  • the user information acquisition unit 111 acquires a moving image of the user's face or a still image in which the user's face is continuously captured as user information via a camera, and the language information analysis unit 319 obtains a moving image of the face.
  • the user's emotion score is calculated by acquiring the type and intensity of the user's emotion as characteristic information from the shape and angle of the eyebrows, eyes, nose or mouth included in the image or still image, and the user state information generation unit 311 , May be configured to generate user status information using the emotion score.
  • the solution determination unit 313 may be configured to determine the vibration cycle based on the user state information and the desired state information.
  • the solution determination unit 313 determines the vibration cycle so that the cycle at the start of the vibration is substantially synchronized with the user's current heartbeat based on the information regarding the heartbeat.
  • the solution determination unit 313 determines, for example, a pattern of change in one or both of the period and the intensity after the start of vibration based on the desired state information.
  • the solution determination unit 313 when the solution determination unit 313 should induce a state in which the user's tension is relaxed, such as a relaxed state or a calm state, based on the desired state information, the cycle is gradually set after the start of vibration. Determine the solution to change the cycle to be longer. This induces the user to move the current autonomic balance toward a more parasympathetic-dominant state, resulting in a relaxed and calm state.
  • the solution determination unit 313 gradually shortens the vibration cycle after the start of the vibration, or replaces or additionally, when the user should be guided to the awake state based on the desired state information. Determine the solution to change the cycle so that the strength of the is stronger. As a result, the user is awakened by inducing the current autonomic balance toward a more sympathetic-dominant state.
  • the solution determination unit 313 changes the vibration cycle and intensity so as to guide the user state toward the state indicated by the reference state information based on the reference state information when there is no input of the desired state. Determine the vibration pattern as a solution.
  • the skin image analysis unit 117 of the mobile terminal 10 acquires the information necessary for acquiring the information related to the heartbeat from the skin image
  • the heartbeat information acquisition unit 315 of the user of the server 30 acquires the information related to the heartbeat.
  • the skin image analysis unit 117 or the heartbeat information acquisition unit 315 may acquire information on the heartbeat from the skin image. In that case, one of the skin image analysis unit 117 and the heart rate information acquisition unit 315 is omitted.
  • the user information acquisition unit 111 may acquire the answer to the question about the facial condition, which has a correlation with the emotion or fatigue condition appearing on the user's face, as the user status information.
  • the user information acquisition unit 111 first displays a moving image of the user's face captured by the camera, which is the input unit 130, or a still image of the user's face continuously captured on the display unit 153. , A question about the facial condition, which correlates with the emotion or fatigue condition appearing on the user's face displayed on the display unit 153, is displayed on the display unit 153.
  • the user information acquisition unit 111 accepts the input of the answer by the user to the question via the input unit 130 in a state where the face image is displayed on the display unit 153.
  • the input unit 130 is arranged at a position where the operation can be performed while looking at the question.
  • the answer to the question about the condition of the face may be input by voice or text, or may be input by, for example, letting the user select which of the five grades it corresponds to. Further, the question may be one or more.
  • the user information acquisition unit 111 inputs an answer to the question by the user while showing the image of the user's face reflected in the mirror unit that reflects the user's face, instead of displaying the image of the face on the display unit 153. It may be configured to accept.
  • the display unit 153 is arranged at a position where the user can see the user's face reflected in the mirror unit at the same time, and the input unit 130 operates while looking at the user's face reflected in the mirror unit and the question displayed on the display unit. Is placed in a position where you can do.
  • the solution providing system of this embodiment is a computer system including a mobile terminal 10 and a server 30.
  • the mobile terminal 10 and the server 30 are connected to each other so as to be able to communicate with each other by a communication network 90 such as a mobile phone network.
  • the number of mobile terminals 10 and the number of servers 30 may be plural.
  • the mobile terminal 10 includes a mobile terminal control unit 1110 and an output unit 1130, or further includes an imaging unit 1150, an input unit 1170, and a history storage unit 1190, for example, a smartphone, a tablet terminal, or the like. It is a general-purpose terminal. Alternatively, the mobile terminal 10 may be a dedicated terminal that can be carried by the user.
  • the mobile terminal control unit 1110 is composed of an arithmetic processing device such as a CPU, a memory, an I / O device, and the like.
  • the mobile terminal control unit 1110 functions as, for example, a user information acquisition unit 1111 and a solution providing unit 1113, or further as a display control unit 1115 and a response receiving unit 1117 by reading and executing a predetermined program.
  • the user information acquisition unit 1111 acquires user information including information obtained from the user's body or movement via, for example, the image pickup unit 1150 and the input unit 1170.
  • the solution providing unit 1113 provides the solution determined by the solution determining unit 1313 to the user via the output unit 1130.
  • the display control unit 1115 displays the image of the user's face imaged by the image pickup unit 1150 on the display unit 1133, and displays a question about the state of the user's face displayed on the display unit 1133 on the display unit 1133.
  • the question is a question that has a correlation with the emotion or fatigue state appearing on the user's face.
  • the answer reception unit 1117 accepts the input of the answer by the user to the question about the user's facial condition via the input unit 1170 in a state where the face image is displayed on the display unit 1133.
  • the output unit 1130 includes, for example, a vibration generation unit 1131, a display unit 1133, a voice reproduction unit 1135, and a scent generation unit 1137, and provides a solution to the user under the control of the solution provision unit 1113 and the like. ..
  • the vibration generation unit 1131 is, for example, a vibrator that provides the user with a predetermined periodic vibration when the solution determined by the solution determination unit 1313 includes a predetermined periodic vibration according to the user state information. ..
  • the display unit 1133 is a display that displays the display information and provides it to the user when the display information including information for promoting a predetermined operation or an image for improving the user state is included according to the user state information. ..
  • the voice reproduction unit 1135 is a speaker that reproduces the voice and provides it to the user when the solution includes a human voice, a natural sound, or a voice including music according to the user status information.
  • the scent generation unit 1137 generates a scent and provides it to the user when a predetermined scent according to the user status information is included in the solution.
  • the image pickup unit 1150 is, for example, a camera, and acquires an image of the user's face.
  • the input unit 1170 is, for example, an input mechanism for characters such as a touch panel and a keyboard and selection results, and is used when the answer reception unit 1117 accepts an input of an answer by a user to a question about a user's facial condition.
  • the input unit 1170 is arranged at a position where the operation can be performed while looking at the image of the user's face displayed on the display unit 1133 and the question about the state of the face.
  • the history storage unit 1190 is composed of storage devices such as ROM, RAM, and HDD.
  • the history storage unit 1190 stores the information of the solution provided to the user for a predetermined period or a predetermined number of times, and also stores the information necessary for the processing of the mobile terminal, the processing result of the mobile terminal, and the like. ..
  • the history storage unit 1190 is configured not to store the face image and the user status information included in the user information, for example.
  • the server 30 is, for example, a computer configured to include a server control unit 1310 and a solution storage unit 1330.
  • the server control unit 1310 is composed of an arithmetic processing unit such as a CPU, a memory, an I / O device, and the like.
  • the server control unit 1310 functions as, for example, a user state information generation unit 1311 and a solution determination unit 1313 by reading and executing a predetermined program.
  • the user state information generation unit 1311 generates user state information indicating the user state of the user based on the information acquired from the body or movement acquired by the user information acquisition unit 1111.
  • the solution determination unit 1313 determines a solution according to the user status information from a plurality of solutions stored in the solution storage unit 1330.
  • the solution storage unit 1330 is composed of storage devices such as ROM, RAM, and HDD.
  • the solution storage unit 1330 contains information on a plurality of solutions that can be provided to the user in order to improve the user condition, which is one or both of the user's emotional and fatigue states, as well as information and solutions necessary for processing the solution providing system. It stores the processing results of the provided system.
  • the solution information stored in the solution storage unit 1330 may be digital data itself such as music, voice, video, a predetermined periodic vibration pattern, or code information such as an ID that identifies a predetermined scent. It may be there.
  • these solutions are provided to the user alone or in combination, they function as a solution for improving the user's emotional and / or fatigued state.
  • the user's emotions include so-called psychological states such as emotions and negative states, as well as the state of autonomic nervous balance as one of the indicators of whether the person is in an excited state or a relaxed state, and awakening and rest. It is a concept that includes the state of self-awareness by the user such as, calmness, and liberation.
  • ⁇ User information acquisition process> When a series of processes are started, first, the user information acquisition unit 1111 of the mobile terminal 10 acquires the user information and transmits it to the server 30 (FIG. 9 / S1110).
  • the user information acquisition unit 1111 acquires an image of the user's face via the image pickup unit 1150 (FIG. 10 / S1111).
  • the display control unit 1115 displays the image of the user's face imaged by the image pickup unit 1150 on the display unit 1133, and displays a question about the state of the user's face displayed on the display unit 1133 on the display unit 1133. (FIG. 10 / S1113).
  • the answer reception unit 1117 accepts the input of the user's answer to the question about the user's face condition via the input unit 1170 with the face image displayed on the display unit 1133. (FIG. 10 / S1115).
  • the answer reception unit 1117 displays, for example, a plurality of questions about the condition of the user's face and answer options in order for each question, and accepts the options selected by the user as answers to the question.
  • the user information acquisition unit 1111 acquires the answer to the question about the facial condition received in this way as the user status information.
  • the answer to the question about the condition of the face may be input by, for example, letting the user select which of the five grades it corresponds to, or may be input by voice or text. Further, the question may be one or more.
  • the user information acquisition unit 1111 analyzes the facial image (FIG. 10 / S1117). That is, for example, the user information acquisition unit 1111 acquires information necessary for acquiring information on the heartbeat from the face image as an analysis result of the face image.
  • the user information acquisition unit 1111 may be used as a method for the user information acquisition unit 1111 to acquire information necessary for acquiring information related to the heartbeat from the face image, and the user information acquisition unit 1111 is, for example, a face image.
  • Information on changes in the brightness of each color component of RGB is acquired from a moving image or a continuously captured still image.
  • the user information acquisition unit 1111 responds to the question about the facial condition of the user who has received the input in this way, and the analysis result of the facial image (for example, RGB which is information necessary for acquiring information about the heartbeat). Information on changes in the brightness of each color component of the above) and is transmitted to the server 30 as user information (FIG. 10 / S1119).
  • the user state information generation unit 1311 of the server 30 receives the user information (FIG. 9 / S1210), and the user information such as the answer by the user to the question about the user's face state and the analysis result of the face image.
  • the information contained in is analyzed (FIG. 9 / S1230).
  • the user state information generation unit 1311 acquires information on the user's heartbeat from the information on the change in the luminance of each color component of RGB, which is the information necessary for acquiring the information on the heartbeat (FIG. 11 / S1231). ).
  • the user state information generation unit 1311 As a method for the user state information generation unit 1311 to acquire information on the user's heartbeat from the information necessary for acquiring the information on the heartbeat, various known methods may be used, and the user state information generation unit 1311 is, for example, RGB.
  • the user's heartbeat is acquired by analyzing the change in the brightness of a specific color component (for example, G (green)) included in the information on the change in the brightness of each color component in the above using a predetermined algorithm.
  • the user status information generation unit 1311 calculates and acquires index values such as CVR-R and CCVTP from the user's heart rate, for example, heart rate, heart rate interval, or these information.
  • the user state information generation unit 1311 uses a predetermined algorithm from index values such as CVR-R and CCVTP to indicate a fatigue state based on the user's heartbeat in 0.1 increments between 0 and 10. Is calculated.
  • the user status information generation unit 1311 acquires the autonomic nerve balance information based on the information related to the heartbeat (FIG. 11 / S1233).
  • the user state information generation unit 1311 analyzes the fluctuation of the heartbeat by frequency, and obtains the ratio (LF / HF value) of the low frequency component LF and the high frequency component HF of the heartbeat fluctuation to the autonomic nerve balance information. Get as.
  • the user state information generation unit 1311 calculates an autonomic nerve balance score indicating the balance of the user's autonomic nerve in 0.1 increments between 0 and 10 using a predetermined algorithm from the autonomic nerve balance information.
  • the user status information generation unit 1311 analyzes the user's answer to the question about the user's facial condition included in the user status information (FIG. 11 / S1235).
  • the user state information generation unit 1311 obtains, for example, a value obtained by adding the values associated with each option selected by the user for each question about the state of the user's face.
  • the signs of fatigue appearing on the user's face are quantified as a quantified fatigue sign score, and the fatigue sign score is determined as an analysis result.
  • the user state information generation unit 1311 generates user state information indicating the user state of the user based on the analysis result in the user information analysis process (FIG. 9 / S1250).
  • the user state information generation unit 1311 uses the combination of the fatigue degree score based on the heartbeat, the autonomic nerve balance score, and the fatigue sign score obtained above as the user state information.
  • the solution determination unit 1313 determines a solution according to the user status information and transmits it to the mobile terminal 10 (FIG. 9 / S1270).
  • a combination of a fatigue degree score based on a heartbeat, an autonomic nerve balance score, and a fatigue sign score and a correspondence table with the solution are stored in advance in the solution storage unit 1330, and the solution determination unit 1313 ,
  • a solution provided to the user by recognizing a solution corresponding to the combination of the fatigue degree score, the autonomic nervous balance score, and the fatigue sign score obtained as described above by referring to the corresponding table. To decide.
  • a predetermined periodic vibration having an effect of lowering the fatigue
  • a human voice a voice including natural sound or music
  • a predetermined scent a predetermined scent
  • the autonomic nerve balance score indicates a state in which the autonomic nerve balance is not well-balanced, for example, the sympathetic nerve or the parasympathetic nerve is excessively dominant
  • a predetermined periodic period having an effect of adjusting the autonomic nerve balance is obtained. Vibration and the like are determined alone or a combination of these according to the user's condition as a solution to be provided to the user.
  • the solution providing unit 1113 receives the solution from the server 30 (FIG. 9 / S1310) and provides the received solution to the user (FIG. 9 / S1330).
  • the solution providing unit 1113 has a predetermined periodic period via the vibration generating unit 1131, the display unit 1133, the voice reproducing unit 1135, and the scent generating unit 1137, depending on the content of the solution received from the server 30.
  • Tactile stimuli such as vibrations, human voices, natural sounds (bird's voice, stream babbling, etc.) or auditory stimuli such as voice including music, olfactory stimuli such as predetermined scents, to improve user status
  • passive stimuli such as visual stimuli such as images, and active stimuli containing information that encourages the user to perform predetermined actions.
  • the solution providing unit 1113 causes the voice reproduction unit 1135 to play the music.
  • the solution providing unit 1113 generates a scent corresponding to the ID in the scent generating unit 1137.
  • the received solution is information that encourages the user to perform a given action, then change at regular intervals, "Let's do a simple mindfulness meditation while feeling the vibration", "Stretch your spine and correct your posture.
  • the display unit 1133 displays a combination of sentences that encourage breathing or meditation in a predetermined motion or in a predetermined manner, such as "Let's relax your shoulders and breathe slowly through your nose", or the voice playback unit 1135. Played by.
  • the user status is considered to improve gradually rather than rapidly. Therefore, it is expected that the solutions of the last few times or the last period will be the same solution.
  • the mobile terminal 10 may be configured to store the solution provided to the user in the history storage unit 1190 for a predetermined period or a predetermined number of times.
  • the solution determination unit 1313 is configured not to transmit the determined solution to the mobile terminal 10 when the determined solution is stored in the history storage unit 1190.
  • the solution provision unit 1113 acquires the determined solution from the history storage unit 1190 and provides the solution to the user. It is composed.
  • Various methods may be adopted as a method for the solution determination unit 1313 to determine whether or not the determined solution is stored in the history storage unit 1190 of the mobile terminal 10.
  • the solution determination unit 1313 stores information specifying a solution determined in the past in the solution storage unit 1330 for a predetermined period or a predetermined number of times.
  • the predetermined period or the predetermined number of times is the same as the period or the number of times stored in the history storage unit 1190 of the mobile terminal 10.
  • the solution determination unit 1313 determines whether or not the solution determined this time matches any of the solutions stored in the solution storage unit 1330, and when the matching solution is stored in the solution storage unit 1330. In addition, it is determined that the determined solution is stored in the history storage unit 1190 of the mobile terminal 10.
  • the solution determination unit 1313 does not send the determined solution to the mobile terminal 10, and instead, the information that identifies which solution the determined solution is stored in the history storage unit 1190. Is transmitted to the mobile terminal 10.
  • the solution providing unit 1113 receives information from the server 30 that identifies which solution is stored in the history storage unit 1190, and transfers the corresponding solution from the history storage unit 1190. Get it and provide it to the user.
  • the server 30 may be omitted, and all the functions described above that the server 30 has may be provided in the mobile terminal 10. That is, the mobile terminal 10 includes a user state information generation unit 1311A, a solution determination unit 1313A, and a solution storage unit 1330A, which are the same as the user state information generation unit 1311, the solution determination unit 1313, and the solution storage unit 1330 described above. It is composed of.
  • the user information acquisition unit 1111 inputs an answer to the question by the user while showing the image of the user's face reflected in the mirror unit that reflects the user's face, instead of displaying the image of the face on the display unit 1133. It may be configured to accept.
  • the display unit 1133 is arranged at a position where the user can see the user's face reflected in the mirror unit at the same time, and the input unit 1170 looks at the user's face reflected in the mirror unit and the question displayed on the display unit 1133. It is placed in a position where it can be operated.
  • the user information acquisition unit 1111 recognizes whether the user is in the first situation where the image of the skin of the fingers should be acquired or the second situation where the image of the skin of the face should be acquired.
  • the user information including the image of the skin of the finger of the user is acquired, and when the user is in the second situation, the user information including the image of the skin of the user's face is acquired. It may be configured as follows.
  • the user state information generation unit 1311A generates user state information based on the image of the user's face acquired by the user information acquisition unit 1111 when the user is in the first situation, and the user is in the second situation.
  • the user state information is generated based on the image of the user's face acquired by the user information acquisition unit 1111.
  • the user information acquisition unit 1111 displays a selection button for selecting whether the user is in the first situation or the second situation on the display of the mobile terminal 10 and causes the user to select the first situation. Recognize whether you are in the 1st situation or the 2nd situation.
  • the user information acquisition unit 1111 may recognize whether the user is in the first situation or the second situation based on the current time zone. That is, for example, the user information acquisition unit 1111 recognizes that it is the first situation in the daytime time zone and the second situation in the night time zone before going to bed.
  • the solution providing system of this embodiment has a function as a state improving device.
  • This state improving device is for giving a vibration stimulus to the user to improve the user's mental and physical condition, and more specifically, providing a vibration stimulus to be the user's mental and physical state, for example. It is a device that promotes improvement of the user's work efficiency, fatigue state, and ease of introducing sleep (hereinafter referred to as "user state").
  • the state improving device includes a device control unit 2010, a storage unit 2020, and a stimulus generation unit 2030, or further includes an image pickup unit 2050, a display unit 2070, and an input unit 2090.
  • a general-purpose device such as a smartphone or a tablet may be used, but a dedicated terminal may be used.
  • a part of the mechanism constituting the state improving device such as the stimulus generation unit 2030 may be provided as an external device separated from the main body of the state improving device.
  • the device control unit 2010 is composed of an arithmetic processing device such as a CPU, a memory, an I / O device, and the like.
  • the device control unit 2010 of the present embodiment functions as, for example, a heartbeat recognition unit 2110 and a stimulus content determination unit 2130 by reading and executing a predetermined program, or further, an autonomic nerve state recognition unit 2150 and a desired state reception unit 2170. , The answer reception unit 2190, the user status information acquisition unit 2210, and the mode reception unit 2230.
  • the state improving device of the present embodiment has functions as a user information acquisition unit, a user state information generation unit, a solution determination unit, and a solution provision unit.
  • the user information acquisition unit acquires information indicating the user's heartbeat as user information, and has a function as the autonomic nerve state recognition unit 2150.
  • the user state information generation unit generates user state information based on the user information, and has functions as the heart rate recognition unit 2110 and the desired state reception unit 2170.
  • the user state information generation unit may be configured to further have a function as an autonomic nerve state recognition unit 2150.
  • the solution determination unit determines the solution to be provided to the user, and has a function as the stimulus content determination unit 2130. Further, the solution providing unit provides the solution to the user and has a function as the stimulus generating unit 2030.
  • the heartbeat recognition unit 2110 acquires information indicating the user's heartbeat and recognizes the tempo of the user's heartbeat from the information indicating the heartbeat.
  • the heartbeat recognition unit 2110 recognizes information indicating the user's heartbeat based on, for example, an image of the skin of the user's face or fingers imaged by the image pickup unit 2050.
  • the stimulus content determination unit 2130 determines the tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit 2110 as the stimulus provided to the user, for example, the tempo of vibration and sound. Alternatively, the stimulus content determination unit 2130 determines the content of the stimulus based on the information indicating the user's heartbeat, the sign information included in the user status information acquired by the user status information acquisition unit 2210, or the information regarding the LF / HF value.
  • the stimulus content determination unit 2130 determines the content of information or scent of, for example, sound, characters or images to be provided to the user in combination with vibration which is a stimulus provided to the user.
  • the autonomic nerve state recognition unit 2150 recognizes the state of the user's autonomic nerve.
  • the autonomic nerve state recognition unit 2150 recognizes the state of the user's autonomic nerve based on the information indicating the user's heartbeat acquired by the heartbeat recognition unit 2110, for example.
  • the autonomic nerve state recognition unit 2150 may recognize the state of the user's autonomic nerve based on information indicating the user's respiration, blood pressure, body temperature, sweating, urination, and other states.
  • the desired state reception unit 2170 accepts the user's designation of the desired state indicating the user's desired state, for example, via the input unit 2090.
  • the answer reception unit 2190 accepts the input of the answer by the user to the question regarding the user's facial condition displayed on the display unit 2070, for example, via the input unit 2090.
  • the user status information acquisition unit 2210 acquires user status information including sign information indicating the user status appearing on the user's face based on the response received by the response reception unit 2190. Alternatively, the user status information acquisition unit 2210 acquires user status information including information on the user's LF / HF value based on the information indicating the user's heart rate recognized by the heart rate recognition unit 2110.
  • the mode reception unit 2230 recognizes the user's heart rate based on the image of the skin of the user's face and the second mode of recognizing the heart rate of the user based on the image of the skin of the user's fingers. And, the user's designation of the operation mode including, is accepted, for example, via the input unit 2090.
  • the storage unit 2020 is composed of a storage device such as a ROM, a RAM, or an HDD.
  • the storage unit 2020 is, for example, a vibration, or even a sound, a character, for improving the mental and physical state of the user, such as work efficiency, fatigue state, and ease of introducing sleep (hereinafter referred to as "user state").
  • user state In addition to storing stimulus information consisting of image and scent information, it also stores the processing results of the state improving device and the information necessary for processing the state improving device.
  • the sound is, for example, a human voice, music, a natural sound (including a wave, a wind sound, or a synthetic sound imitating these).
  • the stimulus generation unit 2030 is a mechanism for generating a stimulus at a tempo determined by the stimulus content determination unit 2130 toward the user, and is configured to include a vibration unit 2310 such as a vibrator that generates vibration, or further emits a scent. It is configured to include a scent generating unit 2350 to be generated.
  • the sound reproduction unit 2040 such as a speaker
  • characters and images still image or moving image, etc.
  • the display unit 2070 is used as the stimulus generation unit 2030. Function.
  • the image pickup unit 2050 is, for example, a camera that acquires an image of the user's face, an image of the face or the skin of the fingers.
  • the display unit 2070 is, for example, a display, and displays an image of the user's face imaged by the image pickup unit 2050. Further, the display unit 2070 functions as an output unit that outputs the question to the user when the question regarding the state of the user's face displayed on the display unit 2070 is output as characters or images.
  • the sound reproduction unit 2040 functions as an output unit.
  • the input unit 2090 is, for example, a touch panel that receives input from the user to the state improving device, but may be configured by an input mechanism that is a keyboard, a mouse, or other pointing device.
  • FIG. 21 shows the contents of the overall processing of the state improving device of the present embodiment.
  • the desired state receiving unit 2170 when the process is started, the desired state receiving unit 2170 first receives the user's designation of the desired state indicating the user's desired state (FIG. 21 / S2011).
  • the desired states indicating the user's desired states are, for example, "sympathetic nerve dominant state”, “parasympathetic nerve dominant state”, “work efficiency state”, “fatigue recovery state”, and “sleep introduction”. Although it is "easy to do”, other mental and physical conditions of the user may be adopted as appropriate.
  • the imaging unit 2050 acquires an image of the user's face (FIG. 21 / S2031), and the answer receiving unit 2190 accepts the input of the user's answer to the question regarding the user's facial condition (FIG. 21 / S2033).
  • the display unit 2070 displays the image of the user's face captured by the image pickup unit 2050, and outputs a question regarding the state of the user's face displayed on the display unit 2070 to the user. .. Then, the answer reception unit 2190 accepts the input of the answer by the user to the question regarding the condition of the user's face via the input unit 2090.
  • the question is a question that has a correlation with the mental and physical conditions such as the user's work efficiency, fatigue state, and sleep quality appearing on the user's face. , “Darkness of bears around the eyes”, “Acne or pimples”, “Rising or lowering of the corners of the mouth”, “Moisturizing lips”.
  • the heartbeat recognition unit 2110 recognizes the tempo of the user's heartbeat (FIG. 21 / S2035). For example, the heartbeat recognition unit 2110 acquires information indicating the user's heartbeat based on the image of the skin of the user's face imaged by the image pickup unit 2050. The image of the skin of the user's face may be captured in the process of S2031, and may be captured again at the start of the process of S2035, for example.
  • the heartbeat recognition unit 2110 may use, for example, the skin of the user's face.
  • Information indicating the user's heartbeat is acquired by analyzing the change in the brightness of a specific color component (for example, G (green)) included in the information on the change in the brightness of each RGB color component of the image using a predetermined algorithm. do.
  • the heartbeat recognition unit 2110 recognizes the tempo of the user's heartbeat from the information indicating the heartbeat acquired as described above.
  • the heart rate recognition unit 2110 recognizes, for example, the heart rate per minute (bpm) as the tempo of the user's heartbeat.
  • the user status information acquisition unit 2210 executes a process of acquiring the user status information (FIG. 21 / S2037) as necessary, and the details of the process will be described later.
  • the stimulus content determination unit 2130 determines the tempo of the stimulus to be provided to the user based on the tempo of the user's heartbeat recognized by the heartbeat recognition unit 2110 (FIG. 21 / S2050), and further determines the content of the stimulus as necessary. Is determined (FIG. 21 / S2080). Details of the process for determining the tempo and content of the stimulus will be described later.
  • the stimulus generation unit 2030 for example, the vibration unit 2310 or the sound reproduction unit 2040, generates a stimulus at a tempo determined by the stimulus content determination unit 2130 toward the user (FIG. 21 / S2091). A series of processes of the state improving device of the above is completed.
  • the autonomic nerve state recognition unit 2150 recognizes the state of the user's autonomic nerve (FIG. 22 / S2039).
  • the autonomic nerve state recognition unit 2150 may be used as a method for the autonomic nerve state recognition unit 2150 to recognize the state of the user's autonomic nerve. That is, for example, the user status information acquisition unit 2210 frequency-analyzes the fluctuation of the heartbeat based on the information indicating the heartbeat of the user acquired by the heartbeat recognition unit 2110, and uses the LF and the high-frequency component, which are low-frequency components of the fluctuation of the heartbeat. The ratio (LF / HF value) with a certain HF is acquired as autonomic nerve balance information.
  • the user status information acquisition unit 2210 recognizes the sign information indicating the user's condition appearing on the user's face based on the response received by the response reception unit 2190 (FIG. 22 / S2041).
  • the user status information acquisition unit 2210 outputs a value obtained by adding the values associated with each option selected by the user to each question about the user's face condition on the user's face. It is calculated as the score of the sign of the user status, and the score is recognized as the sign information.
  • the user status information acquisition unit 2210 recognizes information regarding the user's LF / HF value based on the information indicating the user's heart rate recognized by the heart rate recognition unit 2110 (FIG. 22 / S2043).
  • the user state information acquisition unit 2210 recognizes the LF / HF value recognized by the autonomic nerve state recognition unit 2150 as the state of the user's autonomic nerve in S2039.
  • the user status information acquisition unit 2210 determines the autonomic nerve balance score, which is an index of the LF / HF value by a score between 1 and 10. For example, it is determined that the more predominant the sympathetic nerve is, the closer the score is to 1, and the more predominant the parasympathetic nerve is, the closer the score is to 10.
  • the user state information acquisition unit 2210 acquires the score of the sign of the user state and the autonomic nerve balance score recognized in this way as the user state information (FIG. 22 / S2045), and ends the process of acquiring the user state information. do.
  • the stimulus content determination unit 2130 first determines the tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit 2110 as the tempo at the start of the vibration that is the stimulus (FIG. 23 / S2051).
  • tempo synchronized with the tempo of the user's heartbeat does not mean only that it completely matches the tempo of the user's heartbeat. That is, for example, when the tempo of the user's heartbeat is 85 to 89 bpm, 85 bpm is determined as the stimulus tempo. , The recognized tempo may be configured to be determined as the tempo of the stimulus.
  • the stimulus content determination unit 2130 determines the desired state received by the desired state reception unit 2170 (FIG. 23 / S2053).
  • the stimulus content determining unit 2130 is set to increase the speed stepwise, for example, from the start time to the end time of the stimulus. Determine the change in tempo (FIG. 23 / S2055).
  • the stimulus content determination unit 2130 refers to a table as shown in FIG. 24, which is stored in advance in the storage unit 2020, so that the tempo becomes faster from the start time to the end time of the stimulus. Recognize that the tempo at the end is "150% of the tempo of the user's heartbeat" when determining the change.
  • the tempo of the user's heartbeat that is, the tempo at the start of the stimulus
  • 55 bpm ⁇ 150% 82.5 bpm
  • the stimulus content determining unit 2130 is gradually delayed from the start time to the end time of the stimulus, for example.
  • the change in tempo is determined as follows (FIG. 23 / S2057).
  • the stimulus content determination unit 2130 refers to a table as shown in FIG. 24, which is stored in advance in the storage unit 2020, so that the tempo becomes slower from the start time to the end time of the stimulus. Recognize that the tempo at the end is "80% of the tempo of the user's heartbeat" when determining the change.
  • the stimulus content determination unit 2130 determines the change so that the tempo becomes slower from the start time to the end time of the stimulus
  • the stimulus content determination unit 2130 determines a predetermined degree from the tempo of the user's heartbeat recognized by the heart rate recognition unit 2110.
  • the change is determined so that the slow tempo is the tempo at the end of the stimulus and the change is determined so that the tempo becomes faster from the start point to the end point of the stimulus
  • the change is determined so that the tempo at the end of the stimulus is a tempo that is predetermined to be faster than the tempo of the heartbeat.
  • the stimulus content determination unit 2130 determines, for example, a change stored in the storage unit 2020 in advance so that the tempo becomes faster from the start time to the end time of the stimulus with reference to a table as shown in FIG. 24. Recognizing the upper limit of (or the lower limit when determining the change so that the tempo becomes slower from the start to the end of the stimulus), the speed below the predetermined upper limit (or the speed above the lower limit) It may be configured to determine the change so that the tempo of is the tempo at the end of the stimulus.
  • the stimulus content determination unit 2130 determines the tempo at the start and end of the stimulus, and also determines how to change the tempo from the tempo at the start to the end of the stimulus.
  • the stimulus content determination unit 2130 performs the stimulus with a tempo of 65 bpm for 20 seconds and the stimulus with a tempo of 60 bpm for 20 seconds. It is determined that a stimulus with a tempo of 55 bpm is generated for 80 seconds. The length of the stimulus in this case is 120 seconds.
  • the stimulus content determination unit 2130 performs a stimulus with a tempo of 70 bpm for 10 seconds and a stimulus with a tempo of 65 bpm for 20 seconds. It is determined that a stimulus with a tempo of 60 bpm is generated for 20 seconds and a stimulus with a tempo of 55 bpm is generated for 70 seconds. The length of the stimulus in this case is also 120 seconds.
  • the stimulus content determination unit 2130 performs a stimulus with a tempo of 90 bpm for 10 seconds and a stimulus with a tempo of 85 bpm for 10 seconds. , 80 bpm tempo stimulus for 10 seconds, 75 bpm tempo stimulus for 10 seconds, 70 bpm tempo stimulus for 10 seconds, 65 bpm tempo stimulus for 20 seconds, 60 bpm tempo stimulus for 20 seconds, 55 bpm tempo stimulus It is determined that the stimulus is generated for 60 seconds. The length of the stimulus in this case is 150 seconds.
  • the stimulus content determination unit 2130 may determine the length of the stimulus to be different according to the tempo of the user's heartbeat (that is, the tempo at the start of the stimulus).
  • the stimulus content determination unit 2130 may, for example, store the tempo of the user's heartbeat (or the tempo at the start of the stimulus) stored in the storage unit 2020 in advance, how to change the tempo as described above, the length of the stimulus, and the like. With reference to the information indicating the correspondence with , how to change from the tempo at the start of the stimulus to the tempo at the end of the stimulus is determined.
  • the desired state received by the desired state receiving unit 2170 is "a state in which sleep is easily introduced", “a state in which work efficiency is high”, and "a state in which fatigue is recovered” will be described.
  • the stimulus content determining unit 2130 determines the desired state received by the desired state receiving unit 2170 (FIG. 25 / S2053), and the desired state received by the desired state receiving unit 2170 is determined.
  • the tempo change is determined so as to be delayed from the start time to the end time of the stimulus (FIG. 25 / S2059), and the tempo determination process is terminated.
  • the stimulus content determination unit 2130 when the stimulus content determination unit 2130 has a tempo of 65 bpm at the start of the stimulus and the tempo of the end point is 50 bpm, the stimulus content determination unit 2130 performs a stimulus with a tempo of 65 bpm for 30 seconds, 60 bpm. It is determined that the tempo stimulus is generated for 32 seconds, the 55 bpm tempo stimulus is generated for 35 seconds, and the 50 bpm tempo stimulus is generated for 130 seconds.
  • the length of the stimulus in the present embodiment is determined to be about 4 minutes, which is longer than the case where the desired state is "a state with high power efficiency" or "a state in which fatigue is recovered" (described later).
  • the time at which the stimulus is generated at the tempo (65 bpm to 55 bpm) before the tempo at the end of the stimulus (50 bpm in the above case) is longer than the length (30 seconds to 35 seconds) of each stage.
  • the change in tempo is determined so that the length of time (130 seconds) for generating the stimulus at the tempo of is longer.
  • the time during which the stimulus is being provided at the end tempo (130 seconds) is determined to be longer than the sum of the previous times (97 seconds).
  • the magnitude of the change in tempo between each stage, the length of each stage, and the length of the entire stimulus may be appropriately set (the same shall apply hereinafter).
  • the stimulus content determining unit 2130 further determines the autonomic nervous state of the user. Judgment (FIG. 25 / S2061).
  • the stimulus content determination unit 2130 is delayed from the start time to the end time of the stimulus.
  • the change of the tempo is determined so as to be (FIG. 25 / S2063), and the tempo determination process is terminated.
  • the stimulus content determination unit 2130 recognizes that the state of the user's autonomic nerve is in the predominant state of the sympathetic nerve when the user's LF / HF value is 2.0 or more.
  • the stimulus content determination unit 2130 starts the stimulus at a tempo of 65 bpm, and then the time is 2 minutes. It is determined that the tempo is linearly slowed down to 50 bpm with the same deceleration (that is, negative acceleration) to stop the stimulation with the progress of.
  • the autonomic nerve state recognition unit 2150 recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve, the tempo is changed so as to be faster from the start time to the end time of the stimulus. After the determination (FIG. 25 / S2065), the temp determination process is completed.
  • the stimulus content determination unit 2130 recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve when the user's LF / HF value is less than 0.8.
  • the stimulus content determination unit 2130 performs a stimulus with a tempo of 50 bpm for 24 seconds and a stimulus with a tempo of 56.3 bpm. 24 seconds, 62.5 bpm tempo stimulus for 24 seconds, 68.75 bpm tempo stimulus for 24 seconds, 75 bpm tempo stimulus for 24 seconds, that is, increasing the tempo step by step. And decide to stop the stimulation.
  • the stimulus content determination unit 2130 determines the autonomic nervous state of the user (FIG. 26 / S2067).
  • the stimulus content determination unit 2130 is delayed from the start time to the end time of the stimulus.
  • the change in the tempo is determined so as to be (FIG. 26 / S2069), and the tempo determination process is terminated.
  • the stimulus content determination unit 2130 sets the tempo from the start time to the end time of the stimulus when the autonomic nerve state recognition unit 2150 recognizes that the user's autonomic nerve state is in a balanced state. It is decided to maintain (FIG. 26 / S2071), and the tempo determination process is terminated.
  • the stimulus content determination unit 2130 accelerates from the start time to the end time of the stimulus.
  • the change in the tempo is determined so as to be (FIG. 26 / S2073), and the tempo determination process is terminated.
  • the stimulus content determination unit 2130 recognizes that the state of the user's autonomic nerve is in the predominant state of the sympathetic nerve when the user's LF / HF value is 2.0 or more.
  • the content of determining the tempo of the stimulus in this case is, for example, the same as in the case of FIG. 25 / S2063 described above.
  • the stimulus content determination unit 2130 recognizes that the state of the user's autonomic nerve is in a balanced state when the user's LF / HF value is 0.8 or more and less than 2.0. Then, it is determined that the stimulus at the tempo at the start of the stimulus (for example, 60 bpm) is generated for 120 seconds.
  • the stimulus content determination unit 2130 recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve when the user's LF / HF value is less than 0.8.
  • the content of determining the tempo of the stimulus in this case is, for example, the same as in the case of FIG. 25 / S2065 described above.
  • the stimulus content determination unit 2130 determines the tempo of the vibration and sound included in the stimulus provided to the user. Determine the tempo so that they synchronize with each other.
  • the tempo at the start of the vibration and the sound is synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit 2110, and the end of the vibration and the sound. Both tempos at the time points are the same tempo determined by the stimulus content determination unit 2130.
  • the tempo at the start of the sound is the same as the tempo of the vibration at the time when the sound is started. It is determined by the determination unit 2130.
  • these tempos are determined by the stimulus content determination unit 2130 so that the tempo of the vibration and the sound are synchronized.
  • the stimulus content determination unit 2130 determines whether or not one or both of the sign information and the autonomic nerve state information included in the user state information is in a predetermined state (FIG. 27 / S2083), and the user When one or both of the sign information and the autonomic nerve state information included in the state information are in a predetermined state, it is a predetermined action to be performed during the generation of the stimulus, and the user's work efficiency is improved, the fatigue state is improved, and so on. Information that encourages the user to take actions that have an effect of improving the physical and mental condition of the user, such as promoting sleep, is determined (FIG. 27 / S2085).
  • the stimulus content determination unit 2130 is, for example, when the autonomic nerve balance score included in the user state information is 4 or less and the score of the sign of the user state is 6 or more (that is, the user whose sympathetic nerve is dominant and appears on the face). When the condition is good in view of the signs of the condition), it is determined that the user is in the predetermined condition, and in other cases, it is determined that the user is not in the predetermined condition.
  • the stimulus content determination unit 2130 refers to, for example, information previously stored in the storage unit 2020 indicating the correspondence between one or both of the autonomic nerve balance score and the user state sign score and whether or not the user is in a predetermined state. Then, it is determined whether or not the user is in a predetermined state.
  • the stimulus content determination unit 2130 determines the content of the stimulus based on one or both of the sign information and the autonomic nervous system state information included in the user state information.
  • the stimulus content determination unit 2130 provides information that prompts the user to perform a predetermined action during the generation of the stimulus when one or both of the symptom information and the autonomic nervous state information included in the user state information are not in a predetermined state. Do not execute the process to determine.
  • the vibration unit 2310 (and the sound reproduction unit 2040) generates the stimulus toward the user.
  • the information determined by the stimulus content determination unit 2130 is output over all or part of the time.
  • the display unit 2070 displays the character or image and the character or image is concerned.
  • the sound reproduction unit 2040 outputs the voice by reproducing the voice.
  • the stimulus content determination unit 2130 determines the image information or the content of the scent to be provided to the user in combination with the vibration stimulus, based on the information indicating the user's heartbeat acquired by the heartbeat recognition unit 2110 as needed.
  • the image information or scent provided to the user in combination with the stimulus is, for example, an image or scent corresponding to the desired state received by the desired state receiving unit 2170. That is, for example, when the desired state is the predominant state of the sympathetic nerve, the image or scent that can image the predominant state of the sympathetic nerve is determined from the list of images or scents stored in advance in the storage unit 2020. Selected by unit 2130.
  • the imaging unit 2050 is configured to capture an image of the skin of the fingers in addition to or in place of the image of the skin of the user's face
  • the heartbeat recognition unit 2110 is the image of the user's fingers imaged by the imaging unit 2050. It may be configured to recognize information indicating the user's heartbeat based on an image of the skin.
  • condition improvement device There are various situations in which users who want to use the condition improvement device are placed. For example, if you use the condition improvement device before going to bed at home at night or when the user is alone, there is not much resistance to taking the image of the face and acquiring the user's heartbeat from the image of the skin of the face. It is thought that it will not occur. However, if the condition improving device is used in a public place such as a workplace or a place where the person is out in the daytime, he / she may be reluctant to take an image of the face and hesitate to use the condition improving device.
  • the user can specify whether to acquire the image of the skin of the face or the image of the skin of the finger, so that the state improving device according to the situation in which the user is placed can be used. You can choose how to use it, which is convenient.
  • the desired state receiving unit 2170 accepts the designation of the desired state (FIG. 28 / S2011), and then the mode receiving unit 2230 accepts the designation of the operation mode (FIG. 28 / S2013).
  • the operation mode is a first mode that recognizes the tempo of the user's heartbeat based on the image of the skin of the user's face, and a second mode that recognizes the tempo of the user's heartbeat based on the image of the skin of the user's fingers.
  • the mode is a first mode that recognizes the tempo of the user's heartbeat based on the image of the skin of the user's face, and a second mode that recognizes the tempo of the user's heartbeat based on the image of the skin of the user's fingers.
  • the mode reception unit 2230 determines whether the designated mode is the first mode or the second mode (FIG. 28 / S2015).
  • the processing after S2031 is executed. Since the content of the process is the same as that in FIG. 21, the description thereof will be omitted.
  • the image pickup unit 2050 first acquires an image of the skin of the user's finger (FIG. 28 / S2131), and the heart rate recognition unit 2110 images the image with the image pickup unit 2050.
  • Information indicating the user's heartbeat is acquired based on the image of the skin of the user's finger (FIG. 28 / S2133).
  • the heartbeat recognition unit 2110 acquires information indicating the user's heartbeat from the image of the skin of the user's fingers by the same method as the method of acquiring the information indicating the user's heartbeat from the image of the skin of the user's face, for example.
  • the heartbeat recognition unit 2110 recognizes the tempo of the user's heartbeat from the information indicating the heartbeat acquired as described above (FIG. 28 / S2135), and the user state information acquisition unit 2210 acquires the user state information (FIG. 28 / S2135). FIG. 28 / S2137).
  • the stimulus content determination unit 2130 determines the tempo of the stimulus to be provided to the user based on the tempo of the user's heartbeat recognized by the heartbeat recognition unit 2110 (FIG. 28 / S2150), and further determines the content of the stimulus as necessary. Is determined (FIG. 28 / S2180).
  • the solution providing system of the present embodiment has a function as an analysis system for analyzing a user's fatigue state, and the configuration of this analysis system will be described below with reference to FIG. 29.
  • the analysis system of the present embodiment is a computer system composed of a user terminal 3001 and a server 3002, and between the user terminal 3001 and the server 3002, for example, wirelessly or wiredly. It is connected by the communication network NW of. Although only one user terminal 3001 and one server 3002 are shown in FIG. 29, a plurality of user terminals 3001 and servers 3002 may be provided.
  • the user terminal 3001 is, for example, a smartphone, a tablet or other computer including a display unit 3010, an input unit 3030, an image pickup unit 3050, and a terminal control unit 3070a.
  • the user terminal 3001 may further include a speaker 3110 that outputs sound information and a vibrator 3130 that generates vibration.
  • the display unit 3010 is, for example, a display for the user terminal 3001 to display information toward the user.
  • the input unit 3030 is, for example, a touch panel for receiving input of information such as operation contents by the user, but may be a keyboard, a mouse, or other pointing device.
  • the image pickup unit 3050 is a camera that captures an image of the user's face.
  • the terminal control unit 3070a is composed of a CPU, a memory, an I / O device, and the like.
  • the arithmetic processing unit (processor) of the terminal control unit 3070a functions as, for example, an output control unit 3710 and an input reception unit 3730 by reading and executing a predetermined program.
  • the output control unit 3710 displays the image of the user's face imaged by the image pickup unit 3050 on the display unit 3010, and also contains information on a question regarding the state of a predetermined portion of the user's face displayed on the display unit 3010 and the user.
  • Information prompting the input of emotional information indicating the content of the emotion held by the user himself / herself with respect to the image of the face of the user is output to the display unit 3010.
  • the input reception unit 3730 is in a state where the image of the user's face captured by the image pickup unit 3050 is displayed on the display unit 3010 by the output control unit 3710, and the information of the answer to the question and the emotional information are displayed via the input unit 3030. Accept input.
  • the user terminal 3001 of the present embodiment has a function as a user information acquisition unit.
  • This user information acquisition unit acquires user information as user information, and has functions as the display unit 3010, the input unit 3030, the image pickup unit 3050, the output control unit 3710, and the input reception unit 3730 described above. There is.
  • the server 3002 is a computer including a server control unit 3070b and a storage unit 3090.
  • the server control unit 3070b is composed of an arithmetic processing unit (processor) such as a CPU, a memory, an I / O device, and the like.
  • the server control unit 3070b functions as, for example, a subjective fatigue state information acquisition unit 3750 by the arithmetic processing device reading and executing a predetermined program, or further, as an objective fatigue state information acquisition unit 3770 and a determination unit 3790. Function.
  • the subjective fatigue state information acquisition unit 3750 is predetermined from the information of the answer to the question and the emotional information indicating the content of the emotion that the user has with respect to the image of the user's face, which is received by the input reception unit 3730 of the user terminal 3001. Obtain a value that indicates the degree of subjective fatigue that the user feels, which is calculated by the method.
  • the objective fatigue state information acquisition unit 3770 acquires information on the user's heart rate by a predetermined means, and the heart rate state information indicating the state of the user's heart rate calculated by a predetermined method from the information on the heart rate and the user's autonomic state.
  • the autonomic nerve balance information indicating the nerve balance is acquired, and the user's objective fatigue level information is acquired based on the heartbeat state information and the autonomic nerve balance information.
  • the determination unit 3790 makes the user recognize the user's subjective fatigue state or improves the user's subjective fatigue state with the information combining the value indicating the degree of the user's subjective fatigue state and the emotional information.
  • the fatigue recognition improvement information corresponding to the combined information is determined with reference to the fatigue recognition improvement information consisting of the information for the purpose and the information indicating the correspondence relationship.
  • the fatigue recognition improvement information is, for example, a first comment consisting of word information indicating the user's subjective fatigue state, a second comment consisting of word information indicating the user's objective fatigue state, and user subjectivity. It is improvement content which is information for improving a general fatigue state and an objective fatigue state.
  • the storage unit 3090 is composed of a storage device such as a ROM, RAM, or HDD.
  • the storage unit 3090 stores information necessary for processing of the analysis system, processing results of the analysis system, and the like, in addition to the content database (DB) 3910 that stores a plurality of improved contents.
  • DB content database
  • the server 3002 has a function as a user status information generation unit and a solution determination unit.
  • This user state information generation unit generates user state information based on the user information, and has functions as the subjective fatigue state information acquisition unit 3750 and the objective fatigue state information acquisition unit 3770 described above.
  • the solution determination unit determines the solution to be provided to the user, and has the function as the determination unit 3790 described above.
  • FIG. 30 shows an embodiment when the above configuration is provided in the user terminal 3001.
  • the server 3002 may be omitted and only the user terminal 3001 may be configured.
  • the image pickup unit 3050 of the user terminal 3001 captures an image of the user's face (FIG. 31 / S3011).
  • the output control unit 3710 of the user terminal 3001 displays the image of the user's face imaged by the image pickup unit 3050 on the display unit 3010, and asks a question regarding the state of a predetermined portion of the user's face displayed on the display unit 3010.
  • Information is displayed on the display unit 3010 (FIG. 31 / S3013).
  • the information in the question about the condition of a given part of the user's face is, for example, whether they look tired eyes, whether they look like their mouth corners are down, and they feel their complexion is dull. It contains information asking about the condition of the face, which correlates with the fatigue condition appearing on the user's face displayed on the display unit 3010, such as whether the face is stiff and difficult to move. ..
  • the output control unit 3710 displays the information of these questions in order on the display unit 3010, for example, and the input reception unit 3730 sequentially receives the information of the answers to these questions (FIG. 31 / S3015).
  • the input reception unit 3730 accepts the information of the answers to these questions, for example, by letting the user select the magnitude of the degree to which he / she feels that it applies to the state asked in each question from the five-grade evaluation of 1 to 5.
  • the magnitude of the degree indicates that, for example, 1 is the smallest and 5 is the largest.
  • the output control unit 3710 displays the image of the user's face captured by the image pickup unit 3050 on the display unit 3010, and the user's own emotions toward the image of the user's face displayed on the display unit 3010.
  • Information indicating the content of the above is displayed on the display unit 3010 (FIG. 31 / S3017), and the input reception unit 3730 accepts the input of the emotion information (FIG. 31 / S3019).
  • Information that prompts the input of emotional information that indicates the content of the emotion that the user has on the image of the user's face is, for example, a display such as "What kind of words do you say when you look at your face?" This is information that prompts the user displayed in the unit 3010 to input information of words that the user himself / herself wants to say, such as words of encouragement or comfort that are suitable for improving the fatigue state that the user himself / herself is aware of.
  • the input reception unit 3730 says “I did my best!, “It was a good day”, “Let's do my best tomorrow", “I'm tired ", “It was painful " ⁇
  • the input of emotional information is accepted.
  • the input receiving unit 3730 receives input of answer information and emotion information to a question via the input unit 3030 in a state where the image of the user's face captured by the imaging unit 3050 is displayed on the display unit 3010. ..
  • the input reception unit 3730 of the user terminal 3001 transmits the answer information and the emotion information to the question to the server 3002 via, for example, the communication network NW.
  • the subjective fatigue state information acquisition process (FIG. 31 / S3030) for acquiring a value indicating the degree of the subjective fatigue state felt by the user.
  • the objective fatigue state information acquisition process (FIG. 31 / S3050) for acquiring a value indicating the degree of the user's objective fatigue state and the determination process (FIG. 31 / S3070) for determining the fatigue recognition improvement information are executed. The contents of these processes will be described later.
  • the subjective fatigue state information acquisition unit 3750, the objective fatigue state information acquisition unit 3770, and the determination unit 3790 of the server 3002 acquire and determine the subjective fatigue state information, the objective fatigue state information, and the fatigue recognition improvement information in the user terminal 3001. Send to.
  • the output control unit 3710 of the user terminal 3001 outputs the subjective fatigue state information and the objective fatigue state information received from the server 3002 by displaying them on the display unit 3010 (FIG. 31 / S3091), and also outputs the fatigue recognition received from the server 3002.
  • the improvement information is provided to the user (FIG. 31 / S3093), and the series of processes is completed.
  • FIG. 32 is an output image of a screen for displaying subjective fatigue state information and objective fatigue state information and providing fatigue recognition improvement information to the user.
  • the user's subjective fatigue level is output as "mental health level” and the user's objective fatigue level is output as “physical health level” will be described.
  • the subjective fatigue state information is a display showing how many points out of a maximum of 10 points as a mental health SF, and a display showing the points depending on how much the heart mark is satisfied. It is converted to and displayed.
  • the objective fatigue state information is converted into a display showing how many points out of 10 points are given as the physical health OF, and a display showing the points depending on how much the humanoid mark is satisfied. Is displayed.
  • first comment Com1 consisting of verbal information indicating the user's subjective fatigue state
  • second comment Com2 consisting of verbal information indicating the user's objective fatigue state
  • the information of the comprehensive comment Com3 that comprehensively evaluates the subjective and objective fatigue state as shown at the top of the screen (for example, "I am in a state where I do not have to worry that my mind and body are satisfied", "The body is I'm a little tired, but my heart is a little tired and I should be careful.
  • one of the first comment Com1 and the second comment Com2 may be displayed.
  • buttons B1 for providing the improved content determined by the determination unit 3790 are displayed.
  • Button B1 may be prepared.
  • the output control unit 3710 displays the character information included in the fatigue recognition improvement information on the display unit 3010, and the sound information is transmitted via the speaker 3110.
  • the vibration information is provided to the user by generating the vibration via the vibrator.
  • a button B2 for displaying a more detailed analysis result or the like may be displayed.
  • the autonomic nerve balance, the LF / HF value, the CVR-R (coefficient of variation R-R interval) value, and the like may be displayed.
  • the subjective fatigue state information acquisition unit 3750 scores the answer information and the emotional information for the question received from the user terminal 3001 as the user's subjective fatigue level by a predetermined method.
  • the subjective fatigue state information acquisition unit 3750 uses a value obtained by calculating the total value (5 to 20) of the five-grade evaluations for which input is accepted as the degree of feeling that it applies to the state asked in each question as an answer to the question.
  • the score is based on the score, and for emotional information, the score associated with the word selected by the user in advance (for example, "I did my best! Is 10 points, "It was a good day” is 8 points, and so on. ⁇ ⁇ ”Is 0 points, etc.) as a score (0 to 10) based on emotional information.
  • the balance between the weighting of the score related to the answer to the question and the score related to the emotional information and the score associated with each word selected by the user were determined by the inventors during the development of the analysis system of the present invention. In the experiment conducted, the balance and the score, which were highly convinced by the user, were adopted and set, so that the setting has a certain degree of reproducibility with respect to the convincing feeling of the user.
  • the contents of the experiment are (1) a value obtained by dividing the score based on the answer to the question by 0.2 and converting it to 100 points, and (2) the score based on the answer to the question and the score based on the emotional information.
  • the subjective fatigue state information acquisition unit 3750 evaluates the score obtained by adding the score based on the answer to the question and the score based on the emotional information on a 10-point scale by a predetermined algorithm, and 10
  • the subjective fatigue state information acquisition unit 3750 transmits the value of the “mental health” acquired in this way to the user terminal 3001 as the value of the user's subjective fatigue degree, and ends the subjective fatigue state information acquisition process. do.
  • the objective fatigue state information acquisition unit 3770 acquires information on the user's heartbeat (FIG. 33 / S3051).
  • a method for acquiring information on the user's heartbeat various well-known methods may be arbitrarily adopted.
  • the user's face image captured by the image pickup unit 3050 of the user terminal 3001 may be used. Get information about your heartbeat.
  • the change in the luminance of each color component of RGB is obtained from a plurality of still images or moving images of faces continuously captured by the input receiving unit 3730 for a certain period of time (for example, for 30 seconds) by the input receiving unit 3730. Get information. Then, the input reception unit 3730 transmits information on the change in luminance of each color component of RGB based on the acquired image of the user's face to the server 3002.
  • the information transmitted by the input reception unit 3730 to the server 3002 may be information on the change in the luminance of the color component of a specific color (for example, G) based on the image of the user's face.
  • the objective fatigue state information acquisition unit 3770 Upon receiving the information, acquires the user's heart rate during a certain period as information on the user's heart rate from the information on the change in the brightness of each color component of RGB based on the image of the user's face. ..
  • the objective fatigue state information acquisition unit 3770 acquires heart rate state information indicating the user's heart rate state from the user's heart rate information (FIG. 33 / S3053).
  • the objective fatigue state information acquisition unit 3770 acquires, for example, CVR-R, which is information on the fluctuation of the user's heartbeat, as heartbeat state information. This is because the fluctuation of the heartbeat is closely related to the user's objective fatigue state.
  • the objective fatigue state information acquisition unit 3770 acquires the autonomic nerve balance information indicating the user's autonomic nerve balance from the information of the user's heart rate (FIG. 33 / S3055).
  • the objective fatigue state information acquisition unit 3770 autonomously determines the ratio (LF / HF value) of LF, which is a low-frequency component of heartbeat fluctuation, and HF, which is a high-frequency component, obtained by frequency analysis of heartbeat fluctuation. Obtained as nerve balance information.
  • the objective fatigue state information acquisition unit 3770 acquires objective fatigue degree information by a predetermined method from the CVR-R which is the heartbeat state information and the LF / HF value which is the autonomic nerve balance information (Fig.). 33 / S3057).
  • the objective fatigue state information acquisition unit 3770 evaluates the CVR-R value and the LF / HF value on a 10-point scale by a predetermined algorithm, and calculates how many points each of the 10 points is. , The sum of these values is divided by 2 to obtain an average value, and the average value is defined as "physical health".
  • the objective fatigue state information acquisition unit 3770 transmits the value of "body health" acquired based on the heart rate state information and the autonomic nerve balance information to the user terminal 3001 as an objective fatigue state value. Then, the process of acquiring the objective fatigue state information is completed.
  • the determination unit 3790 determines the first comment corresponding to the state of the combination of the subjective fatigue degree information and the emotional information (FIG. 34 / S3071).
  • the determination unit 3790 includes information on the combination of the user's subjective fatigue level value and emotional information, as shown in FIG. 35, which is stored in the storage unit 3090 in advance, and the user's information.
  • the first comment corresponding to the combination information is determined with reference to the information indicating the correspondence between the first comment consisting of the information of words indicating the subjective fatigue state and the information indicating the correspondence.
  • FIG. 35 shows a part of the information showing the correspondence relationship.
  • the determination unit 3790 refers to the information and identifies the first comment corresponding to the combination of the subjective fatigue score and the emotional information.
  • the determination unit 3790 determines the second comment corresponding to the state of the combination of the objective fatigue degree information and the autonomic nerve balance information (FIG. 34 / S3073).
  • the determination unit 3790 includes, for example, information on the combination of the user's objective fatigue level value and the autonomic nerve balance information stored in advance in the storage unit 3090, and the user's objective fatigue state.
  • the second comment corresponding to the combination information is determined with reference to the information indicating the correspondence between the second comment consisting of the information of the words indicating.
  • the image of the information showing the correspondence is the same as the image shown in FIG. 35. That is, for example, in the above-mentioned objective fatigue state information acquisition process, the "body health degree" acquired as an objective fatigue degree value from the CVR-R which is the heartbeat state information and the LF / HF value which is the autonomic nerve balance information. And the state of the LF / HF value which is the autonomic nerve balance information (for example, the first state which is the best state when the LF / HF value is less than 0.8, ... When the LF / HF value is 5 or more. The second comment corresponding to each combination of (such as the fourth state, which is the worst state) is stored in the information indicating the corresponding relationship.
  • the second comment By deciding the second comment with reference to such information, even if the value of "body health" is the same, the second comment depends on the state of the LF / HF value which is the autonomic nerve balance information. Will be different.
  • the determination unit 3790 determines the vibration and sound corresponding to the state of the combination of the user's subjective fatigue degree information and the objective fatigue degree information (FIG. 34 / S3075).
  • the determination unit 3790 determines the mental health score (out of 10 points) acquired in the subjective fatigue status information acquisition process, the physical health score (out of 10 points) acquired in the objective fatigue status information acquisition process, and the like. Refer to the matrix table as shown in FIG. 36, which is divided into 3 groups according to their scores, and which of A to C3 the combination of the user's mental health and physical health corresponds to. Identify.
  • the matrix table of FIG. 36 shows that the state "A" in which both the mental health level and the physical health level of the user are high is the best state.
  • C1 to C3 indicate that either the mental health level or the physical health level of the user is low, and among them, "C3", in which both are low, is the worst state.
  • the determination unit 3790 determines the vibration and sound previously associated with each combination of the user's mental health and physical health identified in this way as the improvement content.
  • the determination unit 3790 relatively shortens the length of vibration included in the improved content if the combination is A. If the combination is B, the vibration length is slightly lengthened, and if it is C1 to C3, the vibration length is the longest. This is because the longer the time for providing the vibration stimulus to a certain extent is, the higher the effect of improving the fatigue state of the user is higher than the case where the length of the time for providing the vibration stimulus is short.
  • the determination unit 3790 changes the content of the sound included in the improved content according to the combination. That is, for example, if the combination is A, the determination unit 3790 considers the content of the sound to be music. If the combination is B, the content of the sound is a combination of music and environmental sounds (bird chirping, river babbling, etc.), or a combination of music and reading voice. This is because it is more effective to improve the user's fatigue state by providing not only music but also environmental sounds and reading voices in combination.
  • the determination unit 3790 determines the content of the sound and the music having the effect of improving the mental health. And.
  • the combination is C2, that is, when the physical health is low and the mental health is medium or high, the determination unit 3790 determines the content of the sound and the music having the effect of improving the physical health. do.
  • the determination unit 3790 sets the content of the sound as music having the effect of improving the mental and physical health.
  • the content of the sound is not limited to the above, and may be a human voice, natural sound, or music.
  • the determination unit 3790 determines the user's subjective fatigue when the user's subjective fatigue state is worse than the predetermined first criterion (Fig. 34 / S3077: Yes).
  • the verbal information for improving the fatigue state is determined (Fig. 34 / S3079) and the user's objective fatigue state is worse than the predetermined second criterion (Fig. 34 / S3081: Yes)
  • the user's objective fatigue state is determined.
  • Determine verbal information to improve objective fatigue Fig. 34 / S3083. This is because, especially when in a high fatigue state, it is better to provide specific verbal information to improve the fatigue state than to provide such verbal information. This is because the improvement effect is high.
  • the determination unit 3790 is a case where the mental health is less than 3, and the physical health is 3 or more, that is, a combination of the mental health and the physical health. Is C1, it is determined that the user's subjective fatigue state is worse than the predetermined first criterion, and the verbal information for improving the user's mental health (subjective fatigue state) is determined. ..
  • Verbal information for improving the user's mental health is, for example, voice-guided or written words that recognize oneself and have self-friendly emotions, so-called self-compassion. Information.
  • the decision unit 3790 refers to the information indicating the correspondence between the emotional information and the verbal information for improving the mental health (subjective fatigue state), and determines the mental health corresponding to the emotional information. Determine verbal information for improvement.
  • the decision unit 3790 determines the information of words that have a particularly high effect of improving the mental health (subjective fatigue state) if the emotional information is "It was painful ", and the emotional information is obtained. If “I'm tired ", determine the information of words that have a high improvement effect, and if the emotional information is "I did my best!, “It was a good day”, “Let's do my best tomorrow", the improvement effect is moderate. Determine the information in the following words:
  • the determination unit 3790 is when the physical health is less than 3, and the mental health is 3 or more, that is, when the combination of the physical health and the mental health is C2. , It is determined that the user's objective fatigue state is worse than the predetermined second criterion, and the verbal information for improving the user's physical health (objective fatigue state) is determined.
  • Verbal information for improving the user's physical health is, for example, audio guide or written verbal information that recognizes and relaxes the tension of one's body, which encourages so-called self-release. Information.
  • the decision unit 3790 refers to the information indicating the correspondence between the autonomic nerve balance information and the information of words for improving the health of the body (objective fatigue state), and the body corresponding to the autonomic nerve balance information. Determine verbal information to improve your health (objective fatigue).
  • the determination unit 3790 determines the information of words that have a particularly high effect of improving the health of the body (objective fatigue state) if the LF / HF value, which is the autonomic nerve balance information, is 5 or more. If the LF / HF value is 2 or more and less than 5, the information of words having a high improvement effect is determined, and if the LF / HF value is less than 2, the information of words having a moderate improvement effect or less is determined.
  • the determination unit 3790 is user-subjective when both mental and physical health are less than 3, that is, when the combination of physical and mental health is C3. Judging that both the fatigue state and the objective fatigue state are worse than the predetermined standard, the user's physical health (objective fatigue state) and mental health (subjective fatigue state) are determined. Determine information in words that are particularly effective in both improvements.
  • the storage unit 3090 contains a plurality of improved contents having different contents, the first, so that the combination with the emotional information, the improved content, the first comment, and the second comment can be determined and provided to the user.
  • the comment and the second comment are stored.
  • the subjective fatigue state information acquisition process or the objective fatigue state information acquisition process may be performed first.
  • the information transmitted by the input reception unit 3730 to the server 3002 is a plurality of still images or moving images of a plurality of faces captured by the image pickup unit 3050, and the image is converted into an image of the user's face.
  • the process of acquiring the information on the change in the luminance of each color component (or the color component of a specific color) of RGB based on the image may be performed by the objective fatigue state information acquisition unit 3770.
  • the improvement content may be vibration only, sound only, or verbal information only.
  • part or all of the fatigue recognition improvement information determined by the determination unit in the determination process may be omitted. In this case, if the speaker 3110 and the vibrator 3130 are unnecessary, they may be omitted.
  • the objective fatigue state information acquisition process may be omitted.
  • the objective fatigue state information acquisition unit 3770 is also omitted, and the information output to the user is a value indicating the degree of the user's subjective fatigue state, and the user is informed of the degree of the user's subjective fatigue state.
  • the fatigue recognition improvement information provided to the user is information for making the user recognize the user's subjective fatigue state or improving the user's subjective fatigue state.
  • the analysis system of the present embodiment may be configured to acquire user information via an input unit and generate user state information based on this user information.
  • User status information generation unit 313, 131, 1313A ... Solution determination unit, 315 ... Heart rate information Acquisition unit, 317 ... Autonomous nerve balance acquisition unit, 319 ... Language information analysis unit, 330 ... Server storage unit, 331 ... Corresponding dictionary, 333 ... Judgment model, 335 ... Conversion model, 337 ... Reference state information, 1115 ... Display control unit , 1117, 2190 ... Answer reception unit, 1150, 2050, 3050 ... Imaging unit, 1190 ... History storage unit, 1330, 1330A ... Solution storage unit, 2010 ... Device control unit, 2020, 3090 ... Storage unit, 2030 ... Stimulation generation unit , 2040 ... Sound reproduction unit, 2110 ...
  • Heart rate recognition unit 2130 ... Stimulation content determination unit, 2150 ... Autonomous nerve state recognition unit, 2210 ... User status information acquisition unit, 2230 ... Mode reception unit, 2310 ... Vibration unit, 3001 ... User Terminal, 3070a ... Terminal control unit, 3110 ... Speaker, 3130 ... Vibrator, 3710 ... Output control unit, 3730 ... Input reception unit, 3750 ... Subjective fatigue state information acquisition unit, 3770 ... Objective fatigue state information acquisition unit, 3790 ... Determination unit , 3910 ... Content DB.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Physics & Mathematics (AREA)
  • Public Health (AREA)
  • General Engineering & Computer Science (AREA)
  • Animal Behavior & Ethology (AREA)
  • Epidemiology (AREA)
  • Anesthesiology (AREA)
  • Primary Health Care (AREA)
  • Theoretical Computer Science (AREA)
  • Biophysics (AREA)
  • Psychology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Child & Adolescent Psychology (AREA)
  • Social Psychology (AREA)
  • Acoustics & Sound (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Pain & Pain Management (AREA)
  • Developmental Disabilities (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychiatry (AREA)
  • Hematology (AREA)
  • Pathology (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Bioethics (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • General Business, Economics & Management (AREA)
  • Computing Systems (AREA)

Abstract

La présente invention concerne un système de fourniture de solution qui comprend : une unité de stockage pour stocker des informations sur de multiples solutions pour améliorer un état d'utilisateur qui est l'un ou les deux parmi l'état d'émotion et l'état de fatigue d'un utilisateur ; une unité d'acquisition d'informations d'utilisateur qui acquiert des informations d'utilisateur comprenant des informations obtenues à partir du corps ou du mouvement de l'utilisateur ; une unité de génération d'informations d'état d'utilisateur qui génère des informations d'état d'utilisateur sur la base des informations acquises à partir du corps ou du mouvement ; une unité de détermination de solution qui détermine, parmi les multiples solutions, une solution selon les informations d'état d'utilisateur ; et une unité de fourniture de solution qui fournit la solution déterminée à l'utilisateur.
PCT/JP2021/044468 2020-12-03 2021-12-03 Système de fourniture de solution WO2022118955A1 (fr)

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
JP2020200827A JP6963669B1 (ja) 2020-12-03 2020-12-03 ソリューション提供システム及び携帯端末
JP2020200823A JP6963668B1 (ja) 2020-12-03 2020-12-03 ソリューション提供システム
JP2020-200827 2020-12-03
JP2020-200823 2020-12-03
JP2021-128933 2021-08-05
JP2021128933A JP7095169B1 (ja) 2021-08-05 2021-08-05 状態改善装置
JP2021-180720 2021-11-05
JP2021180720A JP7024136B1 (ja) 2021-11-05 2021-11-05 分析システム

Publications (1)

Publication Number Publication Date
WO2022118955A1 true WO2022118955A1 (fr) 2022-06-09

Family

ID=81853371

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/044468 WO2022118955A1 (fr) 2020-12-03 2021-12-03 Système de fourniture de solution

Country Status (1)

Country Link
WO (1) WO2022118955A1 (fr)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005237668A (ja) * 2004-02-26 2005-09-08 Kazuya Mera コンピュータネットワークにおける感情を考慮した対話装置
JP2010187810A (ja) * 2009-02-17 2010-09-02 Nissan Motor Co Ltd 居眠り防止装置及び居眠り防止方法
JP2012203590A (ja) * 2011-03-24 2012-10-22 Nsd Co Ltd トータルヘルスサポートシステム
US20160346501A1 (en) * 2014-02-04 2016-12-01 Team Turquoise Ltd. Wearable apparatus
WO2018163361A1 (fr) * 2017-03-09 2018-09-13 株式会社資生堂 Terminal mobile, dispositif de génération de parfum, serveur, procédé de détermination de parfum et programme
JP2019000474A (ja) * 2017-06-16 2019-01-10 グローリー株式会社 脈拍周期検出装置、脈拍周期検出方法、脈拍周期検出プログラム、及び脈波検出装置
JP2019066667A (ja) * 2017-09-29 2019-04-25 株式会社アールライブ 環境音再生装置
JP2019518572A (ja) * 2016-04-01 2019-07-04 ユニバーシティ オブ ピッツバーグ −オブ ザ コモンウェルス システム オブ ハイヤー エデュケイション 調節デバイス及び関連方法
JP2019528894A (ja) * 2016-09-16 2019-10-17 ボーズ・コーポレーションＢｏｓｅ Ｃｏｒｐｏｒａｔｉｏｎ 睡眠システム

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005237668A (ja) * 2004-02-26 2005-09-08 Kazuya Mera コンピュータネットワークにおける感情を考慮した対話装置
JP2010187810A (ja) * 2009-02-17 2010-09-02 Nissan Motor Co Ltd 居眠り防止装置及び居眠り防止方法
JP2012203590A (ja) * 2011-03-24 2012-10-22 Nsd Co Ltd トータルヘルスサポートシステム
US20160346501A1 (en) * 2014-02-04 2016-12-01 Team Turquoise Ltd. Wearable apparatus
JP2019518572A (ja) * 2016-04-01 2019-07-04 ユニバーシティ オブ ピッツバーグ −オブ ザ コモンウェルス システム オブ ハイヤー エデュケイション 調節デバイス及び関連方法
JP2019528894A (ja) * 2016-09-16 2019-10-17 ボーズ・コーポレーションＢｏｓｅ Ｃｏｒｐｏｒａｔｉｏｎ 睡眠システム
WO2018163361A1 (fr) * 2017-03-09 2018-09-13 株式会社資生堂 Terminal mobile, dispositif de génération de parfum, serveur, procédé de détermination de parfum et programme
JP2019000474A (ja) * 2017-06-16 2019-01-10 グローリー株式会社 脈拍周期検出装置、脈拍周期検出方法、脈拍周期検出プログラム、及び脈波検出装置
JP2019066667A (ja) * 2017-09-29 2019-04-25 株式会社アールライブ 環境音再生装置

Similar Documents

Publication Publication Date Title
US11974851B2 (en) Systems and methods for analyzing brain activity and applications thereof
Davis Perceptual and affective reverberation components
Costa et al. EmotionCheck: leveraging bodily signals and false feedback to regulate our emotions
US20070167690A1 (en) Mind-body correlation data evaluation apparatus and method of evaluating mind-body correlation data
Saarikallio et al. Dance moves reflect current affective state illustrative of approach–avoidance motivation.
JP6963668B1 (ja) ソリューション提供システム
WO2022118955A1 (fr) Système de fourniture de solution
CN112827136A (zh) 一种呼吸训练方法、装置、电子设备、训练系统及存储介质
CN113687744B (zh) 一种用于情绪调节的人机交互设备
US20230306860A1 (en) Training system with interaction assist feature, training arrangement and training
Pancini et al. Breathing in virtual Reality for Promoting Mental Health: A scoping review
JP7061714B1 (ja) ソリューション提供システム及び携帯端末
JP7069390B1 (ja) 携帯端末
JP7095169B1 (ja) 状態改善装置
JP6963669B1 (ja) ソリューション提供システム及び携帯端末
JP7069389B1 (ja) ソリューション提供システム及び携帯端末
Gancea et al. AN INTELLIGENT EMDR SYSTEM FOR HELPING STUDENTS WITH PSYCHOLOGICAL PROBLEMS.
CN112530589B (zh) 触发asmr的方法、装置、系统、电子设备及存储介质
Yap et al. Dyadic nonverbal synchrony during pre and post music therapy interventions and its relationship to self-reported therapy readiness
Yu et al. HSVRS: A Virtual Reality System of the Hide-and-Seek Game to Enhance Gaze Fixation Ability for Autistic Children
Chen The Evaluation and Application of Bio-Emotion Estimation Methods
Zhou Language comprehension grounded in perceptual experiences: an investigation on text and speech perception
Ramírez-Meléndez Neurocognitive Music Therapy: Intersecting Music, Medicine and Technology for Health and Well-Being
JP2023069103A (ja) 分析システム
Garsmark Development and Testing of a Sensor Setup for a Ship Captain's Chair

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21900704

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21900704

Country of ref document: EP

Kind code of ref document: A1