CN105726045A - Emotion monitoring method and mobile terminal thereof - Google Patents
Emotion monitoring method and mobile terminal thereof Download PDFInfo
- Publication number
- CN105726045A CN105726045A CN201610061012.4A CN201610061012A CN105726045A CN 105726045 A CN105726045 A CN 105726045A CN 201610061012 A CN201610061012 A CN 201610061012A CN 105726045 A CN105726045 A CN 105726045A
- Authority
- CN
- China
- Prior art keywords
- data
- user
- state information
- emotional state
- emotion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6802—Sensor mounted on worn items
Abstract
The invention discloses an emotion monitoring method and a device thereof. The emotion monitoring method includes the steps that a mobile terminal receives monitoring data sent by a wearable device and obtains expression data and sound data of a user, wherein the monitoring data includes sign data and movement state types; according to the monitoring data, the expression data and the sound data, emotion state information of the user is determined, wherein the emotion state information includes emotion types and pressure indexes; regulating suggestions matched with the emotion state information are obtained and displayed. In this way, emotions of the user can be dynamically monitored, the regulating suggestions are provided according to the emotions of the user, the user can regulate the emotions conveniently, and adverse effects caused by bad motions are reduced.
Description
Technical field
The application relates to communication technical field, particularly relates to a kind of emotion monitoring method and equipment thereof.
Background technology
Along with the quickening of social high speed development and modern life rhythm, increasing people is just subject bigger life stress, and anxious state of mind, depressed, anxiety etc. often occur in life in people.Different hormones can be secreted owing to human body is in different emotions, can stimulate when anxious state of mind is excessive a large amount of Secretion of human body stress element, be likely to hurt Different Organs under the long-time stimulus of excess hormones.
But, as a rule, when anxious state of mind is bigger, people often could not realize in time and be regulated and controled, if unhealthy emotion is not regulated and controled for a long time, it will having a strong impact on thus affecting people's live and work, even causing disease.
Summary of the invention
The application provides a kind of emotion monitoring method and equipment thereof, it is possible to dynamic monitoring user emotion also provides adjustment suggestion according to user emotion, it is simple to user regulates emotion to reduce the harmful effect that good emotion is brought.
For solving above-mentioned technical problem, the technical scheme that the application adopts is: provide a kind of emotion monitoring method, described emotion monitoring method is applied to mobile terminal, described mobile terminal includes front-facing camera, mike, described method comprises the steps: to receive the Monitoring Data that wearable device sends, and obtains expression data and the voice data of user；Wherein, described Monitoring Data includes sign data and kinestate type；The emotional state information of described user is determined according to described Monitoring Data, described expression data and described voice data；Wherein said emotional state information includes type of emotion and pressure index；Obtain and show and described emotional state information matches adjustment suggestion.
Wherein, the step of the emotional state information of described user is determined according to described Monitoring Data, described expression data and described voice data particularly as follows: determine the emotional state information of described user according to described Monitoring Data, described expression data and described voice data and local data base or network data base.
Wherein, obtain and after the step regulating suggestion of display and described emotional state information matches, described method also includes: described emotional state information and described adjustment are advised sending extremely described wearable device.
Wherein, described voice data includes voice, intonation, loudness of a sound；Obtain and show and after the step regulating suggestion of described emotional state information matches, described method also includes: confirm described user accept described regulate suggestion time, regulate suggestion perform described to regulate the corresponding operation of suggestion according to described.
For solving above-mentioned technical problem, another technical scheme that the application adopts is: provide a kind of emotion monitoring method, described emotion monitoring method is applied to mobile terminal wearable device, described wearable device includes heart rate sensor, motion sensor, described method includes: the sign data of monitoring user, and obtains described user movement Status Type information；Determine the emotional state information of described user according to described sign data and described kinestate type, and show described emotional state information.
For solving above-mentioned technical problem, another technical scheme that the application adopts is: provide a kind of mobile terminal with emotion control function, and described mobile terminal includes transceiver module, acquisition module, determines module, adjustment module and display module；Described transceiver module is for receiving the Monitoring Data that wearable device sends；Wherein, described Monitoring Data includes sign data and kinestate type；Described acquisition module is for obtaining expression data and the voice data of user；Described determine that described expression data that module obtains for the described Monitoring Data received according to described transceiver module, described acquisition module and described voice data determine the emotional state information of described user；Wherein said emotional state information includes type of emotion and pressure index；Described adjustment module is advised for the adjustment obtained with described emotional state information matches；Described display module is used for showing described emotional state information and described adjustment suggestion.
Wherein, described determine that module specifically for determining the emotional state information of described user according to described Monitoring Data, described expression data and described voice data and local data base or network data base.
Wherein, described transceiver module is additionally operable to advise sending to described wearable device by described emotional state information and described adjustment.
Wherein, described voice data includes voice, intonation, loudness of a sound；Described adjustment module is additionally operable to when confirming that described user accepts described adjustment suggestion, advises performing the operation that described adjustment suggestion is corresponding according to described adjustment.
For solving above-mentioned technical problem, another technical scheme that the application adopts is: providing a kind of wearable device with emotion control function, described wearable device includes sign data monitoring modular, moving state acquisition module, control module and display module；Described sign data monitoring modular is for monitoring the sign data of user；Described moving state acquisition module is used for obtaining described user movement Status Type information；Described control module for determining the emotional state information of described user according to described sign data and described kinestate type；Described display module is used for showing described emotional state information.
Such scheme, the Monitoring Data that mobile terminal sends according to wearable device, and the expression data of user self gathered and voice data determine the emotional state information of user, and the adjustment suggestion of acquisition and current emotional states information matches is for reference, can dynamic monitoring user emotion, and adjustment suggestion is provided, it is simple to user regulates emotion to reduce the harmful effect that good emotion is brought.
Accompanying drawing explanation
Fig. 1 is the flow chart of the application emotion monitoring method one embodiment；
Fig. 2 is the flow chart of the application emotion monitoring another embodiment of method；
Fig. 3 is the flow chart of the application emotion monitoring method another embodiment；
Fig. 4 is the structural representation that the application has mobile terminal one embodiment of emotion control function；
Fig. 5 is the structural representation that the application has wearable device one embodiment of emotion control function；
Fig. 6 is the structural representation that the application has another embodiment of mobile terminal of emotion control function；
Fig. 7 is the structural representation that the application has another embodiment of wearable device of emotion control function.
Detailed description of the invention
In being described below, in order to illustrate rather than in order to limit, it is proposed that the such as detail of particular system structure, interface, technology etc, in order to thoroughly understand the application.But, it will be clear to one skilled in the art that and can also realize the application in other embodiment do not have these details.In other situation, omit the detailed description to well-known device, circuit and method, in order to avoid unnecessary details hinders the description of the present application.
Consult the flow chart that Fig. 1, Fig. 1 are the application emotion monitoring method one embodiments.The executive agent of the present embodiment is mobile terminal, and mobile terminal includes front-facing camera, mike.The method setting up exchange group of the present embodiment comprises the following steps:
S101: receive the Monitoring Data that wearable device sends, and obtain expression data and the voice data of user.
After mobile terminal and wearable device set up communication connection, receive the Monitoring Data that wearable device sends, and utilize facial recognition techniques to pass through front-facing camera collection user's expression data, voice data by mike collection user.
Wherein, wearable device can be intelligent watch；The Monitoring Data that wearable device sends is obtained by heart rate sensor, motion-sensing sensor by wearable device；Motion sensor can be acceleration transducer.Monitoring Data includes sign data and kinestate type information.Sign data can be heart rate, changes in heart rate characteristic information, breathing rate and blood pressure etc.；Kinestate type can be resting state, walking states, running state, state etc. of travelling frequently.
Owing to overwhelming majority emotion all can be expressed by facial expression, the expression action that different emotions can be corresponding different, and each expression can be broken into a lot of little Facial action units；It can thus be stated that each expression is the face action tissue system of these Facial action units composition, and these independent Facial action units can not represent any emotion, but utilizes their assemblage characteristic, it is possible to carries out some human facial expression recognition.Extract the point of some keys at face, by those geostationary " anchor point ", such as nose, the most fixing point of some references, then judge, with as the such point of the corners of the mouth, the expression that user makes.
Voice data can include voice, intonation, loudness of a sound.The voice data difference that different emotions is corresponding.
It is understood that the expression data of mobile terminal collection and voice data can be Real-time Collections, it is also possible to be periodically gather every preset time period (preset time period can be configured according to actual needs), be not limited as herein.Gather preset time period corresponding to expression data to can be the same or different with the preset time period gathering voice data.
S102: determine the emotional state information of described user according to described Monitoring Data, described expression data and described voice data；Wherein said emotional state information includes type of emotion and pressure index.
Mobile terminal comprehensively analyzes, according to the Monitoring Data received and the expression data got, voice data, the emotional state that user is current.Wherein, emotional state information includes type of emotion and pressure index.The corresponding Monitoring Data of every kind of type of emotion, an expression data and a voice data.The corresponding Monitoring Data of each pressure index grade/pressure index value, an expression data and a voice data.Type of emotion can be divided into happy, wild with joy, angry, sad, frightened, desperate, rage etc..
Wherein, when this locality is previously stored with reference value or the term of reference value of Monitoring Data corresponding to each emotional state, expression data and voice data, mobile terminal can by Monitoring Data, expression data, voice data, each self-corresponding reference value or term of reference value compare with it respectively, to determine the current type of emotion of user and current pressure index.
Wherein, wearable device when disconnecting the state of communication connection with mobile terminal, and wearable device can primarily determine that the current emotional state of user according to sign data and kinestate type and remind user.
It is understandable that, in other embodiments, mobile terminal by Monitoring Data, expression data and voice data upload server, can also enable the server to the emotional state that the aggregation of data analysis user according to Monitoring Data, expression data, voice data and network data is current.Wherein, in network data, storage has every kind of type of emotion and each self-corresponding Monitoring Data reference value/term of reference of each pressure index grade/pressure index value, expression data reference value/term of reference and voice data reference value/term of reference.Type of emotion current for the user determined and pressure index are sent to mobile terminal by server.
S103: obtain and the adjustment of display and described emotional state information matches is advised.
Mobile terminal, after determining the current type of emotion of user and pressure index, obtains the adjustment suggestion matched with current type of emotion and pressure index, and by emotional state information, regulate suggestion and be shown to user.
Such as, mobile terminal is when determining that user's current emotional type be happy, pressure index is 30 (pressure index more high pressure is more big), and regulating suggestion can be continue maintenance be in a cheerful frame of mind.
Mobile terminal is when determining that the current emotional state of user be wild with joy, pressure index is 20, and regulating suggestion can be the music etc. that some mild moods are listened in suggestion.
Mobile terminal is when determining that the current emotional state of user is 60 for sad, pressure index, regulating suggestion can for listen some brisk, positive music, see comedy or the caricature/video/picture etc. made laughs, but be not limited to this, specifically can be configured according to practical situation.
Advise it is understood that mobile terminal can provide one or more adjustment for the emotional state that user is current, be not limited as herein.
Such scheme, the Monitoring Data that mobile terminal sends according to wearable device, and the expression data of user self gathered and voice data determine the emotional state information of user, and the adjustment suggestion of acquisition and current emotional states information matches is for reference, can dynamic monitoring user emotion, and adjustment suggestion is provided, it is simple to user regulates emotion to reduce the harmful effect that good emotion is brought.
Consult the flow chart that Fig. 2, Fig. 2 are the application emotion monitoring another embodiments of method.The executive agent of the present embodiment is mobile terminal, and mobile terminal includes front-facing camera, mike.The method setting up exchange group of the present embodiment comprises the following steps:
S201: receive the Monitoring Data that wearable device sends, and obtain expression data and the voice data of user.
The step S201 of the present embodiment is identical with the step S101 in a upper embodiment, specifically refers to the associated description of S101 in an embodiment, does not repeat herein.
S202: determine the emotional state information of described user according to described Monitoring Data, described expression data and described voice data and local data base or network data base.
Mobile terminal is according to the current emotional state of the aggregation of data analysis user of the Monitoring Data received, the expression data got, voice data and local data base；Or according to the current emotional state of the aggregation of data analysis user of the Monitoring Data received, the expression data got, voice data and network data base.
Wherein, emotional state information includes type of emotion and pressure index.The corresponding Monitoring Data of every kind of type of emotion, an expression data and a voice data.The corresponding Monitoring Data of each pressure index grade/pressure index value, an expression data and a voice data.Type of emotion can be divided into happy, wild with joy, angry, sad, frightened, desperate, rage etc..
Wherein, when local data base is previously stored with reference value or the term of reference value of Monitoring Data corresponding to each emotional state, expression data and voice data, mobile terminal can by Monitoring Data, expression data, voice data, each self-corresponding reference value or term of reference value compare with it respectively, to determine the current type of emotion of user and current pressure index.
When local data base does not store reference value or the term of reference value of Monitoring Data corresponding to each emotional state, expression data and voice data, mobile terminal by Monitoring Data, expression data and voice data upload server, can also enable the server to the emotional state that the aggregation of data analysis user according to Monitoring Data, expression data, voice data and network data is current.
Wherein, network data stores be in a bad mood state investigation and analysis report and solution.Include but not limited to the feature of every kind of type of emotion, every kind of type of emotion and each self-corresponding Monitoring Data reference value/term of reference of each pressure index grade/pressure index value, expression data reference value/term of reference and voice data reference value/term of reference, the adjustment advisory information etc. of every kind of type of emotion.Type of emotion current for the user determined and pressure index are sent to mobile terminal by server.
It is understood that wearable device when disconnecting the state of communication connection with mobile terminal, wearable device can primarily determine that the current emotional state of user according to sign data and kinestate type and remind user.
S203: obtain and the adjustment of display and described emotional state information matches is advised.
Mobile terminal, after determining the current type of emotion of user and pressure index, obtains the adjustment suggestion matched with current type of emotion and pressure index, and advises at mobile terminal vision-control, asks the user whether to accept to regulate suggestion.
Such as, mobile terminal is when determining that user's current emotional type be happy, pressure index is 30 (pressure index more high pressure is more big), and regulating suggestion can be continue maintenance be in a cheerful frame of mind.
Mobile terminal is when determining that the current emotional state of user be wild with joy, pressure index is 20, and regulating suggestion can be the music etc. that some mild moods are listened in suggestion.
Mobile terminal is when determining that the current emotional state of user is 60 for sad, pressure index, regulating suggestion can for listen some brisk, positive music, see comedy or the caricature/video/picture etc. made laughs, but be not limited to this, specifically can be configured according to practical situation.
Advise it is understood that mobile terminal can provide one or more adjustment for the emotional state that user is current, be not limited as herein.
S204: advise sending to described wearable device by described emotional state information and described adjustment.
Emotional state information, adjustment suggestion are sent to wearable device by mobile terminal, emotional state information, adjustment suggestion to be presented to user by wearable device and mobile terminal, and to ask the user whether to accept adjustment suggestion.
S205: when confirming that described user accepts described adjustment suggestion, advises performing the operation that described adjustment suggestion is corresponding according to described adjustment.
Mobile terminal, when receiving user and accepting the described confirmation regulating suggestion, performs the predetermined registration operation corresponding with regulating suggestion.
Such as, user's current emotional type is happy, pressure index is 30 (pressure index more high pressure is more big), regulating suggestion and be in a cheerful frame of mind for continuing maintenance, mobile terminal, when determining that user accepts to regulate suggestion, is play brisk music or mobile terminal is done not any process.
The current emotional state of user is wild with joy, pressure index is 20, regulates suggestion and listens the music of some mild moods for suggestion, and mobile terminal is when determining that user accepts to regulate suggestion, and playing can the music of information gently.
The current emotional state of user is 60 for sad, pressure index, regulate suggestion for listen some brisk, positive music, see comedy or the caricature made laughs, mobile terminal is when determining that user accepts to regulate suggestion, play positive, brisk music, or caricature/picture etc. that broadcasting comedy/video or display are made laughs, but it is not limited to this, specifically can be configured according to practical situation.
Such scheme, the Monitoring Data that mobile terminal sends according to wearable device, and the expression data of user self gathered and voice data determine the emotional state information of user, and the adjustment suggestion of acquisition and current emotional states information matches is for reference, and perform when confirmation user accepts to regulate suggestion to advise corresponding operation with regulating, can dynamic monitoring user emotion, and adjustment suggestion is provided and performs to regulate the operation that suggestion is corresponding, it is simple to user regulates emotion to reduce the harmful effect that good emotion is brought.
Consult the flow chart that Fig. 3, Fig. 3 are the application emotion monitoring method another embodiment.The executive agent of the present embodiment is wearable device, and wearable device can be intelligent watch, but is not limited to this.Wearable device includes heart rate sensor, motion sensor.The method setting up exchange group of the present embodiment comprises the following steps:
S301: the sign data of monitoring user, and obtain described user movement Status Type information.
Wearable device is by the sign data of heart rate sensor monitoring user, and is obtained the kinestate type information of user by motion sensor.
Wherein, motion sensor can be acceleration transducer.Sign data can be heart rate, changes in heart rate characteristic information, breathing rate and blood pressure etc.；Kinestate type can be resting state, walking states, running state, state etc. of travelling frequently.
It is understandable that, when wearable device sets up communication connection with mobile terminal, the sign data of user and kinestate type information can be sent to mobile terminal by wearable device, so that mobile terminal can utilize the emotional state of the sign data of user, kinestate type information and other information comprehensive analysis user, and emotional state information current for user is sent to wearable device.
S302: judge the emotional state information of described user according to described sign data and described kinestate type, and show described emotional state information.
Wearable device is comprehensively analyzed the emotional state that user is current according to the sign data of user, kinestate type information, and is shown emotional state information.Wherein, emotional state information includes type of emotion and pressure index.Every kind of type of emotion corresponding a sign data, a kinestate type.The corresponding Monitoring Data of each pressure index grade/pressure index value, an expression data and a voice data.Type of emotion can be divided into happy, wild with joy, angry, sad, frightened, desperate, rage etc..
Wherein, wearable device is previously stored with reference value or term of reference value, the kinestate type information of user's sign data corresponding to each emotional state in this locality, self-corresponding with it for user's sign data reference value or term of reference value can be compared by wearable device respectively, and determine the current type of emotion of user and current pressure index in conjunction with kinestate type information.
It is understood that wearable device can also be advised according to the adjustment that the emotional state that user is current obtains with emotional state information matches from local data base, and emotional state information, adjustment suggestion are shown to user, are adjusted with for reference.
Such as, wearable device is when determining that user's current emotional type be happy, pressure index is 30 (pressure index more high pressure is more big), and regulating suggestion can be continue maintenance be in a cheerful frame of mind.
Wearable device is when determining that the current emotional state of user be wild with joy, pressure index is 20, and regulating suggestion can be the music etc. that some mild moods are listened in suggestion.
Wearable device is when determining that the current emotional state of user is 60 for sad, pressure index, regulating suggestion can for listen some brisk, positive music, see comedy or the caricature/video/picture etc. made laughs, but be not limited to this, specifically can be configured according to practical situation.
Advise it is understood that wearable device can provide one or more adjustment for the emotional state that user is current, be not limited as herein.
Such scheme, wearable device determines the emotional state information of user according to the sign data of user and the kinestate type of user, and show emotional state information, it is possible to dynamic monitoring user emotion, it is simple to user regulates emotion to reduce the harmful effect that good emotion is brought.
Referring to Fig. 4, Fig. 4 is the structural representation that the application has mobile terminal one embodiment of emotion control function.Each module included by mobile terminal in the present embodiment, for performing each step in embodiment corresponding to Fig. 1 respectively, specifically please refer to the associated description of each step in embodiment corresponding to Fig. 1 and Fig. 1, not repeat herein.The mobile terminal in the present embodiment with emotion control function includes transceiver module 410, acquisition module 420, determines module 430, adjustment module 440 and display module 450.
Transceiver module 410 is for receiving the Monitoring Data that wearable device sends；Wherein, described Monitoring Data includes sign data and kinestate type.Such as, transceiver module 410 receives the Monitoring Data that wearable device sends；Wherein, described Monitoring Data includes sign data and kinestate type.Described Monitoring Data is sent to by transceiver module 410 determines module 430.
Acquisition module 420 is for obtaining expression data and the voice data of user.Such as, acquisition module 420 obtains expression data and the voice data of user.Expression data and the audio data transmitting of the user of acquisition are delivered to and are determined module 430 by acquisition module 420.
Determining Monitoring Data that module 430 sends and the expression data of user that acquisition module 420 sends and voice data for receiving transceiver module 410, described expression data that the described Monitoring Data received according to described transceiver module, described acquisition module obtain and described voice data determine the emotional state information of described user；Wherein said emotional state information includes type of emotion and pressure index.
Such as, determining that module 430 receives Monitoring Data that transceiver module 410 sends and the expression data of user that acquisition module 420 sends and voice data, described expression data that the described Monitoring Data received according to described transceiver module, described acquisition module obtain and described voice data determine the emotional state information of described user；Wherein said emotional state information includes type of emotion and pressure index.Determine that the emotional state information determined is sent to adjustment module 440 by module 430.
Adjustment module 440, for receiving the emotional state information determining that module 430 sends, obtains the adjustment with described emotional state information matches and advises.Such as, adjustment module 440 receives determines the emotional state information that module 430 sends, and the adjustment suggestion of acquisition and described emotional state information matches.Emotional state information, adjustment suggestion are sent to display module 450 by adjustment module 440.
Emotional state information, adjustment that display module 450 sends for receiving adjustment module 440 are advised, and show described emotional state information and described adjustment suggestion.Such as, display module 450 is used for showing described emotional state information and described adjustment suggestion.
Such scheme, the Monitoring Data that mobile terminal sends according to wearable device, and the expression data of user self gathered and voice data determine the emotional state information of user, and the adjustment suggestion of acquisition and current emotional states information matches is for reference, can dynamic monitoring user emotion, and adjustment suggestion is provided, it is simple to user regulates emotion to reduce the harmful effect that good emotion is brought.
Please continue to refer to Fig. 4, in another kind of embodiment, each module included by mobile terminal, for performing each step in embodiment corresponding to Fig. 2 respectively, specifically please refer to the associated description of each step in embodiment corresponding to Fig. 2 and Fig. 2, not repeat herein.Wherein:
Transceiver module 410 is for receiving the Monitoring Data that wearable device sends；Wherein, described Monitoring Data includes sign data and kinestate type.Such as, transceiver module 410 receives the Monitoring Data that wearable device sends；Wherein, described Monitoring Data includes sign data and kinestate type.Described Monitoring Data is sent to by transceiver module 410 determines module 430.
Acquisition module 420 is for obtaining expression data and the voice data of user.Wherein, described voice data includes voice, intonation, loudness of a sound.Such as, acquisition module 420 obtains expression data and the voice data of user.Wherein, described voice data includes voice, intonation, loudness of a sound.Expression data and the audio data transmitting of the user of acquisition are delivered to and are determined module 430 by acquisition module 420.
Determine Monitoring Data that module 430 sends for receiving transceiver module 410 and the expression data of user that acquisition module 420 sends and voice data, determine the emotional state information of described user according to described Monitoring Data, described expression data and described voice data and local data base or network data base；Wherein said emotional state information includes type of emotion and pressure index.
Such as, determine that module 430 receives Monitoring Data that transceiver module 410 sends and the expression data of user that acquisition module 420 sends and voice data, determine the emotional state information of described user according to described Monitoring Data, described expression data and described voice data and local data base or network data base；Wherein said emotional state information includes type of emotion and pressure index.Determine that the emotional state information determined is sent to adjustment module 440 and wearable device by module 430.
Adjustment module 440, for receiving the emotional state information determining that module 430 sends, obtains the adjustment with described emotional state information matches and advises.Such as, adjustment module 440 receives determines the emotional state information that module 430 sends, and the adjustment suggestion of acquisition and described emotional state information matches.Emotional state information, adjustment suggestion are sent to display module 450 by adjustment module 440.
Adjustment module 440 is additionally operable to when confirming that described user accepts described adjustment suggestion, advises performing the operation that described adjustment suggestion is corresponding according to described adjustment.
Emotional state information, adjustment that display module 450 sends for receiving adjustment module 440 are advised, and show described emotional state information and described adjustment suggestion.Such as, display module 450 is used for showing described emotional state information and described adjustment suggestion.
Such scheme, the Monitoring Data that mobile terminal sends according to wearable device, and the expression data of user self gathered and voice data determine the emotional state information of user, and the adjustment suggestion of acquisition and current emotional states information matches is for reference, and perform when confirmation user accepts to regulate suggestion to advise corresponding operation with regulating, can dynamic monitoring user emotion, and adjustment suggestion is provided and performs to regulate the operation that suggestion is corresponding, it is simple to user regulates emotion to reduce the harmful effect that good emotion is brought.
Referring to Fig. 5, Fig. 5 is the structural representation that the application has wearable device one embodiment of emotion control function.Wearable device can be intelligent watch, but is not limited to this.Wherein, wearable device has display screen, heart rate sensor, motion sensor.Each module included by wearable device in the present embodiment, for performing each step in embodiment corresponding to Fig. 3 respectively, specifically please refer to the associated description of each step in embodiment corresponding to Fig. 3 and Fig. 3, not repeat herein.The wearable device in the present embodiment with emotion control function includes sign data monitoring modular 510, moving state acquisition module 520, controls module 530 and display module 540.
Sign data monitoring modular 510 is for monitoring the sign data of user.Such as, sign data monitoring modular 510 monitors the sign data of user.The sign data detected is sent to controlling module 530 by sign data monitoring modular 510.
Moving state acquisition module 520 is used for obtaining described user movement Status Type information.Such as, moving state acquisition module 520 obtains described user movement Status Type information.The user movement Status Type information obtained is sent to controlling module 530 by moving state acquisition module 520.
Control module 530 for the user movement Status Type information that the sign data and moving state acquisition module 520 receiving the transmission of sign data monitoring module 510 sends, determine the emotional state information of described user according to described sign data and described kinestate type.Control module 530 to send the emotional state information of the user determined to display module 540.
Display module 540 controls, for receiving, the emotional state information that module 530 sends, and shows described emotional state information.
Such scheme, wearable device determines the emotional state information of user according to the sign data of user and the kinestate type of user, and show emotional state information, it is possible to dynamic monitoring user emotion, it is simple to user regulates emotion to reduce the harmful effect that good emotion is brought.
Consult the structural representation that Fig. 6, Fig. 6 are the application another embodiments of mobile terminal.Mobile terminal 600 includes: memorizer 610, processor 620, transceiver 630 and bus 640.Processor 620 is connected with memorizer 610 by bus 640.Processor 620 is connected with transceiver 630 by bus 640.
Transceiver 630 is used for receiving transmission data.
Memorizer 610 stores programmed instruction.
Processor 620 be central processing unit (English: centralprocessingunit, CPU) or the combination of CPU and hardware chip abbreviation:.Processor 620 performs following operation according to the programmed instruction that memorizer 610 stores:
Processor 620 receives, for controlling transceiver 630, the Monitoring Data that wearable device sends；Wherein, described Monitoring Data includes sign data and kinestate type.
Processor 620 is for obtaining expression data and the voice data of user, and the described expression data obtained for the described Monitoring Data received according to described transceiver module, described acquisition module and described voice data determine the emotional state information of described user；Wherein said emotional state information includes type of emotion and pressure index.
Processor 620 is additionally operable to the adjustment obtained with described emotional state information matches advises, and is shown described emotional state information and described adjustment suggestion by display screen.
Alternatively, processor 620 specifically for determining the emotional state information of described user according to described Monitoring Data, described expression data and described voice data and local data base or network data base.
Alternatively, processor 620 is additionally operable to control transceiver 630 and described emotional state information and described adjustment suggestion is sent extremely described wearable device.
Alternatively, described voice data includes voice, intonation, loudness of a sound；Processor 620 is additionally operable to when confirming that described user accepts described adjustment suggestion, advises performing the operation that described adjustment suggestion is corresponding according to described adjustment.
Such scheme, the Monitoring Data that mobile terminal sends according to wearable device, and the expression data of user self gathered and voice data determine the emotional state information of user, and the adjustment suggestion of acquisition and current emotional states information matches is for reference, can dynamic monitoring user emotion, and adjustment suggestion is provided, it is simple to user regulates emotion to reduce the harmful effect that good emotion is brought.
Consult the structural representation that Fig. 7, Fig. 7 are the application another embodiments of wearable device.Mobile terminal 700 includes: memorizer 710, processor 720, transceiver 730 and bus 740.Processor 720 is connected with memorizer 710 by bus 740.Processor 720 is connected with transceiver 730 by bus 740.
Transceiver 730 is used for receiving transmission data.
Memorizer 710 stores programmed instruction.
Processor 720 be central processing unit (English: centralprocessingunit, CPU) or the combination of CPU and hardware chip abbreviation:.Processor 720 performs following operation according to the programmed instruction that memorizer 710 stores:
Processor 720 is for controlling the sign data of heart rate sensor monitoring user, and obtains described user movement Status Type information by motion sensor.
Processor 720 is additionally operable to determine the emotional state information of described user according to described sign data and described kinestate type, and is used for controlling display screen and shows described emotional state information.
Such scheme, wearable device determines the emotional state information of user according to the sign data of user and the kinestate type of user, and show emotional state information, it is possible to dynamic monitoring user emotion, it is simple to user regulates emotion to reduce the harmful effect that good emotion is brought.
In above description, in order to illustrate rather than in order to limit, it is proposed that the such as detail of particular system structure, interface, technology etc, in order to thoroughly understand the application.But, it will be clear to one skilled in the art that and can also realize the application in other embodiment do not have these details.In other situation, omit the detailed description to well-known device, circuit and method, in order to avoid unnecessary details hinders the description of the present application.
Claims (10)
1. an emotion monitoring method, it is characterised in that described emotion monitoring method is applied to mobile terminal, and described mobile terminal includes front-facing camera, mike, and described method includes:
Receive the Monitoring Data that wearable device sends, and obtain expression data and the voice data of user；Wherein, described Monitoring Data includes sign data and kinestate type；
The emotional state information of described user is determined according to described Monitoring Data, described expression data and described voice data；Wherein said emotional state information includes type of emotion and pressure index；
Obtain and show and described emotional state information matches adjustment suggestion.
2. method according to claim 1, it is characterized in that, determine the step of the emotional state information of described user according to described Monitoring Data, described expression data and described voice data particularly as follows: determine the emotional state information of described user according to described Monitoring Data, described expression data and described voice data and local data base or network data base.
3. method according to claim 1 and 2, it is characterized in that, obtain and show and after the step regulating suggestion of described emotional state information matches, described method also includes: advising sending to described wearable device by described emotional state information and described adjustment.
4. method according to claim 1, it is characterised in that described voice data includes voice, intonation, loudness of a sound；
Obtain and show and after the step regulating suggestion of described emotional state information matches, described method also includes: confirm described user accept described regulate suggestion time, regulate suggestion perform described to regulate the corresponding operation of suggestion according to described.
5. an emotion monitoring method, it is characterised in that described emotion monitoring method is applied to mobile terminal wearable device, and described wearable device includes heart rate sensor, motion sensor, and described method includes:
The sign data of monitoring user, and obtain described user movement Status Type information；
Determine the emotional state information of described user according to described sign data and described kinestate type, and show described emotional state information.
6. a mobile terminal with emotion control function, it is characterised in that described mobile terminal includes transceiver module, acquisition module, determines module, adjustment module and display module；
Described transceiver module is for receiving the Monitoring Data that wearable device sends；Wherein, described Monitoring Data includes sign data and kinestate type；
Described acquisition module is for obtaining expression data and the voice data of user；
Described determine that described expression data that module obtains for the described Monitoring Data received according to described transceiver module, described acquisition module and described voice data determine the emotional state information of described user；Wherein said emotional state information includes type of emotion and pressure index；
Described adjustment module is advised for the adjustment obtained with described emotional state information matches；
Described display module is used for showing described emotional state information and described adjustment suggestion.
7. mobile terminal according to claim 6, it is characterised in that described determine that module specifically for determining the emotional state information of described user according to described Monitoring Data, described expression data and described voice data and local data base or network data base.
8. the mobile terminal according to claim 6 or 7, it is characterised in that described transceiver module is additionally operable to advise sending to described wearable device by described emotional state information and described adjustment.
9. mobile terminal according to claim 6, it is characterised in that described voice data includes voice, intonation, loudness of a sound；Described adjustment module is additionally operable to when confirming that described user accepts described adjustment suggestion, advises performing the operation that described adjustment suggestion is corresponding according to described adjustment.
10. a wearable device with emotion control function, it is characterised in that described wearable device includes sign data monitoring modular, moving state acquisition module, control module and display module；
Described sign data monitoring modular is for monitoring the sign data of user；
Described moving state acquisition module is used for obtaining described user movement Status Type information；
Described control module for determining the emotional state information of described user according to described sign data and described kinestate type；
Described display module is used for showing described emotional state information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610061012.4A CN105726045A (en) | 2016-01-28 | 2016-01-28 | Emotion monitoring method and mobile terminal thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610061012.4A CN105726045A (en) | 2016-01-28 | 2016-01-28 | Emotion monitoring method and mobile terminal thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105726045A true CN105726045A (en) | 2016-07-06 |
Family
ID=56246924
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610061012.4A Pending CN105726045A (en) | 2016-01-28 | 2016-01-28 | Emotion monitoring method and mobile terminal thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105726045A (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106175800A (en) * | 2016-07-10 | 2016-12-07 | 北京工业大学 | A kind of Mood State quantitative estimation method based on human motion state data |
| CN106372604A (en) * | 2016-08-31 | 2017-02-01 | 北京光年无限科技有限公司 | Intelligent robot negative emotion detection method and system |
| CN106512207A (en) * | 2016-11-11 | 2017-03-22 | 深圳欧德蒙科技有限公司 | Emotion regulation method and system based on galvanic skin |
| CN107714056A (en) * | 2017-09-06 | 2018-02-23 | 上海斐讯数据通信技术有限公司 | A kind of wearable device of intellectual analysis mood and the method for intellectual analysis mood |
| CN107943279A (en) * | 2017-10-27 | 2018-04-20 | 捷开通讯(深圳)有限公司 | Intelligent wearable device and method of work, the device with store function |
| CN107993674A (en) * | 2016-10-27 | 2018-05-04 | 中兴通讯股份有限公司 | A kind of emotion control method and device |
| CN108305640A (en) * | 2017-01-13 | 2018-07-20 | 深圳大森智能科技有限公司 | Intelligent robot active service method and device |
| CN108604246A (en) * | 2016-12-29 | 2018-09-28 | 华为技术有限公司 | A kind of method and device adjusting user emotion |
| CN108594991A (en) * | 2018-03-28 | 2018-09-28 | 努比亚技术有限公司 | A kind of method, apparatus and computer storage media that help user to adjust mood |
| CN108629313A (en) * | 2018-05-04 | 2018-10-09 | 河北省科学院应用数学研究所 | Emotion adjustment method, device, system and computer storage media |
| WO2018188097A1 (en) * | 2017-04-14 | 2018-10-18 | 格兰比圣（深圳）科技有限公司 | Method and device for regulating family atmosphere |
| CN108960023A (en) * | 2017-09-19 | 2018-12-07 | 炬大科技有限公司 | A kind of portable Emotion identification device |
| CN109147824A (en) * | 2017-06-23 | 2019-01-04 | 卡西欧计算机株式会社 | Electronic equipment, emotional information obtain system and adquisitiones and storage medium |
| CN109218512A (en) * | 2017-07-06 | 2019-01-15 | 新华网股份有限公司 | Mobile terminal user emotion detection method, system and mobile terminal |
| CN110471534A (en) * | 2019-08-23 | 2019-11-19 | 靖江市人民医院 | Information processing method and tele-medicine management system based on Emotion identification |
| CN110770845A (en) * | 2017-07-18 | 2020-02-07 | 梅德拉控股公司 | Method and interactive system for improving pump performance and user experience |
| CN111430007A (en) * | 2020-03-19 | 2020-07-17 | 乐爱健康科技（苏州）有限公司 | Information processing method and device |
| CN113144374A (en) * | 2021-04-09 | 2021-07-23 | 上海探寻信息技术有限公司 | Method and device for adjusting user state based on intelligent wearable device |
| CN113287281A (en) * | 2018-09-21 | 2021-08-20 | 史蒂夫·柯蒂斯 | System and method for integrating emotion data into social network platform and sharing emotion data on social network platform |
| CN114422920A (en) * | 2021-12-28 | 2022-04-29 | 歌尔科技有限公司 | Control method and device of wireless audio equipment and earphone |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007200126A (en) * | 2006-01-27 | 2007-08-09 | Advanced Telecommunication Research Institute International | Feeling informing reporting device |
| CN201504263U (en) * | 2009-09-14 | 2010-06-09 | 幻音科技(深圳)有限公司 | Health detection mobile phone |
| CN103491251A (en) * | 2013-09-24 | 2014-01-01 | 深圳市金立通信设备有限公司 | Method and terminal for monitoring user calls |
| CN104035558A (en) * | 2014-05-30 | 2014-09-10 | 小米科技有限责任公司 | Terminal device control method and device |
| CN104434142A (en) * | 2014-11-14 | 2015-03-25 | 惠州Tcl移动通信有限公司 | Wearable device and emotion reminding method |
| CN104699972A (en) * | 2015-03-18 | 2015-06-10 | 小米科技有限责任公司 | Emotion recognition reminding method and device |
| CN104905803A (en) * | 2015-07-01 | 2015-09-16 | 京东方科技集团股份有限公司 | Wearable electronic device and emotion monitoring method thereof |
-
2016
- 2016-01-28 CN CN201610061012.4A patent/CN105726045A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007200126A (en) * | 2006-01-27 | 2007-08-09 | Advanced Telecommunication Research Institute International | Feeling informing reporting device |
| CN201504263U (en) * | 2009-09-14 | 2010-06-09 | 幻音科技(深圳)有限公司 | Health detection mobile phone |
| CN103491251A (en) * | 2013-09-24 | 2014-01-01 | 深圳市金立通信设备有限公司 | Method and terminal for monitoring user calls |
| CN104035558A (en) * | 2014-05-30 | 2014-09-10 | 小米科技有限责任公司 | Terminal device control method and device |
| CN104434142A (en) * | 2014-11-14 | 2015-03-25 | 惠州Tcl移动通信有限公司 | Wearable device and emotion reminding method |
| CN104699972A (en) * | 2015-03-18 | 2015-06-10 | 小米科技有限责任公司 | Emotion recognition reminding method and device |
| CN104905803A (en) * | 2015-07-01 | 2015-09-16 | 京东方科技集团股份有限公司 | Wearable electronic device and emotion monitoring method thereof |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106175800A (en) * | 2016-07-10 | 2016-12-07 | 北京工业大学 | A kind of Mood State quantitative estimation method based on human motion state data |
| CN106372604A (en) * | 2016-08-31 | 2017-02-01 | 北京光年无限科技有限公司 | Intelligent robot negative emotion detection method and system |
| CN107993674A (en) * | 2016-10-27 | 2018-05-04 | 中兴通讯股份有限公司 | A kind of emotion control method and device |
| CN106512207A (en) * | 2016-11-11 | 2017-03-22 | 深圳欧德蒙科技有限公司 | Emotion regulation method and system based on galvanic skin |
| US11291796B2 (en) | 2016-12-29 | 2022-04-05 | Huawei Technologies Co., Ltd | Method and apparatus for adjusting user emotion |
| CN108604246A (en) * | 2016-12-29 | 2018-09-28 | 华为技术有限公司 | A kind of method and device adjusting user emotion |
| CN108305640A (en) * | 2017-01-13 | 2018-07-20 | 深圳大森智能科技有限公司 | Intelligent robot active service method and device |
| WO2018188097A1 (en) * | 2017-04-14 | 2018-10-18 | 格兰比圣（深圳）科技有限公司 | Method and device for regulating family atmosphere |
| CN109147824A (en) * | 2017-06-23 | 2019-01-04 | 卡西欧计算机株式会社 | Electronic equipment, emotional information obtain system and adquisitiones and storage medium |
| CN109218512A (en) * | 2017-07-06 | 2019-01-15 | 新华网股份有限公司 | Mobile terminal user emotion detection method, system and mobile terminal |
| CN110770845A (en) * | 2017-07-18 | 2020-02-07 | 梅德拉控股公司 | Method and interactive system for improving pump performance and user experience |
| CN107714056A (en) * | 2017-09-06 | 2018-02-23 | 上海斐讯数据通信技术有限公司 | A kind of wearable device of intellectual analysis mood and the method for intellectual analysis mood |
| CN108960023A (en) * | 2017-09-19 | 2018-12-07 | 炬大科技有限公司 | A kind of portable Emotion identification device |
| CN107943279A (en) * | 2017-10-27 | 2018-04-20 | 捷开通讯(深圳)有限公司 | Intelligent wearable device and method of work, the device with store function |
| CN108594991A (en) * | 2018-03-28 | 2018-09-28 | 努比亚技术有限公司 | A kind of method, apparatus and computer storage media that help user to adjust mood |
| CN108629313A (en) * | 2018-05-04 | 2018-10-09 | 河北省科学院应用数学研究所 | Emotion adjustment method, device, system and computer storage media |
| CN108629313B (en) * | 2018-05-04 | 2022-04-08 | 河北省科学院应用数学研究所 | Emotion adjusting method, device and system and computer storage medium |
| CN113287281A (en) * | 2018-09-21 | 2021-08-20 | 史蒂夫·柯蒂斯 | System and method for integrating emotion data into social network platform and sharing emotion data on social network platform |
| CN110471534A (en) * | 2019-08-23 | 2019-11-19 | 靖江市人民医院 | Information processing method and tele-medicine management system based on Emotion identification |
| CN110471534B (en) * | 2019-08-23 | 2022-11-04 | 靖江市人民医院 | Information processing method based on emotion recognition and remote medical management system |
| CN111430007A (en) * | 2020-03-19 | 2020-07-17 | 乐爱健康科技（苏州）有限公司 | Information processing method and device |
| CN111430007B (en) * | 2020-03-19 | 2023-10-20 | 乐爱健康科技（苏州）有限公司 | Information processing method and device |
| CN113144374A (en) * | 2021-04-09 | 2021-07-23 | 上海探寻信息技术有限公司 | Method and device for adjusting user state based on intelligent wearable device |
| CN114422920A (en) * | 2021-12-28 | 2022-04-29 | 歌尔科技有限公司 | Control method and device of wireless audio equipment and earphone |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105726045A (en) | Emotion monitoring method and mobile terminal thereof | |
| US20220198798A1 (en) | Computing device for enhancing communications | |
| JP2017021737A (en) | Program, terminal and system for giving emotional identifier to application by using myoelectrical signal | |
| CN115137372A (en) | Electroencephalogram data analysis system, information processing terminal, electronic device, and information presentation device for electroencephalogram analysis and examination | |
| CN103169471A (en) | Portable electroencephalogram detection system | |
| WO2018161896A1 (en) | Remote rehabilitation system | |
| CN112672120B (en) | Projector with voice analysis function and personal health data generation method | |
| US20210026449A1 (en) | Neurofeedback focus and productivity system, process, and method of use | |
| US10643636B2 (en) | Information processing apparatus, information processing method, and program | |
| US20220189626A1 (en) | Systems and methods for detecting and addressing quality issues in remote therapy sessions | |
| CN110196900A (en) | Exchange method and device for terminal | |
| CN103637774A (en) | Human startle reflex experimental system and working method thereof | |
| CN209980795U (en) | Mirror image neuron rehabilitation training system | |
| US20220054842A1 (en) | Assessing responses to sensory events and performing treatment actions based thereon | |
| CN114169366A (en) | Neurofeedback training system and method | |
| US20220184405A1 (en) | Systems and methods for labeling data in active implantable medical device systems | |
| WO2022125510A1 (en) | Systems and methods for detecting and addressing quality issues in remote therapy sessions | |
| Celestrini et al. | Applying remote health monitoring to understand users’ QoE in multisensory applications in real-time | |
| US20220015691A1 (en) | Voice training therapy app system and method | |
| WO2023145350A1 (en) | Information processing method, information processing system, and program | |
| WO2022125499A1 (en) | Systems and methods for labeling data in active implantable medical device systems | |
| WO2023157237A1 (en) | Information processing system, information processing system control method, and measurement device | |
| US11771618B2 (en) | Adaptive speech and biofeedback control of sexual stimulation devices | |
| US20240130651A1 (en) | Information processing device, control method, and storage medium | |
| WO2024009944A1 (en) | Information processing method, recording medium, and information processing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160706 |