WO2024103464A1

WO2024103464A1 - Emotion training system

Info

Publication number: WO2024103464A1
Application number: PCT/CN2022/137731
Authority: WO
Inventors: 黄艳; 梁建惠
Original assignee: 深圳先进技术研究院
Priority date: 2022-11-18
Filing date: 2022-12-08
Publication date: 2024-05-23
Also published as: CN115671489A

Abstract

Provided is an emotion training system, the system comprising: a visual presentation system (100) and a training analysis system (110), wherein a scale display module (101) in the visual presentation system (100) is configured, before training starts and after training ends, for displaying a preset emotion scale to a trainee, respectively, and sending the obtained scale data before training and scale data after training to the training analysis system (110), respectively; a stimulation presentation module (102) in the visual presentation system (100) is configured, in response to detecting a training trigger instruction, for sequentially displaying each visual stimulation signal in a visual stimulation signal set to the trainee, wherein the visual stimulation signal set is used for indicating the trainee to perform upward eye movement training; a scale analysis module (111) in the training analysis system (110) is configured for outputting an emotion training result determined on the basis of the received scale data before training and scale data after training. The emotion training system realizes the flexibility of emotion training, and reduces the time cost and the labor cost.

Description

An emotion training system

Technical Field

[01] The present invention relates to the field of medical device technology, and in particular to an emotion training system.

Background technique

[02] Emotion is a general term for a series of subjective cognitive experiences. It is a person’s attitude towards objective things and the corresponding behavioral response. It is generally believed that emotion is a psychological activity mediated by individual desires and needs. It is an emotional state that affects our behavior and psychological changes. Long-term negative emotions are a high-risk factor for many mental illnesses, such as depression, anxiety, etc.

[03] In the prior art, most of the research on emotions focuses on emotion recognition, but lacks research content on improving emotions. At present, the training methods for improving emotions mainly adopt psychological education and knowledge lectures, etc., which require the participation of experienced professionals and have high time and labor costs.

technical problem

[04] In the prior art, most of the research on emotions focuses on emotion recognition, but lacks research content on improving emotions. At present, the training methods for improving emotions mainly adopt psychological education and knowledge lectures, etc., which require the participation of experienced professionals and have high time and labor costs.

Technical Solutions

[05] The embodiment of the present invention provides an emotion training system to solve the problem in the prior art that the emotion-enhancing training process requires the guidance and participation of professionals, thereby achieving the flexibility of emotion training and reducing time and labor costs.

[06] According to one embodiment of the present invention, an emotion training system is provided, the system comprising: a visual presentation system and a training analysis system; wherein the visual presentation system comprises a scale display module and a stimulus presentation module;

[07] The scale display module is used to display the preset emotion scale to the trainee before and after the training, and send the acquired pre-training scale data and post-training scale data to the training analysis system respectively;

[08] The stimulus presentation module is used to display each visual stimulus signal in the visual stimulus signal group to the trainee in sequence in response to detecting a training trigger instruction; wherein the visual stimulus signal group is used to instruct the trainee to perform upward eye movement training;

[09] The training analysis system includes a scale analysis module, which is used to determine the emotion training results based on the received pre-training scale data and post-training scale data, and output the emotion training results.

[10] In an optional embodiment, the visual stimulation signal group includes a saccade stimulation signal group and/or a tracking stimulation signal group, wherein the saccade stimulation signal group represents the trainee performing an upward saccade task, and the tracking stimulation signal group represents the trainee performing an upward eye movement tracking task.

[11] In an optional embodiment, each visual stimulation signal in the saccadic stimulation signal group includes a saccadic fixation point stimulation signal, a blank screen stimulation signal, and a saccadic pattern stimulation signal; wherein, the graphic position of the saccadic stimulation graphic in the saccadic pattern stimulation signal is higher than the center position of the fixation point in the saccadic fixation point stimulation signal, and the vertical angle between the graphic position and the position corresponding to the center position is greater than or equal to a first angle threshold, and the emotion level corresponding to the saccadic stimulation graphic is neutral or positive.

[12] In an optional embodiment, the tracking stimulation signal group includes a first tracking stimulation signal group, the first tracking stimulation signal group includes a tracking fixation point stimulation signal and a first tracking stimulation signal, the first tracking stimulation signal represents that a first tracking stimulation graphic moves at a uniform speed along a preset upward trajectory, the vertical angle between the starting graphic position and the ending graphic position of the first tracking stimulation graphic is greater than or equal to a second angle threshold, and the emotion level corresponding to the first tracking stimulation graphic is negative, neutral or positive.

[13] In an optional embodiment, the tracking stimulation signal group includes a second tracking stimulation signal group, the second tracking stimulation signal group includes a tracking fixation point stimulation signal and a second tracking stimulation signal, the second tracking stimulation signal represents that in the process of the first tracking stimulation graphic moving at a constant speed along a preset upward trajectory, based on a preset replacement duration, the first tracking stimulation graphic is replaced by the second tracking stimulation graphic moving at a constant speed along the preset upward trajectory, the vertical angle between the starting graphic position and the ending graphic position of the first tracking stimulation graphic is greater than or equal to a third angle threshold, the emotion level corresponding to the first tracking stimulation graphic is negative or neutral, and the emotion level corresponding to the second tracking stimulation graphic is higher than that of the first tracking stimulation graphic.

[14] In an optional embodiment, the training analysis system further includes a behavior analysis device, which is used to collect training behavior data of the trainee during the emotional training process, and output training prompt information of the trainee generated based on the training behavior data; wherein the training prompt information represents the training status of the trainee during the emotional training process.

[15] In an optional embodiment, the behavior analysis device includes a button device and/or an eye tracking device, and accordingly, the training behavior data includes button response data and/or eye movement data.

[16] In an optional embodiment, when the visual stimulation signal group includes a saccadic stimulation signal group, and the behavior analysis device includes a key device, the saccadic stimulation graphic in the saccadic stimulation signal group is a face graphic, and the key response data represents the key response input by the trainee for the facial gender corresponding to the face graphic.

[17] In an optional embodiment, when the visual stimulation signal group includes a tracking stimulation signal group, the tracking stimulation signal group includes a first tracking stimulation graphic group and a second tracking stimulation graphic group, and the behavior analysis device includes a key device, the key response data represents the key response of the trainee to whether the first tracking stimulation graphic moving at a constant speed along a preset upward trajectory is replaced.

[18] In an optional embodiment, the button device is used to determine the response parameters of the trainee based on the button response data, and generate training prompt information for the trainee based on the response parameters; wherein the response parameters include response accuracy and/or target response time.

[19] In an optional embodiment, the eye tracking device is used to determine the trainee's concentration parameters based on the eye movement data, and generate training prompt information for the trainee based on the concentration parameters; wherein the concentration parameters include at least one of gaze duration, eye movement direction, eye movement angle, eye movement distance and eye movement speed.

[20] In an optional embodiment, the visual presentation system further includes a selection module, which is used to, in response to detecting a selection instruction corresponding to a training selection control, add a training stimulus signal group corresponding to the training selection control to a visual stimulus signal group and generate a training trigger instruction; wherein the training selection control includes a saccade selection control and/or a tracking selection control, and the training stimulus signal group is a saccade stimulus signal group or a tracking stimulus signal group.

Beneficial Effects

[21] The technical solution of the embodiment of the present invention is to set up a visual presentation system and a training analysis system, wherein the visual presentation system includes a scale display module and a stimulus presentation module, the scale display module is used to display a preset emotion scale to the trainee before and after the training, and send the acquired pre-training scale data and post-training scale data to the training analysis system respectively, the stimulus presentation module is used to display each visual stimulus signal in the visual stimulus signal group to the trainee in turn in response to detecting a training trigger instruction; wherein the visual stimulus signal group is used to instruct the trainee to do upward eye movement training, and the training analysis system includes a scale analysis module, which is used to determine the emotion training result based on the received pre-training scale data and post-training scale data, and output the emotion training result, thereby solving the problem in the prior art that the emotion training process needs the guidance and participation of professionals, realizing the flexibility of emotion training, and reducing time cost and labor cost.

[22] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description.

BRIEF DESCRIPTION OF THE DRAWINGS

[23] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[24] FIG1 is a schematic diagram of the structure of an emotion training system provided by an embodiment of the present invention;

[25] FIG. 2 is a schematic diagram of a position vertical angle provided by an embodiment of the present invention;

[26] FIG3 is a schematic diagram of a saccadic stimulation signal group provided by an embodiment of the present invention;

[27] FIG. 4 is a schematic diagram of a first tracking stimulation signal group provided by an embodiment of the present invention;

[28] FIG. 5 is a schematic diagram of a second tracking stimulation signal group provided by an embodiment of the present invention;

[29] FIG. 6 is a schematic diagram of the structure of another emotion training system provided by an embodiment of the present invention;

[30] FIG. 7 is a schematic diagram of the structure of another emotion training system provided by an embodiment of the present invention;

[31] FIG8 is a rendering of a display interface of a selection module provided by an embodiment of the present invention;

[32] FIG. 9 is a rendering of a display interface of another selection module provided by an embodiment of the present invention;

[33] FIG10 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention.

Embodiments of the present invention

[34] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[35] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units that are not explicitly listed or inherent to these processes, methods, products or devices.

[36] FIG. 1 is a schematic diagram of the structure of an emotion training system provided by an embodiment of the present invention. This embodiment is applicable to the situation of training the emotions of the trainee. The system can be implemented in the form of software and/or hardware.

[37] In this embodiment, the emotion training system includes: a visual presentation system 100 and a training analysis system 110; wherein the visual presentation system 100 includes a scale display module 101 and a stimulus presentation module 102; the scale display module 101 is used to display a preset emotion scale to the trainee before and after the training, and send the acquired pre-training scale data and post-training scale data to the training analysis system 110 respectively; the stimulus presentation module 102 is used to display each visual stimulus signal in the visual stimulus signal group to the trainee in turn in response to detecting a training trigger instruction; wherein the visual stimulus signal group is used to instruct the trainee to perform upward eye movement training; the training analysis system 110 includes a scale analysis module 111, which is used to determine the emotion training result based on the received pre-training scale data and post-training scale data, and output the emotion training result.

[38] Exemplarily, the visual presentation system 100 may be composed of a host, a liquid crystal display with a high refresh rate (144 Hz), and psychological visual presentation software, wherein the psychological visual presentation software may be a Matlab (matrix factory) and Psychtoolbox (psychology toolbox) toolkit, and the visual stimulus signal may be presented to the trainee through the liquid crystal display using the Psychtoolbox programming in Maltlab, and the stimulus brightness may be accurately measured by a photometer (unit: cd/ ^cm2 ).

[39] Specifically, the scale display module 101 is used to display the preset emotion scale to the trainee before the trainee conducts emotion training, and send the pre-training scale data input by the trainee based on the preset emotion scale to the training analysis system 110; and after the trainee conducts emotion training, display the preset emotion scale to the trainee again, and send the post-training scale data input by the trainee based on the preset emotion scale to the training analysis system 110.

[40] Specifically, the preset emotion scale may be one or more. Exemplarily, the preset emotion scale includes but is not limited to the Positive and Negative Emotion Scale, the Hamilton Depression Rating Scale, the Hamilton Anxiety Rating Scale, and the Depression-Anxiety-Stress Scale (DASS-21), etc. The preset emotion scale used is not limited here.

[41] Among them, exemplarily, the pre-training scale data or the post-training scale data includes but is not limited to the score of each item in the preset emotion scale, the total score of all items in the preset training scale, the grade of each item in the preset emotion scale and the total grade of all items in the preset training scale, etc.

[42] Specifically, the visual stimulation signal group is set by programming with Psychtoolbox in Maltlab, wherein the visual stimulation signal group includes a plurality of visual stimulation signals. In an optional embodiment, the stimulation presentation module 102 is specifically used to display each visual stimulation signal to the trainee in sequence based on the presentation duration corresponding to each visual stimulation signal in the visual stimulation signal group in response to detecting the training trigger instruction. The presentation duration corresponding to each visual stimulation signal can be the same or different.

[43] In an optional embodiment, the visual stimulation signal group includes a saccade stimulation signal group and/or a tracking stimulation signal group, wherein the saccade stimulation signal group represents the trainee performing an upward saccade task, and the tracking stimulation signal group represents the trainee performing an upward eye movement tracking task.

[44] Specifically, the visual stimulation signal group includes multiple groups of saccade stimulation signal groups and/or multiple groups of tracking stimulation signal groups. Exemplarily, the training time corresponding to the visual stimulation signal group can be 10 minutes or 15 minutes. The training time is not limited here.

[45] In which, exemplary, the emotion training results include but are not limited to whether the emotion level is improved, the difference in emotion levels, and the emotion improvement ratio. For example, the emotion level corresponding to the scale data before training is 10, and the emotion level corresponding to the scale data after training is 25, then the emotion level is improved, the difference in emotion levels is 10, and the emotion improvement ratio is 150%.

[46] In an optional embodiment, outputting the emotion training results includes: sending the emotion training results to the visual presentation system 100, so that the visual presentation system 100 outputs the received emotion training results.

[47] In another optional embodiment, outputting the emotion training result includes: sending the emotion training result to a mobile terminal. Exemplarily, the emotion training result may be sent in the form of text message, email, phone call, etc.

[48] The technical solution of this embodiment is to set up a visual presentation system and a training analysis system, wherein the visual presentation system includes a scale display module and a stimulus presentation module, the scale display module is used to display a preset emotion scale to the trainee before and after the training, and send the acquired pre-training scale data and post-training scale data to the training analysis system respectively, the stimulus presentation module is used to display each visual stimulus signal in the visual stimulus signal group to the trainee in turn in response to detecting a training trigger instruction; wherein the visual stimulus signal group is used to instruct the trainee to do upward eye movement training, and the training analysis system includes a scale analysis module, which is used to determine the emotion training result based on the received pre-training scale data and post-training scale data, and output the emotion training result, thereby solving the problem in the prior art that the emotion-enhancing training process requires the guidance and participation of professionals, realizing the flexibility of emotion training, and reducing time and labor costs.

[49] Based on the above embodiment, the embodiment of the present invention further refines the "eye-saccade stimulation signal group" and "pursuit stimulation signal group" in the above embodiment.

[50] In an optional embodiment, each visual stimulation signal in the saccade stimulation signal group includes a saccade fixation point stimulation signal, a blank screen stimulation signal, and a saccade pattern stimulation signal; wherein, the graphic position of the saccade stimulation graphic in the saccade pattern stimulation signal is higher than the center position of the fixation point in the saccade fixation point stimulation signal, and the vertical angle between the graphic position and the position corresponding to the center position is greater than or equal to a first angle threshold, and the emotion level corresponding to the saccade stimulation graphic is neutral or positive.

[51] Specifically, the presentation durations of the saccadic fixation point stimulation signal, the blank screen stimulation signal, and the saccadic pattern stimulation signal may be the same or different.

[52] Specifically, the eye-saccade stimulation graphics can be screened from a first emotion graphics library. Exemplarily, the first emotion graphics library includes but is not limited to the Geneva emotion graphics library (GAPED), KDEF emotion graphics library, AKDEF emotion graphics library, Fer2013 emotion graphics library, RaFD emotion graphics library, etc. The first emotion graphics library used here is not limited.

[53] Specifically, the graphic position can be used to represent the graphic center position of the eye-saccade stimulation graphic. When the trainee keeps his head fixed during the emotional training, the vertical angle of the position can be used to represent the vertical angle between the first line connecting the trainee's eyeball and the center position and the second line connecting the eyeball and the graphic position. Exemplarily, the first angle threshold can be 12°, which is not limited here.

[54] FIG. 2 is a schematic diagram of a position vertical angle provided by an embodiment of the present invention. Specifically, the “eye” on the left side of FIG. 2 represents the eye position of the trainee during the emotion training process, “A” represents the first line between the eye and the center position, “B” represents the second line between the eye and the graphic position, and “α” represents the position vertical angle.

[55] For example, assuming that the distance between the trainee's eyeball and the visual presentation system 100 is 30 cm, and the first angle threshold is 12°, the vertical distance between the graphic position and the center position must be greater than or equal to 6.38 cm. Specifically, the graphic position of the saccadic stimulation graphic can be directly above, to the upper left, or to the upper right of the gaze point. The graphic position of the saccadic stimulation graphic in the horizontal direction is not limited here.

[56] FIG3 is a schematic diagram of a saccadic stimulation signal group provided by an embodiment of the present invention. Specifically, the saccadic stimulation signal group includes a 500ms saccadic fixation point stimulation signal, a 500ms blank screen stimulation signal, and a 1000ms saccadic pattern stimulation signal. FIG3 takes the graphic position of the saccadic stimulation pattern directly above the fixation point as an example. It can be understood that the graphic position of the saccadic stimulation pattern is included in all upper display areas where the vertical angle of the position is greater than or equal to the first angle threshold.

[57] In an optional embodiment, the tracking stimulation signal group includes a first tracking stimulation signal group, the first tracking stimulation signal group includes a tracking fixation point stimulation signal and a first tracking stimulation signal, the first tracking stimulation signal represents that the first tracking stimulation graphic moves at a uniform speed along a preset upward trajectory, the vertical angle between the starting graphic position and the ending graphic position of the first tracking stimulation graphic is greater than or equal to a second angle threshold, and the emotion level corresponding to the first tracking stimulation graphic is negative, neutral or positive.

[58] Specifically, the first tracking stimulus pattern can be obtained by screening from the second emotion pattern library. For example, the second emotion pattern library includes but is not limited to the Geneva emotion pattern library (GAPED), KDEF emotion pattern library, AKDEF emotion pattern library, Fer2013 emotion pattern library, RaFD emotion pattern library, etc. The second emotion pattern library used is not limited here. Specifically, the first emotion pattern library and the second emotion pattern library can be the same or different.

[59] Specifically, the starting graphic position can be used to represent the position of the graphic center of the first tracking stimulation graphic at the starting point, and the ending graphic position can be used to represent the position of the graphic center of the first tracking stimulation graphic at the ending point. Exemplarily, the starting point can be the fixation point in the tracking fixation point stimulation signal, and the specific starting graphic position is not limited here.

[60] Specifically, when the trainee keeps his head fixed during the emotion training, the vertical angle of the position can be used to represent the vertical angle between the first line connecting the trainee's eyeball and the starting graphic position and the second line connecting the eyeball and the ending graphic position. Exemplarily, the second angle threshold can be 12°, and the second angle threshold is not limited here. Specifically, the first angle threshold and the second angle threshold can be the same or different.

[61] For example, assuming that the distance between the starting and ending positions of the first tracking stimulation pattern is 9 cm, and the presentation duration of the first tracking stimulation signal is 3000 ms, the moving speed of the first tracking stimulation pattern is 3 cm/s.

[62] In which, illustratively, the termination graphic position of the first tracking stimulation graphic may be directly above, to the upper left, or to the upper right of the fixation point, etc. The graphic position of the first tracking stimulation graphic in the horizontal direction is not limited here.

[63] FIG4 is a schematic diagram of a first tracking stimulation signal group provided by an embodiment of the present invention. Specifically, the first tracking stimulation signal group includes a 500 ms tracking fixation point stimulation signal and a 3000 ms first tracking stimulation signal. FIG4 takes the example of the termination graphic position of the first tracking stimulation graphic being directly above the fixation point. It can be understood that the termination graphic position of the first tracking stimulation graphic is included in all upper display areas where the vertical angle of the position is greater than or equal to the second angle threshold.

[64] In an optional embodiment, the tracking stimulation signal group includes a second tracking stimulation signal group, the second tracking stimulation signal group includes a tracking fixation point stimulation signal and a second tracking stimulation signal, the second tracking stimulation signal represents that in the process of the first tracking stimulation graphic moving at a constant speed along a preset upward trajectory, based on a preset replacement duration, the first tracking stimulation graphic is replaced by the second tracking stimulation graphic and moves at a constant speed along the preset upward trajectory, the vertical angle between the starting graphic position and the ending graphic position of the first tracking stimulation graphic is greater than or equal to a third angle threshold, the emotion level corresponding to the first tracking stimulation graphic is negative or neutral, and the emotion level corresponding to the second tracking stimulation graphic is higher than that of the first tracking stimulation graphic.

[65] Specifically, the first tracking stimulus graphic can be obtained by screening from the second emotion graphic library. Exemplarily, the second emotion graphic library includes but is not limited to the Geneva emotion graphic library (GAPED), KDEF emotion graphic library, AKDEF emotion graphic library, Fer2013 emotion graphic library, RaFD emotion graphic library, etc. The second emotion graphic library used here is not limited.

[66] Specifically, the second tracking stimulus pattern can be obtained by screening from a third emotion pattern library. For example, the third emotion pattern library includes but is not limited to the Geneva emotion pattern library (GAPED), KDEF emotion pattern library, AKDEF emotion pattern library, Fer2013 emotion pattern library, RaFD emotion pattern library, etc. The third emotion pattern library used is not limited here. Specifically, the first emotion pattern library, the second emotion pattern library and the third emotion pattern library can be the same or different.

[67] Specifically, the replacement time point of the second tracking stimulation pattern can be random, such as the second tracking stimulation pattern can be replaced after the first tracking stimulation pattern moves 100ms, or can be replaced after the first tracking stimulation pattern moves 500ms. Exemplarily, the preset replacement time length can be 100ms or 200ms, and the preset replacement time length is not limited here.

[68] Specifically, when the emotion level corresponding to the first tracking stimulus graphic is negative, the emotion level corresponding to the second tracking stimulus graphic is neutral or positive; and when the emotion level corresponding to the first tracking stimulus graphic is neutral, the emotion level corresponding to the second tracking stimulus graphic is positive.

[69] FIG5 is a schematic diagram of a second tracking stimulation signal group provided by an embodiment of the present invention. Specifically, the second tracking stimulation signal group includes a 500ms tracking fixation point stimulation signal and a 3000ms second tracking stimulation signal, wherein the second tracking stimulation signal includes a preset replacement duration of 100ms for a second tracking stimulation graphic to replace the first tracking stimulation graphic. FIG5 takes the example of the termination graphic position of the first tracking stimulation graphic being directly above the fixation point. It can be understood that the termination graphic position of the first tracking stimulation graphic is included in all upper display areas where the vertical angle of the position is greater than or equal to the second angle threshold.

[70] Based on the above embodiment, the emotion training system further includes a forehead support, which is used to support the head of the trainee and keep the head of the trainee stationary during the emotion training.

[71] Figure 6 is a schematic diagram of the structure of another emotion training system provided by an embodiment of the present invention. The embodiment of the present invention further refines the training analysis system 110 in the above embodiment.

[72] As shown in FIG6 , the training analysis system 110 further includes a behavior analysis device 112, which is used to collect training behavior data of the trainee during the emotional training process, and output training prompt information of the trainee generated based on the training behavior data; wherein the training prompt information represents the training status of the trainee during the emotional training process.

[73] Specifically, the behavior analysis device 112 is activated in response to detecting a training trigger instruction. In an optional embodiment, the behavior analysis device 112 includes a key device and/or an eye tracking device, and accordingly, the training behavior data includes key response data and/or eye movement data.

[74] In one example, the key device may be a remote controller, a keyboard, a mouse or other device that can realize key functions. In one example, the key response data may be used to characterize the attribute data of the key behavior input by the trainee based on the preset key task. In one example, the key response data includes at least one key behavior signal and the signal response duration corresponding to each key behavior signal.

[75] In particular, the eye tracking device exemplarily includes a camera unit for collecting eye movement data of the trainee, wherein the eye movement data includes eye movement trajectory and gaze point position, etc.

[76] Based on the above embodiment, optionally, when the visual stimulation signal group includes at least two saccadic stimulation signal groups and the behavior analysis device 112 includes a button device, each saccadic stimulation signal group includes two graphic types of saccadic stimulation graphics, and the button response data represents the button response of the trainee to the graphic type corresponding to the saccadic stimulation graphics.

[77] In which, illustratively, the graphic types of the saccadic stimulation graphics include landscape graphics and face graphics, the graphic types of the saccadic stimulation graphics include cartoon graphics and face graphics, or the graphic types of the saccadic stimulation graphics include landscape graphics and cartoon graphics, etc. The two graphic types are not limited here.

[78] Taking the button device as a mouse as an example, assuming that the graphic types of the saccadic stimulation graphics include landscape graphics and face graphics, when the graphic type of the saccadic stimulation graphics in the current saccadic stimulation signal group is the landscape type, the trainee can press the left button of the mouse; when the graphic type of the saccadic stimulation graphics in the current saccadic stimulation signal group is the face type, the trainee can press the right button of the mouse.

[79] Based on the above embodiment, optionally, when the visual stimulation signal group includes a saccadic stimulation signal group, and the behavior analysis device 112 includes a button device, the saccadic stimulation graphic in the saccadic stimulation signal group is a face graphic, and the button response data represents the button response input by the trainee for the facial gender corresponding to the face graphic.

[80] Taking the button device as a mouse as an example, when the face gender of the eye-saccade stimulation graphic in the current eye-saccade stimulation signal group is male, the trainee can press the left button of the mouse; when the face gender of the eye-saccade stimulation graphic in the current eye-saccade stimulation signal group is female, the trainee can press the right button of the mouse.

[81] Based on the above embodiment, optionally, when the visual stimulation signal group includes a tracking stimulation signal group, the tracking stimulation signal group includes a first tracking stimulation graphic group and a second tracking stimulation graphic group, and the behavior analysis device 112 includes a button device, the button response data represents the trainee's button response to whether the first tracking stimulation graphic moving at a constant speed along a preset upward trajectory is replaced.

[82] Taking the button device as a mouse as an example, when the first tracking stimulation pattern in the current tracking stimulation signal group is replaced, the trainee can press the left button of the mouse.

[83] In an optional embodiment, training prompt information of the trainee generated based on the training behavior data is output, including: determining the training parameters of the trainee based on the training behavior data, generating training prompt information based on the comparison result between the training parameters and the preset parameter range, and outputting the training prompt information.

[84] Specifically, the training parameters include response parameters determined based on the keystroke behavior data and/or focus parameters determined based on the eye movement data. The response parameters include response accuracy and/or target response duration, and the focus parameters include at least one of gaze duration, eye movement direction, eye movement angle, eye movement distance, and eye movement speed.

[85] Based on the above embodiment, optionally, a button device is used to determine the trainee's response parameters based on the button response data, and generate training prompt information for the trainee based on the response parameters; wherein the response parameters include response accuracy and/or target response time.

[86] Specifically, the key response data includes at least one key behavior signal and a signal response duration corresponding to each key behavior signal.

[87] In one embodiment, the key response data includes at least one key behavior signal. For each key behavior signal, if the key classification corresponding to the key behavior signal is the same as the true classification, the key behavior signal is marked as "correct", and if the key classification corresponding to the key behavior signal is different from the true classification, the key behavior signal is marked as "wrong", and the ratio between the number of "correct" key behavior signals and the number of signal groups corresponding to the visual stimulus signal group is used as the response accuracy. The key classification represents the classification of the graphic type, the classification of the face gender, or the replacement classification of the first tracking stimulus graphic.

[88] For example, assuming that the key-pressing behavior signal is a key-pressing behavior signal corresponding to the eye-saccade stimulation signal group, and the trainee's key-pressing task includes distinguishing the gender of the face of the eye-saccade stimulation pattern, then the total number of key-pressing represents the number of signal groups corresponding to the eye-saccade stimulation signal group. If the key classification corresponding to the key-pressing behavior signal is male (left key), and the real classification corresponding to the key-pressing behavior signal is male (left key), then the key-pressing behavior signal is marked as "correct". Assuming that the key-pressing behavior signal is a key-pressing behavior signal corresponding to the tracking stimulation signal group, and the trainee's key-pressing task includes determining whether the first tracking stimulation pattern is replaced, then the total number of key-pressing guarantees the number of signal groups corresponding to the tracking stimulation signal group. If the key classification corresponding to the key-pressing behavior signal is replaced (key-pressing), and the real classification corresponding to the key-pressing behavior signal is replaced (key-pressing), then the key-pressing behavior signal is marked as "correct".

[89] In one embodiment, the key response data includes a signal response duration corresponding to at least one key behavior signal, and the signal response duration can be used to characterize the time length between the appearance time of the eye saccade stimulation pattern in the eye saccade stimulation signal and the key pressing time, or the signal response duration can be used to characterize the time length between the appearance time of the second tracking stimulation pattern in the second tracking stimulation signal group and the key pressing time. Specifically, based on the key response data, determining the response parameter of the trainee includes: taking the mean value of the signal response duration in the key response data as the trainee's target response duration, or taking the mean value of the signal response duration corresponding to the "correct" key behavior signal in the key response data as the trainee's target response duration.

[90] In an optional embodiment, the eye tracking device is used to determine the trainee's concentration parameters based on the eye movement data, and generate training prompt information for the trainee based on the concentration parameters; wherein the concentration parameters include at least one of gaze duration, eye movement direction, eye movement angle, eye movement distance and eye movement speed.

[91] Specifically, the eye movement data includes eye movement trajectory and fixation point position. Fixation duration can be used to indicate the duration of the trainee's eye movement trajectory remaining within the preset area where the fixation point is located during the presentation duration of the saccade fixation point stimulation signal or the tracking fixation point stimulation signal; eye movement direction can be used to indicate the trainee's eye movement direction corresponding to the saccade stimulation signal group or the tracking stimulation signal group; eye movement angle can be used to indicate the trainee's eye movement angle corresponding to the saccade stimulation signal group or the tracking stimulation signal group; eye movement distance can be used to indicate the trainee's eye movement distance corresponding to the saccade stimulation signal group; and eye movement speed can be used to indicate the trainee's eye movement speed corresponding to the tracking stimulation signal group.

[92] Specifically, generating training prompt information for the trainee based on the focus parameter includes: comparing the focus parameter with a preset parameter range, and generating training prompt information for the trainee based on the comparison result. The preset parameter range corresponding to the fixation duration may be determined based on the presentation duration of the eye saccade fixation point stimulation signal or the tracking fixation point stimulation signal, the preset parameter range corresponding to the eye movement angle may be determined based on the vertical angle of the position, and the preset parameter range corresponding to the eye movement speed may be determined based on the moving speed of the first tracking stimulation pattern.

[93] Specifically, if the training parameters satisfy the preset parameter range, the training state represented by the generated training prompt information is better; if the training parameters do not satisfy the preset parameter range, the training state represented by the generated training prompt information is worse.

[94] Based on the above embodiment, optionally, the training prompt information is output, including: when the training parameters do not meet the preset parameter range, the training prompt information is output. In this embodiment, the output training prompt information is the training prompt information indicating that the training state is poor. The advantage of such a setting is that the training prompt information is not outputted all the time during the emotion training process, which affects the training state of the trainee.

[95] In an optional embodiment, outputting the training prompt information includes: sending the training prompt information to the visual presentation system 100, so that the visual presentation system 100 outputs the received training prompt information. In this embodiment, the information type of the training prompt information is text information or color information. Exemplarily, the text information is "The training status is poor, please pay attention", and the color information is red.

[96] In another optional embodiment, the output form of the training prompt information includes but is not limited to a sound prompt or an indicator light prompt. In which, for example, the sound prompt may be a voice prompt, such as "The training status is poor, please pay attention", the sound prompt may also be a prompt tone prompt, such as a prompt tone with a higher output frequency, and the indicator light prompt may be an indicator light with a higher flashing frequency. The specific output form of the training prompt information is not limited here.

[97] The technical solution of this embodiment is to set up a behavior analysis device in the training analysis system to collect the training behavior data of the trainee during the emotional training process, and output the training prompt information of the trainee generated based on the training behavior data, wherein the training prompt information represents the training status of the trainee during the emotional training process, solves the problem that the trainee's concentration is reduced during the emotional training process and affects the training effect, realizes the purpose of real-time feedback on the training status during the training process, and improves the training effect of the emotional training system.

[98] Figure 7 is a schematic diagram of the structure of another emotion training system provided by an embodiment of the present invention. This embodiment further refines the visual presentation system 100 in the above embodiment.

[99] As shown in FIG7 , the visual presentation system 100 further includes a selection module 103, which is used to, in response to detecting a selection instruction corresponding to a training selection control, add a training stimulus signal group corresponding to the training selection control to the visual stimulus signal group and generate a training trigger instruction; wherein the training selection control includes a saccade selection control and/or a tracking selection control, and the training stimulus signal group is a saccade stimulus signal group or a tracking stimulus signal group.

[100] In one embodiment, in response to detecting a trigger operation input by a trainee based on a training selection control on the display interface of the selection module 103, a selection instruction corresponding to the training selection control is generated. Specifically, only one training selection control can be selected in one trigger operation. Accordingly, in this embodiment, the visual stimulation signal group includes a saccade stimulation signal group or a pursuit stimulation signal group.

[101] FIG8 is a rendering of a display interface of a selection module provided in an embodiment of the present invention. Specifically, the “saccade training task” and “tracking training task” in FIG8 represent training selection controls, respectively. In this embodiment, the training selection control is a command control that responds to a single click by the trainee to trigger an operation.

[102] In another embodiment, in response to detecting a trigger operation input by the trainer based on the training trigger control on the display interface of the selection module 103, a selection instruction is generated based on the training selection control in the selected state. Specifically, before the trigger operation based on the training trigger control input, the trainer may input a selection operation based on the training selection control in the display interface of the selection module 103 in advance, and accordingly, the control state of the training selection control corresponding to the selection operation is set to the selected state. In this embodiment, the visual stimulation signal group includes an eye saccade stimulation signal group and/or a tracking stimulation signal group.

[103] FIG9 is a rendering of the display interface of another selection module provided by an embodiment of the present invention. Specifically, the “eye-saccade training task” and “tracking training task” in FIG9 represent training selection controls, respectively, and “start training” represents a training trigger control, wherein the training trigger control is a command control that responds to a single-click trigger operation by the trainee; the training selection control is a checkbox control that has two control states: a selected state and an unselected state.

[104] The technical solution of this embodiment is to set a selection module in the visual presentation system, wherein the selection module is used to add the training stimulus signal group corresponding to the training selection control to the visual stimulus signal group in response to detecting a selection instruction corresponding to the training selection control, and generate a training trigger instruction, wherein the training selection control includes a saccade selection control and/or a tracking selection control, and the training stimulus signal group is a saccade stimulus signal group or a tracking stimulus signal group, thereby solving the problem that the emotion training system cannot customize the selection of the visual stimulus signal group, so that the trainee can make personalized selection of the visual stimulus signal group used for emotion training, further improving the flexibility and pertinence of the emotion training system.

[105] FIG. 10 is a schematic diagram of the structure of an electronic device provided in accordance with an embodiment of the present invention. The electronic device 10 may be configured with a functional device in the visual presentation system 100 or a functional device in the training analysis system 110 in accordance with an embodiment of the present invention.

[106] Specifically, electronic device 10 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The components, their connections and relationships, and their functions shown in the embodiments of the present invention are merely examples and are not intended to limit the implementation of the present invention described and/or claimed herein.

[107] As shown in FIG. 10 , the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11 in communication, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program executable by the at least one processor 11, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to the bus 14.

[108] A number of components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.

[109] The processor 11 may be a variety of general and/or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the emotion training method in the above embodiment.

[110] In some embodiments, the emotion training method described above may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed on the electronic device 10 via the ROM 12 and/or the communication unit 19.

[111] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and/or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[112] It is worth noting that in the above-mentioned embodiment of the emotion training system, the various units, modules and devices included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

Claims

An emotion training system, characterized by comprising: a visual presentation system and a training analysis system; wherein the visual presentation system comprises a scale display module and a stimulus presentation module;

The scale display module is used to display the preset emotion scale to the trainee before and after the training, and send the acquired pre-training scale data and post-training scale data to the training analysis system respectively;

The stimulation presentation module is used for displaying each visual stimulation signal in the visual stimulation signal group to the trainee in sequence in response to detecting the training trigger instruction; wherein the visual stimulation signal group is used to instruct the trainee to perform upward eye movement training;

The training analysis system includes a scale analysis module, which is used to determine the emotion training result based on the received pre-training scale data and post-training scale data, and output the emotion training result.
The emotion training system according to claim 1 is characterized in that the visual stimulation signal group includes a saccade stimulation signal group and/or a tracking stimulation signal group, wherein the saccade stimulation signal group represents that the trainee performs an upward saccade task, and the tracking stimulation signal group represents that the trainee performs an upward eye movement tracking task.
The emotion training system according to claim 2 is characterized in that each visual stimulation signal in the saccade stimulation signal group includes a saccade fixation point stimulation signal, a blank screen stimulation signal and a saccade graphic stimulation signal; wherein the graphic position of the saccade stimulation graphic in the saccade graphic stimulation signal is higher than the center position of the fixation point in the saccade fixation point stimulation signal, and the vertical angle between the graphic position and the position corresponding to the center position is greater than or equal to a first angle threshold, and the emotion level corresponding to the saccade stimulation graphic is neutral or positive.
The emotion training system according to claim 2 is characterized in that the tracking stimulation signal group includes a first tracking stimulation signal group, the first tracking stimulation signal group includes a tracking gaze point stimulation signal and a first tracking stimulation signal, the first tracking stimulation signal represents that the first tracking stimulation graphic moves at a uniform speed along a preset upward trajectory, the vertical angle between the starting graphic position and the ending graphic position of the first tracking stimulation graphic is greater than or equal to a second angle threshold, and the emotion level corresponding to the first tracking stimulation graphic is negative, neutral or positive.
The emotion training system according to claim 2 is characterized in that the tracking stimulation signal group includes a second tracking stimulation signal group, the second tracking stimulation signal group includes a tracking fixation point stimulation signal and a second tracking stimulation signal, the second tracking stimulation signal represents that in the process of the first tracking stimulation graphic moving at a uniform speed along a preset upward trajectory, based on a preset replacement duration, the first tracking stimulation graphic is replaced by the second tracking stimulation graphic moving at a uniform speed along the preset upward trajectory, the vertical angle between the starting graphic position and the ending graphic position of the first tracking stimulation graphic is greater than or equal to a third angle threshold, the emotion level corresponding to the first tracking stimulation graphic is negative or neutral, and the emotion level corresponding to the second tracking stimulation graphic is higher than that of the first tracking stimulation graphic.
The emotion training system according to claim 2 is characterized in that the training analysis system also includes a behavior analysis device, which is used to collect training behavior data of the trainee during the emotion training process, and output training prompt information of the trainee generated based on the training behavior data; wherein the training prompt information represents the training status of the trainee during the emotion training process.
The emotion training system according to claim 6 is characterized in that the behavior analysis device includes a button device and/or an eye tracking device, and correspondingly, the training behavior data includes button response data and/or eye movement data.
The emotion training system according to claim 7 is characterized in that when the visual stimulation signal group includes a saccadic stimulation signal group and the behavior analysis device includes a key device, the saccadic stimulation graphic in the saccadic stimulation signal group is a face graphic, and the key response data represents the key response input by the trainee for the facial gender corresponding to the face graphic.
The emotion training system according to claim 8 is characterized in that when the visual stimulation signal group includes a tracking stimulation signal group, the tracking stimulation signal group includes a first tracking stimulation graphic group and a second tracking stimulation graphic group, and the behavior analysis device includes a key device, the key response data represents the key response of the trainee to whether the first tracking stimulation graphic moving at a constant speed along a preset upward trajectory is replaced.
The emotion training system according to claim 8 or 9 is characterized in that the button device is used to determine the response parameters of the trainee based on the button response data, and generate training prompt information for the trainee based on the response parameters; wherein the response parameters include response accuracy and/or target response duration.
The emotion training system according to claim 7 is characterized in that the eye tracking device is used to determine the concentration parameters of the trainee based on the eye movement data, and generate training prompt information for the trainee based on the concentration parameters; wherein the concentration parameters include at least one of gaze duration, eye movement direction, eye movement angle, eye movement distance and eye movement speed.
The emotion training system according to claim 2 is characterized in that the visual presentation system also includes a selection module, which is used to add the training stimulus signal group corresponding to the training selection control to the visual stimulus signal group in response to detecting a selection instruction corresponding to the training selection control, and generate a training trigger instruction; wherein the training selection control includes a saccade selection control and/or a tracking selection control, and the training stimulus signal group is a saccade stimulus signal group or a tracking stimulus signal group.