CN107799165A - A kind of psychological assessment method based on virtual reality technology - Google Patents

A kind of psychological assessment method based on virtual reality technology Download PDF

Info

Publication number
CN107799165A
CN107799165A CN201710839186.3A CN201710839186A CN107799165A CN 107799165 A CN107799165 A CN 107799165A CN 201710839186 A CN201710839186 A CN 201710839186A CN 107799165 A CN107799165 A CN 107799165A
Authority
CN
China
Prior art keywords
data
psychological assessment
question
answer
neural networks
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710839186.3A
Other languages
Chinese (zh)
Inventor
徐向民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Bo Wei Intelligent Technology Co., Ltd.
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CN201710839186.3A priority Critical patent/CN107799165A/en
Publication of CN107799165A publication Critical patent/CN107799165A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks

Abstract

Psychological assessment method of the invention based on virtual reality technology, by mental scale virtual scene;Collection subject question and answer, behavior and physiological data in real time;Question and answer option based on subject, complete the intelligent skip of mental scale problem;Comprehensive intelligent analysis is carried out to gauge content, by three class data by carrying out Fusion Features after convolutional neural networks, Recognition with Recurrent Neural Network training, softmax layers is input to, draws psychological assessment model;Subject's psychological assessment result is compared with doctor's label using psychological assessment model, by counting loss function and gradient reverse conduction, intelligent correction is carried out to subject's question and answer option;Physiology, behavior and calibrated question and answer data are calculated by psychological assessment model again, obtain final assessment result.The technologies such as VR, intelligent sensing, big data analysis, artificial intelligence are combined by the present invention with traditional psychological assessment method, are improved the accuracy of psychological assessment, are effectively saved medical resource.

Description

A kind of psychological assessment method based on virtual reality technology
Technical field
The present invention relates to mental health domains, intelligent sensing field, virtual reality technology, big data analysis field and artificial A kind of smart field etc., and in particular to psychological assessment method based on virtual reality technology.
Background technology
As the fast development of social economy and competitive pressure continue to increase, all kinds of Psychological Health Problems emerge in an endless stream.
But the corresponding medical resource wretched insufficiency in China, China's clinical diagnosis psychological problems typically first pass through equipment at present Check to exclude organic disease, then assess using scale and doctor assess by the way of being combined whether to make a definite diagnosis with psychology Disease, the aspectant diagnosis of doctors and patients excessively rely on the professional knowledge of doctor and subjective opinion.In view of patient generally has sick shame sense, With that may have been concealed in the aspectant communication process of doctor, this causes doctor patient communication very big difficulty to be present.
Virtual reality (Virtual Reality, VR) technology is widelyd popularize and developed in recent years, in medical field Existing certain application, and also attempted in terms of mental disease treatment.VR technologies can be built and real world heights Similar virtual world, user can carry out, close to really interacting, producing experience on the spot in person with virtual world.
VR technologies, intelligent sensing technology, big data analytical technology, artificial intelligence technology and traditional mental scale are assessed into phase With reference to improving the limitation that traditional psychological assessment method is brought, the sick shame sense of deficiency, sufferer including medical resource, comment Estimate the subjectivity of process.By the effective psychological assessment scene of VR technique constructions, self-service psychological assessment side is provided for user Method, Waiting time can be saved, save medical resource, increase the comfort level of user, reduce the sick shame sense of user, raising makes The fitness of user and the validity of psychological assessment;Gather user's physiological data and behavioral data in real time in evaluation process, User's real-time status is analyzed using intelligent information processing technology, intelligent correction is carried out to subject's question and answer option, psychology is improved and comments Estimate the accuracy and objectivity of result;By standardizing interrogation process, can solve the present situation of quantification difficult in traditional interrogation.Simultaneously With reference to big data technology, the excavation of user individual psychological characteristics and regularity summarization are carried out, lifts the accuracy of psychological assessment.
Therefore, by VR technologies, intelligent sensing technology, virtual reality technology, big data analytical technology, artificial intelligence technology with Traditional psychological assessment method is combined, and can make up many deficiencies of conventional method, and provide one to assess psychological condition Kind new method and thinking.
The content of the invention
To solve the problems of prior art, the present invention provides a kind of psychological assessment side based on virtual reality technology Method, this method is by VR technologies, intelligent sensing technology, big data analytical technology, artificial intelligence technology and traditional psychological assessment method It is combined, improves the accuracy of psychological assessment, while is also effectively saved medical resource.
The technical solution adopted in the present invention is as follows:A kind of psychological assessment method based on virtual reality technology, including with Lower step:
S1:Selected mental scale;
S2:By selected mental scale virtual scene, the assessment content based on the design of specific mental scale is presented;
S3:Collection subject's question and answer data, behavioral data and physiological data in real time;
S4:Question and answer option based on subject, complete the intelligent skip of mental scale problem;
S5:Comprehensive intelligent analysis is carried out to gauge content, behavioral data is passed through convolutional neural networks by comprehensive intelligent analysis Training, the output after question and answer data are trained by Recognition with Recurrent Neural Network, physiological data is trained by convolutional neural networks are through feature A softmax layer is input to after fusion, draws psychological assessment model;
S6:Compared using the psychological assessment result that psychological assessment model obtains to subject's primary learning and doctor's label It is right, by counting loss function and gradient reverse conduction, intelligent correction is carried out to the question and answer option of subject;
S7:Physiological data, behavioral data and calibrated question and answer option are calculated by psychological assessment model again, so as to obtain Final comprehensive assessment result.
Preferably, the intelligent skip of mental scale problem described in step S4, simultaneously root is judged by designing a variety of Correlation Criterias Jump strategy is selected according to real-time condition;The jump strategy include redirected according to relevant issues in doctor's clinical experience scale, according to The user's state for redirecting according to current answer situation and being analyzed in real time according to system is redirected.
Preferably, step S5 comprises the following steps to the training process of behavioral data progress convolutional neural networks:
(1) shape information and Optic flow information are extracted respectively to the behavioral data of video acquisition;
(2) shape information and Optic flow information of extraction are pre-processed, obtains the input picture of convolutional neural networks;
(3) parameter of convolutional neural networks is set, shape information and Optic flow information are subjected to pretreated input picture Two convolutional neural networks are inputted respectively to be trained;
(4) shape information after two convolutional neural networks are handled and the feature of Optic flow information are merged;
(5) output after step (4) Fusion Features is sequentially inputted to follow-up convolutional layer, pond layer and full articulamentum.
Preferably, step S5 to question and answer data Recognition with Recurrent Neural Network is handled the step of it is as follows:
(1) natural language processing is carried out to voice response data, speech data is converted into text data;
(2) text data is encoded;
(3) by first time question and answer data input to Recognition with Recurrent Neural Network;
(4) this question and answer data and previous step output result are input to Recognition with Recurrent Neural Network;
(5) circulation step (4), until question and answer terminate.
Preferably, step S5 comprises the following steps to the training process of physiological data progress convolutional neural networks:
(21) Short Time Fourier Transform is carried out to physiological data, obtains multichannel spectrogram;
(22) multichannel spectrogram is trained using convolutional neural networks.
As can be known from the above technical solutions, the present invention be based on virtual reality technology, merge evaluated object mental scale determine, Behavioral data and the physiological data monitored in real time, by based on the data marked with doctor via convolutional neural networks and circulation Neutral net even depth learning algorithm obtains psychological assessment model, and the model has clinical experience, can autonomous intelligence assess do not have The data of doctor's mark.Meanwhile the psychological assessment result of subject is compared the present invention with doctor's label, damaged by calculating Lose function and gradient reverse conduction and intelligent correction is carried out to question and answer option, the question and answer data after correction can preferably reflect subject True psychological condition, then calculated via psychological assessment model, so as to obtain final comprehensive assessment result.Compared with prior art, The present invention at least has the advantages that:
Mental scale evaluation process is embodied by the present invention, is transformed into scale problem using virtual reality technology and is easy to The virtual scene that subject understands, while doctor is observed into Data Digital, and subject physiologic's data are gathered, by question and answer number Comprehensive analysis is carried out according to, physiological data and behavioral data, obtains subject's psychological assessment result, while assessment result is marked with doctor The intelligence correction for realizing subject's question and answer option is compared in label., can using traditional doctors experience and objective physiological parameter To lift the accuracy of psychological assessment, help user to be known from body psychological condition in time, help user management mental health, prevention The generation of mental disease.Working doctor amount, save medical resources can be reduced simultaneously.And this method provides for medical research New research ideas and methods, be advantageous to find related emotional, psychological judgement symbol thing and mechanism.This method collects largely User data can be used for realizing cloud computing, excavate user individual psychological characteristics with the method for machine learning, enter one Step provides targetedly psychological consultation.
Brief description of the drawings
Fig. 1 is psychological assessment flow chart of the present invention;
Fig. 2 is comprehensive intelligent analysis principle figure;
Fig. 3 is intelligent correction schematic diagram;
Fig. 4 is behavioral data processing procedure figure;
Fig. 5 is the network structure of question and answer data processing;
Fig. 6 is physiology data handling procedure figure.
Embodiment
The present invention proposes a kind of psychological assessment method based on virtual reality technology, by mental scale evaluation process tool as Change, scale problem is transformed into the virtual scene for being easy to subject to understand using virtual reality technology;Doctor is observed simultaneously Data Digital, subject physiologic's data are gathered, handle subject's scale question and answer data, triplicity is subjected to comprehensive analysis, Intelligent correction of answering invalid to subject simultaneously.Subject is avoided because the difference that external interference and doctor observe causes to assess As a result difference, and avoid answer privacy concern because of sick shame sense is the diversity of this immersive VR content and true Reality is that doctor assesses and brought great convenience, while based on big data technology, to excavate subject more under particular context Information.
Psychological assessment method of the present invention includes virtual reality presentation, speech recognition and the natural language processing skill of mental scale Art, the intelligent skip logic of evaluation problem, the intelligent correcting algorithm of subject's question and answer option, comprehensive intelligent parser, such as scheme 1, specifically comprise the following steps:
Step S1:Selected mental scale;
Step S2:Selected mental scale virtual scene is presented in the assessment based on the design of specific mental scale Hold;
The virtual reality of the mental scale is presented, and using virtual reality technology, mental scale is converted into Virtual Space The enquirement form of middle fititious doctor.Mental scale virtual scene, i.e., by being decomposed to sentimental space, make with specific The virtual reality scenario that mood induces, mental scale problem is embodied.
By mental scale continuous mode virtual reality scenario, the standard understood for improving subject mental scale problem True property, the validity of subject's answer is improved, so as to which psychological assessment result is more scientific and effective;Aid in objective physiological number simultaneously According to behavioral data, assess and provide effectively and easily means for psychological condition.Wherein virtual reality scenario includes but is not limited to Fititious doctor image design, cyberspace design, fititious doctor inquiry form.
Step S3:Gather subject real-time question and answer data, real-time behavioral data and non-real time physiological data;
Subject's non-real time physiological data of the collection, including but not limited to brain electricity, brain blood flow, pulse, electrocardio, myoelectricity, Body temperature, skin electricity, blood oxygen concentration.For analyzing the psychological condition in subject's question answering process, the input as psychological assessment model And the condition judgment for intelligent skip logic.
Step S4:Question and answer option based on subject, complete the intelligent skip of mental scale problem;
The intelligent skip of the mental scale problem, by designing a variety of Correlation Criterias judgements and being selected according to real-time condition Jump strategy, include but are not limited to be redirected according to relevant issues in doctor's clinical experience scale, jumped according to current answer situation Turn, redirected according to user's state that system is analyzed in real time.
Step S5:Comprehensive intelligent analysis is carried out to gauge content;
Comprehensive intelligent analysis method, for analyzing gathered user data, a large number of users number based on long-time accumulation According to progress personality mentality feature mining and regularity summarization.Based on the data that doctor marks via convolutional neural networks and following Ring neutral net even depth learning algorithm obtains psychological assessment model.Meanwhile the heart that this method obtains to subject's primary learning Reason assessment result is compared with doctor's label, by counting loss function and gradient reverse conduction, so as to realize that subject measures The intelligence correction that table is answered.Calibrated scale is answered and inputs psychological assessment model again with behavior and physiological data, is drawn Final psychological assessment report.
Specifically, comprehensive analysis carries out convolutional Neural net respectively to behavioral data, physiological data, question and answer data first The training of network, Recognition with Recurrent Neural Network, convolutional neural networks, the output after three class data are trained carry out Fusion Features, are input to Softmax layers.
Real-time behavioral data is handled, as shown in figure 4, input video material (behavioural information of subject), extraction Wherein shape information and Optic flow information, both are separately input in a convolutional neural networks, two convolutional neural networks structures It is identical, including the first convolutional layer, the first pond layer, the second convolutional layer, the second pond layer, the 3rd convolutional layer 1, the 3rd convolutional layer 2, 3rd pond layer, after two convolutional neural networks carry out Fusion Features, it is input to Volume Four lamination, the 4th pond layer, the 5th complete Articulamentum, the 6th full articulamentum.First convolutional layer, the first pond layer, the second convolutional layer, the second pond layer, the 3rd convolution Layer the 1, the 3rd convolutional layer 2, the 3rd pond layer are sequentially connected, the convolutional neural networks, Volume Four lamination, the 4th pond layer, the Five full articulamentums, the 6th full articulamentum are sequentially connected.
The training process that convolutional neural networks are carried out to real-time behavioral data comprises the following steps:
(1) shape information and Optic flow information are extracted respectively to the behavioral data of video acquisition;
(2) shape information and Optic flow information of extraction are pre-processed, obtains the input picture of convolutional neural networks;
(3) parameter of convolutional neural networks is set, pretreated input picture input convolutional neural networks will be carried out and entered Row training.Training of the convolutional neural networks to input picture, is comprised the following steps that:
(31) input picture inputs the first convolutional layer, and it is 3*3 that size is carried out to it, and step-length 1, the filling distance is 1 volume Product operation, altogether using 3 convolution kernels;
(32) picture exported through the first convolutional layer is input to the first pond layer, carries out maximum pond operation, pond block it is big Small is 2*2, step-length 2;
(33) picture through the first pond layer output is input to the second convolutional layer, and it is 3*3 that size is carried out to it, step-length 1, The filling distance is 1 convolution operation, altogether using 3 convolution kernels;
(34) picture exported through the second convolutional layer is input to the second pond layer, carries out maximum pond operation, pond block it is big Small is 2*2, step-length 2;
(35) picture through the second pond layer output is input to the 3rd convolutional layer 1, and it is 3*3 that size is carried out to it, and step-length is 1, the filling distance is 1 convolution operation, altogether using 3 convolution kernels;
(36) picture exported through the 3rd convolutional layer 1 is input to the 3rd convolutional layer 2, and it is 3*3 that size is carried out to it, and step-length is 1, the filling distance is 1 convolution operation, altogether using 3 convolution kernels;
(37) picture exported through the 3rd convolutional layer 2 is input to the 3rd pond layer, carries out maximum pond operation, pond block it is big Small is 2*2, step-length 2.
(4) shape information after two convolutional neural networks are handled and the feature of Optic flow information are merged;
(5) output after step (4) Fusion Features is input to Volume Four lamination, and it is 3*3 that size is carried out to it, and step-length is 1, the filling distance is 1 convolution operation, altogether using 3 convolution kernels;
(6) picture exported through Volume Four lamination is input to the 4th pond layer, carries out maximum pond operation, the size of pond block For 2*2, step-length 2;
(7) picture through the 4th pond layer output is input to the 5th full articulamentum;
(8) picture through the 5th full articulamentum output is input to the 6th full articulamentum.
The network structure handled question and answer data is as shown in figure 5, be a shot and long term memory Recognition with Recurrent Neural Network.Institute State question and answer data shot and long term memory Recognition with Recurrent Neural Network processing the step of it is as follows:
(1) natural language processing is carried out to voice response data, speech data is converted into text data;
Based on intelligent sound identification with natural language processing algorithm, the voice signal that subject is answered a question is converted into text This, integrative medicine dictionary obtains real-time answer result through row natural language processing, including but be not limited only to segmentation methods, close Keyword extraction, text Emotion identification algorithm.
(2) text data is encoded;
(3) first time question and answer data (i.e. question and answer data 1) are input to shot and long term memory Recognition with Recurrent Neural Network;
(4) this question and answer data and previous step output result are input to shot and long term memory Recognition with Recurrent Neural Network;
(5) circulation step (4), until question and answer terminate.
The process handled using convolutional neural networks physiological data is as shown in fig. 6, the physiology that input monitors in real time Data, by Short Time Fourier Transform, the multichannel spectrogram of physiological data is obtained, is input to a convolutional neural networks, should Convolutional neural networks include the first convolutional layer, the second convolutional layer, the 3rd pond layer and the 4th full articulamentum.The physiological data volume The training process of product neutral net comprises the following steps:
(1) Short Time Fourier Transform is carried out to physiological data, obtains multichannel spectrogram;
(2) parameter of the convolutional neural networks is set, and multichannel spectrogram is inputted into the convolutional neural networks is carried out Training.Physiological data is as follows in the training step of convolutional neural networks:
(21) Short Time Fourier Transform is carried out to physiological data, obtains multichannel spectrogram;
(22) spectrogram is inputted into the first convolutional layer, it is 15*3 that size is carried out to it, and step-length 1, the filling distance is 1 volume Product operation, altogether using 2 convolution kernels;
(23) figure exported through the first convolutional layer is input to the second convolutional layer, it is 1*1 that size is carried out to it, step-length 1, The filling distance is 1 convolution operation, altogether using 1 convolution kernel;
(24) figure exported through the second convolutional layer is input to the 3rd pond layer, carries out maximum pond operation, pond block it is big Small is 2*2, step-length 2;
(25) picture through the 3rd pond layer output is input to the 4th full articulamentum.
The convolutional neural networks of behavioral data, the Recognition with Recurrent Neural Network of question and answer data, the convolutional neural networks of physiological data Output a softmax layer is input to after Fusion Features, draw psychological assessment model.The Fusion Features are by behavioral data Convolutional neural networks, the Recognition with Recurrent Neural Network of question and answer data, the output result of convolutional neural networks of physiological data connect entirely.
Step S6:Intelligence corrects wrong question and answer option;
This step carries out intelligent correction to the wrong question and answer option of subject, by by subject's question and answer data, behavior number It is trained according to physiological data, output psychological assessment result is compared with doctor's label, and counting loss function and gradient are anti- To conduction to question and answer option, the false answer of subject is corrected, as shown in Figure 3.
Such as Fig. 2,3, the present invention carries out comprehensive intelligent analysis and step S6 intelligently correction mistake to gauge content in step S5 By mistake during question and answer option, Fusion Features processing is carried out to subject's behavioral data, simulation doctor clinical evaluation observation is tested Person's state, the real-time behavioral data of subject is recorded, include but are not limited to that expression, sound, eye be dynamic, limb action.Utilize expression The technology such as identification, sound and its Emotion identification, action recognition, for the input of comprehensive intelligent parser and for intelligent jump Turn the condition judgment of logic.Speech recognition and natural language processing are carried out to the real-time behavioral data of subject, collection in real time by The voice signal of examination person is simultaneously converted into text, and natural language processing analysis semanteme and mood are carried out to text.
Step S7:Obtain final subject's psychological assessment report.
The present invention is analyzed by comprehensive intelligent, will be neural via convolutional neural networks and circulation with the data that doctor demarcates Network even depth learning algorithm is learnt, and obtains psychological assessment model.Meanwhile this psychological assessment models is tentatively learned subject Practise the psychological assessment result obtained to be compared with doctor's label, by counting loss function and gradient reverse conduction, to question and answer Option carries out intelligent correction.Physiological data, behavioral data and calibrated question and answer option are calculated by psychological assessment model again, from And obtain final comprehensive assessment result.
The present invention simulates real psychological assessment process, by mental scale question and answer intelligent logical, realizes virtual reality scenario In fititious doctor and subject's intelligent human-machine interaction, Real Time Observation and record subject behavioral data, physiological data, question and answer number According to etc.;Based on obtaining the heart via convolutional neural networks and Recognition with Recurrent Neural Network even depth learning algorithm with the data that doctor marks Manage assessment models, the model has clinical experience, can autonomous intelligence assess the data of no doctor's mark.
As described above, the present invention can be better realized.

Claims (8)

  1. A kind of 1. psychological assessment method based on virtual reality technology, it is characterised in that comprise the following steps:
    S1:Selected mental scale;
    S2:By selected mental scale virtual scene, the assessment content based on the design of specific mental scale is presented;
    S3:Collection subject's question and answer data, behavioral data and physiological data in real time;
    S4:Question and answer option based on subject, complete the intelligent skip of mental scale problem;
    S5:To gauge content carry out comprehensive intelligent analysis, comprehensive intelligent analysis behavioral data is trained by convolutional neural networks, Output after question and answer data are trained by Recognition with Recurrent Neural Network, physiological data is trained by convolutional neural networks is after Fusion Features A softmax layer is input to, draws psychological assessment model;
    S6:The psychological assessment result that subject's primary learning obtains is compared with doctor's label using psychological assessment model, By counting loss function and gradient reverse conduction, intelligent correction is carried out to the question and answer option of subject;
    S7:Physiological data, behavioral data and calibrated question and answer option are calculated by psychological assessment model again, it is final so as to obtain Comprehensive assessment result.
  2. 2. the psychological assessment method according to claim 1 based on virtual reality technology, it is characterised in that described in step S4 The intelligent skip of mental scale problem, judged and according to real-time condition selection jump strategy by designing a variety of Correlation Criterias;Institute Stating jump strategy includes being redirected according to relevant issues in doctor's clinical experience scale, being redirected and according to system according to current answer situation The user's state analyzed in real time of uniting is redirected.
  3. 3. the psychological assessment method according to claim 1 based on virtual reality technology, it is characterised in that step S5 is to row The training process that convolutional neural networks are carried out for data comprises the following steps:
    (1) shape information and Optic flow information are extracted respectively to the behavioral data of video acquisition;
    (2) shape information and Optic flow information of extraction are pre-processed, obtains the input picture of convolutional neural networks;
    (3) parameter of convolutional neural networks is set, shape information and Optic flow information are subjected to pretreated input picture difference Two convolutional neural networks of input are trained;
    (4) shape information after two convolutional neural networks are handled and the feature of Optic flow information are merged;
    (5) output after step (4) Fusion Features is sequentially inputted to follow-up convolutional layer, pond layer and full articulamentum.
  4. 4. the psychological assessment method according to claim 1 based on virtual reality technology, it is characterised in that step S5 is to asking Answer is according to as follows Recognition with Recurrent Neural Network is handled the step of:
    (1) natural language processing is carried out to voice response data, speech data is converted into text data;
    (2) text data is encoded;
    (3) by first time question and answer data input to Recognition with Recurrent Neural Network;
    (4) this question and answer data and previous step output result are input to Recognition with Recurrent Neural Network;
    (5) circulation step (4), until question and answer terminate.
  5. 5. the psychological assessment method according to claim 1 based on virtual reality technology, it is characterised in that step S5 is to life The training process that reason data carry out convolutional neural networks comprises the following steps:
    (21) Short Time Fourier Transform is carried out to physiological data, obtains multichannel spectrogram;
    (22) multichannel spectrogram is trained using convolutional neural networks.
  6. 6. the psychological assessment method according to claim 1 based on virtual reality technology, it is characterised in that the behavior number According to including expression, sound, eye be dynamic and limb action.
  7. 7. the psychological assessment method according to claim 1 based on virtual reality technology, it is characterised in that the physiology number According to, including brain electricity, brain blood flow, pulse, electrocardio, myoelectricity, body temperature, skin electricity and blood oxygen concentration.
  8. 8. the psychological assessment method according to claim 1 based on virtual reality technology, it is characterised in that described in step S2 Virtual scene includes fititious doctor image design, cyberspace design and fititious doctor inquiry form.
CN201710839186.3A 2017-09-18 2017-09-18 A kind of psychological assessment method based on virtual reality technology Pending CN107799165A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710839186.3A CN107799165A (en) 2017-09-18 2017-09-18 A kind of psychological assessment method based on virtual reality technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710839186.3A CN107799165A (en) 2017-09-18 2017-09-18 A kind of psychological assessment method based on virtual reality technology

Publications (1)

Publication Number Publication Date
CN107799165A true CN107799165A (en) 2018-03-13

Family

ID=61531887

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710839186.3A Pending CN107799165A (en) 2017-09-18 2017-09-18 A kind of psychological assessment method based on virtual reality technology

Country Status (1)

Country Link
CN (1) CN107799165A (en)

Cited By (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108345873A (en) * 2018-03-22 2018-07-31 哈尔滨工业大学 A kind of multiple degrees of freedom body motion information analytic method based on multilayer convolutional neural networks
CN108428475A (en) * 2018-05-15 2018-08-21 段新 Biofeedback training system based on human body physiological data monitoring and virtual reality
CN108461126A (en) * 2018-03-19 2018-08-28 傅笑 In conjunction with virtual reality(VR)The novel intelligent psychological assessment of technology and interfering system
CN108453736A (en) * 2018-03-22 2018-08-28 哈尔滨工业大学 A kind of multiple degrees of freedom synchronization myoelectricity control method based on deep learning
CN108665962A (en) * 2018-04-17 2018-10-16 上海大学 A kind of digitlization neuropsychological test system and method
CN108805089A (en) * 2018-06-14 2018-11-13 南京云思创智信息科技有限公司 Based on multi-modal Emotion identification method
CN108877941A (en) * 2018-06-07 2018-11-23 衡阳师范学院 The Evaluation on psychological health dual system of teenager's rebel's phase
CN108888277A (en) * 2018-04-26 2018-11-27 深圳市科思创动科技有限公司 Psychological test method, system and terminal device
CN108937967A (en) * 2018-05-29 2018-12-07 智众伟业(天津)科技有限公司南宁分公司 A kind of psychology data memory promotion detection method and system based on VR technology
CN108983966A (en) * 2018-06-13 2018-12-11 济南博图信息技术有限公司 Reformation of convicts assessment system and method based on virtual reality and eye movement technique
CN108986888A (en) * 2018-07-16 2018-12-11 上海赞彤医疗科技有限公司 Examination anxiety and pressure regulating system and method, storage medium, operating system
CN109086837A (en) * 2018-10-24 2018-12-25 高嵩 User property classification method, storage medium, device and electronic equipment based on convolutional neural networks
CN109102862A (en) * 2018-07-16 2018-12-28 上海赞彤医疗科技有限公司 Concentrate the mind on breathing depressurized system and method, storage medium, operating system
CN109164910A (en) * 2018-07-05 2019-01-08 北京航空航天大学合肥创新研究院 For the multiple signals neural network architecture design method of electroencephalogram
CN109171773A (en) * 2018-09-30 2019-01-11 合肥工业大学 Sentiment analysis method and system based on multi-channel data
CN109192310A (en) * 2018-07-25 2019-01-11 同济大学 A kind of undergraduate psychological behavior unusual fluctuation scheme Design method based on big data
CN109171774A (en) * 2018-09-30 2019-01-11 合肥工业大学 Personality analysis method and system based on multi-channel data
CN109242014A (en) * 2018-08-29 2019-01-18 沈阳康泰电子科技股份有限公司 A kind of deep neural network psychology semanteme marking method based on the micro- feature of multi-source
CN109325457A (en) * 2018-09-30 2019-02-12 合肥工业大学 Sentiment analysis method and system based on multi-channel data and Recognition with Recurrent Neural Network
CN109344909A (en) * 2018-10-30 2019-02-15 咪付(广西)网络技术有限公司 A kind of personal identification method based on multichannel convolutive neural network
CN109480824A (en) * 2018-12-11 2019-03-19 武汉中旗生物医疗电子有限公司 Processing method, device and the server of EGC waveform data
CN109493885A (en) * 2018-11-13 2019-03-19 平安科技(深圳)有限公司 Psychological condition assessment and adjusting method, device and storage medium, server
CN109711383A (en) * 2019-01-07 2019-05-03 重庆邮电大学 Convolutional neural networks Mental imagery EEG signal identification method based on time-frequency domain
CN109960723A (en) * 2019-04-12 2019-07-02 浙江连信科技有限公司 A kind of interactive system and method for psychological robot
CN109994166A (en) * 2019-04-02 2019-07-09 上海市精神卫生中心(上海市心理咨询培训中心) The assessment of teenager's game obstacle, psychological characteristics investigation and Psychological Intervention System
CN109998570A (en) * 2019-03-11 2019-07-12 山东大学 Inmate's psychological condition appraisal procedure, terminal, equipment and system
CN110060762A (en) * 2019-04-22 2019-07-26 北京师范大学 A kind of mental development level appraisal procedure and system based on multiple-factor scale data
CN110096145A (en) * 2019-04-11 2019-08-06 湖北大学 Psychological condition display methods and device based on mixed reality and neural network
CN110123266A (en) * 2019-05-05 2019-08-16 北京航空航天大学 A kind of maneuvering decision modeling method based on multi-modal physiologic information
CN110288974A (en) * 2018-03-19 2019-09-27 北京京东尚科信息技术有限公司 Voice-based Emotion identification method and device
CN110298301A (en) * 2019-04-17 2019-10-01 国网江苏省电力有限公司 A kind of establishment officer's phychology prediction technique
CN110522983A (en) * 2018-05-23 2019-12-03 深圳先进技术研究院 Brain stimulation system, method, equipment and storage medium based on artificial intelligence
CN110610754A (en) * 2019-08-16 2019-12-24 天津职业技术师范大学(中国职业培训指导教师进修中心) Immersive wearable diagnosis and treatment device
CN110916691A (en) * 2019-12-11 2020-03-27 陕西学前师范学院 University student's psychological state testing arrangement
CN111028919A (en) * 2019-12-03 2020-04-17 北方工业大学 Phobia self-diagnosis and treatment system based on artificial intelligence algorithm
CN111134694A (en) * 2019-12-20 2020-05-12 浙江连信科技有限公司 Psychological consultation analysis method and device based on human-computer interaction
CN111524578A (en) * 2020-06-19 2020-08-11 智恩陪心(北京)科技有限公司 Psychological assessment device, method and system based on electronic psychological sand table
CN112086169A (en) * 2020-09-19 2020-12-15 北京心灵力量科技有限公司 Interactive psychological persuasion system adopting psychological data labeling modeling
CN112117002A (en) * 2020-09-09 2020-12-22 温州大学 Novel intelligent psychological assessment intervention system and method combined with virtual reality technology
CN112182339A (en) * 2020-11-03 2021-01-05 深圳市艾利特医疗科技有限公司 Psychological assessment method and system
CN112185558A (en) * 2020-09-22 2021-01-05 珠海中科先进技术研究院有限公司 Mental health and rehabilitation evaluation method, device and medium based on deep learning
CN112185517A (en) * 2020-10-20 2021-01-05 浙江连信科技有限公司 Information processing method and device for public staff psychological construction
CN112599245A (en) * 2020-12-16 2021-04-02 中国人民解放军总医院第八医学中心 Mental health index evaluation method and system
CN112652381A (en) * 2020-12-18 2021-04-13 中国人民解放军总医院第八医学中心 Mental health correction plan generation method and system
CN112716494A (en) * 2021-01-18 2021-04-30 上海对外经贸大学 Mental health condition analysis algorithm based on micro-expression and brain wave analysis algorithm
CN113470787A (en) * 2021-07-09 2021-10-01 福州大学 Emotional recognition and desensitization training effect evaluation method based on neural network
CN113628724A (en) * 2021-07-01 2021-11-09 江苏嘉纳宝医疗科技有限公司 Evaluation intervention method for violent fear psychology based on virtual reality technology
CN113793687A (en) * 2021-09-27 2021-12-14 盐城师范学院 Mental health dynamic management system and method
CN114870197A (en) * 2022-05-20 2022-08-09 中国人民解放军空军军医大学 Immersive psychological massage instrument
CN115607156A (en) * 2022-10-21 2023-01-17 厦门诸格量科技有限公司 Multi-mode-based psychological cognition screening evaluation method and system and storage medium
CN116312970A (en) * 2023-03-23 2023-06-23 苏州复变医疗科技有限公司 Intelligent interaction method and device for psychological assessment
CN116825361A (en) * 2023-08-25 2023-09-29 佛山市龙生光启科技有限公司 Full-automatic psychological state assessment system based on facial recognition
CN117690582A (en) * 2024-01-31 2024-03-12 吉林大学 Information management system and method for nursing workstation
CN117690582B (en) * 2024-01-31 2024-04-26 吉林大学 Information management system and method for nursing workstation

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105893780A (en) * 2016-05-10 2016-08-24 华南理工大学 Mental and psychological assessment method based on VR interaction and brain wave and cerebral blood flow monitoring
CN105975780A (en) * 2016-05-10 2016-09-28 华南理工大学 Machine inquiry system based on virtual reality interaction technology
CN107145878A (en) * 2017-06-01 2017-09-08 重庆邮电大学 Old man's anomaly detection method based on deep learning

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105893780A (en) * 2016-05-10 2016-08-24 华南理工大学 Mental and psychological assessment method based on VR interaction and brain wave and cerebral blood flow monitoring
CN105975780A (en) * 2016-05-10 2016-09-28 华南理工大学 Machine inquiry system based on virtual reality interaction technology
CN107145878A (en) * 2017-06-01 2017-09-08 重庆邮电大学 Old man's anomaly detection method based on deep learning

Cited By (71)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110288974B (en) * 2018-03-19 2024-04-05 北京京东尚科信息技术有限公司 Emotion recognition method and device based on voice
CN108461126A (en) * 2018-03-19 2018-08-28 傅笑 In conjunction with virtual reality(VR)The novel intelligent psychological assessment of technology and interfering system
CN110288974A (en) * 2018-03-19 2019-09-27 北京京东尚科信息技术有限公司 Voice-based Emotion identification method and device
CN108453736A (en) * 2018-03-22 2018-08-28 哈尔滨工业大学 A kind of multiple degrees of freedom synchronization myoelectricity control method based on deep learning
CN108345873A (en) * 2018-03-22 2018-07-31 哈尔滨工业大学 A kind of multiple degrees of freedom body motion information analytic method based on multilayer convolutional neural networks
CN108665962A (en) * 2018-04-17 2018-10-16 上海大学 A kind of digitlization neuropsychological test system and method
CN108888277B (en) * 2018-04-26 2021-05-04 深圳市科思创动科技有限公司 Psychological test method, psychological test system and terminal equipment
CN108888277A (en) * 2018-04-26 2018-11-27 深圳市科思创动科技有限公司 Psychological test method, system and terminal device
CN108428475A (en) * 2018-05-15 2018-08-21 段新 Biofeedback training system based on human body physiological data monitoring and virtual reality
CN108428475B (en) * 2018-05-15 2023-09-15 段新 Biological feedback training system based on human physiological data monitoring and virtual reality
US11577043B2 (en) 2018-05-23 2023-02-14 Shenzhen Institutes Of Advanced Technology Brain stimulation system, method and apparatus based on artificial intelligence and storage medium
CN110522983A (en) * 2018-05-23 2019-12-03 深圳先进技术研究院 Brain stimulation system, method, equipment and storage medium based on artificial intelligence
CN108937967A (en) * 2018-05-29 2018-12-07 智众伟业(天津)科技有限公司南宁分公司 A kind of psychology data memory promotion detection method and system based on VR technology
CN108877941A (en) * 2018-06-07 2018-11-23 衡阳师范学院 The Evaluation on psychological health dual system of teenager's rebel's phase
CN108983966A (en) * 2018-06-13 2018-12-11 济南博图信息技术有限公司 Reformation of convicts assessment system and method based on virtual reality and eye movement technique
CN108983966B (en) * 2018-06-13 2021-07-02 济南博图信息技术有限公司 Criminal reconstruction assessment system and method based on virtual reality and eye movement technology
CN108805089B (en) * 2018-06-14 2021-06-29 南京云思创智信息科技有限公司 Multi-modal-based emotion recognition method
CN108805089A (en) * 2018-06-14 2018-11-13 南京云思创智信息科技有限公司 Based on multi-modal Emotion identification method
CN109164910A (en) * 2018-07-05 2019-01-08 北京航空航天大学合肥创新研究院 For the multiple signals neural network architecture design method of electroencephalogram
CN109164910B (en) * 2018-07-05 2021-09-21 北京航空航天大学合肥创新研究院 Multi-signal neural network architecture design method for electroencephalogram
CN108986888A (en) * 2018-07-16 2018-12-11 上海赞彤医疗科技有限公司 Examination anxiety and pressure regulating system and method, storage medium, operating system
CN109102862A (en) * 2018-07-16 2018-12-28 上海赞彤医疗科技有限公司 Concentrate the mind on breathing depressurized system and method, storage medium, operating system
CN109192310A (en) * 2018-07-25 2019-01-11 同济大学 A kind of undergraduate psychological behavior unusual fluctuation scheme Design method based on big data
CN109242014B (en) * 2018-08-29 2021-10-22 沈阳康泰电子科技股份有限公司 Deep neural network psychological semantic annotation method based on multi-source micro-features
CN109242014A (en) * 2018-08-29 2019-01-18 沈阳康泰电子科技股份有限公司 A kind of deep neural network psychology semanteme marking method based on the micro- feature of multi-source
CN109325457A (en) * 2018-09-30 2019-02-12 合肥工业大学 Sentiment analysis method and system based on multi-channel data and Recognition with Recurrent Neural Network
CN109171774A (en) * 2018-09-30 2019-01-11 合肥工业大学 Personality analysis method and system based on multi-channel data
CN109171773A (en) * 2018-09-30 2019-01-11 合肥工业大学 Sentiment analysis method and system based on multi-channel data
CN109171773B (en) * 2018-09-30 2021-05-18 合肥工业大学 Emotion analysis method and system based on multi-channel data
CN109086837A (en) * 2018-10-24 2018-12-25 高嵩 User property classification method, storage medium, device and electronic equipment based on convolutional neural networks
CN109344909A (en) * 2018-10-30 2019-02-15 咪付(广西)网络技术有限公司 A kind of personal identification method based on multichannel convolutive neural network
CN109493885A (en) * 2018-11-13 2019-03-19 平安科技(深圳)有限公司 Psychological condition assessment and adjusting method, device and storage medium, server
CN109480824B (en) * 2018-12-11 2021-10-08 武汉中旗生物医疗电子有限公司 Method and device for processing electrocardio waveform data and server
CN109480824A (en) * 2018-12-11 2019-03-19 武汉中旗生物医疗电子有限公司 Processing method, device and the server of EGC waveform data
CN109711383A (en) * 2019-01-07 2019-05-03 重庆邮电大学 Convolutional neural networks Mental imagery EEG signal identification method based on time-frequency domain
CN109998570A (en) * 2019-03-11 2019-07-12 山东大学 Inmate's psychological condition appraisal procedure, terminal, equipment and system
CN109994166A (en) * 2019-04-02 2019-07-09 上海市精神卫生中心(上海市心理咨询培训中心) The assessment of teenager's game obstacle, psychological characteristics investigation and Psychological Intervention System
CN110096145A (en) * 2019-04-11 2019-08-06 湖北大学 Psychological condition display methods and device based on mixed reality and neural network
CN109960723A (en) * 2019-04-12 2019-07-02 浙江连信科技有限公司 A kind of interactive system and method for psychological robot
CN110298301A (en) * 2019-04-17 2019-10-01 国网江苏省电力有限公司 A kind of establishment officer's phychology prediction technique
CN110298301B (en) * 2019-04-17 2021-09-07 国网江苏省电力有限公司 Method for predicting psychological states of organization personnel
CN110060762A (en) * 2019-04-22 2019-07-26 北京师范大学 A kind of mental development level appraisal procedure and system based on multiple-factor scale data
CN110123266A (en) * 2019-05-05 2019-08-16 北京航空航天大学 A kind of maneuvering decision modeling method based on multi-modal physiologic information
CN110610754A (en) * 2019-08-16 2019-12-24 天津职业技术师范大学(中国职业培训指导教师进修中心) Immersive wearable diagnosis and treatment device
CN111028919A (en) * 2019-12-03 2020-04-17 北方工业大学 Phobia self-diagnosis and treatment system based on artificial intelligence algorithm
CN110916691A (en) * 2019-12-11 2020-03-27 陕西学前师范学院 University student's psychological state testing arrangement
CN111134694A (en) * 2019-12-20 2020-05-12 浙江连信科技有限公司 Psychological consultation analysis method and device based on human-computer interaction
CN111524578A (en) * 2020-06-19 2020-08-11 智恩陪心(北京)科技有限公司 Psychological assessment device, method and system based on electronic psychological sand table
CN111524578B (en) * 2020-06-19 2023-08-11 智恩陪心(北京)科技有限公司 Psychological assessment device, method and system based on electronic psychological sand table
CN112117002A (en) * 2020-09-09 2020-12-22 温州大学 Novel intelligent psychological assessment intervention system and method combined with virtual reality technology
CN112086169B (en) * 2020-09-19 2024-02-09 北京心灵力量科技有限公司 Interactive psychological dispersion system adopting psychological data labeling modeling
CN112086169A (en) * 2020-09-19 2020-12-15 北京心灵力量科技有限公司 Interactive psychological persuasion system adopting psychological data labeling modeling
CN112185558A (en) * 2020-09-22 2021-01-05 珠海中科先进技术研究院有限公司 Mental health and rehabilitation evaluation method, device and medium based on deep learning
CN112185517A (en) * 2020-10-20 2021-01-05 浙江连信科技有限公司 Information processing method and device for public staff psychological construction
CN112182339A (en) * 2020-11-03 2021-01-05 深圳市艾利特医疗科技有限公司 Psychological assessment method and system
CN112599245A (en) * 2020-12-16 2021-04-02 中国人民解放军总医院第八医学中心 Mental health index evaluation method and system
CN112652381A (en) * 2020-12-18 2021-04-13 中国人民解放军总医院第八医学中心 Mental health correction plan generation method and system
CN112716494A (en) * 2021-01-18 2021-04-30 上海对外经贸大学 Mental health condition analysis algorithm based on micro-expression and brain wave analysis algorithm
CN113628724A (en) * 2021-07-01 2021-11-09 江苏嘉纳宝医疗科技有限公司 Evaluation intervention method for violent fear psychology based on virtual reality technology
CN113628724B (en) * 2021-07-01 2024-03-12 江苏嘉纳宝医疗科技有限公司 Assessment and intervention method for violent fear psychology based on virtual reality technology
CN113470787B (en) * 2021-07-09 2024-01-30 福州大学 Emotion recognition and desensitization training effect evaluation method based on neural network
CN113470787A (en) * 2021-07-09 2021-10-01 福州大学 Emotional recognition and desensitization training effect evaluation method based on neural network
CN113793687A (en) * 2021-09-27 2021-12-14 盐城师范学院 Mental health dynamic management system and method
CN114870197A (en) * 2022-05-20 2022-08-09 中国人民解放军空军军医大学 Immersive psychological massage instrument
CN115607156A (en) * 2022-10-21 2023-01-17 厦门诸格量科技有限公司 Multi-mode-based psychological cognition screening evaluation method and system and storage medium
CN116312970A (en) * 2023-03-23 2023-06-23 苏州复变医疗科技有限公司 Intelligent interaction method and device for psychological assessment
CN116312970B (en) * 2023-03-23 2023-12-15 苏州复变医疗科技有限公司 Intelligent interaction method and device for psychological assessment
CN116825361B (en) * 2023-08-25 2023-11-14 湘南学院 Full-automatic psychological state assessment system based on facial recognition
CN116825361A (en) * 2023-08-25 2023-09-29 佛山市龙生光启科技有限公司 Full-automatic psychological state assessment system based on facial recognition
CN117690582A (en) * 2024-01-31 2024-03-12 吉林大学 Information management system and method for nursing workstation
CN117690582B (en) * 2024-01-31 2024-04-26 吉林大学 Information management system and method for nursing workstation

Similar Documents

Publication Publication Date Title
CN107799165A (en) A kind of psychological assessment method based on virtual reality technology
CN106446533B (en) Human health data processing system and method thereof
CN110507335A (en) Inmate's psychological health states appraisal procedure and system based on multi-modal information
CN109157231A (en) Portable multi-channel Depression trend assessment system based on emotional distress task
CN105893780A (en) Mental and psychological assessment method based on VR interaction and brain wave and cerebral blood flow monitoring
CN107680683A (en) A kind of AI eye healths appraisal procedure
EP4108164A1 (en) Blood pressure prediction method and device
CN108596069A (en) Neonatal pain expression recognition method and system based on depth 3D residual error networks
CN101647696A (en) Intelligent system for health diagnosis and treatment
CN110459328A (en) A kind of Clinical Decision Support Systems for assessing sudden cardiac arrest
CN110033858A (en) A kind of tongue picture analysis method and its storage medium
CN109124655A (en) State of mind analysis method, device, equipment, computer media and multifunctional chair
CN109431492A (en) ECG lead signals based on neural network algorithm simulate method for reconstructing
Pal et al. Deep learning techniques for prediction and diagnosis of diabetes mellitus
CN113397546A (en) Method and system for constructing emotion recognition model based on machine learning and physiological signals
CN106137152A (en) Remote health detection and method of servicing and system thereof
CN109346179A (en) Recurrence prediction model and its modeling method, device after a kind of coronary intervention
Agyeman et al. Classification Techniques for Arrhythmia Patterns Using Convolutional Neural Networks and Internet of Things (IoT) Devices
Devi et al. Cognitive IoT integration for smart healthcare: Case study for heart disease detection and monitoring
Gan et al. Human-computer interaction based interface design of intelligent health detection using PCANet and multi-sensor information fusion
Tian et al. ResNet-50 based technique for EEG image characterization due to varying environmental stimuli
CN105096227A (en) Visualization processing method for health data
CN110610754A (en) Immersive wearable diagnosis and treatment device
Pimentel et al. Human mental state monitoring in the wild: Are we better off with deeperneural networks or improved input features?
Kaur et al. Artificial Intelligence approaches for Predicting Hypertension Diseases: Open Challenges and Research Issues

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20181212

Address after: 510330 Room 7,500, Haicheng West Street, Xingang East Road, Haizhu District, Guangzhou City, Guangdong Province

Applicant after: Guangzhou Boguanwen Language Technology Co., Ltd.

Address before: 510640 No. five, 381 mountain road, Guangzhou, Guangdong, Tianhe District

Applicant before: South China University of Technology

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20190925

Address after: 510000 820, room 8, 8, 116 Heng Road, Dongguan, Guangzhou, Guangdong.

Applicant after: Guangzhou Bo Wei Intelligent Technology Co., Ltd.

Address before: 510330 Room 7,500, Haicheng West Street, Xingang East Road, Haizhu District, Guangzhou City, Guangdong Province

Applicant before: Guangzhou Boguanwen Language Technology Co., Ltd.

TA01 Transfer of patent application right
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20180313

WD01 Invention patent application deemed withdrawn after publication