CN109584992A - Exchange method, device, server, storage medium and sand play therapy system - Google Patents

Exchange method, device, server, storage medium and sand play therapy system Download PDF

Info

Publication number
CN109584992A
CN109584992A CN201811397313.XA CN201811397313A CN109584992A CN 109584992 A CN109584992 A CN 109584992A CN 201811397313 A CN201811397313 A CN 201811397313A CN 109584992 A CN109584992 A CN 109584992A
Authority
CN
China
Prior art keywords
user
user terminal
virtual scene
server end
interaction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811397313.XA
Other languages
Chinese (zh)
Inventor
段新
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201811397313.XA priority Critical patent/CN109584992A/en
Publication of CN109584992A publication Critical patent/CN109584992A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/70ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mental therapies, e.g. psychological therapy or autogenous training
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/67ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H80/00ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Primary Health Care (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • General Business, Economics & Management (AREA)
  • Business, Economics & Management (AREA)
  • Child & Adolescent Psychology (AREA)
  • Developmental Disabilities (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychiatry (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Pathology (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The embodiment of the present application is suitable for technical field of virtual reality, a kind of exchange method, device, server end, computer readable storage medium and the sand play therapy system based on VR are disclosed, method includes: the interaction data for obtaining the first user of the first user terminal acquisition by VR interactive device and the 3D virtual scene constructed in advance;According to interaction data, interaction results are obtained, and interaction results are fed back into the first user terminal, so that the first user terminal shows that equipment shows interaction results to the first user by VR;The interactive process information of first user and 3D virtual scene is transmitted to second user end, so that second user end shows interactive process information to second user.Effect, controllability, privacy and the convenience of sand play therapy (Sandplay therapy) can be improved in the embodiment of the present application.

Description

Exchange method, device, server, storage medium and sand play therapy system
Technical field
The application belongs to technical field of virtual reality more particularly to a kind of exchange method, device, server, computer can Read storage medium and the sand play therapy system based on VR.
Background technique
Sand-play therapy is also referred to as sand play therapy or Sandplay therapy, is Psychotherapy at present with great influence power One of.Sand-play therapy can be regarded as visitor (patient or experiencer) with tangible objects such as sandbox, sand, husky tools, with as The forms such as sign, imago serve not only as the assessment tool of psychological problems, even more become come the process in the unconscious world that makes a display of one's The means of psychological problems treatment.
Under normal circumstances, sand play therapy includes the following steps: the clear sand table principle of therapist, such as holds neutral, objective Attitude, provide a safety, reliable environment etc. for player;Therapist talks player before Sand-play therapy Words, and machine imports Sand-play therapy in due course;Sand table is introduced for player, and player is allowed to start from sand table;Player exists Sand table production is completed under quiet, free environment, therapist will encourage it to watch the sand table world of oneself from different perspectives;Treatment Teacher will allow player to share sand table by speech;How player operates and what kind of has Demeanor, these treated teachers have recorded, and photograph to record to the sand table of player;After, player Dismounting sand table personally, which may be selected, to be retained them temporarily, and therapist will arrange and achieve to entire therapeutic process.
But in traditional Sandplay therapy, visitor must come the case front yard room appointed with therapist, and case front yard room needs Place, utensil and therapist etc. are wanted, beneficiaries are narrower, it is difficult to promote.In addition, visitor may be due in face of true Therapist and generate psychology that is shy, contradicting to influence the effect of sand play therapy.
Summary of the invention
In view of this, the embodiment of the present application provides a kind of exchange method, device, server end, computer-readable storage Medium and sand play therapy system based on VR, to solve, traditional Sandplay therapy effect is poor and convenience, controllability, privacy The lower problem of property.
The first aspect of the embodiment of the present application provides a kind of exchange method, applied to the sand play therapy system based on VR, institute The system of stating include first user terminal, with first user terminal communication connection server end and with the server end The second user end of communication connection;
The exchange method is applied to the server end, and the server end includes Cloud Server, the exchange method Include:
The first user for obtaining the first user terminal acquisition passes through VR interactive device and the 3D virtual scene constructed in advance Interaction data, the 3D virtual scene includes virtual front yard room, virtual sandbox and dummy mould, and first user is to suffer from Person or experiencer;
According to the interaction data, interaction results are obtained, and the interaction results are fed back into first user terminal, with First user terminal is set to show that equipment shows the interaction results to first user by VR;
The interactive process information of first user and the 3D virtual scene is transmitted to the second user end, so that The second user end shows that the interactive process information, the second user are therapist to second user.
With reference to first aspect, in a kind of feasible implementation, the 3D virtual scene further includes the second user Avatar, the exchange method further include:
Obtain the facial expression information of the second user of the second user end acquisition;
According to the facial expression information of the second user, the human face animation of the avatar is driven, so that the void The expression of quasi- incarnation and the expression synchronization of the second user.
With reference to first aspect, described to be believed according to the facial expression of the second user in a kind of feasible implementation Breath, drives the human face animation of the avatar, comprising:
Feature extraction is carried out to the facial expression information of the second user, the facial expression for obtaining the second user is special Sign;
According to the facial expression feature, expression classification is carried out using the classifier of pre-training, obtains classification results;
Test is compared with pre-established Facial expression database in the classification results, obtains Expression Recognition result;
According to the Expression Recognition as a result, driving the human face animation of the avatar.
With reference to first aspect, in a kind of feasible implementation, the of first user terminal acquisition is obtained described One user passes through before the interaction data of VR interactive device and the 3D virtual scene constructed in advance, further includes:
Receive the scene setting instruction that the second user end is sent;
It is instructed according to the scene setting, the scenario parameters of the 3D virtual scene is set.
With reference to first aspect, in a kind of feasible implementation, the exchange method further include:
Obtain the facial expression information of first user of the first user terminal acquisition;
The interaction data, the interaction frequency, the sand table for recording first user are anticipated as data and first user Facial expression information, formed assessment data;
According to formation assessment data, evaluating result is obtained.
The second aspect of the embodiment of the present application provides a kind of interactive device, applied to the sand play therapy system based on VR, institute The system of stating include the first user terminal, with the server end of first user terminal communication connection and communicate with the server end The second user end of connection;
The interactive device is integrated in the server end, and the server end includes Cloud Server, the interactive device Include:
Module is obtained, the first user for obtaining the first user terminal acquisition passes through VR interactive device and building in advance 3D virtual scene interaction data, the 3D virtual scene includes virtual front yard room, virtual sandbox and dummy mould, described First user is patient or experiencer;
Feedback module for according to the interaction data, obtaining interaction results, and the interaction results is fed back to described First user terminal, so that first user terminal shows that equipment shows the interaction results to first user by VR;
Transmission module, for the interactive process information of first user and the 3D virtual scene to be transmitted to described the Two user terminals, so that the second user end shows that the interactive process information, the second user are treatment to second user Teacher.
In conjunction with second aspect, in a kind of feasible implementation, the 3D virtual scene further includes the second user Avatar, the interactive device further include:
First expression information obtains module, the facial table of the second user for obtaining the second user end acquisition Feelings information;
Expression synchronization module drives the people of the avatar for the facial expression information according to the second user Face animation, so that the expression synchronization of the expression of the avatar and the second user.
In conjunction with second aspect, in a kind of feasible implementation, the expression synchronization module includes:
Feature extraction unit carries out feature extraction for the facial expression information to the second user, obtains described the The facial expression feature of two users;
Taxon, for carrying out expression classification using the classifier of pre-training, obtaining according to the facial expression feature Classification results;
Recognition unit is obtained for test to be compared with pre-established Facial expression database in the classification results Expression Recognition result;
Driving unit, for according to the Expression Recognition as a result, driving the human face animation of the avatar.
In conjunction with second aspect, in a kind of feasible implementation, the interactive device further include:
Receiving module, the scene setting instruction sent for receiving the second user end;
The scenario parameters of the 3D virtual scene are arranged for instructing according to the scene setting in scene setting module.
In conjunction with second aspect, in a kind of feasible implementation, the interactive device further include:
Second expression information obtains module, the facial table of first user for obtaining the first user terminal acquisition Feelings information;
Logging modle, for record the interaction data of first user, the interaction frequency, sand table meaning as data and The facial expression information of first user forms assessment data;
Assessment module, for obtaining evaluating result according to formation assessment data.
The third aspect of the embodiment of the present application provides a kind of sand play therapy system based on VR, including the first user terminal, with The server end of the first user terminal communication connection and the second user end communicated to connect with the server end, the clothes Business device end includes Cloud Server;
First user terminal is used to acquire the first user and passes through VR interactive device and the 3D virtual scene that constructs in advance Interaction data, and the interaction data is transmitted to the server end, the 3D virtual scene includes virtual front yard room, virtual Sandbox and dummy mould, first user are patient or experiencer;
The server end is used to obtain interaction results, and the interaction results are fed back to according to the interaction data First user terminal, so that first user terminal shows that equipment shows that the interaction is tied to first user by VR Fruit;The server end is also used to for the interactive process information of first user and the 3D virtual scene being transmitted to described the Two user terminals;
The second user end is used to show that the interactive process information, the second user are treatment to second user Teacher.
In conjunction with the third aspect, in a kind of feasible implementation, the 3D virtual scene further includes the second user Avatar, the second user end further includes the depth transducer for acquiring the facial expression information of the second user Equipment;
The server end is also used to receive the facial expression information, and is believed according to the facial expression of the second user Breath drives the human face animation of the avatar, so that the expression synchronization of the expression of the avatar and the second user.
The fourth aspect of the embodiment of the present application provides a kind of server, including memory, processor and is stored in described In memory and the computer program that can run on the processor, the processor are realized when executing the computer program Such as the step of any one of above-mentioned first aspect the method.
5th aspect of the embodiment of the present application provides a kind of computer readable storage medium, the computer-readable storage medium Matter is stored with computer program, and the side as described in above-mentioned any one of first aspect is realized when the computer program is executed by processor The step of method.
Existing beneficial effect is the embodiment of the present application compared with prior art:
The embodiment of the present application by VR technology create safely, the virtual scene that loosens, saved the equipment such as place sand tool, had Conducive to elimination patient or experiencer to the jamais vu of therapist, sense of insecurity in reality, and patient or experiencer do not have to face True therapist avoids generation that is shy, contradicting psychology, so that the effect of Sandplay therapy is more preferable, controllability, privacy are more It is high;It is communicated to connect between first user terminal, server end and second user end, so that patient or experiencer can be entered by network Sand-play therapy is carried out to virtual reality case front yard room, breaches the limitation in space, convenience is higher.
Detailed description of the invention
It in order to more clearly explain the technical solutions in the embodiments of the present application, below will be to embodiment or description of the prior art Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only some of the application Embodiment for those of ordinary skill in the art without any creative labor, can also be according to these Attached drawing obtains other attached drawings.
Fig. 1 provides a kind of framework schematic block diagram of sand play therapy system based on VR for the embodiment of the present application;
Fig. 2 is another system architecture schematic block diagram of the sand play therapy system provided by the embodiments of the present application based on VR;
Fig. 3 is another system architecture schematic block diagram of the sand play therapy system provided by the embodiments of the present application based on VR;
Fig. 4 is a kind of schematic process flow diagram of exchange method provided by the embodiments of the present application;
Fig. 5 is the schematic process flow diagram of Expression Recognition process provided by the embodiments of the present application;
Fig. 6 is the schematic process flow diagram of assessment process provided by the embodiments of the present application;
Fig. 7 is a kind of structural schematic block diagram of interactive device provided by the embodiments of the present application;
Fig. 8 is the schematic diagram of server provided by the embodiments of the present application.
Specific embodiment
In being described below, for illustration and not for limitation, the tool of such as particular system structure, technology etc is proposed Body details, so as to provide a thorough understanding of the present application embodiment.However, it will be clear to one skilled in the art that there is no these specific The application also may be implemented in the other embodiments of details.In other situations, it omits to well-known system, device, electricity The detailed description of road and method, so as not to obscure the description of the present application with unnecessary details.
In order to illustrate technical solution described herein, the following is a description of specific embodiments.
Embodiment one
Referring to Figure 1, a kind of framework schematic block diagram of sand play therapy system based on VR is provided for the embodiment of the present application, it should System may include the first user terminal 11, with the server end 12 of the first user terminal 11 communication connection and communicate with server end The second user end 13 of connection, server end include Cloud Server;
First user terminal is used to acquire the first user and passes through the interaction of VR interactive device and the 3D virtual scene constructed in advance Data, and interaction data is transmitted to server end, 3D virtual scene includes virtual front yard room, virtual sandbox and virtual mould Tool, the first user are patient or experiencer.
Server end is used to obtain interaction results, and interaction results are fed back to the first user terminal according to interaction data, with The first user terminal is set to show that equipment shows interaction results to the first user by VR;Server end is also used to the first user and 3D The interactive process information of virtual scene is transmitted to second user end.
Second user end is used for second user display interactive process information, and second user is therapist.
It is understood that the first user is patient either experiencer, hereinafter referred to as visitor.Visitor can pass through First user terminal is interacted with 3D virtual scene, carried out in 3D virtual scene Sand-play therapy, creation sand table meaning as, to treatment The operations such as teacher's consulting.
First user terminal includes communication module and user interactive module, user interactive module may include VR interactive device, VR shows that equipment and voice module, VR interactive device can include but is not limited to VR handle, data glove and gesture sensing Device etc., VR show that equipment can show equipment for wear-type VR, can be host Formula V R, all-in-one machine VR or cell phone VR.After VR shows that the 3D virtual scene that equipment can receive and display server end is sent, visitor wear VR display equipment, 3D virtual scene can be entered, corresponding interactive operation is then carried out by VR interactive devices such as VR handle, data glove.
In some cases, the first user terminal can also include expression for acquiring the facial expression image of visitor with Track equipment, the expression tracking equipment are specifically mounted in VR and show in equipment, can be specially to take in virtual reality glasses platform The small-sized high-definition camera of the one or more of load, to capture the facial expression image of visitor, and the facial table that will be captured Feelings image transmitting to server end is stored, and as one of assessment data, can also in real time be shown the facial expression of visitor Show at second user end, so that therapist can recognize the psychology variation of visitor in real time, is conducive to therapist's remote reviewing The case where analyzing visitor.
The first user terminal of received server-side interaction data collected, the interaction data for example can be the dynamic of visitor Make instruction either gesture information.Server end identifies interaction data, is handled, obtain virtual information feedback, and by this A little virtual informations return to the first user terminal, show that equipment is shown by VR, so that movement and the virtual scene of visitor Operation reach harmonious.
For example, visitor wear VR show equipment, be provided with corresponding VR interactive device with it, in 3D virtual scene into Row Sand-play therapy moves arm when user passes through, and a husky tool on dummy mould frame is moved in virtual sandbox, first User terminal then acquires the sensor information on arm, and transmits it to server end, and server end is according to the move, then Corresponding virtual information processing is executed, a husky tool on dummy mould frame is moved in virtual sandbox, and the processing is tied Fruit shows that equipment is shown to the first user by VR, to reach harmonious.
Server end can be also used for building rendering 3D virtual scene, building rendering therapist's avatar, assessment data Record storage, facial expression image processing, data assessment etc..
Wherein, 3D virtual scene may include virtual front yard room, virtual sandbox and dummy mould (sand tool), in some feelings It can also include the dummy mould frame for putting dummy mould under condition.6 to 7 layers can be divided into mold rack, number of molds can There are 1500~2000, cover most of classifications, for example, religion class, vehicles class, animal class, plant etc..These moulds Tool (miniatures) can carry out digitization modeling by 3D scanner and obtain.The building and rendering of 3D virtual scene can pass through The prior art is realized, such as is realized by virtual reality modelling software VRML, X3D or Open Inventor, no longer superfluous herein It states.
When constructing therapist's avatar, virtual reconstruction can be carried out by face of the face recognition technology to therapist, So that avatar can simulate the expression of therapist, avatar and true man's expression synchronization are realized, with visitor's speech exchange Deng.Specifically, it can be captured by the expression to therapist, highly to restore the facial characteristics of therapist, be completed virtual The building of incarnation, and can be developed in Unity3D and utilize the binding of redirecting technique completion face bone in engine.
Second user end may include display module and control module, wherein and display module for example can be display screen, It is displayed for the real-time expression and some other need contents to be shown of virtual scene, visitor, for example, number in real time According to, assessment parameter etc..Control module can be used for being configured the parameter of 3D virtual scene, for example, the selection of 3D case front yard room, Avatar selection setting, consultation setting, participation number setting, participant's priority assignation etc..The second user end can be with The specially end PC or mobile terminal.
In some cases, second user end may include that the depth for acquiring the facial expression data of second user passes Sensor equipment, for example, KINECT sensor.Its facial expression for acquiring therapist is sent to server end, to realize virtualization The expression synchronization of body and therapist.
Therapist can carry out scene setting, the expression for observing visitor and sand table by second user end and create process, Speech exchange etc. is carried out with visitor.
In order to guarantee the real-time of system, should be guaranteed that between the first user terminal, server end and second user end low Time delay.Specifically, it can be communicated based on 5G network, to guarantee the low delay of system data transmission.Server end packet The Cloud Server included is for realizing remote network services, and certainly, server end can also include other servers, does not make herein It limits.
Optionally, in some embodiments, above-mentioned 3D virtual scene can also include second user avatar, second User terminal further includes the depth transducer equipment for acquiring the facial expression information of second user;Server end is also used to receive Facial expression information, and according to the human face animation of the facial expression information of second user driving avatar, so that avatar Expression and second user expression synchronization.By the way that the avatar of therapist, and the expression of avatar and therapist is arranged Expression synchronization, visitor can seek advice from virtual scene in avatar, communication etc., so that Sandplay therapy Better effect.
It should be noted that the quantity of visitor can be one, it is also possible to multiple, that is, a therapist can phase To a visitor, at this point it is possible to be known as individual Sandplay therapy;Can also relatively multiple visitors, at this point it is possible to referred to as group Sandplay therapy.Similarly, the quantity of therapist can be one, be also possible to multiple, that is, a visitor can control with respect to one Teacher is treated, it can also relatively multiple therapists.
When for Group Sandplay Therapy, which can construct system, specific framework using distributed virtual case front yard technology Refer to Fig. 2 shows the sand play therapy system based on VR another system architecture schematic block diagram, the system include second use Family end 21, at least one server end 22 and at least one first user terminal 23, the quantity of server end and the first user terminal Quantity it is identical, the corresponding server end of each first user terminal.
Referring to another system architecture schematic block diagram of the sand play therapy system based on VR shown in Fig. 3, which includes First user terminal 31, server end 32 and second user end 33, the first user terminal 31 are interior including interactive terminal 311 and client Socket312 is held, multiple participants carry out virtual reality Sand-play therapy by interactive terminal.Server end includes scene pipe Device 321, data management system 322, media server 323 are managed, scene server 321 is responsible for the login of user, Information Proofreading, resource Read, update 3D virtual scene etc., and receive the scene update data of user, data management system 322 include scene database and Customer data base.Second user end includes interactive terminal.
It is set it should be noted that the specific framework of the sand play therapy system based on VR can carry out selection according to actual needs It sets, is not limited thereto.
The present embodiment by VR technology create safely, the virtual scene that loosens, saved the equipment such as place sand tool, be conducive to Patient or experiencer are eliminated in reality to the jamais vu of therapist, sense of insecurity, and patient or experiencer do not have in face of true Therapist, avoid it is shy, contradict psychology generation so that the effect of Sandplay therapy is more preferable, controllability, privacy are higher; It is communicated to connect between first user terminal, server end and second user end, so that patient or experiencer can be entered by network Virtual reality case front yard room carries out Sand-play therapy, breaches the limitation in space, convenience is higher.
Embodiment two
After the system architecture for having introduced the sand play therapy system based on VR, the present embodiment will be to the sand play therapy system Interactive process be illustrated.
Fig. 4 is referred to, is a kind of schematic process flow diagram of exchange method provided by the embodiments of the present application, this method can answer For the sand play therapy system based on VR, which includes the first user terminal, the server end with the communication connection of the first user terminal And the second user end with server end communication connection, server end includes cloud server.With the sand play therapy based on VR The related introduction of system refers to above-described embodiment one, and details are not described herein.
The exchange method can be regarded as the working method of the sand play therapy system based on VR, the exchange method concrete application In server end.This method may include:
Step S401, the first user for obtaining the acquisition of the first user terminal is virtual by VR interactive device and the 3D that constructs in advance The interaction data of scene, 3D virtual scene include virtual front yard room, virtual sandbox and dummy mould, the first user be patient or Experiencer.
It is understood that above-mentioned 3D virtual scene can be server end constructs completion in advance, and pass through VR interaction Equipment is shown to the scene of visitor.The 3D virtual scene can include but is not limited to virtual front yard room, virtual sandbox and void Quasi- mold can also include the dummy mould frame for putting mold under some cases.
Above-mentioned interaction data may include the first user wearing or generate after making corresponding actions using VR interactive device Action command or gesture information etc..First user terminal acquires the interaction data that VR interactive device generates, and by the interaction data It is transmitted through the network to server end.
Step S402, according to interaction data, interaction results are obtained, and interaction results are fed back into the first user terminal, so that First user terminal shows that equipment shows interaction results to the first user by VR.
Specifically, the interaction datas such as the collected action command of received server-side, gesture information, to the interaction data into Row identification judgement, then carries out virtual space information processing according to the interaction data, updates the data of 3D virtual scene, and by phase The feedback result answered shows that equipment is shown to visitor by VR.For example, after visitor makes the instruction of a mobile husky tool, Server end, accordingly to the processing of virtual scene process, moves in virtual scene according to the instruction so that corresponding sand has.
Step S403, the interactive process information of the first user and 3D virtual scene is transmitted to second user end, so that the Two user terminals show interactive process information to second user, and second user is therapist.
It should be noted that above-mentioned interactive process information may include the number such as real-time pictures of interaction data, virtual scene According to by the interactive process information real-time display to therapist, the sand table that therapist can be made to understand visitor creates process.
In one embodiment, in order to further increase the effect of Sandplay therapy, treatment can be set in 3D virtual scene The avatar of teacher, and the expression synchronization of the expression of the avatar and therapist, therapist can by the avatar with Visitor carries out communication.In a kind of feasible implementation, 3D virtual scene further includes the avatar of second user, Above-mentioned exchange method can also include: the facial expression information for obtaining the second user of second user end acquisition;It is used according to second The facial expression information at family drives the human face animation of avatar, so that the expression of avatar and the expression of second user are same Step.
It should be noted that the acquisition of the facial expression information of second user can be by being arranged in the depth at second user end Sensor device acquisition is spent, which for example can be KINECT.It can be adopted by the depth transducer equipment Collect the facial expression image and human body image of therapist.After second user end collects the facial expression image of second user, It can be by the image transmitting to server end.Server end identifies the facial expression image, obtains expression parameter, is based on the expression The human face animation of the driving parameter avatar, so that the expression synchronization of avatar and therapist.
Further, referring to Fig. 5, the above-mentioned facial expression information according to second user drives the face of avatar dynamic The detailed process of picture may comprise steps of:
Step S501, feature extraction is carried out to the facial expression information of second user, obtains the facial expression of second user Feature.
Specifically, Expression Recognition can be carried out by fusion depth image and multi-channel feature.Extract the facial expression image Textural characteristics and geometrical characteristic, textural characteristics may include that depth image entropy, gray level image entropy and color image conspicuousness are special Sign, the textural characteristics can be extracted using histogram method.And geometrical characteristic can use active appearance models AAM, from colour Facial expression feature point is extracted in image to obtain.
Step S502, according to facial expression feature, expression classification is carried out using the classifier of pre-training, obtains classification knot Fruit.
After extracting facial expression textural characteristics and geometrical characteristic, textural characteristics and geometrical characteristic are first merged, then Using dimensionality reduction fusion results as the input of classifier, which can be SVM classifier, be also possible to other classifiers. Feature is trained, classifies by classifier, obtains classification prediction result.
Step S503, test is compared with pre-established Facial expression database in classification results, obtains Expression Recognition As a result.
After obtaining classification results, which survey is compared with the Facial expression database pre-established Examination, to search out the corresponding expression of the classification results.The corresponding expression knot of each classification is stored in the Facial expression database Fruit.
Step S504, according to Expression Recognition as a result, the human face animation of driving avatar.
After identifying expression result, the corresponding expression parameter of the expression result can be input to the face of avatar Model.Since in modeling, each bone of face corresponds to an anamorphoser, each anamorphoser includes that a deformation is strong The weight of degree, therefore need to only determine that the weight of each anamorphoser can be obtained by the different movable anamorphoser parameters of face.The deformation Device parameter is expression parameter, and the human face animation of avatar can be driven according to expression parameter.To realize avatar and control Treat the expression synchronization of teacher.
In some embodiments, therapist can also set the relevant parameter of test scene.Optionally, above-mentioned Obtain the first user of the first user terminal acquisition by VR interactive device and the interaction data of 3D virtual scene that constructs in advance it Before, it can also include: the scene setting instruction for receiving second user end and sending;It is instructed according to scene setting, 3D virtual field is set The scenario parameters of scape.
It should be noted that scene setting instruction can be the instruction that therapist is issued by second user end.This Scape setting instruction can include but is not limited to mode parameter, parameter is arranged in participant, assessment parameter, the setting of case front yard room parameter, void Quasi- incarnation setting parameter etc..Wherein, mode parameter can be used for being arranged the mode of Sandplay therapy, specifically include consultation and trip Play mode.Participating in this setting parameter can be used for being arranged the number of participant, permission etc..Assessment parameter, which can be used for being arranged, to be used for The clock rate of assessment, type.Case front yard room setting parameter can be used for being arranged specific layout in 3D virtual scene, environment, color Adjust etc..Avatar setting parameter can be used for being arranged gender, age, complexion of avatar etc..That is, therapist can 3D virtual scene, participant's number and permission, avatar etc. is arranged by server end.
According to the demand of therapist, after setting 3D virtual scene, then the 3D virtual scene can be shown by VR Equipment is shown to visitor.
In some embodiments, in order to further increase the effect of Sandplay therapy, the face of visitor can be acquired in real time Facial expression image, and the facial expression image is transmitted to second user end, so that therapist can remotely observe visitor's Expression shape change is analyzed convenient for the psychological condition to visitor.
Referring to Fig. 6, above-mentioned exchange method can also include:
Step S601, the facial expression information of the first user of the first user terminal acquisition is obtained.
Specifically, the first user terminal can also include that the expression tracking for acquiring the facial expression image of visitor is set Standby, it can be specially to carry in virtual reality glasses platform which, which is specifically mounted in VR and shows in equipment, One or more small-sized high-definition cameras, to capture the facial expression image of visitor, and the facial expression figure that will be captured It is stored as being transmitted to server end, as one of assessment data, can also in real time be shown the facial expression of visitor Second user end is conducive to the analysis of therapist's remote reviewing so that therapist can recognize the psychology variation of visitor in real time The case where visitor.
Step S602, interaction data, the interaction frequency, the sand table for recording the first user are anticipated as data and the face of the first user Portion's expression information forms assessment data.
It should be noted that the above-mentioned interactive frequency refers to the total degree of user's interaction during sand table creation.Above-mentioned sand Disk meaning includes the image data for the sand table works that visitor is created and the original data of sand table as data.Server end These data are recorded, as assessment data.
Step S603, according to data of testing and assessing are formed, evaluating result is obtained.
Specifically, therapist can be allowed according to these data of testing and assessing, Synthetic by these assessment data feedbacks to therapist Teacher and the talk of visitor etc. are treated, obtains evaluating result.It is also possible to server end according to these data of testing and assessing, obtains one A evaluating result, at this point, server end can carry out the data in these test datas and the database pre-established one by one Comparison, to obtain corresponding prediction result, and feeds back to therapist for the prediction result, and assessment knot is finally determined by therapist Fruit.
The present embodiment by VR technology create safely, the virtual scene that loosens, saved the equipment such as place sand tool, be conducive to Patient or experiencer are eliminated in reality to the jamais vu of therapist, sense of insecurity, and patient or experiencer do not have in face of true Therapist, avoid it is shy, contradict psychology generation so that the effect of Sandplay therapy is more preferable, controllability, privacy are higher; It is communicated to connect between first user terminal, server end and second user end, so that patient or experiencer can be entered by network Virtual reality case front yard room carries out Sand-play therapy, breaches the limitation in space, convenience is higher.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present application constitutes any limit It is fixed.
Embodiment three
Fig. 7 is referred to, is a kind of structural schematic block diagram of interactive device provided by the embodiments of the present application, which is applied to Sand play therapy system based on VR, the system include the first user terminal, with the first user terminal communication connection server end and With the second user end of server end communication connection;
The interactive device is integrated in server end, which includes Cloud Server, which specifically includes:
Module 71 is obtained, what the first user for obtaining the acquisition of the first user terminal constructed by VR interactive device and in advance The interaction data of 3D virtual scene, 3D virtual scene include virtual front yard room, virtual sandbox and dummy mould, and the first user is Patient or experiencer;
Feedback module 72, for obtaining interaction results, and interaction results are fed back to the first user according to interaction data End, so that the first user terminal shows that equipment shows interaction results to the first user by VR;
Transmission module 73, for the interactive process information of the first user and 3D virtual scene to be transmitted to second user end, So that second user end shows interactive process information to second user, second user is therapist.
In a kind of feasible implementation, 3D virtual scene further includes the avatar of second user, and interactive device is also Include:
First expression information obtains module, the facial expression information of the second user for obtaining the acquisition of second user end;
Expression synchronization module drives the human face animation of avatar for the facial expression information according to second user, with Make the expression of avatar and the expression synchronization of second user.
In a kind of feasible implementation, expression synchronization module includes:
Feature extraction unit carries out feature extraction for the facial expression information to second user, obtains second user Facial expression feature;
Taxon, for carrying out expression classification using the classifier of pre-training, obtaining classification according to facial expression feature As a result;
Recognition unit obtains expression for test to be compared with pre-established Facial expression database in classification results Recognition result;
Driving unit, for according to Expression Recognition as a result, driving avatar human face animation.
In a kind of feasible implementation, interactive device further include:
Receiving module, for receiving the scene setting instruction of second user end transmission;
The scenario parameters of 3D virtual scene are arranged for instructing according to scene setting in scene setting module.
In a kind of feasible implementation, interactive device further include:
Second expression information obtains module, the facial expression information of the first user for obtaining the acquisition of the first user terminal;
Logging modle, interaction data, the interaction frequency, sand table for recording the first user are anticipated as data and the first user Facial expression information, formed assessment data;
Assessment module, for obtaining evaluating result according to data of testing and assessing are formed.
The present embodiment by VR technology create safely, the virtual scene that loosens, saved the equipment such as place sand tool, be conducive to Patient or experiencer are eliminated in reality to the jamais vu of therapist, sense of insecurity, and patient or experiencer do not have in face of true Therapist, avoid it is shy, contradict psychology generation so that the effect of Sandplay therapy is more preferable, controllability, privacy are higher; It is communicated to connect between first user terminal, server end and second user end, so that patient or experiencer can be entered by network Virtual reality case front yard room carries out Sand-play therapy, breaches the limitation in space, convenience is higher.
Example IV
Fig. 8 is the schematic diagram for the server that one embodiment of the application provides.As shown in figure 8, the server 8 of the embodiment wraps It includes: processor 80, memory 81 and being stored in the computer that can be run in the memory 81 and on the processor 80 Program 82,.The processor 80 realizes the step in above-mentioned each exchange method embodiment when executing the computer program 82, Such as step S401 to S403 shown in Fig. 4.Alternatively, the processor 80 realized when executing the computer program 82 it is above-mentioned each Each module or the function of unit in Installation practice.
Illustratively, the computer program 82 can be divided into one or more modules or unit, it is one or The multiple modules of person or unit are stored in the memory 81, and are executed by the processor 80, to complete the application.It is described One or more modules or unit can be the series of computation machine program instruction section that can complete specific function, which uses In implementation procedure of the description computer program 82 in the server 8.For example, the computer program 82 can be divided It is as follows to be cut into acquisition module, feedback module and transmission module, each module concrete function:
Module is obtained, the 3D that the first user for obtaining the acquisition of the first user terminal constructs by VR interactive device and in advance The interaction data of virtual scene;Feedback module, for obtaining interaction results, and interaction results are fed back to according to interaction data First user terminal, so that the first user terminal shows that equipment shows interaction results to the first user by VR;Transmission module, being used for will The interactive process information of first user and 3D virtual scene is transmitted to second user end, so that second user end is aobvious to second user Show interactive process information.
The server may include, but be not limited only to, processor 80, memory 81.It will be understood by those skilled in the art that Fig. 8 is only the example of server 8, does not constitute the restriction to server 8, may include than illustrating more or fewer portions Part perhaps combines certain components or different components, such as the server can also include input-output equipment, network Access device, bus etc..
Alleged processor 80 can be central processing unit (Central Processing Unit, CPU), can also be Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field- Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic, Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor Deng.
The memory 81 can be the internal storage unit of the server 8, such as the hard disk or memory of server 8. The memory 81 is also possible to the External memory equipment of the server 8, such as the plug-in type being equipped on the server 8 is hard Disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card (Flash Card) etc..Further, the memory 81 can also both include the internal storage unit of the server 8 or wrap Include External memory equipment.The memory 81 is for other programs needed for storing the computer program and the server And data.The memory 81 can be also used for temporarily storing the data that has exported or will export.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each function Can unit, module division progress for example, in practical application, can according to need and by above-mentioned function distribution by different Functional unit, module are completed, i.e., the internal structure of described device is divided into different functional unit or module, more than completing The all or part of function of description.Each functional unit in embodiment, module can integrate in one processing unit, can also To be that each unit physically exists alone, can also be integrated in one unit with two or more units, it is above-mentioned integrated Unit both can take the form of hardware realization, can also realize in the form of software functional units.In addition, each function list Member, the specific name of module are also only for convenience of distinguishing each other, the protection scope being not intended to limit this application.Above system The specific work process of middle unit, module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, is not described in detail or remembers in some embodiment The part of load may refer to the associated description of other embodiments.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed Scope of the present application.
In embodiment provided herein, it should be understood that disclosed device, device and method can pass through Other modes are realized.For example, device described above, apparatus embodiments are only schematical, for example, the module or The division of unit, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units Or component can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, institute Display or the mutual coupling or direct-coupling or communication connection discussed can be through some interfaces, device or unit INDIRECT COUPLING or communication connection can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated module or unit are realized in the form of SFU software functional unit and sell as independent product Or it in use, can store in a computer readable storage medium.Based on this understanding, the application realizes above-mentioned reality The all or part of the process in a method is applied, relevant hardware can also be instructed to complete by computer program, it is described Computer program can be stored in a computer readable storage medium, the computer program when being executed by processor, it can be achieved that The step of above-mentioned each embodiment of the method.Wherein, the computer program includes computer program code, the computer program Code can be source code form, object identification code form, executable file or certain intermediate forms etc..Computer-readable Jie Matter may include: can carry the computer program code any entity or device, recording medium, USB flash disk, mobile hard disk, Magnetic disk, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that described The content that computer-readable medium includes can carry out increasing appropriate according to the requirement made laws in jurisdiction with patent practice Subtract, such as does not include electric carrier signal and electricity according to legislation and patent practice, computer-readable medium in certain jurisdictions Believe signal.
Embodiment described above is only to illustrate the technical solution of the application, rather than its limitations;Although referring to aforementioned reality Example is applied the application is described in detail, those skilled in the art should understand that: it still can be to aforementioned each Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features;And these are modified Or replacement, the spirit and scope of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution should all Comprising within the scope of protection of this application.

Claims (10)

1. a kind of exchange method, which is characterized in that applied to the sand play therapy system based on VR, the system comprises described first User terminal, the second user with the server end of first user terminal communication connection and with server end communication connection End;
The exchange method is applied to the server end, and the server end includes Cloud Server, and the exchange method includes:
Obtain the friendship that the first user of the first user terminal acquisition passes through VR interactive device and the 3D virtual scene constructed in advance Mutual data, the 3D virtual scene include virtual front yard room, virtual sandbox and dummy mould, first user be patient or Experiencer;
According to the interaction data, interaction results are obtained, and the interaction results are fed back into first user terminal, so that institute It states the first user terminal and shows that equipment shows the interaction results to first user by VR;
The interactive process information of first user and the 3D virtual scene is transmitted to the second user end, so that described Second user end shows that the interactive process information, the second user are therapist to second user.
2. exchange method according to claim 1, which is characterized in that the 3D virtual scene further includes the second user Avatar, the exchange method further include:
Obtain the facial expression information of the second user of the second user end acquisition;
According to the facial expression information of the second user, the human face animation of the avatar is driven, so that the virtualization The expression synchronization of the expression of body and the second user.
3. exchange method according to claim 2, which is characterized in that described to be believed according to the facial expression of the second user Breath, drives the human face animation of the avatar, comprising:
Feature extraction is carried out to the facial expression information of the second user, obtains the facial expression feature of the second user;
According to the facial expression feature, expression classification is carried out using the classifier of pre-training, obtains classification results;
Test is compared with pre-established Facial expression database in the classification results, obtains Expression Recognition result;
According to the Expression Recognition as a result, driving the human face animation of the avatar.
4. exchange method according to claim 1, which is characterized in that obtain the of first user terminal acquisition described One user passes through before the interaction data of VR interactive device and the 3D virtual scene constructed in advance, further includes:
Receive the scene setting instruction that the second user end is sent;
It is instructed according to the scene setting, the scenario parameters of the 3D virtual scene is set.
5. exchange method according to any one of claims 1 to 4, which is characterized in that the exchange method further include:
Obtain the facial expression information of first user of the first user terminal acquisition;
The interaction data, the interaction frequency, the sand table for recording first user are anticipated as data and the face of first user Portion's expression information forms assessment data;
According to formation assessment data, evaluating result is obtained.
6. a kind of interactive device, which is characterized in that applied to the sand play therapy system based on VR, the system comprises the first users End, the second user end with the server end of first user terminal communication connection and with server end communication connection;
The interactive device is integrated in the server end, and the server end includes Cloud Server, and the interactive device includes:
Module is obtained, the 3D that the first user for obtaining the first user terminal acquisition constructs by VR interactive device and in advance The interaction data of virtual scene, the 3D virtual scene include virtual front yard room, virtual sandbox and dummy mould, and described first User is patient or experiencer;
Feedback module, for obtaining interaction results, and the interaction results are fed back to described first according to the interaction data User terminal, so that first user terminal shows that equipment shows the interaction results to first user by VR;
Transmission module is used for the interactive process information of first user and the 3D virtual scene to be transmitted to described second Family end, so that the second user end shows that the interactive process information, the second user are therapist to second user.
7. a kind of sand play therapy system based on VR, which is characterized in that communicated including the first user terminal, with first user terminal The server end of connection and the second user end communicated to connect with the server end, the server end includes cloud service Device;
First user terminal is used to acquire the first user and passes through the interaction of VR interactive device and the 3D virtual scene constructed in advance Data, and the interaction data is transmitted to the server end, the 3D virtual scene includes virtual front yard room, virtual sandbox And dummy mould, first user are patient or experiencer;
The server end is used to obtain interaction results according to the interaction data, and the interaction results is fed back to described First user terminal, so that first user terminal shows that equipment shows the interaction results to first user by VR;Institute Server end is stated to be also used to for the interactive process information of first user and the 3D virtual scene to be transmitted to second use Family end;
The second user end is used to show that the interactive process information, the second user are therapist to second user.
8. system according to claim 7, which is characterized in that the 3D virtual scene further includes the void of the second user Quasi- incarnation, the second user end further includes that the depth transducer for acquiring the facial expression information of the second user is set It is standby;
The server end is also used to receive the facial expression information, and is driven according to the facial expression information of the second user The human face animation of the avatar is moved, so that the expression synchronization of the expression of the avatar and the second user.
9. a kind of server, which is characterized in that in the memory and can be described including memory, processor and storage The computer program run on processor, the processor are realized when executing the computer program as claim 1 to 5 is any The step of item the method.
10. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer journey Sequence is realized when the computer program is executed by processor such as the step of any one of claim 1 to 5 the method.
CN201811397313.XA 2018-11-22 2018-11-22 Exchange method, device, server, storage medium and sand play therapy system Pending CN109584992A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811397313.XA CN109584992A (en) 2018-11-22 2018-11-22 Exchange method, device, server, storage medium and sand play therapy system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811397313.XA CN109584992A (en) 2018-11-22 2018-11-22 Exchange method, device, server, storage medium and sand play therapy system

Publications (1)

Publication Number Publication Date
CN109584992A true CN109584992A (en) 2019-04-05

Family

ID=65923687

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811397313.XA Pending CN109584992A (en) 2018-11-22 2018-11-22 Exchange method, device, server, storage medium and sand play therapy system

Country Status (1)

Country Link
CN (1) CN109584992A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110070944A (en) * 2019-05-17 2019-07-30 段新 Training system is assessed based on virtual environment and the social function of virtual role
CN110096145A (en) * 2019-04-11 2019-08-06 湖北大学 Psychological condition display methods and device based on mixed reality and neural network
CN110910490A (en) * 2019-11-27 2020-03-24 温州大学 Virtual sand table creating operation method and application thereof
CN112133409A (en) * 2020-09-30 2020-12-25 山西智优利民健康管理咨询有限公司 Virtual diagnosis and treatment system and method
CN112562838A (en) * 2020-12-28 2021-03-26 中国人民解放军陆军军医大学第一附属医院 Method for deducing large-batch patient emergency sand table through instant messaging software
CN113555119A (en) * 2021-07-26 2021-10-26 中国科学院自动化研究所 Scene intelligent psychological assessment system, method and equipment based on directional task
CN113723530A (en) * 2021-09-02 2021-11-30 中国科学院自动化研究所 Intelligent psychological assessment system based on video analysis and electronic psychological sand table

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106682329A (en) * 2016-12-30 2017-05-17 中南大学 Virtual sand table system and data processing method thereof
CN107280693A (en) * 2017-06-20 2017-10-24 国网技术学院 Psychoanalysis System and method based on VR interactive electronic sand tables
CN107333086A (en) * 2016-04-29 2017-11-07 掌赢信息科技(上海)有限公司 A kind of method and device that video communication is carried out in virtual scene
CN108338799A (en) * 2018-01-30 2018-07-31 重庆云日创心教育科技有限公司 Psychological assessment system and appraisal procedure based on VR sand tables
CN108459717A (en) * 2018-03-13 2018-08-28 重庆虚拟实境科技有限公司 Virtual education method, apparatus, computer installation and storage medium
CN208065739U (en) * 2018-04-16 2018-11-09 公安消防部队高等专科学校 A kind of sand table mold display rack

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107333086A (en) * 2016-04-29 2017-11-07 掌赢信息科技(上海)有限公司 A kind of method and device that video communication is carried out in virtual scene
CN106682329A (en) * 2016-12-30 2017-05-17 中南大学 Virtual sand table system and data processing method thereof
CN107280693A (en) * 2017-06-20 2017-10-24 国网技术学院 Psychoanalysis System and method based on VR interactive electronic sand tables
CN108338799A (en) * 2018-01-30 2018-07-31 重庆云日创心教育科技有限公司 Psychological assessment system and appraisal procedure based on VR sand tables
CN108459717A (en) * 2018-03-13 2018-08-28 重庆虚拟实境科技有限公司 Virtual education method, apparatus, computer installation and storage medium
CN208065739U (en) * 2018-04-16 2018-11-09 公安消防部队高等专科学校 A kind of sand table mold display rack

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110096145A (en) * 2019-04-11 2019-08-06 湖北大学 Psychological condition display methods and device based on mixed reality and neural network
CN110070944A (en) * 2019-05-17 2019-07-30 段新 Training system is assessed based on virtual environment and the social function of virtual role
CN110070944B (en) * 2019-05-17 2023-12-08 段新 Social function assessment training system based on virtual environment and virtual roles
CN110910490A (en) * 2019-11-27 2020-03-24 温州大学 Virtual sand table creating operation method and application thereof
CN112133409A (en) * 2020-09-30 2020-12-25 山西智优利民健康管理咨询有限公司 Virtual diagnosis and treatment system and method
CN112562838A (en) * 2020-12-28 2021-03-26 中国人民解放军陆军军医大学第一附属医院 Method for deducing large-batch patient emergency sand table through instant messaging software
CN112562838B (en) * 2020-12-28 2024-03-08 中国人民解放军陆军军医大学第一附属医院 Method for deducting emergency sand table of large-batch patients through instant messaging software
CN113555119A (en) * 2021-07-26 2021-10-26 中国科学院自动化研究所 Scene intelligent psychological assessment system, method and equipment based on directional task
CN113723530A (en) * 2021-09-02 2021-11-30 中国科学院自动化研究所 Intelligent psychological assessment system based on video analysis and electronic psychological sand table

Similar Documents

Publication Publication Date Title
CN109584992A (en) Exchange method, device, server, storage medium and sand play therapy system
CN112215927B (en) Face video synthesis method, device, equipment and medium
Le et al. Live speech driven head-and-eye motion generators
CN108537152A (en) Method and apparatus for detecting live body
CN108427939A (en) model generating method and device
CN111833418A (en) Animation interaction method, device, equipment and storage medium
CN108416324A (en) Method and apparatus for detecting live body
CN108347490A (en) A kind of campus application apparatus and system based on biological identification technology
CN110418095B (en) Virtual scene processing method and device, electronic equipment and storage medium
CN108885800B (en) Communication system based on Intelligent Augmented Reality (IAR) platform
CN108776786A (en) Method and apparatus for generating user's truth identification model
CN110213521A (en) A kind of virtual instant communicating method
CN107910060A (en) Method and apparatus for generating information
CN110995812A (en) Cross-platform artificial intelligence assistant system application scheme
CN110321761A (en) A kind of Activity recognition method, terminal device and computer readable storage medium
CN108388889A (en) Method and apparatus for analyzing facial image
CN110175505A (en) Determination method, apparatus, storage medium and the electronic device of micro- expression type
CN111291151A (en) Interaction method and device and computer equipment
CN109431525A (en) A kind of psychological sand table device and implementation method based on Internet of Things and virtual reality
CN114360018B (en) Rendering method and device of three-dimensional facial expression, storage medium and electronic device
CN108510466A (en) Method and apparatus for verifying face
CN113633983A (en) Method, device, electronic equipment and medium for controlling expression of virtual character
CN112071130A (en) Knowledge education system and education method based on VR technology
CN108983966A (en) Reformation of convicts assessment system and method based on virtual reality and eye movement technique
CN116630549A (en) Face modeling method and device, readable storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190405