CN114185435B - Emergency training device and method based on virtual reality equipment - Google Patents
Emergency training device and method based on virtual reality equipment Download PDFInfo
- Publication number
- CN114185435B CN114185435B CN202111514236.3A CN202111514236A CN114185435B CN 114185435 B CN114185435 B CN 114185435B CN 202111514236 A CN202111514236 A CN 202111514236A CN 114185435 B CN114185435 B CN 114185435B
- Authority
- CN
- China
- Prior art keywords
- virtual
- emergency
- model
- scene
- aid
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012549 training Methods 0.000 title claims abstract description 90
- 238000000034 method Methods 0.000 title claims abstract description 64
- 230000008569 process Effects 0.000 claims abstract description 20
- 238000013519 translation Methods 0.000 claims description 88
- 230000003993 interaction Effects 0.000 claims description 49
- 238000012544 monitoring process Methods 0.000 claims description 35
- 230000009471 action Effects 0.000 claims description 29
- 230000008859 change Effects 0.000 claims description 21
- 238000004519 manufacturing process Methods 0.000 claims description 12
- 238000001266 bandaging Methods 0.000 claims description 6
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 238000011156 evaluation Methods 0.000 claims description 6
- 230000002452 interceptive effect Effects 0.000 claims description 6
- 230000004044 response Effects 0.000 claims description 6
- 230000006870 function Effects 0.000 claims description 5
- 238000013528 artificial neural network Methods 0.000 claims description 3
- 238000013480 data collection Methods 0.000 claims description 3
- 238000009877 rendering Methods 0.000 claims description 3
- 238000010276 construction Methods 0.000 claims description 2
- 230000007474 system interaction Effects 0.000 claims description 2
- 229940088594 vitamin Drugs 0.000 claims 1
- 229930003231 vitamin Natural products 0.000 claims 1
- 235000013343 vitamin Nutrition 0.000 claims 1
- 239000011782 vitamin Substances 0.000 claims 1
- 150000003722 vitamin derivatives Chemical class 0.000 claims 1
- 238000013461 design Methods 0.000 description 12
- 238000005516 engineering process Methods 0.000 description 11
- 230000033001 locomotion Effects 0.000 description 8
- 230000008901 benefit Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 238000013507 mapping Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 239000000645 desinfectant Substances 0.000 description 3
- 229920000742 Cotton Polymers 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000009429 distress Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 238000005406 washing Methods 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- LGZXYFMMLRYXLK-UHFFFAOYSA-N mercury(2+);sulfide Chemical compound [S-2].[Hg+2] LGZXYFMMLRYXLK-UHFFFAOYSA-N 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000005180 public health Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000004804 winding Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Computer Graphics (AREA)
- Architecture (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses an emergency training device and method based on virtual reality equipment, and relates to the technical field of virtual reality, wherein the device comprises a VR head display and a handle; a plurality of virtual first-aid scenes are implanted in the VR head display; each virtual emergency scene comprises a virtual character model and a virtual emergency equipment model corresponding to the virtual emergency scene; the virtual character model at least comprises a rescuee model and a rescuer model; the handle is connected with the VR head display; the handle is used for operating the rescuer model and the virtual emergency equipment model in the virtual emergency scene to carry out emergency on the rescuee model, and the VR head display is used for acquiring and displaying the changes of the virtual character model and the virtual emergency equipment model in the emergency process. The invention can provide emergency training for both online and immersive experiences.
Description
Technical Field
The invention relates to the technical field of virtual reality, in particular to an emergency training device and method based on virtual reality equipment.
Background
The popularization of the first-aid knowledge not only comprises the wide spread of the first-aid theoretical knowledge, but also comprises the wide grasp of the first-aid skills. Along with the development of information technology, the first-aid knowledge transmission medium is gradually changed from traditional printed matters such as emergency manuals, books, propaganda columns and the like to information technology products such as emergency websites, medical software and the like. In contrast, common people have more and more opportunities to contact with the first-aid theoretical knowledge, and the acquired first-aid theoretical knowledge is more and more abundant. The popularization of the first-aid knowledge is mature, but the popularization of the first-aid knowledge cannot be only stopped on the theoretical knowledge, and more importantly, the popularization of the first-aid skill is realized.
In real life, the popularization of first-aid skills is to be enhanced. The first problem is how to rescue patients who fall suddenly, and the lack of actual first aid skills often results in businessman, which brings great risks to life safety of wounded persons. At present, the emergency skill training of residents is only conducted by the guidance of China's red meeting and emergency hospitals under the line. The method has the advantages that the beneficial crowd is less, the first-aid training is basically not contacted in rural areas and other areas, in addition, a lot of manpower and material resources are required to be consumed for organizing first-aid training, in addition, the training effect is greatly reduced due to the reason of language in the training process, and the method is obvious in the areas where multiple nationalities are located, such as Xinjiang and Tibet. For Chinese red cross and emergency hospitals, related personnel are required to be specially organized, corresponding training materials are prepared for carrying out emergency training courses; for learners, a lot of time is required to be extracted to receive training in specific places, and the problems of language failure, understanding errors and the like are also considered.
Based on the many problems with offline emergency training, there is a need in the art for an emergency training device and method to provide emergency training for online and immersive experiences.
Disclosure of Invention
The invention aims to provide an emergency training device and an emergency training method based on virtual reality equipment, which can provide on-line and immersive emergency training.
In order to achieve the above object, the present invention provides the following solutions:
an emergency training device based on virtual reality equipment, the device comprises a VR head display and a handle;
A plurality of virtual first-aid scenes are implanted in the VR head display; each virtual first-aid scene comprises a virtual character model and a virtual first-aid equipment model corresponding to the virtual first-aid scene; the virtual character model at least comprises a rescuee model and a rescuer model;
The handle is connected with the VR head display; the handle is used for operating the rescuer model and the virtual emergency equipment model in the virtual emergency scene to carry out emergency on the rescuee model, and the VR head display is used for acquiring and displaying the changes of the virtual character model and the virtual emergency equipment model in the emergency process.
Optionally, a plurality of the virtual emergency scenarios are each constructed based on a 3D modeling tool and Unity 3D.
Optionally, the plurality of virtual emergency scenes includes a virtual home emergency scene, a virtual public place emergency scene, a virtual field emergency scene, a virtual emergency bandaging scene, and a virtual doctor's office emergency scene.
Optionally, the virtual emergency equipment model comprises a public place arranged emergency equipment model; the public place-located emergency equipment model includes an automatic external defibrillator model, a home first-aid kit model, and an ambulance model.
Optionally, the changes in the virtual character model include changes in a pose of the virtual character model, changes in a motion of the virtual character model, changes in a position of the virtual character model, and changes in a state of the virtual character model.
Optionally, the change in the virtual emergency equipment model includes a change in a position of the virtual emergency equipment model and a change in a state of the virtual emergency equipment model.
Optionally, a language pack is implanted in the VR head display; the language pack is designed and manufactured by utilizing a machine translation model; the language package is used for carrying out language conversion on the text information displayed in the virtual first-aid scene.
The invention also provides the following scheme:
the first-aid training method based on the virtual reality equipment is applied to the first-aid training device based on the virtual reality equipment, and comprises the following steps:
acquiring various virtual first-aid scenes; the virtual first-aid scene is acquired based on a VR head display;
acquiring an operation action; the operation action is acquired based on a handle;
acquiring the change of a virtual character model and a virtual emergency equipment model in the virtual emergency scene according to the operation action;
judging whether the emergency process is correct according to the changes of the virtual character model and the virtual emergency equipment model;
If yes, displaying that the operation action is correct;
If not, sending a vibration signal and displaying an error prompt; the vibration signal is used for vibrating the handle; the error prompt is for display in the virtual emergency scene.
Optionally, the determining whether the emergency procedure is correct according to the changes of the virtual character model and the virtual emergency equipment model specifically includes:
Comparing the change of the virtual character model with the change of a preset virtual character model, and comparing the change of the virtual emergency equipment model with the change of the preset virtual emergency equipment model to obtain a comparison result;
If the comparison results are the same, determining that the first-aid process is correct;
if the comparison results are different, determining that the emergency procedure is incorrect.
According to the specific embodiment provided by the invention, the invention discloses the following technical effects:
According to the emergency training device and method based on the virtual reality equipment, the virtual emergency scene constructed by the 3D modeling tool and the Unity3D is implanted into the VR head display, and the rescuer model and the virtual emergency equipment model in the virtual emergency scene are operated by the handle to carry out emergency on the rescuee model, so that the emergency training of online and immersive experience is realized.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the drawings that are needed in the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a block diagram of an embodiment of a virtual reality device based emergency training apparatus of the present invention;
FIG. 2 is a flowchart of a method for constructing a virtual first-aid course according to an embodiment of the present invention;
FIG. 3 is a flow chart of emergency skill training provided by an embodiment of the present invention;
FIG. 4 is a block diagram of a virtual emergency training apparatus according to an embodiment of the present invention;
FIG. 5 is a block diagram of another virtual emergency training apparatus according to an embodiment of the present invention;
FIG. 6 is a block diagram of an electronic device for emergency skill training in a virtual emergency scene according to an embodiment of the present invention;
FIG. 7 is a flow chart of an embodiment of a virtual reality device based emergency training method of the present invention;
Fig. 8 is a flow chart of a new emergency training method according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The invention aims to provide an emergency training device and an emergency training method based on virtual reality equipment, which can provide on-line and immersive emergency training.
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.
Fig. 1 is a block diagram of an embodiment of a virtual reality device-based emergency training apparatus of the present invention. Referring to fig. 1, the virtual reality device-based emergency training apparatus includes a VR head display 1 and a handle 2.
A plurality of virtual first-aid scenes are implanted in the VR head display 1; each virtual emergency scene comprises a virtual character model and a virtual emergency equipment model corresponding to the virtual emergency scene; the virtual character model at least comprises a rescuee model and a rescuer model;
The handle 2 is connected with the VR head display 1; the handle 2 is used for operating the rescuer model and the virtual emergency equipment model in the virtual emergency scene to carry out emergency treatment on the rescuee model, and the VR head display 1 is used for acquiring and displaying the changes of the virtual character model and the virtual emergency equipment model in the emergency treatment process.
In the invention, a plurality of virtual emergency scenes are implanted in the VR head display 1, which is equivalent to downloading application software on the mobile phone, and the relation between the VR head display and the virtual emergency scenes is equivalent to the relation between the mobile phone and the treasured washing (the mobile phone is a hardware device and the treasured washing is a system based on hardware development). The virtual training system (virtual emergency scene) developed by the invention is released on the Internet, a user accesses the Internet by using the VR head display 1, accesses and installs the virtual training system, and the virtual training system can render a plurality of emergency scenes when running.
Specifically, a variety of virtual emergency scenarios are built based on 3D modeling tools and Unity 3D.
Wherein the virtual emergency scene, the virtual emergency equipment and the virtual emergency person are designed and manufactured by using 3D modeling tools such as 3D MAX and Blender. The interaction between the virtual emergency scene and the user (the handle 2) is realized based on the Unity3D technology, namely, the change of the virtual character model in the virtual emergency scene and the change of the virtual emergency equipment model in the virtual emergency scene are all constructed based on the Unity3D technology.
The plurality of virtual emergency scenes includes a virtual home emergency scene, a virtual public occasion emergency scene, a virtual field emergency scene, a virtual emergency bandaging scene, and a virtual doctor's office emergency scene.
The virtual emergency equipment model includes an emergency equipment model arranged in a public place; the public place arranged first aid equipment model comprises an automatic external defibrillator model, a home first aid kit model and an ambulance model.
The changes in the virtual character model include changes in the pose of the virtual character model, changes in the motion of the virtual character model, changes in the position of the virtual character model, and changes in the state of the virtual character model.
The change in the virtual emergency equipment model includes a change in a location of the virtual emergency equipment model and a change in a state of the virtual emergency equipment model.
A language pack is implanted in the VR head display 1; the language pack is designed and manufactured by utilizing a machine translation model; the language package is used for carrying out language conversion on the text information displayed in the virtual first-aid scene.
The VR head display 1 is embedded with a language pack, namely the language pack is downloaded to the inner side of the VR head display 1, and the VR head display 1 can load the language pack; the language package at least comprises Chinese, english, uygur language and Kazakhstan language and is used for carrying out language conversion on the text interaction information in the virtual training system.
In addition, a machine translation model can be implanted in the VR head display 1 to realize language conversion of the text information displayed in the virtual emergency scene, but the mode is slow to load and can influence user experience.
The invention provides an emergency training device based on virtual reality equipment, and provides a method for popularizing emergency knowledge and training emergency skills, as shown in fig. 2, which comprises the following steps:
Step 101: and designing and manufacturing a virtual 3D model.
Designing and manufacturing a virtual 3D model specifically comprises the following steps:
The virtual character model and the virtual emergency equipment model are designed and manufactured, and the virtual character model at least comprises a distress person model (a rescuee model) and a rescuer model which are suitable for different emergency implementation processes. The virtual first aid device model includes at least a public place arranged first aid device model, such as an automatic external defibrillator model, a home first aid kit model, and an ambulance model.
And virtualizing the gesture and behavior of the character in the real world according to the virtual character model, and displaying different emergency situations to the user.
And virtualizing the emergency equipment in the real world according to the virtual emergency equipment model, and displaying the use modes of different emergency equipment to a user.
Different actions which can be performed by the character model and the emergency equipment model are designed and manufactured. Such as: the model designed for emergency binding skills includes: a rescuer model, a wounded person model, a disinfectant model, a forceps model, a scissors model, a gauze model, a cotton swab model, and a medical kit model. The actions of the rescuer model include walking, finger up and down movement, grasping, left and right hand parallel movement toward each other. The actions of the victim model include making a sound, a basic facial expression. The disinfectant model acts include rotation, back and forth movement, up and down. The gauze action includes a side-to-side movement. The actions of the swab model include up and down movements.
The designed and manufactured virtual 3D model at least comprises a character model and an emergency equipment model, and comprises a distress call model and a rescuer model which are suitable for different emergency implementation processes.
Step 102: virtual first-aid scenes are designed and manufactured.
The virtual first-aid scene design and manufacture specifically comprises:
the gesture, action, position, moving track and moving range of the character model are preset for the specific virtual first aid scene.
The position and the state of the virtual emergency equipment are preset for a specific virtual emergency scene.
The changing process of the virtual emergency execution environment is preset for a specific virtual emergency scene.
Designing and manufacturing the virtual first-aid scene further comprises:
The virtual emergency scene includes at least a virtual emergency execution environment, a virtual emergency equipment model, a character model, and an interactive system. The emergency execution environment at least comprises a household emergency environment, a public occasion emergency environment and a field emergency environment.
The virtual emergency scene is designed and manufactured based on emergency skills. Virtual emergency scenes are designed and made according to the scenes most likely to be used by the emergency skills, wherein the virtual emergency scenes comprise virtual models, and interactions between virtual emergency implementation environments and the models. The virtual emergency implementation environment can be made by adopting live-action shooting. For example, the virtual emergency bandaging scenario includes a model of the emergency bandaging skill design, the virtual emergency enforcement environment may be a medical office or a home, and interactions between the models may be all steps required for emergency bandaging.
Step 103: the virtual scene interaction monitoring system (interaction supervision system) is designed and realized.
The interactive monitoring system specifically comprises:
And monitoring the changes of the posture, the action and the position of the character model when the character models interact.
When the character model and the virtual emergency equipment model are interacted, the change of the position and the state of the virtual emergency equipment is monitored.
When the character model and the virtual emergency execution environment interact, the change of the state, the position and the action of the character model is monitored.
When the virtual emergency equipment and the virtual emergency implementation environment interact, the state and the position of the emergency equipment are monitored.
Monitoring changes in the virtual emergency execution environment as the character model interacts with the virtual emergency execution environment.
After the user enters the virtual emergency scene, monitoring the interaction process, and feeding back the user through vibration and text prompt.
The interactive system further comprises:
And designing corresponding virtual emergency equipment models, character models and virtual emergency implementation environments based on the emergency knowledge to form corresponding emergency scenes.
Compiling interactions in the emergency scene based on the game engine at least comprises:
Interactions between character models.
Interactions between the character model and the virtual emergency equipment model.
Interactions between the character model and the virtual emergency enforcement environment.
Interaction between the virtual emergency device and the virtual emergency enforcement environment.
The interaction mode at least comprises clicking, sliding and position changing.
The virtual first-aid scene interaction supervision system at least comprises: supervising the character model action, supervising the interaction logic of the character model and the virtual environment, supervising the interaction logic of the character model and the first-aid equipment model, and supervising the position of the character model in the virtual environment;
The interaction record of the character model in the virtual emergency scene can truly reflect the grasping degree of a user aiming at a certain emergency skill. By designing the interaction monitoring system of the character model in the emergency scene, certain specific interactions of the user can be recorded, and finally, basis is provided for evaluating the skill grasping degree of the user on emergency. Such as: monitoring interaction of a rescuer model in a virtual emergency binding scene such as cancelling the liquid, taking a cotton swab, coating the disinfectant, taking gauze, winding, taking scissors, intercepting the gauze and the like, and whether the interaction occurs and the occurrence sequence reflect the emergency binding capability of a user.
And obtaining a virtual emergency training course taking emergency knowledge as a core by combining the virtual 3D model, the virtual emergency scene and the virtual scene interaction supervision system.
Text in the emergency training lesson is translated in accordance with the user language. Translating text in the emergency training lesson according to the user language further comprises:
A machine translation model is obtained by training a large number of multilingual corpus.
Setting the default target language of the user as Chinese, and setting the default target language number as Chinese number.
When a user enters a virtual emergency scene, a request for selecting a system language is submitted, wherein the request contains a target language number.
The system judges whether the target language label is a Chinese number or not, and if the system language selected by the user is Chinese, the system directly enters a virtual first-aid scene for learning. Otherwise, taking the system language selected by the user as a target language, taking the Chinese text in the virtual emergency scene as the input of a machine translation model, and outputting a translation result of the target language by the translation model to replace the corresponding Chinese text as the target language text.
And modifying the default target language number of the user, and automatically translating the virtual emergency scene text into the target language when the user enters learning next time.
When receiving a learning starting request submitted by a user, selecting translation emergency courses according to the language of the user, recording the learning process of the user, and feeding back the emergency knowledge and the mastering condition of the emergency skills of the user.
Step 104: and testing the virtual first-aid scene and the interaction monitoring system.
The first-aid knowledge popularization and first-aid skill training method further comprises the following steps:
Presetting a search box.
When a user search request is received, fuzzy query is carried out according to search contents in the request; all matched first aid knowledge, first aid skills and virtual first aid courses are fed back in a paginated manner.
The first-aid knowledge popularization and first-aid skill training method further comprises the following steps:
A recommendation button is preset.
And triggering a recommendation button when receiving user information submitted by a user.
And acquiring user information at least comprising ethnicity, occupation, family member health condition and whether the residence is in the city according to a preset user information template.
And feeding back the results of the retrieval of the virtual emergency course library and the emergency knowledge library to the user according to the user information.
The first-aid knowledge popularization and first-aid skill training method further comprises the following steps:
An emergency knowledge learning window is preset.
And displaying the first-aid knowledge to the user by receiving the operation of triggering access to the first-aid knowledge learning window by the user.
The method shown in fig. 2 is a method for developing a virtual emergency training course, which is based on virtual reality technology, and a user experiences an emergency scene in a first visual manner. In combination with machine translation techniques, multilingual emergency lessons are provided for users in different languages.
The invention provides a first-aid training device based on virtual reality equipment, and also provides a first-aid skill training method, namely a method for optimizing popularization of existing first-aid knowledge and training of first-aid skills by combining virtual reality and machine translation technology so as to improve awareness of people with different languages on the first-aid knowledge and mastery degree of the first-aid skills, as shown in fig. 3, wherein the method comprises the following steps:
Step 201: the user enters a virtual emergency scene.
Step 202: the user clicks to select the virtual scene language.
Step 203: and receiving an instruction of selecting a target language by a user.
Step 204: and selecting a target language.
The default user's target language is chinese, and in the language selection option, if the user's selected target language is chinese, chinese is set to the default language, as shown in step 204 b. If the target language selected by the user is not Chinese, the translation model is run to translate the text in the virtual scene to the target language and to set the current target language to the default language, as shown in step 204 a.
The translation model comprises the steps of collecting Chinese corpus in the first aid field, submitting a translation request to a translation website such as Goole translation and hundred-degree translation by taking Chinese text as request content, and receiving translation content in response, so that parallel corpus of Chinese dimension language, chinese English, chinese Kazakhstan and Chinese Russian is obtained. And submitting translation requests for translating Chinese into the same language to different translation websites by taking the Chinese text as request content, receiving response information, encoding translation results of the different translation websites by using a Google pretrained sentence encoder, and calculating the similarity of the different translation results by using pearson correlation coefficients. If the semantics of the different translation results are similar, receiving the translation results for constructing parallel corpus; otherwise, recording the Chinese translated at this time and the translated version thereof, and then carrying out manual examination or translation. Neural network translation models, such as a transfomer model, are trained using parallel corpora, and the translation quality of the translation model is assessed using BLUE values.
According to the language selected by the user as the target language of translation, taking the Chinese text in the virtual emergency scene as the input of a translation model, and outputting the text of the target language by the model to replace the Chinese text in the virtual emergency scene.
Step 205: the user interacts with the virtual environment, the virtual emergency equipment, the virtual character model in the virtual emergency environment.
Step 206: and monitoring the interaction of the user, recording the completion degree of the key emergency step, and evaluating the grasp condition of the user on a certain emergency skill.
Step 207: and collecting interaction information, feeding back the learning degree to the user through comparison with the correct first aid skill implementation step, and recording.
Further, as an implementation of the method shown in fig. 2 and 3, the present invention further provides a virtual emergency training system based on a virtual reality device, that is, a virtual emergency training device (an emergency knowledge popularization and emergency skill training device), which corresponds to the method shown in fig. 2 and 3, and which can correspondingly implement all the contents of the embodiment of the method shown in fig. 2 and 3, and the device is applied to an emergency training service, and specifically as shown in fig. 4, the device includes:
the model loading module (model design creating module) 301 is used for loading a specific 3D model and is also used for designing and creating a virtual 3D model, and the virtual 3D model at least comprises a character model and an emergency equipment model.
The scenario loading module (scenario design and manufacturing module) 302 is configured to load a specific virtual emergency scenario, and is further configured to design and manufacture a virtual emergency scenario, where the virtual emergency scenario includes at least a virtual emergency implementation environment, a virtual emergency equipment model, a character model, and an interactive system. The emergency execution environment at least comprises a household emergency environment, a public occasion emergency environment and a field emergency environment.
The translation module 303 is configured to translate the text of the first aid knowledge and the interaction information in the virtual first aid scene according to the target language of the user, and translate the text in the virtual first aid scene to the target language according to the target language selected by the user. The translation model may implement at least translation functions including chinese to wiki, chinese to Kazakhstan, and chinese to english.
The monitoring module 304 is configured to monitor interactions of a user in a virtual emergency scene, and monitor all interactions in the virtual emergency scene, including monitoring changes in posture, motion, and position of the character model when the character model interacts with the virtual emergency equipment model, monitoring changes in position and state of the virtual emergency equipment when the character model interacts with the virtual emergency implementation environment, monitoring changes in state and position of the character model when the virtual emergency equipment interacts with the virtual emergency implementation environment, monitoring changes in state and position of the emergency equipment when the character model interacts with the virtual emergency implementation environment, monitoring changes in the virtual emergency implementation environment when the character model interacts with the virtual emergency implementation environment, and monitoring an interaction process to feed back the user with vibration and text prompts after the user enters the virtual emergency scene.
The evaluation module 305 is used for comparing the interaction of the user in the virtual emergency scene with the steps preset for the emergency skills, evaluating the user mastering degree, and comparing the emergency knowledge points according to the interaction of the user in the virtual emergency scene, and evaluating the user mastering degree.
A feedback module 306 for feeding back the first aid knowledge and the first aid skill level (situation) to the user.
The virtual first aid training apparatus (virtual first aid skill training apparatus) further includes a recording module for recording a record of interactions of the user in the virtual first aid scene in the first person.
Further, as shown in fig. 5, the model design and manufacturing module 301 specifically includes:
A design unit 3011 for determining a required character model and emergency equipment model based on emergency skills, wiring using a modeling tool such as 3DMAX, building up the rough outline of the model, and generating a low model.
A thinning unit 3012, for introducing the low model with a small number of surfaces into a low-model engraving tool such as ZBrush4R6, and then processing the low model with reference to the object to engrave a high model. The high-modulus topology is then low-modulus using specialized model topology software to obtain a model that can be imported into the game engine.
And a mapping unit 3013, configured to perform normal mapping, UV mapping rendering, diffuse reflection mapping, and contrast normal mapping on the low mode obtained by the high mode topology.
Action design unit 3014 is used to design basic actions of different character models, such as walking, running, squatting, pressing, pulling, etc.
The scene design and production module 302 specifically includes:
a virtual emergency execution environment rendering unit 3021 for presetting a virtual emergency execution environment based on an application scenario of emergency skills and invoking execution when a user enters.
A loading unit 3022, configured to invoke execution when the user enters the virtual emergency scene, and load the relevant 3D model.
An interaction setting unit 3023 for setting specific actions and orders and system interactions based on the emergency skills.
The translation module 303 specifically includes:
The data collection unit 3031 is configured to collect chinese corpus in the first-aid field, submit a translation request to a translation website, such as a gole translation and a hundred-degree translation, with chinese text as request content, and receive translation content in a response, so as to obtain parallel corpus in chinese, chinese-english, chinese-kana, and chinese-russian.
And the checking unit 3032 is used for submitting the translation requests for translating the Chinese into the same language to different translation websites by taking the Chinese text as request content, receiving response information, encoding the translation results of the different translation websites by using a Google pretrained sentence encoder, and calculating the similarity of the different translation results by using the pearson correlation coefficient. If the semantics of the different translation results are similar, receiving the translation results for constructing parallel corpus; otherwise, recording the Chinese translated at this time and the translated version thereof, and then carrying out manual examination or translation.
A construction unit 3033 is configured to train the neural network translation model using the parallel corpus and evaluate the translation quality of the translation model using the BLUE value.
And the translation unit 3034 is used for taking the Chinese text in the virtual emergency scene as the input of a translation model according to the language selected by the user as the translated target language, and outputting the text of the target language by the model to replace the Chinese text in the virtual emergency scene.
The first recording unit 3035 is configured to record a target language currently selected by the user, automatically detect whether the target language of the user is chinese when the user enters the virtual emergency scene again, and automatically translate the text into the target language if the target language is not chinese.
The monitoring module 304 specifically includes:
And a monitoring unit 3041, configured to monitor actions and other interactions with the system of the user in the virtual emergency scene.
A second recording unit 3042 for recording actions and sequences of the user in the virtual emergency scene and other interactions with the system.
The evaluation module 305 specifically includes a comparison unit 3051 and a third recording unit 3052. The comparison unit 3051 is configured to compare a result of the second recording unit in the monitoring module with a content preset in the action setting unit in the scene design and manufacturing module when the user exits the virtual emergency scene, so as to evaluate the emergency training quality of the user according to the completion degree of the preset content.
The first-aid training device (virtual first-aid training device) comprises a processor, a memory, a sensor and a lens, wherein the model loading module, the scene loading module, the translation module, the monitoring module, the evaluation module, the feedback module and the like are all stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions. Wherein the model and scene design are stored in memory after being completed.
The processor includes a kernel, and the kernel fetches the corresponding program unit from the memory. One or more cores can be arranged, the traditional pre-hospital emergency mode is optimized by adjusting the core parameters and combining the information technology, the timeliness of pre-hospital emergency diagnosis is improved, the reasonable allocation of emergency resource utilization is realized, and the quality of pre-hospital emergency is improved.
The invention further provides a storage medium on which a program is stored, and the program is executed by a processor to realize a pre-hospital emergency method.
The invention further provides a processor, which is used for running a program, wherein the program runs to execute the pre-hospital emergency method.
The invention provides an emergency training device based on virtual reality equipment, and also provides electronic equipment, as shown in fig. 6, wherein the equipment comprises at least one processor 501, and at least one memory 502, a bus 503, a sensor 504, a lens 505 and an input device 506 which are connected with the processor 501; wherein the processor 501, the memory 502, the sensor 504, the lens 505 and the input device 506 complete communication with each other through the bus 503; the processor 501 is configured to invoke program instructions in the memory 502 to perform a pre-hospital emergency method.
The device in the invention can be a VR head display and the like.
In addition, the invention also provides an emergency knowledge popularization and emergency skill training system, which comprises the data collection unit 3031 and the checking unit 3032 in the translation module 303.
The invention also provides an electronic device, which at least comprises: the system comprises a memory, a processor, a lens, a sensor, an input device (display card) and a program which is stored on the memory and can run on the processor, wherein when the processor executes the program, the method for popularizing emergency knowledge and training the emergency skill by utilizing a virtual technology and a machine translation model is realized.
Wherein the processor and the memory communicate with each other via a bus.
The processor is used for calling program instructions in the memory to execute the pre-hospital emergency method.
The invention also provides a computer readable storage medium having a computer program stored thereon, the program when run implementing a method for first aid knowledge popularization and first aid skill training using virtual techniques and machine translation models.
Fig. 7 is a flow chart of an embodiment of a virtual reality device based emergency training method of the present invention. Referring to fig. 7, the first-aid training method based on virtual reality equipment is applied to the first-aid training device based on virtual reality equipment according to an embodiment of the first-aid training device based on virtual reality equipment, and includes:
Step S1: acquiring various virtual first-aid scenes; the virtual emergency scene is acquired based on the VR head display.
Step S2: acquiring an operation action; the operation action is acquired based on the handle.
Step S3: and acquiring the changes of the virtual character model and the virtual emergency equipment model in the virtual emergency scene according to the operation actions.
Step S4: and judging whether the emergency procedure is correct according to the changes of the virtual character model and the virtual emergency equipment model.
Wherein, the first aid process, i.e. the first aid operation performed by the user through the handle, both the virtual character model and the virtual first aid equipment model are changed during the first aid process, i.e. the first aid operation performed.
If the output result of step S4 is yes, step S5 is executed: the display operation is correct.
If the output result of the step S4 is no, executing a step S6: sending a vibration signal and displaying an error prompt; the vibration signal is used for vibrating the handle; the error prompt is for display in a virtual emergency scene.
The correct display operation is also displayed in the virtual emergency scene.
The step S4 specifically includes:
And comparing the change of the virtual character model with the change of the preset virtual character model, and comparing the change of the virtual emergency equipment model with the change of the preset virtual emergency equipment model to obtain a comparison result.
If the comparison results are the same, the emergency procedure is determined to be correct.
If the comparison results are different, the emergency procedure is determined to be incorrect.
The invention provides a novel emergency training method and device, namely a method, a device and a system for popularizing emergency knowledge and training emergency capability, which relate to the field of popularizing public health safety knowledge and the field of machine translation, and are combined with virtual reality and machine translation technology to optimize the conventional emergency knowledge popularizing and emergency skill training mode, so that the awareness degree of social crowd on the emergency knowledge and the mastering degree of the emergency skills are improved, the first witness on an emergency scene can be helped to quickly and correctly develop emergency actions before an ambulance arrives at the emergency scene, and the death rate of emergency accidents is reduced. The new emergency training method is shown in fig. 8, a virtual 3D model is designed and manufactured (the virtual 3D model at least comprises a character model and an emergency equipment model), a virtual emergency scene is designed and manufactured (the virtual emergency scene at least comprises a square emergency scene, a family emergency scene and a field emergency scene), and interaction of the virtual emergency scene and the model is designed and realized (the virtual emergency scene interaction supervision system at least comprises supervision character model actions, interaction logic of supervision character model and virtual environment, interaction logic of supervision character model and emergency equipment model and the position of supervision model in the virtual environment), the virtual emergency scene is translated according to a user target language, texts in the virtual environment are input as models, the translation model outputs texts in different languages according to actual needs, at least the translation functions of Chinese to Violet, chinese to Kazak and Chinese to English can be realized, the existing extensive emergency knowledge is highlighted through the interactive virtual emergency scene, the user learns the emergency knowledge in immersion experience, and grasps the emergency skill; the user enters a specific emergency scene by wearing the virtual display device, and interacts by selecting different languages and virtual environments, so that the aim of learning emergency knowledge and emergency skills is fulfilled.
The invention can be widely applied to popularization of social first-aid knowledge and first-aid skill. The invention mainly aims to fully utilize the advantages of the virtual reality technology in simulating the emergency scene and the advantages of the machine translation technology compared with the manual translation in multilingual translation, construct multilingual virtual emergency scene based on the emergency skills, provide immersive experience for emergency skill learners, enable the emergency learners to more economically and conveniently receive emergency skill training, further master the emergency knowledge and the emergency skills, break language barriers in the emergency training, and provide a platform for learning the emergency knowledge and training the emergency skills for more people.
Compared with the prior art, the invention has at least the following advantages:
In one aspect, the user may be provided with the greatest degree of learning freedom, and may choose emergency training content where appropriate based on personal interests or home reality, without being limited to emergency training sites and emergency schedules. Meanwhile, the problems of high cost, poor training effect, purchase of emergency training equipment, maintenance cost and the like of the conventional emergency skill training mechanism are solved.
On the other hand, the invention benefits more widely. According to the invention, the conditions that rural multi-nationality campaigns such as Xinjiang and Tibet are considered, the common general language popularization rate is low, and the existing training mode is difficult to develop are considered, a machine translation model is constructed aiming at the same virtual first-aid scene, chinese texts in the virtual first-aid scene are translated into first-aid training resources of a target language version according to target languages selected by users, the problem of weak rural first-aid strength is relieved, and the popularization degree of first-aid knowledge and first-aid skills is greatly improved.
Finally, the user experience of the invention is better. The key point of the invention is to fully utilize the advantages of the virtual reality technology in simulating the emergency scene in reality, learn the emergency skill in the virtual emergency scene in a first person-to-person mode for the user, and practice the use of the emergency skill without limitation. The immersive experience is easier and more acceptable than off-line emergency training. Meanwhile, the user exercises for many times in the virtual first-aid scene, so that the training effect is better.
In the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, and identical and similar parts between the embodiments are all enough to refer to each other.
The principles and embodiments of the present invention have been described herein with reference to specific examples, the description of which is intended only to assist in understanding the methods of the present invention and the core ideas thereof; also, it is within the scope of the present invention to be modified by those of ordinary skill in the art in light of the present teachings. In view of the foregoing, this description should not be construed as limiting the invention.
Claims (2)
1. An emergency training device based on virtual reality equipment is characterized by comprising a VR head display and a handle;
A plurality of virtual first-aid scenes are implanted in the VR head display; each virtual first-aid scene comprises a virtual character model and a virtual first-aid equipment model corresponding to the virtual first-aid scene; the virtual character model at least comprises a rescuee model and a rescuer model; the plurality of virtual emergency scenes comprise a virtual home emergency scene, a virtual public occasion emergency scene, a virtual field emergency scene, a virtual emergency bandaging scene and a virtual medical room emergency scene; the virtual emergency equipment model includes an emergency equipment model arranged in a public place; the public place arranged first-aid equipment model comprises an automatic external defibrillator model, a household first-aid kit model and an ambulance model; a language pack is implanted in the VR head display; the language pack is designed and manufactured by utilizing a machine translation model; the language package is used for carrying out language conversion on the text information displayed in the virtual first-aid scene;
The handle is connected with the VR head display; the handle is used for operating the rescuer model and the virtual emergency equipment model in the virtual emergency scene to carry out emergency treatment on the rescuee model, and the VR head display is used for acquiring and displaying the changes of the virtual character model and the virtual emergency equipment model in the emergency treatment process; the first aid process is that the first aid operation is executed by the user through the handle, and the virtual character model and the virtual first aid equipment model are changed in the first aid process, and the change is that the first aid operation is executed; judging that the emergency process is incorrect according to the changes of the virtual character model and the virtual emergency equipment model, sending a vibration signal for vibrating the handle and displaying an error prompt in the virtual emergency scene;
The first aid training device based on the virtual reality equipment further comprises: a virtual emergency training apparatus, the virtual emergency training apparatus comprising: the system comprises a model loading module, a scene loading module, a translation module, a monitoring module, an evaluation module and a feedback module;
the model loading module and the scene loading module are used for designing and manufacturing a virtual first-aid scene implanted in the VR head display; implanting a machine translation model into the VR head display to realize language conversion of the text information displayed in the virtual first-aid scene, wherein the translation model of the translation module at least realizes translation functions including Chinese to Wired language, chinese to Kazakhstan and Chinese to English; the user carries out emergency operation through the handle, both the virtual character model and the virtual emergency equipment model change in the emergency process, and the monitoring module monitors the changes of the virtual character model and the virtual emergency equipment model; the evaluation module and the feedback module evaluate and feed back the monitored changes of the virtual character model and the virtual emergency equipment model;
the model loading module is used for loading a 3D model and designing and manufacturing a virtual 3D model, and the virtual 3D model at least comprises a virtual character model and a virtual first-aid equipment model;
The scene loading module is used for loading a virtual emergency scene and designing and manufacturing the virtual emergency scene, and the virtual emergency scene at least comprises a virtual emergency implementation environment, a virtual emergency equipment model, a character model and an interactive system; the emergency implementation environment at least comprises a household emergency environment, a public occasion emergency environment and a field emergency environment;
The translation module is used for translating the emergency knowledge text and the interaction information in the virtual emergency scene according to the target language of the user and translating the text in the virtual emergency scene to the target language according to the target language selected by the user; the translation model at least realizes the translation functions of Chinese to vitamin, chinese to Kazakhstan and Chinese to English;
The monitoring module is used for monitoring the interaction of a user in the virtual emergency scene, monitoring all interactions in the virtual emergency scene, including monitoring the changes of the posture, the action and the position of the character model when the character model interacts with the virtual emergency equipment model, monitoring the changes of the position and the state of the virtual emergency equipment when the character model interacts with the virtual emergency implementation environment, monitoring the changes of the state and the position of the character model when the virtual emergency equipment interacts with the virtual emergency implementation environment, monitoring the changes of the state and the position of the emergency equipment when the character model interacts with the virtual emergency implementation environment, monitoring the changes of the virtual emergency implementation environment when the character model interacts with the virtual emergency implementation environment, and monitoring the interaction process to feed back the user by vibration and text prompts after the user enters the virtual emergency scene;
The assessment module is used for comparing the interaction of the user in the virtual emergency scene with the steps preset for the emergency skills, assessing the user mastering degree, and also used for comparing the emergency knowledge points according to the interaction of the user in the virtual emergency scene, and assessing the user mastering degree;
the feedback module is used for feeding back first-aid knowledge and first-aid skill mastering degree to the user;
the virtual emergency training device further comprises a recording module, wherein the recording module is used for recording interaction records of the user in the virtual emergency scene by the first person;
The scene loading module specifically comprises:
a virtual emergency execution environment rendering unit for presetting a virtual emergency execution environment based on an application scene of emergency skills and invoking execution when a user enters;
the loading unit is used for calling and executing when the user enters the virtual emergency scene, and loading the 3D model;
an interaction setting unit for setting specific actions, order and system interactions based on the first aid skills;
The translation module specifically comprises:
The data collection unit is used for collecting Chinese corpus in the first-aid field, submitting a translation request to a translation website by taking a Chinese text as a request content, and receiving translation content in a response, so that parallel corpus of Chinese dimension language, chinese English, chinese Kazak language and Chinese Russian language is obtained;
The checking unit is used for submitting translation requests for translating Chinese into the same language to different translation websites by taking Chinese texts as request contents, receiving response information, encoding translation results of the different translation websites by using a Google pretrained sentence encoder, and calculating the similarity of the different translation results by using pearson correlation coefficients; if the semantics of the different translation results are similar, receiving the translation results for constructing parallel corpus; otherwise, recording the Chinese translated at this time and the translated version thereof, and then carrying out manual examination or translation;
The construction unit is used for training a neural network translation model by using the parallel corpus;
The translation unit is used for taking the language selected by the user as a translated target language, taking the Chinese text in the virtual emergency scene as the input of a translation model, and outputting the text of the target language by the model to replace the Chinese text in the virtual emergency scene;
The first recording unit is used for recording the target language selected by the user currently, automatically detecting whether the target language of the user is Chinese when the user enters the virtual emergency scene again, and automatically translating the text into the target language if the target language of the user is not Chinese;
The monitoring module specifically comprises:
the monitoring unit is used for monitoring actions of a user in the virtual emergency scene and other interactions with the system;
A second recording unit for recording actions and sequences of the user in the virtual emergency scene and other interactions with the system;
The evaluation module specifically comprises a comparison unit and a third recording unit; the comparison unit is used for comparing the result of the second recording unit in the monitoring module with the preset content in the action setting unit in the scene loading module when the user exits the virtual emergency scene, and evaluating the emergency training quality of the user according to the completion degree of the preset content.
2. The virtual reality device-based emergency training apparatus of claim 1, wherein a plurality of the virtual emergency scenarios are each constructed based on a 3D modeling tool and Unity 3D.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111514236.3A CN114185435B (en) | 2021-12-13 | 2021-12-13 | Emergency training device and method based on virtual reality equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111514236.3A CN114185435B (en) | 2021-12-13 | 2021-12-13 | Emergency training device and method based on virtual reality equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114185435A CN114185435A (en) | 2022-03-15 |
| CN114185435B true CN114185435B (en) | 2024-06-25 |
Family
ID=80543339
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111514236.3A Active CN114185435B (en) | 2021-12-13 | 2021-12-13 | Emergency training device and method based on virtual reality equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114185435B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110867122A (en) * | 2019-12-11 | 2020-03-06 | 温州医科大学 | Interactive first-aid training system based on virtual reality technology |
| CN113112578A (en) * | 2021-05-17 | 2021-07-13 | 中国人民解放军军事科学院军事医学研究院 | Simulated rescue training method, computer device and computer readable medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9886873B2 (en) * | 2012-04-19 | 2018-02-06 | Laerdal Medical As | Method and apparatus for developing medical training scenarios |
| JP2022516074A (en) * | 2018-12-27 | 2022-02-24 | マジック リープ， インコーポレイテッド | Systems and methods for virtual and augmented reality |
| CN110335359B (en) * | 2019-04-22 | 2023-01-03 | 国家电网有限公司 | Distribution board fire accident emergency drilling simulation method based on virtual reality technology |
| CN111091732B (en) * | 2019-12-25 | 2022-05-27 | 塔普翊海（上海）智能科技有限公司 | Cardiopulmonary resuscitation (CPR) instructor based on AR technology and guiding method |
| CN112102677A (en) * | 2020-09-17 | 2020-12-18 | 中国人民解放军陆军军医大学 | Mixed reality high-simulation battle site emergency training platform and training method thereof |
-
2021
- 2021-12-13 CN CN202111514236.3A patent/CN114185435B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110867122A (en) * | 2019-12-11 | 2020-03-06 | 温州医科大学 | Interactive first-aid training system based on virtual reality technology |
| CN113112578A (en) * | 2021-05-17 | 2021-07-13 | 中国人民解放军军事科学院军事医学研究院 | Simulated rescue training method, computer device and computer readable medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114185435A (en) | 2022-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Dharwadkar et al. | A medical chatbot | |
| Paramythis et al. | A modular approach to the evaluation of adaptive user interfaces | |
| Treu | User interface evaluation: A structured approach | |
| TWI597699B (en) | Medical diagnosis management education system and method thereof | |
| Zhang et al. | Assessing social communication and collaboration in autism spectrum disorder using intelligent collaborative virtual environments | |
| CN109035085A (en) | A kind of online course assiatant method and computer equipment | |
| Damacharla et al. | Effects of voice-based synthetic assistant on performance of emergency care provider in training | |
| WO2012020906A1 (en) | Apparatus and method for generating a cognitive training application program using brain waves, and medium for recording same | |
| Lugrin et al. | Adapted foreigner-directed communication towards virtual agents | |
| Hossain et al. | Mr. Dr. Health-Assistant Chatbot | |
| CN114185435B (en) | Emergency training device and method based on virtual reality equipment | |
| Kiuchi et al. | Psychological insights into the research and practice of embodied conversational agents, chatbots and social assistive robots: a systematic meta-review | |
| CN116936037A (en) | Online psychological consultation method and system based on artificial intelligence | |
| Wang | [Retracted] Computer‐Aided College English Teaching System Based on Virtual Reality and Artificial Intelligence | |
| Lin et al. | Development of safety training in construction: Literature review, scientometric analysis, and meta-analysis | |
| Su et al. | Implication of cognitive style in designing computer‐based procedure interface | |
| Tellols et al. | Sentient embodied conversational agents: Architecture and evaluation | |
| Alfredo et al. | Slade: A method for designing human-centred learning analytics systems | |
| Sun et al. | AR-voice interaction research based on factor analysis | |
| Vanderheiden et al. | Will AI allow us to dispense with all or most accessibility regulations? | |
| Yu et al. | Application of psychological counseling system based on virtual reality technology in college students' psychological counseling | |
| KR20140105112A (en) | Language evaluation system through network and its method | |
| KR102511777B1 (en) | Systems and methods for accessible computer-user interaction | |
| CN117180588A (en) | Cognitive function rehabilitation training device, system and control method | |
| Lopes et al. | A service oriented ontological framework for the semantic validation of web accessibility |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |