CN116682304B - Teaching method, system, storage medium and device in virtual reality environment - Google Patents

Teaching method, system, storage medium and device in virtual reality environment Download PDF

Info

Publication number
CN116682304B
CN116682304B CN202310968030.0A CN202310968030A CN116682304B CN 116682304 B CN116682304 B CN 116682304B CN 202310968030 A CN202310968030 A CN 202310968030A CN 116682304 B CN116682304 B CN 116682304B
Authority
CN
China
Prior art keywords
virtual
teaching
equipment
mode
head
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310968030.0A
Other languages
Chinese (zh)
Other versions
CN116682304A (en
Inventor
王晓敏
张琨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangxi Geruling Technology Co ltd
Original Assignee
Jiangxi Geruling Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangxi Geruling Technology Co ltd filed Critical Jiangxi Geruling Technology Co ltd
Priority to CN202310968030.0A priority Critical patent/CN116682304B/en
Publication of CN116682304A publication Critical patent/CN116682304A/en
Application granted granted Critical
Publication of CN116682304B publication Critical patent/CN116682304B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The invention provides a teaching method, a system, a storage medium and equipment in a virtual reality environment, wherein the method comprises the steps of constructing a virtual teaching scene, then obtaining time information and login information of a virtual demonstrator, and judging whether the virtual teaching scene is activated or not; if yes, corresponding head-mounted VR equipment and operation equipment are activated, a virtual operation device is loaded at the same time, and an operation instruction generated by a virtual demonstrator is acquired; according to the operation instruction, a corresponding teaching mode is triggered, corresponding target operation equipment is activated, operation information of the target operation equipment is acquired in real time, interaction information of a virtual user corresponding to the target operation equipment and a virtual operation device is acquired, and the virtual user and the virtual operation device are displayed through the head-mounted VR equipment to complete teaching.

Description

Teaching method, system, storage medium and device in virtual reality environment
Technical Field
The invention belongs to the technical field of virtual reality, and particularly relates to a teaching method, a teaching system, a storage medium and teaching equipment in a virtual reality environment.
Background
With the development of society, virtual reality technology is widely focused, and is applied to various fields, such as video entertainment, education, medicine, military, and the like.
Aiming at the education field, if the virtual reality technology is reasonably utilized, the teaching aid is greatly helpful, and particularly for practical exercises. At present, operators are generally required to operate specific industrial robot courseware (for example, three-year maintenance of an industrial robot), and the mastering capability of a novice user can be improved through actual operation.
However, in the course of teaching a teacher down-line, many problems are faced, such as (1) because of the need for a real-world field, the limitation of the field area is encountered; (2) The manufacturing cost of the physical robot is high, and the physical robot is limited by the place when being placed; (3) The maintenance cost of the physical robot is high, and a certain risk exists when an operator operates the physical robot; (4) In the teaching process, teachers are not beneficial to students to watch and learn because of being limited by places, and the learning effect is affected; (5) data during operation cannot be recorded.
Disclosure of Invention
Based on this, the embodiment of the invention provides a teaching method, a system, a storage medium and a device in a virtual reality environment, so as to solve the above-mentioned problems possibly faced when a teacher performs an offline teaching process.
A first aspect of an embodiment of the present invention provides a teaching method in a virtual reality environment, applied to a scenario of a head-mounted VR device and an operating device electrically connected to the head-mounted VR device, where the method includes:
constructing a virtual teaching scene which at least comprises a virtual user and a virtual operation device, wherein the virtual user comprises a virtual demonstrator and a virtual educator;
acquiring time information and login information of a virtual demonstrator, and judging whether to activate a virtual teaching scene;
if yes, acquiring virtual trainee login information, activating corresponding head-mounted VR equipment and operation equipment according to the virtual trainee login information and the virtual trainee login information, loading the virtual operation device at the same time, and acquiring an operation instruction generated by the virtual trainee, wherein the iris of the trainee is acquired through the head-mounted VR equipment, and personal information of the trainee is determined according to the acquired iris information;
triggering a corresponding teaching mode according to the operation instruction, wherein the teaching mode at least comprises a teacher teaching sub-mode, a designated exercise sub-mode and a full-staff exercise sub-mode;
Activating corresponding target operation equipment according to the teaching mode, collecting operation information of the target operation equipment in real time, and simultaneously acquiring interaction information of a virtual user corresponding to the target operation equipment and the virtual operation device, and displaying through the head-mounted VR equipment to complete teaching;
judging whether an operation abnormality exists or not according to the operation information;
if yes, the corresponding head-mounted VR equipment is controlled to send an assistance request to the head-mounted VR equipment of the demonstrator so as to inform the demonstrator of intervention;
the step of judging whether the operation abnormality exists according to the operation information comprises the following steps:
acquiring eyeball photos through head-mounted VR equipment, and judging whether the subject is distracted according to the eyeball photos;
if not, acquiring the current operation step of the subject, matching the corresponding operation standard, and judging whether the operation of the subject accords with the operation standard;
if not, determining that the operation abnormality exists;
and triggering a corresponding teaching mode according to the operation instruction, wherein the teaching mode at least comprises a teacher teaching sub-mode, an appointed training sub-mode and a full-member training sub-mode, when the full-member training sub-mode is triggered, a virtual station is controlled to be generated at an appointed position of each virtual taught person, virtual courseware is configured on the virtual station, a communication barrier is formed in a preset range of each virtual station, and the communication barrier is used for carrying out voice communication on the corresponding taught person when one virtual taught person enters the communication barrier corresponding to the virtual station of the other virtual taught person.
Further, the step of obtaining the time information and the login information of the virtual demonstrator and judging whether to activate the virtual teaching scene includes:
obtaining login information of a virtual demonstrator, and judging whether the demonstrator is online;
if yes, acquiring time information, and judging whether the class time is reached;
if yes, activating the virtual teaching scene.
Further, according to the operation instruction, triggering a corresponding teaching mode, where the teaching mode at least includes a teacher teaching sub-mode, a designated exercise sub-mode, and a full-member exercise sub-mode, and the steps include:
when a teacher teaching sub-mode is triggered, only the speaking function of the head-mounted VR equipment corresponding to the virtual teaching person is controlled to be started, the operation equipment is activated, and meanwhile, the virtual operation device in the virtual teaching scene is controlled to be displayed in the view angles of all the teaching persons;
when the appointed exercise sub-mode is triggered, only the speaking function of the head-mounted VR equipment of the appointed educated person and the demonstrator is controlled to be started, and the operation equipment is activated;
when the full-staff exercise sub-mode is triggered, the speaking function of the head-mounted VR equipment of all the trainees and the demonstrators is controlled to be started, the operation equipment is activated, and meanwhile, the operation process of all the virtual trainees is supervised to acquire the exercise progress and abnormal feedback of the trainees.
Further, activating the corresponding target operation device according to the teaching mode, collecting operation information of the target operation device in real time, and simultaneously obtaining interaction information of a virtual user corresponding to the target operation device and the virtual operation device, and displaying the interaction information through the head-mounted VR device, so that the teaching is completed, and then the method comprises the following steps:
and respectively acquiring operation steps and corresponding operation time lengths in the training process of each virtual trainee, and generating a data report according to the operation steps and the operation time lengths, wherein the data report comprises training data of each trainee and comprehensive training data of all the trainees, and is used for helping the trainee to know teaching conditions.
A second aspect of an embodiment of the present invention provides a teaching system in a virtual reality environment, applied to a scenario of a head-mounted VR device and an operating device electrically connected to the head-mounted VR device, where the system includes:
the system comprises a construction module, a control module and a control module, wherein the construction module is used for constructing a virtual teaching scene which at least comprises a virtual user and a virtual operation device, and the virtual user comprises a virtual demonstrator and a virtual educator;
the judging module is used for acquiring time information and login information of the virtual demonstrator and judging whether to activate the virtual teaching scene or not;
The virtual teaching device comprises an acquisition module, a virtual operation device and a virtual teaching module, wherein the acquisition module is used for acquiring virtual teaching subject login information when judging that a virtual teaching scene needs to be activated, activating corresponding head-mounted VR equipment and operation equipment according to the virtual teaching subject login information and the virtual teaching subject login information, loading the virtual operation device at the same time, and acquiring an operation instruction generated by the virtual teaching subject, wherein the iris of the teaching subject is acquired through the head-mounted VR equipment, and personal information of the teaching subject is determined according to the acquired iris information;
the trigger module is used for triggering a corresponding teaching mode according to the operation instruction, the teaching mode at least comprises a teacher teaching sub-mode, an appointed exercise sub-mode and a full-member exercise sub-mode, when the full-member exercise sub-mode is triggered, a virtual station is controlled to be generated at an appointed position of each virtual taught person, virtual courseware is configured on the virtual station, a communication barrier is formed in a preset range of each virtual station, and the communication barrier is used for enabling a corresponding taught person to conduct voice communication when a certain virtual taught person enters the communication barrier corresponding to the virtual station of another virtual taught person;
The activation module is used for activating the corresponding target operation equipment according to the teaching mode, collecting the operation information of the target operation equipment in real time, and simultaneously obtaining the interaction information of the virtual user corresponding to the target operation equipment and the virtual operation device, and displaying the interaction information through the head-mounted VR equipment so as to complete teaching;
the system further comprises:
the operation abnormality judging module is used for judging whether operation abnormality exists or not according to the operation information;
the transmitting module is used for controlling the corresponding head-mounted VR equipment to transmit an assistance request to the head-mounted VR equipment of the demonstrator so as to inform the demonstrator of intervention when the existence of the operation abnormality is determined;
the operation abnormality judgment module includes:
a third judging unit, configured to obtain an eyeball photograph through a head-mounted VR device, and judge whether the subject is distracted according to the eyeball photograph;
a fourth judging unit, configured to obtain the current operation step of the subject when it is judged that the subject is focused, match the corresponding operation standard, and judge whether the operation of the subject meets the operation standard;
an operation abnormality determining unit for determining that there is an operation abnormality when it is judged that the operation of the subject does not meet the operation standard.
A third aspect of the embodiments of the present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the teaching method in the virtual reality environment provided in the first aspect.
A fourth aspect of an embodiment of the present invention provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the teaching method in the virtual reality environment provided in the first aspect when executing the program.
The teaching method, the teaching system, the storage medium and the teaching equipment in the virtual reality environment provided by the embodiment of the invention have the following beneficial effects:
the virtual teaching scene at least comprises a virtual user and a virtual operation device, wherein the virtual user comprises a virtual demonstrator and a virtual educator; acquiring time information and login information of a virtual demonstrator, and judging whether to activate a virtual teaching scene; if yes, acquiring virtual trainee login information, activating corresponding head-mounted VR equipment and operation equipment according to the virtual trainee login information and the virtual trainee login information, loading the virtual operation device at the same time, and acquiring an operation instruction generated by the virtual trainee; triggering a corresponding teaching mode according to the operation instruction, wherein the teaching mode at least comprises a teacher teaching sub-mode, a designated exercise sub-mode and a full-member exercise sub-mode; according to the teaching mode, corresponding target operation equipment is activated, operation information of the target operation equipment is acquired in real time, interaction information of a virtual user corresponding to the target operation equipment and a virtual operation device is acquired, and the virtual user and the virtual operation device are displayed through the head-mounted VR equipment to complete teaching.
Drawings
Fig. 1 is a flowchart for implementing a teaching method in a virtual reality environment according to a first embodiment of the present invention;
fig. 2 is a block diagram of a teaching system in a virtual reality environment according to a second embodiment of the present invention;
fig. 3 is a block diagram of an electronic device according to a third embodiment of the present invention.
Detailed Description
In order that the invention may be readily understood, a more complete description of the invention will be rendered by reference to the appended drawings. Several embodiments of the invention are presented in the figures. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
It will be understood that when an element is referred to as being "mounted" on another element, it can be directly on the other element or intervening elements may also be present. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present. The terms "vertical," "horizontal," "left," "right," and the like are used herein for illustrative purposes only.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and/or" as used herein includes any and all combinations of one or more of the associated listed items.
Example 1
Referring to fig. 1, fig. 1 shows a teaching method in a virtual reality environment, provided by a first embodiment of the present invention, which is applied to a scenario of a head-mounted VR device and an operation device electrically connected to the head-mounted VR device, and the method specifically includes steps S01 to S05.
And S01, constructing a virtual teaching scene which at least comprises a virtual user and a virtual operation device, wherein the virtual user comprises a virtual demonstrator and a virtual educator.
Specifically, a virtual teaching scene is first required to be built and manufactured in a modeling manner, wherein the built virtual teaching scene at least comprises a virtual user and a virtual operation device, the virtual user can be a virtual demonstrator and a virtual educator, and also can be a virtual temporary user, the virtual demonstrator can be understood as a virtual teacher, the virtual educator can be understood as a virtual student, the virtual temporary user can be understood as a temporary added virtual character, such as a virtual lesson person, and the virtual operation device is virtual training equipment, and in the embodiment, the virtual teaching scene is a virtual industrial robot, but is not limited by the virtual teaching scene, and in other embodiments, the virtual teaching scene can be also large-sized high-precision equipment, high-risk equipment, and the like.
Step S02, time information and virtual demonstrator login information are acquired, whether the virtual teaching scene is activated is judged, and if yes, step S03 is executed.
It should be noted that, first, the virtual demonstrator login information is acquired, and whether the demonstrator is online is determined according to the acquired virtual demonstrator login information, where the virtual demonstrator login information may include a connection condition of a communication signal, that is, when the communication signal having an IP address representing the identity of the demonstrator establishes connection, it indicates that the demonstrator is online, and in order to prevent the situation that other users except the demonstrator take the place of online by impersonation, an iris database needs to be established in advance, that is, iris information of the demonstrator, the trainee and related personnel is collected, and then a mapping relationship is established between the iris information and corresponding personal information, so that when the iris of the user is acquired through the head-mounted VR device, the personal information is determined according to the acquired iris information, and it may be understood that the personal information may include contents such as name, grade, number, etc. Specifically, when the time of the lesson is reached, all iris information which can be acquired is acquired, personal information is matched according to the iris information, meanwhile, the information of the person to be taught which needs to participate in the current lesson theoretically is called, and the result of the iris-matched personal information is compared with the information of the person to be taught theoretically so as to determine the absent personnel.
Further, the current time and the preset class time are obtained, when the current time reaches the preset class time, the teaching state is indicated to be immediately entered, and then the virtual teaching scene is activated, namely, the virtual teaching scene is presented in front of the eyes of a demonstrator and a trainee through the head-mounted VR equipment, meanwhile, character models of the virtual demonstrator and the virtual trainee appear in the virtual teaching scene, and in addition, in order to enhance the interestingness and the freshness, the appearance of various different character models can be provided for the user to select.
Step S03, acquiring virtual trainee login information, activating corresponding head-mounted VR equipment and operation equipment according to the virtual trainee login information and the virtual trainee login information, loading the virtual operation device at the same time, and acquiring an operation instruction generated by the virtual trainee.
Specifically, according to the obtained virtual demonstrator login information and virtual trainee login information, corresponding head-mounted VR equipment and operation equipment are activated, wherein the head-mounted VR equipment is used for presenting two-dimensional and three-dimensional pictures, the operation equipment is used for manipulating virtual characters or virtual scenes and the like, and further, virtual operation devices, namely equipment needing to be exercised, can be also called courseware are loaded.
It can be understood that after a user enters a virtual environment, after the user triggers to enter a class, the class is loaded first, so that the teaching class is conveniently subjected to self state detection, the program application is free, the teaching of a smoother operation process of a teacher is finally achieved, the teaching class can be displayed in the virtual environment after the class is loaded, and the user in the current virtual environment can see the initialized class state. After the preparation is finished, the virtual demonstrator sends out an operation instruction to enter different demonstration modes.
And step S04, triggering a corresponding teaching mode according to the operation instruction, wherein the teaching mode at least comprises a teacher teaching sub-mode, a designated exercise sub-mode and a full-member exercise sub-mode.
In this embodiment, the teaching mode includes at least a teacher teaching sub-mode, a designated training sub-mode and a full-member training sub-mode, when the teacher teaching sub-mode is triggered, only the speaking function of the head-mounted VR device corresponding to the virtual teaching person is controlled to be turned on, the operation device is activated, and at the same time, the virtual operation device in the virtual teaching scene is controlled to be presented in the view angles of all the teaching subjects, in the teaching mode, the teaching mode is mainly explained by the teacher, so that the user except the teacher does not need to speak, and if necessary, the user can designate speaking; when the appointed exercise sub-mode is triggered, only the speaking function of the head-mounted VR equipment of the appointed educated person and the demonstrator is controlled to be started, and the operation equipment is activated; when the full-staff exercise sub-mode is triggered, the speaking function of the head-mounted VR equipment of all the trainees and the demonstrators is controlled to be started, the operation equipment is activated, and meanwhile, the operation process of all the virtual trainees is supervised to acquire the exercise progress and abnormal feedback of the trainees.
In any mode, a teacher can control the sound of a certain virtual student or an integral student, and control the student to answer in a scene, so that the problem of random question asking of teaching in a teacher course can be solved, and the method is beneficial to ensuring good class order.
And step S05, activating the corresponding target operation equipment according to the teaching mode, collecting the operation information of the target operation equipment in real time, and simultaneously acquiring the interaction information of the virtual user corresponding to the target operation equipment and the virtual operation device, and displaying through the head-mounted VR equipment to complete teaching.
In this embodiment, according to the teaching mode, a corresponding target operation device is activated, and operation information of the operation device is collected in real time; judging whether the operation is abnormal or not according to the operation information; if yes, the corresponding head-mounted VR device is controlled to send an assistance request to the head-mounted VR device of the demonstrator so as to inform the demonstrator of the intervention. Specifically, the step of judging whether the operation abnormality exists according to the operation information includes acquiring an eyeball photo through a head-mounted VR device, judging whether the attention of a person to be taught is not concentrated according to the eyeball photo, wherein the eyeball photo is acquired in real time through the head-mounted VR device, and the eyeballs are identified, if the eyeballs are not identified within a certain continuous time, the fact that the user has a long-time eye closing condition and possibly has a dozing suspicion is indicated, and the corresponding head-mounted VR device can be controlled to send an assistance request to the head-mounted VR device of the demonstrator so as to inform the demonstrator of intervention; if not, acquiring the current operation step of the subject, matching the corresponding operation standard, and judging whether the operation of the subject accords with the operation standard; if not, the corresponding head-mounted VR device can be controlled to send an assistance request to the head-mounted VR device of the demonstrator to inform the demonstrator of the intervention. The intelligent online inspection system has the advantages that the inspection problem of offline teachers is solved by providing the monitoring capability, the offline inspection efficiency is low, the supervision is not complete, no better supervision mode is available, the system supervision capability assists teaching management of the teacher through system supervision in the whole-student exercise process, the teacher can know the exercise progress of each student at the first time, and under abnormal conditions, scene intervention is carried out, auxiliary teaching can be completed at the first time, the exercise efficiency of specific students is improved, the teaching and supervision requirements of teacher classroom exercises are finally solved, and the whole teaching quality is improved.
In the operation process of each subject, the operation data is recorded in real time, and as the corresponding operation standard, namely the sequence of steps, the operation time limit of each step and the like, is formulated for the operation flow in advance, whether the abnormal operation exists or not is judged according to the data recorded in real time and the operation standard. In addition, after the operation of all the educators is finished, the operation steps and the corresponding operation time length in the training process of each virtual educator are respectively obtained, and a data report is generated according to the operation steps and the operation time length and is used for helping the educators to know the teaching condition, wherein the data report comprises training data of each educator and comprehensive training data of all the educators, and through the data report, the user can know which educator has better mastered condition and which operation step is the condition of the ubiquitous problem.
Specifically, when a specific courseware is required to be operated, viewing of virtual action animation is performed through real-time visual data transmission, and in the operation process, people in a virtual environment need to record current operation nodes because of random assignment, so that intervention operation can be performed at any time when the operation nodes are assigned to be operated, students performing the courseware can perform real-time synchronous transmission on data when the students performing the courseware are operated, and other students in a virtual scene can see the latest execution state of real-time update of the courseware to complete teaching. It should be noted that, when the user is operating courseware, the action change of the virtual limbs is supported and displayed, the actual action off line is simulated more vividly and specifically, and better watching experience is finally displayed for students.
It should be noted that, because training is performed in a virtual teaching scene, the method is not limited by a site, each subject has a single virtual courseware to perform operation, in order to be more practical, each subject can control the virtual subjects to walk in the virtual teaching scene to perform communication, watching and learning. In addition, since the virtual teaching subject can be operated to move by the teaching subject, disorder of class order may be caused, and at this time, the virtual teaching subject can be controlled by the teaching subject, namely, the virtual teaching subject is controlled to roam and seat to be fixed in the virtual teaching scene.
In order to achieve the above-mentioned functions, that is, to enable virtual users to move in space and to perform private conversations in a preset area, while other virtual users cannot hear conversations between them, specifically, virtual users are digitized entities created by using virtual reality technology, each virtual user has unique identity and attribute, and can freely move in virtual teaching scenes.
The demonstrator or the educator can create own virtual users and set personalized appearance and attribute for the virtual users, wherein each virtual user has a unique identity identifier for identification and positioning in the virtual teaching scene. Specifically, a coordinate system is firstly constructed, a virtual teaching scene is built on the basis of the coordinate system, after the virtual teaching scene is built, the target positions of virtual objects such as a virtual station, a virtual operation device and the like relative to the edge coordinate positions are determined according to the edge coordinate positions of the virtual teaching scene, meanwhile, a circular area is drawn by taking the center coordinate of a plane view of a overlooking view of the virtual station as a circle center, a preset distance is taken as a radius, boundary coordinates of the circular area are determined, it is required to be explained that the plane view of the overlooking view of the virtual station is that extreme coordinate points in the upper, lower, left and right directions, namely maximum values and minimum values on an x-axis and a y-axis, are determined according to the overlooking view of the virtual station, after the extreme coordinate points are determined, parallel lines with the x-axis are respectively drawn by the upper extreme point and the lower extreme point, parallel lines with the y-axis are respectively drawn by the left extreme point and the right extreme point, and the area enclosed by the four parallel lines is the plane view of the virtual station.
In this embodiment, a communication barrier with a certain transparency may be formed in the z-axis direction on the basis of the coordinates of the communication barrier, for displaying in a virtual teaching scene, in addition, a movable virtual user in the virtual teaching scene is also composed of a plurality of coordinate points, where the plurality of coordinate points include a core coordinate point and a non-core coordinate point associated with the core coordinate point, where the core coordinate point of the virtual user head is determined as a target coordinate point, and it may be understood that the core coordinate point of the virtual user head is a central coordinate point of the virtual user head area, and specifically, when the target coordinate point breaks through the coordinates of the communication barrier and enters the circular area, a voice interaction of a virtual user in the communication barrier is established. The corresponding virtual user converts the received digital signal back to speech using the same technique, enabling a real-time speech dialogue between the two virtual users.
In summary, in the teaching method in the virtual reality environment in the above embodiment of the present invention, a virtual teaching scene is constructed, where the virtual teaching scene includes at least a virtual user and a virtual operation device, and the virtual user includes a virtual demonstrator and a virtual educator; acquiring time information and login information of a virtual demonstrator, and judging whether to activate a virtual teaching scene; if yes, acquiring virtual trainee login information, activating corresponding head-mounted VR equipment and operation equipment according to the virtual trainee login information and the virtual trainee login information, loading the virtual operation device at the same time, and acquiring an operation instruction generated by the virtual trainee; triggering a corresponding teaching mode according to the operation instruction, wherein the teaching mode at least comprises a teacher teaching sub-mode, a designated exercise sub-mode and a full-member exercise sub-mode; according to the teaching mode, corresponding target operation equipment is activated, operation information of the target operation equipment is acquired in real time, interaction information of a virtual user corresponding to the target operation equipment and a virtual operation device is acquired, and the virtual user and the virtual operation device are displayed through the head-mounted VR equipment to complete teaching.
Example two
Referring to fig. 2, fig. 2 is a block diagram of a teaching system 200 in a virtual reality environment according to a second embodiment of the present invention, where the teaching system 200 in a virtual reality environment includes: the device comprises a construction module 21, a judgment module 22, an acquisition module 23, a trigger module 24 and an activation module 25, wherein:
a construction module 21, configured to construct a virtual teaching scene, where the virtual teaching scene includes at least a virtual user and a virtual operation device, and the virtual user includes a virtual demonstrator and a virtual educator;
the judging module 22 is configured to acquire time information and login information of the virtual demonstrator, and judge whether to activate the virtual teaching scene;
the obtaining module 23 is configured to obtain virtual trainee login information when it is determined that the virtual teaching scene needs to be activated, activate corresponding head-mounted VR device and operation device according to the virtual trainee login information and the virtual trainee login information, load the virtual operation device at the same time, and obtain an operation instruction generated by the virtual trainee, where iris of the trainee is obtained through the head-mounted VR device, and determine personal information of the trainee according to the collected iris information;
The triggering module 24 is configured to trigger a corresponding teaching mode according to the operation instruction, where the teaching mode includes at least a teacher teaching sub-mode, an appointed training sub-mode, and a full-member training sub-mode, and when the full-member training sub-mode is triggered, the virtual station is controlled to generate a virtual station at an appointed position of each virtual subject, and virtual courseware is configured on the virtual station, where a communication barrier is formed in a preset range of each virtual station, and the communication barrier is configured to enable a corresponding subject to perform voice communication when a certain virtual subject enters a communication barrier corresponding to a virtual station of another virtual subject;
and the activation module 25 is configured to activate the corresponding target operation device according to the teaching mode, collect operation information of the target operation device in real time, and obtain interaction information between a virtual user corresponding to the target operation device and the virtual operation device, and display the interaction information through the head-mounted VR device, so as to complete teaching.
Further, in some alternative embodiments of the present invention, the determining module 22 includes:
the first judging unit is used for acquiring login information of the virtual demonstrator and judging whether the demonstrator is on line or not;
The second judging unit is used for acquiring time information when judging that the demonstrator is online and judging whether the teaching time is reached or not;
and the first activating unit is used for activating the virtual teaching scene when judging that the teaching time is reached.
Further, in some alternative embodiments of the present invention, the triggering module 24 includes:
the first control unit is used for controlling the starting of the speaking function of the head-mounted VR equipment corresponding to the virtual demonstrator and the activation of the operation equipment when the teacher demonstrating sub-mode is triggered, and controlling the virtual operation device in the virtual teaching scene to be displayed in the visual angles of all the educated persons;
a second control unit, configured to control, when the specified exercise sub-mode is triggered, only the speaking function of the head-mounted VR device of the specified subject and the demonstrator to be turned on, and the operation device to be activated;
and the third control unit is used for controlling the speaking functions of the head-mounted VR devices of all the educators and the demonstrators to be started and the operation device to be activated when the full-staff exercise sub-mode is triggered, and simultaneously supervising the operation process of all the virtual educators to acquire the exercise progress and abnormal feedback of the educators.
Further, in some optional embodiments of the present invention, the teaching system 200 in a virtual reality environment further includes:
The data report generation module is used for respectively acquiring the operation steps and the corresponding operation time lengths in the training process of each virtual trainee, and generating a data report according to the operation steps and the operation time lengths, and the data report is used for helping the trainee to know the teaching condition, wherein the data report comprises training data of each trainee and comprehensive training data of all the trainees.
Further, in some optional embodiments of the present invention, the teaching system 200 in a virtual reality environment further includes:
the operation abnormality judging module is used for judging whether operation abnormality exists or not according to the operation information;
and the sending module is used for controlling the corresponding head-mounted VR equipment to send an assistance request to the head-mounted VR equipment of the demonstrator so as to inform the demonstrator of intervention when the abnormal operation is determined.
Further, in some optional embodiments of the present invention, the operation anomaly determination module includes:
a third judging unit, configured to obtain an eyeball photograph through a head-mounted VR device, and judge whether the subject is distracted according to the eyeball photograph;
a fourth judging unit, configured to obtain the current operation step of the subject when it is judged that the subject is focused, match the corresponding operation standard, and judge whether the operation of the subject meets the operation standard;
An operation abnormality determining unit for determining that there is an operation abnormality when it is judged that the operation of the subject does not meet the operation standard.
Example III
In another aspect, referring to fig. 3, an electronic device according to a third embodiment of the present invention includes a memory 20, a processor 10, and a computer program 30 stored on the memory and capable of running on the processor, where the processor 10 implements the teaching method in the virtual reality environment when executing the computer program 30.
The processor 10 may be, among other things, a central processing unit (Central Processing Unit, CPU), a controller, a microcontroller, a microprocessor or other data processing chip for running program code or processing data stored in the memory 20, e.g. executing an access restriction program or the like, in some embodiments.
The memory 20 includes at least one type of readable storage medium including flash memory, a hard disk, a multimedia card, a card memory (e.g., SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, etc. The memory 20 may in some embodiments be an internal storage unit of the electronic device, such as a hard disk of the electronic device. The memory 20 may also be an external storage device of the electronic device in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card) or the like. Further, the memory 20 may also include both internal storage units and external storage devices of the electronic device. The memory 20 may be used not only for storing application software of an electronic device and various types of data, but also for temporarily storing data that has been output or is to be output.
It should be noted that the structure shown in fig. 3 does not constitute a limitation of the electronic device, and in other embodiments the electronic device may comprise fewer or more components than shown, or may combine certain components, or may have a different arrangement of components.
The embodiment of the invention also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor implements the teaching method in the virtual reality environment.
Those of skill in the art will appreciate that the logic and/or steps represented in the flow diagrams or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
It is to be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The foregoing examples illustrate only a few embodiments of the invention, which are described in detail and are not to be construed as limiting the scope of the invention. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the invention, which are all within the scope of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.

Claims (7)

1. The teaching method in the virtual reality environment is applied to a scene of a head-mounted VR device and an operation device electrically connected with the head-mounted VR device, and is characterized by comprising the following steps:
Constructing a virtual teaching scene which at least comprises a virtual user and a virtual operation device, wherein the virtual user comprises a virtual demonstrator and a virtual educator;
acquiring time information and login information of a virtual demonstrator, and judging whether to activate a virtual teaching scene;
if yes, acquiring virtual trainee login information, activating corresponding head-mounted VR equipment and operation equipment according to the virtual trainee login information and the virtual trainee login information, loading the virtual operation device at the same time, and acquiring an operation instruction generated by the virtual trainee, wherein the iris of the trainee is acquired through the head-mounted VR equipment, and personal information of the trainee is determined according to the acquired iris information;
triggering a corresponding teaching mode according to the operation instruction, wherein the teaching mode at least comprises a teacher teaching sub-mode, a designated exercise sub-mode and a full-staff exercise sub-mode;
activating corresponding target operation equipment according to the teaching mode, collecting operation information of the target operation equipment in real time, and simultaneously acquiring interaction information of a virtual user corresponding to the target operation equipment and the virtual operation device, and displaying through the head-mounted VR equipment to complete teaching;
Judging whether an operation abnormality exists or not according to the operation information;
if yes, the corresponding head-mounted VR equipment is controlled to send an assistance request to the head-mounted VR equipment of the demonstrator so as to inform the demonstrator of intervention;
the step of judging whether the operation abnormality exists according to the operation information comprises the following steps:
acquiring eyeball photos through head-mounted VR equipment, and judging whether the subject is distracted according to the eyeball photos;
if not, acquiring the current operation step of the subject, matching the corresponding operation standard, and judging whether the operation of the subject accords with the operation standard;
if not, determining that the operation abnormality exists;
according to the operation instruction, a corresponding teaching mode is triggered, wherein the teaching mode at least comprises a teacher teaching sub-mode, an appointed training sub-mode and a full-member training sub-mode, when the full-member training sub-mode is triggered, a virtual station is controlled to be generated at an appointed position of each virtual teaching subject, virtual courseware is configured on the virtual station, a communication barrier is formed in a preset range of each virtual station, the communication barrier is used for carrying out voice communication on a corresponding teaching subject when a certain virtual teaching subject enters a communication barrier corresponding to a virtual station of another virtual teaching subject, the position of the communication barrier is determined according to the edge coordinate position of the virtual station relative to a virtual teaching scene, the coordinate of the communication barrier is the boundary coordinate of a circular area, a communication barrier with a certain transparency is formed in the z-axis direction on the basis of the boundary coordinate of the circular area, when a target coordinate point representing the head of a virtual user breaks through the communication barrier, voice interaction of the virtual user in the circular barrier is established, and the value of the target coordinate point of the virtual user in the circular area is compared with the virtual coordinate point of the y-axis of the virtual user in the circular area to judge whether the virtual coordinate point enters the circular area.
2. The method according to claim 1, wherein the step of acquiring time information and virtual demonstrator login information to determine whether to activate the virtual teaching scene comprises:
obtaining login information of a virtual demonstrator, and judging whether the demonstrator is online;
if yes, acquiring time information, and judging whether the class time is reached;
if yes, activating the virtual teaching scene.
3. The method according to claim 2, wherein the step of triggering the corresponding teaching mode according to the operation instruction, wherein the teaching mode includes at least a teacher teaching sub-mode, a designated training sub-mode, and a full-member training sub-mode includes:
when a teacher teaching sub-mode is triggered, only the speaking function of the head-mounted VR equipment corresponding to the virtual teaching person is controlled to be started, the operation equipment is activated, and meanwhile, the virtual operation device in the virtual teaching scene is controlled to be displayed in the view angles of all the teaching persons;
when the appointed exercise sub-mode is triggered, only the speaking function of the head-mounted VR equipment of the appointed educated person and the demonstrator is controlled to be started, and the operation equipment is activated;
When the full-staff exercise sub-mode is triggered, the speaking function of the head-mounted VR equipment of all the trainees and the demonstrators is controlled to be started, the operation equipment is activated, and meanwhile, the operation process of all the virtual trainees is supervised to acquire the exercise progress and abnormal feedback of the trainees.
4. The teaching method in the virtual reality environment according to claim 3, wherein activating the corresponding target operation device according to the teaching mode, collecting operation information of the target operation device in real time, and simultaneously obtaining interaction information of a virtual user corresponding to the target operation device and the virtual operation device, and displaying the interaction information through the head-mounted VR device, so as to complete the teaching step, the method comprises:
and respectively acquiring operation steps and corresponding operation time lengths in the training process of each virtual trainee, and generating a data report according to the operation steps and the operation time lengths, wherein the data report comprises training data of each trainee and comprehensive training data of all the trainees, and is used for helping the trainee to know teaching conditions.
5. A teaching system in a virtual reality environment, applied to a head-mounted VR device and an operating device electrically connected to the head-mounted VR device, the teaching system comprising:
The system comprises a construction module, a control module and a control module, wherein the construction module is used for constructing a virtual teaching scene which at least comprises a virtual user and a virtual operation device, and the virtual user comprises a virtual demonstrator and a virtual educator;
the judging module is used for acquiring time information and login information of the virtual demonstrator and judging whether to activate the virtual teaching scene or not;
the virtual teaching device comprises an acquisition module, a virtual operation device and a virtual teaching module, wherein the acquisition module is used for acquiring virtual teaching subject login information when judging that a virtual teaching scene needs to be activated, activating corresponding head-mounted VR equipment and operation equipment according to the virtual teaching subject login information and the virtual teaching subject login information, loading the virtual operation device at the same time, and acquiring an operation instruction generated by the virtual teaching subject, wherein the iris of the teaching subject is acquired through the head-mounted VR equipment, and personal information of the teaching subject is determined according to the acquired iris information;
the system comprises a trigger module, a virtual station and a virtual system module, wherein the trigger module is used for triggering a corresponding teaching mode at least comprising a teacher teaching sub-mode, an appointed training sub-mode and a whole person training sub-mode, when the whole person training sub-mode is triggered, a virtual station is controlled to be generated at an appointed position of each virtual subject, virtual courseware is configured on the virtual station, a communication barrier is formed in a preset range of each virtual station, the communication barrier is used for carrying out voice communication on a corresponding subject when one virtual subject enters a communication barrier corresponding to a virtual station of another virtual subject, the position of the communication barrier is determined according to the position of the virtual station relative to the edge coordinate of a virtual teaching scene, the coordinate of the communication barrier is the boundary coordinate of a circular area, a communication barrier with a certain transparency is formed in the z-axis direction on the basis of the boundary coordinate of the circular area, when a target coordinate point representing the head of a virtual user breaks through the coordinate of the communication barrier, voice interaction of the virtual user in the communication barrier is established, and the value of the target coordinate point of the virtual user in the circular area is compared with the virtual coordinate point of the y-axis of the virtual user in the circular area, and whether the virtual user in the circular area enters the virtual coordinate area is judged;
The activation module is used for activating the corresponding target operation equipment according to the teaching mode, collecting the operation information of the target operation equipment in real time, and simultaneously obtaining the interaction information of the virtual user corresponding to the target operation equipment and the virtual operation device, and displaying the interaction information through the head-mounted VR equipment so as to complete teaching;
the system further comprises:
the operation abnormality judging module is used for judging whether operation abnormality exists or not according to the operation information;
the transmitting module is used for controlling the corresponding head-mounted VR equipment to transmit an assistance request to the head-mounted VR equipment of the demonstrator so as to inform the demonstrator of intervention when the existence of the operation abnormality is determined;
the operation abnormality judgment module includes:
a third judging unit, configured to obtain an eyeball photograph through a head-mounted VR device, and judge whether the subject is distracted according to the eyeball photograph;
a fourth judging unit, configured to obtain the current operation step of the subject when it is judged that the subject is focused, match the corresponding operation standard, and judge whether the operation of the subject meets the operation standard;
an operation abnormality determining unit for determining that there is an operation abnormality when it is judged that the operation of the subject does not meet the operation standard.
6. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements a teaching method in a virtual reality environment according to any of claims 1-4.
7. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing a teaching method in a virtual reality environment according to any of claims 1-4 when the program is executed.
CN202310968030.0A 2023-08-03 2023-08-03 Teaching method, system, storage medium and device in virtual reality environment Active CN116682304B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310968030.0A CN116682304B (en) 2023-08-03 2023-08-03 Teaching method, system, storage medium and device in virtual reality environment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310968030.0A CN116682304B (en) 2023-08-03 2023-08-03 Teaching method, system, storage medium and device in virtual reality environment

Publications (2)

Publication Number Publication Date
CN116682304A CN116682304A (en) 2023-09-01
CN116682304B true CN116682304B (en) 2023-11-07

Family

ID=87779574

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310968030.0A Active CN116682304B (en) 2023-08-03 2023-08-03 Teaching method, system, storage medium and device in virtual reality environment

Country Status (1)

Country Link
CN (1) CN116682304B (en)

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000067231A1 (en) * 1999-05-05 2000-11-09 Accenture Properties (2) B.V. System method and article of manufacture for creating a virtual classroom
CN106339082A (en) * 2016-08-16 2017-01-18 惠州Tcl移动通信有限公司 Reminding method and system based on teaching headset device
CN108961881A (en) * 2018-08-06 2018-12-07 林墨嘉 A kind of the intelligent scene building and system of real-time interactive
CN109523441A (en) * 2018-12-20 2019-03-26 合肥凌极西雅电子科技有限公司 A kind of Teaching Management Method and system based on video identification
CN112820158A (en) * 2019-11-15 2021-05-18 上海泽稷教育培训有限公司 Virtual reality-based network teaching method and system, storage medium and platform
CN113706960A (en) * 2021-08-29 2021-11-26 华中科技大学同济医学院附属协和医院 Nursing operation exercise platform based on VR technology and use method
WO2021240416A1 (en) * 2020-05-27 2021-12-02 Djuric Marko Notification application for a computing device
CN114327060A (en) * 2021-12-24 2022-04-12 华中师范大学 Working method of virtual teaching system based on AI assistant
US11410570B1 (en) * 2021-09-27 2022-08-09 Central China Normal University Comprehensive three-dimensional teaching field system and method for operating same
KR20220125540A (en) * 2021-03-05 2022-09-14 주식회사 맘모식스 A method for providing a virtual space client-based mutual interaction service according to location interlocking between objects in a virtual space and a real space
CN115731751A (en) * 2022-11-23 2023-03-03 中软航科数据科技(珠海横琴)有限公司 Online teaching system integrating artificial intelligence and virtual reality technology
CN116448095A (en) * 2023-04-25 2023-07-18 珠海格力智能装备有限公司 Mobile robot, navigation method and device thereof, computer equipment and storage medium
CN116486661A (en) * 2023-04-25 2023-07-25 中国人民解放军陆军军医大学第一附属医院 VR-based cerebrovascular disease teaching display system and method

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000067231A1 (en) * 1999-05-05 2000-11-09 Accenture Properties (2) B.V. System method and article of manufacture for creating a virtual classroom
CN106339082A (en) * 2016-08-16 2017-01-18 惠州Tcl移动通信有限公司 Reminding method and system based on teaching headset device
CN108961881A (en) * 2018-08-06 2018-12-07 林墨嘉 A kind of the intelligent scene building and system of real-time interactive
CN109523441A (en) * 2018-12-20 2019-03-26 合肥凌极西雅电子科技有限公司 A kind of Teaching Management Method and system based on video identification
CN112820158A (en) * 2019-11-15 2021-05-18 上海泽稷教育培训有限公司 Virtual reality-based network teaching method and system, storage medium and platform
WO2021240416A1 (en) * 2020-05-27 2021-12-02 Djuric Marko Notification application for a computing device
KR20220125540A (en) * 2021-03-05 2022-09-14 주식회사 맘모식스 A method for providing a virtual space client-based mutual interaction service according to location interlocking between objects in a virtual space and a real space
CN113706960A (en) * 2021-08-29 2021-11-26 华中科技大学同济医学院附属协和医院 Nursing operation exercise platform based on VR technology and use method
US11410570B1 (en) * 2021-09-27 2022-08-09 Central China Normal University Comprehensive three-dimensional teaching field system and method for operating same
CN114327060A (en) * 2021-12-24 2022-04-12 华中师范大学 Working method of virtual teaching system based on AI assistant
CN115731751A (en) * 2022-11-23 2023-03-03 中软航科数据科技(珠海横琴)有限公司 Online teaching system integrating artificial intelligence and virtual reality technology
CN116448095A (en) * 2023-04-25 2023-07-18 珠海格力智能装备有限公司 Mobile robot, navigation method and device thereof, computer equipment and storage medium
CN116486661A (en) * 2023-04-25 2023-07-25 中国人民解放军陆军军医大学第一附属医院 VR-based cerebrovascular disease teaching display system and method

Also Published As

Publication number Publication date
CN116682304A (en) 2023-09-01

Similar Documents

Publication Publication Date Title
Westerfield et al. Intelligent augmented reality training for motherboard assembly
KR102045260B1 (en) Simulation method for training first aid treatment using augmented reality and virtual reality
Monroy Reyes et al. A mobile augmented reality system to support machinery operations in scholar environments
Restivo et al. Augmented reality in electrical fundamentals
CN111290568A (en) Interaction method and device and computer equipment
US20170263142A1 (en) Anti-cheating device for online examination
US9472119B2 (en) Computer-implemented operator training system and method of controlling the system
CN109658516B (en) VR training scene creation method, VR training system and computer-readable storage medium
CN111027486A (en) Auxiliary analysis and evaluation system and method for big data of teaching effect of primary and secondary school classroom
CN110444061B (en) Thing networking teaching all-in-one
CN111459286A (en) Web-based VR interactive learning education system and method
Sharma et al. Situational awareness-based Augmented Reality Instructional (ARI) module for building evacuation
Motejlek et al. A taxonomy for virtual and augmented reality in education
Peña-Ríos et al. Towards the next generation of learning environments: An InterReality learning portal and model
Zhang et al. Exploring virtual environments by visually impaired using a mixed reality cane without visual feedback
CN110727351A (en) Multi-user collaboration system for VR environment
CN117651960A (en) Interactive avatar training system
Kim et al. Virtual reality as a standard in the construction management curriculum
CN116682304B (en) Teaching method, system, storage medium and device in virtual reality environment
CN113570920B (en) Interactive remote teaching system and method
RU2751759C2 (en) Software and hardware complex of the training system with automatic assessment of the student's emotions
Liang A web‐based training framework in automotive electric education
CN114170859A (en) Online teaching system and method based on virtual reality
Westerfield Intelligent augmented reality training for assembly and maintenance
Sukaridhoto et al. Implementation of virtual Fiber Optic module using Virtual Reality for vocational telecommunications students

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant