CN114092290A - Teaching system in educational meta universe and working method thereof - Google Patents
Teaching system in educational meta universe and working method thereof Download PDFInfo
- Publication number
- CN114092290A CN114092290A CN202210064953.9A CN202210064953A CN114092290A CN 114092290 A CN114092290 A CN 114092290A CN 202210064953 A CN202210064953 A CN 202210064953A CN 114092290 A CN114092290 A CN 114092290A
- Authority
- CN
- China
- Prior art keywords
- teaching
- teacher
- participants
- virtual
- learner
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
Abstract
The invention belongs to the field of teaching application of the meta universe, and provides a teaching system for teaching in the meta universe and a working method thereof. The teaching system comprises a teaching activity organization module, a shared space creation module, a virtual object representation module, a virtual object position evaluation module and a teacher-student interaction module. The teaching system constructed by the invention realizes the creation of teaching activity scenes and the generation of participant shared spaces, supports the synchronization of virtuality and reality, and realizes the one-to-one teaching guidance service of a real teacher and a virtual avatar thereof and a learner. The invention is beneficial to the development of intelligent teaching activities in the teaching meta-space and promotes the deep fusion of the meta-space and the teaching.
Description
Technical Field
The invention belongs to the field of teaching application of the meta universe, and particularly relates to a teaching system for teaching in the meta universe and a working method thereof.
Background
With the accelerated development of virtual contents, the characteristics of the fusion of virtual and real, online and offline of the metauniverse can greatly promote the arrival of the digital society. The education meta universe is used as a vertical application of the meta universe in the education industry, and has good application prospects in education scenes such as situational teaching, game learning, personalized learning and teacher study and repair. The educational metacavity teaching system supporting scene type and collaborative type teaching practices is constructed, a virtual teaching environment with participation of multiple users can be created, and the remote interaction of teachers and students in an immersive teaching situation is supported. The application prospect of the teaching system is expected to be further improved by enhancing the intelligence of the teaching system.
However, there are many problems with the current development of teaching activities in the meta universe: (1) the existing meta-universe system can support multiple users to access the same scene, but how to quickly organize teaching activities, create shared spaces and synchronize information according to the existing teaching forms becomes a key for constructing the teaching system in the education meta-universe; (2) in the process of creating a situational teaching environment in the educational element universe, how to lay different types of virtual objects relates to an important environment of subsequent teaching experience, and if the virtual objects are improperly placed, poor experience of participants can be caused, and even war and danger can be caused; (3) at present, interaction in different places can be realized in a dialogue and voice mode in the educational meta universe, and teachers still cannot find confusion of learners in time and cannot give targeted guidance one by one. These deficiencies limit the widespread use of teaching systems in the universe of educational elements.
Disclosure of Invention
Aiming at the defects or improvement requirements of the prior art, the invention provides a teaching system in the educational meta-universe and a working method thereof, and provides a new working method for teaching activity organization, representation and application scenes for the teaching system in the educational meta-universe.
The object of the invention is achieved by the following technical measures.
The invention provides a teaching system in an educational meta universe, which comprises a teaching activity organization module, a shared space creation module, a virtual object representation module, a virtual object position evaluation module and a teacher-student interaction module.
The teaching activity organization module is used for pushing teaching activity notifications, constructing teaching activity organization forms and accurately identifying participant identities.
The shared space creation module is used for realizing the construction of a main view and other view modes in the virtual environment and the updating and sharing of the positions and the states of participants.
The virtual object representation module is used for realizing attribute setting, icon representation and state dynamic update of the object.
The virtual object position evaluation module is used for realizing the setting of the object position and the risk level evaluation during dynamic update.
The teacher-student interaction module is used for realizing one-to-one guidance service of a teacher and a learner, prompting the learning task steps and results and displaying the teaching difficulty and difficulty contents.
The invention also provides a working method of the teaching system in the educational meta universe, which comprises the following steps:
s1, teaching activity organization, wherein students enter a teaching place of an educational elementary universe by clicking a teaching activity address pushed by a teacher; other teachers can organize the class to join the teaching activity to form a 1+ X teaching activity organization form; and the identity of the participant is identified by adopting an iris scanning technology.
S2, creating a shared space, providing two modes of a main view and other views, and recording interactive operation, behavior tracks and dialogue information in the main view mode; eliminating the corresponding records of other participants when the other view mode is terminated; and acquiring and updating the position and the state of the participant according to the sensor information.
S3, virtual object representation, setting public, private and visibility attributes of the object in the teaching place; displaying the positions of the participants on the navigation chart by using icons, and expressing the distance between the participants and the query object by using different animation effects; the learner initiated call status is prompted with a highlight.
S4, estimating the position of the virtual object, and setting the positions for placing and collecting teaching aids and learning tools; giving an evaluation score aiming at the risk level of danger, dispute easiness and poor experience of the candidate position; the potential risk of the virtual object position is dynamically updated in conjunction with the visual and inertial components.
S5, the teacher and the student interact, the teacher opens up a plurality of independent discussion spaces, and the virtual avatar is used to develop one-to-one guiding service with the learner; superposing the solution on the visual field picture of the learner to prompt the execution steps and results of the learning task; and the teacher is supported to operate the virtual object and show the teaching contents difficult to operate or difficult to understand.
The invention has the beneficial effects that: the students click the teaching activity notification pushed by the teacher to enter a virtual teaching place of the education meta universe, so that the 1+ X teaching activity organization form is supported, and the identities of participants can be accurately identified; an activity space shared by multiple participants is created, two browsing modes of a main view and other views are supported, and the virtual and real synchronization of time, position and action is realized. When entering a teaching activity place, the scene elements of the participant terminal need to be initialized, and a collaborative white board is adopted to realize resource sharing and display; setting the position and the visibility of a shared object on a navigation chart and the distance between participants, and displaying the conversation state of teachers and students; the method comprises the steps of configuring the position of an object in a virtual teaching environment, evaluating the risk level of a candidate position of the object, and dynamically updating the potential risk. The teacher can use the virtual avatar to guide the learner one to one, and a specific guiding scheme is provided; and marking the participants according to the visual proximity relation and the condition of the access terminal, and realizing the management of users and teaching resources in the education meta universe. Currently, the development of the teaching element universe is emerging, and the functions of teaching systems in the teaching element universe are increasingly urgent to design and enrich. The invention is beneficial to the development of intelligent teaching activities in the teaching meta-space and promotes the deep fusion of the meta-space and the teaching.
Drawings
FIG. 1 is a schematic diagram of a teaching system in the universe of educational elements in an embodiment of the present invention.
FIG. 2 is a flowchart of the teaching activities organization module in an embodiment of the present invention.
Fig. 3 is a flow chart of the operation of the synchronization module in the embodiment of the present invention.
Fig. 4 is a schematic front view of a participant in a virtual classroom environment in the universe of educational elements in accordance with an embodiment of the present invention.
Fig. 5 is a diagram showing the effect of a participant querying other participants nearby on a navigation chart in an embodiment of the present invention.
FIG. 6 is a diagram illustrating a risk score evaluation result when the candidate desk location is a road according to an embodiment of the present invention.
Fig. 7 is a flowchart of the AI helper module operation in an embodiment of the present invention.
FIG. 8 is a flow chart of the teacher-student interaction module in the embodiment of the invention.
FIG. 9 is a diagram of a teacher providing instruction to a learner for explanation and operational steps in an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. In addition, the technical features involved in the embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
As shown in fig. 1, this embodiment provides a teaching system in the educational universe, which includes a teaching activity organization module, a shared space creation module, an AI assistant module, a virtual object representation module, a virtual object position evaluation module, a teaching activity representation module, a synchronization module, a teacher-student interaction module, and a teaching management module.
The teaching activity organization module is used for pushing teaching activity notifications, constructing teaching activity organization forms and accurately identifying participant identities.
The shared space creation module is used for realizing the construction of a main view and other view modes in the virtual environment and the updating and sharing of the positions and the states of participants.
The synchronization module is used for realizing clock synchronization of each participating terminal in the virtual teaching system, synchronous updating of virtual and real positions and offset of learners and real-time updating of actions of virtual avatars of teachers.
The teaching activity representation module is used for initializing a virtual teaching system terminal, a scene and an environment, and setting the visibility and the relative distance of a shared object based on resource sharing, knowledge key point and annotation content display of a collaboration whiteboard.
The virtual object representation module is used for realizing attribute setting of the object, icon representation of participant positions and dynamic representation of call states.
The virtual object position evaluation module is used for realizing the setting of the object position and the risk level evaluation of the object position and the dynamic update of the object position.
The AI assistant module is used for realizing teaching scene understanding based on the AI assistant, the acquisition and positioning of learner questions and the superposition of answers at the user question position.
The teacher-student interaction module is used for realizing one-to-one guiding service of a teacher virtual avatar and a learner, prompting the learning task steps and results, presenting a virtual object and displaying the teaching difficulty and difficulty contents.
The teaching management module is used for realizing that a teacher calls or creates teaching contents and uploads the teaching contents to the cloud server for persistent storage, and the teacher adds marks of participants and records process information of the participants.
The embodiment further provides a working method of the teaching system in the educational meta universe, which comprises the following steps:
(1) the teaching activity organization is that students enter a teaching place of the education metacarpal by clicking a teaching activity address pushed by a teacher; other teachers can organize the class to join the teaching activity to form a 1+ X teaching activity organization form; and the identity of the participant is identified by adopting an iris scanning technology. FIG. 2 illustrates the workflow of the instructional campaign organization module.
And (1-1) teaching activity notification. The teacher pushes the hyperlink address of the teaching activity to students in the class through SMS short messages or other instant software messages, and the students click the link on the tablet or VR terminal of the students, so that the students can directly jump to join the activity and enter the teaching place in the education universe set by the teacher.
And (1-2) organizing multiple teaching units. The teacher can push the dynamic QR code of the teaching activity to other teachers, and the teaching activity information recorded by the JSON string in the QR code is as follows:
{"AppName":A,"Version":B,"InstructorID":C,"TeacherID":D,"ClassTime":E,"Classroom":F}
a represents the name of the educational metacavity application; b represents the version and version number of the education meta-universe application; c represents ID of teacher; d represents the teacher ID of the class; e represents the starting time and the ending time of the lesson; f denotes the class location.
A and B may be used to verify the validity of the QR code value. C and D are the same, which means that the teacher is the same and is in a single class shape; if the number of the classes is different, the teacher receiving the sharing code informs the class of students to join in the teaching activity according to the teaching requirement, and the class is taken as an activity organization unit to form a 1+ X teaching activity organization form in the education meta universe.
And (1-3) identifying the identities of teachers and students. The method is based on the iris scanning technology, identifies the identities of teachers and students who participate in teaching activities in the educational meta universe, enables teachers who host the teaching activities to master the real identities of learners who have a conversation with the teachers in real time, and provides targeted guidance and services for the learners according to learner data stored in a cloud.
(2) Establishing a shared space, wherein a virtual environment in the education meta-universe provides two modes of a main view and other views, and interactive operation, behavior tracks and dialogue information in the task execution process can be recorded in the main view mode; when the view mode is terminated, the corresponding records of other participants are eliminated; and acquiring and updating the position and the state of the participant according to the sensor information.
And (2-1) setting a main view mode. In the main view mode, the participants watch and explore knowledge display and communication discussion in the virtual scene according to the requirements of teaching activities, and record interactive operation, behavior tracks and conversation information in the task execution process.
(2-2) other view mode setting. When the participant enters the teaching activities organized by other users and moves and hides the teaching aids and articles in the virtual teaching environment, the scene display module records and stores the operations, and once the view mode of the participant is terminated, the operation records of the participant and the scene changes caused by the operation records are eliminated.
And (2-3) establishing a shared space. When a participant of a teaching activity enters a teaching place set by a teacher, 6 degrees of freedom of the participant are calculated and obtained according to position information determined by a GPS and a WIFI of the participant and orientation information obtained by a gyroscope, fixed time interval parameters are set, and the position and the state of the participant are shared to other users.
(3) Synchronizing, namely calibrating terminal clock information of each participant by adopting a fixed time interval method, and sequencing operations and events according to message timestamps; synchronizing the position and offset of the participant relative to the teacher terminal space origin; the teacher's motion information is mapped to the avatar and synchronized to the other participant terminals. FIG. 3 shows the workflow of the synchronization module.
And (3-1) time synchronization. And adopting a fixed time interval method, calibrating and synchronizing the terminal time of each participant according to the clock service of the cloud server, sending the operation and event description of the participants in the main view to the cloud server by using the message described in the JSON format, and sequencing from small to large according to the message timestamp.
And (3-2) position synchronization. And during the teaching activity, the positions and the offset of each participant are synchronized according to a fixed time interval and the space origin.
And (3-3) synchronizing action behaviors. In the master view of the teacher, the geographical position of the learner in the real physical space and the virtual environment can be checked at any time, and when the teacher manipulates the object in the virtual environment through gestures, head rotations or body postures, the virtual avatar of the teacher updates the corresponding action and maps the action to the master view of other users participating in the teaching activity.
(4) Teaching activity representation, namely enabling participants to enter a virtual teaching place, initializing scenes and environments of terminals, and acquiring and marking identities and positions of teachers and students participants; the cooperative white board is adopted to realize resource sharing, and display of knowledge key points and annotation contents; the visibility of the shared objects and their relative distances are set on the navigation map.
And (4-1) initializing teaching activities. The participants enter the places of virtual teaching activities in the educational meta universe, the main view scene, teaching contents and the avatar information of other participants of the own equipment are initialized, the time, the message and the operation of the participants of each terminal are synchronized, and the real identities of the participants are labeled.
And (4-2) collaborative content sharing. Through the collaboration white board, the teacher and the student can share messages, documents, pictures, video animations and virtual scenes in the virtual teaching activities, the teacher can display the key points and the annotation contents of knowledge to the learner, and the learner can display and annotate the teaching contents on the collaboration white board when participating in the teaching activities in the form of other views.
And (4-3) grouping the collaborative activity settings. And the participants joining the teaching activities finish task grouping according to the activity process, the familiarity and the class, and can share respective private virtual objects in the process of cooperatively finishing the tasks, and display the visibility and the relative distance of the shared objects on a navigation chart of the main view. Fig. 4 illustrates a front view of a participant when the universe of educational elements is in a virtual classroom environment.
(5) Virtual object representation, setting public, private and visibility attributes of objects in teaching places; displaying the positions of the participants on the navigation chart by using icons, and expressing the distance between the participants and the query object by using different firework animation effects; and highlighting on a teacher terminal navigation chart to prompt the learner to initiate a conversation state.
And (5-1) object representation. The object attributes of the teaching place are divided into public and private types, the private objects belong to personal ownership of participants, visibility of all, groups or individual participants can be set, and teachers can search for public objects or visible private objects in the virtual teaching place based on distance thresholds.
And (5-2) prompting a map. A bird's-eye view navigation chart is displayed on the front right of the main view of the participants, the position of the bird's-eye view navigation chart is displayed by using asterisks, the positions of other participants are displayed by using solid circles, the query result can be displayed on the navigation chart, and the effect chart that the participants query other participants nearby is shown on the navigation chart in fig. 5. When the participants inquire the visible objects in the teaching place, the distance relation between the participants and the objects is expressed by using different firework animation visual effects.
And (5-3) highlighting the prompt. If a learner needs to ask a question to a teacher in the teaching activity, a message, voice or video call can be initiated, a round icon representing the student on a navigation chart of a teacher terminal is highlighted and flickered, and the icon is highlighted all the time but does not flicker in the process of the call between the teacher and the student.
(6) Estimating the position of the virtual object, and setting the position for placing and collecting the virtual object; giving an evaluation score aiming at the risk level of danger, dispute easiness and poor experience of the candidate position; the potential risk of new positions of virtual objects is dynamically updated in conjunction with the visual and inertial components.
(6-1) setting a position of the virtual object. The placement and collection positions of virtual objects (such as teaching aids and learning aid models) using the method d in the teaching process are set according to the layout conditions of virtual campuses, playgrounds, roads and buildings in the navigation map, so that the virtual objects are prevented from being placed at dangerous positions which are easy to cause disputes or poor experiences, and physical effects (such as gravity and friction) are added to the virtual objects.
And (6-2) assessing the position risk level. And evaluating the scores of the candidate positions according to the risk levels of danger, dispute easiness and poor experience of the candidate positions of the virtual object, classifying the positions into four types of usable types, hard to judge types, risky types and excluded types according to the scores, and if the results are the latter two types, selecting the position. Fig. 6 shows the risk scores when the desk candidate location is a road. The first table shows a risk level evaluation index model of the virtual object position, which comprises 6 first-level indexes and 20 second-level indexes, and the total score is 100. The scoring steps are as follows:
the score of each secondary index is given by adopting a Liktet five-point scale, if the score is completely accorded and recorded as 1 score, the score is basically accorded and recorded as 2 score, the score cannot be determined and recorded as 3 score, the score is basically not accorded and recorded as 4 score, the score is completely not accorded and recorded as 5 score, and the higher the score is, the higher the risk is.
Dividing the score of the secondary index by 5, multiplying by the weight, and then multiplying by the weight of the primary index to which the score belongs to obtain the weighted score of the secondary index.
And thirdly, accumulating the weighted scores of all the secondary indexes to obtain the position risk grade score of the virtual object. If the score is in the range of 76-100, 51-75, 26-50, 1-25, the potential risk of the virtual location is ranked as the type that should be excluded, risky, difficult to judge, available.
Table location risk level assessment index
And (6-3) dynamically evaluating the position risk. Based on a high-precision three-dimensional map positioning system, the positions and the directions of participants in virtual and real world are collected and updated by combining visual and inertial components, the real teaching environment is intelligently identified, user feedback information is collected, and the potential risk of the position of a virtual object is dynamically updated.
(7) Setting an AI assistant, and understanding learning elements and teacher and student behaviors in a teaching scene by adopting the teacher AI assistant; obtaining and positioning the question of the learner's annotation sketching, voice description or sight line residence; and extracting the case matched with the question, and overlaying the relevant explanation, explanation or prompt on the question picture of the user. Fig. 7 illustrates the AI helper module workflow.
(7-1) scene understanding. A teacher AI assistant can be added in the teaching activities, a 3D grid map of the real teaching environment where the learner is located is obtained in real time by means of a learner terminal camera and an SLAM technology, the 3D grid is segmented by computer vision semantics, and various learning elements and teacher and student behaviors in the teaching scene are understood.
(7-2) problem location. Aiming at the important and difficult points in the teaching activity process, the learner can draw out the structure composition which is difficult to understand in the teaching scene by adopting virtual annotations, describe the confusion in the knowledge display process by using voice, or use the sight to stay on the object with cognitive difficulty for a long time to assist the teacher AI assistant to acquire and position the problem of the learner.
(7-3) solution of superposition problem. According to the problem clues of the learners, the teacher AI helps the learners to carry solutions in the case base matched with the learners, and superposes related annotations (such as principle explanation, video explanation or formula prompt) on the problem pictures and the sight line residences of the learners, so that related learning guidance is visually and contextually presented.
(8) The teacher and the student interact, the teacher can open up a plurality of independent discussion spaces, and the virtual avatar is used for developing one-to-one guiding service with the learner; superposing the solution on the visual field picture of the learner to prompt the execution steps and results of the learning task; and the teacher is supported to operate the virtual object presented in the terminal and display the teaching content difficult to operate or difficult to understand. FIG. 8 shows the teacher-student interaction module workflow.
(8-1) one-to-one teaching instruction. The teacher can open up a plurality of independent virtual discussion spaces with situational features in the educational element universe, copy own virtual avatar, and develop one-to-one teaching, explanation, answering and discussion with the independent teaching space at the same place as the learner, so that the learner can receive the special guidance service of the teacher.
(8-2) providing a solution. According to the answering condition of the learner and the learning content in the visual field of the learner, the teacher provides corresponding feedback and indication for the learner, pushes the answering thought and the relevant solution in the case library to the learner, and superposes the answering thought and the relevant solution on the visual field picture of the learner to prompt the execution steps and results of the learning task. Fig. 9 shows the explanation and the operation step guidance of the simple circuit teaching provided by the teacher to the learner.
(8-3) specific operation guidance. In a specific operation teaching link, a teacher is supported to touch, grab and move a virtual object presented in a holographic or VR terminal through a hand tracking device, teaching contents difficult to operate or difficult to understand are gradually displayed to the learner one to one, or a guide is quickly positioned or a specific position in a video is explained.
(9) Teaching management, wherein a teacher can add corresponding labels to participants according to the visual proximity relation and the condition of the access terminal; supporting school and personal registration, and recording process information of participants in teaching activities; the teacher can call or create teaching contents and upload the teaching contents to the cloud server for persistent storage.
(9-1) classifying the labeled participants. According to the visual proximity relation, a teacher can divide participants who join in teaching activities into site visible participants, remote participants and visitor listeners, and marks the participants into strong interaction types, weak interaction types or non-interaction types according to whether the participants access to a VR terminal and a camera device.
And (9-2) user management. The method supports schools and individuals to complete registration for teachers, learners and managers in the system, participants join in specific teaching activities according to identities of the participants, publication messages, annotation contents, interactive operation and access scenes of the participants are recorded in personal activity information and are related to the teaching activities in an index mode.
And (9-3) resource management. The teacher can fetch teaching resources, teaching aids and learning aid models in the cloud server, and can also create virtual teaching resources adaptive to learning conditions of learners by self, and the system records the creation content, the used resources, the models and the interaction process of the teachers and students in the teaching process, uploads the resources, the models and the interaction process to the cloud server and stores persistently.
Details not described in the present specification belong to the prior art known to those skilled in the art.
It will be understood by those skilled in the art that the foregoing is merely a preferred embodiment of the present invention, and is not intended to limit the invention, such that any modification, equivalent replacement or improvement made within the spirit and principle of the present invention shall be included within the scope of the present invention.
Claims (11)
1. A teaching system in the universe of education elements is characterized in that: the system comprises a teaching activity organization module, a shared space creation module, a virtual object representation module, a virtual object position evaluation module and a teacher-student interaction module;
the teaching activity organization module is used for pushing a teaching activity notice, constructing a teaching activity organization form and accurately identifying the identity of a participant;
the shared space creation module is used for realizing the construction of a main view and other view modes in a virtual environment and the updating and sharing of the positions and the states of participants;
the virtual object representation module is used for realizing attribute setting, icon representation and state dynamic update of the object;
the virtual object position evaluation module is used for realizing the setting of the object position and the risk level evaluation during the dynamic update;
the teacher-student interaction module is used for realizing one-to-one guidance service of a teacher and a learner, prompting the learning task steps and results and displaying the teaching difficulty and difficulty contents.
2. A working method of a teaching system in an educational meta universe is characterized by comprising the following steps:
s1, teaching activity organization, wherein students enter a teaching place of an educational elementary universe by clicking a teaching activity address pushed by a teacher; other teachers can organize the class to join the teaching activity to form a 1+ X teaching activity organization form; adopting an iris scanning technology to identify the identity of a participant;
s2, creating a shared space, providing two modes of a main view and other views, and recording interactive operation, behavior tracks and dialogue information in the main view mode; eliminating the corresponding records of other participants when the other view mode is terminated; acquiring and updating the positions and states of participants according to the sensor information;
s3, virtual object representation, setting public, private and visibility attributes of the object in the teaching place; displaying the positions of the participants on the navigation chart by using icons, and expressing the distance between the participants and the query object by using different animation effects; using highlight to prompt the learner to initiate a call state;
s4, estimating the position of the virtual object, and setting the positions for placing and collecting teaching aids and learning tools; giving an evaluation score aiming at the risk level of danger, dispute easiness and poor experience of the candidate position; combining visual and inertial components to dynamically update the potential risk of the virtual object location;
s5, the teacher and the student interact, the teacher opens up a plurality of independent discussion spaces, and the virtual avatar is used to develop one-to-one guiding service with the learner; superposing the solution on the visual field picture of the learner to prompt the execution steps and results of the learning task; and the teacher is supported to operate the virtual object and show the teaching contents difficult to operate or difficult to understand.
3. The method of operating a teaching system in the universe of educational elements of claim 2, wherein the organization of teaching activities in step S1 comprises the steps of:
s1.1, informing teaching activities, wherein a teacher pushes hyperlink addresses of the teaching activities to students in the class through SMS messages or other instant software messages, and the students click the links on a flat plate or VR terminal of the students to enter teaching places in an education universe set by the teacher;
s1.2, organizing a plurality of teaching units, and informing a class of students to join in the teaching activity according to the teaching requirement when other teachers receive the dynamic QR code of the teaching activity, wherein the class is taken as an activity organization unit to form a 1+ X teaching activity organization form in an educational unit universe;
s1.3, the teacher and the student identify, adopt the iris scanning technology, the learner identity of discerning participating in the teaching activity, make the teacher who supervises the teaching activity master the real identity of the learner who converses with it in real time, according to the learner data that the cloud end stores, provide targeted guidance and service for it.
4. The method of claim 2, wherein the creating of the shared space in step S2 comprises the following steps:
s2.1, setting a main view mode, wherein in the main view mode, participants watch and explore knowledge display and communication discussion in a virtual scene according to the requirements of teaching activities, and record interactive operation, behavior tracks and conversation information in the process of executing tasks;
s2.2, setting a view mode of the participant, temporarily recording and storing moving and hidden operation records when the participant enters the teaching activities organized by other users and moves and hides teaching aids and articles in a virtual teaching environment, and removing the operation records of the participant and scene changes caused by the operation records once the view mode of the participant is terminated;
and S2.3, establishing a shared space, calculating and acquiring 6 degrees of freedom of the terminal according to the position information determined by the GPS and the WIFI of the participant and the orientation information obtained by the gyroscope when the participant enters a teaching place set by a teacher, setting fixed time interval parameters, and sharing the position and the state of the participant to other users.
5. The method of operation of a teaching system in the universe of educational elements according to claim 2, wherein said representation of virtual objects in step S3 comprises in particular the steps of:
s3.1, representing the objects, wherein the object attributes in the teaching place are divided into public and private types, the private objects belong to personal ownership of participants, visibility of all, groups or individual participants can be set, and teachers search the public objects or visible private objects in the virtual teaching place based on a distance threshold;
s3.2, carrying out map prompting, namely displaying a bird' S-eye view navigation map at the front right of the main view of the participants, displaying the positions of the participants by using asterisks and the positions of other participants by using solid circles, and representing the distance relation by using different firework animation effects when the participants inquire visible objects in a teaching place;
s3.3, highlighting and prompting, wherein if a learner needs to ask a question to a teacher in the teaching activity, a message, voice or video call can be initiated, and a round icon of the student on a navigation map of a teacher terminal is highlighted and flickered; during the conversation, the icon is highlighted all the time.
6. The method of claim 2, wherein said evaluation of the position of the virtual object in step S4 comprises the following steps:
s4.1, setting the positions of virtual objects, setting the positions for placing and collecting the virtual objects according to the layout conditions of virtual campuses, playgrounds, roads and buildings in the navigation map, avoiding placing the virtual objects at dangerous positions which are easy to cause disputes or poor experiences, and adding physical effects to each virtual object;
s4.2, evaluating the position risk level, evaluating the scores of the candidate positions aiming at the risk levels of danger, dispute easiness and poor experience of the candidate positions of the virtual object, classifying the candidate positions into four types of usable types, risky types, difficult judgment types and difficult elimination types according to the scores, and if the result is the latter two types, not selecting the position;
and S4.3, dynamically evaluating the position risk, collecting and updating the positions and directions of the participants in virtual and real world based on a high-precision three-dimensional map positioning system and by combining a visual component and an inertial component, intelligently identifying the real teaching environment, collecting user feedback information, and dynamically updating the potential risk of the virtual object position.
7. The method of claim 2, wherein the teacher-student interaction in step S5 comprises the following steps:
s5.1, teaching guidance is performed one to one, a teacher develops a plurality of independent virtual discussion spaces with situational features in an educational element universe, a virtual avatar of the teacher is copied, the teaching space is independent and in the same place as a learner, one to one teaching, explanation, answering and discussion are performed, and the learner is enabled to receive a special guidance service of the teacher;
s5.2, providing a solution, combining the learning content in the visual field of the learner according to the answering condition of the learner, providing corresponding feedback and indication for the learner by the teacher, pushing the answering thought and the relevant solution in the case library to the learner, and superposing the solution on the visual field picture of the learner to prompt the execution steps and results of the learning task;
and S5.3, specifically guiding operation, namely supporting a teacher to touch, grab and move a virtual object presented in the holographic or VR terminal through a hand tracking device, gradually displaying teaching contents with difficult operation or difficult understanding to the learner one by one, or quickly positioning a guide or explaining a specific position in a video.
8. Method of operating a teaching system in the universe of educational elements according to claim 2, characterized in that the method further comprises the steps of:
synchronizing; calibrating the terminal clock information of each participant by adopting a fixed time interval method, and sequencing operations and events according to the message timestamps; synchronizing the position and offset of the participant relative to the teacher terminal space origin; mapping the motion information of the teacher to the virtual avatar and synchronizing the motion information of the teacher to the terminals of other participants; in particular
Firstly, time synchronization, namely calibrating and synchronizing terminal time of each participant according to clock service of a cloud server by adopting a fixed time interval method, describing messages by using a JSON format, sending operation and event description of the participants in a main view to the cloud server, and sequencing from small to large according to message timestamps;
step two, synchronizing positions, namely taking a space origin of a teacher terminal as a coordinate origin of a teaching space, determining the position and direction offset of other participants relative to the space origin in an initial state, and synchronizing the position and offset of each participant according to a fixed time interval and the space origin during teaching activities;
step three, the synchronization of action behaviors can check the geographic positions of learners in the real physical space and the virtual environment at any time in the master view of the teacher, and when the teacher manipulates objects in the virtual environment through gestures, head rotation or body postures, the virtual avatar of the teacher updates the corresponding actions and maps the corresponding actions to the master views of other users participating in teaching activities.
9. Method of operating a teaching system in the universe of educational elements according to claim 2, characterized in that the method further comprises the steps of:
a representation of a teaching activity; the method comprises the following steps that a participant enters a virtual teaching place, the scene and the environment of a terminal are initialized, and the identity and the position of a teacher-student participant are obtained and marked; the cooperative white board is adopted to realize resource sharing, and display of knowledge key points and annotation contents; setting visibility of the shared object and a relative distance thereof on the navigation map; in particular
Step one, initializing a teaching activity, enabling participants to enter a virtual teaching activity place, initializing a main view scene, teaching contents and avatar information of other participants of own equipment, synchronizing time, messages and operation of the participants of each terminal, and marking real identities of the participants;
sharing the collaboration content, namely supporting the sharing of messages, documents, pictures, video animations and virtual scenes between teachers and students in the virtual teaching activities through a collaboration white board, displaying the key points and the comment content of knowledge to a learner by the teacher, and displaying and commenting the teaching content on the collaboration white board when the learner participates in the teaching activities in the form of other views;
and step three, grouping the collaborative activity settings, adding participants in the teaching activity, completing task grouping according to the activity process, the familiarity degree and the class to which the participants belong, sharing respective private virtual objects by the participants in the collaborative process, and displaying the visibility and the relative distance of the shared objects on a navigation chart of a main view.
10. Method of operating a teaching system in the universe of educational elements according to claim 2, characterized in that the method further comprises the steps of:
setting an AI assistant; a teacher AI assistant is adopted to understand learning elements and teacher and student behaviors in a teaching scene; obtaining and positioning the question of the learner's annotation sketching, voice description or sight line residence; extracting a case matched with the question, and superposing a relevant explanation, explanation or prompt on a question picture of the learner; in particular
Step one, scene understanding, namely adding a teacher AI assistant in a teaching activity, acquiring a 3D grid map of a real teaching environment of a learner in real time by means of a learner terminal camera by adopting an SLAM technology, dividing the 3D grid by adopting computer vision semantics, and understanding various learning elements and teacher-student behaviors in a teaching scene;
secondly, problem positioning, namely aiming at important and difficult points in the teaching activity process, a learner draws a structure composition which is difficult to understand in a teaching scene by adopting virtual annotations, describes a confused part in the knowledge display process by using voice, or stays on an object with cognitive difficulty for a long time by using sight lines, and assists a teacher AI assistant to acquire and position the problem of the learner;
and step three, overlaying the problem solutions, wherein the teacher AI helps to carry the solutions in the case base matched with the problem solutions according to the problem clues of the learner, and overlays principle descriptions, video explanations or formula prompts on the positions where the problem pictures and the sight lines of the learner reside, and visually and contextually presents the relevant learning guidance.
11. Method of operating a teaching system in the universe of educational elements according to claim 2, characterized in that the method further comprises the steps of:
teaching management; according to the visual proximity relation and the condition of the access terminal, the teacher adds corresponding labels to the participants; supporting school and personal registration, and recording process information of participants in teaching activities; a teacher calls or creates teaching contents and uploads the teaching contents to a cloud server for persistent storage; in particular
Classifying and labeling participants, dividing the participants who join in the teaching activity into site visible participants, remote participants and visitor listeners by a teacher according to the visual proximity relation, and labeling each participant into a strong interaction type, a weak interaction type or an interaction incapable type according to whether a VR terminal and a camera device are accessed or not;
step two, user management, namely supporting schools and individuals to complete registration for teachers, learners and managers in the system, participating personnel join in specific teaching activities according to identities of the participating personnel, and published messages, comment contents, interactive operation and access scenes of the participating personnel are recorded in personal activity information and are related to the teaching activities in an index form;
and step three, resource management, namely, a teacher calls teaching resources, teaching aids and learning tools in the cloud server or creates virtual teaching resources adaptive to the learning conditions of learners by the teacher, and the system records the creation contents, used resources, objects and the interaction process of the teacher and the students in the teaching process, uploads the resources, the objects and the interaction process to the cloud server and stores the resources persistently.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210064953.9A CN114092290A (en) | 2022-01-20 | 2022-01-20 | Teaching system in educational meta universe and working method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210064953.9A CN114092290A (en) | 2022-01-20 | 2022-01-20 | Teaching system in educational meta universe and working method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114092290A true CN114092290A (en) | 2022-02-25 |
Family
ID=80308982
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210064953.9A Pending CN114092290A (en) | 2022-01-20 | 2022-01-20 | Teaching system in educational meta universe and working method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114092290A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114832349A (en) * | 2022-05-16 | 2022-08-02 | 中国科学技术大学 | Yuanzhou swimming teaching auxiliary system and use method thereof |
| CN115565519A (en) * | 2022-11-30 | 2023-01-03 | 广汽埃安新能源汽车股份有限公司 | Dialogue voice generation method, device, equipment and computer readable medium |
| CN115657860A (en) * | 2022-12-09 | 2023-01-31 | 环球数科集团有限公司 | Motion interaction delay processing system for meta universe |
| CN115937480A (en) * | 2023-01-06 | 2023-04-07 | 河南开放大学 | Virtual reality decentralization redirection system based on artificial potential field |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104575142A (en) * | 2015-01-29 | 2015-04-29 | 上海开放大学 | Experiential digitalized multi-screen seamless cross-media interactive opening teaching laboratory |
| CN113096252A (en) * | 2021-03-05 | 2021-07-09 | 华中师范大学 | Multi-movement mechanism fusion method in hybrid enhanced teaching scene |
| CN113242277A (en) * | 2021-04-19 | 2021-08-10 | 华中师范大学 | Virtual synchronous classroom teaching system in 5G network environment and working method thereof |
| CN113593351A (en) * | 2021-09-27 | 2021-11-02 | 华中师范大学 | Three-dimensional comprehensive teaching field system and working method thereof |
| CN113946211A (en) * | 2021-10-14 | 2022-01-18 | 网易有道信息技术(江苏)有限公司 | Method for interacting multiple objects based on metauniverse and related equipment |
-
2022
- 2022-01-20 CN CN202210064953.9A patent/CN114092290A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104575142A (en) * | 2015-01-29 | 2015-04-29 | 上海开放大学 | Experiential digitalized multi-screen seamless cross-media interactive opening teaching laboratory |
| CN113096252A (en) * | 2021-03-05 | 2021-07-09 | 华中师范大学 | Multi-movement mechanism fusion method in hybrid enhanced teaching scene |
| CN113242277A (en) * | 2021-04-19 | 2021-08-10 | 华中师范大学 | Virtual synchronous classroom teaching system in 5G network environment and working method thereof |
| CN113593351A (en) * | 2021-09-27 | 2021-11-02 | 华中师范大学 | Three-dimensional comprehensive teaching field system and working method thereof |
| CN113946211A (en) * | 2021-10-14 | 2022-01-18 | 网易有道信息技术(江苏)有限公司 | Method for interacting multiple objects based on metauniverse and related equipment |
Non-Patent Citations (1)
| Title |
|---|
| 华子荀等: "教育元宇宙的教学场域架构、关键技术与实验研究", 《现代远程教育研究》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114832349A (en) * | 2022-05-16 | 2022-08-02 | 中国科学技术大学 | Yuanzhou swimming teaching auxiliary system and use method thereof |
| CN114832349B (en) * | 2022-05-16 | 2023-03-10 | 中国科学技术大学 | Yuanzhou swimming teaching auxiliary system and use method thereof |
| CN115565519A (en) * | 2022-11-30 | 2023-01-03 | 广汽埃安新能源汽车股份有限公司 | Dialogue voice generation method, device, equipment and computer readable medium |
| CN115657860A (en) * | 2022-12-09 | 2023-01-31 | 环球数科集团有限公司 | Motion interaction delay processing system for meta universe |
| CN115937480A (en) * | 2023-01-06 | 2023-04-07 | 河南开放大学 | Virtual reality decentralization redirection system based on artificial potential field |
| CN115937480B (en) * | 2023-01-06 | 2023-07-04 | 河南开放大学 | Virtual reality decentralization redirection system based on artificial potential field |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114092290A (en) | Teaching system in educational meta universe and working method thereof | |
| Zhang et al. | The development and evaluation of an augmented reality-based armillary sphere for astronomical observation instruction | |
| Bulman et al. | Mixed reality applications in urban environments | |
| AU2019201980B2 (en) | A collaborative virtual environment | |
| US10469547B2 (en) | Online distributed interaction | |
| CN109191964A (en) | A kind of teaching interaction system based on virtual reality | |
| CN114327060B (en) | Working method of virtual teaching system based on AI assistant | |
| Nakanishi et al. | Transcendent communication: location-based guidance for large-scale public spaces | |
| Riquelme et al. | Where are you? Exploring micro-location in indoor learning environments | |
| Zurita et al. | Context, patterns and geo-collaboration to support situated learning | |
| CN111985035B (en) | BIM-based achievement display method and device for campus reduction system and storage medium | |
| Economou et al. | Treasure hunt pervasive games in cultural organisations | |
| CN106484118A (en) | A kind of augmented reality exchange method based on fixing trigger source and system | |
| Scotta et al. | Tangible user interfaces in order to improve collaborative interactions and decision making | |
| Kurti et al. | Designing and implementing ubiquitous learning activities supported by mobile and positioning technologies | |
| JP4004724B2 (en) | Learning management method | |
| Francese et al. | Augmented treasure hunting generator for edutainment | |
| Hansert et al. | Interactive AR models in participation processes | |
| Hruby | From third-person to first-person cartographies with immersive virtual environments | |
| Fathy | The Effect of Difference of Visual Stimuli in Photo Sharing Websites (Instagram) on Cognitive Achievement for Secondary Students in the Curriculum of Computer and Information Technology | |
| CN116501892B (en) | Training knowledge graph construction method based on automatic following system of Internet of things | |
| Mustapha et al. | Incorporating Spatial-Visual Topology In Mobile Augmented Reality Application To Enhance Visual Realism | |
| Inoue et al. | Use of human geographic recognition to reduce GPS error in mobile mapmaking learning | |
| Axup et al. | Representation of self-reported information usage during mobile field studies: Pilots & Orienteers 2 | |
| Chouhan et al. | AI-Enabled Augmented Reality-Based Shared Collaborative Experience |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220225 |
|
| RJ01 | Rejection of invention patent application after publication |