CN116360593B

CN116360593B - Teaching method, system and medium of immersion teaching plan system based on XR technology

Info

Publication number: CN116360593B
Application number: CN202310282684.8A
Authority: CN
Inventors: 蔡铁峰
Original assignee: Shenzhen Polytechnic
Current assignee: Shenzhen Polytechnic
Priority date: 2023-03-10
Filing date: 2023-03-10
Publication date: 2023-11-24
Anticipated expiration: 2043-03-10
Also published as: CN116360593A

Abstract

The invention provides a teaching method, a system and a medium of an immersion teaching plan system based on XR technology, wherein the method comprises the following steps: the teaching plan is released, the teaching plan is made to enter an implementation preparation state, and the teaching plan information comprises target personnel and teaching plans for implementing the teaching plan; the teaching plan system distributes teaching activities or teaching tasks according to a teaching plan in the teaching plan, in classroom teaching, the teaching plan system can automatically create a three-dimensional teaching activity scene for teachers and students according to a designed teaching process, can automatically switch the teaching activity scene for teachers and students, and a user can also control the teaching plan system to create or switch the teaching activity scene by sending commands. The teaching plan system is constructed by adopting the XR technology, so that the generation and management of an XR teaching process can be realized, the implementation effect of the teaching plan can be accurately mastered in real time, and the teaching plan can be dynamically adjusted.

Description

Teaching method, system and medium of immersion teaching plan system based on XR technology

Technical Field

The invention relates to the technical field of immersion teaching based on XR technology, in particular to a teaching method, a system and a medium of an immersion teaching plan system based on XR technology.

Background

The traditional teaching plan is a practical teaching document which is used for a teacher to smoothly and effectively develop teaching activities, and specifically designs and arranges teaching contents, teaching steps, teaching methods and the like according to course standards, teaching outline and textbook requirements and actual situations of students by taking lessons or topics as units. The teaching plan comprises teaching material analysis, student analysis, teaching purpose, serious difficulty, teaching preparation, teaching process, training design and the like. Under the internet + teaching mode, the teaching plan is directly associated with activities such as PPT courseware, answering, roll-call answering, group discussion and the like through the internet + teaching platform, and the internet + teaching function is provided.

Under the energization of high-performance wireless network technologies such as a 5G network and wifi6, services such as storage, calculation, rendering and the like required by an extended reality (XR) mobile terminal (a 5G mobile phone, a head display and the like) can be put on the cloud. Thus, based on cloud services such as cloud storage, cloud computing, cloud rendering and the like, computing, storage and rendering capabilities which can be possessed by a single XR terminal can be unlimited. The XR technology can present rich three-dimensional information in teaching, can provide interaction with course content, and can create an immersive teaching environment to enable students to concentrate more and learn effects more deeply. With the deepening of XR technology in teaching application, the teaching content and the teaching activity form are fundamentally changed, and the XR technology can reconstruct the teaching plan form.

Disclosure of Invention

The invention mainly aims to provide a teaching method, a system and a medium of an immersion teaching plan system based on an XR technology, and aims to construct the teaching plan system by adopting the XR technology, correlate with XR teaching contents, XR immersion type cognitive teaching, practical training, examination, and XR teaching activities/task scenes such as team cooperation, competition and the like in an XR practical training environment, realize generation and management of an XR teaching process, realize three-dimensional visualization and rich teaching data generation functions based on the XR technology, accurately grasp teaching plan implementation effects in real time and dynamically adjust the teaching plan.

In order to achieve the above object, the present invention provides a teaching method of an immersion teaching plan system based on XR technology, the method comprising the following steps:

step S10, a teaching plan is released, the teaching plan is made to enter an implementation preparation state, and the information of the teaching plan comprises target personnel and teaching plans for implementing the teaching plan;

step S20, a teaching plan is implemented, the teaching plan system distributes teaching activities or teaching tasks according to a teaching plan in the teaching plan, in classroom teaching, the teaching plan system can automatically create a three-dimensional teaching activity scene for teachers and students according to a designed teaching process, the teaching activity scene can be automatically switched for teachers and students, and a user can also control the teaching plan system to create or switch the teaching activity scene by sending commands.

In a further technical scheme of the present invention, in the step S20, after receiving an instruction of entering a teaching plan scene from a user, the teaching plan system generates a teaching plan scene instance, the teaching plan scene instance and the user interface are in communication connection, receives the pose and interaction information of the user, generates an experience picture for the user to see, and enables the user to enter the teaching plan scene, the teaching plan scene presents teaching plan information, and the teaching plan scene also presents three-dimensional models, scenes and animations contained in the teaching plan information.

In a further aspect of the present invention, in the step S20, the scenario may also be a three-dimensional presentation of a live teaching activity or task in progress related to the scenario.

In the step S20, the teaching plan scene can play back the completed teaching activities or task process for the user, the user can interact with the ongoing teaching activities or task scene related to the teaching plan in the teaching plan scene, so as to manage the teaching activities or tasks in the process of intervening, and can also view the teaching plan information of each student.

In a further technical scheme of the invention, after receiving an instruction of a student user to enter a case scenario, the system generates a case scenario example, the case scenario example and the student user interface are in communication connection, the student user pose and interaction information are received, an experience picture is generated to be seen by the student user, the student user enters the case scenario, the case scenario presents case information related to the student user, and the case scenario also presents a three-dimensional model, a scene and an animation contained in the case information.

According to a further technical scheme, in the step S20, a case learning scene can also be used for presenting a live state of an ongoing teaching activity or task related to the case learning, the case learning scene can also be used for playing back a completed teaching activity or task process for a user in a stereoscopic mode, the user can also interact with the ongoing teaching activity or task scene related to the case learning, when the user selects a teaching activity or task object in the case learning scene, after an instruction of entering the activity scene or entering the task scene is sent, the case learning system generates a teaching activity or task experience picture for the user to see according to the instruction, and the display of the case learning scene experience picture is stopped, so that the user enters the teaching activity or teaching task scene from the case learning scene.

The teaching method further comprises the steps of S00, editing a teaching plan, setting teaching plan target personnel and a teaching plan, setting teaching plan starting implementation time and ending time, setting teaching plan teaching time and ending time in the teaching plan, in the step of S20, when teaching activities are multi-person activities, a teaching plan system can automatically match with activity participators, the step of S20 comprises three teaching plan implementation stages before, during a lesson and after the lesson, in the pre-lesson stage, the system distributes pre-lesson tasks to students at the set teaching plan starting implementation time, the students select to enter task scenes after receiving the pre-lesson tasks, complete the pre-lesson tasks, in the during the lesson stage, the teaching plan system can automatically create teaching activity three-dimensional scenes for teachers and students according to designed teaching processes, can automatically switch teaching activity scenes for teachers and students, and users can also control the teaching plan system to create or switch teaching activity scenes by sending commands, in the post-lesson stage, after the teaching plan system receives post-lesson tasks to students, after the teaching completion of the lesson, the students select post-lesson tasks after the lesson completion tasks.

The further technical scheme of the invention is that the teaching plan system comprises teaching plan information, teaching targets, teaching contents, serious difficulties, teaching groups and teaching condition information, the step S10 is used for creating a teaching plan start implementing timer, a classroom teaching start timer and a teaching plan implementing end timer, the step S20 is used for counting the overall teaching target completion degree set by the teaching plan and the student individual teaching target completion degree in real time and displaying the overall teaching target completion degree and the student individual teaching target completion degree in a teaching plan scene, the student individual teaching target completion degree is displayed in a student individual teaching plan scene, and the teaching plan system further comprises the step S30 for ending implementing the teaching plan and generating a teaching plan implementing report.

To achieve the above object, the present invention also proposes a teaching system of an immersion teaching plan based on XR technology, the system comprising a memory, a processor and a teaching program of an immersion teaching plan based on XR technology stored on the processor, the teaching program of an immersion teaching plan of XR technology being executed by the processor to perform the steps of the method as described above.

To achieve the above object, the present invention also proposes a computer readable storage medium storing a teaching program of an immersive teaching plan based on XR technology, which is executed by a processor to perform the steps of the method as described above.

The teaching method, the teaching system and the medium of the immersion teaching plan system based on the XR technology have the beneficial effects that:

the teaching plan system constructed by the XR technology can be associated with XR teaching contents, XR immersion type cognitive teaching, practical training, examination, and XR teaching activities/task scenes such as team cooperation, competition and the like in an XR practical training environment, so that the generation and management of an XR teaching process are realized. The invention further provides three-dimensional visualization and rich teaching data generation functions based on the XR technology, and can accurately grasp the implementation effect of the teaching plan in real time and dynamically adjust the teaching plan.

Drawings

FIG. 1 is a flow diagram of a teaching method of an XR technology-based immersive teaching plan system of the present invention;

FIG. 2 is a system configuration diagram of the immersive teaching plan in embodiment 1;

FIG. 3 is a schematic diagram of a scenario set-up;

FIG. 4 is a schematic diagram of a scenario construction;

FIG. 5 is a schematic diagram of a teaching plan implementation service module;

FIG. 6 is a schematic representation of an active scene live in a teaching plan scene;

FIG. 7 is a system configuration diagram of the immersive teaching plan in embodiment 2;

fig. 8 is a schematic diagram of a scenario experience effect.

The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent.

Detailed Description

It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.

The invention provides a teaching method of an immersion teaching plan system based on an XR technology, which is characterized in that the teaching plan system is constructed by adopting the XR technology, and can be associated with XR teaching contents, XR immersion type cognitive teaching, practical training, examination, and group cooperation, competition and other XR teaching activities/task scenes in an XR practical training environment, so that the generation and management of an XR teaching process are realized. And further, based on the three-dimensional visualization and rich teaching data generation function of the XR technology, the teaching plan implementation effect is accurately mastered in real time, and the teaching plan is dynamically adjusted. The method comprises the following steps:

the teaching plan system can automatically distribute tasks before and after lessons for students according to a set teaching process in the teaching plan, automatically creates XR teaching activity scenes for teachers and students in lessons, and can automatically switch the XR teaching activity scenes for the teachers and students after the current teaching activity is completed. And a teacher can also control the creation and switching of the XR teaching activity scene by sending a control command to the teaching plan system. Thereby realizing the generation and management of the XR teaching process. The XR teaching activity/task three-dimensional scene in the teaching plan implementation process is presented in the teaching plan scene, and teachers can intuitively know the XR teaching live of all students. The teaching plan system collects data from the student XR teaching activities/tasks in real time, thereby evaluating teaching plan implementation effects in real time. Based on evaluating the implementation effect of the teaching plan, the teaching plan system can perform personnel matching for teaching activities such as coordination and competition in the implementation process of the teaching plan according to the learning condition, the teaching content and the important difficulties and teaching targets, and can add new teaching activities and tasks into the teaching plan.

Specifically, referring to fig. 1, the teaching method of the immersion teaching plan system based on XR technology of the present invention includes the following steps:

In the step S20, after receiving an instruction of entering a teaching plan scene from a user, the teaching plan system generates a teaching plan scene instance, the teaching plan scene instance and the user interface are in communication connection, receives pose and interaction information of the user, generates an experience picture for the user to see, and enables the user to enter the teaching plan scene, the teaching plan scene presents teaching plan information, and three-dimensional models, scenes and animations contained in the teaching plan information are also presented in a three-dimensional mode.

In the step S20, the teaching plan scene can also stereoscopically present a live of the teaching activity or task in progress related to the teaching plan.

In the step S20, the teaching plan scene can also play back the completed teaching activities or task process for the user in a three-dimensional manner, the user can interact with the ongoing teaching activities or task scene related to the teaching plan in the teaching plan scene, so as to manage the teaching activities or tasks in the process of intervention, and can also view the learning plan information of each student, when the user selects the teaching activities or task objects in the teaching plan scene, the teaching plan system generates the teaching activities or task experience picture for the user to see according to the instruction, and stops displaying the teaching plan scene experience picture, so that the user enters the teaching activities or teaching task scene from the teaching plan scene.

After receiving the instruction of entering the case scenario by the student user, the system generates a case scenario instance, the case scenario instance and the student user interface are in communication connection, the pose and interaction information of the student user are received, an experience picture is generated for the student user to see, the student user enters the case scenario, the case scenario presents the case information related to the student user, and the case scenario also presents the three-dimensional model, the scene and the animation contained in the case information.

In the step S20, the case learning scene may further present the live condition of the in-progress teaching activity or task related to the case learning, the case learning scene may further be a three-dimensional playback of the completed teaching activity or task process for the user, the user may further interact with the in-progress teaching activity or task scene related to the case learning in the case learning scene, and after the user selects the teaching activity or task object in the case learning scene, sends a command to enter the activity scene or enter the task scene all the time, according to the command, the case learning system generates the teaching activity or task experience picture to the user to see, and stops displaying the case learning scene experience picture, so that the user enters the teaching activity or teaching task scene from the case learning scene.

As one implementation scheme, the invention further comprises a step S00 before the step S10, editing the teaching plan, setting a teaching plan target person and a teaching plan, setting a teaching plan start implementation time and a teaching plan end time, setting a teaching plan start time and a teaching plan end time in the teaching plan, wherein in the step S20, when the teaching activity is a multi-person activity, a teaching plan system can automatically match with the activity participants, the step S20 comprises three teaching plan implementation stages before, during the lesson and after the lesson, in the pre-lesson stage, the system distributes the pre-lesson task to students at the set teaching plan start implementation time, the students select to enter a task scene to complete the pre-lesson task after receiving the pre-lesson task, in the during the lesson stage, the teaching plan system can automatically create a teaching activity three-dimensional scene for the teacher and the students according to the designed teaching process, the user can also control the teaching plan system to create or switch the teaching activity scene for the teacher and students through sending commands, in the post-lesson stage, the teaching plan system distributes the post-lesson task to the students after the lesson completion, and the students select to enter the post-lesson task after the post-lesson task is completed.

The teaching plan system comprises teaching plan information, teaching targets, teaching contents, weight difficulties, teaching groups and teaching condition information, wherein the step S10 is used for creating a teaching plan start implementation timer, a classroom teaching start timer and a teaching plan implementation end timer, the step S20 is used for counting the overall teaching target completion degree set by the teaching plan and the student individual teaching target completion degree in real time and displaying the overall teaching target completion degree and the student individual teaching target completion degree in a teaching plan scene, the student individual teaching target completion degree is displayed in the student individual teaching plan scene, and the step S30 is used for ending implementation of the teaching plan and generating a teaching plan implementation report.

The teaching method of the present invention based on the XR technology immersion teaching plan is described in detail below with reference to fig. 2 to 7, and examples 1 to 5.

Example 1:

1. system composition of immersive teaching plan

The two concepts of "scene" and "scene instance" are described herein for distinction. A scene defines objects contained in a three-dimensional space, object states, object itself running logic, and logic for interactions between objects; the scene example is a program process or thread which is operated in real time by computing resources such as a computer processor, a memory, a display card and the like according to scene definition, and the program process or thread calculates the states of all objects in the scene in real time, renders pictures and responds to the interaction of users. When a single scene has multiple user experiences at the same time, if the computing resource which can be obtained by the single scene instance can not generate experience pictures for all users in real time, multiple scene instances are needed to be generated for the scene and distributed to all users, object states in the scene are synchronized among the scene instances, and each scene instance respectively generates experience pictures for the corresponding users in real time, so that all users share the experience scene.

As shown in fig. 2, the immersion teaching plan system based on XR technology of the present invention is composed of a teaching plan scene example 10, a background service module 20, a database 30, a scene example generating module 40, a student user interface 50, a teacher user interface 60, a teaching plan scene example 70, etc., and the components of the system can communicate with each other. Wherein the teacher user interface 60 comprises a 1 st teacher user interface (60-1), a 2 nd teacher user interface (60-2), an H th teacher user interface (60-H), H is a positive integer, H is more than or equal to 0 and less than or equal to 100000000; the teaching plan scene examples 70 include a 1 st teaching plan scene example (70-1), a 2 nd teaching plan scene example (70-2), a.i., a G-th teaching plan scene example (70-G), and G is more than or equal to 0 and less than or equal to 100000000; the student user interface 50 includes a 1 st student user interface (50-1), a 2 nd student user interface (50-2), a K-th student user interface (50-K), K being a positive integer, 0.ltoreq.k.ltoreq.100000000; the case learning scene examples 10 comprise a case learning scene example 1 (10-1), a case learning scene example 2 (10-2), an nth case learning scene example 10-N, wherein N is a positive integer, and N is more than or equal to 0 and less than or equal to 100000000; the scene example generation module 40 comprises a 1 st scene example generator (40-1), a 2 nd scene example generator (40-2), a J scene example generator (40-J), wherein J is a natural number, and J is more than or equal to 1 and less than or equal to 100000000; the background service module 20 comprises an object adding and deleting service 201, an information reading and writing service 202, teaching situation data statistics 203, a scene instance management service 204, a retrieval service 205, a file reading and writing service 206, a teaching plan release service 207 and a teaching implementation service module 208; database 30 includes personnel object 301, knowledge point object 302, scene object 303, teaching content object 304, task activity object 305, teaching situation data 306, scene instance information 307, teaching plan object 308, and teaching plan object 309.

As shown in fig. 3, the teaching plan scenario example 70 includes: a learning condition module 701, a teaching content module 702, a personnel module 703, a teaching target module 704, a teaching effect evaluation and thinking back 705, a result display module 706, a learning scheme module 707 and a teaching process module 708. The teaching process module 708 further comprises a pre-class module 7081, a class module 7082 and a post-class module 7083. The teaching process modules before, during and after the class consist of XR teaching activities and XR teaching tasks.

As shown in fig. 4, case scenario example 10 includes: personal emotion module 101, teaching content module 102, personnel module 103, personal teaching goal module 104, personal learning effect evaluation and review 105, personal result display module 106, and learning process module 107. The learning process module 107 further includes a personal pre-class module 1071, a personal in-class module 1072, and a personal after-class module 1073. The learning process modules before, during and after the class consist of the XR teaching activities and the XR teaching tasks participated by the individual.

As shown in fig. 5, the teaching plan implementation service module 208 includes a 1 st teaching plan implementation service module (208-1), a 2 nd teaching plan implementation service module (208-2), a third, and an L-th teaching plan implementation service module (208-L), where N is a natural number, and 1.ltoreq.l.ltoreq.100000000.

The database 30 personnel object 301 stores basic information such as the name, ID number, sex, specialty, grade, etc. of the teacher and the student. The person object 301 may also store a three-dimensional representation (digital virtual person) of each person, as well as a user interface address (e.g., terminal IP address and port number). Knowledge point object 302 stores knowledge point name, ID number, knowledge point introduction, etc.

Each object stored in the scene object 303 includes scene name, scene ID, scene file address. The scene files related to the scene objects 303 comprise a teaching plan scene file, a learning plan scene file, a task scene file, an activity scene file and a teaching content scene file. The computer system runs the scene files with parameters, and can respectively generate a teaching plan three-dimensional scene, a learning plan three-dimensional scene, a task three-dimensional scene, an activity three-dimensional scene and a teaching content three-dimensional scene. When the belt is in operation with the teaching plan scene file, the parameters comprise the teaching plan ID, and the generated three-dimensional teaching plan scene reads the teaching plan information from the database teaching plan object 308 according to the teaching plan ID and presents the teaching plan information; when the learning case scene file is operated with the parameters, the parameters comprise learning case IDs, and the generated learning case three-dimensional scene reads learning case information from a database learning case object 309 and presents the learning case information according to the learning case IDs; when the task or the activity scene file is operated with the parameters, the teaching content object ID corresponding to the activity or the task is specified in the parameters, and the generated three-dimensional scene of the activity or the task is loaded into the teaching content. The task three-dimensional scene and the activity three-dimensional scene are three-dimensional scenes constructed by adding activities/task functions such as multi-person collaboration, competition and the like on the basis of teaching contents, have the function of judging whether the activities or tasks are completed (for example, judging whether the activities or tasks are completed according to whether the last interaction step of the practical training activities or tasks is triggered or not), and also have the function of counting the knowledge points and the practical operation grasping degree of students involved in the activities or tasks (for example, counting the knowledge and the practical operation degree according to the answer points or the practical operation points), wherein the function development of the task/activity three-dimensional scene is a technology well known to those skilled in the art, and the specification does not describe the details.

In the embodiment of the invention, the teaching plan scene file comprises a teaching plan main scene prefabricated part, wherein the main scene prefabricated part comprises personnel objects, teaching group objects, learning condition objects, teaching plan target objects, teaching effect and evaluation objects, teaching content objects and teaching result display objects. When the teaching plan scene file is operated, a teaching plan main scene prefabricated part is instantiated to generate a teaching plan main scene Jing Shili, and basic information such as personnel basic information, grouping information, learning condition data, teaching plan targets, teaching effects and evaluation, documents/pictures/videos/three-dimensional models and animations in teaching contents and teaching result display are assigned to each object in the teaching plan main scene instance, so that the teaching plan information can be displayed, and basic information viewing interactive functions such as page turning, switching and switching of information display are provided. And by using an XR engine such as units 3D, the interactive function of the teaching plan information presentation and information viewing of the teaching plan scene is developed, which is a common technical means for the person skilled in the art, so that the description of specific implementation is skipped.

After the case main scene example is generated and loaded, scene files (such as an assetbond scene resource package in the unit 3 d) of activities, tasks and the like can be read, the examples of the scenes of the activities, the tasks and the like are generated, the scene examples are loaded to form sub-scenes of the case, the rotation scaling translation relation between the sub-scene coordinate system and the case main scene coordinate system is set respectively, each sub-scene is deployed in the case main scene according to a certain size and pose, a three-dimensional representation cutting interval of each sub-scene in the case scene can be set, and each sub-scene is only displayed in the case scene in the part of the cutting interval, so that the sub-scenes are prevented from overlapping in space. Any sub-scene can be selected, the cutting interval and coordinate system scaling of the sub-scene can be canceled, so that the sub-scene is displayed in the main scene of the teaching plan, and the main scene of the teaching plan and other sub-scenes are hidden or destroyed. The XR engine such as unit 3d has the technical means common to those skilled in the art, and the description of specific implementation is skipped in this specification, so that the function of developing the scenario file of the teaching plan is developed by loading a plurality of scenes after loading 1 three-dimensional scene.

Similarly, the case learning scene file comprises a case learning main scene prefabricated body, the case learning scene after the case learning scene file is operated generates and loads a case learning main scene Jing Shili through the case learning main scene prefabricated body, and case learning information is assigned to the case learning main scene to realize the interaction of the case learning scene to the presentation of case learning information and the checking of case learning information. After the case learning scene file is generated and loaded with the case learning main scene, sub-scenes such as teaching activities and tasks can be loaded, so that all the sub-scenes are deployed in the case learning main scene according to a certain size and pose, and a three-dimensional presentation cutting interval of all the sub-scenes in the case learning scene can be set. Any sub-scene can be selected, the cutting interval and coordinate system scaling of the sub-scene can be canceled, the sub-scene is displayed in the case learning scene, and the case learning main scene and other sub-scenes are hidden or destroyed.

The tutorial object 304 stores a tutorial name, ID number, type, tutorial file storage address, a set of associated knowledge points (represented by a set of knowledge point object IDs). The teaching content object types can be documents, pictures, videos, three-dimensional models, animations, three-dimensional scenes and the like. According to the embodiment of the invention, the teaching content files are developed according to a certain specification, the topics in the teaching content files, the steps in the actual operation and the knowledge points have clear mapping relations, rich teaching condition data can be generated, when the teaching content files are used in teaching, the scoring condition of the answering questions, whether the steps in the actual operation are correctly operated and the time consumption can be acquired, and the knowledge and the manual grasping degree of students on the knowledge points can be counted in real time.

The task activity object 305 stores a task/activity object name, an ID number, a task/activity type, a participant (represented by a person ID set), an activity scheduled start time, an activity scheduled end time, a task deadline, grouping information of the participant, a competition relationship between the participant, a scene object ID contained in the task/activity. The activities differ from tasks by: the activity will typically specify a start time and may further set an end time, while the task will typically not set start and end times but will set a completion deadline. The teaching activity types mainly include: the teaching device comprises a pure teacher teaching device, a student learning device, a student training device, a student multi-person collaborative training device, a student single examination device, a student multi-person collaborative examination device, a student single examination multi-person competition device, a student multi-person collaborative team examination team competition device, an excellent student real-time demonstration device, an excellent team real-time demonstration device and a teacher real-time demonstration device. In the process of demonstrating teachers/students/groups, other students can practice at the same time. The task types are: a student single-person cognitive learning task, a single-person practical training task, a multi-person cooperative practical training task, a single-person checking task, a multi-person cooperative checking task and the like.

The teaching situation data 306 stores the mastery degree of all knowledge points of each student, the cognitive ability, the working ability, the team cooperation ability, the teaching ability of each teacher, and the like of each student. The scenario instance information 307 stores the scenario type, the scenario object ID, the person ID using this scenario instance, the communication address of the scenario instance, of all scenario instances generated by the teaching plan system. Wherein the scene type adopts enumeration values (0-teaching content scene, 1-teaching task scene, 2-teaching activity scene, 3-teaching plan scene, 4-teaching plan scene and 5-achievement display scene).

The information stored by each of the teaching plan objects 308 is: the name and ID of the teaching plan, the teacher ID of the implementing teaching plan, the student ID of the implementing object of the teaching plan, the object ID of the teaching content, the emphasis and difficulty of the teaching content, the teaching target, the implementing time of the teaching plan, the teaching time of the classroom, the learning task before and after the class of the student and the teaching process of the classroom. Wherein the teaching content object in a single teaching plan can be multiple. The teaching plan data 308 may also store real-time statistical data of teaching plan implementation, teaching result display information, teaching effect evaluation and returnal thinking information. Teaching plan data 308 teaching plan implementation study condition data: for each leading knowledge point of the teaching plan, before the teaching plan is implemented, the mastering degree of each student of the teaching plan implementation object, the learning ability of each student and the team cooperative ability of each student are achieved. The learning ability also comprises the cognitive ability and the manual ability, and the teaching ability of a teacher. Teaching plan data 308 teaching plan implementation learning condition data is also included in the teaching plan implementation, and teaching plan learning condition data also includes the grasping degree of each knowledge point in the teaching plan by each student at each moment. Teaching plan data 308 teaching plan implementation teaching situation data which is limited to single teaching plan implementation teaching situation data and which is related to teaching situation data 306, the former part of the teaching situation data is obtained from the latter, and the method comprises the following steps: before the teaching plan is implemented, the mastering degree of each student of the teaching plan implementation object, the learning ability of each student, the team coordination ability of each student and the teaching ability of a teacher are all implemented; the former implements the teaching plan, and the new knowledge degree of the students is updated to the latter for storage. The displayed teaching result is expressed by the state of each virtual object after the teaching content object is actually operated, and the teaching result display information of the teaching plan data 308 stores the ID of the teaching content object and the state value of each virtual object in the teaching content object. The teaching effect evaluation and thinking-back information storage information of the teaching plan data 308 comprises a final completion value of a teaching target automatically generated by a teaching plan system, and the stored thinking-back information is manually filled in by a teacher after the teaching plan is implemented. The classroom teaching process is a classroom teaching activity object ID sequence.

Each of the case objects 309 stores therein: the learning object ID, student name and ID, teaching plan ID, personal teaching target, personal learning condition data, personal learning effect evaluation and thinking back and personal learning process. Wherein the personal affective data includes: before the teaching plan is implemented, the mastering degree of the student individuals on the leading knowledge points, the learning ability of the student individuals, the team collaborative ability of the student individuals, the mastering degree of the student individuals on all knowledge points in the teaching plan at each moment and the completion degree of the individual teaching targets. The personal learning process records a sequence of activity/task object IDs that the person participates in.

2. Construction method

S00, editing a teaching plan

Using web pages or units 3D, etc., an editor for editing the teaching plan information can be developed, and related development techniques are well known to those skilled in the art. In the embodiment of the invention, any teacher creates a teaching plan through a teaching plan editor, sets the name of the teaching plan, the teacher who implements the teaching plan, the class of the teaching plan implementation object or students, teaching contents, the key and difficulty of the teaching contents, teaching targets, teaching plan implementation time, classroom teaching time, learning tasks before and after the class of the students and classroom teaching processes. And saving the teaching plan to a database.

Creating a teaching plan theta in an editor, creating a teaching plan object in a teaching plan object 308 of a database by the editor through an object adding and deleting service 201 of a background service module 20 of the teaching plan system, and assigning an ID number phi to the teaching plan theta _j . Is provided withTeacher who carries out the fixed teaching plan theta uses the ID numberAnd (3) representing. Target students are implemented by setting a teaching plan theta and their ID numbers are gatheredAnd (3) representing. Setting teaching contents of a teaching plan, wherein the teaching contents consist of single or multiple teaching contents objects (the single teaching contents object can comprise a knowledge point, a piece of equipment, a production line, a building and other cognition and practical operation comprising multiple knowledge points), and the teaching contents objects are assembled by using a set>And (3) representing. Knowledge point set use composed of all new knowledge points in teaching content in teaching plan>Knowledge point set use composed of all leading knowledge points (leading knowledge points are learned knowledge points) of teaching content of teaching plan>And (3) representing. Each teaching content object also has its own leading knowledge point and new knowledge point, and the leading knowledge point of the single teaching content object may be the whole teaching plan leading knowledge point set +.>The knowledge points in the new knowledge point set K in the entire teaching plan are also possible. For any teaching content object v _i The set for leading knowledge point is +.>Representing, for new knowledge points, the set +.>And (3) representing. Teaching plan editor backward suitThe business module 20 sends instructions to invoke the information read-write service 202 to read the student's cognitive ability, hands-on ability, team coordination ability, teacher's teaching ability, and the student's mastery of the teaching content's leading knowledge points from the teaching situation data 306. Arbitrary student p _j For teaching plan arbitrary leading knowledge point +.>Is used for the mastery degree of (1)>And (3) representing. Arbitrary student p _j Is->Indicating that the manual ability is +.>Representing team collaborative capability with c _j Indicating +.>And (3) representing.

When editing a teaching plan, the set teaching content weight point has larger weight when evaluating the completion degree of a teaching target, and the set teaching content difficulty point needs more time and energy for teachers and students to master knowledge. For the teaching plan Θ, the mode of setting the key points and the difficulties of the teaching contents is as follows: for knowledge point set [ kappa ] ₀ κ ₁ … κ _n ]Any knowledge point kappa _i The importance of (a) is a value gamma _i The difficulty is represented by lambda _i And (3) representing.

And setting a teaching target of the teaching plan. Firstly, teaching targets can be divided into 3 components, namely a cognitive target, a capability target and a quality target. Secondly, according to the teaching content level, the teaching targets are divided into: the object of the whole teaching plan, the object of the teaching content module and the object of the knowledge point. Again, the teaching plan implements the overall goals, personal goals, of all students. The teaching targets can also be set according to the stage, including the teaching targets before class and the teaching in class Learning objectives and post-class teaching objectives. Teaching targets of the teaching plan can be set from above in a plurality of dimensions, and priorities among the teaching targets can be set. The measure of overall teaching effect score is measured by a variety of strategies, such as: the average or median of all individual scores may also be the minimum of all individual scores. The score of the individual teaching effect can be measured by means of answering questions, training examination scores and the like. For example, the global target value metric employs a strategy that averages over all individual values. The whole cognitive score, the ability score and the quality target score of the students before the class are respectively usedIndicating that the cognitive score, the ability score and the diathesis score of the students in class are respectively +.>The cognitive score, the ability score and the diathesis score of the students after class are expressed by +.>The teaching targets of the set teaching plan are as follows: wherein (1)> Is a constant threshold. And further sets teaching objectives for each student.

Setting the start implementation time t of teaching plan ₀ Classroom teaching start time t ₁ End time t of classroom teaching ₂ End of teaching plan implementation time t ₃ 。

Setting learning task before class of student, and using task to move objectTask object ID set in 305 Representation, wherein arbitrary task is set->The task type, the teaching content module contained in the task and the participators need to be set. Setting teaching activities and processes in class by using active object ID sequence in task active object 305Indicating, wherein arbitrary activity is set>When the system is used, the type of the activity, the duration of the activity plan, the teaching content module contained in the activity and the participators need to be set. Setting post-class learning tasks, and collecting tasks>And (3) representing.

The teacher clicks the UI control for saving the information of the teaching plan in the editor, and invokes the information read-write service of the background service module to save the information of the teaching plan Θ to the teaching plan object 308 of the database 30.

S10, issuing a teaching plan

Any teacher userTransmits a "issue teaching plan" instruction [ M ] to the teaching plan background service module 20 through the ith teacher user interface (60-i') ] ₀ Φ _j ]Instruction parameter M ₀ For instruction ID, phi _j For the teaching plan ID, the teaching plan background service module 20 receives the instruction and then generates a teaching plan ID number M according to the instruction ID number ₀ Activation response: invoking the information read-write service 202 reads the ID number Φ from the database 30 schema object 308 _j Start of teaching plan implementation time t ₀ Classroom teaching start time t ₁ End time t of classroom teaching ₂ Ending of teaching planTime t of implementation ₃ And invokes the teaching plan real-time service module 208 to generate the Φ _j Teaching plan implementation service module (208-phi) _j ) Phi, phi _j Teaching plan implementation service module (208-phi) _j ) Creating a "teaching plan start implementing" timer->"classroom teaching Start" timer>"classroom teaching end" timer>"teaching plan end implementation" timer>Phi (phi) _j Teaching plan implementation service module (208-phi) _j ) A case object is created in the case object 309 of the database 30 for all students of the case implementation object. For any student, ID number p _i Creates a case object for it at case object 309, phi _j Teaching plan implementation service module (208-phi) _j ) Is p _i Generate ID number->Teaching plan Φ also from teaching plan object 308 _j Internal reading teaching plan ID number phi _j Teaching content information, p _i Personal educational objective, personal mood data. In the implementation of the latter teaching, p can also be used _i The learning object of the scheme is written with learning process information, personal achievement display information, personal learning effect evaluation and returnal thinking information. Writing case information to case object 309>Is a kind of medium.

S20, implementing teaching plan

In implementing the teaching plan step, the system can generate immersive experiences of teaching plan scenes and learning plan scenes for teachers and students respectively. The teaching plan scene and the learning plan scene update teaching condition information in real time and also present teaching activities/task live. All three-dimensional scenes of the ended teaching tasks and teaching activities and the three-dimensional scenes of the in-progress teaching tasks and teaching activities are presented in the teaching plan scene, and a user entering the teaching plan scene can watch playback of the ended activities/tasks or live of the in-progress activities/tasks in the teaching plan scene. For any student individual, all the three-dimensional scenes of the completed teaching tasks and teaching activities and the three-dimensional scenes of the ongoing teaching tasks and teaching activities are presented in the case scene, and the student user enters the case scene to watch the playback of the completed activities/tasks or the live condition of the ongoing activities/tasks. The teacher user can enter the selected activity/task scene in the teaching plan scene, and the student user can enter the selected activity/task scene in the learning plan scene. When all the in-process teaching tasks and the three-dimensional scenes of the teaching activities are presented in the teaching plan scene, a teacher user can directly interact with virtual objects in any in-process teaching activities/task scene in the teaching plan scene. The teacher can check the study plan information of any student in the teaching plan scene. The personnel in the multi-person activities can be selected manually or can be matched automatically by the system. According to the teaching process set by the teaching plan, the system automatically distributes teaching tasks and teaching activities, and in the classroom teaching, the system automatically switches activity scenes for teachers and students to push the teaching process. The teacher may also send commands to control the switching of the activity scenes, thereby controlling the teaching process. According to the teaching situation data acquired by the teaching task/activity scene, the degree of completion of the teaching plan target and the degree of completion of the student personal teaching target are counted in real time and presented in the teaching plan scene, and the degree of completion of the student personal teaching target is presented in the student personal teaching plan scene. Teachers and students can adjust teaching plans and learning plans according to the real-time teaching target completion degree.

1) Generating an immersive experience of a teaching plan scene for a teacher user:

any ID number ofThrough its user interface ith 'teacher user interface (60-i'), sends "enter tutorial Φ" to the user background service module 20 _j Instruction->Wherein parameter M ₁ For instruction ID +.>For the ith 'teacher user interface (60-i') address (e.g., IP and port number). The background service module 20 receives the instructionThen according to the instruction ID number M ₁ Activation response: invoking the scenario instance management service 204 sends the "assign scenario instance to user" instruction to the scenario instance generation module 40 +.>Wherein parameter->Is an instruction ID number. When the scene instance generation module 40 receives the instruction, it generates a scene instance according to the instruction ID number +>Activation response: calling a scene instance generator with enough idle computing resources, inquiring from the scene objects 303 to obtain the address of the scenario scene file, reading the scenario scene file, and carrying out parameter +.>And running the teaching plan scene file to generate an i 'th teaching plan scene example (70-i'). Handle->Stored to scene instance information 307, where constant 3 is an enumerated value for field Jing Leixing-teaching plan scene in scene instance information 307, +.>For the communication address of the i 'th scenario instance (70-i'), when the system destroys the i 'th scenario instance (70-i') for reasons such as the user exiting the scenario, the scenario instance information 307 is deleted The scenario instance (70-i') reads the phi with ID number from the scenario object 308 through the information read-write service 202 of the background service module 20 _j And the teaching plan information is presented in the teaching plan scene, and the scenes of the activities, the tasks and the like are read according to the activity task ID numbers and loaded to become sub-scenes of the teaching plan scene. The i 'th teaching plan scenario example (70-i') is directed to the communication address +.>And sending an application for establishing the communication connection. After receiving the communication connection application, the ith teacher user interface (60-i ') establishes a communication connection with the ith teaching plan scene example (70-i'). The ith teacher user interface (60-i ') sends pose and interaction operation information to the ith teaching plan scene example (70-i'), the ith teaching plan scene example (70-i ') renders according to the pose information of the user to generate a user immersive experience picture, and sends the user immersive experience picture to the ith teacher user interface (60-i') to display the user immersive experience picture to the teacher user>Looking at. Based on the multiple-scene operation functions of the XR engine such as units 3D, virtual objects in any loaded activity/task sub-scene can be directly interacted in the main scene of the teaching plan. As shown in fig. 8, the schematic illustration of experience effect of the teaching plan scene is shown, after the user enters the teaching plan scene, the user can view the task and the activity three-dimensional scene contained in the teaching process module before, during and after the class, view the three-dimensional scene contained in the teaching content module and the result display module, view the digital virtual person and personal information of the teacher and the student, view the learning condition data, the teaching target and the teaching effect evaluation And selecting a digital virtual person of any student according to the information such as the thinking back, so that the student's case learning scene can be popped up, and the experience effect of the case learning scene is similar to that of the case learning scene.

2) Generating an immersive experience of a case scenario for a student user:

p for arbitrary ID number _i Through its user interface ith student user interface (10-i), sends "enter associated teaching plan Φ" to the background service module 20 _j Instructions for personal case [ M ] ₂ Φ _j Γ _i p _i ]Wherein parameter M ₂ For instruction ID Γ _i Is the communication address of the ith student user interface (10-i). The background service module 20 receives the instruction [ M ] ₂ Φ _j Γ _i p _i ]Then according to the instruction ID number M ₂ Activation response: invoking the search service 205 according to the teaching plan ID number phi _j With student ID number p _i Retrieving p from the case object 309 _i Is a study of the proposal ID numberInvoking the scenario instance management service 204 sends the "assign scenario instance to user" instruction to the scenario instance generation module 40 +.>Wherein parameter->Is an instruction ID number. When the scene instance generation module 40 receives the instruction, it generates a scene instance according to the instruction ID number +>Activation response: invoking a scenario instance generator with enough free computing resources, querying the scenario object 303 for the scenario file address, reading the scenario file, and carrying parameters And running the case scene file to generate an ith case scene instance (10-i). HandleStored to scene instance information 307, where constant 4 is an enumerated value, D, for field Jing Leixing-case-learning scene in scene instance information 307 _i For the communication address of the ith case scenario instance (10-i), when the system destroys the ith case scenario instance (10-i) because of the user's exit from case, etc., the +_in the scenario instance information 307 is deleted>Case scenario instance (10-i), reading ID number from case object 309 through information read-write service 202 of background service module 20And the case learning information is presented in the case learning scene, and the scenes of the activities, the tasks and the like are read according to the activity task ID numbers and loaded to become sub-scenes of the case learning scene. Case i scenario example (10-i) to communication address Γ _i And sending an application for establishing the communication connection. After receiving the communication connection application, the ith student user interface (50-i) establishes communication connection with the ith scenario instance (10-i). The ith student user interface (50-i) sends pose and interaction operation information to the ith case learning scene example (10-i), and the ith case learning scene example (10-i) renders and generates a user immersive experience picture according to the user pose information and sends the user immersive experience picture to the ith student user interface (50-i) to be displayed to the student user p _i Looking at. Based on the multiple scene operation functions of the XR engine such as units 3D, virtual objects in the loaded activity/task sub-scenes can be directly interacted in the case study main scene. The experience effect of the learning case scene is similar to the experience effect of the teaching case scene, and is not repeated here.

3) The user enters a teaching activity scene to develop teaching activities or enters a teaching task scene to complete teaching tasks:

for arbitrary ID number ofIs assigned to the teacher user in the systemSelecting any teaching activity or task sub-scene in the i ' th teaching plan scene instance (70-i '), sending an instruction for entering the teaching activity/task, and enabling a response by the i ' th teaching plan scene instance (70-i): and canceling the three-dimensional display cutting interval and coordinate system scaling of the selected sub-scene, so that the selected sub-scene is displayed in a full-scale manner in the teaching plan scene, and the main scene and other sub-scenes of the teaching plan are hidden/destroyed. When the user enters the activity/task sub-scene in the teaching plan scene, the user is +.>By sending instructions or phi-th to switch sub-scenes _j Teaching plan implementation service module (208-phi) _j ) Automatically generating an instruction for switching to another sub-scene, and activating a response after the teaching plan scene instance receives the instruction: and hiding or destroying the current sub-scene, and restoring to display the other sub-scene.

P for arbitrary ID number _i In the system, selecting any teaching activity or task sub-scene in the system for the ith case scenario example (10-i) allocated to the student user, sending an instruction for entering the teaching activity/task, and enabling the ith case scenario example (10-i) to respond: and canceling the three-dimensional display cutting interval and coordinate system scaling of the selected sub-scene, so that the selected sub-scene is displayed in the case learning scene, and the case learning main scene and other sub-scenes are hidden/destroyed. When user p _i After entering the activity/task sub-scene in the case learning scene, the user can switch the sub-scene by sending an instruction or phi _j Teaching plan implementation service module (208-phi) _j ) Automatically generating an instruction for switching to another sub-scene, and activating a response after receiving the instruction by the case learning scene example (10-i): and hiding or destroying the current sub-scene, and restoring to display the other sub-scene.

When the activities/tasks entered by the teacher and student users are multi-person participation, if the states of the activities/tasks are incomplete, the states of virtual objects in the scene need to be communicated and synchronized between the activity/task scene instances corresponding to the same activity/task. For the personnel participating in the same activity/task, the communication addresses of the case/teaching plan scene examples of other participants can be queried from the scene example information 307 according to the IDs of the other participants, and the communication addresses are used for establishing communication between the case/teaching plan scene examples and synchronizing the states of the virtual objects in the activity/task sub-scenes.

After entering the activity/task sub-scene, the teachers and students can send back instructions of the teaching plan scene or the learning plan scene. After receiving the instruction of returning to the teaching plan scene, the teaching plan scene instance resumes displaying the teaching plan main scene, and resumes the presentation of all the finished activity/task sub-scenes and the ongoing activity/task sub-scenes in the teaching plan main scene by scaling the pose parameters; and after receiving an instruction for returning to the case learning scene, the case learning scene example resumes to display the case learning main scene, resumes all the activities/tasks sub-scenes of which the student personal participation has ended and the presentation of the activities/tasks sub-scenes in progress in the case learning main scene by scaling the pose parameters.

4) Live presentation of teaching activities and tasks by a teaching plan/learning plan scenario:

live presentation of teaching notes to and teaching activities and tasks. When teaching plan scene examples load teaching activities and tasks related to all teaching plans, and when the teaching activities/tasks are in progress, the states of the pose, animation and the like of each virtual object in the activity/task scene under the activity/task scene coordinate system are synchronized with the corresponding virtual object in the corresponding activity/task scene in the teaching plan scene examples. As shown in the above diagram, the student user 1 and the student user 2 participate in the teaching activity 1 together, and the student user 3 participates in the teaching activity 2, and correspondingly, the teaching activity scene 1 is loaded in the case scenario examples of the students 1 and 2, and the teaching activity scene 2 is loaded in the case scenario example of the student 3. In order to enable the live states of the teaching activities 1 and 2 to be presented in the teaching plan scene, the teaching plan scene example is loaded with the teaching activity scene 1 and the teaching activity scene 2, and the teaching plan scene example synchronize the states of all virtual objects in the activity scene.

Because the case scenario directly loads the instance of the activity/task that the student personally participates in, the student can see the live of the activity/task that he participates in while in the case scenario.

5) Teaching plan/learning plan scene plays result and process playback to teaching activity/task:

teachers and students can submit results to the teaching plan system after completing activities and tasks to save the results to teaching plan data 308 in the database 30, the submitted results can be three-dimensional objects or three-dimensional scenes (expressed by states of teaching content object IDs and virtual objects in the teaching content objects) generated after actual operations, the pose and scaling scale of the three-dimensional objects in the teaching plan scene coordinate system are set, or the rotation translation scaling transformation relation from the activity or task result three-dimensional scene coordinate system to the teaching plan main scene coordinate system is set, the three-dimensional objects or scenes of the activities/task results are loaded on the teaching plan scene, the display of the activities and task results by the teaching plan scene is realized, and the three-dimensional cutting display interval can be set for the three-dimensional objects or scenes of the results when the activities and the task results are displayed. When a teacher and a student experience in an activity or task scene, object states and personnel states in the scene at each moment are saved, so that an activity and task process can be recorded, and a process record is saved to a teaching plan object 308. And setting a rotation translation scaling relation between the activity and task scene coordinate system and the teaching plan scene coordinate system for the completed activity and task scene, loading the teaching plan scene into the activity and task scene, reading process record data of the activity or task by the teaching plan scene after clicking a play process record UI control of the activity and task in the teaching plan scene, and driving state changes of objects and personnel in the scene or task according to the process record to realize playback of teaching activities/tasks.

The same can realize the achievement display and process playback of teaching activities/tasks in the case learning scene.

6) Within the teaching plan scenario, the study plan of each student can also be viewed:

the study plan is a subset of the study plan, and each student study plan information can be obtained directly from the study plan object information without reading from the study plan object 309. Teacher userSending and viewing any student p to teaching plan scene instance through UI _i Is a teaching instruction of the teaching plan, and the teaching plan scene example is from the teaching plan object phi _j Extracting p from information _i Personal emotion, personal learning goal, p _i Information composition p of teaching activities and tasks needing participation _i Is taught and presented.

7) Teaching tasks or activities may be distributed to students:

the teaching plan system can automatically distribute teaching activities or teaching tasks to students. The time in the class is compact, the main teaching activities are distributed, the time after the class is free, and the main teaching tasks with limited cut-off time are distributed. In the following, a specific implementation manner of distributing teaching tasks or activities to students is described by taking pre-class distribution of teaching tasks and in-class distribution of teaching activities as an example.

The specific implementation mode of the pre-class distribution teaching task is as follows:

for any teaching plan phi _j In teaching plan phi _j Set start execution time t ₀ Phi in the background service module 20 _j Teaching plan implementation module (208-phi) _j ) Timer of (a)Activation response: phi (phi) _j Teaching plan implementation module (208-phi) _j ) Reading the teaching plan Φ from the teaching plan object 308 _j Is a piece of information of (a). In the read teaching plan information, the teaching plan implementation target student ID set isThe task object ID set before class is +.>For any student p _i Phi, phi _j Teaching plan implementation module (208-phi) _j ) According to teaching plan ID No. phi _j With student ID number p _i Retrieving p from the case object 309 _i The study ID number of (2) is->Traversing each task in the set of pre-class tasks forAny pre-class task->If the participant contains p _i Pre-class task->Writing ID number to case object 309 case +.>Is in the pre-class task set. Still further look up student p from person object 301 _i Is (are) the user interface address Γ _i Handle->All pre-class task IDs and task names of (1) are sent to the user interface address Γ _i . Student p _i When entering a case scene, a student p can view the distributed task scene _i The instruction case sent when the application enters the classroom scene can also be provided with the task ID parameter before class, and the system can directly display the task scene before class corresponding to the ID in a full-scene full-scale manner when generating the case instance of the learning case.

The specific implementation mode of the teaching activities distributed in the class is as follows:

the teaching plan system can automatically create teaching activity scenes for teachers and students according to the designed teaching process, can automatically switch the teaching scenes for teachers and students, and can also create and switch the teaching scenes according to the control commands by sending the control commands.

Phi (phi) _j Teaching plan implementation module (208-phi) _j ) Read teaching plan phi _j Information, teaching process set in class is active object ID sequenceThe in-sequence ID is an active object ID number in the task active object 305 in the database 30. Teaching plan phi _j Set classroom teaching start time t ₁ "classroom teaching Start" timer>Activation response: for any student p _i In the event sequence->In the method, the participant and the activity scene file address of the activity object are read from the task activity object 305 according to the activity object ID number, and the first participant is searched to contain p _i Activity of->Instruction p _i According to +.>The address of the active scene file is read, an active scene instance is generated, the generated active scene is loaded to the learning case scene without scaling, the learning case main scene and other sub-scenes in the learning case are hidden, and the part is closed >Write student p _i In the in-class activity ID set of the case object 309; for teacher who implements the teaching plan->In the active sequence->In, the first participant is searched for to include +.>Activity of (2)Instruction->I' th teaching plan scenario example->According to->And the activity scene file address reads the activity scene file and generates an activity scene instance, wherein the activity scene is loaded to the teaching plan scene without scaling, and the main scene of the teaching plan and other sub-scenes of the teaching plan instance are hidden. At any moment in the lesson, for any student user p _i The teaching activity currently participated in is +.>If p is _i Or p _i Is complete with other classmates->Student p _i I-th scenario example (10-i) to phi-th _j Teaching plan implementation service module (208-phi) _j ) Send Activity->And (5) completing the message. Phi (phi) _j Teaching plan implementation service module (208-phi) _j ) After receiving the activity completion message, the slave sequence +.>Find->The next later requires p _i Activity of participation->And transmits "switch to active scenario +_to the ith scenario instance (10-i)>"instruction, i.e. the case scenario example (10-i) receives the instruction, and hides or destroys the sub scenario +.>And load and display the active scenario +.>Is->Write student p _i In the in-class active set of the case object 309. Similarly, when the activities participated by the teacher are finished, the teaching plan scenes can be automatically switched. Teacher user->Can also be directed to phi _j Teaching plan implementation service module (208-phi) _j ) Send student p _i Switch to active scenario +.>Scene switching instruction, and after receiving the instruction, phi _j Teaching plan implementation service module (208-phi) _j ) To user p _i The i-th scenario instance (10-i) send "switch to active scenario +.>The instruction of' i is that the ith learning case scene example (10-i) hides or destroys the sub scene +.>And load and display the active scenario +.>Is->Write student p _i In the in-class active set of the case object 309. Likewise, teacher user->The method can also switch the own activity scene by sending an instruction.

Teaching plan phi _j Set classroom teaching end time t ₂ "classroom teaching start" timerAnd activating a response of distributing the teaching task after the class, wherein the response mode is the same as that of distributing the teaching task before the class.

8) Personnel automatic matching:

in the process of performing multi-person activities and tasks requiring coordination and competition, the system can automatically match the optimal person. When matching collaborative personnel, the principle of the most complementary knowledge points among the personnel is adopted, and the principle of the least difference (potential enemy) of the knowledge points among matching competition personnel is adopted. For any teaching activity/task, the teaching content object included in the teaching activity/task is v _l At v _l Of the pre-knowledge points and the new knowledge points, student p _i The set of learned knowledge points (the knowledge points are considered to be learned if the degree of knowledge is higher than a set threshold value) isArbitrary student p _j The set of the grasped advanced knowledge points and the new knowledge points is +.>By union->The number of knowledge points characterizes p _i And p is as follows _j The higher the number of knowledge points in the union, the higher the degree of collaborative matching. For student p _i When the cooperative personnel are allocated, students with high cooperative matching degree are preferentially allocated. By means of the collection->Quantity characterization of knowledge points p _i And p is as follows _j Competition match of (1), set->The fewer the number of knowledge points, the more powerful the competition, and the higher the match degree of the competition. For student p _i When the competing personnel are distributed, the students with high matching degree with the competing personnel are preferentially distributed. When matching competition among groups, firstly counting the set of knowledge points mastered by the whole group, and then calculating the competition matching degree among groups according to a competition matching degree calculating method among single students. />

9) Evaluating the completion degree of the teaching target in real time:

in the embodiment of the invention, all the teaching activities/tasks in progress are based on the data acquisition of teaching contents and knowledge point mastering degree statistical capability, and the cognition/kinetic energy mastering degree data of the activities/tasks participating in students on all knowledge points are acquired in real time and transmitted to the phi-th _j Teaching plan implementation service module (208-phi) _j ) Phi, phi _j Teaching plan implementation service module (208-phi) _j ) The call teaching situation data statistics function 203 is used for counting the completion degree of teaching targets of the teaching plan and the completion degree of personal teaching targets, evaluating the completion degree of the teaching targets in real time, writing the counting result into the teaching situation data of the teaching plan object 308 and the teaching plan object 309, and reading and presenting the teaching target completion degree data from the teaching plan object 308 and the teaching plan object 309 at a certain time interval by the teaching plan scene instance and the teaching plan scene instance.

The teacher can temporarily adjust the teaching activities/tasks, edit the tasks through the teaching plan editing UI, click to release, and write the teaching plan object 308. Students can also actively adjust individual teaching activities/tasks, and after the adjustment results in the teacher's approval, the teacher will write to the teaching plan object 308. The teaching plan scene example can inquire whether the teaching plan is adjusted at certain time intervals, and if the teaching plan is adjusted, the teaching plan information is read again and presented.

S30, ending the implementation of the teaching plan

At time t when the teaching plan is finished ₃ Timer for ending teaching planActivation response: the student updates the knowledge point mastery degree in the teaching plan to the teaching condition data 306 to destroy the phi-th teaching plan theta _j Teaching plan implementation module (208-phi) _j ). After the teaching plan Θ is finished, the system generates a teaching plan implementation report, wherein the report comprises the start time and the end time of each teaching task or activity of teachers and students, knowledge points of students after each activity and task are participated by each activity and task participator change in mastering degree, and the overall teaching target completion degree of the final teaching plan and the individual teaching target completion degree of the students. Teachers and students can also enter a teaching plan or a learning plan scene to view teaching plan or learning plan information. The user can also write the teaching plan of the teaching plan Θ to the teaching plan object 308 through the UI to perform evaluation and teaching jeopardy.

Example 2:

after the teaching plan and the learning plan are loaded with a large number of activities or task scenes, the required calculation resources are large, and the calculation equipment running the teaching plan scene example or the learning plan scene example may not be loaded. To reduce the computational resources required for the case scenario instances or the case scenario instances, embodiment 1 was modified. The system generates an instance independent of a teaching plan scene instance and a learning plan scene instance for an activity or task scene, the teaching plan or learning plan scene no longer loads the full scene of the full-scale teaching activity/task, only loads the simplified activity/task scene (the means for simplifying the scene comprises cutting the scene, subtracting unimportant virtual objects and reducing the resolution of the virtual objects), and the simplified activity/task scene in the teaching plan or learning plan scene instance and the independent activity/task scene instance are synchronous in state, so that a user can view the activity/task live in the teaching plan/learning plan scene. Thus, the computational resources required to run the teaching or learning scenario instances are significantly reduced.

The specific implementation mode is as follows:

as shown in fig. 6, on the basis of embodiment 1, the teaching plan system further includes a teaching application scenario instance 80, where the teaching application scenario instance 80 includes a 1 st teaching application scenario instance (80-1), a 2 nd teaching application scenario instance (80-2),. The mth teaching application scenario instance, and M is 1.ltoreq.m.ltoreq.100000000. The teaching application scene instance can be a teaching activity scene instance, a teaching task scene instance, a three-dimensional scene instance contained in teaching content, and a result display three-dimensional scene instance.

The scene instance generator in the scene instance generation module 40 can generate events, tasks, teaching content scenes and achievement presentation scene instances besides generating teaching plan scene instances and learning plan scene instances. On the basis of embodiment 1, the scene object information of each activity/task/teaching content in the scene object 303 includes not only the address of the normal scene file but also the file address of the simplified scene. The teaching plan scene instance and the learning plan scene instance load activities/tasks/teaching contents/achievements and display scenes, and load simplified scenes.

The teacher user can enter an activity/task/teaching content/achievement presentation scenario from a teaching plan scenario. Teacher user After entering the i 'teaching plan scene instance (70-i'), clicking the activity/task/teaching content/result display simplified scene, and triggering the i 'teaching plan scene instance (70-i') to send a user entering activity/task/teaching content/result display scene command to the background service module 20 through UI operation>Wherein M is ₃ Is instruction ID, B _k Is the scene object ID and,is->After receiving the instruction, the background service module 20 receives the instruction ID number M ₃ Activation response: invoking the scene instance management service 204 to send the generate scene instance instruction +.>After the scene instance generation module 40 receives the instruction, the rootAccording to instruction ID number->Activation response: from scene object 303 according to ID number B _k Searching the address of the scene file, calling a scene instance generator with enough idle computing resources, reading the scene file, operating the scene file to generate a scene instance (kth teaching application scene instance), and the kth teaching application scene instance (80-k) is used for processing the scene fileStored to scene instance information 307, where a constant delta _k Is the field Jing Leixing-enumerated value, D, in the scene instance information 307 _k For the communication address of the kth tutorial application scenario instance (80-k), the kth tutorial application scenario instance (80-k) communicates the address +. >After receiving the application, the ith teacher user interface (60-i ') establishes communication connection with the kth teaching application scene example (80-k), the ith teacher user interface (60-i ') sends pose and interactive operation information to the kth teaching application scene example (80-k), the kth teaching application scene example (80-k) renders according to the user positioning information to generate a user immersive experience picture, and sends the user immersive experience picture to the ith teacher user interface (60-i ') to be displayed to a teacher user>The ith teacher user interface (60-i') stops receiving pictures of the teaching plan scene examples, so that the user can enter teaching activities/tasks/teaching contents/achievements from the teaching plan scene. The same way can realize that the user enters the teaching activity/task/teaching content/achievement display scene from the case learning scene. When the system generates a teaching plan scenario immersive experience for a teacher user, for an ongoing teaching activity/task, the teaching plan scenario instance queries from scenario instance information 307 through the teaching activity/task scenario ID number to obtain the communication address of the teaching activity/task scenario instance, thereby establishing the teaching activity/task scenario instanceAnd the system is communicated with the teaching plan scene example, the states of the teaching activity/task scene example and the corresponding simplified scene in the teaching plan scene example are synchronized, so that a user can view the live condition of the teaching activity/task scene in the teaching plan scene, and conversely, the user performs coordinate system conversion on the pose parameters of the interactive operation on the interactive operation in the teaching activity/task simplified scene, converts the interactive operation into the interactive operation under the teaching activity/task scene coordinate system, and transmits the converted interactive operation to the teaching activity/task scene example in real time to activate the activity operation response, thereby realizing the interactive management of the user on the teaching activity/task in the teaching plan scene. The same can be done for users to view the live and interactive teaching activities/tasks in the case scenario.

Example 3:

on the basis of the embodiment 2, the teaching plan/learning plan scene is not loaded with a simplified scene of teaching activities/tasks/teaching contents/achievements, is modified to be loaded with a three-dimensional voxel map/voxel video of the scene, and the on-going activity/task scene instance generates and transmits the three-dimensional voxel map of the scene to the teaching plan/learning plan scene in real time, so that the live information of the activities/tasks is presented in the teaching plan/learning plan scene. The improvement avoids the simplified scene of teaching activity/task/teaching content/result display and the exposure of the resources and logic of teaching activity/task/teaching content/result display to the teaching plan system, thereby being more beneficial to protecting the intellectual property rights of teaching activity/task/teaching content.

In the description of the patent application number 202210427227.9, an immersion type classroom construction method, an immersion type classroom construction system and a storage medium based on an XR technology are disclosed, a mode that a classroom scene loads a teaching content scene body figure in real time is described in detail, the live presentation of the teaching content scene in the classroom scene is realized, and a mode that interaction of the teaching content scene in the classroom scene is also disclosed. By using the technology, the teaching activity/task/teaching content/achievement display scene can be presented in the teaching plan/learning plan scene through the three-dimensional voxel diagram/voxel video, the teaching activity/task live is checked in the teaching plan/learning plan scene, and the interaction of virtual objects in the teaching activity/task scene in the teaching plan/learning plan scene is realized.

Example 4

In embodiments 1, 2 and 3, further improvements are provided, where the teaching plan scene or the learning plan scene is split into a plurality of sub-scenes, and the sub-scenes are respectively rendered, and the sub-scene rendering pictures are spliced to generate the immersive experience of the complete teaching plan scene and learning plan scene, so that the rendering of the teaching plan/learning plan scene can be performed on a plurality of computing devices, and a plurality of computing devices with common performance can be used for rendering complex and huge teaching plan/learning plan scenes after forming a computing device cluster.

The invention patent of application number 202210022608.9 describes a method for generating an immersive experience picture of a complete scene by respectively rendering pictures and splicing a plurality of sub-scenes in detail in a specification of a new dimension space construction method, a system and a platform based on an XR technology.

Example 5

The embodiment 2 and the embodiment 4 are improved, when the teaching plan scene presents the in-process teaching activity/task scene, the in-process teaching activity/task scene can be adopted to generate stereoscopic live broadcast picture transmission and be displayed to a user for viewing after being spliced with the immersive experience pictures of other contents of the teaching plan scene, so that the in-process teaching activity/task scene live condition is realized when the user views the teaching plan scene. For a specific implementation method, please refer to application form of patent application 202210906282.6, "XR technology-based immersive interactive live broadcast construction method, system and medium".

The beneficial effects are that: live scenes are presented by live pictures, immersion is reduced, but a group of live pictures of active/task scenes in progress can be a large number of users for three-dimensionally presenting the live scenes, so that the number of scene instances is greatly reduced, and the requirement on rendering hardware resources is reduced.

The teaching method of the immersion teaching plan system based on the XR technology has the beneficial effects that:

To achieve the above objective, the present invention further proposes a teaching system of an immersion teaching plan based on XR technology, which is characterized in that the system includes a memory, a processor, and a teaching program of the immersion teaching plan based on XR technology stored on the processor, and the teaching program of the immersion teaching plan of XR technology is executed by the processor to perform the steps of the method described in the above embodiments, which are not repeated herein.

To achieve the above objective, the present invention further proposes a computer readable storage medium, where a teaching program of an immersive teaching plan based on XR technology is stored, and the teaching program based on the immersive XR teaching management platform is executed by a processor to perform the steps of the method described in the above embodiments, which is not described herein again.

The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the invention, and all equivalent structures or modifications in the structures or processes described in the specification and drawings, or the direct or indirect application of the present invention to other related technical fields, are included in the scope of the present invention.

Claims

1. An XR technology-based teaching method of an immersive teaching plan system, the method comprising the steps of:

step S20, implementing a teaching plan, wherein the teaching plan system distributes teaching activities and/or teaching tasks according to a teaching process set in the teaching plan, in the classroom teaching, the teaching plan system can automatically set a three-dimensional teaching activity scene for teachers and students according to the designed teaching process, can automatically switch the teaching activity scene for teachers and students, and a user can also control the teaching plan system to set or switch the teaching activity scene by sending a command, wherein the designed teaching process in the classroom teaching is a teaching activity sequence for any student p _i In classroom teaching, teaching plan systemIs p _i The created three-dimensional scene of the teaching activity is that p is needed in the teaching activity sequence _i The three-dimensional scene corresponding to the participated teaching activity is p _i The new teaching activity scene generated by automatic switching is p in the teaching activity sequence _i The current participation in teaching activities requires p _i And a three-dimensional scene corresponding to the participated teaching activity.

2. The teaching method of the immersion teaching plan system based on XR technology according to claim 1, wherein in step S20, after the teaching plan system receives the instruction of the user to enter the teaching plan scene, the system generates a teaching plan scene instance, the teaching plan scene instance establishes communication connection with the user interface, receives the pose and interaction information of the user, generates an experience picture for the user to see, and enables the user to enter the teaching plan scene, the teaching plan scene presents the teaching plan information, and the teaching plan scene also presents the three-dimensional model, the scene and the animation contained in the teaching plan information.

3. The teaching method of an XR technology based immersive teaching plan system according to claim 2, characterized in that in said step S20 a teaching plan scene is also capable of presenting three-dimensionally a live of an ongoing teaching activity or task related to said teaching plan.

4. The teaching method of the immersion teaching plan system based on XR technology according to claim 3, wherein in step S20, the teaching plan scene can play back the completed teaching activity or task process for the user, the user can interact with the ongoing teaching activity or task scene related to the teaching plan in the teaching plan scene, thereby managing the intervening ongoing teaching activity or task, and can view the teaching plan information of each student, when the user selects the teaching activity or task object in the teaching plan scene, and after the instruction of entering the activity scene or the task scene is sent, the teaching plan system generates the teaching activity or task experience picture for the user to see according to the instruction, and stops displaying the teaching plan scene experience picture, so that the user enters the teaching activity or the teaching task scene from the teaching plan scene.

5. The teaching method of the immersion teaching plan system based on XR technology according to claim 1, wherein after receiving the instruction of entering the teaching plan scene from the student user in step S20, the system generates a teaching plan scene instance, the teaching plan scene instance establishes communication connection with the student user interface, receives the pose and interaction information of the student user, generates an experience picture for the student user to see, and enables the student user to enter the teaching plan scene, the teaching plan scene presents teaching plan information related to the student user, and the teaching plan scene also presents three-dimensional models, scenes and animations contained in the teaching plan information.

6. The teaching method of the immersion teaching plan system based on XR technology according to claim 5, wherein in step S20, the teaching plan scene can also present the live of the teaching activity or task in progress related to the teaching plan, the teaching plan scene can also play back the completed teaching activity or task process for the user in a stereoscopic manner, the user can also interact with the teaching activity or task scene in progress related to the teaching plan, when the user selects the teaching activity or task object in the teaching plan scene, and after the instruction of always entering the activity scene or the task scene is issued, the teaching plan system generates the teaching activity or task experience picture for the user to see according to the instruction, stops displaying the teaching plan scene experience picture, and enables the user to enter the teaching activity or the teaching task scene from the teaching plan scene.

7. The method according to any one of claims 1-6, further comprising the steps of S00, editing a teaching plan, setting a teaching plan target person, a teaching plan including a learning task before and after a student' S lesson, a classroom teaching process, setting a teaching plan start time and an ending time in a classroom teaching, and after step S00, further comprising step S10, issuing The teaching plan is distributed, the teaching plan is made to enter an implementation preparation state, in the step S20, when the teaching activity is a multi-person activity, the teaching plan system can automatically match with activity participators, the step S20 comprises three teaching plan implementation stages before, during and after the class, in the pre-class stage, the system distributes the pre-class task to students at the set teaching plan starting implementation time, after the students receive the pre-class task, the students select to enter a task scene to complete the pre-class task, in the in-class stage, the teaching plan system can automatically create a teaching activity three-dimensional scene for teachers and students according to the designed teaching process, can automatically switch the teaching activity scene for teachers and students, the user can also control the teaching plan system to create or switch the teaching activity scene by sending commands, in the post-class stage, after the teaching plan system finishes the classroom teaching, the teaching plan system distributes the post-class task to students, after the post-class task scene is completed by the students, the post-task scene is selected to enter the post-class task scene, in the pre-class task distributed to the students at the pre-class stage, for any p _i Distributed to p _i The pre-course task is the pre-course task set by the teaching plan, and p is needed _i And the teaching task is participated, wherein the pre-course task set by the teaching plan is a task set.

8. The teaching method of the immersion teaching plan system based on the XR technology according to claim 7, wherein the teaching plan system comprises teaching plan information including teaching targets, teaching contents, difficulties, teaching groups and teaching situation information, the step S10 creates a teaching plan start implementation timer, a classroom teaching start timer and a teaching plan implementation end timer, the step S20 counts the overall teaching target completion degree set by the teaching plan and the student individual teaching target completion degree in real time and displays the overall teaching target completion degree and the student individual teaching target completion degree in a teaching plan scene, the teaching plan system further comprises the step S30 ending implementation of the teaching plan and generating a teaching plan implementation report.

9. An XR technology based immersive teaching system comprising a memory, a processor and an XR technology based immersive teaching program stored on the processor, which when run by the processor performs the steps of the method of any of claims 1 to 8.

10. A computer readable storage medium storing a teaching program of an immersive teaching plan based on XR technology, which teaching program based on an immersive XR teaching management platform is executed by a processor to perform the steps of the method of any of claims 1 to 8.