CN107195210B

CN107195210B - Two-dimensional and three-dimensional combined remote teaching system and control method

Info

Publication number: CN107195210B
Application number: CN201710534633.4A
Authority: CN
Inventors: 梁小龙; 高晗; 霍岩; 张航进
Original assignee: Beijing Dasheng Online Technology Co ltd
Current assignee: Beijing Havo Online Technology Co ltd
Priority date: 2017-07-03
Filing date: 2017-07-03
Publication date: 2020-07-10
Anticipated expiration: 2037-07-03
Also published as: CN107195210A

Abstract

The invention relates to a two-dimensional and three-dimensional combined remote teaching system, which comprises a remote server, a teacher end and a student end, wherein the teacher end and the student end are connected with the remote server; the student end and the teacher end are also used for downloading the two-dimensional and three-dimensional teaching materials of the class from the remote server according to the virtual space ID number and loading the downloaded two-dimensional and three-dimensional teaching materials on a display interface; the teacher end or the student end is also used for receiving the operation of the user on the two-dimensional and three-dimensional teaching materials, generating teaching material operation information and sending the teaching material operation information to the remote server; the server is further used for synchronously forwarding the teaching material operation information to other teacher terminals or student terminals belonging to the same virtual space, and the other teacher terminals or student terminals synchronously display the teaching material operation information according to the received teaching material operation information. The demonstration device has the advantages of good demonstration effect, small storage space of the teaching material, compatibility with all the advantages of the traditional two-dimensional teaching material and capability of realizing remote and local demonstration.

Description

Two-dimensional and three-dimensional combined remote teaching system and control method

Technical Field

The invention relates to the field of internet teaching, in particular to a two-dimensional and three-dimensional combined remote teaching system and a two-dimensional and three-dimensional combined remote teaching system control method.

Background

The internet education needs to improve the real substituting feeling of the students and improve the real experience of the students; the virtual teaching environment is constructed, so that the real experience of the student can be improved, and the learning enthusiasm of the student is improved.

At present, three-dimensional model teaching systems mainly comprise two types: the first kind uses real three-dimensional material object to teach and demonstrate, not only is restricted by the place but also carries very inconveniently, is restricted by light and scene space simultaneously and demonstrates that the effect is not good, uses very inconveniently. The second method fully uses virtual three-dimensional scenes and three-dimensional models for teaching, the 3D model of the technology is only displayed at a local client at present, and the 3D model has no function of remote demonstration teaching; meanwhile, the teaching materials are expensive in manufacturing cost, high in system complexity, large in data volume and complex in interface interactive design due to the fact that the virtual three-dimensional scene is completely used.

Teaching systems using three-dimensional models for teaching and demonstration of real three-dimensional real objects have the following disadvantages: the demonstration device is limited by the field, is inconvenient to carry, is limited by light and scene space, has poor demonstration effect and is inconvenient to use.

Teaching systems that fully use three-dimensional models of virtual three-dimensional scenes and three-dimensional models have the following disadvantages: the whole three-dimensional scene is expensive in manufacturing cost, large in model data volume and difficult to store and transmit, the system design is complex, and interactive operation is complex and difficult to control and use.

Disclosure of Invention

The invention provides a two-dimensional and three-dimensional combined remote teaching system for solving the problems of poor demonstration effect, complex system, complex three-dimensional interactive operation and difficulty in control and use of the teaching system in the prior art, which comprises a remote server, a teacher end and a student end, wherein the remote server is connected with the teacher end and the student end; the remote server is used for forming a virtual space according to the teacher end and the student end which are connected to the server and pushing the same three-dimensional and two-dimensional teaching material information to the teacher end and the student end which are connected to the same virtual space; the virtual space is a collection formed by a group of users connected to the server; the teacher end and the student end are used for sending the local end recorded real-time video stream and the voice stream after entering the virtual space, receiving the video stream and the voice stream of other teacher ends or student ends forwarded by the server, displaying according to the received video stream, and playing according to the received voice stream; the student end and the teacher end are also used for downloading the two-dimensional and three-dimensional teaching materials of the class from the remote server according to the virtual space ID number and loading the downloaded two-dimensional and three-dimensional teaching materials on a display interface; the teacher end or the student end is also used for receiving the operation of the user on the two-dimensional and three-dimensional teaching materials, generating teaching material operation information and sending the teaching material operation information to the remote server; the server is further used for synchronously forwarding the teaching material operation information to other teacher terminals or student terminals belonging to the same virtual space, and the other teacher terminals or student terminals synchronously display the teaching material operation information according to the received teaching material operation information.

Further, teacher's end or student's end still are used for showing two-dimensional teaching materials display interface goes up to generate and covers display interface's transparent mark picture layer receives the user and is in drawing operation, characters mark operation on the transparent mark picture layer will in real time drawing operation, characters mark operation send to remote server, remote server will drawing operation, characters mark operation send to other teacher's end or student's end, other teacher's end or student's end according to drawing operation, characters mark operation carry out synchronous real-time display.

Further, the drawing operation comprises one or more of drawing a label line, drawing a label block diagram and adjusting the attribute of the label block diagram; when the drawing operation is a drawing and marking line operation, the teacher end or the student end receives a mouse moving track point sequence formed by user operation on the display interface, the mouse moving track points are connected by line segments, a marking line is formed on the transparent marking layer in the teacher end or the student end, the teacher end or the student end sends the mouse moving track point sequence to the remote server, the remote server sends the mouse moving track point sequence to other teacher ends or student ends, and the other teacher ends or the student ends form a marking line on the transparent marking layer by using the moving track point sequence;

when the drawing operation is an operation of drawing a labeling block diagram, the teacher end or the student end receives first click position information and second click position information which are formed by the operation of a user on the display interface, the teacher end or the student end generates a labeling diagram on the transparent labeling diagram layer by taking the first click position information and the second click position information as the upper left corner position and the lower right corner position of the labeling diagram, meanwhile, the teacher end or the student end sends the first click position information and the second click position information to the remote server, the remote server sends the first click position information and the second click position information to the other teacher end or the student end, the other teacher end or the student end forms a labeling block diagram on the transparent labeling layer by using the first click position information and the second click position information as the upper left corner position and the lower right corner position of the labeling block diagram; the labeling block diagram comprises a rectangular block diagram, a circular block diagram and an oval block diagram;

when the drawing operation is a marked block diagram attribute adjusting operation, the teacher end or the student end receives marked block diagram selection information and attribute setting information which are formed by a user through operation on the display interface, the attributes of the marked block diagram are changed and displayed according to the marked block diagram selection information and the attribute setting information, meanwhile, the marked block diagram selection information and the attribute setting information are sent to the remote server, the remote server sends the marked block diagram selection information and the attribute setting information to other teacher ends or student ends, and the other teacher ends or student ends display the marked block diagram with the modified attributes on the transparent marked layer by using the marked block diagram selection information and the attribute setting information; the attribute setting information includes color setting information, transparency setting information, size setting information, position setting information, and rotation angle setting information.

Further, the text marking operation comprises a text input operation and a text attribute setting operation; when the character marking operation is a character input operation, the teacher end or the student end receives position selection information formed by the operation of a user on the display interface, displays a character input frame on the transparent marking layer according to the position selection information, continues to receive character input information of the user, displays a character marking frame on the transparent marking layer according to the character input information, simultaneously sends the position selection information and the character input information to the remote server, sends the position selection information and the character input information to other teacher ends or student ends, and displays the character marking frame on the transparent marking layer by the other teacher ends or the student ends according to the position selection information and the character input information;

when the text labeling operation is a text attribute operation, the teacher end or the student end receives text labeling frame selection information and text labeling frame attribute setting information which are formed by a user through operation on the display interface, the attributes of the text labeling frame are changed and displayed according to the text labeling frame selection information and the text labeling frame attribute setting information, meanwhile, the text labeling frame selection information and the text labeling frame attribute setting information are sent to the remote server, the remote server sends the text labeling frame selection information and the text labeling frame attribute setting information to other teacher ends or the student ends, and the other teacher ends or the student ends display the text labeling frames with modified attributes on the transparent labeling layer by using the text labeling frame selection information and the text labeling frame attribute setting information; the attribute setting information includes font setting information, color setting information, character size setting information, position setting information, and rotation angle setting information.

The teacher end or the student end is further configured to generate a transparent labeling layer covering the display interface on which the two-dimensional teaching materials are displayed, receive two-dimensional animation link selection information and/or animation attribute setting information which are formed by a user operating on the display interface, play a two-dimensional animation on the transparent labeling layer by using a playing plug-in according to the two-dimensional animation link selection information and/or the animation attribute setting information, and simultaneously send the two-dimensional animation link selection information and/or the animation attribute setting information and animation picture display position information to the remote server. And the remote server sends the two-dimensional animation link selection information and/or animation attribute setting information and animation picture display position information to other teacher terminals or student terminals, and the other teacher terminals or student terminals play the animation on the transparent labeling layer by using the two-dimensional animation link selection information and/or animation attribute setting information and animation picture display position information and using a playing plug-in.

The teacher end or the student end is further used for receiving selection information and attribute setting information of a user on a two-dimensional teaching material for pictures in the two-dimensional teaching material, changing attributes of the pictures in the two-dimensional teaching material, and sending the selection information and the attribute setting information to a remote server, the remote server sends the selection information and the attribute setting information to other teacher ends or the student end, and the other teacher end or the student end changes the attributes of the pictures in the two-dimensional teaching material according to the selection information and the attribute setting information;

and/or the teacher end or the student end is further used for receiving playing operation information of a user on the two-dimensional teaching material for the animation in the two-dimensional teaching material, playing the animation in the two-dimensional teaching material according to the playing operation information of the animation, and simultaneously sending the playing operation information of the animation to the remote server, the remote server sends the playing operation information of the animation to other teacher ends or student ends, and the other teacher ends or student ends play the animation according to the playing operation information of the animation;

and/or the teacher end or the student end is further used for receiving window attribute setting information of a video window of a user on the two-dimensional teaching material, changing the attribute of the video window on the two-dimensional teaching material according to the window attribute setting information and displaying the attribute, meanwhile, sending the window attribute setting information to the remote server, sending the window attribute setting information to other teacher ends or the student end by the remote server, and changing the attribute of the video window in the two-dimensional teaching material by the other teacher ends or the student end according to the window attribute setting information.

Further, the teacher end or the student end is further configured to receive an operation of a user on a 3D model on a three-dimensional teaching material, change display information of the 3D model in the three-dimensional teaching material according to the operation on the 3D model, and simultaneously send the operation on the 3D model to the remote server, the remote server sends the operation on the 3D model to the other teacher end or the student end, and the other teacher end or the student end generates and displays updated display information of the 3D model according to the operation on the 3D model.

Further, the operation on the 3D model comprises a multi-angle rotation model operation, a model disassembling operation, a three-dimensional model animation playing operation, a model triggering particle animation operation, a model triggering special effect animation operation, a model triggering sound operation, a model moving operation and a model zooming operation.

Further, the teacher end is further configured to generate a video and voice control mode signal including student end selection information, and send the video and voice control mode signal to the remote server, where the remote server sends the video and voice control mode signal to a student end corresponding to the student end selection information according to the student end selection information, and a student end user receiving the video and voice control mode signal controls a video and voice mode of the student end according to the video and voice control mode signal, where the video and voice mode includes: receiving a voice signal mode; receiving a video signal mode; a voice signal transmission mode; video signal transmission mode.

On the other hand, the invention also provides a two-dimensional and three-dimensional combined remote teaching system control method, wherein the teaching system comprises a remote server, a teacher end and a student end, wherein the teacher end and the student end are connected with the remote server; the remote server is used for forming a virtual space according to the teacher end and the student end which are connected to the server and pushing the same three-dimensional and two-dimensional teaching material information to the teacher end and the student end which are connected to the same virtual space; the virtual space is a collection formed by a group of users connected to the server; the control method comprises the following steps:

the teacher end and the student end are connected with the virtual space, the local end is sent to record real-time video streams and voice streams, the video streams and the voice streams of other teacher ends or student ends forwarded by the server are received, the video streams and the voice streams are displayed according to the received video streams, and the video streams and the voice streams are played according to the received voice streams;

the student terminal and the teacher terminal download the two-dimensional and three-dimensional teaching materials of the class from the remote server according to the virtual space ID number, and load the downloaded two-dimensional and three-dimensional teaching materials on a display interface;

the teacher end or the student end receives the operation of the user on the two-dimensional and three-dimensional teaching materials, generates teaching material operation information and sends the teaching material operation information to the remote server;

and the server synchronously forwards the teaching material operation information to other teacher terminals or student terminals belonging to the same virtual space, and the other teacher terminals or student terminals synchronously display the teaching material operation information according to the received teaching material operation information.

The invention combines the traditional two-dimensional teaching materials (such as pictures, pdf, ppt, videos, flash animations and the like) and the virtual three-dimensional models to manufacture the teaching materials, and can overcome the defects of a teaching system of the three-dimensional models for teaching and demonstrating by using real three-dimensional real objects and a teaching system of the three-dimensional models completely using virtual three-dimensional scenes and the three-dimensional models. The demonstration device has the advantages of good demonstration effect, small storage space of the teaching materials, convenience in storage and transmission, simple system design, simplicity in operation, compatibility with all the advantages of the traditional two-dimensional teaching materials, no limitation of sites, light, scene space and the like, and capability of realizing remote and local demonstration.

Drawings

The features and advantages of the present invention will be more clearly understood by reference to the accompanying drawings, which are illustrative and not to be construed as limiting the invention in any way, and in which:

FIG. 1 is a schematic diagram of a two-dimensional and three-dimensional combined remote teaching system in accordance with some embodiments of the present invention;

FIG. 2 is a flow chart of a method for controlling a two-dimensional and three-dimensional combined remote teaching system according to some embodiments of the present invention.

Detailed Description

In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited by the specific embodiments disclosed below.

The teaching system based on the two-dimensional teaching materials is combined with the teaching system based on the three-dimensional teaching materials, so that the cost of two systems is saved, local operation information is synchronized to the remote end in order to realize local and remote demonstration, and the remote end carries out analysis and display. See the examples below for specific embodiments.

Example one

As shown in fig. 1, the present invention provides a two-dimensional and three-dimensional combined remote teaching system 100, which comprises a remote server 110, a teacher end 120 and a student end 130 connected to the remote server 110; the remote server 110 is configured to form a virtual space according to the teacher end 120 and the student end 130 connected to the remote server 110, and push the same three-dimensional and two-dimensional teaching material information to the teacher end 120 and the student end 130 connected to the same virtual space; the virtual space is a collection formed by a group of users connected to the server 110; the teacher end 120 and the student end 130 are configured to send the local recorded real-time video stream and the voice stream after entering the virtual space, receive the video stream and the voice stream of the other teacher end 120 or the student end 130 forwarded by the server 110, display the video stream according to the received video stream, and play the video stream according to the received voice stream; the student terminal 130 and the teacher terminal 120 are further configured to download the two-dimensional and three-dimensional teaching materials from the remote server according to the virtual space ID number, and load the downloaded two-dimensional and three-dimensional teaching materials on a display interface; the teacher end 120 or the student end 130 is further configured to receive operations of the user on two-dimensional and three-dimensional teaching materials, generate teaching material operation information, and send the teaching material operation information to the remote server 110; the server 110 is further configured to synchronously forward the teaching material operation information to other teacher terminals 120 or student terminals 130 belonging to the same virtual space, where the other teacher terminals 120 or student terminals 130 perform synchronous display according to the received teaching material operation information.

Teacher's end 120 or student's end 130 still are used for showing two-dimensional teaching materials generate on the display interface and cover the transparent mark picture layer of display interface receives the user and is in drawing operation, characters mark operation on the transparent mark picture layer will in real time drawing operation, characters mark operation send to remote server 110, remote server 110 will drawing operation, characters mark operation send to other teacher's end 120 or student's end 130, other teacher's end 120 or student's end 130 basis drawing operation, characters mark operation carry out synchronous real-time display.

Specifically, the drawing operation includes one or more of drawing a labeled line, drawing a labeled block diagram, and adjusting the property of the labeled block diagram; when the drawing operation is a labeling line drawing operation, the teacher end 120 or the student end 130 receives a mouse moving track point sequence formed by a user operating on the display interface, connects the mouse moving track points by line segments, forms a labeling line on the transparent labeling layer in the teacher end 120 or the student end 130, simultaneously sends the mouse moving track point sequence to the remote server 110 by the teacher end 120 or the student end 130, sends the mouse moving track point sequence to the other teacher end 120 or the student end 130, and forms a labeling line on the transparent labeling layer by the other teacher end 120 or the student end 130 by using the moving track point sequence;

when the drawing operation is an operation of drawing a callout block diagram, the teacher end 120 or the student end 130 receives the first click position information and the second click position information formed by the user operation on the display interface, the teacher end 120 or the student end 130 generates a labeled diagram on the transparent labeled layer by taking the first click position information and the second click position information as the upper left corner position and the lower right corner position of the labeled diagram, while the teacher end 120 or the student end 130 transmits the first click position information and the second click position information to the remote server 110, the remote server 110 transmits the first click position information and the second click position information to the other teacher's terminal 120 or the student's terminal 130, the other teacher end 120 or the student end 130 uses the first click position information and the second click position information as the upper left corner position and the lower right corner position of the labeled block diagram to form a labeled block diagram on the transparent labeled layer; the labeling block diagram comprises a rectangular block diagram, a circular block diagram and an oval block diagram;

when the drawing operation is a labeled block diagram attribute adjustment operation, the teacher end 120 or the student end 130 receives labeled block diagram selection information and attribute setting information which are formed by a user operating on the display interface, the attributes of the labeled block diagram are changed and displayed according to the labeled block diagram selection information and the attribute setting information, the labeled block diagram selection information and the attribute setting information are sent to the remote server 110, the remote server 110 sends the labeled block diagram selection information and the attribute setting information to the other teacher end 120 or the student end 130, and the other teacher end 120 or the student end 130 displays the labeled block diagram with the modified attributes on the transparent labeled layer by using the labeled block diagram selection information and the attribute setting information; the attribute setting information includes color setting information, transparency setting information, size setting information, position setting information, and rotation angle setting information.

Further, the text marking operation comprises a text input operation and a text attribute setting operation; when the text marking operation is a text input operation, the teacher end 120 or the student end 130 receives position selection information formed by the user through operation on the display interface, displays a text input frame on the transparent marking layer according to the position selection information, the teacher end 120 or the student end 130 continues to receive text input information of the user, displays a text marking frame on the transparent marking layer according to the text input information, and simultaneously sends the position selection information and the text input information to the remote server 110, the remote server 110 sends the position selection information and the text input information to the other teacher end 120 or the student end 130, and the other teacher end 120 or the student end 130 displays the text marking frame on the transparent marking layer by using the position selection information and the text input information;

when the text marking operation is a text attribute operation, the teacher end 120 or the student end 130 receives text marking box selection information and text marking box attribute setting information which are formed by the user operation on the display interface, changing the attribute of the text labeling block diagram according to the text labeling box selection information and the text labeling box attribute setting information and displaying the attribute, simultaneously transmits the text label box selection information and the text label box attribute setting information to the remote server 110, the remote server 110 transmits the text label box selection information and the text label box attribute setting information to the other teacher's terminal 120 or the student's terminal 130, the other teacher end 120 or the student end 130 displays the text label box with modified attribute on the transparent label layer by using the text label box selection information and the text label box attribute setting information; the attribute setting information includes font setting information, color setting information, character size setting information, position setting information, and rotation angle setting information.

The teacher end 120 or the student end 130 is further configured to generate a transparent annotation layer covering the display interface on which the two-dimensional teaching materials are displayed, receive two-dimensional animation link selection information and/or animation attribute setting information that is formed by a user operating on the display interface, play a two-dimensional animation on the transparent annotation layer by using a play plug-in according to the two-dimensional animation link selection information and/or the animation attribute setting information, and send the two-dimensional animation link selection information and/or the animation attribute setting information and animation picture display position information to the remote server 110. The remote server sends the two-dimensional animation link selection information and/or animation attribute setting information and animation picture display position information to the other teacher end 120 or the student end 130, and the other teacher end 120 or the student end 130 uses the two-dimensional animation link selection information and/or animation attribute setting information and animation picture display position information to play animation on the transparent annotation layer by using a playing plug-in.

The teacher end 120 or the student end 130 is further configured to receive selection information and attribute setting information of a user on a two-dimensional teaching material for a picture in the two-dimensional teaching material, change an attribute of the picture in the two-dimensional teaching material, and send the selection information and the attribute setting information to the remote server 110, the remote server 110 sends the selection information and the attribute setting information to the other teacher end 120 or the student end 130, and the other teacher end 120 or the student end 130 changes the attribute of the picture in the two-dimensional teaching material according to the selection information and the attribute setting information;

and/or the teacher end 120 or the student end 130 is further configured to receive playing operation information of the animation in the two-dimensional teaching material from the user on the two-dimensional teaching material, play the animation in the two-dimensional teaching material according to the playing operation information of the animation, and simultaneously send the playing operation information of the animation to the remote server 110, the remote server 110 sends the playing operation information of the animation to the other teacher end 120 or the student end 130, and the other teacher end 120 or the student end 130 plays the animation according to the playing operation information of the animation;

and/or the teacher end 120 or the student end 130 is further configured to receive window attribute setting information of a video window on a two-dimensional teaching material from a user, change and display attributes of the video window on the two-dimensional teaching material according to the window attribute setting information, and simultaneously send the window attribute setting information to the remote server 110, the remote server 110 sends the window attribute setting information to the other teacher end 120 or the student end 130, and the other teacher end 120 or the student end 130 changes attributes of the video window in the two-dimensional teaching material according to the window attribute setting information.

The teacher end 120 or the student end 130 is further configured to receive an operation of a user on a three-dimensional teaching material on a 3D model, change display information of the 3D model in the three-dimensional teaching material according to the operation on the 3D model, and simultaneously send the operation on the 3D model to the remote server 110, the remote server 110 sends the operation on the 3D model to the other teacher end 120 or the student end 130, and the other teacher end 120 or the student end 130 generates 3D model update display information according to the operation on the 3D model and displays the 3D model update display information.

The operation on the 3D model comprises multi-angle rotation model operation, model disassembling operation, three-dimensional model animation playing operation, model triggering particle animation operation, model triggering special effect animation operation, model triggering sound operation, model moving operation and model zooming operation.

Further, the teacher end 130 is further configured to generate a video and voice control mode signal including student end selection information, and send the video and voice control mode signal to the remote server, where the remote server sends the video and voice control mode signal to a student end corresponding to the student end selection information according to the student end selection information, and a student end user receiving the video and voice control mode signal controls a video and voice mode of a local end according to the video and voice control mode signal, where the video and voice mode includes: receiving a voice signal mode; receiving a video signal mode; a voice signal transmission mode; video signal transmission mode. The video and voice mode is controlled to control the processing flow of the student end 130 to the video signal and the voice signal.

Example two

The specific process of the operation of the two-dimensional and three-dimensional combined remote teaching system is as follows:

1. the teacher end and the student end are connected with a remote server and enter the same virtual space room, and the virtual space is a set formed by a group of users connected with the server end. The server will push the same three-dimensional and two-dimensional textbook (there may be more on both the teacher's side and the student's side) to users who enter the same virtual space.

2. After the teacher end or the student end enters the virtual room space of the server, all the user ends (all the teacher users and the student users) can transmit video streams and voice streams with the server, and each user end can transmit real-time video streams and voice streams recorded by the user end to the server to transmit voice video streams. According to the setting of the server, each user end receives the video stream and the voice stream of n (n > ═ 0) paths of other ends forwarded by the server and receives the video and voice signals from all other ends, each user end displays the received video stream, plays the received voice stream and simultaneously sends the video and voice signals of the user end to all other ends. At the moment, all teacher terminals and student terminals can carry out remote voice and video calls.

3. And all users entering the same virtual space start to download the two-dimensional and three-dimensional teaching materials of the class from the remote material server according to the ID number of the virtual space, and load the downloaded two-dimensional and three-dimensional teaching materials on a display interface of a user side.

4. After the steps are completed, the teacher and the students can start to attend the class and enter the class attending state.

5. Teachers in class use video voice calls, mice, gestures and other modes to operate the downloaded two-dimensional and three-dimensional teaching materials to give lessons to students. The operation modes comprise: the system comprises a labeling mode, a two-dimensional operation mode, a three-dimensional operation mode and a video and voice control mode.

The operating states of the modes are as follows:

① the teacher end and the student end in the teaching system download the two-dimensional teaching materials (such as pictures, pdf, ppt, video, flash animation, etc.) and three-dimensional model teaching materials stored in the server end through the connection server.

② the teacher end and the student end in the teaching system can transmit real-time video and voice to each other via the server to carry out real-time video and voice call.

③ marking mode, the marking mode is operated by teacher end in default condition, and can be operated by teacher authorization to other user end, the marking mode is that one or more user end marks on displayed teaching material, then the marking operation is sent to server, the server forwards to all other user ends to synchronize, finally realizing the effect that each user end displays the same marking state (note: the mode is marked to students in two-dimensional mode on the picture after the normal display of two-dimensional three-dimensional material, just as the teacher draws on ppt with drawing pen when speaking ppt), the marking mode has the following 4 aspects:

1. after entering the labeling mode, a transparent labeling layer with the same size as the display picture is generated at each user side, and the layer is covered on the existing display picture. All the following drawing operations are performed in the transparent label layer.

2. A user end draws a marking line in a display picture, a user moves on the display picture by a mouse, the user end records moving track points, a series of track points are connected by line segments to form a marking line at a local client end, the moving track points are sent to a server in real time and then are forwarded to other end users by the server, the other end users can also connect the moving track points to form a marking line to be displayed on a marking picture layer of the user end after receiving the series of track points, a marking rectangular frame is drawn, a marking circular frame is drawn, an indicating symbol such as a marking elliptical frame is drawn, when the indicating symbol of a frame shape is drawn, the user firstly clicks a certain position of the picture to determine the upper left corner position of the frame shape mark, then the mouse is dragged to determine the lower right corner of the frame shape mark, and finally a rectangular frame, a circular frame or an elliptical frame and the like are drawn on the marking picture layer of the local client end according to the determined coordinates of the upper left corner and the lower, simultaneously, coordinates of the upper left corner and the lower right corner of the box-shaped mark are sent to a server, the server forwards the coordinates to other clients for same drawing, the color, the transparency, the size, the position, the rotating direction and the like of the indicative symbol can be adjusted and set, a user right clicks on the indicative symbol needing to be set, color parameters such as the color, the transparency and the like of the indicative symbol can be selected and set according to a popped menu, the color parameters can be displayed in a local client after the setting is finished, the color, the transparency and the like can be uploaded to the server, the server forwards the same setting to other clients, the user can drag and zoom the position of the indicative symbol by using a mouse by left clicking on the indicative symbol, the local client can redraw the indicative symbol according to the position and the length and width data of the point of the dragged and zoomed indicative symbol, and the local client can send the dragged and zoomed data to the server, the indication symbol is forwarded to other user terminals by the server, and the operated indication symbol is redrawn at the other user terminals.

3. Inputting characters in a display picture for marking explanation, clicking the position of the local user side display picture needing to input the character marking by a mouse, drawing a character input box on a marking layer by the local user side, displaying the character marking box on the marking layer after inputting the characters, sending the position information and the character content of the character marking to a server by the local user side, transmitting the position information and the character content to other user sides by the server, and displaying the character marking box on the other user sides in the same way. The characters can be English, Chinese or other characters, the fonts, the colors, the sizes, the positions, the rotation angles and the like of the characters can be set, the character marking frame is clicked on the right side of the user side, different setting options such as the fonts, the colors, the sizes, the positions, the rotation angles and the like are selected to be set, the local user side can redisplay the character marking frame in the marking layer according to set information, the information such as the fonts, the colors, the sizes, the positions, the rotation angles and the like is sent to the server, the server forwards the information to other user sides, and the same display is carried out on the character marking on other user sides.

4. The method can display two-dimensional animation in a display picture, when the animation is displayed, firstly, a link of the two-dimensional animation (a remote UR L animation link or a local animation file link) is clicked in a local user side, then, a playing plug-in such as flash is used for displaying and playing the two-dimensional animation in a label layer, meanwhile, the local user side can send the animation link and the position where the animation picture is displayed to a server, the server forwards the animation link and the position where the animation picture is displayed to other user sides, after the other user sides receive the animation link and the position information where the animation is displayed, the other user sides play the transmitted animation link on the transmitted position information by using the playing plug-in such as flash, the animation picture is also displayed in the label layer, the content, the size, the position, the direction, the playing progress and the like of the animation can be set, the local user side can synchronize the set information to the other user sides through.

④ two-dimensional operation mode, controlling the position, size, color, transparency and rotation direction of some pictures in the two-dimensional teaching materials, the local user will firstly display the position, size, color, transparency and rotation direction of the pictures, the control information will be sent to the server by the local user end and transmitted to other user ends by the server, the other user ends will update the display of the pictures according to the control information to realize the synchronization of the courseware display of all user ends, the position, size, color, transparency and rotation direction of the video window in the video voice call are controlled to control the animation play in the two-dimensional teaching materials, the control information will be sent to the server by the local user end and transmitted to other user ends by the server, the other user ends will update the display of the images in the video voice call and trigger the animation play of the teaching materials according to the control information to realize the display synchronization of all user ends.

⑤ three-dimensional operation mode, which is the operation of the model after the client loads the 3D model, 1. moving the mouse to the model for dragging, the left and right dragging of the mouse changing the angle of rotation of the model, the up and down dragging of the mouse changing the angle of rotation of the model, the local client sending the angle of rotation of the operated model to the server during the mouse dragging, forwarding to the other clients by the server, the other clients setting the angle of rotation of the received model to the attributes of the angle of rotation of the model, and achieving the synchronous rotation of the other end models, 2. the disassembled model (i.e. the structure that is mainly used for demonstrating the student) is a composite model composed of multiple sub-models, the disassembling process is performed by clicking one of the detachable sub-models selected by the local client, the disassembling process is repeated, and the disassembling of the detachable model is performed when the detachable model is actually moved to the sub-models, so the process is the process of transmitting the moving sub-3D model to the server, the disassembling process is performed by the local client sending the local client-triggered by the local client moving of the local client to the server, the server triggers the disassembling process of the disassembling of the three-dimensional model, the special-effect of the playing model is performed by the local client.

⑥ video and voice control mode, 1, controlling whether the user side receives voice signals, 2, controlling whether the user side receives video signals, 3, controlling whether the user side sends voice signals, 4, controlling whether the user side sends video signals, the video and voice control mode is controlled by the teacher side, when the teacher side sets the video and voice control mode signals of one or more student sides, the teacher side sends the set information to the server, when the server sends the control mode signals to the set one or more student sides, and after receiving the control mode signals, the student side controls the 4 modes of video and voice control according to the mode signals.

⑦ teacher control commands including ②③④⑤⑥ control commands.

⑧ student side control commands including ②③④⑤⑥.

⑨ the three-dimensional model teaching material is a 3D model that is built by 3dmax, Maya, SketchUp, etc. and contains texture maps, material, brightness attributes and animation, and the three-dimensional model is compressed and then stored in a server, and each user end downloads the 3D model from the server and loads the 3D model as required in practice.

⑩ the two-dimensional teaching materials include pictures, pdf, ppt, video, flash animation, etc., and the two-dimensional teaching materials are compressed and then stored in the server, and in practice, each user end downloads the two-dimensional teaching materials from the server and loads the required two-dimensional teaching materials.

EXAMPLE III

As shown in fig. 2, another aspect of the present invention provides a two-dimensional and three-dimensional combined remote teaching system control method, where the teaching system includes a teacher end and a student end, where a remote server is connected to the remote server; the remote server is used for forming a virtual space according to the teacher end and the student end which are connected to the server and pushing the same three-dimensional and two-dimensional teaching material information to the teacher end and the student end which are connected to the same virtual space; the virtual space is a collection formed by a group of users connected to the server; the control method comprises the following steps:

s1, the teacher end and the student end are connected with the virtual space, the transmitting end records real-time video stream and voice stream, receives the video stream and the voice stream of other teacher ends or student ends forwarded by the server, displays the video stream according to the received video stream, and plays the video stream according to the received voice stream;

s2, the student terminal and the teacher terminal download the two-dimensional and three-dimensional teaching materials of the class from the remote server according to the virtual space ID number, and load the downloaded two-dimensional and three-dimensional teaching materials on a display interface;

s3, the teacher end or the student end receives the operation of the user on the two-dimensional and three-dimensional teaching materials, generates teaching material operation information and sends the teaching material operation information to the remote server;

and S4, the server synchronously forwards the teaching material operation information to other teacher terminals or student terminals belonging to the same virtual space, and the other teacher terminals or student terminals synchronously display the teaching material operation information according to the received teaching material operation information.

The step S3 and the step S4 receive the operation information of the user on the three-dimensional and two-dimensional teaching materials, generate the display content of the local terminal, and simultaneously generate various corresponding operation modes (label mode, two-dimensional operation mode, three-dimensional operation mode, video and voice control mode) of the display content through the synchronous analysis of the server sending the operation information to the remote student terminal or the teacher, referring to the operation of each mode in the second embodiment.

The method combines the traditional two-dimensional teaching materials (such as pictures, pdf, ppt, videos, flash animations and the like) and the virtual three-dimensional model to manufacture the teaching materials, and can overcome the defects of a teaching system of the three-dimensional model for teaching and demonstrating by using real three-dimensional real objects and a teaching system completely using a virtual three-dimensional scene and the three-dimensional model. The demonstration device has the advantages of good demonstration effect, small storage space of the teaching materials, convenience in storage and transmission, simple system design, simplicity in operation, compatibility with all the advantages of the traditional two-dimensional teaching materials, no limitation of sites, light, scene space and the like, and capability of realizing remote and local demonstration.

In the present invention, the terms "first", "second", and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. The term "plurality" means two or more unless expressly limited otherwise.

The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A two-dimensional and three-dimensional combined remote teaching system is characterized by comprising a remote server, a teacher end and a student end, wherein the teacher end and the student end are connected with the remote server; the remote server is used for forming a virtual space according to the teacher end and the student end which are connected to the server and pushing the same three-dimensional and two-dimensional teaching material information to the teacher end and the student end which are connected to the same virtual space; the virtual space is a collection formed by a group of users connected to the server; the teacher end and the student end are used for sending the local end recorded real-time video stream and the voice stream after entering the virtual space, receiving the video stream and the voice stream of other teacher ends or student ends forwarded by the server, displaying according to the received video stream, and playing according to the received voice stream; the student end and the teacher end are also used for downloading the two-dimensional and three-dimensional teaching materials of the class from the remote server according to the virtual space ID number and loading the downloaded two-dimensional and three-dimensional teaching materials on a display interface; the teacher end or the student end is also used for receiving the operation of the user on the two-dimensional and three-dimensional teaching materials, generating teaching material operation information and sending the teaching material operation information to the remote server; the server is also used for synchronously forwarding the teaching material operation information to other teacher terminals or student terminals belonging to the same virtual space based on the virtual space ID number, and the other teacher terminals or student terminals synchronously display the teaching material operation information according to the received teaching material operation information; the teacher end or the student end is further used for generating a transparent labeling layer covering the display interface on which the two-dimensional teaching materials are displayed, receiving drawing operations and character labeling operations of a user on the transparent labeling layer, and sending the drawing operations and the character labeling operations to the remote server in real time, the remote server sends the drawing operations and the character labeling operations to other teacher ends or student ends, and the other teacher ends or student ends synchronously display the drawing operations and the character labeling operations in real time according to the drawing operations and the character labeling operations;

the drawing operation comprises one or more of drawing a marking line operation, drawing a marking block diagram operation and marking block diagram attribute adjustment operation; when the drawing operation is a drawing and marking line operation, the teacher end or the student end receives a mouse moving track point sequence formed by user operation on the display interface, the mouse moving track points are connected by line segments, a marking line is formed on the transparent marking layer in the teacher end or the student end, the teacher end or the student end sends the mouse moving track point sequence to the remote server, the remote server sends the mouse moving track point sequence to other teacher ends or student ends, and the other teacher ends or the student ends form a marking line on the transparent marking layer by using the mouse moving track point sequence;

when the drawing operation is an operation of drawing a labeling block diagram, the teacher end or the student end receives first click position information and second click position information which are formed by the operation of a user on the display interface, the teacher end or the student end generates a labeling diagram on the transparent labeling diagram layer by taking the first click position information and the second click position information as the upper left corner position and the lower right corner position of the labeling diagram, meanwhile, the teacher end or the student end sends the first click position information and the second click position information to the remote server, the remote server sends the first click position information and the second click position information to the other teacher end or the student end, the other teacher end or the student end forms a labeling block diagram on the transparent labeling layer by using the first click position information and the second click position information as the upper left corner position and the lower right corner position of the labeling block diagram; the labeling block diagrams comprise a rectangular block diagram, a circular block diagram and an oval block diagram;

when the drawing operation is a marked block diagram attribute adjusting operation, the teacher end or the student end receives marked block diagram selection information and attribute setting information which are formed by a user through operation on the display interface, the attributes of the marked block diagram are changed and displayed according to the marked block diagram selection information and the attribute setting information, meanwhile, the marked block diagram selection information and the attribute setting information are sent to the remote server, the remote server sends the marked block diagram selection information and the attribute setting information to other teacher ends or student ends, and the other teacher ends or student ends display the marked block diagram with the modified attributes on the transparent marked layer by using the marked block diagram selection information and the attribute setting information; the attribute setting information comprises color setting information, transparency setting information, size setting information, position setting information and rotation angle setting information;

the teacher end or the student end is further used for generating a transparent labeling layer covering the display interface on which the two-dimensional teaching materials are displayed, receiving two-dimensional animation link selection information and/or animation attribute setting information which are formed by operation of a user on the display interface, playing two-dimensional animations on the transparent labeling layer by using a playing plug-in according to the two-dimensional animation link selection information and/or the animation attribute setting information, sending the two-dimensional animation link selection information and/or the animation attribute setting information and animation picture display position information to the remote server, sending the two-dimensional animation link selection information and/or the animation attribute setting information and the animation picture display position information to other teacher ends or student ends by the remote server, and sending the two-dimensional animation link selection information and/or the animation attribute setting information and the animation picture display position information to other teacher ends or student ends by the other teacher ends or the student ends by using the two-dimensional animation link selection information And displaying the position information on the transparent labeling layer by utilizing a playing plug-in for playing animation.

2. The two-dimensional and three-dimensional combined remote teaching system according to claim 1, wherein said text labeling operation comprises a text input operation, a text attribute setting operation; when the character marking operation is a character input operation, the teacher end or the student end receives position selection information formed by the operation of a user on the display interface, displays a character input frame on the transparent marking layer according to the position selection information, continues to receive character input information of the user, displays a character marking frame on the transparent marking layer according to the character input information, simultaneously sends the position selection information and the character input information to the remote server, sends the position selection information and the character input information to other teacher ends or student ends, and displays the character marking frame on the transparent marking layer by the other teacher ends or the student ends according to the position selection information and the character input information;

when the text labeling operation is a text attribute operation, the teacher end or the student end receives text labeling frame selection information and text labeling frame attribute setting information which are formed by a user through operation on the display interface, the attributes of the text labeling frame are changed and displayed according to the text labeling frame selection information and the text labeling frame attribute setting information, meanwhile, the text labeling frame selection information and the text labeling frame attribute setting information are sent to the remote server, the remote server sends the text labeling frame selection information and the text labeling frame attribute setting information to other teacher ends or the student ends, and the other teacher ends or the student ends display the text labeling frames with modified attributes on the transparent labeling layer by using the text labeling frame selection information and the text labeling frame attribute setting information; the character marking box attribute setting information comprises font setting information, color setting information, character size setting information, position setting information and rotation angle setting information.

3. The two-dimensional and three-dimensional combined remote teaching system according to claim 1, wherein the teacher end or the student end is further configured to receive selection information and attribute setting information of a user on a two-dimensional teaching material for a picture in the two-dimensional teaching material, change an attribute of the picture in the two-dimensional teaching material, and send the selection information and attribute setting information to a remote server, the remote server sends the selection information and attribute setting information to the other teacher end or the student end, and the other teacher end or the student end changes the attribute of the picture in the two-dimensional teaching material according to the selection information and attribute setting information;

4. The two-dimensional and three-dimensional combined remote teaching system according to claim 1, wherein the teacher end or the student end is further configured to receive an operation of a user on a three-dimensional teaching material on a 3D model, change display information of the 3D model in the three-dimensional teaching material according to the operation on the 3D model, and simultaneously send the operation on the 3D model to the remote server, the remote server sends the operation on the 3D model to the other teacher end or the student end, and the other teacher end or the student end generates and displays updated display information of the 3D model according to the operation on the 3D model.

5. The two-dimensional and three-dimensional combined remote teaching system according to claim 4, wherein said operation on 3D model comprises multi-angle rotation model operation, model disassembling operation, three-dimensional model animation playing operation, model particle animation triggering operation, model special effect animation triggering operation, model sound triggering operation, model moving operation, model zooming operation.

6. The two-dimensional and three-dimensional combined remote teaching system according to claim 1, wherein the teacher end is further configured to generate a video and audio control mode signal containing student end selection information, and send the video and audio control mode signal to the remote server, the remote server sends the video and audio control mode signal to a student end corresponding to the student end selection information according to the student end selection information, and the student end user receiving the video and audio control mode signal controls a video and audio mode of the student end according to the video and audio control mode signal, and the video and audio mode includes: a voice signal receiving mode, a video signal receiving mode, a voice signal transmitting mode and a video signal transmitting mode.

7. A two-dimensional and three-dimensional combined remote teaching system control method is characterized in that a teaching system comprises a remote server, a teacher end and a student end, wherein the teacher end and the student end are connected with the remote server; the remote server is used for forming a virtual space according to the teacher end and the student end which are connected to the server and pushing the same three-dimensional and two-dimensional teaching material information to the teacher end and the student end which are connected to the same virtual space; the virtual space is a collection formed by a group of users connected to the server; the control method comprises the following steps:

the server synchronously forwards the teaching material operation information to other teacher ends or student ends belonging to the same virtual space based on the virtual space ID number, and the other teacher ends or student ends synchronously display the teaching material operation information according to the received teaching material operation information; wherein the content of the first and second substances,

the teacher end or the student end generates a transparent labeling layer covering the display interface on which the two-dimensional teaching materials are displayed, receives drawing operations and character labeling operations of a user on the transparent labeling layer, sends the drawing operations and the character labeling operations to the remote server in real time, the remote server sends the drawing operations and the character labeling operations to other teacher ends or student ends, and the other teacher ends or student ends synchronously display the drawing operations and the character labeling operations in real time;

the teacher end or the student end receives two-dimensional animation link selection information and/or animation attribute setting information which are formed by the operation of the user on the display interface, playing the two-dimensional animation on the transparent labeling layer by using a playing plug-in according to the two-dimensional animation link selection information and/or animation attribute setting information, simultaneously transmitting the two-dimensional animation link selection information and/or animation attribute setting information and animation picture display position information to the remote server, the remote server transmits the two-dimensional animation link selection information and/or animation attribute setting information and animation picture display position information to the other teacher's terminal or student's terminal, and the other teacher end or the student end utilizes the two-dimensional animation link selection information and/or the animation attribute setting information and the animation picture display position information to play the animation on the transparent labeling layer by utilizing a playing plug-in.