TW201742036A - Interactive teaching systems and methods thereof - Google Patents

Abstract

The present invention provides an interactive teaching system, including a cloud server, a control device, a motion sensor, a system device, and a first display screen. The cloud server stores a plurality of creative materials. The control device downloads the creative materials from the cloud server, generates and outputs a plurality of virtual scenarios scenes corresponding to a virtual scenarios script according to the creative materials via a user interface, and controls a performance schedule of the virtual scenarios scenes. The motion sensor extracts and outputs a plurality of motion images corresponding to at least one user along a first direction. The system device embeds the motion images into the virtual scenarios scenes, and generates a plurality of final virtual scenarios scenes. The first display screen displays the final virtual scenarios scenes.

Description

Interactive teaching system and method

The present invention relates to an interactive teaching system and method, and more particularly to an interactive teaching and method for embedding a performer's image into a virtual reality scene and simultaneously playing it to a performer for viewing.

In traditional teaching, some teachers use the performance of the theater to enable students to integrate into the textbook context to improve the learning efficiency of students. In traditional classroom performance courses in the classroom, it is usually necessary to build different scenes according to the situational script, and then let the students play the role to experience the current situation. However, in the case of limited resources and time, it will not be able to effectively create an appropriate situation, and the performers will not be able to see their performances in real time, and make improvements based on the performance, so that the effect of learning is limited. Therefore, how to present a situational script in a more efficient way to improve the learning effect is currently a problem to be solved.

In order to solve the above problems, the present invention provides an interactive teaching system, including a cloud server, a control device, a sensor, a system device, And a first screen. The cloud server is used to store material data. The control device is configured to download the material from the cloud server, generate and output a plurality of virtual situation scenes corresponding to a virtual scenario script according to the material information through a user interface, and control the evolution degree of the virtual scene scene. The body sensor is configured to capture and output a plurality of motion images corresponding to at least one user in a first direction. The system device is configured to embed the motion image into the virtual context scene and generate a plurality of final virtual scene scenarios. The first screen is connected to the system device and plays the final virtual scene scene in the first direction.

Another embodiment of the present invention provides an interactive teaching method. The method includes: downloading material data from a cloud server through a control device; and generating, by using a user interface of the control device, a virtual scenario script according to the material data. a plurality of virtual situation scenes; the virtual scene scene is output to a system device through the control device; and the plurality of motion images corresponding to the at least one user are captured in a first direction through the integrated sensor; and the motion image is transmitted through the body sensor Outputting to the system device; inserting, by the system device, the action image into the virtual scenario scenario, and generating a plurality of final virtual scenario scenarios; controlling, by the control device, the evolution of the virtual scenario scenario; and transmitting through a first screen The above first direction plays the above-mentioned final virtual situation scene.

100‧‧‧Interactive teaching system

110‧‧‧Cloud Server

120‧‧‧Control device

130‧‧ ‧ body sensor

140‧‧‧System installation

150‧‧‧ first screen

106‧‧‧ second screen

210, 210A, 210B, 210C‧‧‧ positioning device

220‧‧‧ platform

250, 451, 452 ‧ ‧ performers

311‧‧‧Background

312, 322, 451', 452' ‧ ‧ user action images

315‧‧‧General virtual situational scenes

321, 410‧‧‧ background

323, 420‧‧ ‧ foreground objects

325, 400‧‧‧Multilayer virtual scene scene

S501~S507‧‧‧Step procedure

1 is a block diagram showing an interactive teaching system according to an embodiment of the present invention.

2 is a schematic diagram showing an interactive teaching system according to an embodiment of the present invention.

FIG. 3A is a schematic diagram showing a general virtual situation scenario according to an embodiment of the invention.

FIG. 3B is a schematic diagram showing a multi-layer virtual reality scene according to an embodiment of the invention.

4A and 4B are diagrams showing a multi-layer virtual scene scenario according to another embodiment of the present invention.

Figure 5 is a flow chart showing an interactive teaching method according to an embodiment of the present invention.

Other ranges for the systems and methods of the present invention will be apparent from the detailed description provided hereinafter. It is to be understood that the following detailed description, as well as the specific embodiments, are intended to

1 is a block diagram showing an interactive teaching system 100 in accordance with an embodiment of the present invention. The interactive teaching system 100 includes a cloud server 110, a control device 120, an integrated sensor 130, a system device 140, a first screen 150, and a second screen 160. The cloud server 110 can be a network hard disk or a cloud space having a server address, such as a general network hard disk, a Dropbox, a Google Drive, etc., for storing material materials. Among them, the material materials may include sample scripts, backgrounds, foreground objects, sound effects, and lines. The control device 120 can be any portable electronic device, including but not limited to a handheld computer, a tablet computer, a mobile phone, a media player, and a personal digital assistant ( Personal Digital Assistant, PDA) or other The device or the like is configured to download the material from the cloud server 110, generate and output a plurality of virtual situation scenes corresponding to a virtual scenario script according to the material through a user interface, and control the progress of the virtual scene. The sensor 130 can be a network camera composed of an RGB camera, an infrared ray transmitter, and an infrared CMOS camera, such as a Kinect, for capturing the movements of at least one performer and performing face recognition. Wait. The system device 140 can be an electronic device comprising a central processing unit, a memory, a peripheral interface, and a communication module, such as a desktop computer, a notebook computer, etc., for transmitting the communication module and the control device 120. The connection is to download the virtual context, and combine the user's motion image with the virtual context scene, and output the generated plurality of final virtual scene scenes to the display screen or feedback to the control device 120. The first screen 150 is connected to the system device 140, and can be a liquid crystal display screen, a projection screen, etc., and plays the final virtual scene scene in the direction of the performer.

2 is a schematic diagram showing an interactive teaching system 100 in accordance with an embodiment of the present invention. As shown in FIG. 2, the first screen 150 and the system device 140 are mounted on a platform 220, the body sensor 130 is mounted on the first screen 150, and the performer 250 is located on a positioning device 210 and faces the first The direction of a screen 150 allows the sensor 130 to capture the body motion of the performer 250 and perform facial recognition and the like. The positioning device 210 may be formed by an indicator light (such as an LED lamp) and a ground pad, or may be a projection device, and connected to the system device 140 by wire or wirelessly, for displaying the positioning point or transmitting the projection device by using the indicator light. The method of projecting the anchor point as a function of the stage positioning can control the display of the anchor point according to the dialogue content of the virtual situation scene to indicate the performance position of the performer 250. It is worth noting that although the platform 220 is a fixed table in Figure 2, it can also be a movable display flat. The first screen 150 and the system device 140 can be housed therein.

According to an embodiment of the invention, the user can present a theater through the interactive teaching system 100 that can interact with the performer. First, the user first downloads the material from the cloud server 110 to the control device 120. Then, the user can decide to directly apply the sample script in the material data or design the situation script according to the background, foreground object, sound effect, and lines in the material through an editing interface.

The virtual situation scene in the scenario script may include a general virtual situation scene and a multi-layer virtual scene scene. A general virtual situational scene refers to a virtual situational scene composed only of background, sound effects, and lines. For example, as shown in FIG. 3A, the general virtual situation scene 315 is composed of the background 311 and the action image 312 of the performer, and the corresponding virtual scene scene corresponding to the scene is the action image of the performer. 312 is directly superimposed onto the background 311. However, a multi-layer virtual reality scene refers to a virtual situational scene composed of background, foreground objects, sound effects, and lines. For example, as shown in FIG. 3B, the multi-layer virtual reality scene 325 is composed of the background 321, the performer's action image 322, and the foreground object 323, and the corresponding virtual context scene is represented by The performer's motion image 322 will be displayed between the background 321 and the foreground object 323.

In addition, according to another embodiment of the present invention, the system device 140 determines the multi-layer virtual reality scene according to the relative position of the performer captured by the sensor 130 or the position of the performer on the positioning device 210. For example, the depth sensor of the body sensor 130 determines the relative distance between the performer and the body sensor 130 or passes through the sensor corresponding to the different area on the positioning device 210 (eg, the first sensor system is disposed on In the first region 210A of the positioning device 210, the second sensor is disposed in the second region 210B of the positioning device 210, and the third sensor is disposed in the positioning device 210. In the third zone 210C, the position of the performer on the positioning device 210 is determined to determine the layer corresponding to the image of the performer. Wherein, the sensor may be a pressure sensor or an ultrasonic sensor or the like. As shown in FIG. 4A, the performer 451 and the performer 452 stand in the first zone 210A and the third zone 210C of the positioning device 210, respectively. In this embodiment, the multi-layer virtual scene scene system includes four layer screens, and the first area 210A and the third area 210C of the positioning device 210 respectively correspond to the first layer screen and the third layer screen of the multi-layer screen virtual scene scene. And the background 410 and the foreground object 420 respectively correspond to the second layer and the fourth layer of the multi-layer virtual scene scene. After the depth sensor of the sensor 130 or the sensor corresponding to the different area of the sensor 130 confirms the position of the performer 451 and the performer 452, the system device 140 then captures the image of the performer 451 through the sensor 130. 451' and the image 452' of the performer 452, and combine the performer's image 451', the performer's image 452', the background 410, and the foreground object 420 into a multi-layer virtual reality scene 400 as shown in FIG. 4B.

It is worth noting that the various layers of the aforementioned multi-layer virtual scene scenario may include different attributes. For example, the layer can be a picture, an animation, or a transparent or opaque scene. The transparent scene can be a transparent window or the like, so that the viewer can see the display content in the next layer through the transparent window.

After determining the scenario script, the user connects to the control device 120 by wired or wireless means (for example, via a network cable, radio frequency identification, Bluetooth or Wi-Fi, etc.) and transmits the scenario script to the system device 140. .

After receiving the scenario script, the system device 140 opens the pre-installed learning theater application, loads the scenario script, and projects the virtual context scene in the scenario script to the first screen 150. Next, the system device 140 is capable of feeling The device 130 removes the background through the body sensor 130, leaving only the image of the performer, and outputs a series of action images of the performer to the system device 140.

After receiving the motion image of the performer, the system device 140 embeds the motion image into the virtual context scene to generate a final virtual scene scene, and simultaneously plays the final virtual scene scene through the first screen 150, so that the performer can immediately view the scene itself. An image combined with a virtual situational scene. In addition, the system device 140 can further include a second screen 160 for playing a final virtual scene scene toward a viewer in a different space from the performer. The second screen 160 is connected to the control device 120 by wire or wirelessly, and receives the final virtual scene scene from the control device 120 for synchronous playback. The manner in which the first screen 150 and the second screen 160 are separately played through the above will effectively slow down the performance pressure of the performer. In addition, when the final virtual scene scene is played, the system device 140 can perform the synchronous video recording operation and store the video file in the storage device of the system device 140 or the cloud server 110.

According to another embodiment of the present invention, the user can also control the progress of the virtual context scene through the control interface of the learning theater application corresponding to the system device 140 on the control device 120. For example, when the user wants to switch to the next virtual situation scene, the user can switch to a different virtual situation scene through the icon on the control interface.

Figure 5 is a flow chart showing an interactive teaching method according to an embodiment of the present invention. In step S501, the user downloads the material from the cloud server 110 through the control device 120. Among them, the material materials may include sample scripts, backgrounds, foreground objects, sound effects, and lines. In step S502, the user performs a scenario script based on the material information through a user interface on the control device 120. meter. Among them, the script design includes the design of the virtual situation scene, the display of the dialogue, and the playback of the sound effect. In step S503, the user outputs the designed scenario script to the system device 140 through the control device 120. In step S504, the body sensor 130 captures a plurality of motion images corresponding to at least one performer in the direction of the performer, and outputs the motion image to the system device 140. In step S505, the system device 140 embeds the received motion image into the virtual scenario scene of the scenario script, and generates a plurality of final virtual context scenarios. In step S506, the user controls the progress degree of the final virtual scene scene through the control device 120. In step S507, the first screen 150 plays the final virtual scene scene in the direction of the performer.

In summary, the interactive teaching system and method according to the present invention can enable a performer to easily integrate into a situational content in a virtual stage by combining a performer's action image with a virtual situational scene. Improve the performance of the performers. In addition, the user can control the entire exhibition process through the editing interface and control interface of the control device to make the whole interactive theater more smooth.

The features of many embodiments are described above to enable those of ordinary skill in the art to clearly understand the form of the specification. Those having ordinary skill in the art will appreciate that the objectives of the above-described embodiments and/or advantages consistent with the above-described embodiments can be accomplished by designing or modifying other processes and structures based on the present disclosure. It is also to be understood by those skilled in the art that <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt;

100‧‧‧Interactive teaching system

110‧‧‧Cloud Server

120‧‧‧Control device

130‧‧ ‧ body sensor

140‧‧‧System installation

150‧‧‧ first screen

106‧‧‧ second screen

Claims (10)

An interactive teaching system, comprising: a cloud server for storing material data; a control device for downloading the material data from the cloud server, generating and outputting according to the material data through a user interface a plurality of virtual situation scenes of the virtual scenario script, and controlling the evolution degree of the virtual scene scene; the integrated sensor for capturing a plurality of motion images corresponding to the at least one user in a first direction; a system device for The action image is embedded in the virtual scene scene and generates a plurality of final virtual scene scenes; and a first screen is connected to the system device and plays the final virtual scene scene in the first direction. For example, the interactive teaching system described in claim 1 includes the script, the background, the foreground object, the sound effect, and the lines. The interactive teaching system of claim 2, wherein the virtual scenario scenario comprises a multi-layer virtual reality scenario, and the system device generates the multi-layer virtual reality according to the motion image, the background, and the foreground object. a scenario scene, and playing the multi-layer virtual scene scene in the first direction through the first screen. The interactive teaching system of claim 3, further comprising a positioning device for enabling at least one positioning mark according to the virtual situation scenario. The interactive teaching system of claim 4, wherein the system device obtains a position corresponding to the user through the body sensor or the positioning device, and corresponds to the motion image of the user. Embedded in a layer corresponding to one of the above positions. An interactive teaching method includes: downloading material data from a cloud server through a control device; and generating, by the user interface of the control device, a plurality of virtual situation scenes corresponding to a virtual situation script according to the material data; The device outputs the virtual scene scene to a system device; the plurality of motion images corresponding to the at least one user are captured in a first direction through the integrated sensor; and the motion image is output to the system device through the body sensor; The system device embeds the action image into the virtual scenario scenario, and generates a plurality of final virtual scenario scenarios; controlling, by the control device, the evolution degree of the virtual scenario scenario; and playing the final virtual layer in the first direction through a first screen Situational scene. For example, the interactive teaching method described in claim 6 of the patent scope, wherein the material materials include a script, a background, a foreground object, a sound effect, and a line. For example, in the interactive teaching method described in claim 7 of the patent scope, the steps further include: And generating, by the system device, a multi-layer virtual reality scene according to the motion image, the background, and the foreground object; and playing the multi-layer virtual reality scene through the first screen toward the first direction. For example, in the interactive teaching method described in claim 8, the step further includes: enabling at least one positioning mark according to the virtual situation scene by using a positioning device. The interactive teaching method of claim 9, the method further comprising: obtaining, by the system device, a position corresponding to the user by using the body sensor or the positioning device; and transmitting, by using the system device The motion image of the user is embedded in a layer corresponding to the position.