TWI457871B - Interactive teaching device, method and supporting system thereof - Google Patents

Description

Interactive teaching device, method and bracket system thereof

The present invention relates to interactive teaching, and in particular to interactive teaching using a hybrid reality.

In traditional teaching, students passively learn the knowledge imparted by teachers, so there is a lack of interaction between teachers and students. Teachers can't get the feedback from students in the classroom and understand the learning benefits. In addition, the acquisition of knowledge in traditional teaching is limited. Books and blackboards make it difficult for students to combine knowledge with actual situations, so teaching effects and learning effects are limited.

With the development of digital technology, interactive teaching combined with multimedia and other technologies has gradually been proposed, such as electronic whiteboards. Although the electronic whiteboard can increase the interaction between the teacher and the student by combining the touch screen, the tablet, the question answering device, etc., the electronic whiteboard can only present the information in a plane, and cannot effectively operate the learning environment close to the real environment, so the student cannot Effectively combine knowledge with reality and apply it in real life.

In order to create a learning environment close to the real environment, you can use the technology of Mixed Reality to enable students to learn in a learning environment that is closer to the real situation. However, mixed reality usually only contains virtual characters and lacks more real interaction. In addition, the technology to achieve mixed reality can cost a lot of money in each classroom and it is difficult to spread to schools.

In view of this, the present invention provides an interactive teaching device that combines a mixed-reality learning environment and a physical robot to improve the student's presence by real interaction with the physical robot in a learning environment close to the real environment. Students can learn knowledge more effectively and apply it to real life.

An embodiment of the present invention provides an interactive teaching apparatus, including: a vertical screen to present a background or/and learning information of a learning environment; a horizontal screen to present a landscape of the learning environment; and a first projector to project an image To the horizontal screen; a second projector that projects an image to the vertical screen; a network camera that captures the horizontal screen; a bracket system that supports the first projector and the web camera; a robot placed on the horizontal screen; and a teaching computer system coupled to the first projector and the second projector, comprising: a positioning module, wherein the interactive robot is positioned on the horizontal screen through the network camera a coordinate system; an interactive scene module coupled to the positioning module, determining an event of the learning environment corresponding to the coordinate according to the coordinate of the interactive robot on the horizontal screen, and according to the event and the coordinate Decide on the action of the interactive robot.

An embodiment of the present invention provides an interactive teaching method, including: projecting a background of a learning environment or/and learning information to a vertical screen; projecting a landscape of the learning environment to a horizontal screen; and placing an interactive robot at the level On the screen; positioning a coordinate of the interactive robot on the horizontal screen through a web camera; determining an event of the learning environment corresponding to the coordinate according to the coordinate; and determining the interactive robot according to the event or/and the coordinate Actions.

Another embodiment of the present invention provides a stand system for an interactive teaching device, comprising: a stand support comprising: a ground support portion; and a vertical support portion coupled to the ground support portion in a foldable manner, comprising: a ground end connected to the ground support portion; and a remote end; a projector bracket detachably coupled to the remote end of the vertical support portion of the stand support; and a camera mount comprising: a first portion is operably coupled to the remote end; and a second portion is coupled to the first portion.

Another embodiment of the present invention provides an interactive teaching apparatus, including: a standing support, comprising: a ground support portion; a vertical support portion, comprising: a near ground end connected to the ground support portion; and a a remote end; and a projector mount detachably coupled to the remote end of the vertical support portion of the standoff; and a camera mount including: a first portion removably coupled to the remote And a second portion connected to the first portion; a vertical screen for presenting a background or/and learning information of the learning environment; a horizontal screen for presenting the landscape of the learning environment; and a first projector Fixed to the projector bracket to project images to the horizontal screen; a second projector to project images to the vertical screen; and a network camera connected to the second portion of the camera bracket, the shooting range is The horizontal screen; an interactive robot placed on the horizontal screen; and a teaching computer system coupled to the first projector and the second projector, comprising: a positioning module a group, the coordinates of the interactive robot on the horizontal screen are positioned by the web camera; an interactive scene module is coupled to the positioning module, and the coordinates of the interactive robot on the horizontal screen are determined The coordinate corresponds to the event of the learning environment, and the action of the interactive robot is determined according to the event and the coordinate.

The following description is an embodiment of the present invention. The intent is to exemplify the general principles of the invention and should not be construed as limiting the scope of the invention, which is defined by the scope of the claims.

1 is an interactive teaching apparatus 10 according to an embodiment of the present invention, including a vertical screen 101, a horizontal screen 102, a first projector 103, a second projector 104, a network camera 105, and an interactive robot 106. The computer system 107 and the support system 108 are taught.

The vertical screen 101 can be a vertical rising projection screen, and the second projector 104 is projected onto the vertical screen 101 to present a background of the learning environment. Learning information, teaching materials, movies, and feedback responses in the learning activity can also be presented on the vertical screen 101. on.

The first projector 103 projects onto the horizontal screen 102 to present a landscape of the learning environment. The vertical screen 101, which presents the background of the learning environment, and the horizontal screen 102, which presents the landscape of the learning environment, can create a three-dimensional scene effect. The range of motion of the interactive robot 106 is the horizontal screen 102. The virtual scene (learning environment) is combined with the interactive robot 106 on the horizontal screen 102 using the hybrid reality technology to cause the interactive robot 106 to be active in the virtual scene (learning environment) and presented with the vertical screen 101 and the horizontal screen 102. The learning environment interacts. In an embodiment, the interactive robot can be implemented by a LEGO MINDSTORMS NXT . The virtual scene presented by the learner through the vertical screen 101 and the horizontal screen 102 can be combined with the real-world interactive robot 106 to interact with the virtual scene (learning environment) in addition to the real interaction with the interactive robot 106, as in the real environment. It not only interacts with other people but also interacts with the surrounding environment, thus improving the sense of presence of learners. In one embodiment, the horizontal screen 102 is a collapsible retractable projection panel for convenient storage.

The cradle system 108 is used to support the webcam 105 and the first projector 103 to establish an entire interactive teaching device without affecting the range of student activity and the range of line of sight.

As shown in FIG. 2, the teaching computer system 107 includes a positioning module 201, an interactive scene module 202, and a voice recognition module 203.

The positioning module 201 uses the positioning system program to understand the coordinate position of the interactive robot 106 on the horizontal screen 102 by using the network camera 105. For example, the interactive robot 106 has an infrared emitter, and the positioning module 201 utilizes a webcam. 105 receives the infrared signal emitted by the interactive robot 106 and calculates coordinates and action paths of the interactive robot 106 according to the positioning system program.

The interactive scene module 202 is coupled to the positioning module 201. The interactive scene module 202 obtains the coordinates of the interactive robot 106 on the horizontal screen 102 from the positioning module 201, and determines an event corresponding to the coordinate according to the coordinate. For example, playing a picture, sound, animation, changing the teaching environment, presenting teaching information, etc., and then presenting the event on the horizontal screen 102 or the vertical screen 101 through the first projector 103 or the second projector 104 connected to the teaching computer system 107. The interactive scene module 202 can also determine the action of the interactive robot 106 based on the coordinates, and then control the action of the interactive robot 106 through a wireless device between the teaching computer system 107 and the interactive robot 106, such as a Bluetooth device, for example. Play voice or walk around. The interactive scene module 202 can also receive commands through the voice recognition module 203 and determine events in the learning environment and actions of the interactive robot 106 based on the commands. The voice control module 203 can receive commands through the microphone, and the learner can control the interactive robot 106 to walk on the horizontal screen 102 by transmitting instructions to interact with the interactive robot 106 and the learning environment and complete the learning task.

FIG. 3 is a flow chart 30 of an interactive teaching method in accordance with an embodiment of the present invention.

First, steps S301 to S303 are performed in advance. In step S301, the background or/and learning information of the learning environment is projected to the vertical screen 101 by the second projector 104. In step S302, the landscape of the learning environment is projected to the horizontal screen 102 by the first projector 103. In step S303, the interactive robot 106 is placed on the horizontal screen 102.

At the start of the learning activity, step S304 determines whether there is a voice recognition reception command, and if so, proceeds to step S308 and determines the corresponding event or/and the action of the interactive robot 106 based on the received command. If the command is not received through the voice recognition, steps S305 to S307 determine the corresponding event or/and the action of the interactive robot 106 based on the coordinates of the interactive robot 106, and then execute the determined event and the interactive robot 106 in step S309. action.

In step S305, the coordinates of the interactive robot 106 on the horizontal screen can be located through the webcam 105. For example, the interactive robot 106 has an infrared emitter, and the webcam 105 receives the interactive robot 106. The infrared signal is used to calculate the coordinates of the interactive robot 106, the action path, and the like according to the positioning system program. Then, in step S306, the event of the learning environment corresponding to the coordinate may be determined according to the coordinate obtained in step S305, and the corresponding event is determined according to the event obtained in step S306 or/and the coordinate obtained in step S305 in step S307. The action of the interactive robot 106. For example, when the interactive robot 106 goes to a certain position on the horizontal screen 102, the corresponding picture, movie, etc. will be played on the vertical screen 101, and while the picture, the movie, etc. are played, the interactive robot 106 will also be based on the Play pictures, videos, etc. to make corresponding actions, such as talking or walking.

If the user's command is received through voice recognition, step S308 determines the corresponding event or/and the action of the interactive robot 106 based on the command received in the step.

Finally, step S309 performs the events determined in steps S305 to S308 and the actions of the interactive robot 106. For example, when the interactive robot 106 walks to a certain point on the horizontal screen 102, the vertical screen 101 presents a question to the learner to answer, the learner can answer the answer, and then according to the learner's answer, the vertical screen 101 The solution or instructional video may be presented, or the interactive robot 106 may proceed to the location specified in the learner's response based on the learner's response. The actions of steps S304 to S309 are repeated in the learning activity until the learning activity is terminated.

In another embodiment, the corresponding event or/and the action of the interactive robot 106 may also be determined by the voice recognition of the received command and the coordinates of the interactive robot 106 on the horizontal screen 102.

The following is an example of teaching English in the "introduction" and "color" using the interactive teaching device and method of the present invention. In this embodiment, the learning environment is a room, and four different color boxes are placed on the floor of the room, which are pink, purple, brown, and gray. Thus, the second projector 104 projects the background of the room to the vertical screen 101, while the first projector 103 projects the floor of the room and the box on the floor to the horizontal screen 102 to create a stereoscopic learning environment similar to the real room.

At the beginning of the learning activity, a small introduction video is introduced on the vertical screen 101 to introduce the background story to the students, the learning tasks to be carried out in the learning activities, the vocabulary to be used in the activities, and the student's teaching partner, the interactive robot 106. The students were then divided into two groups, one for the Tibetan monkey group and the other for the monkey group. First, the Tibetan monkey group should hide the eight virtual monkeys in any box (in), side (beside) or behind (behind). The students of the Tibetan monkey group should say the instructions of the Tibetan monkey in English, for example, "Two monkeys". Are in the purple box", then the vertical screen 101 will show the animation of two monkeys hiding in the purple box, so the students will actually practice speaking and applying the prepositions and colors.

When the Tibetan monkey group hid the monkey, the task of finding the monkey group was to find the monkey. The student looking for the monkey group will give instructions to the interactive robot 106, such as "go to the brown box", and then the interactive robot 106 will go to the position of the brown box on the horizontal screen 102. When the robot walks to the position of the brown box on the horizontal screen 102, the vertical position of the brown box is displayed on the vertical screen 101: inside (in), side (beside) and back (behind), when looking for the monkey group of students When it is decided that the interactive robot 106 looks for one of the orientations, the vertical screen 101 displays an animation corresponding to the orientation of the box, for example, when the student says "behind the brown box" and the monkey behind the brown box does have a vertical An animation of the monkey jumping out of the back of the brown box is displayed on the screen 101. The interactive robot 106 can interact with the student during the period of hiding the monkey and finding the monkey, such as reminding the student that the time is not enough.

In summary, the present invention creates a mixed reality learning environment by the scene created by the vertical screen 101 and the horizontal screen 102 in conjunction with the learning environment event, and interacts and interacts with the interactive robot 106 between the student and the entity. The interaction between the robot 106 and the events of the learning environment and the interaction between the student and the events of the learning environment achieve the effect of contextual interactive teaching, so that the student has the opportunity to actually experience the knowledge and apply the knowledge.

Figure 4 shows a stand system 108 of an interactive teaching device in accordance with an embodiment of the present invention. The stand system includes three components: a stand stand 430, a camera stand 440, and a projector stand 450.

The stand 430 includes a ground support portion 410 and a vertical support portion 420. The vertical support portion 420 includes a proximal end and a distal end, and the ground support portion 410 includes a crossbar 401 and tripods 402 and 403 that are foldably coupled to the crossbar 401. The proximal end of the vertical support portion 420 is foldably connected to the crossbar 401 of the ground support portion 410. Since the proximal end of the vertical support portion 420 is foldably connected to the crossbar 401 of the ground support portion 410 and the legs 402 and 403 are foldably connected to the crossbar 401, the stand can be used when not in use. Fold and fold up, as shown in Figure 5.

The camera mount 440 includes a first portion 404 and a second portion 405, the first portion 404 and the second portion 405 being angled. The camera mount 440 is adjustably coupled to the distal end of the vertical support portion 420 of the standoff bracket 430 so that the camera mount 440 can be height adjusted relative to the standoff bracket 430.

The projector stand 450 is detachably coupled to the distal end of the vertical support portion 420 of the stand 430, so that the projector stand 450 can be detached from the stand 430 during storage.

Figure 5 is a partial side elevational view of an interactive teaching apparatus in accordance with an embodiment of the present invention. As shown in Fig. 5, the bracket system 108 is disposed on a table, and the bracket system 108 is locked to the table edge by hooks and fixing clips, etc., by a lifting ring 406 behind the vertical supporting portion 420 as shown in Fig. 6. In order to prevent the bracket system 108 from leaning forward due to the weight of the first projector 103. The vertical screen 101 is disposed on the legs 402, 403 of the rack system 108. One end of the horizontal screen 102 is disposed on the legs 402, 403 of the bracket system 108, and the other end is disposed on the table. The four corners of the back of the horizontal screen 102 are provided with an adjustable height stand to enable the horizontal screen 102 to be leveled.

FIG. 6 is a schematic view showing the camera holder 440 and the projector holder 450 of the bracket system 108 in FIG. 4 being detached from the standing bracket 430, and the standing bracket 430 is folded and folded, so that the interaction of the present invention The bracket system of the teaching device is easy to carry and does not occupy space in the classroom.

The interactive teaching apparatus shown in Fig. 1 can be easily constructed by the bracket system of the interactive teaching apparatus shown in Fig. 4. The vertical screen 101 is hung on the vertical support portion 420 of the stand 430, the first projector 103 is connected to the projector stand 450 to project an image to the horizontal screen 102, and the network camera 105 is connected to the second portion 405 of the camera stand 440. The end is used to detect the position of the interactive robot 106 on the horizontal screen 102, and the table under the horizontal screen 102, the bracket system 108 and the vertical screen 101 can use the original table in the classroom. Similarly, the second projector 104 can also be placed. On the original table in the classroom. Since the bracket system 108 is convenient for storage, and the vertical screen is a retractable standing raised projection screen and the horizontal screen 102 is a foldable projection board, the interactive teaching can be quickly and conveniently stored after the interactive teaching. In order to restore the original state of the classroom, and does not cost a lot of money.

While the invention has been described above in terms of a preferred embodiment, it is not intended to limit the invention, and the invention may be modified and substituted without departing from the spirit and scope of the invention. The scope of the invention should be determined by the scope of the appended claims.

10. . . Interactive teaching device

101. . . Vertical screen

102. . . Horizontal screen

103. . . First projector

104. . . Second projector

105. . . Webcam

106. . . Interactive robot

107. . . Teaching computer system

108. . . Bracket system

201. . . Positioning module

202. . . Interactive scene module

203. . . Speech recognition module

30. . . Interactive teaching method

S301-S311. . . step

401. . . Crossbar

402, 403. . . Tripod

404. . . first part

405. . . Second part

406. . . Ring

410. . . Ground support

420. . . Vertical support

430. . . Site support

440. . . Camera stand

450. . . Projector bracket

1 is an interactive teaching apparatus according to an embodiment of the present invention;

2 is a teaching computer system in accordance with an embodiment of the present invention;

3 is a flow chart showing an interactive teaching method according to an embodiment of the present invention;

4 is a schematic view showing a bracket system of an interactive teaching apparatus according to an embodiment of the present invention;

Figure 5 is a partial side elevational view of an interactive teaching apparatus in accordance with an embodiment of the present invention;

Fig. 6 is a schematic view showing the folding of the bracket system of the interactive teaching apparatus of Fig. 4.

10. . . Interactive teaching device

101. . . Vertical screen

102. . . Horizontal screen

103. . . First projector

104. . . Second projector

105. . . Webcam

106. . . Interactive robot

107. . . Teaching computer system

108. . . Bracket system

Claims (20)

An interactive teaching device comprising: a vertical screen for presenting a background or/and learning information of a learning environment; a horizontal screen for presenting a landscape of the learning environment; and a first projector for projecting images to the horizontal screen; a second projector that projects an image to the vertical screen; a network camera that captures the horizontal screen; a bracket system that supports the first projector and the web camera; and an interactive robot placed at the level On the screen; and a teaching computer system, connected to the first projector and the second projector, comprising: a positioning module, the coordinates of the interactive robot on the horizontal screen are located through the network camera; The scene module is coupled to the positioning module, and determines an event of the learning environment corresponding to the coordinate according to the coordinate of the interactive robot on the horizontal screen, and determines the interactive robot according to the event and the coordinate action. The interactive teaching device of claim 1, further comprising a wireless device, wherein the interactive scene module controls the action of the interactive robot through the wireless device. The interactive teaching device of claim 2, wherein the event comprises playing a picture, a sound, an animation, the background of the learning environment and the scenery and the learning information. An interactive teaching device as described in claim 3, The interactive scene module projects the event to the horizontal screen or/and the vertical screen through the first projector or/and the second projector. The interactive teaching device of claim 4, wherein the teaching computer system further comprises a voice recognition module, wherein the interactive scene module receives an instruction through the voice recognition module, and determines the Learning the events of the environment or/and the actions of the interactive robot. The interactive teaching device of claim 1, wherein the positioning module positions the coordinates of the interactive robot on the horizontal screen through infrared rays. An interactive teaching method comprising: projecting a background of a learning environment or/and learning information to a vertical screen; projecting a landscape of the learning environment to a horizontal screen; placing an interactive robot on the horizontal screen; The road camera locates the coordinate of the interactive robot on the horizontal screen; determines an event of the learning environment corresponding to the coordinate according to the coordinate; and determines an action of the interactive robot according to the event or/and the coordinate. The interactive teaching method of claim 7, wherein the event comprises playing a picture, a sound, an animation, the background of the learning environment and the scenery and the learning information. The interactive teaching method as described in claim 8 further includes: projecting the event to the horizontal screen or/and the vertical screen. For example, the interactive teaching method described in claim 9 The method further includes: receiving an instruction through a speech recognition module; and determining an event of the learning environment or/and an action of the interactive robot according to the instruction. The interactive teaching device of claim 1, wherein the bracket system comprises: a stand support comprising: a ground support portion; a vertical support portion coupled to the ground support portion in a foldable manner The method includes: a near ground end connected to the ground support portion; and a remote end; a projector bracket detachably connected to the remote end portion of the vertical support portion of the standing support; and a camera bracket The method includes: a first portion coupled to the remote end in an adjustable manner; and a second portion coupled to the first portion. The interactive teaching device of claim 11, wherein the ground support portion comprises: a horizontal portion coupled to the vertical support portion in a foldable manner; and at least two stand members, respectively The horizontal portion is coupled in a foldable manner. The interactive teaching device of claim 11, wherein the camera holder moves vertically relative to the vertical support portion of the standing frame. The interactive teaching apparatus of claim 12, wherein the stand is retracted by folding a portion that is foldably coupled. An interactive teaching device comprising: a standing support comprising: a ground support portion; a vertical support portion comprising: a near ground end connected to the ground support portion; and a remote end; and a projector a bracket detachably coupled to the distal end of the vertical support portion of the standing bracket; and a camera mount comprising: a first portion removably coupled to the remote end; and a second portion a first screen connected to the first part; a vertical screen showing the background of the learning environment or/and learning information; a horizontal screen showing the landscape of the learning environment; a first projector fixed to the projector bracket Projecting an image to the horizontal screen; a second projector projecting an image to the vertical screen; and a network camera connected to the second portion of the camera holder, the shooting range being the horizontal screen; an interactive a robot placed on the horizontal screen; and a teaching computer system coupled to the first projector and the second projector, comprising: a positioning module through the network camera Positioning the coordinates of the interactive robot on the horizontal screen; An interactive scene module is coupled to the positioning module, and determines an event of the learning environment corresponding to the coordinate according to the coordinate of the interactive robot on the horizontal screen, and determines the interaction according to the event and the coordinate The action of the robot. The interactive teaching device of claim 15, wherein the interactive scene module controls the action of the interactive robot through a wireless device. The interactive teaching apparatus of claim 16, wherein the event comprises playing a picture, a sound, an animation, the background of the learning environment and the scenery, and the learning information. The interactive teaching device of claim 17, wherein the interactive view module projects the event to the horizontal screen or/and the vertical through the first projector or/and the second projector Screen. The interactive teaching device of claim 18, wherein the interactive scene module further receives an instruction through a speech recognition module, and determines an event of the learning environment or/and the interactive robot according to the instruction. The action. The interactive teaching device of claim 15, wherein the positioning module positions the coordinates of the interactive robot on the horizontal screen through infrared rays.