TWI822267B - Immersive ecological house interactive learning system - Google Patents

Abstract

An immersive ecological house interactive learning system is disclosed. The immersive ecological house interactive learning system includes a house body, at least one display module, a guided walker module, a computer system, a question-and answer module and an image recognition module. The at least one display module is used for displaying an ecological environment image screen. The guided walker module is used to provide the user with walking or running at the original position and output a displacement signal. The computer system controls the display modules to synchronously present moving pictures according to the displacement signal. The question and answer module extracts the corresponding voice answer from the computer system according to the user’s voice question, so as to reply to the user. The image recognition module performs an imager recognition program according to the ecological environment image picture touched by the user, and feeds back a recognition result to the computer system to extract a corresponding ecological teaching data and display it on the display modules.

Description

Immersive eco-house interactive learning system

The present invention relates to an interactive learning system, and in particular to an immersive eco-house interactive learning system.

In recent years, research related to the application of virtual reality (VR) technology in education has been a rapidly growing trend. Research results indicate that assisting learning through VR technology has a significant impact on improving learning motivation. Taking advantage of this advantage, it is necessary to explore the use of VR technology to assist learning in learning content design.

Taking VR technology as an example, the immersive experience that its head-mounted screens can bring is a highlight. However, the weight of the head-mounted screen has always been a difficult problem to solve. Therefore, if you are young and have insufficient head and neck support, you need to pay a lot of attention when using it. In terms of interaction, positioning needs to be done first. In terms of user positioning, it is necessary to set up sensing lenses in the virtual reality space to capture the user's position and movements. In terms of hand movement sensing, in order to improve interactivity and more accurate command input response, VR users usually need to wear wired gloves or handheld controllers to input commands to objects in the virtual reality. , such as "execute" and "cancel", or more complex "take" and "twist" actions.

However, wearing the aforementioned head-mounted screen, wired gloves or hand-held controller is not only inconvenient to wear but also limits the learner's mobility. In addition, wearing a head-mounted screen can also cause stuffy heat and pressure on the user's head.

Therefore, how to provide an "immersive eco-house interactive learning system" has become a problem to be solved in the industry.

Embodiments of the present invention provide an immersive eco-house interactive learning system, including a house, at least one display module, a navigation walker module, a computer system, a question and answer module and an image recognition module. At least one display module is used to display an ecological environment image screen. The navigation walker module is used to allow the user to walk or run in the original position and output a displacement signal. The computer system controls the display modules to synchronously display moving images based on the displacement signal. The Q&A module extracts corresponding voice answers from the computer system based on the user's voice questions to reply to the user. The image recognition module performs an image recognition process based on the ecological environment image screen touched by the user, and feeds a recognition result back to the computer system to extract corresponding ecological teaching data and present it on the display modules .

In some embodiments, an image recognition self-propelled robot is also included, which is installed at the remote end and connected to the computer system to present the captured images on the display modules.

In some embodiments, the house also includes a dome structure and a polygonal wall. The dome structure and/or the polygonal wall are connected to the dome structure for setting the display modules.

In some embodiments, the dome structure has a semicircular shape and the polygonal wall has a hexagonal shape.

In some embodiments, the polygonal wall is also provided with a projection module for projecting ecological environment images.

In some embodiments, the ecological teaching materials include mammals, birds, reptiles, amphibians, fish and insects.

In some embodiments, the image recognition module includes a type of neural network model.

In some embodiments, the neural network model is a YOLO model, an RCNN model, a CTPN model or an EAST model.

In some embodiments, the navigation walker module is a universal treadmill.

In order to make the present invention more obvious and understandable, the following embodiments are illustrated in conjunction with the accompanying drawings. Details are as follows.

10:House

12:Dome structure

14:Polygonal wall

20:Display module

22:Projection module

30: Navigation walker module

40:Computer system

50: Q&A module

60:Image recognition module

70: Image recognition self-propelled robot

100,110,120: Immersive eco-house interactive learning system

Figure 1 is a system block diagram of an embodiment of the present invention.

Figure 2 is a system block diagram of another embodiment of the present invention.

Figure 3 is a system block diagram of another embodiment of the present invention.

Figure 4 is a schematic diagram of the appearance structure of an embodiment of the present invention.

Figure 5 is a perspective structural diagram of an embodiment of the present invention.

Specific implementations of the present invention will be further described below with reference to the accompanying drawings and examples. The following examples are only used to illustrate the technical solution of the present invention more clearly, but cannot limit the scope of protection of the present invention.

For the sake of clarity and convenience of illustration, the size and proportion of components in the drawings may be exaggerated or reduced. In the following description and/or patent claims, when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present; and when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present; When "directly connected" or "directly coupled" to another element, there are no intervening components present, and other words used to describe the relationship between components or layers should be interpreted in a like manner; "first", "second", etc. Ordinal numbers have no sequential relationship with each other. They are only used to identify two different components with the same name. For ease of understanding, the same components in the following embodiments are labeled with the same symbols.

Please refer to Figure 1, which is a system block diagram of an embodiment of the present invention. As shown in Figure 1, the immersive eco-house interactive learning system 100 includes a house 10, a display module 20, a navigation walking module 30, a computer system 40, a question and answer module 50 and an image recognition module 60.

The house body 10 has an accommodation space. The house 10 can be used to install the display module 20 and guide walking The server module 30, the computer system 40, the question and answer module 50 and the image recognition module 60. In fact, the house 10 can be made of building materials such as wood, cement, Styrofoam and/or cardboard.

The display module 20 is located in the house 10 . The display module 20 is used to display an ecological environment image screen. The display module 20 may, for example, be composed of a liquid crystal display or a touch display. The display module 20 may be composed of one or more liquid crystal displays.

The navigation walking module 30 is located in the house 10 . The navigation walking module 30 is connected with the display module 20 . The navigation walker module 30 is used to allow the user to walk or run in the original position and output a displacement signal. The navigation walker module 30 may be composed of a universal treadmill, for example. For example, users can adjust according to the direction they want to walk, and the adjusted direction can see the lens to be projected. In other words, when the user walks forward, he will see the picture of the camera walking forward projected on the wall in front. If he turns right on the spot and walks forward, he can see another ecological picture. The navigation walker module 30 can allow the user to determine the orientation of the camera lens while walking. In other words, the navigation walker module 30 has a linkage effect with the lens orientation, and can also allow the user to select the content of the image to be viewed. In other words, the navigation walking module 30 also provides mouse-like functions.

The computer system 40 is connected to the navigation walking module 30 . The computer system 40 controls the display module 20 to synchronously present a moving picture corresponding to the ecological environment image picture according to the displacement signal. The computer system 40 has functions such as instruction processing, database, display, wired or wireless network connection, etc.

The question and answer module 50 is connected to the computer system 40 . The question and answer module 50 extracts corresponding voice answers from the computer system 40 according to the user's voice questions to reply to the user. For example, a microphone can be installed in the room 10 to pick up questions asked by users, determine the keywords of the questions, match them with the database of the computer system 40, and reply voice answers to the users.

The image recognition module 60 is connected to the computer system 40 . The image recognition module 60 performs an image recognition process based on the ecological environment image screen touched by the user on the display module 20, and feeds back a recognition result to the computer system 40 to extract the corresponding ecological teaching data and display it. Module 20 submitted now. Ecological teaching materials include mammals, birds, reptiles, amphibians, fish and insects. The image recognition module 60 includes a type of neural network model. The neural network-like model is YOLO model, RCNN model, CTPN model or EAST model.

Please refer to Figure 2, which is a system block diagram of another embodiment of the present invention. As shown in Figure 2, the immersive eco-house interactive learning system 110 includes a house 10, a projection module 22, a navigation walking module 30, a computer system 40, a question and answer module 50 and an image recognition module 60. Since the difference between the embodiment in Figure 2 and the embodiment in Figure 1 lies in the projection module 22, and the other modules are the same as those in Figure 1, they will not be described in detail below.

The projection module 22 is connected to the navigation walking module 30 . The projection module 22 is used to project ecological environment images. The projection module 22 may be composed of a full-color laser projector.

Please refer to Figure 3, which is a system block diagram of another embodiment of the present invention. As shown in Figure 3, the immersive eco-house interactive learning system 120 includes a house 10, a display module 20, a navigation walking module 30, a computer system 40, a question and answer module 50, an image recognition module 60 and an image recognition system. Self-propelled robot 70. Since the difference between the embodiment in Figure 3 and the embodiment in Figure 1 lies in the image recognition self-propelled robot 70, and the other modules are the same as those in Figure 1, they will not be described again. The image recognition self-propelled robot 70 is installed at the remote end and connected to the computer system 40 . The image recognition self-propelled robot 70 is used to present the captured images on the display module 20 .

The image recognition self-propelled robot 70 has components such as a microcomputer system, a network module, a display module, a battery module, a camera module, a flying propeller, and/or a universal wheel. Thereby, the image recognition self-propelled robot 70 can move in the ecological zone, take pictures of ecological environment images, and record ecological environment image data. In some embodiments, there can be multiple image recognition self-propelled robots 70 , and they are respectively set up in multiple ecological environment areas (for example, forest ecosystem, water ecosystem, terrestrial ecosystem, etc.) to capture and record ecological environment images. material.

In some embodiments, the image recognition autonomous robot 70 may be a drone, used to fly in the aerial environment to shoot and record ecological environment image data. In some embodiments, the image recognition autonomous robot 70 may be a submarine, used to photograph and record ecological environment image data underwater. In some embodiments, the image recognition self-propelled robot 70 may be a self-propelled vehicle, used to shoot and record ecological environment image data on land.

Please refer to Figure 4, which is a schematic diagram of the appearance structure of an embodiment of the present invention. As shown in FIG. 4 , the house 10 includes a dome structure 12 and a polygonal wall 14 . The dome structure 12 covers the polygonal wall 14 . The polygonal wall 14 is connected to the dome structure 12 . The dome structure 12 has a semicircular shape, and the polygonal wall 14 has a hexagonal shape, but is not limited to this, and can also be designed into other geometric shapes according to actual needs.

Please refer to Figure 5, which is a perspective structural diagram of an embodiment of the present invention. As shown in FIG. 5 , the user is located on the navigation walking vehicle module 30 in the room 10 . A plurality of display modules 20 are provided on the polygonal wall 14 . More specifically, the polygonal wall 14 is composed of a hexagonal shape. A display module 20 is provided on each wall. This provides users with a 360-degree viewing angle of the surrounding landscape. In some embodiments, a projection module 22 may be provided on the dome structure 12 and the polygonal wall 14 to project ecological environment images throughout the entire area.

For example, the situation of the immersive ecological house interactive learning system 100 is a real picture projected by a camera, so the image recognition self-propelled robot 70 will project the physical picture in the ecological environment. In the process, the image recognition self-propelled robot 70 The real pictures captured will be visible to users.

When the user sees an animal captured by the image recognition autonomous robot 70 and is interested in the animal, the user can stop walking and stand in place to watch. The user can touch the animal on the display module 20. At this time, the image recognition module 60 will determine that the user wants to know more about the animal.

Then, the image recognition self-propelled robot 70 will perform image recognition on the animal, and provide the recognized ecological teaching materials and present them on the display module 20 so that the user can have more and further understanding.

For example, the image recognition self-propelled robot 70 captures that the creature on the road is a blue magpie, and the user wants to know more about the blue magpie. You can click on the blue magpie on the display module 20, and the image recognition self-propelled robot 70 will identify the clicked blue magpie and provide ecological information related to the blue magpie (for example, the gender, age, breeding season, etc. of the blue magpie) ), allowing users to know more about Blue Magpie.

If the user is more interested, he or she can make more inquiries through the question and answer module 50 . Following the above, if the user has more unclear questions about Blue Magpie, the user can use the question and answer module 50 to ask questions using a spoken narrative mechanism. The question and answer module 50 will make judgments based on the questions raised by the user, and then The computer system 40 extracts the corresponding voice answer and replies to the user in voice and/or screen mode.

To sum up, the immersive ecological house interactive learning system of the present invention can provide users with choices based on the ecological environment they want to understand, including forest ecosystem, water ecosystem, and terrestrial ecosystem. Each ecosystem has different ecological courses, which are roughly divided into mammals, birds, reptiles, amphibians, fish, insects, etc. Learners can actually experience and immerse themselves in these ecological courses to understand the current status of the ecological environment, and Through the introduction of the course, we can understand the knowledge and skills required. We hope that through the immersive eco-house interactive learning system, we can enhance learners' emphasis on ecological awareness and implement practical ecological protection in daily life.

According to the immersive eco-house interactive learning system of the present invention, there is no need to wear a head-mounted screen, wired gloves or handheld controllers, which improves the user's mobility and does not cause the problem of stuffy head heat.

Although the present invention has been disclosed above through embodiments, they are not intended to limit the present invention. Anyone with ordinary knowledge in the relevant technical field may make some modifications and modifications without departing from the spirit and scope of the present invention. Therefore, The protection scope of the present invention shall be determined by the appended patent application scope.

10:House

20:Display module

30: Navigation walker module

40:Computer system

50: Q&A module

60:Image recognition module

100: Immersive eco-house interactive learning system

Claims (8)

An immersive ecological house interactive learning system includes: a house including a dome structure and a polygonal wall, the polygonal wall is connected to the dome structure; at least one display module is located in the house to display a Ecological environment image screen, the polygonal wall is used to set the display modules; a navigation walker module is located in the house to allow the user to walk or run in the original position and output a displacement signal; a computer The system controls the display modules to synchronously present moving images corresponding to the ecological environment image according to the displacement signal; a question and answer module extracts corresponding voice answers from the computer system based on the user's voice questions to reply to the user and an image recognition module that performs an image recognition process based on the ecological environment image screen touched by the user on the display modules, and feeds a recognition result back to the computer system to extract the corresponding An ecological teaching material is presented on the display modules. The immersive eco-house interactive learning system as described in claim 1, which also includes an image recognition self-propelled robot, which is installed at the remote end and connected to the computer system to present the captured images on the display models. group on. The immersive eco-house interactive learning system as described in claim 1, wherein the dome structure is in a semicircular shape, and the polygonal wall is in a hexagonal shape. The immersive ecological house interactive learning system as described in claim 1, wherein the dome structure and/or the polygonal wall are further provided with a projection module for projecting the ecological environment image. The immersive ecological house interactive learning system as described in claim 1, wherein the ecological teaching materials include mammals, birds, reptiles, amphibians, fish and insects. The immersive eco-house interactive learning system as described in claim 1, wherein the image recognition module includes a type of neural network model. The immersive eco-house interactive learning system as described in claim 6, wherein the neural network model is a YOLO model, an RCNN model, a CTPN model or an EAST model. The immersive eco-house interactive learning system as described in claim 1, wherein the guide walker module is a universal treadmill.

Images