TWM652006U - XR digital co-learning system - Google Patents

Abstract

An XR digital learning system, including at least: a host and a receiver. The host and the receiver are connected by signals. The host can conduct live broadcasting through a live broadcast platform or a teaching material module in combination with real people. Teaching, and the receiver can receive the live broadcast platform or the teaching material module and browse and learn together; the anchor terminal includes: at least one camera, a first audio and video processing device and a live broadcast platform player; the receiver The broadcast terminal includes: at least one XR device that can watch and browse a live broadcast platform viewer, so that the live broadcast platform viewer can be used to watch and browse the teaching mode on the live broadcast platform player. Accordingly, by combining the real-person teaching mode and XR The device receives the live broadcast for viewing, which can enhance the realism of the lecture.

Description

XR digital learning system

The present invention relates to an XR digital co-learning system, and in particular, an XR digital co-learning system that can use an XR device and watch or browse a live broadcast platform or a teaching material module or a metaverse platform combined with a real person teaching mode.

With the advent of the digital age, the technology used to simulate feelings, perceptions and environments has evolved. An extended reality (XR) device has been launched in the later period, which is an augmented reality (AR), Devices with mixed technologies such as virtual reality (VR) and mixed reality (MR) use XR devices to produce visual core effects, and then use the capabilities of objects, gestures and gaze tracking to combine real-world and Virtual environments and human-computer interaction devices are used to conduct navigation modes or view situation-related information. Therefore, XR devices can be used in many fields, such as environment, marketing, real estate, education and training, and remote work. In addition, wearable VR devices can now be replaced by experimental JavaScript APIs (hereinafter referred to as WebVR), which mainly use web browsers to provide virtual reality effects. In the same way, WebXR also uses web browsers to provide virtual reality, augmented reality, or/and mixed reality effects. In other words, WebXR is a software that can be used to access virtual reality (VR), augmented reality, and/or mixed reality. Devices for augmented reality (AR) and mixed reality (MR).

Moreover, in this post-epidemic era after experiencing a global infectious disease epidemic, in order to reduce the gathering of people and avoid the spread of the virus, digital online operation models such as remote work and remote classes have exploded; online teaching For example, the evolution from the original broadcasting of existing teaching videos to the live broadcast application of online real-time video communication teaching through communication software has made the digital teaching model attract the attention and importance of all walks of life. However, most of the existing online live teaching models are taught through online teaching software, such as ZOOM, Cisco Webex, Microsoft Teams, Google Meet, BigBlueButton and other communication software. However, the above-mentioned online teaching software still lacks offline practical application. Interaction modes that can be carried out in class, such as: group interaction, facial expression interaction, etc. Therefore, even though the online teaching software can live broadcast the lecturer's pictures and presentations, and enable real-time video and audio communication and interaction, students are still susceptible to the effects of class time. The environment (such as bedroom, living room, kitchen, outdoors, etc.) causes students to be unable to concentrate on learning during class; or, when using online teaching software, students can play lectures through laptops and computer screens. However, the immersive experience of having students teach in front of a screen is much different from attending classes with their peers in person, making online teaching still lack a sense of reality.

In view of the various shortcomings derived from the above, how to combine XR devices and provide a digital learning system that allows students to focus on learning and allow students to have an immersive experience has become a developer and developer of related industries such as today's education field. It is a problem that relevant researchers need to continue to work hard to overcome and solve.

The reason is that, in view of this, and with the assistance of its rich professional knowledge and years of practical experience, the creator created an XR digital co-learning system. The purpose is to provide an XR digital co-learning system by combining teaching scenarios , teaching interaction, allowing the receiver to use XR devices to receive live broadcasts and experience a sense of virtual and real integrated interactive learning, allowing students to focus on learning, and allowing students to have an immersive experience, improve learning efficiency, and provide a breakthrough in distance teaching Develop technology.

The secondary purpose of this new model is to provide an XR digital co-learning system that combines real-person teaching mode and XR devices to receive live broadcasts for browsing, thereby improving the realism of teaching.

Another purpose of this model is to provide an XR digital shared learning system that uses scenes, photos or other fields that match the course content, and provides XR devices to watch or browse homemade WebVR teaching materials. After learning the course together, the broadcast Clients can use XR devices to experience course content on their own and learn in depth.

Another purpose of this new model is to provide an XR digital learning system that uses a studio green screen for real-person recording, combines 360 photos or videos, and 3D scene synthesis, and can be used with teaching materials such as presentations, 3D objects, audio-visual materials, etc., through live broadcasts content teaching and XR devices to receive live broadcasts for browsing; in addition, VR interactive teaching materials or self-made immersive interactive teaching materials can also be used. After learning the course together, the broadcaster can use the XR device to experience the course content on its own and perform practical operations. An immersive learning experience with viewing.

Another purpose of the present invention is to provide an XR digital learning system that allows real people to capture sounds and body movements in real time in a studio through Vtuber software and motion capture software, placing them in virtual scenes or real scenes. The created virtual characters are used for teaching, achieving a teaching situation that integrates virtual and real interactions, and an immersive learning experience that enables actual operation and viewing, allowing students to focus on learning and improve learning efficiency.

Another purpose of this new model is to provide an XR digital co-learning system that captures real-life physical teaching scenes through 360 cameras or 3D guides, synchronizes on-site teaching and live teaching, coordinates teaching scenes and teaching interactions, and allows the receiver to use XR devices Receive live broadcasts to experience the sense of interactive learning integrating virtual and real situations, which can enhance the effect of realism in teaching.

The XR digital learning system that can achieve the above-mentioned new purposes at least includes: a host and a receiver. The host and the receiver are connected by signals. The host can communicate through a live broadcast platform or a teaching material. The module combines real people to teach, and the broadcast terminal can receive the live broadcast platform or the teaching material module and browse and learn together; the anchor terminal includes: at least one camera; a first audio and video processing device, electrically connected to the camera , used for audio and video processing of the audio and video information obtained by the camera; and a live broadcast platform player, the signal is connected to the first audio and video processing device, and the first audio and video processing device controls and sets the desired selection of the live broadcast platform player. teaching mode; the broadcast terminal includes: at least one XR device for receiving the control signal of the first audio and video processing device, and the XR device can watch and browse a live broadcast platform viewing terminal, so that the live broadcast platform viewing terminal can Used to watch and browse the teaching mode on the player side of the live broadcast platform.

According to the above-mentioned XR digital learning system, the camera can be a 360-degree panoramic camera.

According to the above-mentioned XR digital learning system, the live broadcast platform can be any one of YouTube live broadcast, Facebook live broadcast, etc live broadcast, Instagram live broadcast, Twitch live broadcast, 17 LIVE live broadcast, and e-commerce platform live broadcast.

According to the above-mentioned XR digital learning system, it further includes: an electronic device, the electronic device is connected to the camera and the live broadcast platform player signal respectively.

According to the above-mentioned XR digital learning system, the electronic device is one of a mobile phone, a tablet, a laptop, and a mobile device.

According to the above-mentioned XR digital learning system, the teaching mode for viewing and browsing on the XR device is to watch a 360-degree panoramic live video.

According to the above-mentioned XR digital learning system, it further includes: at least a second audio and video processing device, and the second audio and video processing device is signal connected with the first audio and video processing device.

According to the above-mentioned XR digital learning system, the first audio and video processing device and the second audio and video processing device can be any one of a broadcasting machine, a 3D broadcasting machine, and a live broadcast workstation.

According to the above-mentioned XR digital learning system, the first audio and video processing device is a broadcaster or a 3D broadcaster; the second audio and video processing device is a live broadcast workstation.

According to the above-mentioned XR digital learning system, the teaching mode for viewing and browsing by the XR device is to watch 3D live videos.

According to the above-mentioned XR digital learning system, the teaching mode for viewing and browsing on the XR device is to watch 3D live videos and browse WebVR teaching materials.

According to the above-mentioned XR digital learning system, the teaching mode for viewing and browsing on the XR device is to watch 3D live videos, participate in learning activities and VR interactive teaching materials.

According to the above-mentioned XR digital learning system, it further includes: at least a second audio and video processing device, the second audio and video processing device is connected to the camera signal; a third audio and video processing device, the third audio and video processing device is respectively connected to the second audio and video processing device. The audio and video processing device, the first audio and video processing device and the live broadcast platform playback end are connected by signals.

According to the above-mentioned XR digital learning system, the first audio and video processing device is a director or a 3D director; the second audio and video processing device has either a director or a 3D director and a virtual live host (VTuber) software ; The third audio and video processing device is a live broadcast workstation.

According to the above-mentioned XR digital learning system, the teaching mode for viewing and browsing on the XR device is to watch 3D live videos, participate in learning activities and VR interactive teaching materials; and the 3D live video viewing has a plane mode for watching 3D live videos. And an immersive interactive mode for watching 3D live videos.

The XR digital learning system that can achieve the above-mentioned new purpose at least includes: a broadcaster and a receiver, and the signal connection between the broadcaster and the receiver, wherein the broadcaster can use the Universe platform. Teaching, and the broadcasting end can receive the Metaverse platform and browse and learn together; the anchoring end includes: at least one camera; a first audio and video processing device, electrically connected to the camera, for processing the information obtained by the camera The audio and video information is processed for audio and video; and the One Yuan Universe platform control terminal is connected to the first audio and video processing device via a signal, and controls and sets the teaching mode selected by the Yuan Universe platform control terminal through the first audio and video processing device; the receiver It includes: at least one XR device for receiving the control signal of the first audio and video processing device, and the XR device can watch and browse the one-dimensional universe platform receiving end, so that the one-dimensional universe platform receiving end can be used to watch and browse the one-dimensional universe platform. This teaching mode of the universe platform control terminal.

According to the above-mentioned XR digital learning system, it further includes: at least a second audio and video processing device, the second audio and video processing device is connected to the camera signal; a third audio and video processing device, the third audio and video processing device is respectively connected to the second audio and video processing device. The audio and video processing device, the first audio and video processing device and the live broadcast platform playback end are connected by signals.

According to the above-mentioned XR digital learning system, the first audio and video processing device is a director or a 3D director; the second audio and video processing device has either a director or a 3D director and a virtual live host (VTuber) software ; The third audio and video processing device is a live broadcast workstation.

According to the above-mentioned XR digital learning system, the teaching mode for viewing and browsing on the XR device is to watch 3D live videos, participate in learning activities and VR interactive teaching materials; and the 3D live video viewing has a plane mode for watching 3D live videos. And an immersive interactive mode for watching 3D live videos.

Based on the above, this new model provides an XR digital co-learning system, which can combine teaching scenes and teaching interactions to allow the receiver to use XR devices to receive live broadcasts and experience the sense of virtual and real integrated interactive learning, allowing students to focus on learning, and It allows students to have an immersive experience, improves learning efficiency, and provides breakthrough development technology for distance teaching. By combining real-person teaching mode and XR devices to receive live broadcasts for browsing, the effect of realism in teaching can be improved; through the use of Scenes, photos or other areas that match the course content, and provide XR devices to watch or browse homemade WebVR teaching materials. After learning the course together, the receiver can use the XR device to experience the course content and learn in depth; use the studio green screen Live recording, combined with 360 photos or videos, 3D scene synthesis, and teaching materials such as presentations, 3D objects, audio-visual materials, etc. can be used to teach content through live broadcast and XR devices can receive live broadcasts for browsing; in addition, VR interactive teaching materials can also be used Or make your own immersive interactive teaching materials. After learning the course together, the broadcaster can use the XR device to experience the course content by himself, and have an immersive learning experience of actual operation and viewing; through Vtuber software and dynamic teaching by real people in the studio, Capture software can capture sounds and body movements in real time, put you in a virtual scene or a real scene, and teach with the created virtual character, achieving a teaching situation that integrates virtual and real interactions, and an immersive learning experience that allows for actual operation and viewing. Students can focus on learning and improve learning efficiency; and capture real-life physical teaching scenes through 360 cameras or 3D guides, synchronize on-site teaching and live teaching, match teaching scenes and teaching interactions, and allow the receiver to use XR devices to receive live broadcasts to experience virtual and real integration interaction The feeling of learning can enhance the realism of teaching.

In order to help the examiner understand the technical features, content and advantages of the present invention and the effects it can achieve, the present invention is described in detail below in the form of embodiments with the accompanying drawings, and the drawings used therein are as follows. The subject matter is only for illustrative and auxiliary instructions, and may not represent the true proportions and precise configuration of the present invention after implementation. Therefore, the proportions and configuration relationships of the attached drawings should not be interpreted to limit the scope of rights of the present invention in actual implementation. Let’s explain first.

In order to solve the technical problems of the previous technology, this new model provides an XR digital co-learning system, which combines teaching scenes and teaching interactions, allowing the receiver to use XR devices to receive live broadcasts and experience the sense of virtual and real integrated interactive learning, so that students can focus on learning. It also allows students to have an immersive experience, improves learning efficiency, and provides breakthrough development technology for distance teaching.

Please refer to Figure 1. Figure 1 is a block diagram of the first embodiment of the XR digital learning system according to the new embodiment of the present invention. The XR digital learning system 100 at least includes: a host 10 and a receiver 20. The host 10 and the receiver 20 are connected by signals. The host 10 can communicate through a live broadcast platform or a teaching material. The module combines real people to teach, and the receiver 20 can receive the live broadcast platform or the teaching material module and browse and learn together.

The anchor terminal 10 includes: at least one camera 11; a first audio and video processing device 12, electrically connected to the camera 11, for audio and video processing of the audio and video information obtained by the camera 11; and a live broadcast platform player 13, signal connection The first audio and video processing device 12 controls and sets the teaching mode selected by the live streaming platform player 13 through the first audio and video processing device 12 .

The receiver 20 includes: at least one XR device 21 for receiving the control signal of the first audio and video processing device 12, and the XR device 21 can watch and browse a live broadcast platform viewing end 22, so that the live broadcast platform viewing end 22 can be used to watch and browse the teaching mode of the live broadcast platform player 13.

In other words, this new type of XR digital learning system can combine teaching scenes and teaching interactions, allowing the receiver to use XR devices to receive live broadcasts and experience the sense of virtual and real integrated interactive learning, allowing students to focus on learning and allowing students to experience it. Feel the environment and improve learning efficiency.

In an embodiment of the present invention, the live broadcast platform can be any one of YouTube live broadcast, Facebook live broadcast, etc live broadcast, Instagram live broadcast, Twitch live broadcast, 17 LIVE live broadcast, and e-commerce platform live broadcast. The XR device can be an XR device manufactured by any manufacturer such as Apple, Microsoft, Google, FB, HTC, SONY, etc., and is not limited by this invention. Preferably, the camera 11 can be a 360-degree panoramic camera. Accordingly, through 360 cameras or 3D guides combined with live teaching mode and XR devices to receive live broadcasts for browsing, the effect of on-site realism in teaching can be enhanced.

Please refer to Figure 2 as well. Figure 2 is a schematic diagram of the use of the first embodiment of the XR digital learning system of the new embodiment of the present invention. The anchor end 10 of the XR digital learning system 100 can be a studio 18, and the studio 18 is equipped with the camera 11, the first audio and video processing device 12 and a background screen 19; preferably, the The first audio and video processing device 12 can be a 3D guide, a guide or a live broadcast workstation; the background 19 can be a green screen or a blue screen, but the present invention is not limited thereto; the receiver 20 can be directly the XR device 21 According to this, you can use the background of the studio to record real people, combine 360 photos or videos, 3D scene synthesis, and use teaching materials such as presentations, 3D objects, audio-visual materials, etc. to conduct content teaching through live broadcast, and the broadcast end Use the XR device to receive the live broadcast and browse it. In a preferred embodiment of the present invention, the host terminal 10 and the receiver terminal 20 can transmit and receive signals through a communication device 30. The communication device 30 can be a mobile communication base station, a local area network, Any of the Internet and wireless communication protocols.

Please refer to Figure 3. Figure 3 is a block diagram of the second embodiment of the XR digital learning system according to the new embodiment of the present invention. Figure 3 is roughly the same as Figure 1. In this embodiment, the XR digital learning system 100 further includes: an electronic device 14, which is connected to the camera 11 and the live broadcast platform player 13 respectively. Signal connection. The electronic device 14 is one of a mobile phone, a tablet, a laptop, and a mobile device. Preferably, the camera 11 can be a 360-degree panoramic camera; the teaching mode for viewing and browsing by the XR device 21 is to watch a 360-degree panoramic live video 211. Accordingly, the 360 panoramic camera live broadcast or video mode is combined with real-person teaching, and the receiver uses an XR device to receive the live broadcast and browse it, thereby improving the realism of on-site teaching.

Please refer to Figures 3 and 4 together. Figure 4 is a schematic diagram of the use of the second embodiment of the XR digital learning system of the new embodiment. Among them, Figure 4 is substantially the same as Figure 2. In this embodiment, it further includes an electronic device 14, and the electronic device 14 is either a mobile phone or a tablet. The anchor end 10 of the XR digital learning system 100 of the present invention can be a studio 18, and the studio 18 is equipped with the camera 11, the first audio and video processing device 12, the electronic device 14 and a background 19; Preferably, the camera 11 can be a 360-degree panoramic camera; the first audio and video processing device 12 and the electronic device 14 can be switched to operate independently. For example, the present invention can also directly replace the third video camera through the electronic device 14. An audio and video processing device 12 directly processes live video and audio combined with virtual reality, and then sends the processed video to the live broadcast platform player 13 for playback; the teaching mode for viewing and browsing by the XR device 21 is to watch 360-degree panoramic live video 211; Accordingly, the use of 360 panoramic camera live broadcast or video mode combined with real-person teaching, and the receiver uses an XR device to receive the live broadcast for browsing, thereby improving the realism of on-site teaching. Preferably, the first audio and video processing device 12 can be a 3D guide, a guide or a live broadcast workstation; the receiver 20 can be directly the XR device 21; accordingly, the background of the studio can be used for real-person recording , combined with 360 photos or videos, 3D scene synthesis, and can be used with teaching materials such as presentations, 3D objects, audio and video materials, etc., to conduct content teaching through live broadcast, and the receiver uses an XR device to receive the live broadcast for browsing.

Please refer to Figures 5 to 7. Figure 5 is a block diagram of the third embodiment of the XR digital learning system of the new embodiment. Figure 6 is the fourth embodiment of the XR digital learning system of the present invention. Block diagram of the embodiment. Figure 7 is a block diagram of the fifth embodiment of the XR digital learning system of the new embodiment of the present invention. The XR digital learning system 100 further includes: at least a second audio and video processing device 15, and the second audio and video processing device 15 is signal connected with the first audio and video processing device 12. In this embodiment, the first audio and video processing device 12 and the second audio and video processing device 15 can be any one of a broadcasting machine, a 3D broadcasting machine, and a live broadcast workstation. Preferably, the first audio and video processing device 12 is a broadcasting machine or a 3D broadcasting machine; the second audio and video processing device 15 is a live broadcast workstation.

As shown in Figure 5, the teaching mode watched and browsed by the XR device 21 is to watch 3D live video 212. By combining the teaching scene and teaching interaction, the receiver uses the XR device to receive the live broadcast and experience the sense of virtual and real integrated interactive learning. It allows students to focus on learning, and allows students to have an immersive experience, improving learning efficiency.

As shown in Figure 6, the teaching mode for viewing and browsing by the XR device 21 is to watch 3D live videos 212 and browse WebVR teaching materials 213. Through interactive learning, the teaching content application mode can be switched or clicked in different scenes to display interactive text and pictures to form a 3D live interactive teaching mode; in another embodiment, real-person recording can also be used combined with 360 photos or videos, 3D scene synthesis can be used with teaching materials such as presentations, 3D objects, audio-visual materials, etc. to conduct content teaching through live broadcast. The receiver 20 receives the live broadcast and browses it to form a teaching mode of 3D live browsing.

As shown in Figure 7, the teaching mode watched and browsed by the XR device 21 is watching 3D live videos 212, participating in learning activities 214 and VR interactive teaching materials 215. Using live recording combined with 360 photos or videos, 3D scene synthesis, it can be combined with teaching materials such as presentations, 3D objects, audio and video materials, etc., to conduct content teaching through live broadcast. The receiver 20 uses the XR device 21 to receive the live broadcast through the live broadcast platform viewing end 22 to browse. Preferably, the XR device 21 can also use VR interactive teaching materials from the Ministry of Education's large market, outsourcing or self-made, so that after learning the course together, the receiver 20 can use the XR device 21 to experience the course content by itself and conduct practical exercises. An immersive learning experience for both action and viewing. In addition, the VR interactive teaching materials can be self-made immersive interactive teaching materials for an immersive learning experience of actual operation and viewing.

Please refer to Figure 8, which is a block diagram of the sixth embodiment of the XR digital learning system according to the new embodiment of the present invention. The XR digital learning system 100 further includes: at least a second audio and video processing device 15, the second audio and video processing device 15 is connected to the camera 11; a third audio and video processing device 16, the third audio and video processing device 16 are respectively Signal connection with the second audio and video processing device 15, the first audio and video processing device 12 and the live broadcast platform player 13. The first audio and video processing device 12 is a director or a 3D director; the second audio and video processing device 15 has either a director or a 3D director and a virtual live host (VTuber) software; the third audio and video processing device 16 is the live broadcast workstation. In this embodiment, the teaching mode for viewing and browsing by the XR device 21 is to watch 3D live videos 212, participate in learning activities 214 and VR interactive teaching materials 215; and the 3D live video viewing 212 has a plane for watching 3D live videos. mode 2121 and an immersive interactive mode 2122 for watching 3D live videos. In this way, real-life physical teaching scenes are captured through 360 cameras or 3D guides, and live teaching and live teaching are synchronized, matching the teaching scenes and teaching interactions, so that the receiver can use the XR device to receive the live broadcast and experience the sense of virtual and real integrated interactive learning. Improve the effect of on-the-spot realism in teaching.

Please refer to Figure 9. Figure 9 is a block diagram of the seventh embodiment of the XR digital learning system according to the new embodiment of the present invention. The present invention also provides an XR digital learning system 100, which at least includes: a host terminal 10 and a receiver terminal 20. The host terminal 10 and the receiver terminal 20 are signally connected, wherein the anchor terminal 10 can be connected via a single The metaverse platform is used for teaching, and the receiver 20 can receive the metaverse platform and browse and learn together.

The anchor terminal 10 includes: at least one camera 11; a first audio and video processing device 12, electrically connected to the camera 11, for audio and video processing of the audio and video information obtained by the camera 11; and a one-dimensional universe platform control terminal 17, signal connection The first audio and video processing device 12 controls and sets the teaching mode selected by the Metaverse platform control terminal 17 through the first audio and video processing device 12 .

The receiver 20 includes: at least one XR device 21 for receiving the control signal of the first audio and video processing device 12, and the XR device 21 can watch and browse the one-dimensional universe platform receiving end 23, so that the one-dimensional universe platform receives The terminal 23 can be used to watch and browse the teaching mode of the metaverse platform control terminal 17.

In this embodiment, the XR digital learning system further includes: at least a second audio and video processing device 15, the second audio and video processing device 15 is signally connected to the camera 11; a third audio and video processing device 16, the third audio and video processing device 16. The audio and video processing device 16 is connected with signals to the second audio and video processing device 15, the first audio and video processing device 12 and the Metaverse platform control terminal 17 respectively. The first audio and video processing device 12 is a director or a 3D director; the second audio and video processing device 15 has either a director or a 3D director and a virtual live host (VTuber) software; the third audio and video processing device Device 16 is a live broadcast workstation. The teaching mode for viewing and browsing by the XR device 21 is to watch 3D live videos 212, participate in learning activities 214 and VR interactive teaching materials 215; and the 3D live video viewing 212 has a plane mode 2121 for watching 3D live videos and a viewing mode 2121. 3D live video immersive interactive mode 2122. According to this, real people can use Vtuber software and motion capture software to capture sounds and body movements in real time in the studio, put themselves in virtual scenes or real scenes, and use the created virtual characters to teach, achieving the integration of virtual and real interactions. Teaching scenarios provide an immersive learning experience with practical operations and viewing, allowing students to focus on learning and improve learning efficiency.

Based on the above, the new embodiment of the present invention provides an XR digital co-learning system. By combining teaching scenes and teaching interactions, the receiver uses the XR device to receive live broadcasts and experience the sense of virtual and real integrated interactive learning, so that students can focus on learning and be able to It allows students to have an immersive experience, improves learning efficiency, and at the same time provides breakthrough development technology for distance teaching and learning; by using scenes, photos or other fields that match the course content, and providing XR devices to watch or browse homemade WebVR teaching materials, After learning the course together, the broadcaster can use the XR device to experience the course content by himself and learn in depth; use VR interactive teaching materials or self-made immersive interactive teaching materials to allow the broadcaster to use the XR device to experience the course by himself after learning the course together. content, an immersive learning experience of actual operation and viewing; by using real people in the studio, through Vtuber software and motion capture software, real-time capture of sounds and body movements, immersing oneself in virtual scenes or actual scenes, to create Virtual characters teach, achieving an interactive teaching scenario that integrates virtual and real situations, and an immersive learning experience that allows for actual operation and viewing, allowing students to focus on learning and improve learning efficiency; capture real-person teaching scenes through 360 cameras or 3D guides, synchronizing with the scene Teaching and live teaching, combined with teaching scenes and teaching interactions, allow the receiver to use XR devices to receive live broadcasts and experience the sense of virtual and real integrated interactive learning, thereby improving the realism of teaching. In addition, in another embodiment, by integrating the XR digital co-learning system with the Metaverse platform, the teaching mode of the XR digital co-learning system can be changed from the live broadcast platform to the Metaverse platform, making it available on the Metaverse platform. The learning effect of the XR digital co-learning system can also be achieved.

The present invention is disclosed in this article only through preferred embodiments. However, anyone familiar with the technical field should understand that the above embodiments are only used to describe the present invention and are not intended to limit the scope of the patent rights claimed by the present invention. Any changes or substitutions that are equal or equivalent to the above embodiments should be construed as being within the spirit or scope of the present invention. Therefore, the protection scope of the present invention shall be defined by the following patent application scope.

100:XR digital learning system 10: Anchor end 11:Camera 12:The first audio and video processing device 13: Live broadcast platform player 14: Electronic devices 15: Second audio and video processing device 16: The third audio and video processing device 17: Metaverse platform control terminal 18:Photo studio 19:Backstage 20: Receiver 21:XR device 211:Watch 360-degree panoramic live video 212:Watch 3D live video 2121:Watch 3D live video in flat mode 2122: Watch 3D live video in immersive interactive mode 213: Browse WebVR teaching materials 214: Participate in learning activities 215: VR interactive teaching materials 22: Live broadcast platform viewing terminal 23: Metaverse platform receiving end 30:Communication device

The accompanying drawings are provided to enable those with ordinary knowledge in the technical field to which the present invention belongs to further understand the present invention, and are incorporated into and constitute a part of the specification of the present invention. The drawings illustrate exemplary embodiments of the invention and, together with the description of the invention, serve to explain the principles of the invention. Figure 1 is a block diagram of the first embodiment of the new XR digital learning system. Figure 2 is a schematic diagram of the use of the first embodiment of the new XR digital learning system. Figure 3 is a block diagram of the second embodiment of the new XR digital learning system. Figure 4 is a schematic diagram of the use of the second embodiment of the new XR digital learning system. Figure 5 is a block diagram of the third embodiment of the new XR digital learning system. Figure 6 is a block diagram of the fourth embodiment of the new XR digital learning system. Figure 7 is a block diagram of the fifth embodiment of the new XR digital learning system. Figure 8 is a block diagram of the sixth embodiment of the new XR digital learning system. Figure 9 is a block diagram of the seventh embodiment of the new XR digital learning system.

100:XR digital learning system

10: Anchor end

11:Camera

12:The first audio and video processing device

13: Live broadcast platform player

20: Receiver

21:XR device

22: Live broadcast platform viewing terminal

Claims (19)

An XR digital learning system, including at least: An anchor end (10) and a receiver end (20), the anchor end (10) and the receiver end (20) are connected by signals, wherein the anchor end (10) can pass a live broadcast platform or a teaching material The module combines real people to teach, and the receiver (20) can receive the live broadcast platform or the teaching material module and browse and learn together; The anchor terminal (10) includes: at least one camera (11); A first audio and video processing device (12), electrically connected to the camera (11), for performing audio and video processing on the audio and video information obtained by the camera (11); and A live broadcast platform player (13) connects the signal to the first audio and video processing device (12), and controls and sets the teaching mode desired by the live broadcast platform player (13) through the first audio and video processing device (12); The receiver (20) includes: At least one XR device (21) is used to receive the control signal of the first audio and video processing device (12), and the XR device (21) can watch and browse a live broadcast platform viewing end (22), so that the live broadcast platform can watch The terminal (22) can be used to watch and browse the teaching mode of the live broadcast platform player terminal (13). The XR digital learning system as described in claim 1, wherein the camera (11) can be a 360-degree panoramic camera. The XR digital learning system as described in request item 1, wherein the live broadcast platform can be any one of YouTube live broadcast, Facebook live broadcast, etc live broadcast, Instagram live broadcast, Twitch live broadcast, 17 LIVE live broadcast, and e-commerce platform live broadcast. The XR digital learning system as described in claim 1 further includes: An electronic device (14), the electronic device (14) is signal-connected to the camera (11) and the live broadcast platform player (13) respectively. The XR digital learning system as claimed in claim 4, wherein the electronic device (14) is one of a mobile phone, a tablet, a laptop, and a mobile device. The XR digital learning system as described in claim 4, wherein the teaching mode viewed and browsed by the XR device (21) is to watch a 360-degree panoramic live video (211). The XR digital learning system as described in claim 1 further includes: At least one second audio and video processing device (15), the second audio and video processing device (15) is signal-connected to the first audio and video processing device (12). The XR digital learning system according to claim 7, wherein the first audio and video processing device (12) and the second audio and video processing device (15) can be any one of a broadcast machine, a 3D broadcast machine, and a live broadcast workstation. As for the XR digital learning system described in claim 7, the first audio and video processing device (12) is a broadcaster or a 3D broadcaster; the second audio and video processing device (15) is a live broadcast workstation. The XR digital learning system as described in claim 9, wherein the teaching mode viewed and browsed by the XR device (21) is to watch 3D live videos (212). The XR digital learning system as described in claim 9, wherein the teaching mode for viewing and browsing by the XR device (21) is viewing 3D live videos (212) and browsing WebVR teaching materials (213). The XR digital learning system as described in claim 9, wherein the teaching mode viewed and browsed by the XR device (21) is watching 3D live videos (212), participating in learning activities (214) and VR interactive teaching materials (215) . The XR digital learning system as described in claim 1 further includes: At least one second audio and video processing device (15), the second audio and video processing device (15) is signal-connected to the camera (11); A third audio and video processing device (16). The third audio and video processing device (16) communicates with the second audio and video processing device (15), the first audio and video processing device (12) and the live broadcast platform player (13) respectively. connection. As for the XR digital learning system described in claim 13, the first audio and video processing device (12) is a guide or a 3D guide; the second audio and video processing device (15) is either a guide or a 3D guide. and a virtual live host (VTuber) software; the third audio and video processing device (16) is a live broadcast workstation. The XR digital learning system as described in claim 14, wherein the teaching mode viewed and browsed by the XR device (21) is watching 3D live videos (212), participating in learning activities (214) and VR interactive teaching materials (215) ; And the 3D live video viewing (212) further has a 3D live video viewing plane mode (2121) and an 3D live video viewing immersive interactive mode (2122). An XR digital learning system, including at least: An anchor end (10) and a receiver end (20), the anchor end (10) and the receiver end (20) are connected by signals, wherein the anchor end (10) can teach through the One Yuan Universe platform, And the receiver (20) can receive the Metaverse platform and browse and learn together; The anchor terminal (10) includes: at least one camera (11); A first audio and video processing device (12), electrically connected to the camera (11), for performing audio and video processing on the audio and video information obtained by the camera (11); and The one-dimensional universe platform control terminal (17) is connected to the first audio-visual processing device (12) through signals, and controls and sets the teaching mode selected by the first audio-visual processing device (12). ; The receiver (20) includes: At least one XR device (21) is used to receive the control signal of the first audio and video processing device (12), and the XR device (21) can watch and browse the one-dimensional universe platform receiving end (23), so that the one-dimensional universe platform The receiving end (23) can be used to watch and browse the teaching mode of the metaverse platform control end (17). The XR digital learning system as described in claim 16 further includes: At least one second audio and video processing device (15), the second audio and video processing device (15) is signal-connected to the camera (11); A third audio and video processing device (16), the third audio and video processing device (16) and the second audio and video processing device (15), the first audio and video processing device (12) and the Metaverse platform control terminal (17) respectively Signal connection. As for the XR digital learning system described in claim 17, the first audio and video processing device (12) is a guide or a 3D guide; the second audio and video processing device (15) is either a guide or a 3D guide. and a virtual live host (VTuber) software; the third audio and video processing device (16) is a live broadcast workstation. The XR digital learning system as described in claim 18, wherein the teaching mode viewed and browsed by the XR device (21) is watching 3D live videos (212), participating in learning activities (214) and VR interactive teaching materials (215) ; And the 3D live video viewing (212) further has a 3D live video viewing plane mode (2121) and an 3D live video viewing immersive interactive mode (2122).

Images