TW202238360A - Simulation virtual classroom - Google Patents

Abstract

A simulation virtual classroom is provided. The simulation virtual classroom includes a server device and two wearable devices. Each of the two wearable devices has a basic sensing module, a data storage module electrically coupled to the basic sensing module, a communication module electrically coupled to the data storage module, a computing module electrically coupled to the communication module and the data storage module, and an operating module and an audio-visual module that are electrically coupled to the computing module. The communication module can send the data to the server device. The computing module can simulate a virtual classroom, and further simulate operators and virtual personnel in the virtual classroom. The operation module can command any one of the operators to execute a trigger event. The audio-visual module can present events in the virtual classroom. Accordingly, the simulation virtual classroom can realize remote simulation teaching.

Description

Simulation virtual classroom

The invention relates to a virtual classroom, in particular to a simulated virtual classroom.

At present, due to special considerations such as geographical separation or infectious diseases, traditional physical teaching is gradually being adjusted to online teaching. Among them, the existing online teaching method is: the teacher uses the computer to broadcast its operation screen (or blackboard screen) and cooperates with audio explanations, so that the remote students use their personal computers to watch and respond with online text or voice.

However, although the existing online teaching can have the advantages of avoiding contact, not being limited by distance, and more flexible space, there are still many elements of physical teaching that cannot be met. For example: (1) Teachers and students lack real-time interaction, which makes it impossible to adjust the teaching progress according to the learning situation; (2) It is difficult to grasp the situation of students in front of the computer; (3) Lack of good presence and interaction, It is impossible to achieve a better learning effect through immersive experience and group motivation. That is to say, how to improve the above shortcomings is an important topic for the existing online teaching.

Therefore, the inventor believes that the above-mentioned defects can be improved, Naite devoted himself to research and combined with the application of scientific principles, and finally proposed an invention with reasonable design and effective improvement of the above-mentioned defects.

The technical problem to be solved by the present invention is to provide a simulated virtual classroom for the deficiencies of the existing technology, which can effectively improve the possible defects of the existing online teaching.

The embodiment of the present invention discloses a simulated virtual classroom, which includes: a servo device, including: a database module, including a classroom environment data and a plurality of operating object data; and a servo communication module, electrically coupled to the A database module, the servo communication module can use network communication to send and receive data in the database module; and two wearable devices can be used for a person to wear respectively, and each of the wearable devices can The server device is connected to the network and includes: a basic sensing module, which can obtain the posture and voice of the person to generate a personnel data; a data storage module, electrically coupled to the basic sensing module, The data storage module includes an initial environment data; a communication module, electrically coupled to the data storage module, the communication module can receive an invitation identification parameter through network communication, and communicate via the servo The module sends and receives the data in the database module; wherein, the communication module can send the personnel data to the database module, so as to be sent by the servo communication module; a computing module, Electrically coupled to the communication module and the data storage module, the computing module can use the initial environment data to simulate an initial virtual environment, and further use the personnel data to create an initial virtual environment A virtual person; the computing module can use the classroom environment data to simulate a virtual classroom, and further use a plurality of the operator data and the personnel data to simulate a plurality of virtual operators and all the virtual classrooms in the virtual classroom The virtual personnel; wherein, when the communication module receives the invitation identification parameter, the computing module switches from simulating the initial virtual environment to simulating the virtual classroom, and simulates the virtual classroom in the virtual classroom A virtual person; an operation module electrically connected to the operation module, the operation module can sense the hand position of the person to generate a hand posture data, and the operation module can use the hand Posture data simulates any one of the virtual manipulators to execute a trigger event in the virtual classroom; and a virtual reality module, electrically coupled to the computing module, the virtual reality module can present the virtual The virtual person and the triggering event in the classroom or the initial virtual environment.

To sum up, the simulated virtual classroom disclosed in the embodiment of the present invention can send and receive information in the database module via the servo communication module after the two wearable devices receive the invitation identification parameters. data, enabling the computing module to simulate the virtual classroom, the virtual personnel, and a plurality of the operating objects" and "the virtual reality module can present all the objects in the virtual classroom or the initial virtual environment The design of the virtual personnel and the triggering events” enables the personnel to directly present the behavior and voice of the virtual personnel in the virtual classroom, as well as multiple The trigger event generated by the command of the operator increases the sense of presence of the personnel in learning.

In order to further understand the features and technical content of the present invention, please refer to the following detailed description and drawings related to the present invention. However, the provided drawings are only for reference and description, and are not intended to limit the present invention.

The following is a description of the implementation of the "simulated virtual classroom" disclosed in the present invention through specific specific examples. Those skilled in the art can understand the advantages and effects of the present invention from the content disclosed in this specification. The present invention can be implemented or applied through other different specific embodiments, and various modifications and changes can be made to the details in this specification based on different viewpoints and applications without departing from the concept of the present invention. In addition, the drawings of the present invention are only for simple illustration, and are not drawn according to the actual size, which is stated in advance. The following embodiments will further describe the relevant technical content of the present invention in detail, but the disclosed content is not intended to limit the protection scope of the present invention.

It should be understood that although terms such as "first", "second", and "third" may be used herein to describe various elements or signals, these elements or signals should not be limited by these terms. These terms are mainly used to distinguish one element from another element, or one signal from another signal. In addition, the term "or" used herein may include any one or a combination of more of the associated listed items depending on the actual situation.

1 to 5, the present embodiment provides a simulated virtual classroom 100, the simulated virtual classroom 100 includes a servo device 1 and two wearable devices (i.e. the first wearable device 2A and the second wearable device 2A in FIG. 1 device 2B). The simulated virtual classroom 100 can use the server device 1 as a data relay station, and further receive and transmit the data to the two wearable devices through network communication technology (for example: wireless network), so that the two wearable devices The above-mentioned wearable device can obtain the same data in real time to construct a synchronous virtual reality image, thereby realizing the effect of virtual reality teaching. It should be noted that terms such as "simulation" and "construction" mentioned in this embodiment are generated by data processing using a device capable of data calculation or calculation. Next, the components of the simulated virtual classroom 100 and their connections will be introduced below.

As shown in FIG. 1 , the servo device 1 includes a database module 11 and a servo communication module 12 electrically coupled to the database module 11 . Wherein, the servo communication module 12 is a device with network communication receiving and sending, the aforementioned network communication technology is wireless network as an example in this embodiment, and can be realized for the database module 11 Push technology (server push). In this embodiment, the database module 11 is composed of a storage unit 111 and a processing unit 112, and in practice, the storage unit 111 can be a traditional hard disk (HDD) or a solid state disk ( SSD) and other storage devices, and the storage unit 111 pre-stores a classroom environment data and a plurality of operator data each with an event parameter, and the processing unit 112 can be used to manage the data distribution of the storage unit 111, Basic computing, command control, etc.

It should be noted that the database module 11 can use electronic devices (such as computers or mobile phones) to add or adjust classroom environment data and operating object data according to actual needs. Of course, the event parameters of each operator data can also be adjusted and increased through the aforementioned electronic device.

As shown in FIG. 2 and FIG. 3 , the two wearing devices can be respectively used for a person to wear. In actual use, the person wearing one of the wearing devices is a lecturer (or teacher), and the person wearing the other wearing device is a trainee (or student). That is to say, the number of wearable devices in the simulated virtual classroom 100 can be adjusted according to actual needs, but the number is at least two.

For the convenience of description, the present embodiment uses two wearable devices for illustration, and the wearable device used for the lecturer is further defined as a first wearable device 2A, which is used for all wearable devices worn by the trainees. The aforementioned wearing device 2 is further defined as a second wearing device 2B. Wherein, the components of the first wearable device 2A and the second wearable device 2B are substantially the same, so the first wearable device 2A is taken as an example below to introduce the first wearable device 2A and the second wearable device 2A. Components and their connections that both wearable device 2B has, and then the different components of the two will be introduced later.

As shown in FIG. 1 and FIG. 2, the first wearable device 2A includes a basic sensing module 21, a data storage module 22 electrically coupled to the basic sensing module 21, and a data storage module electrically coupled to the A communication module 23 of the data storage module, a computing module 24 electrically coupled to the communication module 23 and the data storage module 22, and a computing module 24 electrically coupled to the computing module 24 An operation module 25 and a virtual reality module 26 .

The basic sensing module 21 can acquire the posture and voice of the person (the lecturer will be described below) to generate a person profile. Furthermore, the basic sensing module 21 is composed of various sensors, so as to obtain various parameters to combine into the personnel data, and used for the subsequent simulation (or construction) of the computing module 24 For virtual reality purposes.

In detail, the basic sensing module 21 includes a three-axis posture sensing unit 211 and a face scanning unit 212 in this embodiment. Wherein, the three-axis posture sensing unit 211 can use a three-axis gyroscope (Gyroscope) or a three-axis accelerometer (Three-axis accelerometer) to obtain a posture parameter of the lecturer in practice, and the posture parameter is ideal The dynamic information of the lecturer's head, hands, and feet must be available on the website. In practice, the face scanning unit 212 can use an infrared dot-matrix photography device (for example: True-Depth Camera), and can scan the facial features of the lecturer in real time and generate a facial features parameter, which means that the facial features parameters are all Tell the dynamic changes of the lecturer's eyes, nose, and mouth. In other words, the personal information includes the facial features parameters and the posture parameters, but the present invention is not limited thereto.

For example, in other unillustrated embodiments of the present invention, the three-axis posture sensing unit 211 can also be replaced with a dynamic image recognition unit, which can obtain The posture parameters; or, the basic sensing module 21 adds other sensors, thereby increasing the types of parameters contained in the personnel data.

In addition, the data storage module 22 can be used to store any data. Specifically, the data storage module 22 can store data without network communication, wherein the data stored in the data storage module 22 includes an initial environment data, and the initial environment data is It is used for the computing module 24 to simulate (or construct) an initial virtual environment T5, wherein the initial virtual environment T5 can be understood as a waiting virtual space for waiting for a network communication connection.

In practice, the initial environment data in the data storage module 22 can be preset, or obtained by an environment scanning module 27 of the first wearable device 2A to obtain the real environment where the lecturer is located. Generated, wherein the environment scanning module 27 is electrically coupled to the data storage module 22 . For example, if the initial environment data is pre-set, the initial virtual environment T5 can be a white virtual space (as shown in Figure 4) and has a virtual operator (described later); otherwise, if the When the initial environment data is generated by the environment scanning module 27, the initial virtual environment T5 is to simulate the actual environment of the lecturer. It should be noted that the initial virtual environment T5 can enable the lecturer (and the personnel) to adapt to the visual experience and operating experience of the virtual environment in advance, and can also be used to allow the lecturer to select the Operand information (will be described in detail later).

The communication module 23 is the main component for providing the first wearable device 2A with network communication, and the communication module 23 can perform two-way reception and transmission with the servo communication module 12 . Accordingly, the communication module 23 can send the personnel information to the database module 11, so that the servo communication module 12 can send it to the second wearable device 2B.

It should be noted that the communication module 23 must be authorized or invited to transmit the personnel data to the database module 11 for subsequent push technology. Specifically, after the communication module 23 receives an invitation identification parameter through network communication, the communication module 23 can send and receive the data in the database module 11 through the servo communication module 12 . Therefore, assuming that the communication module 23 does not receive the invitation identification parameter, the calculation module 24 of the first wearable device 2A can only obtain data from the data storage module 22 for simulation.

The computing module 24 adopts an image processing chip (for example: Cupola360) in this embodiment, but the present invention is not limited thereto. The computing module 24 can use the initial environment data to simulate the initial virtual environment T5, and further use the personnel data to generate a virtual person in the initial virtual environment T5 (hereinafter referred to as virtual lecturer T3 and virtual student T4); or, the calculation module 24 can use the classroom environment data to simulate a virtual classroom T1 (as shown in Figure 5), and further use a plurality of the operator data and the personnel The data simulates a plurality of virtual operators T2 and the virtual lecturer T3 (or virtual students T4) in the virtual classroom T1.

It should be noted that when the communication module 23 receives the invitation identification parameter, the computing module 24 switches from simulating the initial virtual environment T5 to simulating the virtual classroom T1, and in the virtual classroom T1 simulates the virtual lecturer T3. That is to say, when the computing module obtains the classroom environment data, it stops simulating the initial virtual environment T5, and merges the personnel data into the classroom environment data for simulation.

The operation module 25 is a glove with a posture sensor in this embodiment, but the present invention is not limited thereto. The operation module 25 can sense the hand position of the lecturer to generate a hand posture data (for example: the coordinate change of the finger), and the operation module 24 can use the hand posture data in the virtual classroom T1 simulates any one of the virtual operators T2 to execute a trigger event. Wherein, the trigger event is simulated and generated by the computing module using the event parameters.

For example, as shown in Figure 5, where the two virtual manipulators T2 are a virtual chalk T21 and a virtual blackboard T22, the lecturer can take the continuous gesture of "picking up the chalk and writing on the blackboard" in reality Let the operation module 25 obtain the specific hand posture data, so that the virtual lecturer T3 in the virtual classroom T1 picks up the virtual chalk T21 and generates writing sound in front of the virtual blackboard T22 trigger events, and the virtual blackboard T22 generates trigger events for writing lines.

The virtual reality module 26 is virtual reality glasses (Virtual reality glasses) in this implementation, and has the function of playing audio, but the present invention is not limited thereto. The virtual reality module 26 can present the virtual lecturer T3 and the trigger event in the virtual classroom T1 or the initial virtual environment T5.

Preferably, the first wearable device 2A may include a scanning modeling module 28 electrically coupled to the data storage module 22, and the scanning modeling module 28 can scan an object to generate a An extended item data of event parameters, which can be stored in the data storage module 22 and used by the computing module 24 to generate an extended operand in the initial virtual environment T5 (also visible is the expanded virtual operator T2). That is to say, the lecturer (or the student) can utilize the scanning modeling module 28 to amplify the virtual objects (ie, virtual manipulators) in the virtual classroom T1 . Of course, in other unillustrated embodiments of the present invention, the extended item data can also be created in other ways, for example: 3D drawing, or imported from an open 3D object database via the Internet . The human-object interaction functions required on the augmented virtual objects are set in real time by the creators of the virtual objects. For example: expanding a virtual mobile phone, and setting a virtual button on the virtual mobile phone to be touched to activate the screen of the virtual mobile phone to display a multimedia content. .

It is worth noting that when the communication module 23 of the first wearable device 2A receives the invitation identification parameter, the communication module 23 can use network communication to send the information via the server communication module 12. The extended item data is stored in the database module 11, and the servo communication module 12 can send the extended item data to the data storage module 22 of the second wearable device 2B for storage. Accordingly, when the virtual objects amplified by the lecturer (or the student) are authorized to enter the virtual classroom T1, they are synchronously stored in the database module 11 for the benefit of the server communication module 12 Subsequent pushing and synchronizing the images of each of the wearable devices 2 . Generally speaking, the action of the lecturer choosing whether to upload the extended item data to the database module 11 will be selected in the initial virtual environment T5.

The above is the components and the connection relationship between the components of the first wearable device 2A and the second wearable device 2B. Next, the different components of the first wearable device 2A and the second wearable device 2B and their connection relationship will be continuously introduced.

As shown in FIG. 2 , generally speaking, the first wearable device 2A is preset to be worn by a manager (ie, a lecturer), so the first wearable device 2A further includes an electrical coupling to the A data management module 29 of the communication module 23, the data management module 29 can send a screening command to the servo communication module 12 through the communication module 23, thereby controlling the servo communication module 12 by All or specific data sent by the database module 11.

For example, assume that the total number of the plurality of operator data is three, and the corresponding virtual operators T2 are a microscope, a wrench, and a welding torch. When the content of the lecture that the lecturer wants to teach is "factory operation", the lecturer can use the data management module 29 to select the operating object data corresponding to the microscope in the database module 11 that cannot be communicated by the servo Sent by module 12. That is to say, in the virtual classroom T1, there are only the virtual operator T2 corresponding to a wrench and the virtual operator T2 corresponding to a welding torch. Accordingly, the data management module 29 can effectively simplify the number of virtual manipulators in the virtual classroom T1 , so as to improve the concentration of the students and reduce the computing load of the computing module 24 .

Similarly, the lecturer can also use the data management module 29 to selectively set whether the virtual operator T2 can be seen by a specific person (that is, a person wearing a wearable device) in the virtual classroom T1. , the content of the triggering event of the virtual operator T2 (for example: scaling, displacement and rotation, special effects, content, etc.) can also be flexibly adjusted to increase flexibility.

As an example, as shown in FIG. 6 , assuming that the mid-term exam is being conducted in the virtual classroom T1, the lecturer can use the data management module 29 to set the display time of the content of the virtual exam paper T2, so that all The content of the virtual examination paper T2 is displayed only at a specific time. Of course, the data management module 29 can also realize data transmission between any virtual student T4 in the virtual classroom T1 and other virtual students T4, such as video, sound, or data.

That is to say, the lecturer (that is, the manager of the virtual classroom T1) can set the two-way or multi-way interaction authority between each person and the virtual operator T2 through the data management module 29, so that The interaction between people and virtual manipulators, people and people, and virtual manipulators and virtual manipulators can be effectively controlled.

As shown in Figure 3, in the special situation where infectious diseases are prevalent, it is also very important for the lecturer to understand the physiological conditions of the students during the lecture, for example: when the students are unwell, they can be found immediately, so The basic sensing module 21 of the second wearable device 2B further includes a physiological monitoring unit 213 . Specifically, the physiological monitoring unit 213 can sense the physiological condition of the student and generate a physiological parameter, which is transmitted by the communication module 23 of the second wearing device 2B via the servo communication module. The group 12 is transmitted to the virtual reality module 26 of the first wearable device 2A for presentation.

That is to say, the lecturer can know the physiological condition of the students wearing the second wearable device 2B in the virtual classroom T1 through the first wearable device 2A (for example: in the virtual classroom T1 Physiological values are presented in the Chinese-Israeli interface), which facilitates the immediate medical treatment of the students in case of abnormalities. Of course, the physiological parameters can also be used as the lecturer to judge the degree of concentration of the student, for example, when the student's heart rate is too stable for a long time, the lecturer can judge the Students may fall asleep.

In practice, the physiological monitoring unit 213 includes a body temperature sensor and a heart rate sensor, the body temperature sensor can detect the body temperature of the student to generate a body temperature value, and the heart rate sensor Then the student's heartbeat can be detected to generate a heartbeat value, that is, the physiological parameter has a body temperature value and a heart rate value in this embodiment, but the present invention is not limited thereto. For example, the physiological monitoring unit 213 can timely increase a blood pressure sensor or an exhalation sensor according to actual needs, so as to increase the physiological information that can be presented by the physiological parameters.

[Technical effects of the embodiments of the present invention]

To sum up, the simulated virtual classroom disclosed in the embodiment of the present invention can send and receive information in the database module via the servo communication module after the two wearable devices receive the invitation identification parameters. data, enabling the computing module to simulate the virtual classroom, the virtual personnel, and a plurality of the operating objects" and "the virtual reality module can present all the objects in the virtual classroom or the initial virtual environment The design of the virtual personnel and the triggering events” enables the personnel to directly present the behavior and voice of the virtual personnel in the virtual classroom, as well as multiple The trigger event generated by the command of the operator increases the sense of presence of the personnel in learning.

The content disclosed above is only a preferred feasible embodiment of the present invention, and does not therefore limit the scope of the patent application of the present invention. Therefore, all equivalent technical changes made by using the description and drawings of the present invention are included in the application of the present invention. within the scope of the patent.

100:Simulating a virtual classroom 1: Servo device 11: Database module 111: storage unit 112: Processing unit 12: Servo communication module 2A: The first wearable device 2B: Second wearable device 21:Basic sensing module 211: Three-axis attitude sensing unit 212: Face scanning unit 213: Physiological Monitoring Unit 22: Data storage module 23: Communication module 24: Operation module 25: Operation module 26: Virtual Reality Module 27:Environment Scanning Module 28:Scan Modeling Module 29: Data management module T1: Virtual Classroom T2: virtual manipulator T21: Virtual Chalk T22: Virtual Blackboard T3: Virtual Lecturer T4: Virtual trainee T5: Initial virtual environment

FIG. 1 is a schematic block diagram of a simulated virtual classroom of the present invention.

FIG. 2 is a schematic block diagram of a first wearable device for simulating a virtual classroom of the present invention.

FIG. 3 is a schematic block diagram of a second wearable device for simulating a virtual classroom of the present invention.

FIG. 4 is a perspective view of the initial virtual environment of the present invention.

FIG. 5 is a schematic perspective view of the virtual classroom of the present invention.

Fig. 6 is a schematic perspective view of the virtual operator of the present invention when it is not authorized.

100:Simulating a virtual classroom

1: Servo device

11: Database module

111: storage unit

112: Processing unit

12: Servo communication module

2A: The first wearable device

2B: Second wearable device

Claims (9)

A simulated virtual classroom comprising: A servo device, comprising: A database module, including a classroom environment data and multiple operand data; and A servo communication module, electrically coupled to the database module, the servo communication module can use network communication to send and receive data in the database module; and Two wearable devices, each capable of being worn by a person, each of the wearable devices can be network-connected to the servo device and include: A basic sensing module capable of acquiring the person's posture and voice to generate a person's data; A data storage module, electrically coupled to the basic sensing module, the data storage module includes an initial environmental data; A communication module, electrically coupled to the data storage module, the communication module can send and receive the data in the database module through the servo communication module after receiving an invitation identification parameter through network communication ; Wherein, the communication module can send the personnel data to the database module, so as to be sent by the servo communication module; A computing module, electrically coupled to the communication module and the data storage module, the computing module can use the initial environment data to simulate an initial virtual environment, and further use the personnel data in the The initial virtual environment generates a virtual person; the computing module can use the classroom environment data to simulate a virtual classroom, and further use a plurality of the operator data and the personnel data to simulate multiple A virtual manipulator and the virtual personnel; wherein, when the communication module receives the invitation identification parameter, the computing module switches from simulating the initial virtual environment to simulating the virtual classroom, and in the a virtual classroom simulating at least said virtual personnel; An operation module, electrically connected to the operation module, the operation module can sense the hand position of the person to generate a hand posture data, and the operation module can use the hand posture data in the the virtual classroom simulates any one of the virtual manipulators to perform a trigger event; and A virtual reality module, electrically coupled to the computing module, capable of presenting the virtual personnel and the triggering events in the virtual classroom or the initial virtual environment. The simulated virtual classroom as described in claim 1, wherein each of the wearable devices further includes a scanning modeling module electrically coupled to the data storage module, and the scanning modeling module can scan objects To generate an extended item data, the extended item data can be stored in the data storage module and utilized by the computing module to generate an extended operand in the initial virtual environment. The simulated virtual classroom according to claim 2, wherein, when the communication module of one of the wearable devices receives the invitation identification parameter, the operation module switches from simulating the initial virtual environment to simulating The virtual classroom, and the communication module uses network communication to send the expanded item data to the database module for storage through the servo communication module, and the servo communication module sends the expanded item data Stored in the data storage module of another wearable device. The simulated virtual classroom as described in claim 1 or 3, wherein the two wearable devices are further defined as a first wearable device and a second wearable device, and the first wearable device further includes an electrically coupled A data management module of the communication module, the data management module can send a screening command to the servo communication module through the communication module, so as to control the servo communication module from the database module All or specific information sent by the group. The simulated virtual classroom as described in claim 4, wherein, the basic sensing module of the second wearable device includes a physiological monitoring unit, and the physiological monitoring unit can sense the physiological condition of the person and generate a Physiological parameters, the physiological parameters are transmitted by the communication module of the second wearable device to the virtual reality module of the first wearable device via the servo communication module for presentation. The simulated virtual classroom as described in claim 5, wherein the physiological monitoring unit includes: A body temperature sensor capable of detecting the body temperature of the person to generate a body temperature value; a heart rate sensor capable of detecting the heartbeat of the person to generate a heartbeat value; and Wherein, the physiological parameters include the body temperature value and the heartbeat value. The simulated virtual classroom as described in claim 1, wherein, the basic sensing module of each of the wearable devices further includes: A three-axis posture sensing unit capable of obtaining the posture of the person and generating a posture parameter; and A face scanning unit, which can scan the facial features of the person in real time and generate a facial features parameter, so that the personal data includes the facial features parameters; Wherein, the personnel information includes the facial features parameters and the attitude parameters. The simulated virtual classroom as described in claim 1, wherein, the basic sensing module of each of the wearable devices further includes a dynamic image recognition unit, and the dynamic image recognition unit can use the image changes of the personnel to obtain A posture parameter; wherein, the personal information includes the posture parameter. The simulated virtual classroom as described in claim 1, wherein each of the wearable devices further includes an environment scanning module electrically coupled to the data storage module, and the environment scanning module can detect the personnel The current environment generates the initial environment data, and stores the initial environment data in the data storage module.

Images