WO2018098720A1

WO2018098720A1 - Virtual reality-based data processing method and system

Info

Publication number: WO2018098720A1
Application number: PCT/CN2016/108118
Authority: WO
Inventors: 熊益冲
Original assignee: 深圳益强信息科技有限公司
Priority date: 2016-11-30
Filing date: 2016-11-30
Publication date: 2018-06-07

Abstract

A virtual reality-based data processing method and system. The method comprises: a first virtual reality device captures first environment information by means of a camera and records a first capturing time; the first virtual reality device receives a setting instruction on a virtual teaching application, and receives and caches a teaching environment parameter that is returned by a background server according to the setting instruction; the first virtual reality device fuses the cached teaching environment parameter and the captured first environment information, generates a first virtual teaching scene according to the first capturing time, and displays the first virtual teaching scene; the first virtual reality device receives an operation instruction on a target course in the first virtual teaching scene, selects a corresponding human teaching model according to the operation instruction, and presents teaching content of the target course according to the human model. The present invention can provide realistic and rich simulated teaching experience so as to improve the learning efficiency of a user.

Description

Data processing method and system based on virtual reality

Technical field

The present invention relates to the field of computer applications, and in particular, to a data processing system and system based on virtual reality.

Background technique

With the advancement of human civilization, electronic devices with data processing and data communication functions are increasingly integrated into people's daily lives. For example, electronic devices such as smart phones and tablet computers have become an indispensable part of people's daily lives. To some extent, the user's demand for games, movies, music and other entertainments is solved; but for the smart phone, when the user controls the teaching application on the screen area through the touch screen, due to the limitation of the mobile phone screen, the teaching content The display effect is general, and it can even be said that the display effect is single, which is far from the user's learning experience in the real environment, so that the user can not truly appreciate the immersive teaching experience; or, for example, smart TV, when the user passes When the button is selected to select the target subject on the smart TV, due to the limitations of the system, the teaching content can never present an intuitive 3D environment display effect. For example, taking the circular motion in physics as an example, the user can only visually view the two-dimensional. Particle motion on the plane, and does not allow users to explore from different angles Intends to showcase the environment, resulting in user experience simulation resources is extremely limited, and thus the customer can not fully enjoy the immersive experience.

Summary of the invention

The technical problem to be solved by the embodiments of the present invention is to provide a data processing method and a data processing system based on virtual reality, which can enrich user experience resources and provide users with a realistic teaching scene so that users can fully enjoy Immersive experience.

In order to solve the above technical problem, the first aspect of the embodiments of the present invention provides a data processing method based on virtual reality, where the data processing method includes:

The first virtual reality device captures the first environment information through the camera, and records the first capture time;

The first virtual reality device receives a setting instruction for the virtual teaching application, and sends the setting Command to the background server;

The background server acquires the teaching environment parameter according to the setting instruction, and sends the teaching environment parameter back to the first virtual reality device; wherein the teaching environment parameter comprises: a virtual projector, a virtual desk, and a virtual seat And virtual classrooms;

The first virtual reality device caches the teaching environment parameter according to the received teaching environment parameter;

The first virtual reality device merges the cached processed teaching environment parameter with the captured first environment information, and generates a first virtual teaching scene according to the first capturing time, and displays the first a virtual teaching scene;

The first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scene, and selects a corresponding character teaching model according to the operation instruction, and displays the teaching content of the target subject based on the character model .

A second aspect of the embodiments of the present invention provides a virtual reality-based data processing system, including: a first virtual reality device and a background server;

The first virtual reality device is configured to capture first environment information by using a camera, and record a first capture time;

The first virtual reality device is further configured to receive a setting instruction for the virtual teaching application, and send the setting instruction to the background server;

The background server is configured to acquire a teaching environment parameter according to the setting instruction, and send the teaching environment parameter to the first virtual reality device; wherein the teaching environment parameter comprises: a virtual projector, a virtual desk , virtual seats and virtual classrooms;

The first virtual reality device is further configured to cache the teaching environment parameter according to the received teaching environment parameter;

The first virtual reality device is further configured to fuse the cached processed teaching environment parameter with the captured first environment information, and generate a first virtual teaching scenario according to the first capture time, and Displaying the first virtual teaching scene;

The first virtual reality device is further configured to receive an operation instruction for the target subject in the first virtual teaching scene, and select a corresponding character teaching model according to the operation instruction, and display the target based on the character model Teaching content of the subject.

It can be seen that the implementation of the embodiment of the present invention has the following beneficial effects: the first virtual reality device first captures the first environment information through the camera, and records the first capture time; secondly, the first virtual reality device receives the setting of the virtual teaching application. And receiving and buffering the teaching environment parameter returned by the background server according to the setting instruction; then, the first virtual reality device fuses the cached processed teaching environment parameter with the captured first environment information And generating a first virtual teaching scene according to the first capturing time, and displaying the first virtual teaching scene; finally, the first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scene And selecting a corresponding character teaching model according to the operation instruction, and displaying the teaching content of the target subject based on the character model. Therefore, the invention can not only provide users with a realistic simulation teaching scene, but also create a richer and more diverse visual experience for the user, fully mobilize the user's feelings and thinking, and greatly improve the user's learning efficiency. .

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a schematic flowchart of a data processing method based on virtual reality according to an embodiment of the present invention;

2 is a schematic flowchart of another virtual reality-based data processing method according to an embodiment of the present invention;

3 is a schematic flowchart diagram of still another virtual reality-based data processing method according to an embodiment of the present invention;

4 is a schematic structural diagram of a data processing system based on virtual reality according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of another data processing system based on virtual reality according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The terms "comprising" and "comprising" and variations of the invention are intended to be in the meaning For example, a process, method, system, product, or device that comprises a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units not listed, or alternatively Other steps or units inherent to these processes, methods, products, or equipment.

The execution of the virtual reality-based data processing method mentioned in the embodiments of the present invention depends on a computer program and can run on a computer system of the Von Ruyman system. The computer program can be integrated into the application or run as a standalone tool class application. The computer system can be a terminal device such as a personal computer, a tablet computer, a notebook computer, or a smart phone.

The details are described below separately.

FIG. 1 is a schematic flowchart of a data processing method based on virtual reality according to an embodiment of the present invention. As shown in FIG. 1 , the data processing method includes at least:

Step S101, the first virtual reality device captures the first environment information by using the camera, and records the first capture time;

Specifically, the first virtual reality device may capture the environment data of the current user by using the front or rear camera, and use the environment data as the first environment information, and record the first corresponding to the first environment information. A capture time, in addition, the camera also has functions such as video call and projection.

The obtaining, by the first virtual reality device, the user's head rotation angle is detected in real time, and the spatial data in the corresponding imaging area is captured in real time according to the rotation angle, and each angle is The corresponding spatial data is integrated to generate the environmental data, and the environmental data is used as the first environmental information.

Step S102, the first virtual reality device receives a setting instruction for the virtual teaching application, and sends the setting instruction to the background server;

Specifically, the first virtual reality device may be a head mounted device, including: a virtual reality eye or a virtual reality helmet; the first virtual reality device is configured to receive a setting instruction of a screen area corresponding to the virtual teaching application by the user, and after the first virtual reality device receives the setting instruction, to the background The server sends the setting instruction;

The setting instruction refers to that the user performs a click operation on the virtual screen area of the first virtual reality device. The click operation includes, but is not limited to, an operation of each type of touch touch screen, such as a pressing operation, a double-click operation, or a sliding screen operation. Generally, in a terminal having a touch screen function, the structure of the touch screen includes at least three layers: a screen glass layer, a touch panel layer, and a display panel layer. The screen glass layer is a protective layer, the touch panel layer is used to sense a user's touch operation, and the display panel layer is used to display an image. At present, related technologies enable the integration of the touch panel layer and the display panel layer.

Step S103, the background server acquires the teaching environment parameter according to the setting instruction, and sends the teaching environment parameter back to the first virtual reality device;

Specifically, when receiving the setting request information sent by the first virtual reality device, the background server returns setting response information according to the setting request information, and acquires the teaching environment parameter, and the teaching environment is Sending parameters back to the first virtual reality device; wherein the teaching environment parameters include: a virtual projector, a virtual desk, a virtual seat, and a virtual classroom;

Step S104: The first virtual reality device caches the teaching environment parameter according to the received teaching environment parameter;

Specifically, when the first virtual reality device receives the teaching environment parameter returned by the background server, the teaching scenario of the virtual teaching application may be set according to the teaching environment parameter; wherein the teaching Environmental parameters include: virtual projectors, virtual desks, virtual seats, and virtual classrooms;

Step S105, the first virtual reality device merges the cached processed teaching environment parameter with the captured first environment information, and generates a first virtual teaching scene according to the first capturing time, and displays The first virtual teaching scene;

Specifically, the first virtual reality device may capture the environment data in a real environment in which the user is currently located by using the camera, and estimate and form a model of a corresponding teaching environment parameter according to the environment data, to Extracting the corresponding teaching environment parameter on the server, and performing data fusion with the captured first environment information to generate a first virtual teaching scene according to the first capturing time, and displaying The first virtual teaching scene;

For example, the first virtual reality device captures the current position of the user in the room A by the camera, and detects that the user's head is slightly shifted to the left, and the first virtual reality device positions the user. And the head offset angle or the like as the environmental data, and extracting teaching environment parameters corresponding to the environmental data according to the environmental data, so that the environmental data and the teaching environment parameters are data-fused to be virtualized The teaching environment parameters are applied to the real teaching environment, so that the real environment data and the virtual teaching scene are superimposed on the same picture or space in real time, and the two exist at the same time. At this time, the user will be located in the middle of the classroom in the virtual teaching environment, and the projection display interface is positioned at a slightly left position with the user as the dividing line.

Step S106, the first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scene, and selects a corresponding character teaching model according to the operation instruction, and displays the target subject based on the character model. Teaching content.

Specifically, the first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scenario by using voice recognition; wherein the operation instruction includes: a model selection operation instruction, a teaching content call operation instruction, and a seat selection Operation instruction

At this time, the first virtual reality device may select a corresponding character teaching model according to the model selection operation instruction, and invoke an operation instruction to display the teaching content of the target subject according to the teaching content, and select an operation according to the seat selection. The instruction and the first capture time schedule virtual target seats in the teaching environment parameters.

For example, taking the model selection operation instruction as an example, the first virtual reality device may receive a model selection operation instruction for a target subject (eg, a plurality of subjects) in the first virtual teaching scene by voice recognition to select a user favorite user. Teaching model. The character teaching model may be an animal cartoon model of the image or a realistic star simulation model.

For example, taking the seat selection operation command as an example, after the first virtual reality device receives the seat selection instruction for the English subject in the first virtual teaching scene by voice recognition, the first capture time is read, and A virtual target seat in the teaching environment parameter is arranged according to the seat selection operation command and the first capture time (eg, the position of the projection screen facing the left side of the center). In addition, the first capture time may be used to record the learning duration of the target subject, and may also be used to select the virtual target seat, so that other users who subsequently enter the English subject cannot repeatedly occupy the selected one of the learning durations. Target seat.

As can be seen from the above, the first virtual reality device first captures the first environment information through the camera, and records the first capture time; secondly, the first virtual reality device receives the setting instruction for the virtual teaching application, and receives and caches the background server according to Setting the teaching environment parameter returned by the instruction; then, the first virtual reality device fuses the cached processed teaching environment parameter with the captured first environment information, and according to the first capturing time Generating a first virtual teaching scene and displaying the first virtual teaching scene; finally, the first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scene, and selects according to the operation instruction a character teaching model, and displaying the teaching content of the target subject based on the character model. Therefore, the invention can not only provide users with a realistic simulation teaching scene, but also create a richer and more diverse visual experience for the user, fully mobilize the user's feelings and thinking, and greatly improve the user's learning efficiency. ,

2 is a schematic flowchart of another virtual reality-based data processing method according to an embodiment of the present invention. As shown in FIG. 2, the data processing method includes at least:

Step S201, the first virtual reality device captures the first environment information by using the camera, and records the first capture time;

Step S202: The first virtual reality device receives a setting instruction for the virtual teaching application, and receives and caches a teaching environment parameter returned by the background server according to the setting instruction.

Specifically, the first virtual reality device receives a setting instruction for the virtual teaching application, and sends the setting instruction to the background server, so that the background server acquires the teaching environment parameter according to the setting instruction, and the teaching The environmental parameter is sent back to the first virtual reality device; wherein the teaching environment parameter comprises: a virtual projector, a virtual desk, a virtual seat, and a virtual classroom; and the teaching environment received by the first virtual reality device After the parameter, the teaching environment parameters are cached.

The first virtual reality device may be a head mounted device, including: a virtual reality glasses or a virtual reality helmet; the first virtual reality device may be configured to receive a setting instruction of a screen area corresponding to the virtual teaching application by the user. And after the first virtual reality device receives the setting instruction, send the setting instruction to the background server;

The setting instruction may be configured to send the setting request information to the background server, and enable the background server to return setting response information according to the setting request information, to extract the teaching environment parameter stored on the background server, and Setting a teaching scenario of the virtual teaching application according to the teaching environment parameter; wherein the teaching environment parameters include: a virtual projector, a virtual desk, a virtual seat, and a virtual classroom;

In addition, the setting instruction refers to a user performing a click operation on a virtual screen area of the first virtual reality device. The click operation includes, but is not limited to, an operation of each type of touch touch screen, such as a pressing operation, a double-click operation, or a sliding screen operation. Generally, in a terminal having a touch screen function, the structure of the touch screen includes at least three layers: a screen glass layer, a touch panel layer, and a display panel layer. The screen glass layer is a protective layer, the touch panel layer is used to sense a user's touch operation, and the display panel layer is used to display an image. At present, related technologies enable the integration of the touch panel layer and the display panel layer.

Step S203, the first virtual reality device converts the teaching environment parameter cached in the graphics card cache into three-dimensional classroom interface data based on the active split screen technology, and uses the first capture time to set the three-dimensional classroom interface data. Merging with the captured first environment information to generate the first virtual teaching scene; wherein the first capturing time is used to record the learning duration of the target subject;

Specifically, the first virtual reality device performs split screen processing on the teaching environment parameters buffered in the bottom layer graphics card cache according to the active split screen technology, so that the teaching environment parameters displayed by the system are equally divided. After processing, the data can be converted into three-dimensional teaching interface data, and then the first virtual reality device performs data fusion between the captured first environment information and the three-dimensional teaching interface data to generate a first virtual teaching scene. And displaying the first virtual teaching scene;

Among them, the active split screen technology realizes the split screen processing through the underlying driver of the system, and can realize the split screen from the display buffer area of the bottom layer of the system, and uses the unique algorithm to perform the equal division split screen processing in the layer of FrameBuffer. In order to achieve all system display content, the screen can be split, and then equipped with virtual reality glasses to achieve the effect of 3D display; in addition, the first virtual reality device can capture the user in the real environment in which the user is currently located by the camera. Environmental data and estimated based on the environmental data And forming a corresponding teaching environment parameter model to extract corresponding teaching environment parameters from the background server, and data fusion between the teaching environment parameters and the captured first environment information, according to Generating a first virtual teaching scene by the first capturing time, and displaying the first virtual teaching scene;

Step S204, the first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scene, and selects a corresponding character teaching model according to the operation instruction, and displays the target subject based on the character model. Teaching content;

Specifically, the first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scenario by using voice recognition; wherein the operation instruction includes: a model selection operation instruction, a teaching content call operation instruction, and a seat selection An operation instruction; at this time, the first virtual reality device may select a corresponding character teaching model according to the model selection operation instruction, and invoke an operation instruction to display the teaching content of the target subject according to the teaching content, and according to the The seat selection operation command and the first capture time arrange virtual target seats in the teaching environment parameters. Receiving an operation instruction for the target subject in the first virtual teaching scene, and selecting a corresponding character teaching model according to the operation instruction, and displaying the teaching content of the target subject based on the character model.

For example, taking the model selection operation instruction as an example, the first virtual reality device may receive a model selection operation instruction for a target subject (eg, a physical subject) in the first virtual teaching scene by voice recognition to select a user favorite user. Teaching model. The character teaching model may be an animal cartoon model of the image or a realistic star simulation model.

For example, the operation instruction is invoked by the teaching content, and the first virtual reality device can receive the operation instruction for the teaching content of the target subject in the first virtual teaching scene by using voice recognition, so that the first virtual reality device can be The virtual image extracted from the background server covers the function in the real world picture, that is, within a certain projection distance, the virtual image of the computer is merged and marked in the real world picture of the user position through the active split screen technology. Finally, the superimposed three-dimensional image is output. For example, you can think of a dinosaur model that has disappeared for many years, and let it be placed around the user's location. It can also help users to reproduce the simulation scene of the launch and launch of the Shenzhou 11 spacecraft in front of the scene. The vivid 3D image allows more users to get to know the technology around them.

Optionally, after performing the foregoing steps S201-S204, the data processing method further includes Including the following steps:

Step S205, the first virtual reality device may further send the first virtual teaching scenario to a user terminal having a wireless connection relationship with the first virtual reality device based on a wireless video transmission technology, so that the user terminal Displaying the first virtual teaching scene;

The user terminal includes: a smart TV. Laptops, PDAs, gaming peripherals and tablets.

It can be seen that the first virtual reality device first captures the first environment information through the camera and records the first capture time; secondly, the first virtual reality device receives the setting instruction for the virtual teaching application, and receives and caches the background server according to the Setting the teaching environment parameter returned by the instruction; then, the first virtual reality device converts the teaching environment parameter cached in the graphics card cache into three-dimensional classroom interface data based on the active split screen technology, and according to the first capture time Combining the three-dimensional classroom interface data with the captured first environment information to generate the first virtual teaching scene; wherein the first capturing time is used to record the learning duration of the target subject; and finally, The first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scene, and selects a corresponding character teaching model according to the operation instruction, and displays the teaching content of the target subject based on the character model It can be seen that with the present invention, the teaching content displayed by the system can be in the underlying driver. Now equalize the screen, so that the application interface in the system realizes the active split screen effect, which can fundamentally improve the 3D display effect, enrich the user's learning resources, and provide users with diverse and realistic virtual Teaching scene.

Further, please refer to FIG. 3, which is a schematic flowchart of still another method for processing data based on virtual reality according to an embodiment of the present invention. As shown in FIG. 3, the data processing method includes at least:

Step S301, the first virtual reality device captures the first environment information by using the camera, and records the first capture time;

Step S302, the first virtual reality device receives a setting instruction for the virtual teaching application, and sends the setting instruction to the background server;

Step S303, the background server acquires the teaching environment parameter according to the setting instruction, and sends the teaching environment parameter back to the first virtual reality device; wherein the teaching environment parameter comprises: a virtual projector, a virtual desk , virtual seats and virtual classrooms;

Step S304: The first virtual reality device caches the teaching environment parameter according to the received teaching environment parameter;

Specifically, the first virtual reality device may be a head mounted device, including: a virtual reality eye or a virtual reality helmet; the first virtual reality device may be configured to receive a setting of a screen area corresponding to the virtual teaching application by a user. And after the first virtual reality device receives the setting instruction, sending the setting instruction to the background server;

Step S305, the first virtual reality device merges the cached processed teaching environment parameter with the captured first environment information, and generates a first virtual teaching scene according to the first capturing time, and displays The first virtual teaching scene;

Specifically, the first virtual reality device may capture the environment data in a real environment in which the user is currently located by using the camera, and estimate and form a model of a corresponding teaching environment parameter according to the environment data, to Extracting corresponding teaching environment parameters from the server, and the teaching The environment parameter is data-fused with the captured first environment information to generate a first virtual teaching scene according to the first capturing time, and display the first virtual teaching scene;

Step S306, the first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scene, and selects a corresponding character teaching model according to the operation instruction, and displays the target subject based on the character model. Teaching content.

Specifically, the first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scenario by using voice recognition; wherein the operation instruction includes: a model selection operation instruction, a teaching content call operation instruction, and a seat selection An operation instruction; at this time, the first virtual reality device may select a corresponding character teaching model according to the model selection operation instruction, and invoke an operation instruction to display the teaching content of the target subject according to the teaching content, and according to the The seat selection operation command and the first capture time arrange virtual target seats in the teaching environment parameters.

Step S307, the second virtual reality device sends a join request to the background server.

Step S308, the background server forwards the received join request to the first virtual reality device;

Step S309, the first virtual reality device generates an acknowledgement response message corresponding to the join request, and sends the acknowledgement response message to the second virtual reality device.

Step S310, the second virtual reality device uploads second environment information to the background server according to the confirmation response message, and records a second capture time;

Specifically, the second virtual reality device may capture the current environment data by using the front or rear camera, and use the environment data as the second environment information, and record the second capture time corresponding to the second environment information. In addition, the camera also has functions such as video calling and projection. After the second virtual reality device receives the confirmation response message sent by the first virtual reality device, uploading the second environment information to the background server;

The obtaining, by the second virtual reality device, the head rotation angle of the user in real time, capturing spatial data in a range corresponding to the imaging area, and integrating the spatial data to generate a The environment data is uploaded, and the environment data is uploaded to the background server as the second environment information to obtain the second teaching scene data of the target subject corresponding to the second capturing time.

Step S311, the background server compares the first virtual teaching scene with the second environment letter Converging, generating first teaching scene data corresponding to the first virtual reality device, and generating second teaching scene data corresponding to the second virtual reality device;

Specifically, after receiving the second environment information uploaded by the second virtual reality device, the background server performs data fusion between the second environment information and the first virtual teaching scenario to generate and The first teaching scene data corresponding to the first virtual reality device is sent to the first virtual reality device; at the same time, the generated second teaching scene data corresponding to the second virtual reality device is sent to the The second virtual reality device is configured to enable the two virtual reality devices to display simulated teaching scenes in different orientations or perspectives in the corresponding virtual teaching scenes.

Step S312, the first virtual reality device receives the first teaching scene data sent by the background server, and updates and displays the first virtual teaching scene according to the second capturing time;

Step S313, the second virtual reality device receives the second teaching scene data sent by the background server, and generates and displays a second virtual teaching scene according to the second capturing time.

Optionally, after performing the foregoing steps S301-S313, the data processing method further includes performing the following steps, the first virtual reality device may further send the first virtual teaching scenario to the wireless video transmission technology to a user terminal having a wireless connection relationship with the first virtual reality device, so that the user terminal displays the first virtual teaching scene;

The user terminal includes: a smart TV. Laptops, PDAs, parade peripherals, and tablets.

As can be seen from the above, the first virtual reality device first captures the first environment information through the camera, and records the first capture time; secondly, the first virtual reality device receives the setting instruction for the virtual teaching application, and receives and caches the background server according to The teaching environment parameter returned by the setting instruction; the first virtual reality device merges the cached processed teaching environment parameter with the captured first environment information, and according to the first capture Generating a first virtual teaching scene and displaying the first virtual teaching scene; finally, the first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scene, and selects according to the operation instruction Corresponding character teaching model, and displaying the teaching content of the target subject based on the character model; then, after receiving the joining request of the second virtual reality device, the background server forwards the joining request to the a first virtual reality device to cause the second virtual reality device to receive the confirmation response After interest, the second environmental information uploaded; Preferably, the first virtual server, the background scene and the teaching The second environment information is used for data fusion, and the first teaching scene data corresponding to the first virtual reality device is generated, and the second teaching scene data corresponding to the second virtual reality device is generated and sent to the a first virtual reality device and the second virtual reality device. Therefore, the present invention not only provides a user with a realistic simulation teaching scene, but also provides a rich virtual interactive platform for multiple users, thereby creating a richer and more diverse visual experience for the user, and providing the user with a visual experience. Fit the realistic teaching scene, greatly help users understand the teaching content and improve learning efficiency.

Further, please refer to FIG. 4, which is a schematic structural diagram of a data processing system based on virtual reality according to an embodiment of the present invention. As shown in FIG. 4, the data processing system 1 includes: a first virtual reality device 10 and a background. Server 20;

The first virtual reality device 10 is configured to capture first environment information by using a camera, and record a first capture time;

Specifically, the first virtual reality device 10 may capture the environment data of the current user by using the front or rear camera, and use the environment data as the first environment information, and record the corresponding information of the first environment information. The first capture time, in addition, the camera also has functions such as video call and projection.

The obtaining, by the first virtual reality device 10, the user's head rotation angle is detected in real time, and the spatial data in the corresponding imaging area is captured in real time according to the rotation angle, and each The spatial data corresponding to the angle is integrated to generate the environmental data, and the environmental data is used as the first environmental information.

The first virtual reality device 10, the first virtual reality device is further configured to receive a setting instruction for the virtual teaching application, and send the setting instruction to the background server;

The background server 20 is configured to acquire a teaching environment parameter according to the setting instruction, and send the teaching environment parameter to the first virtual reality device; wherein the teaching environment parameter comprises: a virtual projector, a virtual class Tables, virtual seats and virtual classrooms;

The first virtual reality device 10 is further configured to cache the teaching environment parameter according to the received teaching environment parameter;

Specifically, the first virtual reality device 10 receives a setting instruction for the virtual teaching application, and sends the setting instruction to the background server 20, so that the background service device 20 obtains the teaching environment parameter according to the setting instruction, and Sending the teaching environment parameter back to the first virtual reality device 10; subsequently, the first virtual reality device 10 refers to the teaching according to the received teaching environment parameter Learn environment parameters for cache processing.

The teaching environment parameters include: a virtual projector, a virtual desk, a virtual seat, and a virtual classroom;

In addition, the first virtual reality device 10 may be a head mounted device, including: a virtual reality eye or a virtual reality helmet; the first virtual reality device may be configured to receive a setting of a screen area corresponding to the virtual teaching application by a user. And after the first virtual reality device receives the setting instruction, sending the setting instruction to the background server;

The first virtual reality device 10 sends the setting request information to the background server 20, and causes the background server 20 to return setting response information according to the setting request information to extract the teaching stored on the background server 20. An environmental parameter, and the teaching scene of the virtual teaching application is set according to the teaching environment parameter; wherein the teaching environment parameter comprises: a virtual projector, a virtual desk, a virtual seat, and a virtual classroom;

The first virtual reality device 10 is further configured to fuse the cached processed teaching environment parameter with the captured first environment information, and generate a first virtual teaching scenario according to the first capture time. And displaying the first virtual teaching scene;

Specifically, the first virtual reality device 10 may be configured to capture, by using the camera, the environment data in a real environment where the user is currently located, and estimate and form a model of a corresponding teaching environment parameter according to the environment data, to The background server 20 extracts corresponding teaching environment parameters, and combines the teaching environment parameters with the captured first environment information to generate a first virtual teaching according to the first capturing time. a scene and displaying the first virtual teaching scene;

The first virtual reality device 10 is further configured to receive an operation instruction for a target subject in the first virtual teaching scene, and select a corresponding character teaching model according to the operation instruction, and display the Teaching content of the target subject;

Specifically, the first virtual reality device 10 is specifically configured to receive an operation instruction for a target account in the first virtual teaching scenario by using voice recognition; wherein the operation instruction includes: a model selection operation instruction, and a teaching content call The operation instruction and the seat selection operation instruction; at this time, the first virtual reality device 10 is further configured to select a corresponding character teaching model according to the model selection operation instruction, and invoke the operation instruction to display the target according to the teaching content. The teaching content of the subject, and the virtual target seat in the teaching environment parameter is arranged according to the seat selection operation instruction and the first capturing time.

As can be seen from the above, the first virtual reality device 10 first captures the first environment information through the camera and records the first capture time; secondly, the first virtual reality device 10 receives the setting instruction for the virtual teaching application, and receives And the teaching environment parameter returned by the cache background server 20 according to the setting instruction; then, the first virtual reality device 10 fuses the cached processed teaching environment parameter with the captured first environment information, and Generating a first virtual teaching scene according to the first capturing time, and displaying the first virtual teaching scene; finally, the first virtual reality device 10 receives an operation instruction for a target subject in the first virtual teaching scene, And selecting a corresponding character teaching model according to the operation instruction, and displaying the teaching content of the target subject based on the character model. Therefore, the invention can not only provide users with a realistic simulation teaching scene, but also create a richer and more diverse visual experience for the user, fully mobilize the user's feelings and thinking, and greatly improve the user's learning efficiency. ,

Further, please refer to FIG. 5, which is another virtual reality-based data processing system according to an embodiment of the present invention. The data processing system 1 includes the first virtual reality device in the specific embodiment corresponding to FIG. 4. 10 and the background server 20, further, the data processing system 1 further includes a second virtual reality device 30;

The second virtual reality device 30 is configured to send a join request to the background server 20;

The background server 20 is further configured to forward the received join request to the first virtual reality device 10;

The first virtual reality device 10 is further configured to generate an acknowledgment response message corresponding to the join request, and send the acknowledgment response message to the second virtual reality device 30;

The second virtual reality device 30 is further configured to upload the second environment information to the background server 20 according to the confirmation response message, and record the second capture time;

The background server 20 is further configured to merge the first virtual teaching scenario with the second environment information, generate first teaching scene data corresponding to the first virtual reality device 10, and generate and The second teaching scene data corresponding to the second virtual reality device 30;

The first virtual reality device 10 is further configured to receive the first teaching scene data sent by the background server 20, and update and display the first virtual teaching scene according to the second capturing time;

The second virtual reality device 30 is further configured to receive the second teaching scene data sent by the background server 20, and generate and display a second virtual teaching scene according to the second capturing time.

Optionally, in the specific embodiment shown in FIG. 4 or FIG. 5, the first virtual reality device 10 is further configured to send the first virtual teaching scenario to the first A virtual reality device 10 has a user terminal in a wireless connection relationship to cause the user terminal to display the first virtual teaching scene.

It can be seen that the first virtual reality device 10 first receives a setting instruction for the virtual teaching application, and sends the setting instruction to the background server 20; secondly, the background server 20 acquires the teaching environment parameter according to the setting instruction, and The teaching environment parameter is sent back to the first virtual reality device 10; then, the first virtual reality device 10 caches the received teaching environment parameter; and the cached processed teaching environment parameter Merging with the captured first environment information, generating a first virtual teaching scene according to the first capturing time, and displaying the first virtual teaching scene; then, the first virtual reality device 10 receives An operation instruction of the target subject in the first virtual teaching scene, and selecting a corresponding character teaching model according to the operation instruction, and displaying the teaching content of the target subject based on the character model; and finally, the background server 20 After receiving the join request of the second virtual reality device 30, forwarding the join request to the first virtual The real device 10, so that the second virtual reality device 30 uploads the second environment information after receiving the confirmation response message; subsequently, the background server 20 compares the first virtual teaching scenario with the The second environment information is merged, the first teaching scene data corresponding to the first virtual reality device 10 is generated, and the second teaching scene data corresponding to the second virtual reality device 30 is generated. It can be seen that the present invention can provide a virtual interactive platform for a plurality of users to enrich the learning resources of the user, and allow the user to fully enjoy the immersive teaching experience to improve the learning efficiency of the user.

Those skilled in the art can understand all or part of the process in implementing the above embodiments. This may be accomplished by a computer program instructing the associated hardware, which may be stored in a computer readable storage medium, which, when executed, may include the flow of an embodiment of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

The above is only the preferred embodiment of the present invention, and the scope of the present invention is not limited thereto, and thus equivalent changes made in the claims of the present invention are still within the scope of the present invention.

Claims

A data processing method based on virtual reality, characterized in that it comprises:

The first virtual reality device captures the first environment information through the camera, and records the first capture time;

The first virtual reality device receives a setting instruction for the virtual teaching application, and sends the setting instruction to the background server;

The background server acquires the teaching environment parameter according to the setting instruction, and sends the teaching environment parameter back to the first virtual reality device; wherein the teaching environment parameter comprises: a virtual projector, a virtual desk, and a virtual seat And virtual classrooms;

The first virtual reality device caches the teaching environment parameter according to the received teaching environment parameter;

The first virtual reality device merges the cached processed teaching environment parameter with the captured first environment information, and generates a first virtual teaching scene according to the first capturing time, and displays the first a virtual teaching scene;

The first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scene, and selects a corresponding character teaching model according to the operation instruction, and displays the teaching content of the target subject based on the character model .
The method according to claim 1, wherein the first virtual reality device fuses the cached processed teaching environment parameter with the captured first environment information, and according to the first capture Time generating a first virtual teaching scene and displaying the first virtual teaching scene, including:

Converting the teaching environment parameter cached in the graphics card cache into three-dimensional classroom interface data based on the active split screen technology, and the three-dimensional classroom interface data and the captured first environment information according to the first capture time Performing fusion to generate the first virtual teaching scene; wherein the first capturing time is used to record the learning duration of the target subject.
The method of claim 1 wherein said first virtual reality device is connected And receiving an operation instruction of the target subject in the first virtual teaching scene, and selecting a corresponding character teaching model according to the operation instruction, and displaying the teaching content of the target subject based on the character model, including:

The first virtual reality device receives an operation instruction for the target subject in the first virtual teaching scene by using voice recognition; wherein the operation instruction includes: a model selection operation instruction, a teaching content invocation operation instruction, and a seat selection operation instruction;

The first virtual reality device selects a corresponding character teaching model according to the model selection operation instruction, and invokes an operation instruction to display the teaching content of the target subject according to the teaching content, and selects an operation instruction according to the seat and the The first capture time, the virtual target seat in the teaching environment parameters is arranged.
The method according to claim 1, wherein the first virtual reality device receives an operation instruction for a target subject in the first virtual teaching scene, and selects a corresponding character teaching model according to the operation instruction, After the character model is controlled by the voice recognition to control the progress of the target subject, the method further includes:

The second virtual reality device sends a join request to the background server;

The background server forwards the received join request to the first virtual reality device;

The first virtual reality device generates an acknowledgement response message corresponding to the join request, and sends the acknowledgement response message to the second virtual reality device;

The second virtual reality device uploads second environment information to the background server according to the confirmation response message, and records a second capture time;

The background server combines the first virtual teaching scenario with the second environment information to generate first teaching scene data corresponding to the first virtual reality device, and generates a corresponding corresponding to the second virtual reality device. Second teaching scene data;

Receiving, by the first virtual reality device, the first teaching scene data sent by the background server, and displaying the first virtual teaching scene in combination with the second capturing time;

The second virtual reality device receives the second teaching scene data sent by the background server, and generates and displays a second virtual teaching scene in combination with the second capturing time.
The method according to any one of claims 1 to 4, further comprising:

Transmitting, by the first virtual reality device, the first virtual teaching scenario to a user terminal having a wireless connection relationship with the first virtual reality device, so that the user terminal displays the first Virtual teaching scenarios.
A data processing system based on virtual reality, wherein the data processing system comprises: a first virtual reality device and a background server;

The first virtual reality device is configured to capture first environment information by using a camera, and record a first capture time;

The first virtual reality device is further configured to receive a setting instruction for the virtual teaching application, and send the setting instruction to the background server;

The background server is configured to acquire a teaching environment parameter according to the setting instruction, and send the teaching environment parameter to the first virtual reality device; wherein the teaching environment parameter comprises: a virtual projector, a virtual desk , virtual seats and virtual classrooms;

The first virtual reality device is further configured to cache the teaching environment parameter according to the received teaching environment parameter;

The first virtual reality device is further configured to fuse the cached processed teaching environment parameter with the captured first environment information, and generate a first virtual teaching scenario according to the first capture time, and Displaying the first virtual teaching scene;

The first virtual reality device is further configured to receive an operation instruction for the target subject in the first virtual teaching scene, and select a corresponding character teaching model according to the operation instruction, and display the target based on the character model Teaching content of the subject.
A data processing system according to claim 6 wherein:

The first virtual reality device is further configured to convert the teaching environment parameter cached in the graphics card cache into three-dimensional classroom interface data based on the active split screen technology, and the three-dimensional classroom according to the first capture time The interface data is merged with the captured first environment information to generate the first virtual teaching scene;

The first capture time is used to record the learning duration of the target subject.
A data processing system according to claim 6 wherein:

The first virtual reality device is further configured to receive, by using voice recognition, an operation instruction for a target account in the first virtual teaching scenario; wherein the operation instruction includes: a model selection operation instruction, a teaching content call operation instruction, and a seat Select an operation instruction;

The first virtual reality device is further configured to select a corresponding character teaching model according to the model selection operation instruction, and invoke an operation instruction to display the teaching content of the target subject according to the teaching content, and select an operation according to the seat selection The instruction and the first capture time schedule virtual target seats in the teaching environment parameters.
The data processing system according to claim 6, wherein the data processing system further comprises: a second virtual reality device and a background server;

The second virtual reality device is configured to send a join request to the background server;

The background server is configured to forward the received join request to the first virtual reality device;

The first virtual reality device is further configured to generate an acknowledgement response message corresponding to the join request, and send the acknowledgement response message to the second virtual reality device;

The second virtual reality device is further configured to upload the second environment information to the background server according to the confirmation response message, and record the second capture time;

The background server is further configured to merge the first virtual teaching scenario with the second environment information, generate first teaching scene data corresponding to the first virtual reality device, and generate and the second The second teaching scene data corresponding to the virtual reality device;

The first virtual reality device is further configured to receive the first teaching scene data sent by the background server, and update and display the first virtual teaching scene according to the second capturing time;

The second virtual reality device is further configured to receive the second teaching scene data sent by the background server, and generate and display a second virtual teaching scene according to the second capturing time.
A data processing system according to any one of claims 6 to 9, wherein:

The first virtual reality device is further specifically configured to: according to a wireless video transmission technology, the first The virtual teaching scenario is sent to a user terminal having a wireless connection relationship with the first virtual reality device, so that the user terminal displays the first virtual teaching scenario.