CN112446948A

CN112446948A - Virtual reality courseware processing method and device, electronic equipment and storage medium

Info

Publication number: CN112446948A
Application number: CN201910819072.1A
Authority: CN
Inventors: 施振磊; 吉昌; 贺翔; 陆嘉鸣; 孙志鹏
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2019-08-30
Filing date: 2019-08-30
Publication date: 2021-03-05
Anticipated expiration: 2039-08-30
Also published as: CN112446948B

Abstract

The application discloses a processing method and device of virtual reality courseware, electronic equipment and a storage medium, and relates to the virtual reality teaching technology. The specific implementation scheme is as follows: determining virtual reality courseware according to the editing operation of a user on resources; generating a courseware configuration file of the virtual reality courseware, wherein the courseware configuration file comprises resource content information, resource addresses and resource association information contained in the virtual reality courseware; if the virtual reality VR courseware is triggered to be loaded, the loader loads a courseware configuration file, and resource data are obtained according to a resource address recorded by the courseware configuration file; and loading the resource data, the resource content information recorded by the courseware configuration file and the resource association information to obtain the virtual reality courseware. One courseware configuration file can be read by different operating systems, the three-dimensional model and the SDK do not need to be packaged aiming at different operating systems, the decoupling effect of VR courseware and the SDK is achieved, and the editing efficiency of VR courseware is improved.

Description

Virtual reality courseware processing method and device, electronic equipment and storage medium

Technical Field

The application relates to a data processing technology, in particular to a virtual reality teaching technology.

Background

At present, when Virtual Reality (VR) courseware files are manufactured, materials of the VR courseware and Software Development Kit (SDK) are packaged together to form the VR courseware files. The format of the VR courseware file is usually an exe file or an apk file. When the courseware is applied to different operating systems, each operating system needs to be packaged once to form a file which can be recognized by the system, such as an exe file or an apk file, and the VR courseware editing efficiency is low.

Disclosure of Invention

The embodiment of the application provides a processing method and device of virtual reality courseware, electronic equipment and a storage medium, and the processing method and device, the electronic equipment and the storage medium are used for decoupling virtual reality VR courseware and SDK and improving VR courseware editing efficiency.

In a first aspect, an embodiment of the present application provides a method for processing a virtual reality courseware, including:

determining virtual reality courseware according to the editing operation of a user on resources;

generating a courseware configuration file of the virtual reality courseware, wherein the courseware configuration file comprises resource content information, resource addresses and resource association information contained in the virtual reality courseware;

if the virtual reality VR courseware is triggered to be loaded, the loader loads a courseware configuration file, and resource data are obtained according to a resource address recorded by the courseware configuration file;

and loading the resource data, the resource content information recorded by the courseware configuration file and the resource association information to obtain the virtual reality courseware.

In the above application embodiment, the courseware configuration file describes the content of resources such as a three-dimensional model included in the VR courseware and the relationship between the resources. SDKs run in loaders in different operating systems, the loaders can acquire resources according to resource addresses recorded in loaded courseware configuration files, and then the loaders load the acquired resources according to the resource configuration files to obtain VR courseware. One courseware configuration file can be read by different operating systems, the three-dimensional model and the SDK do not need to be packaged aiming at different operating systems, the decoupling effect of VR courseware and the SDK is achieved, and the editing efficiency of VR courseware is improved.

In an embodiment of the foregoing application, before determining the virtual reality courseware according to the editing operation of the resource by the user, the method further includes:

outputting an FBX file according to a three-dimensional model made by a user;

exporting the FBX file as an AssetBundle file;

generating a resource configuration file of the three-dimensional model according to the sub-resources contained in the three-dimensional model;

correspondingly, the virtual reality courseware is determined according to the editing operation of the user on the resources, and the method comprises the following steps:

in the courseware editing tool, if a user calls three-dimensional model resources, generating and displaying a three-dimensional model according to a resource configuration file and an AssetBundle file;

determining a virtual reality courseware according to the editing operation of a user on the three-dimensional model and other resource data, wherein the other resources comprise at least one of the following resources: three-dimensional models, panoramas, or videos.

In the embodiment, the three-dimensional model is described by using the resource configuration file, the FBX file is exported to the AssetBundle file, and when the VR courseware is edited by using the courseware editing tool, the three-dimensional model can be loaded according to the resource configuration file and the AssetBundle file, so that three-dimensional models can be used by different platforms (a web platform, an android platform and a PC platform) according to the resource configuration file, and the universality of the three-dimensional model file is improved.

In another embodiment of the above application, the loader loads the courseware configuration file, and acquires the resource data according to the resource address recorded in the courseware configuration file; loading resource data, resource content information recorded by the courseware configuration file and resource associated information to obtain virtual reality courseware, comprising the following steps:

updating the loader;

loading a courseware configuration file by using an updated loader, and acquiring resource data according to a resource address recorded by the courseware configuration file; and loading the resource data, the resource content information recorded by the courseware configuration file and the resource association information by using the updated loader to obtain the virtual reality courseware.

In the above embodiment, the loader includes software toolkits such as an SDK, and when the SDK or other software toolkits are updated, the loader is updated, and at this time, only the loader needs to be updated, and the virtual reality courseware can be loaded by loading the courseware configuration file after the loader is updated. Compared with the existing SDK updating process which needs to be debugged and packaged again, the embodiment only needs to update the loader without changing the courseware configuration file, so that the workload of updating the SDK is greatly reduced, and the updating efficiency is improved.

In another embodiment of the above application, the method is applied to virtual reality courseware loading at a teacher end and a student end, wherein the teacher end uses a web end, and the student end uses a PC end or an Android end;

correspondingly, the loading device loads the courseware configuration file and acquires the resource data according to the resource address recorded by the courseware configuration file, and the method comprises the following steps:

a loader used by a teacher end loads courseware configuration files, and FBX files and other resource data are obtained according to web end resource addresses recorded by the courseware configuration files;

a loader used by a student side loads a courseware configuration file, and an AssetBundle file and other resource data are obtained according to a resource address of a PC side or an Android side recorded by the courseware configuration file;

correspondingly, loading resource data, resource content information recorded by the courseware configuration file and resource associated information to obtain the virtual reality courseware, comprising:

a loader used by a teacher end loads the FBX file, other resource data, resource content information recorded by the courseware configuration file and resource associated information to obtain virtual reality courseware;

and the loader used by the student end loads the asset Block file, other resource data, resource content information recorded by the courseware configuration file and resource associated information to obtain the virtual reality courseware.

According to the embodiment, the web resource address for storing the FBX file and the PC or Android resource address for recording the AssetBundle file can be recorded in the courseware configuration file, the loader can acquire the model file suitable for the system where the loader is located according to the address recorded in the courseware configuration file after the courseware configuration file is obtained, and then the model file (such as the FBX file or the AssetBundle file) and the resource content information and the resource associated information recorded in the courseware configuration file are loaded to obtain the VR courseware. The FBX file can be used for loading a three-dimensional model in a web browser, the AssetBundle file can be used for loading the three-dimensional model at a PC end or an Android end, and the three-dimensional model used by VR courseware and other resources can be respectively obtained by different systems according to the same configuration file. Meanwhile, the model file is independently stored, so that the model file and the courseware configuration file can be independently stored, the access authority of a user to the model file and other resources is provided, and the reusability of the model file and other resources is improved.

In another embodiment of the foregoing application, after the resource data, the resource content information recorded in the courseware configuration file, and the resource association information are loaded to obtain the virtual reality courseware, the method further includes:

a teacher triggers a control instruction when adjusting virtual reality courseware;

the teacher end sends a control instruction to the student end;

and the student end adjusts the local virtual reality courseware according to the received control instruction so as to enable the virtual reality courseware of the student end to be synchronous with the teacher end.

According to the embodiment, the courseware of the student side can be controlled by the teacher side through the control instruction to be synchronized in the teaching process, and the real-time performance is improved.

after the teacher end loads the virtual reality courseware, the teacher end displays a model relation tree contained in the virtual reality courseware;

when the teacher selects the target model in the model relation tree, the teacher sends the selected target model identification to the student;

and the student end identifies the real target model according to the received target model.

In the embodiment, the teacher end has a model selection function in virtual reality courseware, the teacher can quickly find the target model through the model relation tree, and the student end displays the target model according to the target model identification sent by the teacher end, so that the model switching operation of the student end and the model switching operation of the teacher end are synchronous, and the real-time performance is improved.

Other effects of the above-described alternative will be described below with reference to specific embodiments.

Drawings

The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:

FIG. 1 is a schematic diagram according to a first embodiment of the present application;

FIG. 2 is a schematic diagram according to a second embodiment of the present application;

FIG. 3 is a schematic illustration according to a third embodiment of the present application;

FIG. 4 is a schematic illustration according to a fourth embodiment of the present application;

FIG. 5 is a block diagram of an electronic device for implementing a method of processing virtual reality courseware according to an embodiment of the present application;

fig. 6 is a scene diagram of a processing scheme of a virtual reality courseware in which an embodiment of the application may be implemented.

Detailed Description

The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

Example one

Fig. 1 is a schematic diagram of a processing method for virtual reality courseware according to a first embodiment of the present invention, where the method is applied to a VR courseware loading process, and may be executed by a device for editing VR visible courseware or loading VR courseware, and the method includes:

step 101, determining a virtual reality VR courseware according to the editing operation of a user on resources.

The user may be a user, such as a teacher, editing virtual reality VR courseware. The teacher can import resource data in the VR courseware editing tool, and VR courseware is formed through editing operation on the resource data.

The imported resource data comprises three-dimensional model files, panoramas, animations and the like. The three-dimensional model file may be an FBX file, or an AssetBundle file for Unity. The panoramic image and the animation can be pictures which are not contained in the three-dimensional model file. A user can import a three-dimensional model through the three-dimensional model file and edit the three-dimensional model, such as editing each part in the three-dimensional model. The user may also add labels or panels, etc. to the three-dimensional model or components of the three-dimensional model to achieve the interpretation of the three-dimensional model. The user can also import a plurality of three-dimensional models through a plurality of different three-dimensional model files, and establish the relationship, the display sequence and the like among the plurality of three-dimensional models. The user may also add panoramas and/or animations, etc. to the imported three-dimensional model. The specific editing mode is determined by the courseware requirement of the user. The courseware editing tool can provide a visual VR courseware editing function for the user to obtain VR courseware.

And 102, generating a courseware configuration file of the virtual reality courseware.

The courseware configuration file comprises resource content information, resource addresses and resource association information contained in the virtual reality courseware.

After the VR courseware is obtained in step 110, the resource data contained in the VR courseware and the relationship between the resource data are edited. At this point, resource content information, resource address, and resource association information may be determined.

The resource content information is used for describing various resources contained in the VR courseware. The resource address is used for recording the storage address of each resource contained in the VR courseware. A server can be configured in the network test for storing resource data contained in VR courseware, and the resource address is used for recording the storage address of each resource in the server. According to the embodiment of the application, the network measurement server can store resources such as the three-dimensional model, the panoramic image and the video, the resources cannot be displayed to the user in the prior art, and then the user cannot generate the VR courseware based on the resources. According to the resource management method and device, the resources are provided for the user in a resource pool mode, so that the user can perform secondary editing and the like of VR courseware based on the resource data, the existing resources such as three-dimensional models, panoramas and videos are fully utilized, and the resource data can be reused in multiple VR courseware.

The resource data comprise three-dimensional model files, panoramas, animations and the like. For example, the resource addresses include a web-side resource address storing an FBX file and a PC-side or Android-side resource address storing an AssetBundle file. The resource association information is used for recording association relations among resources contained in the VR courseware, for example, relations established by the three-dimensional models, and the relations include parent-child relations, parallel relations, and the like.

Illustratively, the courseware profile includes: version number, courseware name, courseware description, and resource array. Each resource array is used for describing information of one resource, and if N resources exist in the VR courseware, N resource arrays can be generated.

In one implementation, the resource array includes: 1) naming the resource data; 2) the resource ID is an identifier configured for the resource data when the user adds the resource data in the courseware editing tool; 3) the resource type can be a three-dimensional model, a picture, a panoramic image or animation and the like; 4) the guidance description is used for providing the introduction of resource data for the student, for example, if the resource is a heart model, the case recorded in the guidance description is a word indicating that the model is the heart model, and the like; 5) loading information, wherein the loading information is used for describing a display position, a display angle, a scaling ratio and the like of the three-dimensional model when the VR courseware is displayed initially, and 6) resource addresses are used for storing three-dimensional model files running on different platforms, such as a storage address of an FBX file or a storage address of an Assetplay file; 7) the thumbnail storage address is used for displaying the thumbnail of the model in the UI; 8) the parent-child field indicates that the current resource is a main node if the parent-child field is null, and indicates that the non-null value is the identifier of the parent node of the current resource if the parent-child field is a non-null value; 9) the incidence relation model field is used for representing a model which is parallel to the current resource; for example, the heart model and the cross-plane model of the heart are in a parallel relationship with each other, i.e., a non-parent-child relationship; 10) splitting animation identification ID, wherein the splitting animation can be read from a model configuration file, and is used for representing the animation of the three-dimensional model splitting process, such as the expansion of an explosion diagram; 11) the animation array of the model can be read from the model configuration file, and the animation array of the model comprises a plurality of fragment animations in the model delay process; 12) the three-dimensional model playing mode is used for describing the playing sequence of the three-dimensional model, and can be configured into a circulation mode of one-way word playing (such as playing from beginning to end or playing from end to end) or single-item multiple times (such as circularly playing from beginning to end) or multiple-way multiple times (such as circularly playing from end to end and then from end to end); 13) the animation introduction case is used for providing introduction information of the animation for the students; 14) an introduction panel for presenting an explanation of the model or animation by means of a panel; 15) resource hotspot information, wherein the resource hotspot information is used for representing the jump relationship between the models; when the VR courseware is edited, the resources have a tree structure, and the resource hotspots are used for representing a source model and a target model of the jump; when the user skips based on the resource hot spot, a popup window can be popped up to prompt the user to confirm the skip, and the user skips the model after confirming; 16) the hot spot label comprises a text panel and a lead wire of the text panel, and is used for recording the positions, rotation, characters, styles and the like of the text panel and the lead wire; 17) the introduction panel is used for introducing the model and can be configured to manually display the introduction panel or automatically display the introduction panel; 18) highlighting the hot spots, such as the colors, the flashing times, the flashing intervals and the like of the hot spots, and highlighting the models executed by the teachers during teaching; 19) the guiding information is used for pointing to one area of the model, the position and the style of the tail end of the guiding line can be configured, and if a student cannot observe a certain model during teaching, the student can be prompted through the guiding line, and the position of the model taught by the teacher can be prompted; 20) the menu is also called popup window or popup menu.

Wherein 14) the text information in the introduction panel can be converted into voice data and sent to the teacher end or the student end in an off-line mode. When loading VR courseware, the problem that the voice data brought by network speed is blocked can be avoided, and reliability is improved.

In the above example, the resource content information includes: the system comprises 1) resource data naming, 2) resource identification, 3) resource types, 4) guide description, 5) loading information, 7) thumbnail storage addresses, 10) split animation identification IDs, 11) animation arrays of models, 12) three-dimensional model playing modes, 13) animation introduction schemes, 14) introduction panels, 15) resource hotspot information, 16) hotspot tags, 17) introduction panels, 18) highlight forms of hotspots, 19) guide information and 20) menus which are also called popup windows.

The resource address includes: 7) thumbnail storage address in the resource array.

The resource association information includes: 8) parent-child field, 9) association model field.

The user can edit VR courseware in the courseware configuration file, optionally, the courseware configuration file is graphical through a graphical interface, user operation is simplified, operation difficulty is reduced, and the like.

And 103, if the virtual reality VR courseware loading is triggered, loading a courseware configuration file by the loader, and acquiring resource data according to a resource address recorded in the courseware configuration file.

Before giving lessons, the teacher end initiates lesson preparation instructions to the student end, and at the moment, virtual reality VR courseware can be triggered and loaded. And the teacher end and the student end respectively load VR courseware. And when loading VR courseware, loading the courseware configuration file by using a loader. The loader comprises software tools such as SDK and the like, and after the courseware configuration file is loaded through the loader, the resource address in the courseware configuration file is obtained, and the resource data is obtained from the server. The resource data includes a three-dimensional model file (FBX file or AssetBundle file), a panorama, animation, or the like.

And step 104, loading the resource data, the resource content information recorded by the courseware configuration file and the resource association information to obtain the virtual reality courseware.

And after the loader acquires resource data such as an executable three-dimensional model file, loading the VR courseware according to resource content information and resource associated information which are not available in resource configuration.

According to the processing method of the virtual reality courseware, the courseware configuration file describes the content of the resources such as the three-dimensional model contained in the VR courseware and the relation among the resources. SDKs run in loaders in different operating systems, the loaders can acquire resources according to resource addresses recorded in loaded courseware configuration files, and then the loaders load the acquired resources according to the resource configuration files to obtain VR courseware. One courseware configuration file can be read by different operating systems, the three-dimensional model and the SDK do not need to be packaged aiming at different operating systems, the decoupling effect of VR courseware and the SDK is achieved, and the editing efficiency of VR courseware is improved.

Example two

Fig. 2 is a schematic diagram of a processing method for virtual reality courseware according to a second embodiment of the present application, and as a further description of the foregoing embodiment, the processing method includes:

step 201, outputting an FBX file according to the three-dimensional model made by the user.

Step 202, export the FBX file as an AssetBundle file.

The FBX file may be exported as an AssetBundle file using a resource export tool. The AssetBundle file can be used as a package of the FBX file, so that the PC end and the android end can operate to obtain a three-dimensional model.

Step 203, generating a resource configuration file of the three-dimensional model according to the sub-resources contained in the three-dimensional model.

The child resources may be animations contained in the three-dimensional model, etc. The resource configuration file is used for recording content information of the three-dimensional model. Illustratively, the resource profile includes: resource name, resource type (such as three-dimensional model, panoramic video or panoramic image and the like), resource description, split animation ID and animation information array. Wherein, the animation information array includes: 1) an animation identification ID; 2) segment names, names named when programming animations, usually in English; 3) animation names, which can be Chinese names, are used for showing students; and the parent-child node is used for marking the parent node of the animation, wherein null indicates that the current animation is an active picture, and if the current animation is a non-null value, the non-null value is the identifier of the parent node.

The resource profile may describe, in addition to content information describing the three-dimensional model, other resource data, such as panoramas, panoramic videos, or animations.

And step 204, in the courseware editing tool, if the user calls the three-dimensional model resource, generating and displaying the three-dimensional model according to the resource configuration file and the AssetBundle file.

When a user edits VR courseware, when a certain three-dimensional model is imported, the resource configuration file of the three-dimensional model can be read, the sub-resources recorded by the resource configuration file are obtained, and the three-dimensional model is obtained by loading based on the sub-resources.

And step 205, determining the virtual reality courseware according to the editing operation of the user on the three-dimensional model and other resource data.

Wherein the other resources comprise at least one of the following resources: three-dimensional models, panoramas, or videos

And step 206, determining the virtual reality courseware according to the editing operation of the user on the resources.

And step 207, generating a courseware configuration file of the virtual reality courseware.

And 208, if the virtual reality VR courseware loading is triggered, loading a courseware configuration file by the loader, and acquiring resource data according to the resource address recorded in the courseware configuration file.

And step 209, loading the resource data, the resource content information recorded by the courseware configuration file and the resource association information to obtain the virtual reality courseware.

According to the processing method of the virtual reality courseware, the three-dimensional model is described by using the resource configuration file, and the FBX file is exported to be an AssetBundle file. When the courseware editing tool is used for editing VR courseware, the three-dimensional model can be loaded according to the resource configuration file and the AssetBundle file, so that different platforms (a web platform, an android platform and a PC platform) can use the three-dimensional model according to the resource configuration file, and the universality of the three-dimensional model file is improved. According to the method and the device, the SDK is updated in the loader, the updated SDK reads the courseware configuration file, the VR courseware is displayed, and the edited VR courseware does not need to be loaded and updated one by one. Because all resource information and interaction information of the VR courseware are recorded in the courseware configuration file, the universal loader and the VR courseware are completely decoupled, and the modification of the loader does not influence the manufactured VR courseware completely. In addition, courseware configuration files can be edited through a visual interface, so that a user without programming ability can write courseware configuration files through dragging and the like, the association relationship between the SDK and courseware materials does not need to be established by changing into sentences, the effects that research and development personnel do not need to participate in the whole process, and the cost and threshold of VR courseware making are remarkably reduced are achieved.

EXAMPLE III

Fig. 3 is a schematic diagram of a processing method for virtual reality courseware according to a third embodiment of the present application, and as a further description of the foregoing embodiment, the processing method includes:

step 301, determining a virtual reality courseware according to the editing operation of the user on the resources.

And step 302, generating a courseware configuration file of the virtual reality courseware.

And 303, if the virtual reality VR courseware loading is triggered, loading a courseware configuration file by the loader, and acquiring resource data according to a resource address recorded in the courseware configuration file.

Step 304, update the loader.

When the version of the loader is updated, the loader is updated. The update of the loader includes an update of the SDK, and the like.

And 305, loading the courseware configuration file by using the updated loader, and acquiring resource data according to the resource address recorded in the courseware configuration file.

In the embodiment of the application, the courseware configuration file describes the content of the VR courseware. After the loader is updated, when the courseware configuration file is loaded, the courseware configuration file does not need to be updated, the coupling detection of the courseware configuration file and the loader is also not needed, the generated VR courseware does not need to be updated, and the cost is reduced.

And step 306, loading the resource data, the resource content information recorded by the courseware configuration file and the resource association information by using the updated loader to obtain the virtual reality courseware.

In the embodiment of the application, the loader comprises software toolkits such as an SDK (software development kit) and the like, when the SDK or other software toolkits are updated, the loader is updated, at the moment, the loader only needs to be updated, and after the loader is updated, the virtual reality courseware can be loaded by loading courseware configuration files. Compared with the existing SDK updating process which needs to be debugged and packaged again, the embodiment only needs to update the loader without changing the courseware configuration file, so that the workload of updating the SDK is greatly reduced, and the updating efficiency is improved.

Example four

Fig. 4 is a schematic view of a virtual reality courseware processing method provided in a fourth embodiment of the present application, and as a further description of the foregoing embodiment, the foregoing method may be applied to virtual reality courseware loading at a teacher end and a student end, where the teacher end uses a web end and the student end uses a PC end or an Android end, and the method includes:

step 401, determining a virtual reality courseware according to the editing operation of the user on the resource.

Step 402, generating courseware configuration files of virtual reality courseware.

And step 403, if the virtual reality VR courseware loading is triggered, a loader used by the teacher end loads courseware configuration files, and FBX files and other resource data are obtained according to web end resource addresses recorded in the courseware configuration files.

The Web end can load the FBX file through a browser. And the FBX cannot be loaded by the PC end and the Android end, so that the teacher end acquires the web end resource address from the courseware configuration file according to the platform attribute of the teacher end and acquires the FBX file according to the web end resource address.

And step 404, a loader used by the student side loads the courseware configuration file, and the AssetBundle file and other resource data are obtained according to the resource address of the PC side or the Android side recorded in the courseware configuration file.

And the student end receives the VR course by using the PC end or receives the VR course by using the Android end. The file type which can be identified by the PC end and the Android end is an AssetBundle file, so that the PC end or the Android end acquires the resource address of the PC end or the Android end from the courseware configuration file according to the type of the PC end or the Android end, and the AssetBundle file is acquired according to the resource address of the PC end or the Android end.

And 405, loading the FBX file, other resource data and resource content information and resource associated information recorded by the courseware configuration file by a loader used by the teacher end to obtain the virtual reality courseware.

And step 406, the loader used by the student end loads the asset fragment file, other resource data, resource content information recorded by the courseware configuration file, and resource association information to obtain the virtual reality courseware.

According to the embodiment of the application, the web resource address for storing the FBX file and the PC or Android resource address of the AssetBundle file can be recorded in the courseware configuration file, the loader can acquire the model file suitable for the system where the loader is located according to the address recorded in the courseware configuration file after the courseware configuration file is obtained, and then the model file (such as the FBX file or the AssetBundle file) and the resource content information and the resource associated information recorded in the courseware configuration file are loaded to obtain the VR courseware. The FBX file can be used for loading a three-dimensional model in a web browser, the AssetBundle file can be used for loading the three-dimensional model at a PC end or an Android end, and the three-dimensional model used by VR courseware and other resources can be respectively obtained by different systems according to the same configuration file. Meanwhile, the model file is independently stored, so that the model file and the courseware configuration file can be independently stored, the access authority of a user to the model file and other resources is provided, and the reusability of the model file and other resources is improved.

Further, after the resource data, the resource content information recorded in the courseware configuration file, and the resource association information are loaded to obtain the virtual reality courseware, the method further includes:

and the teacher triggers a control instruction when adjusting the virtual reality courseware. And the teacher end sends a control instruction to the student end. And the student end adjusts the local virtual reality courseware according to the received control instruction so as to enable the virtual reality courseware of the student end to be synchronous with the teacher end.

After the teacher end and the student end are synchronized, when the teacher end operates the VR courseware, a control instruction corresponding to the operation is synchronously generated, and after the student end receives the control instruction, the student end locally performs the same operation as the teacher end on the VR courseware according to the control instruction. The operations include, but are not limited to, operations such as rotating, moving, scaling, etc. on the model.

In the current VR teaching process, a teacher end can only send exe files of VR courseware to a student end, and VR courseware displayed by the student end cannot be synchronized with the courseware of the teacher end, so that VR teaching efficiency is reduced. According to the embodiment of the application, the courseware of the student side can be controlled by the teacher side through the control instruction to be synchronized in the teaching process, and the real-time performance is improved.

and after the teacher end loads the virtual reality courseware, the teacher end displays the model relation tree contained in the virtual reality courseware. And when the teacher selects the target model in the model relation tree, the teacher sends the selected target model identification to the student. And the student end identifies the real target model according to the received target model.

Besides the teacher side operating the models, the models can be switched based on the model relation tree, and the model relation tree can not be displayed at the student side. At the moment, when the teacher end carries out model jumping according to the model tree, the student end loads the target model represented by the identification according to the received target model identification.

In the embodiment of the application, the teacher end has a model selection function in virtual reality courseware, a teacher can quickly find a target model through a model relation tree, and the student end displays the target model according to a target model identification sent by the teacher end, so that the model switching operation of the student end and the model selection of the teacher end are synchronous, and the real-time performance is improved. In the course of giving lessons, the teacher can enable resources in the PC end or the android end used by the students to execute the same operation as the resources in the web end used by the teacher through the control instruction, synchronization can be achieved through one control instruction, and data transmission efficiency is improved.

EXAMPLE five

Fig. 5 is a schematic structural diagram of a processing apparatus 500 for virtual reality courseware according to a fifth embodiment of the present application, the apparatus is configured to implement the foregoing method, and includes: a virtual reality courseware editing module 501, a courseware configuration file generating module 502, a courseware configuration file loading module 503 and a virtual reality courseware loading module 504, wherein:

a virtual reality courseware editing module 501, configured to determine a virtual reality courseware according to an editing operation of a user on a resource;

a courseware configuration file generating module 502, configured to generate a courseware configuration file of a virtual reality courseware, where the courseware configuration file includes resource content information, resource address, and resource association information included in the virtual reality courseware;

a courseware configuration file loading module 503, configured to load a virtual reality courseware if triggered, and the loader loads a courseware configuration file and obtains resource data according to a resource address recorded in the courseware configuration file;

and the virtual reality courseware loading module 504 is used for loading the resource data, the resource content information recorded by the courseware configuration file and the resource association information to obtain the virtual reality courseware.

In the processing apparatus for virtual reality courseware provided in the embodiment of the application, the virtual reality courseware editing module 501 determines the virtual reality courseware according to the editing operation of the user on the resource; the courseware configuration file generating module 502 generates a courseware configuration file of the virtual reality courseware, and the courseware configuration file comprises resource content information, resource addresses and resource association information contained in the virtual reality courseware; if the virtual reality courseware is triggered to be loaded, a courseware configuration file loading module 503 loads a courseware configuration file by a loader, and resource data is obtained according to a resource address recorded by the courseware configuration file; the virtual reality courseware loading module 504 loads the resource data, the resource content information recorded in the courseware configuration file, and the resource association information to obtain the virtual reality courseware. The courseware configuration file describes the content of resources such as a three-dimensional model contained in the VR courseware and the relation among the resources. SDKs run in loaders in different operating systems, the loaders can acquire resources according to resource addresses recorded in loaded courseware configuration files, and then the loaders load the acquired resources according to the resource configuration files to obtain VR courseware. One courseware configuration file can be read by different operating systems, the three-dimensional model and the SDK do not need to be packaged aiming at different operating systems, the decoupling effect of VR courseware and the SDK is achieved, and the editing efficiency of VR courseware is improved.

Further, the method also comprises the following steps: a resource export module to:

outputting an FBX file according to a three-dimensional model made by a user;

exporting the FBX file as an AssetBundle file;

accordingly, the virtual reality courseware editing module 501 is configured to:

The processing device for the virtual reality courseware provided by the embodiment of the application describes the three-dimensional model by using the resource configuration file, and exports the FBX file as an AssetBundle file. When the courseware editing tool is used for editing VR courseware, the three-dimensional model can be loaded according to the resource configuration file and the AssetBundle file, so that different platforms (a web platform, an android platform and a PC platform) can use the three-dimensional model according to the resource configuration file, and the universality of the three-dimensional model file is improved.

Further, the courseware configuration file loading module 503 is configured to:

updating the loader;

loading a courseware configuration file by using an updated loader, and acquiring resource data according to a resource address recorded by the courseware configuration file;

the virtual reality courseware loading module 504 is configured to:

and loading the resource data, the resource content information recorded by the courseware configuration file and the resource association information by using the updated loader to obtain the virtual reality courseware.

Furthermore, the method is applied to virtual reality courseware loading of a teacher end and a student end, wherein the teacher end uses a web end, and the student end uses a PC end or an Android end;

the courseware configuration file loading module 503 is configured to:

if the virtual reality courseware loading is triggered, a loader used by the teacher end loads courseware configuration files, and FBX files and other resource data are obtained according to web end resource addresses recorded by the courseware configuration files;

if the virtual reality courseware loading is triggered, a loader used by the student end loads a courseware configuration file, and an AssetBundle file and other resource data are obtained according to a PC end or Android end resource address recorded by the courseware configuration file;

accordingly, the virtual reality courseware loading module 504 is configured to:

Further, still include courseware operation synchronization control module, courseware operation synchronization control module is used for:

the teacher end sends a control instruction to the student end;

According to the embodiment of the application, the courseware of the student side can be controlled by the teacher side through the control instruction to be synchronized in the teaching process, and the real-time performance is improved.

Further, the system further comprises a model selection synchronization module, wherein the model selection synchronization module is configured to:

the student end identifies the real target model according to the received target model

In the embodiment of the application, the teacher end has a model selection function in virtual reality courseware, a teacher can quickly find a target model through a model relation tree, and the student end displays the target model according to a target model identification sent by the teacher end, so that the model switching operation of the student end and the model selection of the teacher end are synchronous, and the real-time performance is improved.

EXAMPLE six

According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.

Fig. 6 is a block diagram of an electronic device of a processing method of a virtual reality courseware according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.

As shown in fig. 6, the electronic apparatus includes: one or more processors 601, memory 602, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). In fig. 6, one processor 601 is taken as an example.

The memory 602 is a non-transitory computer readable storage medium as provided herein. The memory stores instructions executable by the at least one processor to cause the at least one processor to perform the method for processing virtual reality courseware provided herein. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to perform the method of processing virtual reality courseware provided herein.

The memory 602, as a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the processing method of virtual reality courseware in the embodiment of the present application (for example, the virtual reality courseware editing module 501, the courseware configuration file generating module 502, the courseware configuration file loading module 503, and the virtual reality courseware loading module 504 shown in fig. 5). The processor 601 executes various functional applications and data processing of the server by running non-transitory software programs, instructions and modules stored in the memory 602, that is, implementing the processing method of the virtual reality courseware in the above method embodiment.

The memory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created from use of the electronic device for processing of virtual reality courseware, and the like. Further, the memory 602 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 602 optionally includes memory located remotely from the processor 601, and these remote memories may be connected over a network to the electronic device of the processing of the virtual reality courseware. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The electronic device of the processing method of the virtual reality courseware may further include: an input device 603 and an output device 604. The processor 601, the memory 602, the input device 603 and the output device 604 may be connected by a bus or other means, and the bus connection is taken as an example in fig. Y.

The input device 603 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device for processing of virtual reality courseware, such as input devices like a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointer stick, one or more mouse buttons, a track ball, a joystick, etc. The output devices 604 may include a display device, auxiliary lighting devices (e.g., LEDs), and tactile feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.

Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

According to the technical scheme of the embodiment of the application, the middle courseware configuration file describes the content of resources such as a three-dimensional model contained in the VR courseware and the relation among the resources. SDKs run in loaders in different operating systems, the loaders can acquire resources according to resource addresses recorded in loaded courseware configuration files, and then the loaders load the acquired resources according to the resource configuration files to obtain VR courseware. One courseware configuration file can be read by different operating systems, the three-dimensional model and the SDK do not need to be packaged aiming at different operating systems, the decoupling effect of VR courseware and the SDK is achieved, and the editing efficiency of VR courseware is improved.

The three-dimensional model is described by using the resource configuration file, the FBX file is exported to the AssetBundle file, when the VR courseware is edited by using the courseware editing tool, the three-dimensional model can be loaded according to the resource configuration file and the AssetBundle file, the three-dimensional model can be used by different platforms (a web platform, an android platform and a PC platform) according to the resource configuration file, and the universality of the three-dimensional model file is improved.

The loader comprises software toolkits such as an SDK (software development kit) and the like, when the SDK or other software toolkits are updated, the loader is updated, at the moment, the loader only needs to be updated, and after the loader is updated, the courseware configuration file is loaded, so that the virtual reality courseware can be loaded. Compared with the existing SDK updating process which needs to be debugged and packaged again, the embodiment only needs to update the loader without changing the courseware configuration file, so that the workload of updating the SDK is greatly reduced, and the updating efficiency is improved.

The method comprises the steps that a web end resource address for storing an FBX file and a PC end or Android end resource address of an AssetBundle file can be recorded in a courseware configuration file, a loader can obtain a model file suitable for a system where the loader is located according to the address recorded in the courseware configuration file after the loader is based on the courseware configuration file, and then the model file (such as the FBX file or the AssetBundle file) and resource content information and resource associated information recorded in the courseware configuration file are loaded to obtain VR courseware. The FBX file can be used for loading a three-dimensional model in a web browser, the AssetBundle file can be used for loading the three-dimensional model at a PC end or an Android end, and the three-dimensional model used by VR courseware and other resources can be respectively obtained by different systems according to the same configuration file. Meanwhile, the model file is independently stored, so that the model file and the courseware configuration file can be independently stored, the access authority of a user to the model file and other resources is provided, and the reusability of the model file and other resources is improved. In the course of teaching, the teacher end controls the courseware of the student end to be synchronized through the control instruction, and the real-time performance is improved. The teacher end has a model selection function in virtual reality courseware, a teacher can quickly find a target model through the model relation tree, and the student end displays the target model according to a target model identification sent by the teacher end, so that model switching operation of the student end and the teacher end is synchronous, and instantaneity is improved.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.

The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A processing method of virtual reality courseware is characterized by comprising the following steps:

if the virtual reality VR courseware loading is triggered, a loader loads a courseware configuration file, and resource data are obtained according to a resource address recorded by the courseware configuration file;

2. The method of processing virtual reality courseware according to claim 1, further comprising, before determining the virtual reality courseware according to the user's editing operation on the resource:

outputting an FBX file according to a three-dimensional model made by a user;

exporting the FBX file as an AssetBundle file;

correspondingly, the determining the virtual reality courseware according to the editing operation of the user on the resources comprises:

in the courseware editing tool, if a user calls a three-dimensional model resource, generating and displaying a three-dimensional model according to the resource configuration file and the AssetBundle file;

determining a virtual reality courseware according to the editing operation of the user on the three-dimensional model and other resource data, wherein the other resources comprise at least one of the following resources: three-dimensional models, panoramas, or videos.

3. The method for processing the virtual reality courseware according to claim 1, wherein the loader loads a courseware configuration file and acquires resource data according to a resource address recorded in the courseware configuration file; loading the resource data, the resource content information recorded by the courseware configuration file and the resource association information to obtain the virtual reality courseware, comprising the following steps:

updating the loader;

4. The method for processing virtual reality courseware according to claim 1, wherein the virtual reality courseware loading is applied to a teacher end and a student end, the teacher end uses a web end, and the student end uses a PC end or an Android end;

correspondingly, the loading of the courseware configuration file by the loader and the acquisition of resource data according to the resource address recorded in the courseware configuration file include:

a loader used by the teacher end loads courseware configuration files, and FBX files and other resource data are obtained according to web end resource addresses recorded by the courseware configuration files;

the loader used by the student side loads a courseware configuration file, and acquires an AssetBundle file and other resource data according to a resource address of a PC side or an Android side recorded by the courseware configuration file;

correspondingly, the loading the resource data, the resource content information recorded in the courseware configuration file, and the resource association information to obtain the virtual reality courseware includes:

the loader used by the teacher end loads the FBX file, other resource data, resource content information recorded by the courseware configuration file and resource associated information to obtain virtual reality courseware;

and the loader used by the student end loads the AssetBundle file, other resource data, the resource content information recorded by the courseware configuration file and the resource association information to obtain the virtual reality courseware.

5. The method for processing virtual reality courseware according to claim 4, wherein after the resource data, the resource content information recorded in the courseware configuration file and the resource association information are loaded to obtain the virtual reality courseware, the method further comprises:

a teacher triggers a control instruction when adjusting virtual reality courseware at the teacher end;

the teacher end sends a control instruction to the student end;

and the student terminal adjusts the local virtual reality courseware according to the received control instruction so as to synchronize the virtual reality courseware of the student terminal with the teacher terminal.

6. The method for processing virtual reality courseware according to claim 4, wherein after the resource data, the resource content information recorded in the courseware configuration file and the resource association information are loaded to obtain the virtual reality courseware, the method further comprises:

after the virtual reality courseware is loaded by the teacher end, the teacher end displays a model relation tree contained in the virtual reality courseware;

when a teacher selects a target model in the model relation tree, the teacher sends a selected target model identification to the student;

and the student end identifies a real target model according to the received target model.

7. A processing apparatus for virtual reality courseware, comprising:

the virtual reality courseware editing module is used for determining virtual reality courseware according to the editing operation of the user on the resources;

the courseware configuration file generation module is used for generating a courseware configuration file of the virtual reality courseware, and the courseware configuration file comprises resource content information, resource addresses and resource association information contained in the virtual reality courseware;

the courseware configuration file loading module is used for loading a virtual reality courseware if the virtual reality courseware is triggered to be loaded, and acquiring resource data according to a resource address recorded by the courseware configuration file;

and the virtual reality courseware loading module is used for loading the resource data, the resource content information recorded by the courseware configuration file and the resource correlation information to obtain the virtual reality courseware.

8. The processing apparatus of virtual reality courseware of claim 7, further comprising: a resource export module for exporting the data of the resource,

the resource export module is to:

outputting an FBX file according to a three-dimensional model made by a user;

exporting the FBX file as an AssetBundle file;

correspondingly, the virtual reality courseware editing module is used for:

9. The processing apparatus of virtual reality courseware of claim 7, wherein the courseware profile loading module is configured to:

updating the loader;

the virtual reality courseware loading module is used for:

10. The processing device of virtual reality courseware according to claim 7, wherein the virtual reality courseware loading is applied to a teacher end and a student end, the teacher end uses a web end, and the student end uses a PC end or an Android end;

the courseware configuration file loading module is used for:

if the virtual reality courseware is triggered to be loaded, a loader used by the teacher end loads courseware configuration files, and FBX files and other resource data are obtained according to web end resource addresses recorded by the courseware configuration files;

correspondingly, the virtual reality courseware loading module is used for:

11. The processing apparatus of virtual reality courseware of claim 10, further comprising a courseware operation synchronization control module configured to:

the teacher end sends a control instruction to the student end;

12. The processing apparatus of virtual reality courseware of claim 10, further comprising a model selection synchronization module configured to:

13. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-6.

14. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-6.